Welcome to our lesson on "Probability Basics"! This topic is important for making predictions and understanding uncertainties in machine learning. By the end of this lesson, you'll know the essentials of probability and how to calculate probabilities for different events using Python.
Let's begin by understanding what probability is and why it matters.
What is Probability?
Probability measures the likelihood of an event happening. Think of it as quantifying uncertainty. For example, what are the chances it will rain tomorrow, or that a flipped coin will land on heads?
Mathematically, the probability P of an event E happening can be represented as:
P(E)=Total number of possible outcomesNumber of favorable outcomes
Probability ranges from 0 (an impossible event) to 1 (a certain event).
Let's use a deck of playing cards to understand probabilities practically. A standard deck has 52 cards. We'll calculate the probability of different events using these cards.
Probability of Drawing a Specific Card
Probability of Drawing a Card of a Specific Suit
Join the 1M+ learners on CodeSignal
Be a part of our community of 1M+ users who develop and demonstrate their skills on CodeSignal
Imagine we want to calculate the probability of drawing an Ace from a standard deck.
Example:P(Ace)=Total cardsNumber of Aces=524
In Python:
Python
# Total number of cards in a standard decktotal_cards = 52# Number of Aces in a standard deckaces = 4# Probability of drawing an Ace from a standard deckprobability_of_ace = aces / total_cardsprint(f"Probability of drawing an Ace: {probability_of_ace:.2f}") # Probability of drawing an Ace: 0.08
In the print function, .2f is a format specifier that limits the displayed output to 2 decimal places.
Next, let's calculate the probability of drawing a card from the Hearts suit.
Example:P(Hearts)=Total cardsNumber of Hearts=5213
In Python:
Python
# Total number of cards in a standard decktotal_cards = 52# Number of cards from the Hearts suit in a standard deckcards_of_suit = 13# Probability of drawing a card from the Hearts suitprobability_of_suit = cards_of_suit / total_cardsprint(f"Probability of drawing a card from the Hearts suit: {probability_of_suit:.2f}") # Probability of drawing a card from the Hearts suit: 0.25
Probability Addition Rule (Mutually Exclusive Events)
Probability Addition Rule (Non-Mutually Exclusive Events)
Probability Multiplication Rule (Independent Events)
Probability Multiplication Rule (Dependent Events)
Lesson Summary
Great job! Today we covered the basics of probability, including how to calculate probabilities for different events. We explored different types of events: mutually exclusive, non-mutually exclusive, independent, and dependent events to understand their probabilities.
By now, you should be comfortable with the basic probability concepts and calculations.
Next, you will move to a practice session where you will apply these concepts and solidify your understanding. Let's move on to practice!
This rule states that the probability of one of two mutually exclusive events happening is the sum of their individual probabilities.
Mutually exclusive events are events that cannot happen at the same time. In the context of drawing cards, drawing an Ace and a King are mutually exclusive because you can't draw both at the same time from a single draw.
For example, the probability of drawing either an Ace or a King:
P(Ace or King)=P(Ace)+P(King)
In Python:
Python
# Total number of cards in a standard decktotal_cards = 52# Number of Aces in a standard deckaces = 4# Number of Kings in a standard deckkings = 4# Probability of drawing an Aceprobability_of_ace = aces / total_cards# Probability of drawing a Kingprobability_of_king = kings / total_cards# Probability of drawing an Ace or a King (mutually exclusive)probability_of_ace_or_king = probability_of_ace + probability_of_kingprint(f"Probability of drawing an Ace or a King (mutually exclusive): {probability_of_ace_or_king:.2f}") # Probability of drawing an Ace or a King (mutually exclusive): 0.15
When two events are not mutually exclusive, they can happen at the same time. In this case, we need to subtract the probability of both events happening from the sum of their individual probabilities to avoid double-counting.
For example, consider the probability of drawing a card that is either an Ace or a Heart. Since the Ace of Hearts fits both categories, it needs to be subtracted once.
P(Ace or Heart)=P(Ace)+P(Heart)−P(Ace of Hearts)
In Python:
Python
# Total number of cards in a standard decktotal_cards = 52# Number of Aces in a standard deckaces = 4# Number of Hearts in a standard deckhearts = 13# Number of Ace of Hearts in a standard deckace_of_hearts = 1# Probability of drawing an Aceprobability_of_ace = aces / total_cards# Probability of drawing a Heartprobability_of_heart = hearts / total_cards# Probability of drawing an Ace of Heartsprobability_of_ace_of_hearts = ace_of_hearts / total_cards# Probability of drawing an Ace or a Heart (non-mutually exclusive)probability_of_ace_or_heart = probability_of_ace + probability_of_heart - probability_of_ace_of_heartsprint(f"Probability of drawing an Ace or a Heart (non-mutually exclusive): {probability_of_ace_or_heart:.2f}") # Probability of drawing an Ace or a Heart (non-mutually exclusive): 0.31
The next rule applies to independent events, like drawing cards with replacement. Drawing with replacement means that after drawing a card, you place it back in the deck before drawing again. This ensures that the total number of cards remains the same for each draw.
The probability of both events happening is the product of their individual probabilities. For example, here is how we can calculate the probability of drawing a King and and Ace from two draws, given that we put the first card back and shuffle before the second draw.
Example:P(Ace and then King with replacement)=P(Ace)×P(King)
In Python:
Python
# Total number of cards in a standard decktotal_cards = 52# Number of Aces in a standard deckaces = 4# Number of Kings in a standard deckkings = 4# Probability of drawing an Aceprobability_of_ace = aces / total_cards# Probability of drawing a Kingprobability_of_king = kings / total_cards# Probability of drawing an Ace and then drawing a King with replacementprobability_of_ace_and_king = probability_of_ace * probability_of_kingprint(f"Probability of drawing an Ace and then a King (independent, with replacement): {probability_of_ace_and_king:.4f}") # Probability of drawing an Ace and then a King (independent, with replacement): 0.0059
When events are dependent, like drawing cards without replacement, the probability changes after the first event.
Example:
If you draw an Ace first, there are now 51 cards left in the deck, and only 4 of them are Kings. So, the probability of drawing a King is no longer 524, it is now 514
P(Ace and then King without replacement)=P(Ace)×P(King | Ace drawn)
Here, P(King | Ace drawn) represents the conditional probability, i.e., the probability of drawing a King given that an Ace has already been drawn.
P(King | Ace drawn)=Total cards - 1Number of Kings=514
Therefore,
P(Ace and then King without replacement)=524×514
In Python:
# Total number of cards in a standard decktotal_cards = 52# Number of Aces in a standard deckaces = 4# Number of Kings in a standard deckkings = 4# Probability of drawing an Aceprobability_of_ace = aces / total_cards# Probability of drawing a King given an Ace has been drawnprobability_of_king_given_ace_drawn = kings / (total_cards - 1)# Probability of drawing an Ace and then drawing a King without replacementprobability_of_ace_and_king_no_replace = probability_of_ace * probability_of_king_given_ace_drawnprint(f"Probability of drawing an Ace and then a King (dependent, without replacement): {probability_of_ace_and_king_no_replace:.4f}") # Probability of drawing an Ace and then a King (dependent, without replacement): 0.0060
Python
# Total number of cards in a standard decktotal_cards = 52# Number of Aces in a standard deckaces = 4# Number of Kings in a standard deckkings = 4# Probability of drawing an Aceprobability_of_ace = aces / total_cards# Probability of drawing a King given an Ace has been drawnprobability_of_king_given_ace_drawn = kings / (total_cards - 1)# Probability of drawing an Ace and then drawing a King without replacementprobability_of_ace_and_king_no_replace = probability_of_ace * probability_of_king_given_ace_drawnprint(f"Probability of drawing an Ace and then a King (dependent, without replacement): {probability_of_ace_and_king_no_replace:.4f}") # Probability of drawing an Ace and then a King (dependent, without replacement): 0.0060
