Discrete Probability
The triple
- The sample set
is a non-empty set. (where is the power set of ) is the set of events (or -algebra of events), meaning: - (i)
- (ii) If
, then (closed under countable unions) - (iii) If
, then (closed under complements)
- (i)
- The probability
is a function such that: - (i)
(the probability of the entire sample space is 1) - (ii) If
are pairwise disjoint (i.e., for all ), then
- (i)
This means the probability of the union of countably many pairwise disjoint sets is the sum of their individual probabilities.
Simple probability formula
When we have finitely many possible outcomes and we may assume that they are equiprobable, probability is calculated as follows:
Independence (intersection of two independent events)
Events
The events
Conditional Probability
For
Given that
If
Law of Total Probability
For an event
Bayes' Theorem
For an event
Inclusion-Exclusion Formula
For
Example for two events
Example for three events
Example 1
Problem
In a country the number plates are labelled by five digit numbers from 00000 to 99999. We randomly pick one number plate. What is the probability of the event that
a) there's a six among digits on the plate?
b) the digits on the plate are different?
Solution
a)
b)
Example 2
Problem
At a soccer training session 20 players participate, two of them are Simon and Garfunkel. We divide the participants randomly into two groups of 10 persons. What is the probability that Simon and Garfunkel play against each other?
Solution
Let us fix the team of Simon. There are 9 spaces left in it, while there are 19 spots left altogether. So for Garfunkel 10 out of the 19 choices result in being in a different team than Simon.
Example 3
Peter fires at a target with his gun. The first shot has a 60% chance of hitting the target, the second one has 70%, and the last one has 80%. The shots are independent. What is the probability of the following events:
a) Peter not hitting the target?
b) Peter hits the target only at the third shot?
c) Does not hit that target at all, given that the first shot was a miss?
Solution
a) A, B, C: hitting the target for the first, second, third shot. Notice that if certain events are independent, then we get independent events if we replace any of the events with its complement.
b)
c)
Example 4
Problem
Odesseus arrives at a junction while wandering on the road. One leads to Athens, one to Sparta and one to Mycenae. The athenians tell the truth every third time when asked, the mycanaeans every second time, while the spartans never lie. Odesseus does not know which way leads to which city so he chooses randomly. Arriving in the city he asks a person the question: How much is 2 × 2. The answer is 4. What is the probability that he is in Athens?
Solution
T : the answer is true; A: Athens; M : Mycenae. S: Sparta
By using Bayes's theorem for the partition A.M.S and the event T we obtain that
Example 5
Problem
There is a disease which affects 2% of the population. There is a blood test which is positive with probability 95% for people who have the disease, and it is positive with probability 1% for healthy people.
a) What is the probability that Peter's test will be positive? (Peter is a randomly chosen person.)
b) Given that the test of Peter is positive, what is the conditional probability that he has the disease?
c) Now suppose that the test was repeated
Solution
a) Let
Remark: If we repeat the test
The values: 2.8% for
b) We apply Bayes' theorem with the above notation. The probability of
c) Similarly, by using independence of the tests:
For
Example 6
Problem
(Monty Hall problem) In a television show there are 3 doors, such that there is a present behind one of them, and there is nothing behind the other two. The participant of the game chooses one of the doors. Then, the presenter opens one of the other doors, and shows that there is nothing behind it. Then he asks the participant whether he would like to stay with his original choice, or he would like to chose the other door which has not been opened yet. Is it worth changing?
https://randomservices.org/random/apps/MontyHall.html
Solution
It is worth changing.
First strategy: the player does not change his initial choice. He wins if and only if he has chosen the door with the present in the beginning. which has probability 1/3. Second strategy: the player changes his initial choice. Notice that if he had chosen an empty door in the beginning, then he would win for sure: among the two other doors, the empty was chosen. and he has chosen the other one. In the other case, if he had chosen the door with the present in the beginning, then he will find an empty door after changing.
Let A be the event that the player wins, and B be the event that he had chosen the door with the present in the beginning. Then
