Professional Documents
Culture Documents
Chapter 6: Probability: 6.1 Set Theory and Venn Diagrams
Chapter 6: Probability: 6.1 Set Theory and Venn Diagrams
Chapter 6: Probability: 6.1 Set Theory and Venn Diagrams
CHAPTER 6: PROBABILITY
37
CHAPTER 6 PROBABILITY
6.3 Definitions
Before formally defining probability, we need to define some underlying concepts and
terms.
An experiment is a process which may be repeated many times and which results in
the occurrence of one of a set of distinct possible outcomes every time it is repeated. Each
time it is repeated is called a trial of the experiment. For example, a simple experiment is to
observe whether it rains each day: each day is a trial of the experiment and the possible
outcomes are just “rain” and “no rain”. Another simple experiment is to toss a coin: the two
possible outcomes are that a crest or an animal faces upwards.
Outcomes are descriptions of the possible results of a trial of the experiment in the
simplest possible terms. One usually tries to define the outcomes of an experiment in such a
way that they are equally likely to occur. For example, for the experiment of rolling a six-
sided die (whose faces are numbered 1, 2, 3, 4, 5 and 6), the possible outcomes are 1, 2, 3, 4,
5 and 6. If the die is symmetric and balanced, the outcomes 1, 2, 3, 4, 5 and 6 would be
equally likely; if it is biased or unbalanced (loaded) then these outcomes would not be
equally likely.
An event is a set of possible outcomes; if, on a trial of the experiment, one of the
outcomes in the set occurs, then the event is said to have occurred. The outcomes in the set,
ie. the outcomes corresponding to the event, are said to be “favourable to the event”.
Example 6.3.1: For the experiment of rolling a die, some events are: (A) number rolled
is even; (B) number rolled is greater than 3; (C) number rolled is 4. The outcomes
favourable to A are 2, 4 and 6; the outcomes favourable to B are 4, 5 and 6; the only
outcome favourable to C is 4.
There are two ways of defining probability: empirically and theoretically. To define
probability empirically, we consider a series of historical repetitions of the experiment and
we define the probability of an event as the relative frequency with which the event
occurred, ie. the proportion of trials of the experiment which resulted in the event occurring.
For example, if we collect data over ten years showing on how many days it rained and on
38
CHAPTER 6 PROBABILITY
how many days it did not rain, then we may estimate the probability that it will rain on any
particular day as
(Number of rainy days)/(Total number of days) = 2,190/3,652 = 0.6
We define probability theoretically as follows. If an experiment has n distinct
possible outcomes which are equally likely, the probability than an event X occurs on any
given trial of the experiment is
Pr[ X ] = Number of outcomes favourable to X
n
Example 6.3.2: Suppose that two dice are rolled. Let (f, s) represent the outcome that
the first die shows “f” and the second die shows “s”, eg. (1, 6) represents the
outcome that the first die shows 1 and the second shows 6. How many possible
outcomes described in this way are there? Are they equally likely?
There are 36 (= 6*6) possible outcomes described in this way. Assuming that the dice are
fair (ie. balanced, or unbiased), the 36 outcomes are equally likely and the probability of each
such outcome is 1/36.
Example 6.3.3: If two fair dice are rolled and the total (T) is calculated, what is the
probability that T is equal to 4?
If we define outcomes as in Example 6.3.2, there are 36 of them and they are equally likely.
The outcomes that are favourable to the event that T is 4 are (2, 2), (3, 1) and (1, 3). Hence
Pr[ T = 4 ] = Number of favourable outcomes / Total number of outcomes
= 3 / 36 = 1 / 12 = 0.0833
It should be noticed that it is quite possible to define outcomes of an experiment in
such a way that they are not equally likely.
Example 6.3.4: Consider the same experiment as in Example 6.3.2 but let [a, b]
represent the outcome that the dice show “a” and “b” in any order, eg. [1, 6]
represents the outcome that one of the dice shows 1 and the other shows 6. How
many possible outcomes described in this way are there? Are they equally likely?
If a and b are different, each outcome described as [a, b] corresponds to two of the outcomes
described as in Example 6.3.2. Thus, for example, [2, 5] corresponds to (5, 2) and (2, 5).
However, if a and b are the same, the outcome [a, b] corresponds to only one of the outcomes
described as in Example 6.3.2. Thus, for example, [2, 2] corresponds to (2, 2) only. There
are six outcomes described as (f, s), where f and s are the same, and they correspond to the
six outcomes described as [a, b], where a and b are the same. There are 30 outcomes
described as (f, s), where f and s are different, and they correspond in pairs to the outcomes
described as [a, b]. Thus, there are 21 (= 6 + 15) outcomes described as [a, b].
Where a and b are different,
Pr[ [a, b] ] = Pr[ (a, b) or (b, a) ] = 2 / 36
However, Pr[ [a, a] ] = Pr[ (a, a) ] = 1 / 36.
Thus, for example, Pr[ [4, 1] ] = 2 / 36 but Pr[ [4, 4] ] = 1 / 36, so the outcomes described
as [a, b] are not equally likely. As a result they cannot generally be used in the theoretical
definition of probability given above in order to calculate probabilities of events defined for
39
CHAPTER 6 PROBABILITY
the experiment. This definition applies only where a complete set of outcomes has been
defined in such a way that all the outcomes are equally likely.
The phrase “at random” is often used to convey the idea that each possible outcome
is equally likely to occur. If three students are selected “at random” from a class, that means
that, when each student is selected, every student is equally likely to be selected. It also
means that every possible sample of size 3 has the same chance of being the selected sample.
When using the symbolic expression Pr[ X ], it is important to bear in mind that
Pr[ X ] is a number (which may be manipulated just like a pronumeral) and that X is not a
number but an event, ie. something which may or may not happen. For example, for the
experiment of tossing a die, we may write “Pr[ 3 ]” as a form of shorthand, but it does not
mean “the probability of 3” - it means “the probability that 3 appears on the die”.
40
CHAPTER 6 PROBABILITY
“exclusive” meaning. Thus “either X or Y occurs” means “X occurs or Y occurs but not
both”, so the “exclusive or” excludes the case of both X and Y occurring. When “or” is used
without “either”, it is understood to be “inclusive”. Thus “X or Y occurs” means “X occurs
or Y occurs or both occur”, so “or” by itself includes the case of both X and Y occurring.
Similarly “X or Y or Z or … occurs” means that any positive number of these events (at least
one) occurs, but “either X or Y or Z or … occurs” means that exactly one of these events
occurs.
Example 6.5.2: For the experiment of tossing a
die, the following events are defined.
U = [Even number appears];
V = [Number appears that is greater than 2];
W = [1 appears];
Z = [5 appears].
The union of the sets representing U and V, ie. the set {2, 3, 4, 5, 6}, represents the
compound event that “U or V occurs”: the outcomes 2, 4 and 6 are favourable to U and the
outcomes 3, 4, 5 and 6 are favourable to V. On any trial of the experiment, if the outcome is
2, then only U has occurred; if the outcome is 3 or 5, then only V has occurred; if it is 4 or 6,
then both U and V have occurred.
The intersection of the sets representing U and V, ie. the set {4, 6}, represents the
compound event that “U and V occur”: the outcomes 4 and 6 are favourable to U and to V.
On any trial of the experiment, if the outcome is 4 or 6, then both U and V have occurred.
The area outside of both the sets representing U and V, ie. the set {1}, represents the
compound event that “neither U nor V occurs”: the outcome 1 is not favourable to U and it is
not favourable to V. On any trial of the experiment, if the outcome is 1, then U has not
occurred and V has not occurred.
The event that “either U or V occurs”, ie. “exactly one of the events U and V has
occurred”, is representing by the set {2, 3, 5}. On any trial of the experiment, if the outcome
is 2, then U has occurred but V has not; if the outcome is 3 or 5, then V has occurred but U
has not.
The complement of an event, A, is the event that happens whenever A does not
happen, and vice versa (ie. it is the “opposite” of A). It is often denoted by A .
Example 6.5.3: When tossing a die, if A is the event that 1 or 2 appears, then A is the
event that 3, 4, 5 or 6 appears.
41
CHAPTER 6 PROBABILITY
Example 6.7.1: A card is drawn at random from a pack. What is the probability that it
is a picture card (A) and a heart (B)?
Pr[ Picture card and heart ] = Pr[ A and B ]
= Pr[ A/B ]*Pr[ B ]
= Pr[ Picture card/Heart ]*Pr[ Heart ]
= (3/13)(13/52), since each card is equally
likely to be drawn.
= 3/52 (or 0.058 or 5.8 %)
43
CHAPTER 6 PROBABILITY
44
CHAPTER 6 PROBABILITY
In the same way, this proof may be extended to cover any number of mutually exclusive
events.
45
CHAPTER 6 PROBABILITY
46
CHAPTER 6 PROBABILITY
47
CHAPTER 6 PROBABILITY
Tutorial exercises
1. In a survey of 180 motorists, 24 said that they had had a driving accident in the first
two years after getting their driving licences. Use this information to find the
empirical probability that a motorist who has just received his licence will have an
accident within the next two years.
3. Each letter of the alphabet is written on a separate card and the 26 cards are placed in
a bag. One card is drawn at random and the letter on the card is noted. Determine
which of the following two events is more likely to happen: (i) the letter is a vowel;
(ii) the letter is in the word “cross”.
4. A university shop has kept records of its customers. Over a month it found that it had
served 3,245 male students, 643 female students, 548 male staff, 435 female staff,
1,253 other males and 2,256 other females. By using this information and calculating
empirical probabilities, determine which of the following two events is more likely to
happen: (i) the next customer is a female; (ii) the next customer is a male student.
6. A bag contains 24 marbles. Of these 6 are red, 5 green, 4 blue, 3 white, and the
remainder multi-coloured. You select one marble at random from the bag.
(a) What is the probability that it is multi-coloured?
(b) What is the probability that it is red?
(c) Suppose that you keep drawing until you get one that is a single colour. What is the
probability that it is red?
(d) Given that the marble selected is not red, blue or white, what is the probability that it
is multi-coloured?
48
CHAPTER 6 PROBABILITY
8. Alan, Betty and Carol are applying for three different jobs in a company. The
probability that Alan gets his job is 0.5; the probability that Betty gets her job is 0.75;
the probability that Carol gets her job is 0.3. What is the probability that jobs will be
obtained by:
(a) None of them? (e) Two of them?
(b) Only one of them? (f) At least two of them?
(c) At least one of them? (g) At most two of them?
(d) At most one of them? (h) All three of them?
9. Three cards are drawn at random from a pack of playing cards. Calculate the
probability of the following events occurring.
(a) All three cards are hearts.
(b) All three cards are of the same suit.
(c) Two cards are hearts and one is a spade.
49