Professional Documents
Culture Documents
Probability Theory 2
Probability Theory 2
probability function
Definition: Random Variable
A function whose value is a real number determined by
each elements in the sample space is called a random
variable.
𝑋: Ω → ℝ
Example:
1. Consider the experiment of tossing a coin. Let the
random variable X denote the number of heads. What are
the values of X?
𝐸𝑥 = 𝑥𝑓 𝑥 𝑑𝑥
−∞
if X is continuous with probability function 𝑓𝑥 𝑥
iii.) Cumulative Density Function
∞ 0
𝐸𝑥 = 1 − 𝐹𝑥 𝑥 𝑑𝑥 − 𝐹𝑥 𝑥 𝑑𝑥
0 −∞
for an arbitrary random variable X
Example:
1. Consider the experiment of tossing two dice. Let X
denote the total of unturned faces of the dice and Y
their absolute difference. Find the mean of X and Y.
2. Let X be a continuous random variable with probability
density function
𝑓 𝑥 = 𝜆𝑒 −𝜆𝑥 , 𝑥 𝜖 [0, ∞)
Find 𝐸[𝑥]
3. Let X be a random variable of cumulative distribution
function given by
𝐹 𝑥 = 1 − 𝑝𝑒 −𝜆𝑥 𝑜𝑛 [0, ∞)
Find 𝐸[𝑥]
4. Let X be a random variable with probability function
given by 𝑓𝑥 𝑥 = 𝑥 −2 𝑜𝑛 [1, ∞)
Find 𝐸[𝑥]
VARIANCE
The variance of a random variable X will be a measure of
the spread or dispersion of the density of X.
𝑣𝑎𝑟 𝑋 = (𝑥 − 𝜇𝑥 )2 𝑓𝑥 𝑥 𝑑𝑥
−∞
If X is continuous with probability density function 𝑓𝑥 𝑥 .
iii.)
∞
𝑣𝑎𝑟 𝑋 = 2𝑥 1 − 𝐹𝑥 𝑥 + 𝐹𝑥 −𝑥 𝑑𝑥 − 𝜇𝑥2
0
where X is a random variable with cdf 𝐹𝑥.
(i) 𝐸 𝑐 = 𝑐
(ii) 𝐸 𝑐𝑔(𝑋) = 𝑐𝐸[𝑔 𝑋 ]
(iii) 𝐸 𝑐1 𝑔1 𝑋 + 𝑐2 𝑔2 (𝑋) = 𝑐1 𝐸 𝑔1 𝑋 + 𝑐2 𝐸[𝑔2 𝑋 ]
(iv) 𝐸 𝑔1 𝑋 ] ≤ 𝐸[𝑔2 (𝑋) 𝑖𝑓 𝑔1 𝑥 ≤ 𝑔2 𝑥 , ∀𝑥.
Theorem 2
If 𝑋 is a random variable,
2
𝑣𝑎𝑟 𝑋 = 𝐸 𝑋 − 𝐸 𝑋 = 𝐸 𝑋 2 − (𝐸 𝑋 )2
𝑥 1−𝑥
𝑓𝑥 𝑥 = 𝑓𝑥 𝑥, 𝑝 = 𝑝 1 − 𝑝 𝑓𝑜𝑟 𝑥 = 0,1
0 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒
𝐸 𝑋 =𝑝
𝑣𝑎𝑟 𝑋 = 𝑝𝑞
𝑚𝑥 𝑡 = 𝑝𝑒 𝑡 + 𝑞
A random experiment whose outcomes has been classified
into two categories, called success and failure, is called a
Bernoulli trial.
p = probability of a success
q = 1 - p = probability of failure
Example 1
Toss a coin once. Success when it is a head, failure when it is a
tail. This is a Bernoulli experiment.
Binomial Distribution
𝐸 𝑋 = 𝑛𝑝
var 𝑋 = 𝑛𝑝𝑞
𝑚𝑥 𝑡 = 𝑞 + 𝑝𝑒 𝑡 𝑛
.
Example 2
Toss a coin 5 times. Success represents a head coming out.
This is a binomial experiment. What is p?
Example 3
Toss a die 3 times. Getting a 5 is a success. This is a binomial
experiment. What is p?
Hypergeometric Distribution
A random variable X is defined to have a hypergeometric
distribution if the discrete probability function of X is given by
𝒌 𝑵−𝒌
𝒙 𝒏−𝒙
𝒇𝑿 𝒙; 𝑵, 𝒌, 𝒏 = 𝑵 , 𝒇𝒐𝒓 𝒙 = 𝟎, 𝟏, … , 𝒏
𝒏
and 0 otherwise, where N is a positive integer, k is a
nonnegative integer that is at most N, and 𝑛 is a positive
integer that is at most N.
Any distribution function defined by the density function
given above is called a hypergeometric distribution.
Theorem 4
If X is a random variable with a hypergeometric
distribution then,
𝑘
𝐸𝑋 = 𝑛.
𝑁
and
𝑘 𝑁−𝑘 𝑁−𝑛
𝑣𝑎𝑟 𝑋 = 𝑛. 𝑁 . 𝑁 . 𝑁−1 .
Criteria for a Hypergeometric Probability
Experiment
1. The finite population to be sampled has N elements.
2. For each trial of the experiment, there are two outcomes,
success or failure. There are exactly k successes in the
population.
3. A sample of size 𝑛 is obtained from the population of size N
without replacement.
If a probability experiment satisfies these three requirements,
the random variable X, the number of successes in 𝑛 trials of the
experiment, follows the hypergeometric probability function.
Example 1
Suppose a researcher goes to a small college of 100 faculty, 12 of
which have blood type O-negative. She obtains a simple random
sample of 𝑛 = 20 students of the faculty. Let the random variable
X represent the number of faculty in the sample of size 𝑛 = 20
that have blood type O-negative.
(a) What is the probability that 3 of the faculty have blood type O-
negative?
(b) What is the probability that at least one of the faculty has
blood type O-negative?
n=20, N=100, k=12, x=3
12 88
3 17
𝑎. ) 𝑃 𝑋 = 3 = 100
20
= .0833
𝑏. ) 𝑃 𝑋 ≥ 1 = 1 − 𝑃[𝑥 < 1]
= 1 − 𝑃[𝑋 = 0]
= 1 − 0.05734
= .9426
Poisson Distribution
The Poisson distribution is the discrete probability
distributions for the counts of events that occur randomly in
a given interval of time (or space)
Solution
Note that the events occur randomly.
Mean rate 𝜆 = 1.8
−1.8 1.8 4
𝑃 𝑋=4 =𝑒 4!
= .0723
2. What is the probability of observing more than or equal
2 births in a given hour at the hospital?
Solution:
𝑃 𝑋 ≥ 2 = 1 − 𝑃 𝑋 = 0 − 𝑃 𝑋 = 1 = .537
Example 6
Suppose that we know that births in a hospital occur
randomly at an average rate of 1.8 births per hour. What is
the probability that we observe 5 births in a given 2-hour
interval?
Solution
If births occur randomly at a rate of 1.8 births per 1 hour
interval, then births occur randomly at a rate of 3.6 births per
2 hour interval.
Let 𝑌 = number of births in a 2-hour period
Then
3.6 5
𝑃 𝑌 = 5 = 𝑒 −3.6 5!
= 0.13768
Example 7
Suppose that the average number of telephone calls arriving
at the switchboard of a small corporation is 30 calls per hour.
i.) What is the probability that no calls will arrive in a 3-
minute interval?
ii.) What is the probability that more than five calls will arrive
in a 5-minute interval?
Solution:
Assuming that the number of calls arriving during any time period
has a Poisson distribution.
i.) 30 calls/hour ↔ 30/60 calls/minute. That is, 0.5 calls/minute
So in a 3-minute interval, there are on the average,
(0.5)(3)=1.5 calls/3-minute interval.
Let 𝑌= no. of calls/3-minute interval. Then 𝜆𝑌 = 1.5
and
1.5 0
𝑃 𝑌 = 0 = 𝑒 −1.5 0!
= 𝑒 −1.5 ≈ 0.22313
ii.) Let Z be the number of calls arriving in a 5-minute interval.
Then
𝜆𝑍 = 0.5 5 = 2.5
Hence,
𝑃 𝑍 >5 =1−𝑃 𝑍 ≤5
2.5 𝑥
5 −2.5
=1− 𝑥=0 𝑒 𝑥!
−2.5
=1−𝑒 (1 + 2.5 + 3.125 + 2.6041 + 1.6276 + 0.81)
≈ .042338