Download as pdf or txt
Download as pdf or txt
You are on page 1of 16

MATH-361

Probability and Statistics

Lecture 23

MLE
Confidence Intervals

A/P Kamran Aziz Bhatti | Assistant Professor | Dept. of Electrical Engg. | NUST College of Electrical & Mechanical Engineering | Pakistan
Confidence Intervals

• An interval estimate is an interval (“confidence interval”)


obtained from a sample data set
• Confidence intervals1 for an unknown parameter 𝜃 of some
distribution (e.g. 𝜃 = 𝜇) are intervals 𝜃1 ≤ 𝜃 ≤ 𝜃2 that contain
𝜃, not with certainty but with a high probability 𝛾
• Usually 𝛾 is taken as 0.95 or 0.99
• Probability of 0.95 or 95% means there 1 of 20 intervals will not
contain actual 𝜃 (on the average)
• More formally, we usually write

2
Confidence Intervals

• 𝛾 is called the confidence level


• 𝜃1 and 𝜃2 are called the lower and upper confidence limits
• Confidence level and interval length are inter-related
• The larger we choose 𝛾, the longer is the confidence interval
• If 𝛾 → 1, interval length goes to infinity
• Decision of the selection of 𝛾 depends on application

• The Basic Idea: Consider 𝜃1 and 𝜃2 (which are function of the


observations 𝑥1 , 𝑥2 , … , 𝑥𝑛 ) as the observed values of two
random variables Θ1 and Θ2 , so the condition becomes

3
Confidence Intervals

4
Confidence Intervals

5
Confidence Intervals

6
Confidence Intervals

7
Confidence Intervals

8
Confidence Intervals

9
Confidence Intervals

10
Confidence Intervals

11
Confidence Intervals

12
Confidence Intervals

13
Confidence Intervals

14
Confidence Intervals

15
Confidence Intervals

16

You might also like