Professional Documents
Culture Documents
Tutorial Stat 322 PDF
Tutorial Stat 322 PDF
Q1.19)
Grade point average. The director of admissions of a small college selected 120 students at random from the new freshman class in a study
to determine whether a student's grade point average (OPA) at the end of the freshman year (Y) can be predicted from the ACT test score
(X). The results of the study follow. Assume that first-order regression model (1.1) is appropriate.
a. Obtain the least squares estimates of 𝜷𝟎 and 𝜷𝟏 , and state the estimated regression function.
b. Plot the estimated regression function and the data."Does the estimated regression function appear to fit the data well?
c. Obtain a point estimate of the mean freshman OPA for students with ACT test score X = 30.
d. What is the point estimate of the change in the mean response when the entrance test score increases by one point?
Solution:
𝑋̅ = 24.725, 𝑌̅ = 3.07405
𝑛=120
1
𝑌̂ = 2.114 + 0.0388 𝑋
At X=30
Q1.20)
Copier maintenance. The Tri-City Office Equipment Corporation sells an imported copier on a franchise basis and performs preventive
maintenance and repair service on this copier. The data below have been collected from 45 recent calls on users to perform routine
preventive maintenance service; for each call, X is the number of copiers serviced and Y is the total number of minutes spent by the service
person. Assume that first-order regression model (1.1) is appropriate.
)(مصنع يعمل على الصنعة الوقائية
X هو عدد الناسخات الخدمات
Y هو العدد اإلجمالي للدقائق التي يقضيها الشخص الخدمة.
Solution:
𝑋̅ = 5.11111, 𝑌̅ = 76.26667
2
𝑛=120
̂0 = 𝑌̅ − 𝑏1 𝑋̅ = −0.58016
𝑏0 = 𝛽
𝑌̂ = −0.58016 + 15.03525 𝑋
At X=5
Q1.21) (H.W)
Airfreight breakage. A substance used in biological and medical research is shipped by airfreight to users in cartons of 1,000 ampules.
The data below, involving 10 shipments, were collected on the number of times the carton was transferred from one aircraft to another
over the shipment route (X) and the number of ampules found to be broken upon arrival (Y). Assume that first-order regression model
(1.1) is appropriate.
3
a. Obtain the estimated regression function. Plot the estimated regression function and the data. Does a linear regression function appear
to give a good fit here?
b. Obtain a point estimate of the expected number of broken ampules when X = 1 transfer is made.
c. Estimate the increase in the expected number of ampules broken when there are 2 transfers as compared to 1 transfer.
̅, 𝒀
d. Verify that your fitted regression line goes through the point (𝑿 ̅ ).
Q1.22)
Plastic hardness. Refer to Problems 1.3 and 1.14. Sixteen batches of the plastic were made, and from each batch one test item was molded.
Each test item was randomly assigned to one of the four predetermined time levels, and the hardness was measured after the assigned
elapsed time. The results are shown below; X is the elapsed time in hours? and Y is hardness in Brinell units. Assume that first-order
regression model (1.1) is appropria'te.
a. Obtain the estimated regression function. Plot the estimated regression function and the data. Does a linear regression function appear
to give a good fit here?
b. Obtain a point estimate of the mean hardness when X = 40 hours.
c. Obtain a point estimate of the change in mean hardness when X increases by 1 hour.
Solution:
𝑋̅ = 28, 𝑌̅ = 225.5625
𝑛=120
4
𝑛=120
̂0 = 𝑌̅ − 𝑏1 𝑋̅ = 168.6
𝑏0 = 𝛽
𝑌̂ = 168.6 + 2.034375 𝑋
At X=40
∑ 𝑒𝑖2 = 3416.377
∑ 𝑒𝑖2 = 𝑄
∑ 𝑒𝑖2 3416.377
̂2 =
𝜎 = = 79.45063 = 𝑀𝑆𝐸
𝑛−2 43
𝜎 = √𝑀𝑆𝐸 = √79.45063
5
Q1.25) (H.W) Refer to Airfreight breakage Problem 1.21.
a. Obtain the residual for the first case. What is its relation to 𝒆𝟏 ?
b. Compute ∑ 𝒆𝟐𝒊 and MSE. What is estimated by MSE?
a. Obtain the estimated regression function. Plot the estimated regression function and the data. Does a linear regression function appear to give a
good fit here?
𝑌̂ = 10.2 + 4.0𝑋
b. Obtain a point estimate of the expected number of broken ampules when X = 1 transfer is made.
If X=1
Then
𝑌̂ℎ = 10.2 + 4.0(1) = 14.20
c. Estimate the increase in the expected number of ampules broken when there are 2 transfers as compared to 1 transfer.
𝑌̂ℎ2 = 10.2 + 4.0(2) = 18.20
̂
𝑌ℎ1 = 10.2 + 4.0(1) = 14.20
𝑌̂ ̂
ℎ2 − 𝑌ℎ1 = 𝑏1 = 4.0
d. Verify that your fitted regression line goes through the point (𝑋̅, 𝑌̅).
𝑋̅ = 1, 𝑌̅ = 14.2
(𝑋̅, 𝑌̅) = (1, 14.2)
6
If X=1
Then
𝑌̂ℎ = 10.2 + 4.0(1) = 14.20
Then we can say the regression line goes through the point (𝑋̅, 𝑌̅) = (1, 14.2)
7
Chapter 2
We assume that the normal error regression model is applicable. This model is:
𝑌𝑖 = 𝛽0 + 𝛽1 𝑋𝑖 + 𝜀𝑖
where:
𝛽0 and 𝛽1, are parameters
𝑋𝑖 are known constants
𝜀𝑖 are independent 𝑁 (0, 𝜎 2 )
𝐸(𝑌𝑖 ) = 𝛽0 + 𝛽1 𝑋𝑖
̂𝟏
Sampling Distribution of 𝜷
𝑛
(𝑋𝑖 − 𝑋̅)(𝑌𝑖 − 𝑌̅)
̂1 = 𝑏1 = ∑
𝛽
∑𝑛𝑖=1(𝑋𝑖 − 𝑋̅)2
𝑖=1
̂1 ) = 𝛽1
𝐸(𝛽
𝜎2
̂1 ) =
𝜎 2 (𝛽
∑𝑛𝑖=1(𝑋𝑖 − 𝑋̅)2
𝑀𝑆𝐸
̂1 ) =
𝑠 2 (𝛽
∑𝑛𝑖=1(𝑋𝑖 − 𝑋̅)2
𝑏1 − 𝛽1
~𝑡(𝑛−2)
𝑠(𝑏1 )
Confidence Interval for 𝜷𝟏
8
C.I (1 − 𝛼)% for 𝛽1
𝑏1 − 𝑡(1−𝛼,𝑛−2) 𝑠(𝑏1 ) ≤ 𝛽1 ≤ 𝑏1 + 𝑡(1−𝛼/2,𝑛−2) 𝑠(𝑏1 )
2
Tests Concerning 𝜷𝟏
1. Hypothesis
𝐻0 : 𝛽1 = 𝛽10 𝐻0 : 𝛽1 = 𝛽10 𝐻0 : 𝛽1 = 𝛽10
𝐻1 : 𝛽1 ≠ 𝛽10 𝐻1 : 𝛽1 > 𝛽10 𝐻1 : 𝛽1 < 𝛽10
2. Test statistic
𝑏1 − 𝛽10
𝑇0 =
𝑠(𝑏1 )
3. Decision: Reject 𝐻0 if
|𝑇0 | > 𝑡(1−𝛼,𝑛−2) 𝑇0 > 𝑡(1−𝛼,𝑛−2) 𝑇0 < 𝑡(𝛼,𝑛−2)
2
P-value: Reject 𝐻0 if 𝑝 − 𝑣𝑎𝑙𝑢𝑒 < 𝛼
p-value=2𝑃(𝑡(𝑛−2) > |𝑇0 |) 𝑝 − 𝑣𝑎𝑙𝑢𝑒 = 𝑃(𝑡(𝑛−2) > 𝑇0 ) 𝑝 − 𝑣𝑎𝑙𝑢𝑒 = 𝑃(𝑡(𝑛−2) < 𝑇0 )
Page 114
Q2.4. Refer to Grade point average Problem 1.19.
a. Obtain a 99 percent confidence interval for 𝛃𝟏 . Interpret your confidence interval. Does it include zero? Why might the director of
admissions be interested in whether the confidence interval includes zero?
Solution:
By using Minitab:
𝑆𝑡𝑎𝑡 → 𝑅𝑒𝑔𝑟𝑒𝑠𝑠𝑖𝑜𝑛 → 𝑅𝑒𝑔𝑟𝑒𝑠𝑠𝑖𝑜𝑛 → 𝐹𝑖𝑡 𝑅𝑒𝑔𝑟𝑒𝑠𝑠𝑖𝑜𝑛 𝑀𝑜𝑑𝑒
9
10
Regression Analysis: Yi versus Xi
Analysis of Variance
11
Pure Error 99 39.332 79.61% 39.332 0.3973
Total 119 49.405 100.00%
Model Summary
Coefficients
Regression Equation
Yi = 2.114 + 0.0388 Xi
0.0054 ≤ 𝛽1 ≤ 0.0723
12
𝛼 = 0.01
1. Hypothesis
𝐻0 : 𝛽1 = 0
𝐻1 : 𝛽1 ≠ 0
2. Test statistic
𝑏1 − 𝛽10 𝑏1 0.0388
𝑇0 = = = = 3.04
𝑠(𝑏1 ) 𝑠(𝑏1 ) 0.0128
3. Decision: Reject 𝐻0 if |𝑇0 | > 𝑡(1−𝛼,𝑛−2) , 3.04 > 𝑡(0.995,118) = 1.70943
2
Then reject 𝐻0
c. What is the P-value of your test in part (b)? How does it support the conclusion reached in part (b)?
p-value= 0.003<0.01, then we reject 𝐻0 .
13
Q2.5. Refer to Copier maintenance Problem 1.20.
𝑛=45 45 45 45
a. Estimate the change in the mean service time when the number of copiers serviced increases by one. Use a 90 percent confidence interval.
Interpret your confidence interval.
90% C.I for 𝛽1: 𝑏1 − 𝑡(1−𝛼,𝑛−2) 𝑠(𝑏1 ) ≤ 𝛽1 ≤ 𝑏1 + 𝑡(1−𝛼/2,𝑛−2) 𝑠(𝑏1 )
2
𝛼 = 1 − 0.9 = 0.1
𝑛 𝑛
(𝑋𝑖 − 𝑋̅)(𝑌𝑖 − 𝑌̅) (𝑋𝑖 𝑌𝑖 − 𝑋̅𝑌𝑖 − 𝑋𝑖 𝑌̅ + 𝑋̅𝑌̅) ∑𝑛𝑖=1 𝑋𝑖 𝑌𝑖 − 𝑛𝑋̅𝑌̅ 22660 − 45 ∗ 5.1111 ∗ 76.2667
𝑏1 = ∑ 𝑛 =∑ 𝑛 = 𝑛 = = 15.035
∑𝑖=1(𝑋𝑖 − 𝑋̅)2 ∑𝑖=1(𝑋𝑖 2 − 2𝑋̅𝑋𝑖 + 𝑋̅ 2 ) ∑𝑖=1 𝑋𝑖 2 − 𝑛𝑋̅ 2 1516 − 45 ∗ 5.11112
𝑖=1 𝑖=1
2 (𝑏 )
𝑀𝑆𝐸 3416.377/(45 − 2)
𝑠 1 = 𝑛 = = 0.23337
∑𝑖=1(𝑋𝑖 − 𝑋̅)2 1516 − 45 ∗ 5.11112
b. Conduct a t test to determine whether or not there is a linear association between X and Y here; control the 𝜶 a risk at 0.01. State the
alternatives, decision rule, and conclusion. What is the P-value of your test?
𝛼 = 0.01
1. Hypothesis
14
𝐻0 : 𝛽1 = 0
𝐻1 : 𝛽1 ≠ 0
2. Test statistic
𝑏1 − 𝛽10 𝑏1 15.035
𝑇0 = = = = 31.123
𝑠(𝑏1 ) 𝑠(𝑏1 ) 0.48308
3. Decision: Reject 𝐻0 if |𝑇0 | > 𝑡(1−𝛼,𝑛−2) , 31.123 > 𝑡(0.995,43) = 2.695
2
Then reject 𝐻0
p-value=2𝑃(𝑡(𝑛−2) > |𝑇0 |) = 2 (1 − 𝑃(𝑡(𝑛−2) < 31.123)) = 2(1 − 1)
0.00 < 0.01, then we reject 𝐻0 .
d. The manufacturer has suggested that the mean required time should not increase by more than 14 minutes for each additional copier
that is serviced on a service call. Conduct a test to decide whether this standard is being satisfied by Tri-City. Control the risk of a Type I
error at 0.05. State the alternatives, decision rule, and conclusion. What is the P-value of the test?
𝛼 = 0.05
1. Hypothesis
𝐻0 : 𝛽1 ≤ 14
𝐻1 : 𝛽1 > 14
2. Test statistic
𝑏1 − 𝛽10 𝑏1 − 14 15.035 − 14
𝑇0 = = = = 2.143
𝑠(𝑏1 ) 𝑠(𝑏1 ) 0.48308
3. Decision: Reject 𝐻0 if 𝑇0 > 𝑡(1−𝛼,𝑛−2) , 2.143 > 𝑡(0.95,43) = 1.861
Then reject 𝐻0
p-value=𝑃(𝑡(𝑛−2) > 𝑇0 ) = (1 − 𝑃(𝑡(𝑛−2) < 2.143)) = (1 − 0.981) = 0.019 < 0.05
, then we reject 𝐻0 .
15
Q2.6. Refer to Airfreight breakage Problem 1.21.
𝑋̅ = 1, 𝑌̅ = 14.2, ∑𝑛=10 ̅ ̅
𝑖=1 (𝑋𝑖 − 𝑋 ) (𝑌𝑖 − 𝑌) = 40
∑10 ̅ 2
𝑖=1(𝑋𝑖 − 𝑋 ) = 10, 𝑀𝑆𝐸 = 2.2
𝛼 = 1 − 0.95 = 0.05
𝑛=120
(𝑋𝑖 − 𝑋̅)(𝑌𝑖 − 𝑌̅)
̂1 = ∑
𝑏1 = 𝛽 =4
∑𝑛=120 ̅ 2
𝑖=1 (𝑋𝑖 − 𝑋 )
𝑖=1
𝑀𝑆𝐸 2.2
𝑠 2 (𝑏1 ) = = = 0.22
∑𝑛𝑖=1(𝑋𝑖 − 𝑋̅)2 10
b. Conduct a t test to decide whether or not there is a linear association between number of times a carton is transferred (X) and number
of broken ampules (Y). Use a level of significance of 0.05. State the alternatives, decision rule, and conclusion. What is the P-value of the
test?
𝛼 = 0.05
16
1. Hypothesis
𝐻0 : 𝛽1 = 0
𝐻1 : 𝛽1 ≠ 0
2. Test statistic
𝑏1 − 𝛽10 𝑏1 4
𝑇0 = = = = 8.528
𝑠(𝑏1 ) 𝑠(𝑏1 ) 0.469
3. Decision: Reject 𝐻0 if |𝑇0 | > 𝑡(1−𝛼,𝑛−2) , 8.528 > 𝑡(0.975,8) = 2.308
2
Then reject 𝐻0
p-value=2𝑃(𝑡(𝑛−2) > |𝑇0 |) = 2 (1 − 𝑃(𝑡(8) < 8.528)) = 2(1 − 0.9999)
0.0002 < 0.05, then we reject 𝐻0 .
Analysis of Variance
Model Summary
Coefficients
17
Term Coef SE Coef 95% CI T-Value P-Value VIF
Constant 10.200 0.663 (8.670, 11.730) 15.38 0.000
Xi 4.000 0.469 (2.918, 5.082) 8.53 0.000 1.00
Regression Equation
Yi = 10.200 + 4.000 Xi
H.W:
Q2.7 Refer to Plastic hardness Problem 1.22.
a. Estimate the change in the mean hardness when the elapsed time increases by one hour. Use a 99 percent confidence interval. Interpret
your interval estimate.
b. The plastic manufacturer has stated that the mean hardness should increase by 2 Brinell units per hour. Conduct a two-sided test to
decide whether this standard is being satisfied; use 𝜶 = 𝟎. 𝟎𝟏. State the alternatives, decision rule, and conclusion. What is the P-value of
the test?
18
Chapter 2
We assume that the normal error regression model is applicable. This model is:
𝑌𝑖 = 𝛽0 + 𝛽1 𝑋𝑖 + 𝜀𝑖
where:
𝛽0 and 𝛽1, are parameters
𝑋𝑖 are known constants
𝜀𝑖 are independent 𝑁 (0, 𝜎 2 )
𝐸(𝑌𝑖 ) = 𝛽0 + 𝛽1 𝑋𝑖
̂𝟏
Sampling Distribution of 𝜷
𝑛
(𝑋𝑖 − 𝑋̅)(𝑌𝑖 − 𝑌̅)
̂1 = 𝑏1 = ∑
𝛽
∑𝑛𝑖=1(𝑋𝑖 − 𝑋̅)2
𝑖=1
̂1 ) = 𝛽1
𝐸(𝛽
𝜎2
̂1 ) =
𝜎 2 (𝛽
∑𝑛𝑖=1(𝑋𝑖 − 𝑋̅)2
𝑀𝑆𝐸
̂1 ) =
𝑠 2 (𝛽
∑𝑛𝑖=1(𝑋𝑖 − 𝑋̅)2
19
𝑏1 − 𝛽1
~𝑡(𝑛−2)
𝑠(𝑏1 )
Confidence Interval for 𝜷𝟏
Tests Concerning 𝜷𝟏
1. Hypothesis
𝐻0 : 𝛽1 = 𝛽10 𝐻0 : 𝛽1 = 𝛽10 𝐻0 : 𝛽1 = 𝛽10
𝐻1 : 𝛽1 ≠ 𝛽10 𝐻1 : 𝛽1 > 𝛽10 𝐻1 : 𝛽1 < 𝛽10
2. Test statistic
𝑏1 − 𝛽10
𝑇0 =
𝑠(𝑏1 )
3. Decision: Reject 𝐻0 if
|𝑇0 | > 𝑡(1−𝛼,𝑛−2) 𝑇0 > 𝑡(1−𝛼,𝑛−2) 𝑇0 < 𝑡(𝛼,𝑛−2)
2
P-value: Reject 𝐻0 if 𝑝 − 𝑣𝑎𝑙𝑢𝑒 < 𝛼
p-value=2𝑃(𝑡(𝑛−2) > |𝑇0 |) p-value= 𝑃(𝑡(𝑛−2) > 𝑇0 ) 𝑝 − 𝑣𝑎𝑙𝑢𝑒 = 𝑃(𝑡(𝑛−2) < 𝑇0 )
̂𝟎
Sampling Distribution of 𝜷
̂0 = 𝑏0 = 𝑌̅ − 𝑏1 𝑋̅
𝛽
20
̂0 ) = 𝛽0
𝐸(𝛽
1 𝑋̅ 2
̂0 ) = 𝜎 2 ( +
𝜎 2 (𝛽 )
𝑛 ∑𝑛𝑖=1(𝑋𝑖 − 𝑋̅)2
1 𝑋̅ 2
̂0 ) = 𝑀𝑆𝐸 ( +
𝑠 2 (𝛽 )
𝑛 ∑𝑛𝑖=1(𝑋𝑖 − 𝑋̅)2
𝑏0 − 𝛽0
~𝑡(𝑛−2)
𝑠(𝑏0 )
Confidence Interval for 𝜷𝟏
21
Tests Concerning 𝜷𝟏
1. Hypothesis
𝐻0 : 𝛽0 = 𝛽00 𝐻0 : 𝛽0 = 𝛽00 𝐻0 : 𝛽1 = 𝛽00
𝐻1 : 𝛽0 ≠ 𝛽00 𝐻1 : 𝛽0 > 𝛽00 𝐻1 : 𝛽1 < 𝛽00
2. Test statistic
𝑏0 − 𝛽00
𝑇0 =
𝑠(𝑏0 )
3. Decision: Reject 𝐻0 if
|𝑇0 | > 𝑡(1−𝛼,𝑛−2) 𝑇0 > 𝑡(1−𝛼,𝑛−2) 𝑇0 < 𝑡(𝛼,𝑛−2)
2
P-value: Reject 𝐻0 if 𝑝 − 𝑣𝑎𝑙𝑢𝑒 < 𝛼
p-value=2𝑃(𝑡(𝑛−2) > |𝑇0 |) p-value= 𝑃(𝑡(𝑛−2) > 𝑇0 ) 𝑝 − 𝑣𝑎𝑙𝑢𝑒 = 𝑃(𝑡(𝑛−2) < 𝑇0 )
𝑌ℎ = 𝑏0 + 𝑏1 𝑋ℎ
ANOVA TABLE
22
1. Hypothesis
𝐻0 : 𝛽1 = 0 (Non liner)
𝐻1 : 𝛽1 ≠ 0
2. Test statistic
𝑀𝑆𝑅
𝐹∗ =
𝑀𝑆𝐸
3. Decision: Reject 𝐻0 if
𝐹 > 𝐹(1−𝛼,1,𝑛−2)
𝑏0 = 10.2, 𝑏1 = 4
d) A consultant has suggested, on the basis of previous experience, that the mean number of broken ampules should not exceed 9.0 when no
transfers are made. Conduct an appropriate test, using 𝛼 = 0.025. State the alternatives, decision rule, and conclusion. What is the P-value of the
test?
𝛼 = 0.025
23
1. Hypothesis
𝐻0 : 𝛽0 ≤ 9
𝐻1 : 𝛽0 > 9
2. Test statistic
𝑏0 − 𝛽00 10.2 − 9
𝑇0 = = = 1.809
𝑠(𝑏0 ) 0.6633
1 𝑋̅ 2 1 12
̂0 ) = 𝑀𝑆𝐸 ( +
𝑠 2 (𝛽 ) = 2.2 ( + ) = 0.44
𝑛 ∑𝑛𝑖=1(𝑋𝑖 − 𝑋̅)2 10 10
𝑠(𝑏0 ) = 0.6633
at 𝛼 = 0.05
24
Analysis of Variance
Source DF Seq SS Contribution Adj SS Adj MS F-Value P-Value
Regression 1 160.000 90.09% 160.000 160.000 72.73 0.000
Xi 1 160.000 90.09% 160.000 160.000
Error 8 17.600 9.91% 17.600 2.200
Coefficients
Regression Equation
Yi = 10.200 + 4.000 Xi
25
Q2.25. Refer to Airfreight breakage Problem 1.21.
a. Set up the ANOVA table. Which elements are additive?
b. Conduct an F test to decide whether or not there is a linear association between the number of times a carton is transferred and the
number of broken ampules; control the 𝜶 risk at 0.05. State the alternatives, decision rule, and conclusion.
c. Obtain the t* statistic for the test in part (b) and demonstrate numerically its equivalence to the F* statistic obtained in part (b).
̅ = 𝟏, 𝒀
𝑿 ̅ = 𝟏𝟒. 𝟐, ∑𝒏=𝟏𝟎 ̅ ̅ 𝟏𝟎 ̅ 𝟐
𝒊=𝟏 (𝑿𝒊 − 𝑿) (𝒀𝒊 − 𝒀) = 𝟒𝟎, ∑𝒊=𝟏(𝑿𝒊 − 𝑿) = 𝟏𝟎
𝒏=𝟏𝟎
̅ )𝟐 = 𝟏𝟕𝟕. 𝟔,
∑ (𝒀𝒊 − 𝒀 𝑴𝑺𝑬 = 𝟐. 𝟐, 𝒃𝟎 = 𝟏𝟎. 𝟐, 𝒃𝟏 = 𝟒
𝒊=𝟏
𝑋𝑖 𝑌𝑖 (𝑋𝑖 − 𝑋̅) (𝑌𝑖 − 𝑌̅) (𝑋𝑖 − 𝑋̅)2 (𝑋𝑖 − 𝑋̅) (𝑌𝑖 − 𝑌̅)2 ̂𝑖
𝑌 ̂𝑖 )2
(𝑌𝑖 − 𝑌
∗ (𝑌𝑖 − 𝑌̅)
1 16 0 1.8 0 0 3.24 14.2 3.24
0 9 -1 -5.2 5.2 1 27.04 10.2 1.44
2 17 1 2.8 2.8 1 7.84 18.2 1.44
0 12 -1 -2.2 2.2 1 4.84 10.2 3.24
3 22 2 7.8 15.6 4 60.84 22.2 0.04
1 13 0 -1.2 0 0 1.44 14.2 1.44
0 8 -1 -6.2 6.2 1 38.44 10.2 4.84
1 15 0 0.8 0 0 0.64 14.2 0.64
2 19 1 4.8 4.8 1 23.04 18.2 0.64
0 11 -1 -3.2 3.2 1 10.24 10.2 0.64
10 142 0 0 40 10 177.6 142 17.6
26
̂𝑖 )2 = 17.6
∑(𝑌𝑖 − 𝑌
ANOVA TABLE
𝛼 = 0.05
1. Hypothesis
𝐻0 : 𝛽1 = 0
𝐻1 : 𝛽1 ≠ 0
2. Test statistic
𝐹 ∗ = 72.72
3. Decision: Reject 𝐻0 if 𝐹 ∗ > 𝐹(1−𝛼,1,𝑛−2) , 72.72 > 𝐹(0.95,1,8) = 5.31
Then reject 𝐻0
p-value=𝑃(𝐹(1,𝑛−2) > 𝐹 ∗ ) = (1 − 𝑃(𝐹(1,8) < 72.72)) = (1 − 0.9999) = 0.0001 < 0.05
, then we reject 𝐻0 .
27
Analysis of Variance
Analysis of Variance
28
𝛼 = 0.01
1. Hypothesis
𝐻0 : 𝛽1 = 0
𝐻1 : 𝛽1 ≠ 0
2. Test statistic
𝐹 ∗ = 506.51
3. Decision:
p-value=0.000<0.01
, then we reject 𝐻0 .
29
Prove that
𝑛 𝑛
𝑄 = ∑ 𝜖𝑖 = ∑(𝑌𝑖 − 𝛽0 − 𝛽1 𝑋𝑖 )2
2
𝑖=1 𝑖=1
𝜕𝑄 𝜕𝑄
= 0, =0
𝜕𝛽0 𝜕𝛽1
𝑛
𝜕𝑄
= 2 ∑(𝑌𝑖 − 𝑏0 − 𝑏1 𝑋𝑖 ) (−1) = 0
𝜕𝛽0
𝑖=1
𝑛
∑(𝑌𝑖 − 𝑏0 − 𝑏1 𝑋𝑖 ) = 0
𝑖=1
𝑛 𝑛 𝑛
∑(𝑌𝑖 𝑋𝑖 − 𝑏0 𝑋𝑖 − 𝑏1 𝑋𝑖 2 ) = 0
𝑖=1
30
𝑛 𝑛 𝑛
From 1
𝑌̅ = 𝑏0 + 𝑏1 𝑋̅
𝑏0 = 𝑌̅ − 𝑏1 𝑋̅
𝑛 𝑛 𝑛
31
𝑛 𝑛
𝑛 2 𝑛
(∑ 𝑋𝑖 ) ≠ ∑(𝑋𝑖 2 )
𝑖=1 𝑖=1
𝑛
(𝑋𝑖 − 𝑋̅)(𝑌𝑖 − 𝑌̅) ∑𝑛𝑖=1(𝑋𝑖 − 𝑋̅)(𝑌𝑖 − 𝑌̅)
∑ =
∑𝑛𝑖=1(𝑋𝑖 − 𝑋̅)2 ∑𝑛𝑖=1(𝑋𝑖 − 𝑋̅)2
𝑖=1
𝑛 2 𝑛
∑ 𝑒𝑖 = 0
𝑖=1
𝑛 𝑛 𝑛
̂𝑖 ) = ∑(𝑌𝑖 − 𝑏0 − 𝑏1 𝑋𝑖 )
∑ 𝑒𝑖 = ∑(𝑌𝑖 − 𝑌
𝑖=1 𝑖=1 𝑖=1
𝑛 𝑛 𝑛
32
𝑏0 = 𝑌̅ − 𝑏1 𝑋̅
𝑛 𝑛 𝑛 𝑛 𝑛 𝑛 𝑛
33
𝑛 𝑛
2
∑𝑛𝑖=1(𝑋𝑖 − 𝑋̅)(𝑌𝑖 − 𝑌̅) ∑𝑛𝑖=1(𝑋𝑖 − 𝑋̅)𝑌𝑖 (𝑋𝑖 − 𝑋̅) (𝑋𝑖 − 𝑋̅)
𝑉𝑎𝑟 ( ) = 𝑉𝑎𝑟 ( 𝑛 ) = 𝑉𝑎𝑟 (∑ 𝑛 𝑌) = ∑( 𝑛 ) 𝑉𝑎𝑟(𝑌𝑖 )
∑𝑛𝑖=1(𝑋𝑖 − 𝑋̅)2 ∑𝑖=1(𝑋𝑖 − 𝑋̅)2 ∑𝑖=1(𝑋𝑖 − 𝑋̅)2 𝑖 ∑𝑖=1(𝑋𝑖 − 𝑋̅)2
𝑖=1 𝑖=1
𝑛
̅ )2
(𝑋𝑖 − 𝑋 ∑𝑖=1(𝑋𝑖 − 𝑋̅)
𝑛 2
𝜎 2
=∑ 𝜎2 = 𝜎2 𝑛 =
𝑛 ̅ 2
(∑𝑖=1(𝑋𝑖 − 𝑋) ) 2 (∑𝑖=1(𝑋𝑖 − 𝑋̅)2 )2 ∑𝑛𝑖=1(𝑋𝑖 − 𝑋̅)2
𝑖=1
̂𝑖 ) = 𝑒𝑖
∵ (𝑌𝑖 − 𝑌
𝑛 𝑛 𝑛 𝑛
̂𝑖 )(𝑌
∑(𝑌𝑖 − 𝑌 ̂𝑖 − 𝑌̅) = ∑ 𝑒𝑖 (𝑌
̂𝑖 − 𝑌̅) = ∑ 𝑒𝑖 𝑌
̂𝑖 − 𝑌̅ ∑ 𝑒𝑖
𝑖=1 𝑖=1 𝑖=1 𝑖=1
𝑛 𝑛
̂𝑖 = ∑ 𝑒𝑖 = 0
∵ ∑ 𝑒𝑖 𝑌
𝑖=1 𝑖=1
Then
𝑛
̂𝑖 )(𝑌
∑(𝑌𝑖 − 𝑌 ̂𝑖 − 𝑌̅) = 0
𝑖=1
Then
34
𝑛 𝑛
2 2
̂𝑖 ) + ∑(𝑌
𝑆𝑆𝑇𝑜 = ∑(𝑌𝑖 − 𝑌 ̂𝑖 − 𝑌̅)
𝑖=1 𝑖=1
𝑛 𝑛
2
̂𝑖 − 𝑌̅)2 = 𝑆𝑆𝑅
̂𝑖 ) = 𝑆𝑆𝐸 & ∑(𝑌
∑(𝑌𝑖 − 𝑌
𝑖=1 𝑖=1
35
Chapter 2
2.13 Refer to Grade point average.
Calculate 𝑹𝟐 . What proportion of the variation in Y is accounted for by introducing X into the regression model? From page 98
̅ = 𝟐𝟒. 𝟕𝟐𝟓, ∑𝒏=𝟏𝟐𝟎
𝑿 ̅ 𝟐
𝒊=𝟏 (𝑿𝒊 − 𝑿) = 𝟐𝟑𝟕𝟗. 𝟗𝟐𝟓
Analysis of Variance
Model Summary
𝑆𝑆𝑅 3.588
𝑅2 = = = 0.0726
𝑆𝑆𝑇𝑜 49.405
𝑆𝑆𝐸 45.818
𝑅2 = 1 − = 1− = 1 − 0.9274 = 0.0726
𝑆𝑆𝑇𝑜 49.405
This means that 7.26% of change in the mean freshman OPA for students is by ACT test score
36
a. Obtain a 95 percent interval estimate of the mean freshman OPA for students whose ACT test score is 28. Interpret your confidence interval.
From page 76- to 79
𝑌̂ℎ = 𝑏0 + 𝑏1 𝑋ℎ
1 (𝑋ℎ − 𝑋̅)2
2 ̂
𝑠 (𝑌ℎ ) = 𝑀𝑆𝐸 ( + 𝑛 )
𝑛 ∑𝑖=1(𝑋𝑖 − 𝑋̅)2
𝛼
𝑌̂ℎ ± 𝑡 (1 − ; 𝑛 − 2) 𝑠(𝑌̂ℎ )
2
𝛼
𝛼 = 0.05, = 0.025
2
At 𝑋ℎ = 28
1 (𝑋ℎ − 𝑋̅)2
2 ̂
𝑠 (𝑌ℎ ) = 𝑀𝑆𝐸 ( + 𝑛 )
𝑛 ∑𝑖=1(𝑋𝑖 − 𝑋̅)2
37
b. Mary Jones obtained a score of 28 on the entrance test. Predict her freshman OPA-using a 95 percent prediction interval. Interpret your
prediction interval.
1 (𝑋ℎ − 𝑋̅)2
̂
𝑠 2 (𝑌𝑛𝑒𝑤 ) = 𝑀𝑆𝐸 (1 + + 𝑛 )
𝑛 ∑𝑖=1(𝑋𝑖 − 𝑋̅)2
𝛼
𝑌̂ℎ ± 𝑡 (1 − ̂
; 𝑛 − 2) 𝑠(𝑌𝑛𝑒𝑤 )
2
1 (𝑋ℎ − 𝑋̅)2 1 (28 − 24.725)2
̂
𝑠 2 (𝑌𝑛𝑒𝑤 ) = 𝑀𝑆𝐸 (1 + + 𝑛 ) = 𝟎. 𝟑𝟖𝟖𝟑 (1 + + ) = 0.39328
𝑛 ∑𝑖=1(𝑋𝑖 − 𝑋̅)2 120 2379.925
̂
𝑠(𝑌𝑛𝑒𝑤 ) = 0.6271
3.22012 ± 1.9807(0.6271)
1.9594 < 𝑌ℎ(𝑛𝑒𝑤) < 4.4430
c. Is the prediction interval in part (b) wider than the confidence interval in part (a)? Should it be?
هل فترة الثقة للتنبؤ في الجزء (ب) أوسع من فترة الثقة في الجزء (أ)؟ هل يجب أن تكون؟
Yes, Yes
38
2.15. Refer to Airfreight breakage Problem 1.21.
10
𝑋̅ = 1, ∑(𝑋𝑖 − 𝑋̅)2 = 10
𝑖=1
ANOVA TABLE
a. Because of changes in airline routes, shipments may have to be transferred more frequently than in the past. Estimate the mean breakage for
the following numbers of transfers: X = 2, 4. Use separate 99 percent confidence intervals. Interpret your results.
At 𝑋ℎ = 2
39
𝑌̂ℎ = 10.2 + 4 (4) = 26.2
b. The next shipment will entail two transfers. Obtain a 99 percent prediction interval for the number of broken ampules for this shipment.
Interpret your prediction interval.
1 (𝑋ℎ − 𝑋̅)2 1 (2 − 1)2
̂
𝑠 2 (𝑌𝑛𝑒𝑤 ) = 𝑀𝑆𝐸 (1 + + ) = 𝟐. 𝟐 (1 + + ) = 2.64
𝑛 ∑𝑛𝑖=1(𝑋𝑖 − 𝑋̅)2 10 10
18.2 ± 3.355(1.6248)
40
12.748 < 𝑌ℎ(𝑛𝑒𝑤) < 23.652
With confidence coefficient 0.99, we predict that the mean number of ampules found to be broken upon arrival when 2 transfers from one
aircraft to another over the shipment route of 2 are produced is somewhere between 12.748 and 23.652 ampules.
Boxplot of Xi
40
35
30
Xi
25
20
15
41
𝐺𝑟𝑎𝑝ℎ → 𝐷𝑜𝑡𝑝𝑙𝑜𝑡 → 𝑠𝑖𝑚𝑝𝑙𝑒 → 𝑋 → 𝑜𝑘
Dotplot of Xi
16 20 24 28 32 36 40
Xi
42
𝐺𝑟𝑎𝑝ℎ → 𝑡𝑖𝑚𝑒 𝑠𝑒𝑟𝑖𝑒𝑠 → 𝑠𝑖𝑚𝑝𝑙𝑒 → 𝑋 → 𝑜𝑘
35
30
Xi
25
20
15
2 4 6 8 10 12 14 16
Index
43
For test normality of residuals
𝐺𝑟𝑎𝑝ℎ → 𝑝𝑟𝑜𝑏𝑎𝑏𝑖𝑙𝑖𝑡𝑦 𝑝𝑙𝑜𝑡 → 𝑠𝑖𝑛𝑔𝑙𝑒 → (𝑑𝑖𝑠𝑡𝑟𝑖𝑏𝑢𝑡𝑖𝑜𝑛 𝑁𝑜𝑟𝑚𝑎𝑙) → 𝑋 → 𝑜𝑘
44
Refer to Grade point average.
𝐺𝑟𝑎𝑝ℎ → 𝐵𝑜𝑥𝑝𝑙𝑜𝑡 → 𝑠𝑖𝑚𝑝𝑙𝑒 → 𝑋 → 𝑜𝑘
Boxplot of Xi
35
30
25
Xi
20
15
45
𝐺𝑟𝑎𝑝ℎ → 𝐷𝑜𝑡𝑝𝑙𝑜𝑡 → 𝑠𝑖𝑚𝑝𝑙𝑒 → 𝑋 → 𝑜𝑘
Dotplot of Xi
15 18 21 24 27 30 33
Xi
46
𝐺𝑟𝑎𝑝ℎ → 𝑡𝑖𝑚𝑒 𝑠𝑒𝑟𝑖𝑒𝑠 → 𝑠𝑖𝑚𝑝𝑙𝑒 → 𝑋 → 𝑜𝑘
30
25
Xi
20
15
1 12 24 36 48 60 72 84 96 108 120
Index
47
For test normality of residuals
𝐺𝑟𝑎𝑝ℎ → 𝑝𝑟𝑜𝑏𝑎𝑏𝑖𝑙𝑖𝑡𝑦 𝑝𝑙𝑜𝑡 → 𝑠𝑖𝑛𝑔𝑙𝑒 → (𝑑𝑖𝑠𝑡𝑟𝑖𝑏𝑢𝑡𝑖𝑜𝑛 𝑁𝑜𝑟𝑚𝑎𝑙) → 𝑋 → 𝑜𝑘
48
Chapter 5
Q5.1. For the matrices below, obtain (1) A +B, (2) A - B, (3) AC, (4) AB', (5) B'A.
1 4 1 3
3 8 1
𝐴 = [2 6] 𝐵 = [1 4] 𝐶 = [ ]
5 4 0
3 8 2 5
Solution:
1 4 1 3 1+1 4+3 2 7
𝐴 + 𝐵 = [2 6] + [1 4] = [2 + 1 6 + 4] = [3 10]
3 8 2 5 3+2 8+5 5 13
1 4 1 3 1−1 4−3 0 1
𝐴 − 𝐵 = [2 6] − [1 4] = [2 − 1 6 − 4] = [1 2]
3 8 2 5 3−2 8−5 1 3
1 4
1∗1+1∗2+2∗3 1∗4+1∗6+2∗8
(𝐵′2×3 𝐴3×2 )2×2 = [1 1 2] [2 6] = [ 9 26
]=[ ]
3 4 5 3∗1+4∗2+5∗3 3∗4+4∗6+5∗8 26 76
3 8
49
𝛐
Q5.4. Flavor deterioration. The results shown below were obtained in a small-scale experiment to study the relation between 𝐅 of
storage temperature (X) and number of weeks before flavour deterioration of a food product begins to occur (Y).
i 1 2 3 4 5
𝑿𝒊 8 4 0 -4 -8
𝒀𝒊 7.8 9.0 10.2 11.0 11.7
Assume that first-order regression model (2.1) is applicable. Using matrix methods,
find (𝟏) 𝒀′𝒀, (𝟐) 𝑿′𝑿, (𝟑) 𝑿′𝒀.
𝑽(𝚩) = 𝑀𝑆𝐸(𝑿′𝑿)−𝟏
𝒆′𝒆
𝑀𝑆𝐸 =
𝑛−2
C1 C2 C3
1 8 7.8 1
2 4 9.0 1
3 0 10.2 1
4 -4 11.0 1
5 -8 11.7 1
1 8 7.8
1 4 9.0 1 1 1 1 1
𝑿= 1 0 , 𝒀 = 10.2 , 𝑿′ = [ ]
11.0 8 4 0 −4 −8
1 −4
[1 −8] [11.7]
50
1 8
𝑛 ∑ 𝑋𝑖 1 4
1 1 1 1 1 1+1+1+1+1 8+4+0−4−8
(𝑿′𝑿)𝟐×𝟐 = [ ]=[ ] 1 0 =[ ]
8 4 0 −4 −8 1 −4 8+4+0−4−8 8 ∗ 8 + 4 ∗ 4 + 0 ∗ 0 + −4 ∗ −4 + −8 ∗ −8
∑ 𝑋𝑖 ∑ 𝑋𝑖2
[1 −8]
5 0
=[ ]
0 160
2
−𝟏
𝟏 ∑ 𝑋𝑖 − ∑ 𝑋𝑖
(𝑿′𝑿) = [ ]
∆ −∑𝑋 𝒏
𝑖
𝑌̂ = 9.940 − 0.245𝑋
1 8 9.94 − 0.245 ∗ 8 7.98
1 4 9.94 − 0.245 ∗ 4 8.96
̂ 𝒏×𝟏 = 𝑿𝒏×𝟐 𝚩𝟐×𝟏 = 1 0 [ 9.94 ] = 9.94 − 0.245 ∗ 0 = 9.94
𝒀
1 −4 −0.245 9.94 + 0.245 ∗ 4 10.92
[1 −8] [9.94 + 0.245 ∗ 8] [ 11.9 ]
7.8 7.98 7.8 − 7.98 −0.18
9.0 8.96 9 − 8.96 0.04
𝒆𝒏×𝟏 = 𝒀𝒏×𝟏 − 𝒀̂ 𝒏×𝟏 = 10.2 − 9.94 = 10.2 − 9.94 = 0.26
11.0 10.92 11 − 10.92 0.08
[11.7] [ 11.9 ] [11.7 − 11.9] [ −0.2 ]
51
−0.18
0.04
𝒆′𝟏×𝒏 𝒆𝒏×𝟏 = [∑ 𝑒𝑖2 ] = [−0.18 0.04 0.26 0.08 −0.2 0.26 = [0.148]
]
0.08
[ −0.2 ]
0.148
𝑀𝑆𝐸 = = 0.049333
3
0.2 0 0.009867 0
𝑽(𝚩) = 𝑀𝑆𝐸(𝑿′𝑿)−𝟏 = 0.049333 [ ]=[ ]
0 0.00625 0 0.000308
̂
𝛽 ̂
𝑉𝑎𝑟(𝛽0 ) ̂
𝑐𝑜𝑣(𝛽 ,
0 1
̂
𝛽 )
𝑽 [ 0] = [ ]
̂
𝛽1 ̂ ̂
𝑐𝑜𝑣(𝛽0 , 𝛽1 ) 𝑉𝑎𝑟(𝛽̂1 )
7.8
9.0
𝒀′𝟏×𝒏 𝒀𝒏×𝟏 = [∑ 𝑦𝑖2 ] = [7.8 9.0 10.2 11.0 11.7] 10.2 = [503.77]
11.0
[11.7]
Data Display
Matrix M1
1 8
1 4
1 0 𝑿𝒏×𝟐
1 -4
1 -8
52
Data Display
Matrix M2
1 1 1 1 1
8 4 0 -4 -8 𝑿′𝟐×𝒏
Data Display
𝑛 ∑ 𝑋𝑖
Matrix M3 (𝑿′𝑿)𝟐×𝟐 = [ ]
∑ 𝑋𝑖 ∑ 𝑋𝑖2
5 0
0 160
Data Display
Matrix M4
0.2 0.00000
0.0 0.00625
53
Data Display
Matrix M5
7.8
9.0 𝒀𝒏×𝟏
10.2
11.0
11.7
Data Display
Matrix M6
49.7
-39.2
Data Display
Matrix M7
9.940 𝚩𝟐×𝟏
-0.245
𝑌̂ = 9.940 − 0.245𝑋
54
MTB > tran m5 m13
MTB > print m13
Data Display
Matrix M13
Answer = 503.7700
Data Display
Matrix M8
7.98
8.96
9.94
10.92
11.90
55
MTB > Let c5 = 'y'-C4
Data Display
Matrix M10
Answer = 0.1480
𝒆′𝒆
MSE=0.1480/3=0.049333 𝑴𝑺𝑬 = 𝒏−𝟐
Data Display
Matrix M12
0.0098666 0.0000000
0.0000000 0.0003083
56
̂
𝛽 𝑽𝒂𝒓(𝛽̂0 ) ̂0 , 𝛽
𝒄𝒐𝒗(𝛽 ̂1 )
𝑽 [ 0] = [ ]
̂1
𝛽 ̂0 , 𝛽
𝒄𝒐𝒗(𝛽 ̂1 ) 𝑽𝒂𝒓(𝛽̂1 )
Analysis of Variance
Model Summary
Coefficients
Regression Equation
y = 9.9400 - 0.2450 x
57
H.W
Q5.2 For the matrices below, obtain (1) 𝐴 + 𝐶, (2) 𝐴 − 𝐶, (3) 𝐵′ 𝐴, (4) 𝐴𝐶′, (5) 𝐶′ 𝐴.
2 1 6 3 8
𝐴 = [3 5] 𝐵 = [9] 𝐶 = [8 6]
5 7 3 5 1
4 8 1 2 4
Q5.5 Consumer finance. The data below show, for a consumer finance company operating in six cities, the number of competing loan companies
operating in the city (X) and the number per thousand of the company's loans made in that city that are currently delinquent (Y);
i 1 2 3 4 5 6
𝑋𝑖 4 1 2 3 3 4
𝑌𝑖 16 5 10 15 13 22
Assume that first-order regression model (2.1) is applicable. Using matrix methods, find (1) 𝑌′𝑌, (2) 𝑋′𝑋, (3) 𝑋′𝑌.
58