Professional Documents
Culture Documents
Kxu Stat Anderson Ch12 Student
Kxu Stat Anderson Ch12 Student
1
Simple Linear Regression Model
y = 0 + 1x +
2
Simple Linear Regression Equation
E(y) = 0 + 1x
3
Simple Linear Regression Equation
n Positive Linear Relationship
E(y)
Regression line
Intercept Slope 1
0
is positive
4
Simple Linear Regression Equation
E(y)
Slope 1
is negative
5
Simple Linear Regression Equation
n No Relationship
E(y)
Regression line
Intercept
0
Slope 1
is 0
6
Estimated Simple Linear Regression Equation
ŷ b0 b1 x
7
Estimation Process
Estimated
b0 and b1 Regression Equation
provide estimates of ŷ b0 b1 x
0 and 1 Sample Statistics
b0, b1
8
Least Squares Method
where:
yi = observed value of the dependent variable
for the ith observation
^
yi = estimated value of the dependent variable
for the ith observation
9
The Least Squares Method
xi y i ( xi y i ) / n
b1 2 2
xi ( xi ) / n
10
The Least Squares Method
b0 y b1 x
where:
xi = value of independent variable for ith observation
y_i = value of dependent variable for ith observation
x_ = mean value for independent variable
y = mean value for dependent variable
n = total number of observations
11
Example: Reed Auto Sales
12
Example: Reed Auto Sales
13
Example: Reed Auto Sales
^
y = 10 + 5x
14
Example: Reed Auto Sales
Scatter Diagram
30
25
20
Cars Sold
^
y = 10 + 5x
15
10
5
0
0 1 2 3 4
TV Ads
15
The Coefficient of Determination
( y i y ) ( y^i y ) ( y i y^i )
2 2 2
where:
SST = total sum of squares
SSR = sum of squares due to regression
SSE = sum of squares due to error
16
The Coefficient of Determination
r2 = SSR/SST
where:
SST = total sum of squares
SSR = sum of squares due to regression
17
Example: Reed Auto Sales
Coefficient of Determination
r2 = SSR/SST = 100/114 =
The regression relationship is very strong
because 88% of the variation in number of cars sold
can be explained by the linear relationship between
the number of TV ads and the number of cars sold.
18
The Correlation Coefficient
rxy (sign of b1 ) r 2
where:
b1 = the slope of the estimated regression
equationyˆ b0 b1 x
19
Example: Reed Auto Sales
rxy (sign of b1 ) r 2
The sign of b1 in the equation yˆ 10 5 x is “+”.
rxy = + .8772
rxy = +.9366
20
Model Assumptions
21
Testing for Significance
22
Testing for Significance
An Estimate of 2
The mean square error (MSE) provides the estimate
of 2, and the notation s2 is also used.
s2 = MSE = SSE/(n-2)
where:
SSE ( yi yˆ i ) 2 ( yi b0 b1 xi ) 2
23
Testing for Significance
An Estimate of
– To estimate we take the square root of 2.
– The resulting s is called the standard error of the
estimate.
SSE
s MSE
n2
24
Testing for Significance: t Test
Hypotheses
H0: 1 = 0
Ha: 1 = 0
Test Statistic b1
t
sb1
s
where sb1
i
( x x ) 2
25
Testing for Significance: t Test
n Rejection Rule
26
Example: Reed Auto Sales
t Test
– Hypotheses
H0 : 1 = 0
Ha: 1 = 0
– Rejection Rule
For = .05 and d.f. = 3, t.025 = _____
Reject H0 if t > t.025 = _____
27
Example: Reed Auto Sales
n t Test
• Test Statistics
t = _____/_____ = 4.63
• Conclusions
t = 4.63 > 3.182, so reject H0
28
Confidence Interval for 1
29
Confidence Interval for 1
30
Example: Reed Auto Sales
Rejection Rule
Reject H0 if 0 is not included in
the confidence interval for 1.
95% Confidence Interval for 1
b1 t / 2 sb1
= 5 +/- 3.182(1.08) = 5 +/- 3.44
or ____ to ____
Conclusion
0 is not included in the confidence interval.
Reject H0
31
Testing for Significance: F Test
n Hypotheses
H0 : 1 = 0
Ha : 1 = 0
n Test Statistic
F = MSR/MSE
32
Testing for Significance: F Test
n Rejection Rule
Reject H0 if F > F
33
Example: Reed Auto Sales
n F Test
• Hypotheses
H0 : 1 = 0
Ha: 1 = 0
• Rejection Rule
For = .05 and d.f. = 1, 3: F.05 = ______
Reject H0 if F > F.05 = ______.
34
Example: Reed Auto Sales
n F Test
• Test Statistic
F = MSR/MSE = ____ / ______ = 21.43
• Conclusion
F = 21.43 > 10.13, so we reject H0.
35
Some Cautions about the
Interpretation of Significance Tests
36
Using the Estimated Regression Equation
for Estimation and Prediction
n Confidence Interval Estimate of E(yp)
y p t /2 s y p
yp + t/2 sind
37
Example: Reed Auto Sales
Point Estimation
If 3 TV ads are run prior to a sale, we expect the mean
number of cars sold to be:
^
y =^10 + 5(3) = ______ cars
38
Example: Reed Auto Sales
39
Example: Reed Auto Sales
40
Residual Analysis
yi – y^i
and 1 ( xi x ) 2
hi
n ( xi x ) 2
41
Example: Reed Auto Sales
Residuals
42
Example: Reed Auto Sales
Residual Plot
TV Ads Residual Plot
3
2
Residuals
1
0
-1
-2
-3
0 1 2 3 4
TV Ads
43
Residual Analysis
Residual Plot
y yˆ
Good Pattern
Residual
44
Residual Analysis
n Residual Plot
y yˆ
Nonconstant Variance
Residual
45
Residual Analysis
n Residual Plot
y yˆ
Model Form Not Adequate
Residual
46
End of Chapter 12
47