Professional Documents
Culture Documents
CH 05
CH 05
CH 05
Walter R. Paczkowski
Rutgers University
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 1
Chapter Contents
5.1 Introduction
5.2 Estimating the Parameters of the Multiple
Regression Model
5.3 Sampling Properties of the Least Squares
Estimators
5.4 Interval Estimation
5.5 Hypothesis Testing
5.6 Polynomial Equations
5.7 Interaction Variables
5.8 Measuring Goodness-of-fit
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 2
5.1
Introduction
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 3
5.1
Introduction
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 4
5.1
Introduction
5.1.1
The Economic
Model
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 5
5.1
Introduction
5.1.1
The Economic
Model
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 6
5.1
Introduction
5.1.1
The Economic
Model
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 7
5.1
Introduction
5.1.2
The Econometric
Model
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 8
5.1
Introduction FIGURE 5.1 The multiple regression plane
5.1.2
The Econometric
Model
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 9
5.1 Table 5.1 Observations on Monthly Sales, Price, and Advertising in Big
Introduction
Andy’s Burger Barn
5.1.2
The Econometric
Model
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 10
5.1
Introduction
5.1.2a
The General Model
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 11
5.1
Introduction
5.1.2a
The General Model
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 12
5.1
Introduction
5.1.2a
The General Model
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 13
5.1
Introduction
5.1.2a
The General Model
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 14
5.1
Introduction
5.1.2b
The Assumptions
of the Model
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 15
5.1
Introduction
5.1.2b
The Assumptions
of the Model
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 16
5.1
Introduction
5.1.2b
The Assumptions
of the Model
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 17
5.1
Introduction
5.1.2b
The Assumptions
of the Model
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 18
5.1
Introduction ASSUMPTIONS of the Multiple Regression Model
5.1.2b
The Assumptions
of the Model
MR1. yi 1 2 xi 2 K xiK ei , i 1, , N
MR2. E( yi ) 1 2 xi 2 K xiK E (ei ) 0
MR3. var( yi ) var(ei ) 2
MR4. cov( yi , y j ) cov(ei , e j ) 0
MR5. The values of each xtk are not random and are not
exact linear functions of the other explanatory variables
MR6. yi ~ N (1 2 xi 2 K xiK ), 2 ei ~ N (0, 2 )
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 19
5.2
Estimating the Parameters of the
Multiple Regression Model
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 20
5.2
Estimating the
Parameters of the
Multiple
Regression Model
Eq. 5.4 yi β1 β2 xi 2 β3 xi 3 ei
– This model is simpler than the full model, yet
all the results we present carry over to the
general case with only minor modifications
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 21
5.2
Estimating the
Parameters of the
Multiple
Regression Model
5.2.1
Least Squares
Estimation
Procedure
Mathematically we minimize the sum of squares
function S(β1, β2, β3), which is a function of the
unknown parameters, given the data:
N
S β1 ,β 2 ,β3 yi E yi
2
i 1
Eq. 5.5
N
yi β1 β 2 xi 2 β3 xi 3
2
i 1
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 22
5.2
Estimating the
Parameters of the
Multiple
Regression Model
5.2.1
Least Squares
Estimation
Procedure
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 23
5.2
Estimating the
Parameters of the
Multiple
Regression Model
5.2.2
Least Squares
Estimates Using
Hamburger Chain
Data
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 24
5.2
Estimating the
Parameters of the Table 5.2 Least Squares Estimates for Sales Equation for Big Andy’s
Multiple Burger Barn
Regression Model
5.2.2
Least Squares
Estimates Using
Hamburger Chain
Data
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 25
5.2
Estimating the
Parameters of the
Multiple
Regression Model
5.2.2
Least Squares
Estimates Using
Interpretations of the results:
Hamburger Chain
Data 1. The negative coefficient on PRICE suggests
that demand is price elastic; we estimate that,
with advertising held constant, an increase in
price of $1 will lead to a fall in monthly
revenue of $7,908
2. The coefficient on advertising is positive; we
estimate that with price held constant, an
increase in advertising expenditure of $1,000
will lead to an increase in sales revenue of
$1,863
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 26
5.2
Estimating the
Parameters of the
Multiple
Regression Model
5.2.2
Least Squares
Estimates Using
Interpretations of the results (Continued):
Hamburger Chain
Data 3. The estimated intercept implies that if both price
and advertising expenditure were zero the sales
revenue would be $118,914
• Clearly, this outcome is not possible; a zero
price implies zero sales revenue
• In this model, as in many others, it is important
to recognize that the model is an approximation
to reality in the region for which we have data
• Including an intercept improves this
approximation even when it is not directly
interpretable
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 27
5.2
Estimating the
Parameters of the
Multiple
Regression Model
5.2.2
Least Squares
Estimates Using
Hamburger Chain
Data Using the model to predict sales if price is $5.50
and advertising expenditure is $1,200:
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 28
5.2
Estimating the
Parameters of the
Multiple
Regression Model
5.2.2
Least Squares
A word of caution is in order about interpreting regression
Estimates Using
Hamburger Chain
results:
Data
– The negative sign attached to price implies that
reducing the price will increase sales revenue.
– If taken literally, why should we not keep reducing the
price to zero?
– Obviously that would not keep increasing total revenue
– This makes the following important point:
• Estimated regression models describe the
relationship between the economic variables for
values similar to those found in the sample data
• Extrapolating the results to extreme values is
generally not a good idea
• Predicting the value of the dependent variable for
values of the explanatory variables far from the
sample values invites disaster
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 29
5.2
Estimating the
Parameters of the
Multiple
Regression Model
5.2.3
Estimation of the
Error Variance σ2
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 30
5.2
Estimating the
Parameters of the
Multiple
Regression Model
5.2.3
Estimation of the
Error Variance σ2
i1 ei
N
ˆ 2
Eq. 5.7
ˆ 2
N K
where K is the number of β parameters being
estimated in the multiple regression model.
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 31
5.2
Estimating the
Parameters of the
Multiple
Regression Model
5.2.3
Estimation of the
Error Variance σ2
i1 ei
75
ˆ 2
1718.943
ˆ
2
23.874
N K 75 3
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 32
5.2
Estimating the
Parameters of the
Multiple
Regression Model
5.2.3
Estimation of the
Error Variance σ2
Note that:
N
SSE eˆi2 1718.943
i 1
ˆ 23.874 4.8861
– Both quantities typically appear in the output
from your computer software
• Different software refer to it in different
ways.
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 33
5.3
Sampling Properties of the Least
Squares Estimators
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 34
5.3
Sampling
Properties of the
Least Squares THE GAUSS-MARKOV THEOREM
Estimators
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 35
5.3
Sampling
Properties of the
Least Squares
Estimators
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 36
5.3
Sampling
Properties of the
Least Squares
Estimators
5.3.1
The Variances and
Covariances of the
We can show that:
Least Squares
Estimators
2
var(b2 ) N
(1 r232 ) ( xi 2 x2 ) 2
Eq. 5.8
i 1
where
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 37
5.3
Sampling
Properties of the
Least Squares
Estimators
5.3.1
The Variances and
Covariances of the
Least Squares
Estimators We can see that:
1. Larger error variances 2 lead to larger
variances of the least squares estimators
2. Larger sample sizes N imply smaller
variances of the least squares estimators
3. More variation in an explanatory variable
around its mean, leads to a smaller variance of
the least squares estimator
4. A larger correlation between x2 and x3 leads to
a larger variance of b2
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 38
5.3
Sampling
Properties of the
Least Squares
Estimators
5.3.1
The Variances and
Covariances of the
Least Squares
Estimators
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 39
5.3
Sampling
Properties of the
Least Squares
Estimators
5.3.1
The Variances and
Covariances of the
Least Squares
Estimators
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 40
5.3
Sampling
Properties of the
Least Squares
Estimators
5.3.1
The Variances and
Covariances of the
Least Squares
Estimators
Therefore, we have:
var b1 40.343 cov b1 , b2 6.795
var b2 1.201 cov b1 , b3 0.7484
var b3 0.4668 cov b2 , b3 0.0197
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 41
5.3
Sampling
Properties of the
Least Squares
Estimators
5.3.1
The Variances and
Covariances of the
Least Squares
Estimators
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 42
5.3
Sampling
Properties of the
Least Squares Table 5.3 Covariance Matrix for Coefficient Estimates
Estimators
5.3.1
The Variances and
Covariances of the
Least Squares
Estimators
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 43
5.3
Sampling
Properties of the
Least Squares
Estimators
5.3.2
The Distribution of
the Least Squares
Estimators
Consider the general for of a multiple regression
model:
yi 1 2 xi 2 3 xi 3 K xiK ei
– If we add assumption MR6, that the random
errors ei have normal probability distributions,
then the dependent variable yi is normally
distributed:
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 44
5.3
Sampling
Properties of the
Least Squares
Estimators
5.3.2
The Distribution of
the Least Squares
Estimators
k , var bk
bk ~ N
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 45
5.3
Sampling
Properties of the
Least Squares
Estimators
5.3.2
The Distribution of
the Least Squares
Estimators
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 46
5.3
Sampling
Properties of the
Least Squares
Estimators
5.3.2
The Distribution of
the Least Squares
Estimators
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 47
5.3
Sampling
Properties of the
Least Squares
Estimators
5.3.2
The Distribution of
the Least Squares
Estimators
We can form a linear combination of the
coefficients as:
c1β1 c2β2 cK β K k 1 ck βk
K
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 48
5.3
Sampling
Properties of the
Least Squares
Estimators
5.3.2
The Distribution of
the Least Squares
Estimators
If = 3, the we have:
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 49
5.3
Sampling
Properties of the
Least Squares
Estimators
5.3.2
The Distribution of What happens if the errors are not normally
the Least Squares
Estimators distributed?
– Then the least squares estimator will not be
normally distributed and Eq. 5.11, Eq. 5.12, and
Eq. 5.13 will not hold exactly
– They will, however, be approximately true in large
samples
– Thus, having errors that are not normally
distributed does not stop us from using Eq. 5.12
and Eq. 5.13, but it does mean we have to be
cautious if the sample size is not large
– A test for normally distributed errors was given in
Chapter 4.3.5
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 50
5.4
Interval Estimation
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 51
5.4
Interval Estimation
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 52
5.4
Interval Estimation
5.4.1
Interval Estimation
for a Single
Coefficient
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 53
5.4
Interval Estimation
5.4.1
Interval Estimation
for a Single
Coefficient
Rearranging, we get:
P b2 1.993 se(b2 ) 2 b2 1.993 se(b2 ) .95
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 54
5.4
Interval Estimation
5.4.1
Interval Estimation
for a Single
Using our data, we have b2 = -7.908 and
Coefficient
se(b2) = 1.096, so that:
5.4.1
Interval Estimation
for a Single
Similarly for advertising, we get:
Coefficient
5.4.1
Interval Estimation
for a Single
Coefficient
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 57
5.4
Interval Estimation
5.4.2
Interval Estimation
for a Linear
Combination of
Coefficients Suppose Big Andy wants to increase advertising
expenditure by $800 and drop the price by 40
cents.
– Then the change in expected sales is:
E SALES1 E SALES0
β1 β 2 PRICE0 0.4 β3 ADVERT0 0.8
β1 β 2 PRICE0 β3 ADVERT0
0.4β 2 0.8β3
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 58
5.4
Interval Estimation
5.4.2
Interval Estimation
for a Linear
A point estimate would be:
Combination of
4.6532
ˆ t se ˆ , ˆ t se ˆ
c c
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 59
5.4
Interval Estimation
5.4.2
Interval Estimation
for a Linear
Combination of
Coefficients
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 60
5.4
Interval Estimation
5.4.2
Interval Estimation
for a Linear
Combination of
Coefficients
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 61
5.5
Hypothesis Testing
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 62
5.5
Hypothesis Testing COMPONENTS OF HYPOTHESIS TESTS
1. A null hypothesis H0
2. An alternative hypothesis H1
3. A test statistic
4. A rejection region
5. A conclusion
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 63
5.5
Hypothesis Testing
5.5.1
Testing the
Significance of a
Single Coefficient
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 64
5.5
Hypothesis Testing
5.5.1
Testing the
Significance of a
Single Coefficient
Null hypothesis:
H 0 : k 0
Alternative hypothesis:
H1 : k 0
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 65
5.5
Hypothesis Testing
5.5.1
Testing the
Significance of a
Single Coefficient
Test statistic:
bk
t ~ t( N K )
se bk
t values for a test with level of significance α:
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 66
5.5
Hypothesis Testing
5.5.1
Testing the
Significance of a
Single Coefficient
For our hamburger example, we can conduct a test
that sales revenue is related to price:
1. The null and alternative hypotheses are:
H 0 : 2 0 and H1 : 2 0
2. The test statistic, if the null hypothesis is true, is:
t b2 se b2 ~ t( N K )
3. Using a 5% significance level (α=.05), and 72 degrees
of freedom, the critical values that lead to a
probability of 0.025 in each tail of the distribution are:
t.975,72 1.993 and t.025,72 1.993
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 67
5.5
Hypothesis Testing
5.5.1
Testing the For our hamburger example (Continued) :
Significance of a
Single Coefficient 4. The computed value of the t-statistic is:
7.908
t 7.215
1.096
and the p-value from software is:
P t 72 7.215 P t 72 7.215 2 (2.2 1010 ) 0.000
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 68
5.5
Hypothesis Testing
5.5.1
Testing the
Significance of a
Single Coefficient
Similarly, we can conduct a test that sales revenue is
related to advertising expenditure:
1. The null and alternative hypotheses are:
H 0 : 3 0 and H1 : 3 0
2. The test statistic, if the null hypothesis is true, is:
t b3 se b3 ~ t( N K )
3. Using a 5% significance level (α=.05), and 72 degrees
of freedom, the critical values that lead to a
probability of 0.025 in each tail of the distribution are:
t.975,72 1.993 and t.025,72 1.993
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 69
5.5
Hypothesis Testing
5.5.1
Testing the For our hamburger example (Continued) :
Significance of a
Single Coefficient 4. The computed value of the t-statistic is:
1.8626
t 2.726
0.6832
and the p-value from software is:
P t 72 2.726 P t 72 2.726 2 0.004 0.008
5. Since 2.726 > 1.993, we reject H0: β3 = 0: the
data support the conjecture that revenue is related
to advertising expenditure
• Using the p-value to perform the test, we
reject H0 because 0.008 < 0.05 .
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 70
5.5
Hypothesis Testing
5.5.2a
Testing for Elastic
Demand
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 71
5.5
Hypothesis Testing
5.5.2a
Testing for Elastic
Demand
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 72
5.5
Hypothesis Testing
5.5.2a
Testing for Elastic
Demand
As before:
1. The null and alternative hypotheses are:
H 0 : 2 0 (demand is unit-elastic or inelastic)
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 73
5.5
Hypothesis Testing
5.5.2a
Testing for Elastic
Demand
Hypothesis test (Continued) :
4. The test statistic is:
b2 7.908
t 7.215
se b2 1.096
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 74
5.5
Hypothesis Testing
5.5.2b
Testing Advertising
Effectiveness
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 75
5.5
Hypothesis Testing
5.5.2b
Testing Advertising
Effectiveness
As before:
1. The null and alternative hypotheses are:
H 0 : 3 1
H 1 : 3 > 1
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 76
5.5
Hypothesis Testing
5.5.2b
Testing Advertising
Effectiveness
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 77
5.5
Hypothesis Testing
5.5.3
Hypothesis Testing
for a Linear
Combination of
Coefficients The marketing adviser claims that dropping the
price by 20 cents will be more effective for
increasing sales revenue than increasing
advertising expenditure by $500
– In other words, she claims that -0.2β2 > 0.5β3,
or -0.2β2 - 0.5β3> 0
– We want to test a hypothesis about the linear
combination -0.2β2 – 0.5β3
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 78
5.5
Hypothesis Testing
5.5.3
Hypothesis Testing
for a Linear
As before:
Combination of
Coefficients 1. The null and alternative hypotheses are:
H 0 : 0.2β 2 0.5β3 0 (marketer's claim is not correct)
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 79
5.5
Hypothesis Testing
5.5.3
Hypothesis Testing
for a Linear
Combination of
Coefficients
0.4010
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 80
5.5
Hypothesis Testing
5.5.3
Hypothesis Testing
for a Linear
Combination of
Coefficients Hypothesis test (Continued) :
4. The test statistic is:
0.2b2 0.5b3 1.58158 0.9319
t 1.622
se 0.2b2 0.5b3 0.4010
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 81
5.6
Polynomial Equations
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 82
5.6
Polynomial
Equations
Eq. 5.17 y β1 β2 x2 β3 x3 β K xK e
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 83
5.6
Polynomial
Equations
5.6.1
Hypothesis Testing
for a Linear
Combination of
Coefficients
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 84
5.6
Polynomial
Equations
FIGURE 5.2 (a) Total cost curve and (b) total product curve
5.6.1
Hypothesis Testing
for a Linear
Combination of
Coefficients
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 85
5.6
Polynomial
Equations FIGURE 5.3 Average and marginal (a) cost curves and (b) product curves
5.6.1
Hypothesis Testing
for a Linear
Combination of
Coefficients
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 86
5.6
Polynomial
Equations
5.6.1
Hypothesis Testing
for a Linear
For the general polynomial function:
Combination of
Coefficients
y a0 a1 x a2 x a3 x 2 3
ap x p
– The slope is
dy
Eq. 5.20 a1 2a2 x 3a3 x 2 pa p x p 1
dx
– Evaluated at a particular value, x = x0 , the slope
is:
dy
Eq. 5.21 a1 2a2 x0 3a3 x02 pa p x0p 1
dx x x0
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 87
5.6
Polynomial
Equations
5.6.1
Hypothesis Testing
for a Linear
Combination of
Coefficients
dE TC
2 2 3Q 3 4Q 2
dQ
– For a U-shaped marginal cost curve, we expect
the parameter signs to be α2 > 0, α3 < 0, and
α4 > 0
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 88
5.6
Polynomial
Equations
5.6.1
Hypothesis Testing
for a Linear
Combination of
Coefficients
dE AC
β 2 2β3Q
dQ
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 89
5.6
Polynomial
Equations
5.6.1
Hypothesis Testing
for a Linear
Combination of
Coefficients
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 90
5.6
Polynomial
Equations
5.6.2
Extending the
Model for Burger
Barn Sales
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 91
5.6
Polynomial
Equations
5.6.2
Extending the
Model for Burger
Barn Sales
5.6.2
Extending the
Model for Burger
Barn Sales
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 93
5.6
Polynomial
Equations
5.6.2
Extending the
Model for Burger
Barn Sales
We refer to
E SALES ADVERT
as the marginal effect of advertising on sales
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 94
5.6
Polynomial
Equations
5.6.2
Extending the
Model for Burger
Barn Sales
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 95
5.6
Polynomial
Equations
5.6.2
Extending the
Model for Burger
Barn Sales
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 96
5.6
Polynomial
Equations
5.6.2
Extending the
Model for Burger
Substituting, we find that when advertising is at its
Barn Sales
minimum value in the sample of $500 (ADVERT =
0.5), the marginal effect of advertising on sales is
9.383
– When advertising is at a level of $2,000
(ADVERT = 2), the marginal effect is 1.079
– Allowing for diminishing returns to advertising
expenditure has improved our model both
statistically and in terms of meeting
expectations about how sales will respond to
changes in advertising
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 97
5.6
Polynomial
Equations
5.6.3
The Optimal Level
of Advertising
The marginal benefit from advertising is the
marginal revenue from more advertising
– The required marginal revenue is given by the
marginal effect of more advertising
β3 + 2β4ADVERT
– The marginal cost of $1 of advertising is $1
plus the cost of preparing the additional
products sold due to effective advertising
– Ignoring the latter costs, the marginal cost of $1
of advertising expenditure is $1
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 98
5.6
Polynomial
Equations
5.6.3
The Optimal Level
of Advertising
β3 2β4 ADVERT0 1
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 99
5.6
Polynomial
Equations
5.6.3
The Optimal Level
of Advertising
1 b3 1 12.1512
ADVERT0 2.014
2b4 2 2.76796
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 100
5.6
Polynomial
Equations
5.6.3
The Optimal Level
of Advertising
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 101
5.6
Polynomial
Equations
5.6.3
The Optimal Level
of Advertising
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 102
5.6
Polynomial
Equations
5.6.3
The Optimal Level
of Advertising
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 103
5.6
Polynomial
Equations
5.6.3
The Optimal Level
of Advertising
Thus, for the estimated variance of the optimal
level of advertising, we have:
2 2
1 1 b3 1 1 b3
var ˆ
2b
var b3
4 2b 2
4
var b4 2
2b
4 2b 2
4
cov b3 , b4
1 12.151
2 2
1
12.646 2
0.88477
2 2.768 2 2.768
1 1 12.151
2 2
3.2887
2 2.768 2 2.768
0.016567
and
se ˆ 0.016567 0.1287
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 104
5.6
Polynomial
Equations
5.6.3
The Optimal Level
of Advertising
ˆ t 0.975,71se ˆ , ˆ t 0.975,71se ˆ
2.014 -1.994 0.1287, 2.014 1.994 0.1287
1.757, 2.271
– We estimate with 95% confidence that the
optimal level of advertising lies between $1,757
and $2,271
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 105
09.05.2022
Advanced Econometrics
2021-2022 BAHAR
5.7
Interaction Variables
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 106
5.7
Interaction
Variables
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 107
5.7
Interaction
Variables
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 108
5.7
Interaction
Variables
Table 5.4 Pizza Expenditure Data
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 109
5.7
Interaction
Variables
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 110
5.7
Interaction
Variables
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 111
5.7
Interaction
Variables
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 112
5.7
Interaction
Variables
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 113
5.7
Interaction
Variables
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 114
5.7
Interaction
Variables
5.7.1
Log-Linear Models Consider a wage equation where ln(WAGE)
depends on years of education (EDUC) and years
of experience (EXPER):
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 116
5.7
Interaction
Variables
5.7.1
Log-Linear Models
ln WAGE
β3 β 4 EDUC
EXPER EDUC fixed
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 117
5.7
Interaction
Variables
5.7.1
Log-Linear Models
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 118
5.7
Interaction
Variables
5.7.1
Log-Linear Models
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 119
5.8
Measuring Goodness-of-fit
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 120
5.8
Measuring
Goodness-of-fit
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 121
5.8
Measuring
Goodness-of-fit
yˆ y
N 2
SSR
R i 1
2 i
y y
N 2
SST
i 1 i
SSE
Eq. 5.31 1
SST
i 1 i
N
ˆ
e 2
1
y y
N 2
i 1 i
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 122
5.8
Measuring
Goodness-of-fit
yˆi b1 b2 xi 2 b3 xi 3 bK xiK
– Recall that:
1 N SST
yi y
2
sy
N 1 i 1 N 1
– Then:
SST N 1 s y2
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 123
5.8
Measuring
Goodness-of-fit
i 1 i
N
ˆ
e 2
1718.943
R 1
2
1 0.448
i 1 yi y 3115.482
N 2
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 124
5.8
Measuring
Goodness-of-fit
Interpretation
– 44.8% of the variation in sales revenue is explained
by the variation in price and by the variation in the
level of advertising expenditure
– In our sample, 55.2% of the variation in revenue is
left unexplained and is due to variation in the error
term or to variation in other variables that
implicitly form part of the error term
– Adding the square of advertising to the Burger
Barn model (see Eq. 5.24) increased the R2 to 0.508
• Thus an additional 6% of the variation in sales is
explained by including this variable
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 125
5.8
Measuring
Goodness-of-fit
y y i 1 yˆi y i 1 eˆi 2
N 2 N 2 N
i 1 i
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 126
5.8
Measuring
Goodness-of-fit
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 127
Key Words
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 128
Keywords
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 130
5A Derivation of Least Squares Estimators
5B Large Sample Analysis
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 131
5A
Derivation of the
Least Squares
Estimators
S
21 xi 2 22 xi22 23 xi 2 xi 3 2 xi 2 yi
2
S
21 xi 3 22 xi 2 xi 3 23 xi23 2 xi 3 yi
3
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 132
5A
Derivation of the
Least Squares
Estimators
i 3 1 i 2 i 3 2 i 3b3 xi 3 yi
x b x x b x 2
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 133
5A
Derivation of the
Least Squares
Estimators
b2
i i 2 i3 i i 3 i 2 xi 3
y
x x 2
y
x x
x x x
2
i2
2
i3
2
x
i 2 i3
b3
y x x y x x
i i3
2
i2
i i2
x
i3 i 2
x x x x
2
i2
2
i3
2
i 2 i3
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 134
5B
Large Sample
Analysis
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 135
5B
Large Sample
Analysis
5B.1
Consistency The probability of obtaining an estimate ‘‘close’’
to β2 is:
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 136
5B
Large Sample
Analysis
FIGURE 5B.1 An illustration of consistency
5B.1
Consistency
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 137
5B
Large Sample
Analysis
5B.1
Consistency
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 138
5B
Large Sample
Analysis
5B.1
Consistency
Eq. 5B.3
N
lim bias βˆ 2 lim E βˆ 2 β 2 0
N
– The estimator is said to be asymptotically
unbiased
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 139
5B
Large Sample
Analysis
5B.1
Consistency
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 140
5B
Large Sample
Analysis
5B.1
Consistency
b2 p β 2
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 141
5B
Large Sample
Analysis
5B.2
Asymptotic
Normality
As N → ∞ the probability density function of the
standardized estimator has a distribution that
approaches the standard normal:
bk β k a
~ N 0,1
var bk
– The estimator is asymptotically normal and
generally write:
bk ~ N β k , var bk
a
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 142
5B
Large Sample
Analysis
5B.3
Monte Carlo
Simulation
yi E yi | xi ei β1 β2 xi ei , i 1, ,N
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 143
5B
Large Sample
Analysis
5B.3
Monte Carlo
Simulation
The Monte Carlo parameter values are β1 = 100
and β2 = 10
– The value of xi is 10 for the first N = 2
observations and 20 for the remaining N = 2
observations, so that the regression functions
are:
E yi | xi 10 100 10 xi 100 10 10 200,
i 1, ,N 2
E yi | xi 20 100 20 xi 100 10 20 300,
i N 2 1, ,N
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 144
5B
Large Sample
Analysis
Table 5B.1 The least squares estimators, tests, and interval estimators
5B.3
Monte Carlo
Simulation
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 145
5B
Large Sample
Analysis
FIGURE 5B.2 Histogram of the estimates b2 for N = 40
5B.3
Monte Carlo
Simulation
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 146
5B
Large Sample
Analysis
5B.4
The Delta Method
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 147
5B
Large Sample
Analysis
5B.4.1
Nonlinear
Functions of a
Single Parameter
The Taylor series approximation is:
df x
f x f a x a f a f a x a
dx x a
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 148
5B
Large Sample
Analysis
5B.4.1
Nonlinear
Functions of a
Single Parameter
This Taylor series expansion of shows the
following:
1. If E(b2) = β2 then E[g1(b2)] β2.
2. If b2 is a biased but consistent estimator, so
that b2 β2 , then g1 b2 g1 β2
p
p
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 149
5B
Large Sample
Analysis
5B.4.1
Nonlinear
Functions of a
Single Parameter
= g1 β 2 var b2
2
because β 2 is not random
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 150
5B
Large Sample
Analysis
5B.4.1
Nonlinear
Functions of a
Single Parameter
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 151
5B
Large Sample
Analysis
5B.4.2
The Delta Method
Illustrated
A fitted regression is
yˆ 87.44311 10.68456 x
se 33.8764 2.1425
– Consider the nonlinear function:
5B.4.2
The Delta Method
Illustrated
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 153
5B
Large Sample
Analysis Table 5B.3 Estimates and tests of g1(β2) = exp(β2) =10
5B.4.2
The Delta Method
Illustrated
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 154
5B
Large Sample
Analysis
5B.4.2
The Delta Method
Illustrated
The estimated variance is:
0.38896
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 155
5B
Large Sample
Analysis
5B.4.3
Monte Carlo
Simulation of the
Delta Method
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 156
5B
Large Sample FIGURE 5B.3 Histogram of g1(b2) = exp(b2) =10
Analysis
5B.4.3
Monte Carlo
Simulation of the
Delta Method
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 157
5B
Large Sample
Analysis
5B.5
The Delta Method
Extended
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 158
5B
Large Sample
Analysis
5B.5
The Delta Method
Extended
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 159
5B
Large Sample
Analysis
5B.5
The Delta Method
Extended
g 2 β1 ,β 2 g 2 β1 ,β 2
2 2
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 160
5B
Large Sample
Analysis
5B.5
The Delta Method
Extended
a
Eq. 5B.9 g2 b1 , b2 ~ N g2 β1 ,β2 , var g2 b1 , b2
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 161
5B
Large Sample
Analysis Table 5B.4 Estimates g2(b1, b2) = b1/b2
5B.5.1
The Delta Method
Illustrated:
Continued
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 162
5B
Large Sample
Analysis
5B.5.1
The Delta Method
Illustrated:
Continued
The nonlinear function of two parameters that we
consider is g2(b1, b2) = b1/b2
– The derivatives are:
g 2 β1 ,β 2 1
β1 β2
g 2 β1 ,β 2 β1
2
β 2 β2
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 163
5B
Large Sample
Analysis
5B.5.1
The Delta Method
Illustrated:
Continued
The estimate g2(b1, b2) = b1/b2
= 87.44311 /10.68456 = 8.18406 and its estimated
variance is:
2 2
1 b 1 b
var g 2 b1 , b2 var b1 12 var b2 2 12 cov b1 , b2
b2 b2 b2 b2
22.61857
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 164
5B
Large Sample
Analysis FIGURE 5B.4a Histogram of g2(b1, b2) = b1/b2, N = 40
5B.5.2
Monte Carlo
Simulation of the
Extended Delta
Method
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 165
5B
Large Sample
Analysis FIGURE 5B.4b Histogram of g2(b1, b2) = b1/b2, N = 200
5B.5.2
Monte Carlo
Simulation of the
Extended Delta
Method
Principles of Econometrics, 4th Edition Chapter 5: The Multiple Regression Model Page 166