Professional Documents
Culture Documents
Chapter 7 (Multicolinarity)
Chapter 7 (Multicolinarity)
and Seid H
where are constants such that not all of them are simultaneously zero.
Today, however , the term multicollineaity is used in a broader sense to include
the case of perfect multicollinearity as shown by (1) as well as the case where the
x-variables are inter-correlated but not perfectly so as follows
Econometrics: Module-II
Bedru B. and Seid H
Econometrics: Module-II
Bedru B. and Seid H
Assume ------------------------3.32
Where is non-zero constants. Substitute 3.32in the above and formula:
Econometrics: Module-II
Bedru B. and Seid H
indeterminate.
Applying the same procedure, we obtain similar result (indeterminate value) for
. Likewise, from our discussion of multiple regression model, variance of is
given by :
infinite.
These are the consequences of perfect multicollinearity. One may raise the
question on consequences of less than perfect correlation. In cases of near or high
multicollinearity, one is likely to encounter the following consequences.
Econometrics: Module-II
Bedru B. and Seid H
determinate.
This proves that if we have less than perfect multicollinearity the OLS coefficients
are determinate.
The implication of indetermination of regression coefficients in the case of perfect
multicolinearity is that it is not possible to observe the separate influence of
. But such extreme case is not very frequent in practical applications.
Most data exhibit less than perfect multicollinearity.
3. If multicollineaity is less than perfect (i.e. near or high multicollinearity) , OLS
estimators retain the property of BLUE
Explanation:
Note: While we were proving the BLUE property of OLS estimators in simple
and multiple regression models(module-I); we did not make use of the assumption
of no multicollinearity. Hence, if the basic assumptions which are important to
prove the BLUE property are not violated ,whether multicollinearity exist or
not ,the OLS estimators are BLUE .
3. Although BLUE, the OLS estimators have large variances and covariances.
Econometrics: Module-II
Bedru B. and Seid H
Similarly . (why?)
4. Because of the large variance of the estimators, which means large standard
errors, the confidence interval tend to be much wider, leading to the acceptance of
“zero null hypothesis” (i.e. the true population coefficient is zero) more readily.
5. Because of large standard error of the estimators, the computed t-ratio will be
very small leading one or more of the coefficients tend to be statistically
insignificant when tested individually.
Econometrics: Module-II
Bedru B. and Seid H
6. Although the t-ratio of one or more of the coefficients is very small (which
makes the coefficients statistically insignificant individually), R 2, the overall
measure of goodness of fit, can be very high.
Example: if
In the cases of high collinearity, it is possible to find that one or more of the partial
slope coefficients are individually statistically insignificant on the basis of t-test.
But the R2 in such situations may be so high say in excess of 0.9.in such a case on
the basis of F test one can convincingly reject the hypothesis that
Indeed, this is one of the signals of multicollinearity-
insignificant t-values but a high overall R2 (i.e a significant F-value).
7. The OLS estimators and their standard errors can be sensitive to small change
in the data.
Econometrics: Module-II
Bedru B. and Seid H
However, the combination of all these criteria should help the detection of
multicollinearity.
Econometrics: Module-II
Bedru B. and Seid H
Econometrics: Module-II
Bedru B. and Seid H
(How?)
(How?)
follows:
Econometrics: Module-II
Bedru B. and Seid H
In addition using these value we can drive the condition index (CI) defined as
as
Econometrics: Module-II
Bedru B. and Seid H
high VIF is neither necessary nor sufficient to get high variances and high standard
errors. Therefore, high multicollinearity, as measured by a high VIF may not
necessary cause high standard errors.
4.3.5.Remedial measures
It is more difficult to deal with models indicating the existence of multicollinearity
than detecting the problem of multicollinearity. Different remedial measures have
been suggested by econometricians; depending on the severity of the problem,
availability of other sources of data and the importance of the variables, which are
found to be multicollinear in the model.
Some suggest that minor degree of multicollinearity can be tolerated although one
should be a bit careful while interpreting the model under such conditions. Others
suggest removing the variables that show multicollinearity if it is not important in
the model. But, by doing so, the desired characteristics of the model may then get
affected. However, following corrective procedures have been suggested if the
problem of multicollinearity is found to be serious.
1. Increase the size of the sample: it is suggested that multicollinearity may be
avoided or reduced if the size of the sample is increased. With increase in the size
of the sample, the covariances are inversely related to the sample size. But we
should remember that this will be true when intercorrelation happens to exist only
in the sample but not in the population of the variables. If the variables are
collinear in the population, the procedure of increasing the size of the sample will
not help to reduce multicollinearity.
2. Introduce additional equation in the model: The problem of mutlicollinearity
may be overcome by expressing explicitly the relationship between multicollinear
variables. Such relation in a form of an equation may then be added to the original
model. The addition of new equation transforms our single equation (original)
model to simultaneous equation model. The reduced form method (which is
Econometrics: Module-II
Bedru B. and Seid H
usually applied for estimating simultaneous equation models) can then be applied
to avoid multicollinearity.
3. Use extraneous information – Extraneous information is the information
obtained from any other source outside the sample which is being used for the
estimation. Extraneous information may be available from economic theory or
from some empirical studies already conducted in the field in which we are
interested. Three methods, through which extraneous information is utilized in
order to deal with the problem of multicollinearity.
a. Method of using prior information: Suppose that the correct specification
of the model is , and also are found to be
collinear. If it is possible to gather information on the exact value of
from extraneous source, we then make use of such information in
estimating the influence of the remaining variable of the model in the
following way.
Suppose known a priori, then:
Econometrics: Module-II
Bedru B. and Seid H
The asterisk indicates logs of the variables. Suppose, it is observed that K and L
move together so closely that it is difficult to separate the effect of changing
quantities of labor inputs on output from the effect of variation in the use of
capital. Again, let us assume that on the basis of information from some other
source, we have a solid evidence that the present industry is characterized by
constant returns to scale. This implies that , we can therefore, on the basis
of this information, substitute in the transformed function. On combining
the results, the relationship becomes:
Where is derived from the time series data, is obtained by using the cross-
section data. By following the pooling technique, we have skirted the
multicollinearity between income and price.
The methods described above are no sure methods to get rid of the problem of
multicollinearity. Which of these rules work in practice will depend on the nature
of the data under investigation and severity of the multicollinearity problem.
Chapter Five
Econometrics: Module-II
Bedru B. and Seid H
Example: ------------------------------------------(5.01)
where Y=annual salary of a college professor
if male college professor
= 0 otherwise (i.e., female professor)
Econometrics: Module-II
Bedru B. and Seid H
Note that (5.01) is like the two variable regression models encountered previously
except that instead of a quantitative X variable we have a dummy variable D
(hereafter, we shall designate all dummy variables by the letter D).
Model (5.01) may enable us to find out whether sex makes any difference in a
college professor’s salary, assuming, of course, that all other variables such as age,
degree attained, and years of experience are held constant. Assuming that the
disturbance satisfy the usually assumptions of the classical linear regression
model, we obtain from (5.01).
Mean salary of female college professor: -------(5.02)
Mean salary of male college professor:
that is, the intercept term gives the mean salary of female college professors and
the slope coefficient tells by how much the mean salary of a male college
professor differs from the mean salary of his female counterpart, reflecting
the mean salary of the male college professor. A test of the null hypothesis that
there is no sex discrimination can be easily made by running regression
(5.01) in the usual manner and finding out whether on the basis of the t test the
estimated is statistically significant.
5.2 Regression on one quantitative variable and one qualitative variable with
two classes, or categories
Consider the model: ----------------------------(5.03)
Where: annual salary of a college professor
years of teaching experience
1 if male
=0 otherwise
Model (5.03) contains one quantitative variable (years of teaching experience) and
one qualitative variable (sex) that has two classes (or levels, classifications, or
Econometrics: Module-II
Bedru B. and Seid H
categories), namely, male and female. What is the meaning of this equation?
Assuming, as usual, that we see that
Mean salary of female college professor: ---------(5.04)
Mean salary of male college professor: ------(5.05)
Geometrically, we have the situation shown in fig. 5.1 (for illustration, it is
assumed that ). In words, model 5.01 postulates that the male and female
college professors’ salary functions in relation to the years of teaching experience
have the same slope but different intercepts. In other words, it is assumed that
the level of the male professor’s mean salary is different from that of the female
professor’s mean salary (by but the rate of change in the mean annual salary by
years of experience is the same for both sexes.
If the assumption of common slopes is valid, a test of the hypothesis that the two
regressions (5.04) and (5.05) have the same intercept (i.e., there is no sex
discrimination) can be made easily by running the regression (5.03) and noting the
statistical significance of the estimated on the basis of the traditional t test. If
the t test shows that is statistically significant, we reject the null hypothesis that
the male and female college professors’ levels of mean annual salary are the same.
Econometrics: Module-II
Bedru B. and Seid H
Before proceeding further, note the following features of the dummy variable
regression model considered previously.
5.3 Regression on one quantitative variable and one qualitative variable with
more than two classes
Econometrics: Module-II
Bedru B. and Seid H
Suppose that, on the basis of the cross-sectional data, we want to regress the
annual expenditure on health care by an individual on the income and education of
the individual. Since the variable education is qualitative in nature, suppose we
consider three mutually exclusive levels of education: less than high school, high
school, and college. Now, unlike the previous case, we have more than two
categories of the qualitative variable education. Therefore, following the rule that
the number of dummies be one less than the number of categories of the variable,
we should introduce two dummies to take care of the three levels of education.
Assuming that the three educational groups have a common slope but different
intercepts in the regression of annual expenditure on health care on annual income,
we can use the following model:
--------------------------(5.06)
Where annual expenditure on health care
annual expenditure
1 if high school education
= 0 otherwise
1 if college education
= 0 otherwise
Note that in the preceding assignment of the dummy variables we are arbitrarily
treating the “less than high school education” category as the base category.
Therefore, the intercept will reflect the intercept for this category. The
differential intercepts and tell by how much the intercepts of the other two
categories differ from the intercept of the base category, which can be readily
checked as follows: Assuming , we obtain from (5.06)
Econometrics: Module-II
Bedru B. and Seid H
which are, respectively the mean health care expenditure functions for the three
levels of education, namely, less than high school, high school, and college.
Geometrically, the situation is shown in fig 5.2 (for illustrative purposes it is
assumed that ).
Econometrics: Module-II
Bedru B. and Seid H
Notice that each of the two qualitative variables, sex and color, has two categories
and hence needs one dummy variable for each. Note also that the omitted, or base,
category now is “black female professor.”
Assuming , we can obtain the following regression from (5.07)
Mean salary for black female professor:
Once again, it is assumed that the preceding regressions differ only in the intercept
coefficient but not in the slope coefficient .
An OLS estimation of (5.06) will enable us to test a variety of hypotheses. Thus,
if is statistically significant, it will mean that color does affect a professor’s
salary. Similarly, if is statistically significant, it will mean that sex also affects
a professor’s salary. If both these differential intercepts are statistically
significant, it would mean sex as well as color is an important determinant of
professors’ salaries.
From the preceding discussion it follows that we can extend our model to include
more than one quantitative variable and more than two qualitative variables. The
only precaution to be taken is that the number of dummies for each qualitative
variable should be one less than the number of categories of that variable.
Econometrics: Module-II
Bedru B. and Seid H
Until now, in the models considered in this chapter we assumed that the qualitative
variables affect the intercept but not the slope coefficient of the various subgroup
regressions. But what if the slopes are also different? If the slopes are in fact
different, testing for differences in the intercepts may be of little practical
significance. Therefore, we need to develop a general methodology to find out
whether two (or more) regressions are different, where the difference may be in
the intercepts or the slopes or both.
Econometrics: Module-II
Bedru B. and Seid H
their effect on mean Y may not be simply additive as in (5.08) but multiplicative
as well, as in the following model:
-----------------(4.09)
From (4.09) we obtain
------------(4.10)
which is the mean clothing expenditure of graduate females. Notice that
differential effect of being a female
differential effect of being a college graduate
differential effect of being a female graduate
which shows that the mean clothing expenditure of graduate females is different
(by from the mean clothing expenditure of females or college graduates. If
are all positive, the average clothing expenditure of females is
higher (than the base category, which here is male nongraduate), but it is much
more so if the females also happen to be graduates. Similarly, the average
expenditure on clothing by a college graduate tends to be higher than the base
category but much more so if the graduate happens to be a female. This shows
how the interaction dummy modifies the effect of the two attributes considered
individually. Whether the coefficient of the interaction dummy is statistically
significant can be tested by the usual t test. If it turns out to be significant, the
simultaneous presence of the two attributes will attenuate or reinforce the
individual effects of these attributes. Needless to say, omitting a significant
interaction term incorrectly will lead to a specification bias.
Econometrics: Module-II
Bedru B. and Seid H
crops right after the harvesting season. Often it is desirable to remove the seasonal
factor, or component, from a time series so that one may concentrate on the other
components, such as the trend. The process of removing the seasonal component
from a time series is known as deseasonalization, or seasonal adjustment, and the
time series thus obtained is called the deseasonalized or seasonally adjusted, time
series. Important economic time series, such as the consumer price index, the
wholesale price index, the index of industrial production, are usually published in
the seasonably adjusted form.
It pays commissions based on sales in such manner that up to a certain level, the
target, or threshold, level X*, there is one (stochastic) commission structure and
beyond that level another. (Note: Besides sales, other factors affect sales
commission. Assume that these other factors are represented by the stochastic
disturbance term.) More specifically, it is assumed that sales commission increases
linearly with sales until the threshold level X*, after which also it increases
linearly with sales but at a much steeper rate. Thus, we have a piece-wise linear
Econometrics: Module-II
Bedru B. and Seid H
regression consisting of two linear pieces or segments, which are labeled I and II
in fig. 5.3, and the commission function changes its slope at the threshold value.
Given the data on commission, sales, and the value of the threshold level X*, the
technique of dummy variables can be used to estimate the (differing) slopes of the
two segments of the piecewise linear regression shown in fig. 5.3. We proceed as
follows:
------------------------------------(5.11)
where sales commission
volume of sales generated by the sales person
X*= threshold value of sales also known as a knot (Known in advance)
D=1 if
= 0 if
Assuming we see at once that
---------------------------------------(5.12)
which gives the mean sales commission up to the target level X* and
----------------------(5.13)
which gives the mean sales commission beyond the target level X*.
Thus, gives the slope of the regression lien in segment I, and gives the
slope of the regression line in segment II of the piecewise linear regression shown
in fig 5.3. A test of the hypothesis that there is no break in the regression at the
threshold value X* can be conducted easily by noting the statistical significance of
the estimated differential slope coefficient .
Summary:
1. Dummy variables taking values of 1 and 0 (r their linear transforms) are a
means of introducing qualitative regressors in regression analysis.
Econometrics: Module-II
Bedru B. and Seid H
Econometrics: Module-II
Bedru B. and Seid H
Chapter Six
6.1 Introduction
While considering the standard regression model, we did not pay attention to the
timing of the explanatory variable(s) on the dependent variable. The standard
linear regression implies that change in one of the explanatory variables causes a
Econometrics: Module-II
Bedru B. and Seid H
change in the dependent variable during the same time period and during that
period alone. But in economics, such specification is scarcely found. In economic
phenomenon, generally, a cause often produces its effect only after a lapse of time;
this lapse of time (between cause and its effect) is called a lag. Therefore, realistic
formulations of economic relations often require the insertion of lapped values of
the explanatory or insertion of lagged dependent variables.
is a distributed lag model of consumption function. This means that the value of
the consumption expenditure at any given time depends on the current and
past values of the disposable income . The general form of a distributed lag
model (with only lagged exogenous variables) is written as:
The number of lags, s, may be either finite or infinite. But generally it is assumed
to be finite. The coefficient is known as the short run, or impact, multiplier
because it gives the change in mean value of Y following a unit change in X in the
same time period t. If the change in X is maintained at the same level thereafter,
then,(0+1)gives the change in the (mean value of) Y in the next period,(0+1+
2) in the following period, and so on. These partial sums are called interim, or
intermediate, multipliers. Finally, after ‘s’ periods we obtain which is known as
the long run, distributed-lag multiplier provided the sum exists.
Econometrics: Module-II
Bedru B. and Seid H
Econometrics: Module-II
Bedru B. and Seid H
Econometrics: Module-II
Bedru B. and Seid H
Proponents of this approach chose the second regression as the “best” one because
in the last two equation the sign of was not stable and in the last equation the
sign of was negative, which may be difficult to interpret economically.
Although seemingly straight forward, ad hoc estimation suffers from many
drawbacks, such as the following:
a. There is no guide as to what is the maximum lag length
b. As one estimates successive lags, there are fewer degrees of freedom
left, making statistical inference some what shaky
c. More importantly, in economic time series data, successive values
(lags) tend to be highly correlated; hence multicollinearity rears its
ugly head.
d. The sequential search for the lengths of lags opens the researcher to
the charge of data mining.
In view of the preceding problems, the ad hoc estimation procedure has very little
to recommend it. Some prior or theoretical considerations are brought to bear upon
the various’s if we are to make headway with the estimation problem.
Econometrics: Module-II
Bedru B. and Seid H
periods. More specifically, the Koyck lag formulation assumes that the weights
(impacts) are declining continuously.
Assume the original model is:
According to Koyck:
is known as the rate of decline or decay, of the distributed lag and 1- is known
as the speed of adjustment. But assuming non-negative values for , koyck rules
out the ’s from changing sign, and by assuming <1, lesser weight is assigned to
the decline ’s than current one. Also, the long run multiplier is a finite amount in
Koyck scheme.
Let * (1 ),Vt U t U t 1
Econometrics: Module-II
Bedru B. and Seid H
However, the following features of the koyck transformation may be taken note of:
a. Our original model was a distributed lag model but he transformed model is
autoregressive model because appears as one of the explanatory
variables. Koyck transformation, therefore, also helps to convert
distributed lag model into an auto regressive model.
b. In the new formulation the error term is found to be auto
correlated despite the fact that the disturbance term of the original model is
non-auto correlated. It can be seen as under
c. The lagged variable is not also independent of the error term i.e.
this is because is directly dependent on . Similarly on
. But since and are not independent, will obviously be
related to .
Due to these two problems, the Koyck transformation of the distributed lag model
will give rise to biased and inconsistent estimates. In addition to these estimation
problem, the Koyck hypothesis is quite restrictive in the sense that it assumes that
impact of past periods decline successively in a specific way. But the following
are also possible.
Econometrics: Module-II
Bedru B. and Seid H
What equation (ii) implies is that “economic agents will adapt their expectations
in the light of past experience and that in particular they will learn from their
mistakes.” More specifically, (ii) states that expectations are revised each period
by a fraction of the gap between the current value of the variable and its
previous expected value. Thus, for our model this would mean that expectations
about interest rates are revised each period by a fraction of the discrepancy
between the rate of interest observed in the current period and what its anticipated
value had been in the previous period. Another way of stating this would be to
write (ii) as: -------------------------------------------------(iii)
which shows that the expected value of the rate of interest at time t is a weighted
average of the actual value of the interest rate at time ‘t’ and its value expected in
Econometrics: Module-II
Bedru B. and Seid H
---------------------------(iv)
Now, lag equation (i) by one period, multiply it by 1- , and subtract the product
from (iv). After simple algebraic manipulations, we obtain:
-----------------------------(v)
where
Let us note the difference between (i) and (v). In the former, measures the
average response of Y to a unit change in X*, the equilibrium or long-run value of
X. In (v), on the other hand, measures the average response of Y to a unit
change in the actual or observed value of X. These responses will not be the same
unless, of course, =1, that is, the current and long-run values of X are the same.
In practice, we first estimate (v). Once an estimate of is obtained from the
coefficient of lagged Y, we can easily compute by simply dividing the
coefficient of by .
Note that like the Koyck model, the adaptive expectations model is autoregressive
and its error term is similar to the Koyck error term.
Econometrics: Module-II
Bedru B. and Seid H
The adaptive expectation model is one way of rationalizing the Koyck model.
Another rationalization is provided by Marc Nerlove in the so-called stock
adjustment or partial adjustment model. To illustrate this model, consider the
flexible accelerator model of economic theory, which assumes that there is
equilibrium, optimal, desired, or long-run amount of capital stock needed to
produce a given output under the given state of technology, rate of interest, etc.
For simplicity assume that this desired level of capital is a linear function of
output X as follows:
------------------------------------------------(1)
Since the desired level of capital is not directly observable, Nerlove postulates the
following hypothesis, known as the partial adjustment, or stock adjustment,
hypothesis:
--------------------------------------------(2)
where , such that , is known as the coefficient of adjustment and where
actual change and =desired change.
Since , the change in capital stock between two periods, it is nothing but
investment, (2) can alternatively be written as:
----------------------------------------------------------------(3)
where Investment in time period t.
Equation (2) postulates that the actual change in capital stock (investment) in any
given time period t is some fraction of the desired change for that period. If =1,
it means that the actual stock of capital is equal to the desired stock; that is, actual
stock adjusts to the desired stock instantaneously (in the same period). However,
if =0, it means that nothing changes since actual stock at time t is the same as
that observed in the previous time period. Typically, is expected to lie between
these extremes since adjustment to the desired stock of capital is likely to be
incomplete because of rigidity, inertia, contractual obligations, etc. – hence the
Econometrics: Module-II
Bedru B. and Seid H
name partial adjustment model. Note that the adjustment mechanism (2)
alternatively can be written as:
-------------------------------------------------(4)
showing that the observed capital stock at time t is a weighted average of the
desired capital stock at that time and the capital stock existing in the previous time
period, and (1- ) being the weights. Now substitution of (1) into (4) gives:
----------------------------------(5)
This model is called the partial adjustment model.
Since (1) represents the long-run, or equilibrium, demand for capital stock, (5) can
be called the short-run demand function for capital stock since in the short run the
existing capital stock may not necessarily be equal to its long-run level. Once we
estimate the short-run function (5) and obtain the estimate of the adjustment
coefficient (from the coefficient of ), we can easily derive the long-run
function by simply dividing and by and omitting the lagged Y term,
which will then give (1).
The partial adjustment model resembles both the Koyck and adaptive expectation
models in that it is autoregressive. But it has a much simpler disturbance term: the
original disturbance term multiplied by a constant . But bear in mind that
although similar in appearance, the adaptive expectation and partial adjustment
models are conceptually very different. The former is based on uncertainty (about
the future course of prices, interest rates, etc.), whereas the latter is due to
technical or institutional rigidities, inertia, cost of change, etc. However, both of
these models are theoretically much sounder than the Koyck model.
The important point to keep in mind is that since Koyck, adaptive expectations,
and stock adjustment models – apart from the difference in the appearance of the
Econometrics: Module-II
Bedru B. and Seid H
error term – yield the same final estimating model, one must be extremely careful
in telling the reader which model the researcher is using and why. Thus,
researchers must specify the theoretical underpinning of their model.
---------------------------------------------(b)
where . This model too is autoregressive, the only difference
from the purely adaptive expectations model being that appears along with
as an explanatory variable. Like Koyck and the AE models, the error term in
(b) follows a moving average process. Another feature of this model is linear in
the ’s, it is nonlinear in the original parameters.
Econometrics: Module-II
Bedru B. and Seid H
The Almon lag model possesses two advantages over the Koyck procedure. First,
it does not violate any of the ordinary least square basic assumptions concerning
the disturbance term. Second it is far more flexible than Koyck method in terms
of the form of lag scheme. It is because; this method does not hypothesize any
form of lag before hand.
This model assumes that any pattern of lag scheme among can be described by
polynomial. This idea is based on a theorem in mathematics known as
Weierstrass’s theorem, which states that under general conditions a curve may be
approximated by a polynomial whose degree is one more than the number of
turning points in the curve. Suppose that the in a given distributed lag model
are expected to decrease first, then increase and again decrease
Econometrics: Module-II
Bedru B. and Seid H
where: -----------------------------------------------(c)
This is the final form (or transformed form) of Almon Lag model. We can now
apply OLS method to estimate to obtain in the original
form. Note that vt remains in its original form.
Chapter Seven
7.1 Introduction
In all the previous chapters discussed so far, we have been focusing exclusively
with the problems and estimations of a single equation regression models. In such
models, a dependent variable is expressed as a linear function of one or more
explanatory variables. The cause-and-effect relationship in such models between
the dependent and independent variable is unidirectional. That is, the explanatory
variables are the cause and the independent variable is the effect. But there are
situations where such one-way or unidirectional causation in the function is not
meaningful. This occurs if, for instance, Y (dependent variable) is not only
function of X’s (explanatory variables) but also all or some of the X’s are, in turn,
determined by Y. There is, therefore, a two-way flow of influence between Y and
(some of) the X’s which in turn makes the distinction between dependent and
independent variables a little doubtful. Under such circumstances, we need to
Econometrics: Module-II
Bedru B. and Seid H
consider more than one regression equations; one for each interdependent
variables to understand the multi-flow of influence among the variables. This is
precisely what is done in simultaneous equation models.
The bias arising from application of such procedure of estimation which treats
each equation of the simultaneous equations model as though it were a single
model is known as simultaneity bias or simultaneous equation bias. To avoid this
bias we will use other methods of estimation, such as, Indirect Least Square (ILS),
Two Stage Least Square (2SLS), three Stage Least Square(3SLS), Maximum
Likelihood Methods and the Method of Instrumental Variable (IV).
Econometrics: Module-II
Bedru B. and Seid H
Applying OLS to the first equation of the above structural model will result in
biased estimator because . Now, let’s proof whether this
expression.
Econometrics: Module-II
Bedru B. and Seid H
, since E(UV) = 0
; (since is zero)
Econometrics: Module-II
Bedru B. and Seid H
equivalent to .
Here P and Q are endogenous variables and Y and R are exogenous variables.
Structural models
Econometrics: Module-II
Bedru B. and Seid H
A structural model describes the complete structure of the relationships among the
economic variables. Structural equations of the model may be expressed in terms
of endogenous variables, exogenous variables and disturbances (random
variables). The parameters of structural model express the direct effect of each
explanatory variable on the dependent variable. Variables not appearing in any
function explicitly may have an indirect effect and is taken into account by the
simultaneous solution of the system. For instance, a change in consumption affects
the investment indirectly and is not considered in the consumption function. The
effect of consumption on investment cannot be measured directly by any structural
parameter, but is measured indirectly by considering the system as a whole.
Example: The following simple Keynesian model of income determination can
be considered as a structural model.
-----------------------------------------------(16)
----------------------------------------------------(17)
for >0 and 0<<1
where: C=consumption expenditure
Z=non-consumption expenditure
Y=national income
C and Y are endogenous variables while Z is exogenous variable.
Econometrics: Module-II
Bedru B. and Seid H
----------------------------------(18)
--------------------------------(19)
Equation (18) and (19) are called the reduced form of the structural model of the above.
We can write this more formally as:
Structural form equations Reduced form equations
Parameters of the reduced form measure the total effect (direct and indirect) of a
change in exogenous variables on the endogenous variable. For instance, in the
Econometrics: Module-II
Bedru B. and Seid H
Econometrics: Module-II
Bedru B. and Seid H
a) Determine the reduced form equations for the structural equations (ii) and
(iii).
b) Indicate the expressions for 11 , 12, 21 , and 22 form (a) above.
How to estimate the reduced form parameters?
The estimates of the reduced from coefficients (’s ) may be obtained in two ways.
1) Direct estimation of the reduced coefficients by applying OLS.
2) Indirect estimation of the reduced form coefficients:
Steps:
i) Solve the system of endogenous variables so that each equation contains
only predetermined explanatory variables. In this way we may obtain
the system of parameters’ relations (relations between ’s and
structural parameters)
ii) Obtain the estimates of the structural parameters by any appropriate
econometric method.
iii) Substitute the estimates of the structural coefficients into the system of
parameters’ relations to find the estimates of the reduced coefficients,.
Recursive models
A model is called recursive if its structural equations can be ordered in such a way
that the first equation includes only the predetermined variables in the right hand
side; the second equation contains predetermined variables and the first
endogenous variable (of the first equation) in the right hand side and so on. The
special feature of recursive model is that its equations may be estimated, one at a
time, by OLS without simultaneous equations bias.
Econometrics: Module-II
Bedru B. and Seid H
In the above illustration, as usual, the X’s and Y’s are exogenous and endogenous
variables respectively. The disturbance terms follow the following assumptions.
The above assumption is the most crucial assumption that defines the recursive
model. If this does not hold, the above system is no longer recursive and OLS is
also no longer valid. The first equation of the above system contains only the
exogenous variables on the right hand side. Since by assumption, the exogenous
variable is independent of , the first equation satisfies the critical assumption of
the OLS procedure. Hence OLS can be applied straight forwardly to this equation.
Consider the second equation. It contains the endogenous variable as one of the
explanatory variables along with non-stochastic X’s. OLS can be applied to this
equation only if it can be shown that are independent of each other.
This is true because U1, which affects is by assumption uncorrelated with , i.e.
. acts as a predetermined variable in so far as is concerned.
Hence OLS can be applied to this equation. Similar argument can be stretched to
the 3rd equation because are independent of . In this way, in the
recursive system OLS can be applied to each equation separately.
Econometrics: Module-II
Bedru B. and Seid H
In the first equation, there are only exogenous variables and are assumed to be
independent of . In the second equation, the causal relation between and
is in one direction. Also is independent of and can be treated just like
exogenous variable. Similarly since is independent of , OLS can be applied
to the third equation. Thus, we can rewrite the above equations as follows:
Econometrics: Module-II
Bedru B. and Seid H
*
These methods of estimation are not discussed in this module as they are beyond the scope of this
introductory course.
Econometrics: Module-II
Bedru B. and Seid H
-------------------------------------------------(iii)
Now, suppose A and B are any two constants. Let’s multiply equation (i) by A,
multiply equation (ii) by B and then add the two equations. This gives
or
-------------------(iv)
Equation (iv) is what is known as a linear combination of (i) and (ii). The point
about equation (iv) is that it is of the same statistical form as the wage equation (i).
That is, it has the form:
W = constant + (constant)P + (constant)E + disturbance
Moreover, since A and B can take any values we like, this implies that our wage
price model generates an infinite number of equations such as (iv), which are all
statistically indistinguishable from the wage equation (i). Hence, if we apply OLS
or any other technique to data on W, P and E in an attempt to estimate the wage
Econometrics: Module-II
Bedru B. and Seid H
equation, we can’t know whether we are actually estimating (i) rather than one of
the infinite number of possibilities given by (iv). Equation (i) is said to be
unidentified, and consequently there is now no way in which unbiased or even
consistent estimators of its parameters may be obtained.
Notice that, in contrast, price equation (ii) cannot be confused with the linear
combination (iv), because it is a relationship involving W and P only and does not,
like (iv), contain the variable E. The price equation (ii) is therefore said to be
identified, and in principle it is possible to obtain consistent estimates of its
parameters. A function (an equation) belonging to a system of simultaneous
equations is identified if it has a unique statistical form, i.e. if there is no other
equation in the system, or formed by algebraic manipulations of the other
equations of the system, contains the same variables as the function(equation) in
question.
Identification problems do not just arise only on two equation-models. Using the
above procedure, we can check identification problems easily if we have two or
three equations in a given simultaneous equation model. However, for ‘n’
equations simultaneous equation model, such a procedure is very cumbersome. In
general for any number of equations in a given simultaneous equation, we have
two conditions that need to be satisfied to say that the model is in general
identified or not. In the following section we will see the formal conditions for
identification.
Econometrics: Module-II
Bedru B. and Seid H
In applying the identification rules we should either ignore the constant term, or, if
we want to retain it, we must include in the set of variables a dummy variable (say
X0) which would always take on the value 1. Either convention leads to the same
results as far as identification is concerned. In this chapter we will ignore the
constant intercept.
Econometrics: Module-II
Bedru B. and Seid H
Order condition:
order condition:
Econometrics: Module-II
Bedru B. and Seid H
where the y’s are the endogenous variables and the x’s are the predetermined
variables. This model may be rewritten in the form
Ignoring the random disturbance the table of the parameters of the model is as follows:
Variables
Equations
1st equation -1 3 0 -2 1 0
2nd equation 0 -1 1 0 0 1
3rd equation 1 -1 -1 0 0 -2
Secondly. Strike out the row of coefficients of the equation which is being
examined for identification. For example, if we want to examine the identifiability
of the second equation of the model we strike out the second row of the table of
coefficients.
Thirdly. Strike out the columns in which a non-zero coefficient of the equation
being examined appears. By deleting the relevant row and columns we are left
with the coefficients of variables not included in the particular equation, but
contained in the other equations of the model. For example, if we are examining
for identification the second equation of the system, we will strike out the second,
third and the sixth columns of the above table, thus obtaining the following tables.
Econometrics: Module-II
Bedru B. and Seid H
st
1 -1 3 0 -2 1 0 -1 -2 1
2 nd
0 -1 1 0 0 1
3 rd
1 -1 -1 0 0 -2 1 0 0
Fourthly. Form the determinant(s) of order (G-1) and examine their value. If at
least one of these determinants is non-zero, the equation is identified. If all the
determinants of order (G-1) are zero, the equation is underidentified.
In the above example of exploration of the identifiability of the second structural
equation we have three determinants of order (G-1)=3-1=2. They are:
(the symbol stands for ‘determinant’) We see that we can form two non-zero
determinants of order G-1=3-1=2; hence the second equation of our system is
identified.
Fifthly. To see whether the equation is exactly identified or overidentified we use
the order condition With this criterion, if the equality sign is
satisfied, that is if , the equation is exactly identified. If the
inequality sign holds, that is, if , the equation is overidentified.
In the case of the second equation we have:
G=3 K=6 M=3
And the counting rule gives
(6-3)>(3-1)
Therefore the second equation of the model is overidentified.
The identification of a function is achieved by assuming that some variables of the
model have zero coefficient in this equation, that is, we assume that some
variables do not directly affect the dependent variable in this equation. This,
however, is an assumption which can be tested with the sample data. We will
examine some tests of identifying restrictions in a subsequent section. Some
Econometrics: Module-II
Bedru B. and Seid H
examples will illustrate the application of the two formal conditions for
identification.
Example 1. Assume that we have a model describing the market of an agricultural
product. From the theory of partial equilibrium we know that the price in a market
is determined by the forces of demand and supply. The main determinants of the
demand are the price of the commodity, the prices of other commodities, incomes
and tastes of consumers. Similarly, the most important determinants of he supply
are the price of the commodity, other prices, technology, the prices of factors of
production, and weather conditions. The equilibrium condition is that demand be
equal to supply. The above theoretical information may be expressed in the form
of the following mathematical model.
The above model is mathematically complete in the sense that it contains three
equations in three endogenous variables, D,S and P 1. The remaining variables, Y,
P2, C, t are exogenous. Suppose we want to identify the supply function. We
apply the two criteria for identification:
1. Order condition:
In our example we have: K=7 M=5 G=3
Therefore, (K-M)=(G-1) or (7-5)=(3-1)=2
Consequently the second equation satisfies the first condition for identification.
Econometrics: Module-II
Bedru B. and Seid H
2. Rank condition
The table of the coefficients of the structural model is as follows.
Variables
Equations S
st
1 equation -1 0 0
2nd equation 0 0 -1
3rd equation 1 0 0 0 0 1 0
Following the procedure explained earlier we strike out the second row an the second,
third, fifth, sixth and seventh columns. Thus we are left with the table of the coefficients
of excluded variables:
Complete table of Table of parameters of
Structural parameters variables excluded from
the second equation
-1 0 0 -1
0 0 1
1 0 0 0 0 1 1 -1 0
From this table we can form only one non-zero determinant of order
(G-1) = (3-1) =2
Econometrics: Module-II
Bedru B. and Seid H
We strike out the first row and the three first columns of the table and thus obtain
the table of coefficients of excluded variables.
-1
Complete table of 0 0
0 Table of coefficients of
0 0 -1
0 parameters
structural 0 -1
excluded variables 0
0 -1 0 0 0 0 0 0
1 -1 0 1 0 1 -1 0 0
We evaluate the determinant of this table. Clearly the value of this determinant is
zero, since the second row contains only zeros. Consequently we cannot form any
nonzero determinant of order 3(=G-1). The rank condition is violated. Hence we
conclude that the consumption function is not identified, despite the satisfaction of
the order criterion.
B. The investment function is overidentified
Econometrics: Module-II
Bedru B. and Seid H
1. Order condition
The investment function includes two variables. Hence
K-M = 6-2
Clearly (K-M) > (G-1), given that G-1=3. The order condition is fulfilled.
2. Rank condition
Deleting the second row and the fourth and fifth columns of the structural
coefficients table we obtain.
Complete table of structural Table of coefficients of
Parameters excluded variables
-1 0 0 0
0 0 0 -1 0 -1 0
0 -1 0 0 0 0 -1 0
1 -1 0 1 0 1 -1 -1 0 1
The value of the first 3x3 determinant of the parameters of excluded variables is
(provided )
The rank condition is satisfied since we can construct at least one non-zero
determinant of order 3=(G-1).
Applying the counting rule we see that the inequality sign holds:
4>3; hence the investment function is overidentified.
Econometrics: Module-II
Bedru B. and Seid H
structural model. The rank condition here refers to the value of the determinant
formed from some of the reduced form parameters, π‘s.
Econometrics: Module-II
Bedru B. and Seid H
This model is complete in the sense that it contains three equations in three
endogenous variables. The model contains altogether six variables, three
endogenous and three exogenous
The reduced form of the model is obtained by solving the original equations for
the exogenous variables. The reduced form in the above example is:
Strike out the rows corresponding to endogenous variables excluded from the
particular equation being examined for identifiability. Also strike out all the
columns referring to exogenous variables included in the structural form of the
particular equation.
After these deletions we are left with the reduced form coefficients of exogenous
variables excluded (absent) from the structural equation. For example, assume that
Econometrics: Module-II
Bedru B. and Seid H
we are investigating the identification procedure are found by striking out the first
row (since , does not appear in the second equation) and the third column (since
, is included in this equation).
Complete table of reduced Table of reduced form
form coefficients coefficients of excluded
exogenous variables
Thirdly. Examine the order of the determinants of the π’s of excluded exogenous
variables and evaluate them. If the order of the larges non-zero determinant is
G*-1, the equation is identified. Otherwise the equation is not identified.
Major References
Econometrics: Module-II