Download as pdf or txt
Download as pdf or txt
You are on page 1of 6

econometrics

On the remarkable success of the


Arellano-Bond estimator
by: Tom Wansbeek1

Research often begins with some kind of fascination. This is certainly true in the present case. The fascination is
generated by figure 1. It shows the pattern, over the years, of the citations to the paper by Arellano and Bond (1991).
This paper was published in one of the top journals in economics, the Review of Economic Studies. Whatever the
paper may be about, the pattern is certainly striking, justifying the “remarkable success” in the title. If you don’t
find this picture fascinating, don’t read on!

Figure 1: Citations to Arellano and Bond (1991)

The picture shows something like exponential growth. what the paper by Arellano and Bond (1991), AB
The growth seems to taper off a little recently, but an hereafter for brevity, is in fact about. The issue is to
inspection of the citations data over the first half of 2012, estimate a dynamic model for panel data,
as taken from the endlessly captivating Web of Science,
shows that the citation frequency has in fact doubled, and (1)
an update of the picture at the end of the year would need
stretching the vertical axis by a factor of two. By way of where t = 1, ... ,T indexes time and i = 1, ... ,N indexes
benchmark, the number of citations to the paper will soon individuals, for whom (people) or for which (e.g. firms)
overtake the number of citations to the classical paper by a variable y is observed repeatedly over time, so we
Hansen (1982) that started the generalized method of have so-called “panel data”. As usual in panel data
moments (GMM) revolution in econometrics. models, there is an individual effect capturing the
This being said, it may not hurt to briefly summarize unobservable, time-constant traits of i, and the model
is completed by an error term commonly assumed
uncorrelated over time. The parameter of interest is α, the
Tom Wansbeek (1947) autocorrelation parameter, for which we want to have a
Tom Wansbeek is Professor of Statistics and Econometrics and for- consistent estimator. We consider the case of large N and
mer Dean at the University of Groningen. He obtained his MSc in small T, so the kind of consistency we have in mind is
Econometrics from the University of Amsterdam (1972). After his one where T is fixed and N goes to infinity.
PhD from the University of Leiden (1980) he has worked with the
Netherlands Central Bureau of Statistics, the University of Southern 1 I would like to thank Manuel Arellano and Jan Kiviet for
California and the University of Amsterdam. He has published in their very useful comments, without of course implicating
econometrics (panel data models, measurement error and latent vari- any support for my points of view.
ables), linear algebra and marketing.

AENORM vol. 20 (77) December 2012 15


econometrics

Figure 2: The AB estimator as from the original

AB in perspective
The problem with consistent estimation is that yit AB in perspective
depends on γi . As is clear from the model, this holds for
all t, so the variable at the right-hand side of the model, Another view at the remarkable success of AB is offered
yi,t-1 also depends on γi. Hence there is an endogeneity through a comparison with a number of other papers
problem that we need to tackle if we want to avoid dealing with the dynamic panel data model. Table 1 gives
the risk of ending up with an inconsistent estimator of citation numbers, now in pairs of two as I have added
α. The usual approach is through instrumental variables the numbers from Google Scholar. These numbers are
(IV), and that is also the approach here, as it appears to roughly four times those from the Web of Science, which
be possible to derive instruments from the model; we are is what you usually find; Google Scholar refers to any
in the fortunate situation that we don’t need instruments source that can be found on the internet, whereas the Web
from some external source. AB is one such approach and, of Science only considers citations from a rather select
in fact, by far the dominant one in terms of number of set of international journals; having a decent refereeing
empirical applications. system is a prerequisite for a journal to be included. The
The idea of AB is to transform the model into first success of AB is dramatically brought out by its hitting,
differences. This eliminates the individual effects from somewhere in the beginning of this year, the 10,000 mark
the model. Their presence caused the endogeneity on Google Scholar.
problem and, when gone, cannot cause problems
anymore. For the thus transformed model, the variables Google WoS
yi,t-2 and their predecessors are valid instruments. These
instruments can be used in a GMM approach to obtain an Arellano and Bond (1991) 10342 2349
asymptotically efficient estimator of α. The fame of AB
is based on this simple idea. For the fun of it, I reproduce Blundell and Bond (1998) 5465 1290
the relevant paragraph from their paper, see figure 2. Arellano and Bover (1995) 4588 1021
This short paragraph does it, and brought the authors
Holtz-Eakin, Newey and Rosen (1988) 1380 359
a number of citations of which I am a little jealous. In
fact there is not so much new here since, as was of Anderson and Hsiao (1982) 1384 320
course acknowledged by AB, the idea of using earlier Anderson and Hsiao (1981) 1257 294
observations on y as instruments in a first-differenced
model was already a decade old and was due to Anderson Balestra and Nerlove (1966) 852 319
and Hsiao (1981, 1982). They use only the most recent Ahn and Schmidt (1995) 637 153
preceding y as instrument. What AB added to this was to
use all preceding y’s. A more important contribution of AB, Hsiao, Pesaran and Tahmiscioglu (2002) 153 30
not contained in this paragraph but described at the end of Wansbeek and Bekker (1996) 32 10
the paper, was the presentation of test statistics to test for
autocorrelation in the residuals. This is a critical issue as Table 1: Number of references to selected papers.
the consistency of the AB estimator depends on the νit not
being correlated over time. Incidentally, the observation
made in the last sentence of the paragraph shown was later
on elaborated by Ahn and Schmidt (1995).

16 AENORM vol. 20 (77) December 2012


econometrics

Apart from AB and the other papers that already have and Bond (1991) settled what later has become the
been mentioned, the list contains a selection of other bible for estimating [the dynamic model]” (Soto, 2003).
papers on the dynamic panel data model. The papers by Another reason may come from the teachers’ side. Many
Arellano and Bover (1995) and Blundell and Bond (1998) people over the world (at least, me) teach a course in
were the basis of “System GMM”, with instruments microeconometric models. Often, the theory behind
added to AB that in a sense are the mirror image of AB, GMM is taught somewhere in the beginning of the course.
that is, instruments in difference form used to estimate Later on, panel data models are on the agenda. The AB
the model in its original form in levels. Holtz-Eakin et approach to the dynamic model yields instruments from
al. (1988) elaborated vector autoregression in panel data within the model, which is a rewarding moment for
models, and Balestra and Nerlove (1966) were the first the teacher, and the abundance of instruments nicely
to present an estimator of the dynamic panel data model motivates GMM, which is equally rewarding. Also,
by maximum likelihood. A fairly recent and exhaustive AB’s popularity may be due to a “signaling” function.
treatment of maximum likelihood estimation was given Citing AB clarifies the positioning of a paper in a way
by Hsiao et al. (2002). everybody understands: the paper is clearly about the
I could not resist the temptation to include a paper that dynamic panel data model.
I wrote with my Groningen colleague Paul Bekker in the
1990’s. This paper is mentioned as the last (and least-
cited) entry in the table. As is apparent from the number What kind of dynamics?
of citations, it has more or less been neglected, although
ten citations (no self-citations) is not even that bad for a But there is a more fundamental issue. Behind the popu-
paper published in Economics Letters, where it ended up larity of AB looms another, more general phenomenon,
after being rejected by I forgot which journal. which is the popularity of the dynamic panel data model
The reason to mention it here is that an extended in general. Why has this model become so popular?
version of it, taking additional regressors into account, Again speculating, there are various possible
developed by Harris and Mátyás (2000) and called WB+ answers. From a theorists’ point of view, one reason
by them, in their words including the italics, “generally for the popularity of the dynamic panel data model is
outperformed all other estimators when T was moderate that it is just a very interesting model to work on. The
in all of the situations that an applied researcher might model looks deceivingly simple but yet contains all
encounter.” The other estimators included AB. So we kinds of complications that have invited research up
had the best method on offer at the time, but nobody till the present day. Also, the dynamic panel data model
noticed. Too bad, but such is academic life, sometimes. is a substantively important model as it allows for
We apparently sold our method poorly. disentangling “state dependence” (through the lagged y
Apart from the sheer number of citations by itself, the in the model) and “heterogeneity” (as reflected by the
pattern of citations over time is also a striking feature individual effect in the model). And, last but not least,
of figure 1. The fame of AB developed slowly until the see above, the dynamic formulation may just be the
turn of the millennium, when the number of citations appropriate one, as justified from the underlying theory.
started to grow going over into something resembling an Yet the dynamic specification may not always be best,
explosion over the most recent years. The sky is the limit. and there may be a certain degree of overenthusiasm
At first sight this may not seem remarkable as this for it. Let me explain what I mean, starting from the
pattern is a good proxy of panel data econometrics, following observations. In panel data, the dependent
which has become a healthily growing subfield of variable, y, is always highly persistent. There is still a lot
econometrics, theory and empirics equally. But what of persistence left after projection on the (equally highly
holds at the aggregate need not hold at the level of a single persistent) regressors, x. This is fair enough as the factors
paper. If a paper is important and makes a contribution, that you don’t observe, captured in the error term u, could
it inspires other researchers to build on it and to come be (more or less) equally persistent as the things you do
up with new and better results, which in due course will observe, x. This suggests immediately that any panel data
outshine the paper that inspired it; the source fades away model should allow for an unconstrained time structure
as a paradoxical reflection of success. This is what you of u as there is usually no justification for the opposite.
often see but, by sharp contrast, such a development The model is then a specific form of the so-called
did not occur in the case of AB. The sheer fact that it is “seemingly unrelated regression model” or SUR model.
just a very good paper, fully deserving its place in a top This does of course not preclude the model from having
journal and inspirational for many others, leaves open the the lagged y among the regressors. Yet, as an econometric
question as to its persistent popularity. modeler, you want to keep things simple if possible and
The answer is of course speculative. But speculation you are tempted not to do everything at the same time
is fun. One reason may be is that it is easily available but to consider either dynamics in y or correlation over
in various packages like Stata. The threshold for its use time in u.
is agreeably low, and AB has become the standard; to The question then is where to start. Sometimes the
give a typical quote, “[in] an influential article, Arellano choice is simple. In quite a few cases the economic theory

AENORM vol. 20 (77) December 2012 17


econometrics

underlying the case at hand implies a dynamic model. approach is the simplest one. But as yet I have no better
Examples are growth models, habit-formation models, alternative.
and models based on dynamic optimization. Also, apart The whole issue points a topic that, surprisingly, has
from articulate economic theorizing, a dynamic model not received any research effort as far as I am aware of.
follows, in any context, from partial adjustment in an It is about the following. As was said already above, AB
equilibrium-seeking context. To model this, we assume presents tests for correlation over time of the residuals.
that the static equilibrium value y*it is for an endogenous If no such correlation is found, starting with a dynamic
variable yit, after a realization of the innovation uit has model is apparently justified. But one can also start
been obtained, is given by with a model with u freely correlated over time, and
next test whether the lagged dependent variable should
(2) be added to the model. This is hardly if ever done. The
critical issue here is that both approaches may lead to
different conclusions. An estimator for the structural
where xit is an exogenous variable and i is the individual parameter that is consistent under one specification will
effect of cross-sectional unit i. The path to a static be inconsistent under the other, and the difference can be
equilibrium is described by a partial adjustment model, huge. Some kind of tie-breaking mechanism should be
introduced. My preference for simplicity would lead me
(3) choose the static model with correlated u. Sorting these
very important issues out deserves a place high on the
research agenda. An excellent starting point would be to
Substitution gives extend the ideas of general-to-specific model selection
(e.g., Hendry, 2000) to the panel data context.
(4)

A brief look at the empirical reality


yielding the dynamic panel data model. Notice that
estimation of this model produces an estimate of the short- In order to get an idea about the reasons why empirical
run coefficient (1-α)β and not of the long-run coefficient researchers use the dynamic panel data model, I
(or “structural parameter”) itself. So a trivial bit of extra consulted the Web of Science again, this time to check
work is needed to get an estimate of the parameter of the papers that actually cite AB. Given the huge amount
interest, and a less trivial bit of extra work gives you its of citations, I had to make a selection. At the time I made
asymptotic standard error. this selection, in October 2011, AB had 1925 citations,
Otherwise, if there is no compelling a priori reason which happens to be 25 × 77. Since you can set the Web
to choose between the two approaches, dynamics in y of Science at 25 entries on a page, it was logistically
or correlation over time in u, the choice might be left easy to select the bottom entry on each page, leading to
to invoking a philosophical principle commonly called a manageable 77 papers, equally spread over the citing
Ockham’s razor. There are various formulations of this papers in order of time. Next I went after these papers
principle but it comes down to the idea that, other things through my university’s electronic library.
being equal, simpler explanations are generally better It so happened that eight of these papers could not
than more complex ones. When applying this principle be found there. Another seven papers had no empirical
in the present context one can argue that starting with content, and yet another eleven were empirical but the
correlation over time in u is simpler than starting from model after all was not dynamic. This left me with 51
dynamics in y since the econometric theory behind the papers for inspection, dealing with a bewildering and
SUR model is quite a bit simpler than the theory behind fascinating range of topics; the dynamic model is all over
the dynamic panel data model. the place.
Since econometricians like quantification, there is a The first thing to look at was the motivation behind
statistic that illustrates this point, and that is the amount of the specification of a dynamic model, and in particular
research effort put in both. When scanning the literature the strength of this motivation. In principle this is a well-
over the last ten years, it is hard to find developments defined job but it clearly has a strong subjective element.
around the SUR model, whereas a fifteen-minutes
search for the literature about the dynamic panel data No (clear) argument 17
model showed that at least 80 researchers have written
about the dynamic panel data model in these ten years. Partial adjustment 11
The list is not just very long but is also impressive as “Weakly” theory-based 16
to its quality since it includes a number of the world’s
“Strongly” theory-based 7
leading econometricians. Such a comparison by head
count of research effort may seem a little weird, and I Table 2: Motivation for a dynamic specification.
am happy to trade it in for a better way to show which

18 AENORM vol. 20 (77) December 2012


econometrics

Moreover, I did the job rather quickly, in a first round Another issue is residual autocorrelation. This issue
that I intend to replicate later, so there will no doubt be is crucial as the presence of autocorrelation renders the
inaccuracies; scanning so many papers about so many AB estimator inconsistent. Out of the 51 papers, 20
different topics is a very interesting job, but it is also did not report test results in this important matter. The
sometimes hard to stay concentrated and not to make a other 31 did, and 24 of them obtained test results that
run for the coffee machine when yet another dynamic did not necessitate to reject the null-hypothesis of no
model pops up. autocorrelation. The other seven had to reject the null-
With these caveats, a first set of results of this look at hypothesis although that did not induce further action.
a sample from the AB-citing literature are summarized This suggests that correlation in the error term is not a
in table 2. It is about the motivation for using a dynamic matter of great concern. To repeat the point made above,
specification. It appears that a third of the papers did not however, we could have reached a different conclusion
motivate the dynamic element in a clearly visible way. Of about the model when we would have started from the
the remaining two-thirds of the papers, partial adjustment position that there is such correlation, and test for the
was clearly the favorite, being mentioned, in some form presence of the lagged dependent variable in the model.
or another, in eleven papers. This would lead to a different conclusion about the
Partial adjustment is a sound argument for a dynamic structural parameters in the model.
model, yet something strange appeared. As is apparent
from the discussion of the partial adjustment model given
above, a paper that takes partial adjustment seriously Summing up
should report estimates of the long-run coefficients, β,
not the short-run ones, (1 - α)β, which come out of the One of the great advantages of having panel data availa-
computer first; the long-run coefficients are the structural ble is they can provide insight into the dynamics under-
parameters and should be the objects of interest. Yet only lying the relations that you want to analyze. This mes-
two of the eleven papers invoking partial adjustment did sage is not lost on the research community, given the
this, in a rather minimal way. remarkable success of the Arellano-Bond estimator. Ho-
This left me with 23 out of the 51 papers having some wever, the source of the dynamics is sought very much
kind of substantive story behind the dynamics. In most one-sided in the dynamics in the dependent variable, at
of these cases, though, the motivation is not very deep the cost of attention for dynamics in the error term. Tes-
or very strong, but at least it gets some attention. Only ting between the two (or rather, between a much larger
seven out of the 51 papers take the dynamics more or class of models encompassing them) is a neglected topic
less seriously. Two of these papers deal with growth in econometric theory, and the more so in econometric
models. I was left with the impression that the dynamic practice, although the effects on the estimation of the
element in the model is not a matter of great concern to structural parameters of misspecification can be huge.
applied researchers. Many of the papers showed great Also, the potential of using exogenous variables as
competence and loving attention in discussing the subject instruments is a matter deserving more attention that
matter at hand, with the dynamics playing a minor role. it has received up till now. One reason for this relative
The interest in the precise value of the coefficient of the neglect may be that many papers start by investigating
lagged dependent variable appeared meager. Yet this the dynamic panel data model without further regressors,
is a topic to which still a huge research effort is being adding them later on as an afterthought, that is, as a
dedicated. This was a somewhat melancholic-making (minor) problem that has to be tackled, too, instead as a
finding. part of the solution.
A next issue of interest from inspecting the literature So this short paper ends, like almost all papers in
concerned the methods actually used by the researchers. econometrics, with the conclusion that further research
It appears that 29 out of the 51 papers use AB. This is is needed. Together with my colleagues Laura Spierdijk,
not surprising, of course. Somewhat more surprisingly, also from Groningen, and Christoph Hanck, from the
System GMM, considered superior in a stationary model, Universität Duisburg-Essen, I am trying to elaborate
is used in only twelve papers. The result is no doubt some of the issues raised. I can’t guess how far we
biased since the selection of papers is based on citing AB. will ever come, but dreaming of thousands of citations
Ten papers used different methods. Two used plain, good certainly motivates!
old OLS, another two applied methods that adjust AB for
small-sample bias, in yet another two cases I could not
easily find out what actually has been done, one paper
used the Anderson-Hsiao instrumental variable, and three
papers used lagged values of x as instruments. There is
a lot in favor of the latter, but this again is a issue in
panel data analysis that gets far too little attention,
unfortunately; there are situations where using lagged
values of x as instruments leads to superior results.

AENORM vol. 20 (77) December 2012 19


econometrics

References

Ahn, S.C. and P. Schmidt (1995), “Efficient estimation Holtz-Eakin, D., W. Newey and H.S. Rosen (1988),
of models for dynamic panel data”, Journal of “Estimating vector autoregressions with panel data”,
Econometrics, 68, 5–27. Econometrica, 56, 1371–1395.

Anderson, T.W. and C. Hsiao (1981), “Estimation of Hsiao, C., M.H. Pesaran and A.K. Tahmiscioglu (2002),
dynamic models with error components”, Journal of “Maximum likelihood estimation of fixed effects
the American Statistical Association, 77, 598–606. dynamic panel data models covering short time
periods”, Journal of Econometrics, 109, 107–150.
Anderson, T.W. and C. Hsiao (1982), “Formulation and
estimation of dynamic models using panel data”, Soto, M. (2003), “Taxing capital flows: an empirical
Journal of Econometrics, 18, 47–82. comparative analysis”, Journal of Development
Economics, 72, 203–221.
Arellano, M. and S. Bond (1991), “Some tests of
specification for panel data: Monte Carlo evidence Wansbeek, T.J. and P.A. Bekker (1996), “On IV, GMM
and an application to employment equations”, Review and ML in a dynamic panel data model”, Economics
of Economic Studies, 58, 277–297. Letters, 51, 145–152.

Arellano, M. and O. Bover (1995), “Another look at the


instrumental variable estimation of error-components
models”, Journal of Econometrics, 68, 29–51.

Balestra, P. and M. Nerlove (1966), “Pooling cross-


section and time series data in the estimation of
a dynamic model: the demand for natural gas”,
Econometrica, 34, 585–612.

Blundell, R. and S. Bond (1998), “Initial conditions and


moment restrictions in dynamic panel data models”,
Journal of Econometrics, 87, 115–143.

Hansen, L.P. (1982), “Large sample properties of


generalized method of moments estimators”,
Econometrica, 50, 1029–1054.

Harris, M.N. and L. Mátyás (2000), “Performance of the


operational Wansbeek-Bekker estimator for dynamic
panel data models”, Applied Economics Letters, 7,
149–153.

Hendry, D.F. (2000), “Epilogue: the success of general-


to-specific model selection”, in D.F. Hendry, editor,
Econometrics: alchemy or science? Essays in
econometric methodology, Oxford University Press,
467–490.

20 AENORM vol. 20 (77) December 2012

You might also like