Professional Documents
Culture Documents
Dynarski - 2003 - Does Aid Matter PDF
Dynarski - 2003 - Does Aid Matter PDF
By SUSAN M . DYNARSKI*
The United States spends billions of dollars cent of full-time college students aged 18 to 21
each year on financial aid for college students, were receiving Social Security student
but there is littie evidence that these subsidies benefits.^
serve their goal of increasing college attendance In 1981, Congress voted to eliminate the pro-
and completion. Determining whether aid af- gram. Enrollment sank rapidly (see Figure 1):
fects schooling decisions is an empirical chal- by the 1984-1985 academic year, program
lenge. Tbe traditional approach bas been to re- spending had dropped by $3 billion. Except for
gress a person's educational attainment against the introduction of the Pell Grant program in the
covariates and the aid for which he is eligible early 197O's, and the various G.I. bills, this is
and interpret the coefficient on aid as its casual the largest and sharpest cbange in grant aid for
effect. However, this is problematic, as aid eli- college students that bas ever occurred in the
gibility is correlated with many observed and United States. The program's demise provides
unobserved characteristics that affect school- an opportunity to measure the incentive effects
ing decisions. In order to identify the effect of financial aid. Using difference-in-differences
of aid, we need a source of variation in aid methodology, and proxying for benefit eligibil-
that is plausibly exogenous to unobservable ity with the death of a parent during an individ-
attributes that influence college attendance. A ual's childhood, I find ttiat the elimination of the
shift in aid policy that affects some students but Social Security student benefit program reduced
not others is one such source of exogenous college attendance probabilities by more than a
variation. third. These estimates suggest that an offer of
In this paper, I analyze the impact on college $1,000 in grant aid increases tbe probability of
attendance and completed schooling of the attending college by about 3.6 percentage
elimination of the Social Security Student Ben- points. Aid eligibility also appears to increase
efit Program in 1982. From 1965 to 1982, the completed schooling.
Social Security Administration paid for millions
of students to go to college. Under this program, I. Empirical Framework
the 18- to 22-year-old children of deceased,
disabled, or retired Social Security beneficia- We are interested in the effect of aid on a
ries received monthly payments while enrolled person's educational attainment. Tbis relation-
full time in college. The average annual pay- ship can be expressed with the following re-
ment in 1980 to tbe child of a deceased par- duced-form equation:
ent was $6,700. All dollar amounts are in real
terms ($2,000). At tbe program's peak, 12 per- (1)
In 1981, Congress voted to elitninate the So- cation controls for changes over time in average
cial Security student benefit program. Those not college attendance rates and average differences
enrolled in college as of May 1982 were ineli- in the college attendance of those with a de-
gible for future subsidies, while those currently ceased father and those with a living father. The
enrolled in college had their payments severely key identifying assumption is that any relative
reduced. By the 1983-1984 academic year, pro- shift in the attendance of the children of de-
gram spending had dropped to $0.38 billion. ceased fathers is attributable to the withdrawal
This sharp policy shift creates variation in aid of student benefits. Note that )3 captures the
eligibility that can be used to identify the effect effect on schooling decisions of aid eligibility
of grant aid on schooling decisions. rather than aid receipt. In the language of the
I use difference-in-differences methodology experimentalist literature, j3 captures the effect
to examine the effect of eligibility for Social of the intention to treat. Since policy makers
Security student benefits on college attendance control the offer of aid, but not its take-up, /3 is
and completed schooling. The key estimating the parameter of interest if we wish to predict
equation is the following: the effect of altering aid policy.
The data used in the analysis are the National
(2) Longitudinal Survey of Youth (NLSY). See the
Data Appendix for details. Survey respondents
V, = Q + ^(Father Deceased^ X Before;) in their senior year of high school in the springs
of 1982 and 1983 form the "after" cohorts, who
+ SFather Deceased^ were ineligible for any student benefits upon
high-school graduation. Those who were se-
+ dBefore, + i;, niors in the springs of 1979,1980, or 1981 form
the "before" cohorts.
where the dependent variable is a measure of Means, shown in Table 1, are presented sep-
college attendance or completion and Before^ is arately for the periods before and after the pol-
a binary variable that is set to one if a youth is icy change and for those with living and
a member of a cohort that graduated from high deceased fathers. Five percent of children had a
school before student benefits were eliminated. male parent die before the child turned 18; this
Father Deceased; is a binary variable set to figure is consistent with mortality tables for the
one for those who, due to the death of their relevant age cohorts. Children with deceased
father, were potentially eligible for child survivor fathers grow up in relatively low-income fami-
benefits."" I focus on eligibility due to the death lies and are more likely to live in single-parent
of the parent because parental disability and households.^ Children with deceased fathers are
retirement may be endogenously determined by more likely to be black, due to the higher mor-
the availability of student benefits. This endog- tality rate of prime-age black men, and they
enous selection into aid eligibility would bias have lower Armed Forces Qualification Test
upward the difference-in-differences estimator. (AFQT) scores."^ As the last column shows,
I focus on fathers because 90 percent of student these differences between the two groups are
beneficiaries were entitled to benefits through stable over time. During the period under anal-
their fathers.^ ysis, there is no statistically significant change
The reduced-form effect of Social Security in the differences in background characteristics
student benefits is captured by ^. The specifi- between children with living and dead fathers.
^ Having a deceased father is an imperfect proxy for ^ Some wives remarry after the husband's death, and so
benetit eligibility, since some fathers did not work long not all deceased-father children live in a single-parent
enough in covered employment to generate survivor bene- household. Children continue to be eligible for survivor
fits. As I discuss in Section in, this mismeasurement of benefits if their mothers remarry.
eligibility is minor and will bias the paper's estimates to- '" Blacks are twice as likely to have a dead father (7.2
ward zero. percent vs. 3.4 percent). This is consistent with the National
^ See Social Security Administration (1982). Fathers are Longitudinal Mortality Survey, which shows that the mor-
more likely to have a sufficient working history to generate tality rate for black men aged 25 to 50 is twice that of white
survivor benefits upon death.
282 THE AMERICAN ECONOMIC REVIEW MARCH 2003
Notes: Means are of NLSY poverty and random samples, weighted by 1988 sample weights. Income and household
composition measured during senior year of high school. AFQT is age adjusted; see Data Appendix. Standard errors are
in parentheses. Standard errors in the difference-in-differences column adjusted for clustering at the household
level.
mates attended. The probability of college en- TABLE 2—OLS, EFFECT OF ELiGiBtUTY FOR
STUDENT BENEFITS ON PROBABILITY
rollment dropped by more than a third for the OF ATTENDING COLLEGE BY AGE 23
group with deceased fathers (20.8 percentage
points), while it barely dropped for other stu- (I) (2)
dents (2.6 percentage points). The estimated Difference- Add
effect of eligibility for Social Security student in-differences covariates
benefits on tbe probability of attending college Deceased father X before 0.182 0,219
is the difference in these two differences: 18.2 (0.096) (0.102)
percentage points. This estimate is statistically Deceased father -0,123 Y
significant at the 6-percent level. (0.083)
Before 0.026 Y
I next use regression analysis in order to (0.021)
probe the robustness of this result. I include as Senior-year family income/ Y
covadates family size, income, parental educa- 10,000 ($2,000)
tion, and marital status of household head, all of AFQT score Y
which are measured when the youth is a high- Black Y
Hispanic Y
school senior.'^ AFQT score and state-of- Father attended college Y
residence dummies are also included; these Mother attended coUege Y
variables are measured in the first year of the Single-parent household Y
survey. Additional covariates are age (as of the Family size Y
1988 survey), race, and gender. Results are not Female Y
Age in 1988 Y
sensitive to the functional form taken by age State dummies Y
(linear, quadratic, or dummies). Further, I in- All covariates X before Y
clude two sets of interaction terms: (1) the in- All covariates X deceased Y
teractions of the covariates just discussed with father
the "before" dummy and (2) their interactions 0,002 0.339
Number of observations 3,986 3,986
with the deceased-father dummy.^^ The interac-
tion terms will absorb bias caused by beteroge- Notes: Regressions weighted by 1988 sample weights. Stan-
neity across time and eligibility status in the dard errors adjusted for heteroskedasticity and multiple ob-
effect of the covariates. An example will clarify. servations within households.
A secular drop in the black college attendance
rate coincides with the eliniination of student
benefits. Since youth with a deceased father are Table 2 presents results. The estimated effect
disproportionately black, tbis will bias upward of aid eligibility on attendance barely changes
the estimated effect of aid eligibility if the effect with the addition of this extensive set of covari-
of race is constiained to be constant over time. ates: it is 21.9 percentage points, with a standard
Similarly, tbe ccpUege attendance of low-income error of 10.2 percentage points. However, the
youth may have been particularly affected by explanatory power of the regression rises dra-
tbe 1981-1982 recession, inducing an interac- matically, from 0.002 to 0.339. This regression
tive effect of time and income.''* clearly captures many of the key determinants
of college attendance; an R^ of 0.339 is espe-
cially high for a linear probability model. The
robustness of the point estimate to the inclusion
'^Family income is imputed if missing; see the Data
Appendix. A dummy indicating these imputed values is of this extensive set of covariates provides
included in the regression. Dummies indicating whether strong support for the identifying assumptions
either mother"s> or father's education is missing are also of the paper.
included.
'^ The variables indicating missing data are also inter- Bruce Meyer (1995) points out that diiference-
acted with the before and deceased dummies. in-differences estimates can be sensitive to
'* The repeal of the Middle Income Student Assistance functional form. In particular, the difference-in-
Act (MISAA) may also induce an interaction between in- differences estimate can actually change sign if
come and time, I have run a version of the specification that
Includes dummies corresponding to income eligibility cu(-
a nonlinear transformation, such as a log, is
offs for need-based federal aid before and after the repeal of applied to the dependent variable. The present
MISAA. along with their interaction with the "before" estimates are not vulnerable to tbis most severe
dummy. The results are unaffected- form of functional-form sensitivity. As can be
284 THE AMERICAN ECONOMIC REVIEW MARCH 2003
seen in Table 1, the children of deceased fathers TABLE 3—OLS, EFFECT OF EuGiBiLrrY FOR
were more likely that their counterparts to at- STUDENT BENEFTTS ON SCHOOLING OUTCOMES
tend college before the pohcy change but less BY AGE 23 AND AGE 28
likely to attend college afterward. Under these Attended Completed
conditions, linear and nonlinear analysis will college any years Years of
produce estimates of the same sign, though their full time of college schooling
magnitude may vary. By age 23 0.219 0.145 0.564
The results in Table 2 suggest that aid eligi- (0.102) (0.123) (0.379)
bility has a strong effect on college attendance. By age 28
In the next section, I will put the magnitude of Lower bound 0.224 0.178 0.679
this effect in context. I first examine whether aid (0,106) (0.113) (0.399)
Exclude attriters 0.248 0,191 0.754
eligibility increased completed schooling in ad- (0.111) (0.118) (0.408)
dition to college entry. These estimates are of Assign last value 0.256 0.211 0.727
interest because it is completed schooling that is (0.105) (0.112) (0,397)
rewarded by the labor market, rather than at- Estimates Adjusted for Classification Error
tempted schooHng. If the marginal college en-
trant is not capable of completing even a year of By age 23 0,243 0,161 0.626
By age 28
college, then the attendance results discussed Lower bound 0.249 0,198 0.754
above will substantially overstate the social
benefits of student aid. The estimates, based on Notes: Coefficients are those on deceased father x before in
the fully controlled specification of Table 2, are regressions in which the outcomes are those indicated in the
in Table 3. EUgibility for student benefits appears columns. The regression specification is that of column (2)
in Table 2, See text for explanation.
to increase the probability of completing at least
a year of college by 14.5 percentage points and
years of completed schooling by about half a For none of the outcomes are the estimates at
year, though neither estimate is significant. age 28 lower than those at age 23. This suggests
The positive effect of aid eligibility on atten- that aid eligibility did not simply speed up in-
dance and completion could dissipate over time if vestment in schooling but also raised its optimal
student benefits induce students to simply accel- level. The three approaches to handling attrition
erate, rather than increase, their schooling invest- yield similar results. The lower-bound estimate
ments. I therefore examine schooling decisions as is that eligibility for student benefits increases
of age 28. There is attrition between age 23 and the probability of attending college by age 28 by
28; nonrandom attrition has the potential to bias 22.4 percentage points, which is almost identi-
these estimates.^^ I test three altemative ap- cal to the effect estimated at age 23. If we
proaches to dealing with attrition, all of which examine the other schooling outcomes, the
yield similar results: I drop the attriters, I assign same pattern emerges: the lower bound of the
them their last observed value of the dependent effect at age 28 is just shghtly above the effect
variable, and I assign them values that provide a at age 23, indicating that the effect of aid eligi-
lower hound on the effect of aid eligibility in the bility does not dissipate over time. If anything,
presence of nonrandom attrition. I estimate this it appears that the effect on completed schooling
lower bound by imputing to attriters schooling rises over time, though the size of the standard
values that would be produced by a negative errors precludes any strong conclusions.
correlation between the aid eligibility and
schooling.^^ Results are in Table 3. III. Discussion and Conciusions
Otherwise have entered. While many of these duces an increase of 3.6 percentage points in
marginal entrants will complete just a few years the share of high-school graduates attending
of college, aid likely induces others who would college.^"
have completed just a few years of college to The three-year phaseout of benefits that be-
instead finish their degrees. The effect of move- gan in 1982 complicates the interpretation ofthe
ment along these margins is a relative increase completion results. A beneficiary graduating
by age 28 in average schooling of 0.679 years. from high school in 1981 would bave expected
Classification error will bias these estimates four years of full student benefits, but would
toward zero. Misclassification of the eligible have instead received a subsidy tbat declined
group is minor: the Social Security Administra- from $6,700 in tbe freshman year to $1,100 in
tion estimates that, in the early 198O's, 95 per- the senior year. On average, members of the
cent of children under 18 would have been before cohorts who stayed in college for four
eligible for survivor benefits had a working years would have received annual benefits of
parent died. Misclassification of the control $4,700. Therefore, each $1,000 of smdent ben-
group is also minimal. The share of 17-year- efits offered induced an increase of 0.16 years
olds in 1980 whose fathers were not dead but (=0.754/4,7) in tbe completed schooling of
were eligible for Social Security due to the higb-school graduates attending college.^'
disability or retirement of a parent was 5.3 How do these results compare with previous
percent. '' This degree of misclassification indi- estimates of the effect of aid on schooling de-
cates that the estimates of Table 3 should be cisions? Larry Leslie and Paul Brinkman (1988)
adjusted upward by 11 percent.'^ The bottom review several dozen college attendance stud-
panel of Table 3 contains these adjusted esti- ies, which generally suggest tbat a $1,000 de-
mates, which suggest that aid eligibility in- crease in net price is associated with a 3- to
creases the probabilities of attending college by 5-percentage-point increase in attendance. With
age 23 by 24.3 percentage points and of com- few exceptions, discussed below, these esti-
pleting at least a year of college by 16.1 per- mates are vulnerable to the biases discussed
centage points. The effect on completed earlier in the paper. Several studies that control
schooling at age 28 is 0.754 years. for unobserved determinants of schooling have
These are large effects, but so too was the examined the effect of aid on college entry. By
financial incentive. The average student benefit contrast, none have examined its effect on the
for the child of a deceased parent was about completed schooling of young people, and so
$6,700 in 1980, more than enough to cover the the present completion results, while imprecise,
$1,900 cost of tuition and fees at a public uni- break new ground.^^
versity. If we sum the direct and opportunity Using within-state variation in public tuition
costs of college,, the latter proxied by the annual costs, Thomas J. Kane (1994) concludes that a
wage of young high-school graduates ($18,500 $1,O(X) drop in tuition produces a 3.7-percentage-
in 1980) we obtain an elasticity of attendance point increase in college attendance. Dynarski
with respect to schooling costs of about 1.5,'^
Each $1,000 of student benefits offered in-
^•^ The effect of aid may be nonlinear. In the presence of
liquidity constraints, a threshold amount of aid may be
'^ The number of 17-year-olds is from the 1980 Census needed to affect behavior, leading a large grant to have a
and the number of 17-year-olds with parents retired or on larger per-dollar effect than a small grant. It is also plausible
disability is from Table 54 in Social Security Administra- that the marginal effect of aid falls as aid rises.
tion (1982). Note that the NLSY contains no information ^' The interpretation of the attendance results is not
about parents' retirement or disability status, so these indi- complicated by the phaseout. The college entry decision of
viduals cannot be identified. See Dynarski (1999) for an those affected by the phaseout occurred under the assump-
analysis that uses father's age to proxy for benefit eligibility tion of full benefits, since 85 percent who entered college by
due to father's retirement status. age 23 did so directly after high school.
"*See Dennis Aigner (1973) and Richard Freeman ^^ The only comparable completion studies have focused
(1984) for the derivation of this correction for classification on the effect of the G.I. bills on the schooling of veterans,
error. whose behavior is likely quite different from that of the
'^ Annual wage is the average weekly wage of 19-year- typical young person, Joshua Angrist (1993), Marcus Stan-
old high-school graduates in the Merged Outgoing Rotation ley (2000), and John Bound and Sarah Turner (2002) all
Group of the Current Population Survey multiplied by 50 conclude that veterans' education benefits have a positive
and inflated to current dollars. effect on completed schooling.
286 THE AMERICAN ECONOMIC REVIEW MARCH 2003
(2000) finds that Georgia's HOPE Scholarship, the deceased parent and its transaction costs are
a merit-aid program, produced an increase in extremely low.^^ In traditional programs, the
attendance of 4 percentage points per $1,000 of correlation between aid and parents' human
aid offered. W. Lee Hansen (1983) and Kane capital is negative. The paper's estimates will
(1995) find that the introduction of the Pell provide a biased prediction of the effect of
Grant had no effect on college attendance.^^ need-based aid if the response to aid is hetero-
Neil Seftor and Turner (2002) find an effect of geneous and correlated with parental human
Pell Grant eligibility on the attendance rate of capital. If children from high-human-capital
older adults; they estimate an effect of 0.7 per- faniilies are most sensitive to cost, the Social
centage points per Sl,(X)O in aid.^ In summary, Security program will channel dollars to high-
with the exception of the Pell studies, estimates response individuals and the paper will overes-
that do and do not account for unobservable timate the effect of traditional aid. The opposite
differences across individuals reach similar will hold if, instead, children from high-human-
conclusions: a $1,000 drop in schooling costs capital families are less sensitive to cost.^^ The
increases college attendance by 3 to 4 percent- program's very low transaction costs unambig-
age points. This suggests that either the cross- uously tend to make the present estimates pro-
sectional results are unbiased, or, as is the case vide an upper bound on the incentive effect of
in the retum-to-schooling literature, competing traditional student aid, which imposes substan-
biases cancel in a cross-sectional analysis. tial transaction costs on applicants.
Are the present estimates informative as to From a student's perspective, this program
the effect of traditional aid, such as the Pell made college the optimal choice at very low
Grant? Are the student benefit program and the rates of return to schooling. With the student
population it served sufficiently unique that the benefit, a year of college would pay for itself
estimates' external validity is extremely con- with a rate of return as low as 2.5 percent.^^ The
strained? The youth that are the focus of this program therefore likely induced into college
paper are special in at least one way: their some students with a very low ex ante payoff to
fathers are dead. This may make their families schooling. But given the rapid rise in the return
especially sensitive to the price of college, since to schooling since the early 1980's, ex post
they have only one parent's labor supply with returns for those induced into college by the
which to buffer shocks to schooling costs. On student benefit were likely considerably higher.
otber observable characteristics, the population Do the paper's high estimates of the elasticity
eligible for student benefits closely resembles of college attendance with respect to aid indi-
that served by need-based programs. In partic- cate the presence of liquidity constraints? Since
ular, both groups are disproportionately black grant aid reduces the cost of schooling and
and from low-income families.^^ thereby increases its optimal level, a behavioral
In its structure, the Social Security program is
unusual in that benefits rise with the earnings of
^^ Child beneficiaries had to do little to obtain student
benefits. The Social Security Administration sent form let-
^^ Sarah Turner (2000) suggests that schools may have ters to child beneficiaries nearing age 18. To those respond-
"undone" the Pell Grant by lowering the institutional aid ing that they would be continuing their schooling, SSA
they offered low-income students, thereby explaining the mailed separate, monthly benefit checks until the benefi-
zero program effects. ciary left school, married or turned 22. Schools provided
^ While this effect is smaller than the present estimate, annual verification of enrolhnent to the govemment.
it is comparable in magnitude once the estimates are scaled ^"^ Dynarski (2000) shows that, in a simple human-capital
by the baseline share of the relevant population that is in framework, the sign of the correlation is ambiguous. Kane
college. (1994) presents results that indicate that low-income youth
^ Twenty-six percent of deceased-father children and 21 are most sensitive to tuition. By contrast, Stanley (2000) and
percent of Pell Grant recipients are black (National Center Turner and Bound (forthcoming) find that the post-Worid
for Education Statistics, 2000). The average family income War 11 G.I. Bill had the greatest impact on veterans from
more privileged backgrounds.
in 1973 of student beneficiaries placed them in the bottom
income quartile of families with children in college, while ^^ This calculation assumes costs consisting of tuition
90 percent of dependent Pell Grant recipients are from and fees at a public university ($1,900 in 1980-1981) and a
families with incomes below $40,000 (Bureau of the Cen- year of forgone earnings ($18,500). I further assume a work
sus, 1974; Springer, 1976; National Center for Education life through age 65, annual real wage growth of 1 percent,
and a real discount rate of 4 percent.
Statistics, 1998).
VOL. 93 NO- I DYNARSKI: DOES AID MATTER? 287
. "Rising Public College Tuition and Seftor, NeU and Turner, Sarah, "Back to School:
College Entry: How Well Do Public Subsi- Federal Student Aid Policy and Adult Col-
dies Promote Access to College?" National lege Enrollment." Joumal of Human Re-
Bureau of Economic Research (Cambridge, sources, Spring 2002, 37(2), pp. 336-52.
MA) Working Paper No. 5164, 1995. Social Secnrity Administration. Social Security
Leslie, Larry and Brinkman, Paul. The economic bulletin annual statistical supplement. Wash-
value of higher education. New York: Mac- ington, DC: U.S. Govemment Printing Of-
millan, 1988. fice, various years.
LuzadJs, Rebecca. "Tbe Effect of the Social Se- Springer, Philip. "Characteristics of Student
curity Student Benefit Program on College- OASDI Beneficiaries: An Overview." Social
Going Decisions." Unpublished manuscript, Security Bulletin, November, 1976, pp. 3-32.
Cornell University, 1983. Stanley, Marcus. "College Education and the
Meyer, Bruce. "Natural and Quasi-experiments Mid-Century G.I. Bills." Unpublished manu-
in Economics." Joumal of Business and Eco- script, Harvard University, 2000.
nomic Statistics, April 1995,13(2), pp. 151- Turner, Sarah. "Federal Financial Aid: How
61. Well Does It Work?" in J. Smart, ed.. Higher
National Center for Education Statistics. Digest education: Handbook of theory and research.
of education statistics. Washington, DC: U.S. New York: Agatbon, 2000.
Govemment Printing Office, various years. Turner, Sarah and Bound, John. "Closing the
Office of the Comptroller General. "SocisJ Secu- Gap or Widening the Divide: The Effects of
rity Student Benefits for Postsecondary Stu- the G.I. Bill and World War II on the Edu-
dents Should Be Discontinued." Washington, cational Outcomes of Black Americans."
DC: U.S. General Accounting Office, 1979, Joumal of Economic History (forthcoming).