Professional Documents
Culture Documents
Incentives and Student Learning: January 2012
Incentives and Student Learning: January 2012
net/publication/258555863
CITATIONS READS
0 1,361
2 authors:
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Wayne A. Grove on 20 May 2014.
there is some recent evidence from post-secondary study now requires either more immediate rewards or
schools. As economists, we take a particular interest a better understanding of the link between studying
in the role of monetary incentives and market-based now and the rest of their lives. Many students who are
initiatives and focus on those in this piece. aware of the big financial benefits of completing college
fail to exert academic effort, perhaps because they lack
Theoretical Background role models to envision that such opportunities are
available to them. Incentives ranging from direct pay-
Learning and Incentives ment for performance on standardized tests to pay-
A primary goal of elementary and secondary education ments to families based on student effort (e.g.,
is for children to develop basic academic and social attendance) have been attempted, as discussed in
skills and noncognitive attributes (e.g., perseverance, more detail below.
dependability, and consistency) necessary for produc- Second, how might incentives overcome the lack of
tive citizenship and entry into the work force, a training knowledge of how to convert effort into learning,
program, or college. Despite the broader range of namely, how to effectively study, complete assign-
desired educational outcomes, policymakers focus on ments, and learn material that prevents student effort
the learning of particular subject material. The lack of from yielding achievement? One solution may be
learning, to simplify, may result either from students rewarding the inputs in the learning process rather
themselves or from a problem with the complements to than the outputs. Recent programs show promise on
students’ learning. On the first count, students may this front (e.g., Fryer 2010).
lack motivation to learn or may highly discount the Finally, how might incentives alter administrators’,
future (so that the payoff to academic effort is teachers’, parents’, and fellow students’ behavior to
overwhelmed by the immediacy of alternative uses of influence student achievement? Several incentive pro-
their time). Alternatively, factors beyond students’ con- grams provide direct payments to administrators and
trol may be contributing: ineffective teachers and teachers for improved student performance or simply
administrators and unengaged parents and peers. The putting forth greater effort (additional time with stu-
challenge, then, is to get students to exert effort, for the dents or obtaining additional certification). Charter
effort to yield achievement, and to aid the process with schools also fall within this realm. Some programs
educational and social support. provide payments to parents based on students’ atten-
The theory of student learning entails motivation dance or exam scores.
(intrinsic and extrinsic) determining effort which Although policymakers have focused on the poten-
yields learning depending upon innate ability (the tial role of external rewards and incentives, educational
ease of turning effort into learning) and support. The psychologists (and some economists) have noted their
latter, support, refers to the quality of teaching, the limitations. In an extensive review of the literature,
relationship with the teacher, the classroom and school Deci et al. (1999) conclude that the manner in which
learning environment, parental and family support, students respond to incentives rests on several key
and so on. Thus, aside from individual aptitude, learn- factors, including the student’s own goals and level of
ing is determined by effort which results from intrinsic motivation (which determines the value of the
motivation. task to them) and their perceived likelihood of success.
How might financial incentives help overcome the While much of the empirical work in Education
roadblocks to learning and attainment mentioned in Psychology concludes that extrinsic rewards are helpful
the introduction? First, a variety of incentives might get in getting students to do unpleasant work, such
students to exert more effort. Large and growing wage rewards have been found to be ineffective and even
premiums for high school, college, and professional harmful in certain circumstances – for example, when
education would seem already to provide an extrinsic they are seen as controlling or when they are used as
incentive to study and learn. Research shows, though, incentive to get students to do work they otherwise
that many children and young adults place a low value enjoy; furthermore, subsequent interest, risk prefer-
today on long-term rewards: that is, they highly dis- ence, effort, and emotion can suffer if extrinsic rewards
count future outcomes. So to motivate such students to are overemphasized. Consequently some experimental
Incentives and Student Learning I 1513
studies (e.g., Fryer 2010) measure changes in intrinsic Fryer also finds no evidence that monetary incentives
motivation, using, for example, the Intrinsic Motiva- decrease intrinsic motivation.
tion Inventory, developed by Ryan (1982). In contrast, here are two studies with some evidence
that rewarding outcomes works. Merit scholarship for
Methodology: Randomized girls in Kenya generated significant gains in academic
Evaluation exam scores and yielded positive externalities
A center piece of the recent search for effective educa- (Kremer et al. 2004). In Coshocton, Ohio, 3rd- through
tional policy solutions has been the use of randomized 6th-grade students received cash payments for the suc-
evaluation, with random assignment to treatment and cessful completion of standardized tests (Bettinger
control groups. This is especially important due to 2010). Young children responded to the “paying to
concerns of program effects given complex and multi- learn” program by improving math scores but not the
ple channels of causality. Let us say you use a new test results for reading, social science, and science.
pedagogical approach in class and at the end of the
year your students’ learning is 20% higher than the Motivation and Support
average in the three other classes of the same grade In a randomized field experiment at a large Canadian
and material. Can we attribute the increase to the university (Angrist et al. 2009), first-year undergradu- I
pedagogical approach? Or to you as a teacher versus ates were assigned to one of three treatment groups:
the rest? Or might an unusual mix of students in your (1) services such as peer advising and organized study
class account for the outcome? This selection bias groups, (2) substantial merit scholarship for good
problem, ensuring that participants and nonpartici- grades, and (3) both services and scholarships. Several
pants do not systematically differ, is the central diffi- interesting results emerge. First, use of services was
culty that randomization seeks to avoid. much greater when combined with a financial incen-
tive. Second, none of the interventions affected males,
Important Scientific Research and whereas females’ grades improved for both treatments
Open Questions with scholarships. Finally, retention rates improved for
females who received both services and scholarships.
Student Incentives The Dallas-based Advanced Placement (AP) Incen-
Recent studies by economists have examined the effec- tive Program involved payments both to 11th- and
tiveness of a wide range of monetary incentives in 12th-grade students and to their teachers for passing
a variety of settings in several countries. Direct incen- AP tests. The program improved students’ long run
tives for K-12 and college students take the form of cash academic performance, namely, attending college, col-
payments for performance on standardized exams legiate GPAs, and persistence in college beyond the
(e.g., Advanced Placement exams, Regents exams in freshman year (Jackson 2010). While the program
New York State, exit exams in Israel), school atten- appears to have improved the outcomes of students
dance, and college enrollment. Such incentives gener- who would have attended college anyway, most notably
ally appear to have positive effects. it increased the college graduation rate of black and
Hispanic students, groups that tend to underperform
Reward Inputs or Outcomes? in college. Thus, this program appears to have gener-
Fryer (2010) describes a series of school-based ran- ated lasting positive and large effects.
domized trials in over 250 urban schools designed to
test the impact of financial incentives on student Outcome Rewards Work for Higher
achievement. His results suggest that student incentives Achieving Students
increase achievement (and are less costly) when the Angrist and Lavy (2009) report that cash incentives
rewards are given for inputs to the educational produc- increased the certification rates of Israeli girls (but
tion function, while incentives tied to output are not not of boys), apparently because the girls devoted
effective. He suggests that incentives for inputs may be extra time to exam preparation. The effect on girls
more effective because students do not know how to was largely driven by an increase in passing rates
turn their motivation for rewards into achievement. among those who had a relatively high chance of
1514 I Incentives and Student Learning
passing these exams to begin with, rather than for ● Health-focused conditions, which include
low-achieving students. maintaining health insurance coverage for parents
In an example of who responds to incentives, eco- and their children, as well as obtaining age-
nomics and business freshman at the University of appropriate preventive medical and dental
Amsterdam were offered either a high or a low financial checkups for each family member
reward for passing all first-year requirements compared ● Workforce-focused conditions, aimed at parents,
to a control group with no reward (Leuven et al. 2010). which include sustaining full-time work and par-
Although the passing rate and accumulated credits did ticipation in approved education or job training
not differ between the three groups, higher compensa- activities
tion did elicit better outcomes for students with higher
The program seems to have positively affected the
math skills and more highly educated fathers.
last two areas above but not academic outcomes.
some evidence that the incentives lead to more test prep school, although the choice is often limited to nonsec-
rather than more effort. tarian institutions. Charter schools are privately run
(typically publicly funded) alternatives to public run
School-Level Changes and Incentives schools. The idea is that competition will spur effort
Market-based incentives meant to increase competi- and innovation, leading to improved teaching
tion for students and associated funding have been techniques.
introduced in the USA (and elsewhere) at the Although we will not survey the voluminous liter-
national and local levels. In the USA, the No Child ature on charter schools, we will indicate the very
Left Behind Act, signed into law in 2001, was significant learning gains from the Knowledge is
a response at the national level to the poor learning Power Program (KIPP) charter schools (Angrist et al.
and graduation rates of America’s youth and the 2010). The KIPP schools embrace a No Excuses
debate about education policy precipitated by the approach of public education, have a longer school
1983 publication of the federal government’s report day and year, selective hiring of teachers, strict behavior
on the state of America’s schools, A Nation at Risk norms, and a focus on traditional reading and math
(National Commission on Excellence in Education). skills. In Boston, charter school students outperform
NCLB changed incentives regarding standardized “pilot schools,” which are a public school alternative to I
tests, creating penalizes if students do not meet stan- charter schools in that they have some of the indepen-
dards (“minimum requirements”?) or do not show dence of charter schools but operate within the school
year-to-year improvements. If all students fail to districts, face little risk of closure, and are covered by
meet, or are not making progress toward, minimum many of the same collective bargaining provisions as
standards, schools could be labeled “underperforming” traditional public schools (Abdulkadiroglu et al. 2009).
which allows students to transfer to other schools and According to Rouse and Barrow (2009), a survey of
threatens reduced funding for the school and removal the empirical evidence indicates limited benefits of
of administrators. The Obama administration modi- voucher programs. According to the authors “The
fied NCLB to improve state-adopted learning stan- best research to date finds relatively small achievement
dards, and to focus on the worse-performing 5% of gains for students offered education vouchers, most of
schools (threatening to replace the principals) and which are not statistically different from zero. Further,
well-performing schools (allow more latitude to what little evidence exists regarding the potential for
innovate). public schools to respond to increased competitive
The following studies provide evidence of student pressure generated by vouchers suggests that one
learning benefits of particular changes but no evidence should remain wary that large improvements would
that competition between schools improved educa- result from a more comprehensive voucher system.”
tional outcomes. They continue, “Many questions remain unanswered,
Some evidence exists that lower-performing stu- however, including whether vouchers have longer-run
dents score better at the expense of their higher- impacts on outcomes such as graduation rates, college
performing classmates under programs like NCLB enrollment, or even future wages, and whether
(Neal and Schanzenbach 2007). This likely results vouchers might nevertheless provide a cost neutral
from the incentive structure: schools are sanctioned if alternative to our current system of public education
too many students are not performing up to provision at the elementary and secondary school
a minimum standard. Thus, focus – effort and level.” Some research does report positive outcomes,
resources – is placed on improving the performance for example, in Columbia (Angrist et al. 2006),
of students near the minimum level. Charlotte, North Carolina (Hastings and Weinstein
At the state and local levels, voucher programs and 2007), and Florida (marginally higher scores, Figlio
charter schools are increasingly being used. Several and Rouse 2006).
countries, the USA included, have initiated programs Clark (2009) finds large student achievement gains
designed to inject competition into the primary and in British schools in which the vote to opt out of local
secondary education market. Voucher programs pro- authority and to become autonomous barely won com-
vide public funds so that students may attend any pared to schools in which it barely lost. The gains seem
1516 I Incentives and Student Learning
Jacob, B. A. (2002). Accountability, incentives and behavior: The that the acquisition of knowledge is unconscious in
impact of high-stakes testing in the Chicago Public Schools. nature, though in contrast to implicit learning, there
NBER Working Paper No. 89868. Cambridge, MA: NBER.
is no expectation that such knowledge should remain
Jacob, B., & Levitt, S. (2003). Rotten apples: An investigation of the
prevalence and predictors of teacher cheating. NBER Working largely inaccessible to conscious awareness. However,
Paper No. 9413. Cambridge, MA: NBER. note that some articles may refer to implicit learning
Kremer, M., Miguel, E., & Thornton, R. (2004). Incentives to learn. tasks as incidental without making the above distinc-
NBER Working Paper No. 10971. Cambridge, MA: NBER. tion. There is also a suggestion, mainly from an educa-
Leuven, E., Oosterbeek, H., & van der Klaauw, B. (2010). The effect of
tional perspective, that incidental learning involves
financial rewards on students’ achievements: Evidence from
a randomized experiment. Journal of the European Economic subsequent conscious reflection on material that was
Association, 8, 1243–1265. consciously noted at time of study but not recognized
Muralidharan, K., & Sundararaman, V. (2009). Teacher performance as relevant or useful.
pay: Experimental evidence from India. NBER Working Paper
No. 15323. Cambridge, MA: NBER. Theoretical Background
National Center for Education Statistics. (2010). The nation’s report Incidental learning features mainly in the education/
card: Trial urban district assessment reading 2009 (NCES 2010–
occupational literature and in the cognitive psychology
459). Washington, DC: National Center for Education Statistics,
Institute of Education Sciences, U.S. Department of Education. literature. In the former, incidental learning is seen as I
Neal, D., & Schanzenbach, D. W. (2007). Left behind by design: a subset of “informal learning” which is unstructured
Proficiency counts and test-based accountability. NBER Working and learner-led, the difference being that incidental
Paper No. 13293. Cambridge, MA: NBER. learning is seen as almost always occurring in every
Riccio, J., Dechausay, N., Greenberg, D., Miller, C., Rucks, Z., & situation. As this definition can be seen to incorporate
Verma, N. (2010). Toward reduced poverty across generations
a vast array of circumstances and knowledge bases,
early findings from New York City’s Conditional Cash Transfer
Program. MDRC. www/mdrc.org. Accessed 19 April 2011. these models of incidental/informal learning cite fac-
Rouse, C. E., & Barrow, L. (2009). School vouchers and student tors such as life context of the learner, learning strate-
achievement: Recent evidence and remaining questions. Annual gies, framing problems, and the need for some internal
Review of Economics, 1, 17–42. or external trigger to signal dissatisfaction with current
Ryan, R. M. (1982). Control and information in the intrapersonal
solutions (e.g., Marswick and Watkins 2001).
sphere: An extension of cognitive evaluation theory. Journal of
Personality and Social Psychology, 43, 450–461. In cognitive psychology, the definition of incidental
learning is more likely to involve unconscious acquisi-
tion of information and the contrast between inciden-
tal and intentional learning of stimuli with a predefined
stimulus set. Early research found dissociations
Incidental Learning between intentional and incidental learning with vari-
ables such as intra-list interference, distraction, incen-
STEVE W. KELLY tive, and emotion being manipulated experimentally
Department of Psychology, University of Strathclyde, (e.g., Winnick and Lerner 1963). An example of
Glasgow, Scotland, UK a standard paradigm would be to require learning of
geometric shapes of different colors; the shape would
be intentionally learned as this was part of the study
Synonyms instructions but if color was also found to have been
Experiential learning; Informal learning; Learning correctly remembered then this was taken as evidence
en-passant; Low involvement learning; Tacit knowing; for the incidental learning of color. While laboratory-
Unconscious learning based studies were demonstrating learning effects
under incidental instructions, there was little evidence
Definition to suggest that such learning was commonplace in
Incidental learning refers to any learning that is real life. Morton (1967) examined knowledge of the
unplanned or unintended. It develops while engaging correspondence between the letters and numbers on
in a task or activity and may also arise as a by-product telephone dials. Even experienced telephonists performed
of planned learning. “Incidental learning” can imply poorly on recognition and recall of this material.