Professional Documents
Culture Documents
POLICY BRIEF Empowering Communities and Incentivizing Teachers - 050820
POLICY BRIEF Empowering Communities and Incentivizing Teachers - 050820
POLICY BRIEF Empowering Communities and Incentivizing Teachers - 050820
Background
Teacher accountability is a key challenge to When low service quality arises from inadequate
improving public education quality, particularly accountability, incentives need to be part
in more remote parts of Indonesia. The rate of of a strategy to improve the accountability
teacher absenteeism in Indonesia has declined over relationship between stakeholders and service
the past decade, but it remains high in remote areas providers (World Bank, 2003; Pritchett, 2015). First,
(19.3 percent) compared to the national rate (9.4 there needs to be clarity on the stakeholder’s objectives
percent) (Usman et al., 2004; ACDP, 2014). High teacher and what the service provider must do to achieve these.
absenteeism rates negatively affected student learning Second, the stakeholder needs information to evaluate
and were associated with higher student absenteeism service provider performance. Finally, accountability
and drop-out rates (Usman et al., 2004; UNICEF, 2012; relationships also require motivation — i.e., an incentive
Hasan et al., eds, 2013; Suryahadi and Sambodho, “contract” specifying the rewards (or punishment) for
2013). Weak capacity to enforce quality standards, both good (or bad) performance to affect service providers’
at the top (government) and the bottom (community) intrinsic or extrinsic motivation.
further contribute to the lack of improvement.
The Government of Indonesia has introduced
several reforms to improve the quality of
Teacher absenteeism rate in Indonesia
education but learning outcomes have continued
Rem o t e a re a s Na t i o nal to lag. Reforms have included the provision of cash
19.3% 9.4%
transfers to students from impoverished backgrounds
and greater educational resources to schools,
improvements to teacher qualifications, improved
community participation through school committees,
and benchmarking of student performance using
1
This Policy Brief summarizes findings from two studies:
international assessments. Despite these reforms,
(1) World Bank. 2020. Community Participation and Teacher Accountability:
Improving Learning Outcomes in Remote Areas of Indonesia. student learning outcomes have remained flat, near the
(2) Gaduh, A., Pradhan, M., Priebe, J., and Susanti, D. 2020. Scores, Camera, bottom of international achievement test league tables
Action? Incentivizing Teachers in Remote Areas. RISE Working Paper Series.
20/035. https://doi.org/10.35489/BSG-RISE-WP_2020/035. (Beatty et al. 2018; OECD 2017; World Bank 2013).
POLICY BRIEF
In 2016, the World Bank through KIAT Guru began provides communities with the means to voice their
to support the Government of Indonesia’s efforts concerns and dissatisfaction. KIAT Guru empowers
to promote social accountability for better teacher communities to support and monitor teachers and ties
performance in remote areas. At the community the payment of the government-financed remote area
level, KIAT Guru makes benchmarked data on learning allowance (RAA) to teacher presence or teacher service
outcomes available to education stakeholders, performance, thereby holding teachers accountable
facilitates service performance standards, evaluates for performance.
teacher performance against these standards, and
5
dist r ic t s
&
2
p rov i nc e s
assigned schools to the control and treatment groups.
KIAT Guru combined a social accountability mechanism (SAM) with a
pay-for-performance mechanism (PPM) to improve teacher presence,
teacher service performance, and student learning outcomes in remote
West
K alimantan schools. The project supported participating schools to develop a joint
agreement between communities and teachers that included locally identified
and agreed indicators designed to improve the learning environment in school
and at home. The SAM was combined with two variants of PPM, which linked the
payment of teachers’ RAA with assessments of their presence or service quality.
The two mechanisms were combined into three intervention groups: (1) SAM,
East N usa
Tenggara (2) SAM + PPM based on teacher presence verified by a tamper-proof Android-
based camera application (SAM+Cam), and (3) SAM + PPM based on a broad
measure of the quality of teacher service performance (SAM+Score).
The three interventions vary in the way the teacher scorecards translate
into teacher incentives — creating three different variations of the
delegation-information-motivation relationship. Treatment 1 (hereafter,
SAM) relies entirely on the social accountability mechanism. Monthly meetings
between teachers, community members and village leadership provide informal
pressure if teacher performance falls short of an agreed commitment to improve
service delivery. Administrators are also informed of scores and can act upon
them. Treatments 2 and 3 add to this a pay-for-performance mechanism (PPM).
In these treatments, poor performance leads to cuts to the RAA. In Treatment 2
(hereafter, SAM+Cam), the cut is based on the teacher presence indicator only,
which is objectively verified using a tamper-proof smartphone camera provided
to the schools. In Treatment 3 (hereafter, SAM+Score), the cut is based on the
overall score on the scorecard. However, these schools did not receive the
tamper-proof camera. Teachers with full scores, and teachers in control and SAM
groups always receive their full RAA.
Empowering Communities and Incentivizing Teachers to Accelerate Learning in Remote Areas of Indonesia
The treatments increased teacher presence in using objective rather than subjective measures
schools and improved parental behavior and to evaluate teacher performance, and
perception of the school. Across all treatments,
Rp paying teacher allowances based on objective
teachers were more likely to be in school when they
performance indicators. In the schools that
were supposed to. They were more likely to teach
achieved the most impressive gains, the goals
instead of doing administrative or other work in class.
of KIAT Guru and the roles and responsibilities
Parents in treatment communities increased education
of various stakeholders were made clear with
expenditures and were more likely to find additional
noteworthy transparency.
support (such as a tutor) for their children. Moreover,
parents in treatment communities also interacted more
with teachers and were more satisfied with education Data collected by the qualitative researchers
service delivery and their children’s schools in general. indicates that implementation of the KIAT Guru
The evidence suggests that increased top- project had a strong and pervasive impact on
down supervision and informal community the schools included in the study. The researchers
pressure are at play in delivering results. Across concluded that in all locations, the quality of teaching
the board, principals increased their supervision of and school-community relations improved over the
teachers. Supervision from district officials and school course of the project. Education stakeholders opined
inspectors also increased in SAM+Cam. Teacher scores that the introduction of KIAT Guru exerted a particularly
are generally very high at around 95 percent of the powerful impact on:
maximum score. The average salary cut for teachers 1. teacher attendance,
who received the RAA was 5 percent. This indicates 2. parent attitudes about student learning,
3. teacher performance,
2
It is important to emphasize that the relative success of SAM+Cam over
SAM is not evidence of the effectiveness of a pure Cam treatment. The 4. student attitudes about learning,
difference between SAM+Cam and SAM cannot be interpreted as the
positive impact of a pure camera-based performance-pay treatment without
5. teacher discipline, and
assuming no interaction effects between SAM and the attendance-based,
6. stakeholder relations.
camera-supported performance-pay interventions.
Based on KIAT Guru results, in 2019, the formally excused by the principal. The monthly meeting
Government of Indonesia began to expand results are shared at the village, district, and national
the scope of SAM+Cam to 410 primary schools. level, and RAA for eligible teachers are paid based on
The World Bank continues to provide technical their presence in school. At the end of every semester,
assistance by simplifying and further digitizing essential another diagnostic student learning assessment will
processes. A diagnostic student learning assessment kickstart a village-wide meeting to identify progress and
test, administered by parents and community areas of improvements for the upcoming semester.
representatives on mobile phones, becomes the
basis for school stakeholders to prioritize three joint
agreement indicators, which link efforts from principals,
teachers, and parents to improve learning environment
at school and home. Education stakeholders meet
every month to discuss its implementation and record
the results electronically. In this monthly meeting,
parents also check whether teachers’ absences are
Recommendations
A strategic approach that integrates The pilot demonstrates that such a strategic approach can be
social accountability with measures to implemented using a government-financed allowance. While all
increase public sector responsiveness treatments lead to learning improvements, the treatment which
outperforms a tactical approach combines social accountability with a simple pay-for-performance
that relies on information alone scheme based on teacher presence aided by a tamper-proof camera
to generate collective action and worked best in improving learning outcomes.
influence public sector performance.
A simple transparent rule, This finding is relevant to many developing countries where governments
even though it only targets find it difficult to hold teachers accountable. The comparison of two
and incomplete measure of different pay for performance mechanisms shows that a simple
performance such as teacher contract based on monitoring presence only works better than a more
presence, can work better than a comprehensive, less well specified one. This is an important question
comprehensive evaluation which that arises in many labor contracts (Baker et al., 1994; Khan et al., 2016).
is more prone to subjectivity. While the study finds some evidence of teachers shifting focus to tasks
which are easy to observe, the overall impact on learning is the highest
for the contract that puts the strongest incentive on teacher presence.
This simple contract also leads to less conflict at the community level.
SAM+Cam offers the most Institutionalizing a formal mechanism for connecting communities to the
promising approach and schools and including them in school improvement initiatives produces
outcomes worth considering improvements in the schools. In addition, tying teacher allowance
for policy and implementation to teacher presence evidenced the greatest potential for producing
rollout. long-lasting change. Teachers felt that community representatives
were assigned clear and well-defined tasks. Community engagements
also encouraged teachers to invest more effort in their professional
responsibilities.
Acknowledgment:
The papers and the policy brief are the products of the World Bank Indonesia’s Social Sustainability and Inclusion Global Practice. Financial
support for the pilot was generously provided by the Government of Australia’s Department of Foreign Affairs and Trade (DFAT) through the Local
Solutions to Poverty and USAID’s Local Solutions to Development Trust Funds. RISE Study in Indonesia, managed by SMERU Research Institute,
co-financed the second round of impact evaluation surveys. The Task Team was led by Dewi Susanti. Christopher Bjork, Arya Gaduh, Menno
Pradhan, Jan Priebe, and Dewi Susanti wrote the papers. Dinda Putri Hapsari and Megha Kapoor wrote the policy brief. Yohanes Aji designed the
policy brief, Rebekka Hutabarat and Fazlania Zain provided an overall support. For more information, please contact: dsusanti@worldbank.org.