Download as pdf or txt
Download as pdf or txt
You are on page 1of 11

Improving Teacher Quality through the

Teacher Hiring Process


July 2019

Katherine Key Tim R. Sass


Georgia State University Georgia State University
Improving Teacher Quality through the Teacher Hiring Process 2

HIGHLIGHTS
• Teachers with better grades in college tend to those with only a baccalaureate degree, but
have higher classroom observational ratings, they do not perform significantly better as
are more likely to persist past the first year in teachers. Those with an advanced degree are
the school in which they are placed and have also less likely to stay in their initial school
better attendance rates in their first year, but placement after their first year.
principals do not appear to consider college • Applicants who majored in education are more
GPA when making hiring decisions. likely to receive a job offer, but they do not
• Teachers who applied early in the hiring perform better as teachers than do those with
season (before April) have better classroom bachelor’s degrees in non-education fields.
observations scores and are more likely to stay • Candidates who student taught in the district
in their initial placement school than those are more likely to be given an offer but
who apply later, but application timing does perform no better as teachers than those with
not factor into hiring decisions. student teaching experience in another district
• Candidates with advanced degrees are more (or no student teaching experience at all).
likely to receive an offer of employment than

MOTIVATION
Of the various school-based determinants of significant barriers to removing low-performing
student achievement, teachers are the most teachers. Third, improving teacher selection may
important (Rivkin, Hanushek, and Kain, 2005; be more cost-effective than expenditures on
Aaronson, Barrow, and Sander 2007; Kane, Rockoff, professional development to increase the
and Staiger, 2008). Further, teachers who boost productivity of teachers who are already in the
student test scores the most are also able to classroom. Fourth, initial selection improvements
improve adult outcomes of their students (Chetty et could yield better teacher-school matches, which in
al., 2011; Chetty, Friedman, and Rockoff, 2014). turn could further enhance teacher effectiveness and
There are a number of potential mechanisms for increase teacher retention.
increasing teacher quality, such as improving current
Candidate Characteristics and Teacher
teachers’ skills, enhancing teachers’ incentives to
maximize their performance, and differentially Performance
retaining superior teachers. This brief focuses on A prerequisite to hiring better teachers is being
another promising avenue for enhancing teacher able to identify applicants likely to become superior
quality—improving the teacher hiring process. teachers. Most extant research on the relationship
There are several reasons why changing hiring between observable characteristics and teacher
practices is a particularly attractive policy lever for performance relies on information about currently
raising teacher quality. First, reforming teacher hiring employed teachers. Two consistent findings emerge
practices is less contentious than tying teacher from this research: early-career experience boosts
salaries or retention decisions to measures of
teacher performance. Second, preventing subpar
hires is particularly important given the existence of

MAPLE | GEORGIA POLICY LABS


Improving Teacher Quality through the Teacher Hiring Process 3

teacher productivity1 while attaining a master’s signals of later productivity as a teacher. However,
2
degree does not. Evidence on the relationship the quality of teachers placed through the hiring
between other characteristics and a teacher’s ability process is dependent on the selection process,
to promote student achievement is mixed. These including the screening tools used and the
include college grade point average (GPA), college preferences of decision makers (typically principals)
entrance exam scores, licensure status, certification in the hiring process.
exam scores, certification status/pathway to
Principal Decisions
teaching, and non-cognitive skills. 3
In a recent study of teacher hiring practices in
EXISTING RESEARCH ON Washington, D.C. (Jacob et al., 2018), characteristics
related to teacher productivity bore little relation to
TEACHER SELECTION those increasing a candidate’s chances of being
Teacher selection can be viewed as a two-step
hired. Some predictors of teacher performance, such
process. In the first step, districts may do some initial
as SAT scores and college GPAs, were inversely
screening of candidates. After this, principals select
related to the likelihood of being hired. Across
candidates for interviews and then choose which
multiple analyses, the applicants’ experience and
candidates they want to hire.
attendance at a nearby post-secondary school were
District Screening the most consistent predictors of a candidate being
Two published studies analyze the relationship hired. Applicants who pass various screens (e.g.,
between potential screening devices and teacher interviews, sample lessons, and written assessments)

quality, irrespective of hiring choices. Goldhaber, and become “recommended” are more likely to be
Grout, and Huntington-Klein, 2017 find that the use hired, but principals do not appear to actively seek
of a rubric to score and screen teaching applicants in out candidates with attributes related to teacher
Spokane, Washington, is positively related to performance. This suggests that modifying the
teachers’ retention in the district and their selection process could improve the average quality
contribution to student math achievement but is of new teachers.
uncorrelated with teacher attendance. Sajjadiani et A study of the Los Angeles Unified School District
al., 2019 find that previous non-teaching work teacher hiring process (Bruno and Strunk, 2018)
history could also be useful in identifying quality finds that the overall screening score is predictive of

teacher candidates, particularly if the job description both hiring decisions and some teacher performance
and the reasons for leaving were also reported. measures (attendance, productivity, and evaluation
Observable candidate characteristics are scores) but not other measures (mobility or
important for the hiring process as they can be retention). However, the correlation of specific
screening components with teacher performance

1 Chingos and Peterson, 2011; Staiger and Rockoff, 2010; Rivkin, 3See Clotfelter et al., 2010; Harris and Sass, 2011; Rockoff et al.,
Hanushek, and Kane, 2005; Clotfelter, Ladd, and Vigdor, 2006; 2011; Xu, Hannaway and Taylor, 2011; Kane, Rockoff, and
Dobbie, 2011; Wiswall, 2013; Papay and Kraft, 2015; Rockoff, Staiger, 2008; Ronfeldt et al., 2013; Sass, 2015; Goldhaber,
2004. Gratz, and Theobald, 2016; Goldhaber, Cowan, and Theobald,
2 Sass, Semykina, and Harris 2014; Chingos and Peterson 2011; 2017; Bastian et al., 2017; Bruno and Strunk, 2018; Jacob et al.,
Clotfelter et al. 2007; Bruno and Strunk 2018. 2018 and references therein.

MAPLE | GEORGIA POLICY LABS


Improving Teacher Quality through the Teacher Hiring Process 4

varies considerably across the performance After applications are screened by the district’s HR
measures. This indicates the varied usefulness of the department, principals are free to interview and
screening procedures, highlights teacher quality’s issue hiring requests for any qualified candidate,
multi-dimensionality, and emphasizes the potential including those who have not specifically applied to
tradeoffs when selecting teachers. They also find the principal’s school. Hiring requests are reviewed
that the screening system’s adoption improved by the HR department and, if approved, an official
teacher quality in the district relative to similar offer is issued.
districts and schools.
Measuring Teacher Performance
An analysis of teacher hiring in the state of
Evaluating the efficacy of the hiring process
Washington (Goldhaber, Cowan, and Theobald,
requires a measure of teacher quality. Because
2017) found edTPA scores (a performance-based,
there is no consensus on an ideal metric of
subject-specific assessment) predict teacher hiring.
teacher performance, a variety of measures are
However, the relationship between edTPA scores
used. These include scores on official teacher
and teacher performance is mixed; the raw edTPA
evaluation measures (TKES), Student Growth
score predicts teacher impacts on student math
Percentiles (SGPs), teacher attendance (percent of
performance, while the pass-fail rating predicts a
the year present or in staff development), and
teacher’s impact on student reading achievement.
teacher mobility (whether the teacher remained in
NEW EVIDENCE FROM A the school in which they were initially placed for a
METRO-ATLANTA SCHOOL second year). Because SGPs can only be calculated
for math and ELA teachers in grades 4-8, the sample
DISTRICT size for analyzing impacts on SGPs is somewhat
Since December 2015, a school district in metro
small; results should be considered in the context of
Atlanta has implemented a series of changes
this limitation.
intended to improve its teacher selection process.
Prior to these innovations, only a traditional Sample
background and credential check were required The analysis is limited to teacher candidates who
before principals could view an application. In applied to at least one core academic position; any
December 2015, the district initiated use of the individual only applying to physical education,
GALLUP TeacherInsight exam. However, completing career, technical and agricultural education, special
the test was optional for applicants, only becoming education, gifted education, foreign languages, art,
required in January 2019. The district’s human or early intervention program positions was
resources (HR) department considers a 70 out of 100 removed from the sample. Given that the latest data
score as “passing” and encouraged principals to try on teacher performance cover the 2017/18 school
to hire candidates with a passing score. Now that year, the performance analysis includes teachers
completion of the test is mandatory, principals can hired from January 2016 to the end of the 2017/18
only view materials for applicants with passing school year. For hiring, the analysis was limited to
scores. applications submitted between December 2015 and
May 2018.

MAPLE | GEORGIA POLICY LABS


Improving Teacher Quality through the Teacher Hiring Process 5

Findings measure. Characteristics where the partial


For each of the four teacher performance correlation with teacher performance is not

measures (observational scores, impacts on student distinguishable from zero are listed below the table.
test scores, persistence in initial placement and The policy implications of our findings, as
teacher attendance), we estimate both the discussed below, depend on where the

relationship between observable characteristics of characteristics fall among the six cells in each table.
candidates and the likelihood of being offered a job Navy boxes indicate a mismatch between the
and the relationship between those same likelihood of an offer from principals and that

characteristics and the performance of teachers. teacher’s performance. For characteristics in these
Our findings are summarized in Tables 1-4, with boxes, principals may want to re-prioritize the way
each table representing one of the four performance they value a characteristic. For example, in Table 1,
measures. The three columns of each table early applicants tend to have higher TKES scores
represent three possible categories of the estimated than applicants who otherwise appear similar but
relationship between a characteristic and the apply later in the hiring season; yet, on average,

likelihood of a job offer: being less likely to be principals are less likely to request that such early
offered a job than otherwise similar candidates, applicants be offered a job. Characteristics in gray
having no clear effect on receiving a job offer, or boxes are factors that currently do not have a

being more likely to receive a job offer than discernable effect on hiring decisions but do help
otherwise similar candidates. The rows of each table distinguish who is likely to have better or worse
indicate whether a characteristic is associated with performance as a teacher. White cells indicate cases

lower or higher values of the teacher performance where hiring decisions and teacher job performance
align and thus no change is called for.

Table 1. How Teacher Characteristics are Related to Job Offers and Observational (TKES) Scores
Less Likely to be No Impact on Likelihood More Likely to be
Offered a Job of Being Offered a Job Offered a Job

Lower TKES Score Some Teaching Experience

National Board Certified


Higher TKES Score Applied Before April
College GPA

Characteristics not associated with TKES scores: Certified in Georgia, Certified Outside Georgia, Student Taught in District, Previously
Worked in District, Found Job thru District Employee, Advanced Degree, Education Major, TeacherInsight Score, Currently Under
Contract with Another School District.

MAPLE | GEORGIA POLICY LABS


Improving Teacher Quality through the Teacher Hiring Process 6

Table 2. How Teacher Characteristics are Related to Job Offers and Teacher Impacts on Test Scores (SGPs)
Less Likely to be No Impact on Likelihood More Likely to be
Offered a Job of Being Offered a Job Offered a Job

Lower SGPs Some Teaching Experience

Higher SGPs TeacherInsight Score Certified Outside Georgia

Characteristics not associated with SGPs: Certified in Georgia, National Board Certified, Student Taught in District, Previously Worked in
District, Found Job thru District Employee, Advanced Degree, Education Major, College GPA, Applied Before April, Currently Under
Contract with Another School District.

Table 3. How Teacher Characteristics are Related to Job Offers and Persistence in Initial School
Less Likely to be No Impact on Likelihood More Likely to be
Offered a Job of Being Offered a Job Offered a Job

Lower Persistence Some Teaching Experience Advanced Degree

College GPA Found Job through District


Higher Persistence Applied Before April
Employee

Characteristics not associated with persistence in initial school: Certified in Georgia, Certified Outside Georgia, National Board Certified,
Student Taught in District, Previously Worked in District, Education Major, TeacherInsight Score, Currently Under Contract with Another
School District.

Table 4. How Teacher Characteristics are Related to Job Offers and Teacher Attendance
Less Likely to be No Impact on Likelihood More Likely to be
Offered a Job of Being Offered a Job Offered a Job
Advanced Degree
Lower Attendance Previously Worked in the
District

Higher Attendance College GPA Student Taught in District

Characteristics not associated with teacher attendance: Certified in Georgia, Certified Outside Georgia, National Board Certified, Some
Teaching Experience, Found Job thru District Employee, Education Major, Applied before April, TeacherInsight Score, Currently Under
Contract with Another School District.

MAPLE | GEORGIA POLICY LABS


Improving Teacher Quality through the Teacher Hiring Process 7

Focusing on the elements in the navy and gray employment than are teachers with no prior
cells, some clear patterns emerge that indicate experience.
potential gains from principals reconsidering how Fifth, teachers with higher scores on the
they evaluate candidates for teaching positions. TeacherInsight capability screener tend to have
First, teachers with higher grade point averages greater impacts on student test scores (as measured
tend to have higher observational (TKES) scores, are by SGPs) but are not more likely to be offered
more likely to persist past the first year in the school employment than are lower-scoring candidates.
in which they are placed, and have better Finally, candidates who previously worked in the
attendance rates in their first year than do teachers district are more likely to be offered a job than are
who earned lower grades in college. However, candidates who are new to the district, yet they tend
despite these apparent advantages of hiring teachers to have lower attendance rates their first year on the
with better college grades, college GPA does not job.4
appear to influence principal hiring decisions.
Implications for Policy
Second, applicants who applied early in the hiring
In general, instances where candidate
season (before April) were less likely to receive an
characteristics are associated with better teacher
employment offer than later applicants, but teachers
performance, but candidates possessing those
who had applied early had higher observational
characteristics are not more likely to be hired,
(TKES) scores and were more likely to persist in their
indicate that changes in the hiring process could
initial placement after their first year of
yield improvements in the quality of new hires.
employment.
Further, factors that are directly associated with
Third, candidates with an advanced degree were
instructional quality (classroom observations
more likely to be offered employment but did not
measured by TKES or impacts on student
perform significantly better as a teacher and were
achievement that are measured by SGPs) are of
less likely to stay in their initial placement for more
greater interest than characteristics that are only
than a year and had lower first-year attendance than
linked to differences in persistence or teacher
did candidates with only a bachelor’s degree.
attendance. Finally, to be an effective screen, the
Fourth, candidates with prior experience have
characteristic must be something that is not easily
worse observational (TKES) scores than do rookie
manipulated by candidates.
teachers. They also have a smaller impact on student
Both Gallup TeacherInsight scores and college
test scores (measured by SGPs) and are less likely to
GPAs are associated with at least one measure of
remain in their placement school after one year.
instructional quality and are not malleable by
However, they are no less likely to be offered
candidates but do not appear to influence hiring
decisions by principals.5 Thus, placing greater

4 While there it appears that principals do not place sufficient 5While early applicants tend to have higher TKES scores, setting
weight on National Board certification, this result should be a hiring rule to favor early applicants is problematic, as
interpreted with caution, as there are few teachers in the candidates can simply apply earlier, reducing the effectiveness of
candidate pool who are board certified at the time of the screen. Further, early applicants may be more attractive to
application. other districts, so by the time a principal tries to interview them
they are already hired elsewhere.

MAPLE | GEORGIA POLICY LABS


Improving Teacher Quality through the Teacher Hiring Process 8

emphasis on these measures, either by having a candidate is hired by the district. Second, as
districts set minimum standards or by encouraging described above, the metro-Atlanta district that we
principals to pay greater attention to them, are study did not require candidates to take the
promising. TeacherInsight exam during the period of analysis.
Currently, the case for emphasizing college grades Thus, we only have scores for about 30 percent of
when deciding which candidates to offer applicants. Consequently, we cannot be as confident
employment, is strongest for two reasons. First, our in our findings with respect to the TeacherInsight
findings for college GPA align with the results from screen. Future analyses that will cover the recent
other recent studies of district hiring behavior period where all candidates must take the exam in
elsewhere. In particular, the work by Jacob et al. order to be considered for employment should
(2018) in Washington, D.C. and by Bruno and Strunk provide evidence that will yield stronger conclusions
(2018) in Los Angeles both find that college GPA is on the efficacy of the TeacherInsight tool as a
directly related to measures of instructional screening device.
performance but is not correlated with the likelihood

MAPLE | GEORGIA POLICY LABS


Improving Teacher Quality through the Teacher Hiring Process 9

REFERENCES
Aaronson, Daniel, Lisa Barrow, and William Sander. 2007. Goldhaber, Dan, Trevor Gratz, and Roddy Theobald. 2016.
Teachers and Student Achievement in the Chicago What’s in a Teacher Test? Assessing the Relationship
Public High Schools. Journal of Labor Economics. 25(1): Between Teacher Licensure Test Scores and Student
95-135. STEM Achievement and Course-Taking. National
Bastian, Kevin C., McCord David M., Marks Julie T., and CALDER Working Paper 158.
Carpenter Dale. 2017. A Temperament for Teaching? Goldhaber, Dan, Cyrus Grout, and Nick Huntington-
Associations between Personality Traits and Beginning Klein. 2017. Screen Twice, Cut Once: Assessing the
Teacher Performance and Retention. AERA Open. 3 Predictive Validity of Teacher Selection Tools.
(1): 1:17. Educational Finance and Policy. 12 (2): 197-223.
Bruno, Paul and Katharine Strunk. 2018. Making the Cut: Harris, Douglas and Tim Sass. 2011. Teacher Training,
The Effectiveness of Teacher Screening and Hiring in Teacher Quality and Student Achievement. Journal of
the Los Angeles Unified School District. CALDER Public Economics. 95: 798–812.
Working Paper 184. Jacob, Brian A., Jonah E. Rockoff, Eric S. Taylor,
Chetty, Raj, John Friedman, Nathaniel Hilger, Emmanuel Benjamin Lindy, and Rachel Rosen. 2018. Teacher
Saez, Diane Whitmore Schazenbach, and Danny Applicant Hiring and Teacher Performance: Evidence
Yagan. 2011. How Does Your Kindergarten Classroom from DC Public Schools. Journal of Public Economics.
Affect Your Earnings? Evidence from Project Star. The 166 (October): 81–97.
Quarterly Journal of Economics. 126 (4): 1593-1660. Kane, Thomas J., Jonah Rockoff, and Douglas Staiger.
Chetty, Raj, John Friedman, and Jonah Rockoff. 2014. 2008. What Does Certification Tell Us about Teacher
Measuring the Impacts of Teachers II: Teacher Value- Effectiveness? Evidence from New York City.
Added and Student Outcomes in Adulthood. American Economics of Education Review 27:615–31.
Economic Review. 104 (9): 2633-2679. Papay, John, and Matthew Kraft. 2015. Productivity
Chingos, Matthew, and Paul Peterson. 2011. It’s easier to Returns to Experience in the Teacher Labor Market:
Pick a Good Teacher Than to Train One: Familiar and Methodological Challenges and New Evidence on
New Results on the Correlates of Teacher Long-Term Career Improvement. Journal of Public
Effectiveness. Economics of Education Review 30: 449- Economics. 130: 105-119.
465. Rivkin, Steven, Eric Hanushek, and John Kain. 2005.
Clotfelter, Charles, Ladd, Helen, Vigdor, Jacob. 2006. Teachers, Schools, and Academic Achievement.
Teacher-Student Matching and the Assessment of Econometrica. 73(2): 417-58.
Teacher Effectiveness. Journal of Human Resources. Rockoff, Jonah. 2004. The Impact of Individual Teachers
41. (4): 778-820. on Student Achievement: Evidence from Panel Data.
Clotfelter, Charles, Helen Ladd, Jacob Vigdor. 2007. The American Economic Review. 94 (2): 247-252.
Teacher Credentials and Student Achievement: Rockoff, Jonah E., Brian A. Jacob, Thomas J. Kane and
Longitudinal Analysis with Student Fixed Effects. Douglas O. Staiger. 2011. Can You Recognize an
Economics of Education Review. 26 (6): 673-682. Effective Teacher When You Recruit One? Education
Clotfelter, Charles T., Ladd, Helen F., Vigdor, Jacob L., Finance and Policy. 6(1): 43-74.
2010. Teacher credentials and student achievement in Ronfeldt, Matthew, Michelle Reininger, and Andrew
high school: a cross-subject analysis with student fixed Kwok. 2013. Recruitment of Preparation? Investigating
effects. Journal of Human Resources 45 (3), 655–681. the Effects of Teacher Characteristics and Student
Dobbie, Will. 2011. Teacher Characteristics and Student Teaching. Journal of Teacher Education. 64 (4): 319-
Achievement: Evidence from Teach for America. 337.
blogs.edweek.org/edweek/teacherbeat/teachercharac Sajjadiani, Sima, Aaron Sojourner, John D. Kammeyer-
teristicsjuly2011.pdf Mueller and Elton Mykerezi (2019). Using Machine
Goldhaber, Dan, James Cowan, and Roddy Theobald. Learning to Translate Applicant Work History Into
2017. Evaluating prospective teachers: Testing the Predictors of Performance and Turnover. Journal of
predictive validity of the edTPA. Journal of Teacher Applied Psychology. Advance online publication,
Education 68 (4): 377-393. https://doi.org/10.1037/apl0000405.

MAPLE | GEORGIA POLICY LABS


Improving Teacher Quality through the Teacher Hiring Process 10

Sass, Tim. 2015. Licensure and Worker Quality: A Wiswall, Matthew. 2013. The Dynamics of Teacher
Comparison of Alternative Routes to Teaching. Journal Quality. Journal of Public Economics. 100: 61-78.
of Law and Economics 58:1-35. Xu, Zeyu, Jane Hannaway, and Colin Taylor. 2011. Making
Sass, Tim, Anastasia Semykina, and Douglas Harris. 2014. a Difference? The Effects of Teach for America in High
Value-added Models and the Measurement of Teacher School. Journal of Policy Analysis and Management
Productivity. Economics of Education Review. 38:9-23. 30:447– 69.
Staiger, Douglas, and Jonah Rockoff. 2010. Searching for
Effective Teachers with Imperfect Information. Journal
of Economic Perspectives. 24 (3): 97-117.

MAPLE | GEORGIA POLICY LABS


Improving Teacher Quality through the Teacher Hiring Process 11

ABOUT THE AUTHORS


Katherine Key is a doctoral candidate in economics at Tim R. Sass is a distinguished university professor of
Georgia State University. Her research focuses on the economics at Georgia State whose research focuses on
economics of education utilizing quantitative, survey, and the economics of education. He is also the faculty director
experimental methods. In particular, she is interested in of the Metro Atlanta Policy Lab for Education (MAPLE).
teacher hiring and methods to improve the quality of the Specific areas of interest include teacher labor supply, the
teacher pool. Her research has been funded by Georgia measurement of teacher quality, and school choice. His
State’s Center for the Economic Analysis of Risk. She is work has been published in numerous academic journals
also a 2019 Dan E. Sweat Fellow. She works directly with and has been supported by grants from the U.S.
school district human resource department leaders to Department of Education, the Gates Foundation, the
provide analysis in support of data-driven policy and Smith Richardson Foundation, the Laura and John Arnold
partner-led priorities. Foundation, and the Spencer Foundation. He has acted as
a consultant to school systems in New York City,
Washington, D.C., Charlotte, the state of Florida and the
state of New York. He is a senior researcher at the Center
for Analysis of Longitudinal Data in Education Research
(CALDER) and serves as an associate editor of the Journal
of Human Resources.

ABOUT THE GEORGIA POLICY LABS


The Georgia Policy Labs (GPL) is a collaboration between Georgia State University and a variety of government agencies to
promote evidence-based policy development and implementation. Housed in the Andrew Young School of Policy Studies,
GPL works to create an environment where policymakers have the information and tools available to improve the
effectiveness of existing government policies and programs, try out new ideas for addressing pressing issues, and decide
what new initiatives are promising enough to scale up. The ultimate goal is to help government entities more effectively
use scarce resources and make a positive difference in people’s lives. GPL contains three focus areas: The Metro Atlanta
Policy Lab for Education works to improve K-12 educational outcomes in metro Atlanta; the Career and Technical
Education Policy Exchange focuses on high-school-based career and technical education in multiple U.S. states; and the
Child and Family Lab looks at issues of the whole child and whole family with Georgia’s state agencies. In addition to
conducting evidence-based policy research, GPL serves as a teaching and learning resource for state officials and
policymakers, students, and other constituents. See more at gpl.gsu.edu.

MAPLE | GEORGIA POLICY LABS

You might also like