Download as pdf or txt
Download as pdf or txt
You are on page 1of 13

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/343784940

Recommendations in School Psychological Evaluation Reports for Academic


Deficits: Frequency, Types, and Consistency with Student Data

Article · August 2020


DOI: 10.1007/s40688-020-00313-w

CITATIONS READS

2 1,216

6 authors, including:

Matthew K Burns Courtenay Barrett


University of Missouri Michigan State University
213 PUBLICATIONS   4,421 CITATIONS    27 PUBLICATIONS   218 CITATIONS   

SEE PROFILE SEE PROFILE

Kathrin Maki Daniel B. Hajovsky


University of Florida Texas A&M University
29 PUBLICATIONS   259 CITATIONS    24 PUBLICATIONS   278 CITATIONS   

SEE PROFILE SEE PROFILE

Some of the authors of this publication are also working on these related projects:

Effect of Acquisition Rate on Time off Task with Kindergarten Students View project

Math Anxiety in Elementary Students: Examining the Role of Timing, Task Complexity, Task Difficulty, and Strategy Use View project

All content following this page was uploaded by Matthew K Burns on 05 December 2020.

The user has requested enhancement of the downloaded file.


Recommendations in School Psychological
Evaluation Reports for Academic Deficits:
Frequency, Types, and Consistency with
Student Data

Matthew K. Burns, Courtenay


A. Barrett, Kathrin E. Maki, Daniel
B. Hajovsky, McKinzie D. Duesenberg &
Monica E. Romero
Contemporary School Psychology
The Official Journal of the California
Association of School Psychologists

ISSN 2159-2020
Volume 24
Number 4

Contemp School Psychol (2020)


24:478-487
DOI 10.1007/s40688-020-00313-w

1 23
Your article is protected by copyright and
all rights are held exclusively by California
Association of School Psychologists. This e-
offprint is for personal use only and shall not
be self-archived in electronic repositories. If
you wish to self-archive your article, please
use the accepted manuscript version for
posting on your own website. You may
further deposit the accepted manuscript
version in any repository, provided it is only
made publicly available 12 months after
official publication or later and provided
acknowledgement is given to the original
source of publication and a link is inserted
to the published article on Springer's
website. The link must be accompanied by
the following text: "The final publication is
available at link.springer.com”.

1 23
Author's personal copy
Contemporary School Psychology (2020) 24:478–487
https://doi.org/10.1007/s40688-020-00313-w

Recommendations in School Psychological Evaluation Reports


for Academic Deficits: Frequency, Types, and Consistency
with Student Data
Matthew K. Burns 1 & Courtenay A. Barrett 2 & Kathrin E. Maki 3 & Daniel B. Hajovsky 4 & McKinzie D. Duesenberg 1 &
Monica E. Romero 1

Published online: 20 August 2020


# California Association of School Psychologists 2020

Abstract
School psychological reports of evaluation results have the potential to provide data that are timely, synthesized, and interpreted
and could include recommendations for evidence-based interventions and accommodations for improving student outcomes. The
current study examined 130 school psychological reports from 13 school districts and found that 61.5% of the reports included
recommendations, most of which were related to interventions or accommodations. There were no differences in the frequency or
types of recommendations between reports that did and did not identify a specific learning disability (SLD), but recommenda-
tions were more frequently based on assessment data for students that were identified with SLD, as compared with those who
were not. Only 48.5% of the recommendations were rated as related to a difficulty or strength identified in the report.

Keywords School psychology . Psychoeducational evaluation reports . Specific learning disabilities

Assessment is a critical component of any intervention model et al. 2008), particularly in the context of special educa-
(Herman et al. 2012; McKenna and Stahl 2015; Shapiro tion eligibility decision making for students suspected of
2011), and research has consistently supported the positive having a specific learning disability (SLD). School psy-
effects of linking interventions to assessment data (Fuchs chological reports should be a source of timely data that
and Fuchs 1986; Graham et al. 2015; Hattie and Timperley are linked to student strengths and difficulties, synthe-
2007), especially for English language arts (Kingston and sized, and interpreted, and they could offer recommenda-
Nash 2011). However, teachers may not be effective in using tions based directly on student strengths and needs.
data to drive their practice because they may lack time to Recommendations typically include interventions, broadly
collect and analyze data, skill to interpret the data and develop defined as practices that attempt to prevent a problem
solutions from them, and timely access to data that are relevant from developing or worsening (Adelman and Taylor
to student problems (Marsh 2012). 1994), and accommodations, or changes to assessment
Teachers may also not see assessment as a primary part and instruction intended to enable a student with a dis-
of their job (Young and Kim 2010). Conducting, synthe- ability to better demonstrate knowledge and skills and
sizing, and reporting assessment results are a fundamental benefit from participation in instruction (Thurlow et al.
aspect of school psychological practice (National 2005). Few teachers reported high satisfaction with school
Association of School Psychologists 2020; Ysseldyke psychologists’ assessment reports because they were often
written in a way that did not facilitate readability or trans-
lating the data into practice (Rahill 2018). Moreover,
* Matthew K. Burns teachers most frequently reported that they wanted data
burnsmk@missouri.edu about student strengths and difficulties in the school psy-
chological report, and recommendations for classroom
1 strategies were the second most desired piece of informa-
University of Missouri, 14B Hill Hall, Columbia, MO 65203, USA
2
tion in the report (Rahill 2018). Below, we discuss the
Michigan State University, East Lansing, MI, USA
purpose of school psychological reports, processes for
3
University of Florida, Gainesville, FL 32611, USA selecting recommendations based on student assessment
4
University of South Dakota, Vermillion, SD 57069, USA data, and types of recommendations included in reports.
Author's personal copy
Contemp School Psychol (2020) 24:478–487 479

Purpose of School Psychological Reports There are multiple sources of information regarding poten-
tial recommendations for specific academic areas, especially
Rucker (1967) reported 50 years ago that, “The purpose of the for students identified as SLD (Dexter and Hughes 2011;
report is not to display the psychologist’s competence or lit- Scammacca et al. 2007, 2015). Many factors may go into
erary ability, but rather to give the teacher useful information selecting recommendations for interventions or accommoda-
about the student. This information should then serve the tions, which may include information unrelated to the assess-
teacher as a guide in educational planning for the student” ment data regarding student strengths and needs. Some of
(p. 101). The section that synthesizes assessment data to pro- these factors include familiarity with the recommended prac-
vide an understanding of the student was described as the tice (Fuchs et al. 2005), school resources, and other contextual
“heart of the report” (p. 98), but the recommendations section issues (Stoiber and DeSmet 2010). However, little is known
of the report was described as the “voice, arms, and legs” about how often school psychological reports include recom-
(Lichtenstein and Ecker 2019, p. 100). Thus, school psycho- mendations and the extent to which recommendations are
logical reports should serve multiple purposes, and one prima- based on the assessment data presented within the report.
ry purpose is to make recommendations based on assessment
data. Types of Recommendations
A well-written school psychological report should directly
translate into goals and objectives for individualized education Recommendations in school psychological reports can take
programs (IEP; Macy and Hoyt-Gonzales 2007). However, many forms, such as interventions and accommodations.
IEP goals are often not based on student data nor are they Recommendations are frequently described as interventions
individualized (Sanches-Ferreira et al. 2013). Perhaps IEP (Bradley-Johnson and Johnson 2006; Lichtenstein and Ecker
goals are not based on data from school psychological reports 2019) or practices that attempt to improve the condition of a
because the reports do not include data teachers perceive as problem or prevent the problem from worsening (Adelman
helpful or specific recommendations (Rahill 2018). Little is and Taylor 1994). A number of interventions have been
known about the types of recommendations that are included shown to increase student learning for students identified as
in reports regarding interventions or accommodations to sup- SLD (Berkeley et al. 2010; Gersten et al. 2009; Scammacca
port struggling students. Further, few, if any, empirical studies et al. 2007). Recommendations in reports may take other
have examined the differences in recommendations made be- forms as well, as long as they are specific, measurable, attain-
tween students that do and do not qualify for special education able, realistic, and timely (Mastoras et al. 2011).
services after being evaluated. Recommendations may also include accommodations or
School psychological reports can also help facilitate com- changes to assessment and instruction that are intended to
munication with parents regarding their child’s skills and enable a student with a disability to better demonstrate knowl-
ways in which to support their child at school and at home edge and skills and benefit from participation in instruction
along with other stakeholders in that child’s life (Harvey (Thurlow et al. 2005). However, accommodations included in
2006). Parents can also be active partners in intervention ef- IEPs for students with disabilities are not often selected based
forts because they can effectively implement academic inter- on student need (Byrnes 2008). Research has consistently
ventions (Daly and Kupzyk 2012), and parents’ implementing demonstrated that accommodations for classroom and ac-
specific intervention techniques were more effective than countability assessment have resulted in increased reading
reading with or listening to their children read (Sénéchal and and math scores (Lang et al. 2008) and increased self-
Young 2008). Effective communication is likely the begin- efficacy (Feldman et al. 2011) for students with SLD.
ning point for partnering with parents on specific academic However, there is little research regarding types of recommen-
interventions, which can be described within school psycho- dations included in school psychological reports.
logical reports.
Purpose of Study and Research Questions
Selecting Recommendations
Through school psychological reports, school psychologists
School psychological reports should include specific recom- have the opportunity to synthesize timely data about student
mendations that describe interventions or accommodations problems and make explicit recommendations to teachers,
and how each relates to the referral question and assessment parents, and other school personnel about how to best inter-
data (Bradley-Johnson and Johnson 2006). Recommendations vene with individual students. Although there is little research
are helpful only if they are directly applicable to the student regarding school psychological reports, previous research has
rather than being generic or applicable to all students irrespec- outlined best practices. Reports should provide information
tive of their individual abilities, skills, and circumstances about the child being assessed that is relevant to all of the
(Mastoras et al. 2011). stakeholders in that child’s life (Harvey 2006) and should
Author's personal copy
480 Contemp School Psychol (2020) 24:478–487

directly translate into IEP goals and objectives (Macy and All of the students about whom the reports were written
Hoyt-Gonzales 2007). The report should also include recom- were between kindergarten and eighth grade. A total of 56 of
mendations that outline interventions or accommodations the students (43.1%) were female, and 100 (76.9%) were iden-
(Bradley-Johnson and Johnson 2006; Lichtenstein and Ecker tified as having an SLD while 30 (23.1%) were identified as
2019) that are measurable, attainable, realistic, timely, and not having any disability. The students identified as SLD were
specific to the student being assessed (Mastoras et al. 2011). not identified with any other disability in addition to SLD.
Teachers report a lack of utility of school psychologists’
report recommendations (Rahill 2018), which could be a bar- Procedure
rier to teachers’ implementation of evidence-based practices
in response to assessment data. Research examining school In order to support compliance for special education decision
psychologists’ report recommendations is therefore needed making, the RESA electronically stored school psychological
to gain an understanding of the types of recommendations reports for students evaluated for SLDs. After receiving per-
implemented and their utility for potentially driving interven- mission from the RESA and approval from a university
tion. Recommendations may better support teachers’ use of Institutional Review Board, 100 reports were randomly select-
data, their satisfaction with school psychological reports, and ed using a random number generator. All randomly selected
the overall assessment process. Supporting teachers’ use of reports were from the population of available reports written
assessment data to drive instructional practices is important between August 2015 and May 2019 that were part of a mul-
to ensure that students receive appropriate support based on tidisciplinary evaluation team (MET) process for students
their individual strengths and needs. Therefore, the current identified with SLD. The reports were limited to students in
study was conducted to address these gaps in the literature kindergarten through eighth grade.
by examining recommendations and relevant data within Next, 30 reports for students who were evaluated for an
school psychological reports from students evaluated for SLD but were not identified with SLD during the same time
SLD. The following research questions guided the study: (a) frame were randomly selected using a random number gener-
how often are recommendations included in school psycho- ator. After the 130 reports were selected, they were de-
logical reports for students referred for suspected SLD? (b) identified by removing all names, birthdates, locations,
What types of recommendations (e.g., interventions or recom- school/district information, school psychologist information,
mendations) are included in school psychological reports? (c) and other identifying or personal information.
What effect does identification of SLDs have on frequency
and type of recommendations in school psychological re- Coding
ports? and (d) How often are recommendations in school psy-
chological reports aligned with assessment data presented Reports were then coded for the presence of at least one rec-
within the report? ommendation. If one or more recommendations were present,
then each was recorded, as was the number of times that each
appeared in the 130 reports.
Method
Types of Recommendations
The present study analyzed 160 extant school psychological
reports collected by 13 public school districts served by one Recommendations were also coded using the following catego-
regional education service agency (RESA) in an upper ries: (a) accommodation, (b) content area on which to focus, (c)
Midwestern state. Details regarding the research setting and assessment, (d) communication, or (e) intervention. A recom-
analytic approach are described below. mendation was coded as an accommodation if it suggested a
procedure or practice that helped ensure equitable access during
Participants and Research Setting instruction for struggling students (Thompson et al. 2005). For
example, how information was presented, how a student was
Across the 13 school districts during the 2018–2019 school allowed to respond, changes to the instructional setting or
year, 12.95% of students qualified for special education ser- timing, or changes to the schedule of instruction were consid-
vices (range 8.43–17.00% within each district), 48.37% qual- ered accommodations. Content area on which to focus was cod-
ified for free or reduced meals (range 20.10–71.50%), 45.07% ed if the report identified a specific skill weakness (e.g., reading,
were students of color (range 4.39–75.52%), and 48.0% and math), but did not suggest ways to improve skills in that area.
48.5% of third graders were proficient on the state assessment Assessment was coded if the report suggested collecting addi-
in English/Language Arts (ELA) and math (ranges 29.6– tional data to make future decisions (e.g., progress monitoring).
74.10% and 28.6–82.4%) in 2018–2019, respectively. Please Communication was coded if the recommendation suggested
see Table 1 for additional details regarding the school districts. sharing information about the student with specific people or
Author's personal copy
Contemp School Psychol (2020) 24:478–487 481

Table 1 Characteristics and special education programming of participating districts in 2018–2019

Geographic region % of students receiving % of students eligible for % of students of color % of third graders proficient
special education FRPL on state assessment in ELA

District A City, small 8.43% 33.85% 44.14% 61.40%


District B Suburb, large 9.42% 20.10% 43.23% 70.40%
District C Suburb, large 10.07% 32.15% 14.20% 60.90%
District D Rural, distant 10.68% 31.23% 6.44% 46.50%
District E Town, fringe 10.96% 22.35% 11.60% 72.00%
District F Rural, fringe 11.84% 51.18% 5.27% 40.20%
District G Suburb, large 11.88% 26.03% 25.29% 74.10%
District H Suburb, large 12.29% 43.58% 38.41% 48.10%
District I Town, fringe 13.74% 54.39% 4.39% 34.80%
District J Rural, distant 13.77% 40.75% 6.49% 57.50%
District K Suburb, large 15.89% 62.28% 65.50% 37.7%
District L Suburb, large 16.26% 60.88% 53.77% N/A4
District M City, midsize 17.00% 71.50% 75.52% 29.60%

Note: Geographic region is the National Center for Educational Statistics (2018) locale code in the 2018–2019 school year. FRPL = Free and Reduced
Price Lunch. In 2017–2018, ELA = English Language Arts. This district provides regional programming for surrounding districts and does not have state
assessment data available

professionals. Intervention was coded when the recommenda- number of codings and multiplied by 100, which resulted
tion outlined a specific approach to strengthen skills in a given in 95% IOA between the two raters. There were a total
area or to prevent a problem from developing or worsening of 5 out of 101 disagreements, which were discussed by
(Adelman and Taylor 1994). Coding was limited to the first the two coders until consensus was reached and the data
10 recommendations presented in the report in order to ensure were recoded to represent the consensus. Sixteen of the
some consistency across the reports. 80 reports (20%) that included recommendations were
randomly selected and independently coded by a second
rater to calculate IOA. The second rater coded each sug-
Aligned with Data
gestion as aligned with the data or not. The number of
times that each coder rated a recommendation as aligned
Finally, recommendations were coded as aligned with the
with the data or not aligned with the data was divided by
evaluation data or not. A recommendation was coded as
the total number of recommendations included in the 16
aligned with evaluation data if it were directly related to a
reports, and multiplied by 100 to compute percentage
specific area of difficulty or strength identified by test scores,
agreement, which equaled 96% IOA between the two
teacher reports, parent reports, or background information in
coders. There were a total of 2 disagreements out of 52
the school psychological report. It was coded as not aligned if
recommendations, which were discussed by the two
there was no clear link between the recommendation and a
coders until consensus was reached and the data were
specific area of difficulty or strength identified by the evalua-
recoded to represent the consensus.
tion data within the report.

Interobserver Agreement
Results
Interobserver agreement (IOA) was calculated separately
for the categories of recommendations and alignment A total of 80 (61.5%) reports included recommendations, and
with data. First, a second independent coder recoded all 50 (38.5%) did not. As shown in Tables 2 and 3, there were
recommendations (n = 101) identified within the reports 101 unique recommendations in the reports that appeared 377
to estimate IOA for coding of the recommendation cate- times. The year that the report was written (2015–2016, 2015–
gories as accommodations, areas on which to focus, as- 2017, 2017–2018, 2018–2019) did not significantly affect the
sessment, communication, and intervention based on the number of reports that included recommendations X2 (df = 3,
definitions provided above. The total number of agree- n = 130) = 3.88, p = .274) nor did the school building that the
ments between the two coders was divided by the total student attended X2 (df = 45) = 49.01, p = .315).
Author's personal copy
482 Contemp School Psychol (2020) 24:478–487

Table 2 Recommendations in
school psychology reports that Recommendation n % Recommendation n %
appeared multiple times and
percentage of the 130 reports in None 50 38.5 Incremental rehearsal 6 4.6
which they appeared Extra time on tests/assignments 27 20.8 Reading fluency 6 4.6
Break tasks into smaller units 19 14.6 Increase repetition 6 4.6
Preferential seating 15 11.5 General math intervention 5 3.8
Communication with family 14 10.8 Multisensory approaches 5 3.8
Graphic or visual organizers 14 10.8 Nonverbal cues 5 3.8
General reading interventions 13 10.0 Repeat instructions to student 5 3.8
Special education service 12 9.4 Vision examination 5 3.8
Make others aware of problem 11 8.4 Provide visual information 5 3.8
Read tests/directions to student 10 7.7 Read to student 5 3.8
Less problems or spelling words 10 7.7 Keep oral directions brief 4 3.0
Examination by a physician 10 7.7 Chunking 4 3.0
Frequent breaks 9 6.9 Repeated reading 4 3.1
Visual prompts and instructions 8 6.1 Monitor students attention 4 3.1
Quiet place to work 8 6.1 Provide a list of tasks to finish 4 3.1
Checks for understanding 7 5.3 Refer to school counselor 4 3.1
Reading decoding and accuracy 7 5.3 Math procedures 3 2.3
Direct instruction 7 5.3 Student repeat instructions 3 2.3
Behavior intervention plan 6 4.6 Frequent reviews 3 2.3
Teach study skills 3 2.3 Spelling checks and resources 3 2.3
Provide a copy of notes 3 2.3 Progress monitoring 2 1.5
Allow to use a calculator 2 1.5 Provide a study guide 2 1.5
Buddy pairing 2 1.5 Reduce homework 2 1.5
Computer-assisted instruction 2 1.5 Reinforce positive behavior 2 1.5
Cover-copy-compare 2 1.5 REWARDS 2 1.5
Clink or clunk 2 1.5 Self-monitoring 2 1.5
Use concrete examples 2 1.5 Speech to text software 2 1.5
Math manipulatives 2 1.5 Strategy instruction 2 1.5
Positive behavior supports 2 1.5 Writing transcription 2 1.5

Table 3 Recommendations in
school psychology reports that Recommendation Recommendation Recommendation
appeared once each (0.77%)
Assessment Accommodations Assistive Technology Attendance
Calming Strategies Card Sorts Choral Responding
Community Mental Health Dictating Responses Educate Student About Disability
Elkonin Boxes Encourage to Take Risks Enhance Maturity
Fitzgerald Spelling Flashcards Fluid Reasoning Skills
Highlighter/Cover Overlays I’m Thinking Game General Writing Intervention
Leadership Skills Math Games Math Problem Solving
Mental Imaging Instruction in Money Monitor Understanding of Directions
More Time to Think Before Responding Phrase Progress Reading Practice Counting
Practice Math Facts Practice Tests Preteach Vocabulary
Read at Home Read to Student at Home Reading Comprehension
Reinforce Student Interests Safety Plan SCOPE Reading Intervention
Social-Emotional Learning Enhance Self-Esteem Socialization
Summer School TASK Verbal Prompts to Respond
Visual Timer Practice Vowel Sounds
Author's personal copy
Contemp School Psychol (2020) 24:478–487 483

Frequency of Recommendations family (n = 14, 10.8%), followed by communicating with


school staff who worked with the student (n = 11, 8.4%), re-
Approximately one-third of all of the reports (n = 50, 38.5%) ferring the student to a physician (n = 10, 7.7%),
did not include any recommendations. Extra time to complete recommending a vision examination (n = 5, 3.8%), and refer-
tests and assignments (n = 27, 20.8%) was the most frequently ring the student to a school counselor (n = 4, 3.1%). Finally,
made recommendation, and breaking tasks into smaller units two recommendations addressed assessments such as progress
(n = 19, 14.6%), preferential seating (n = 15, 11.5%), commu- monitoring (n = 2, 1.5%).
nicating with family about concerns (n = 14, 10.8%), and
graphic or visual organizers (n = 14, 10.8%) were also fre-
Effect of SLD Identification on Recommendations
quently recommended. Twelve of the reports (11.9%) recom-
mended a specific special education service such as teacher
As shown in Table 4, 100 of the reports recommended that the
consultant (n = 9), school social worker (n = 2), and occupa-
student qualify for special education services under the cate-
tional therapy (n = 1).
gory of SLD, and 30 of the reports indicated that no disability
was present. Recommendations were included in 60.6% and
Types of Recommendations 66.7% of reports that did and did not identify an SLD, respec-
tively. The Chi-square statistic suggested that there was not a
Most of the 101 unique recommendations were accommoda- significant difference between the frequency of recommenda-
tions (n = 32, 31.7%) and interventions (n = 35, 33.0%), tions described in reports that did and did not identify an SLD;
followed by areas on which to focus (n = 23, 22.8%), commu- or put another way, there was similar frequency of recommen-
nication (n = 9, 8.9%), and assessments (n = 2, 2.0%), with dations across the two types of reports X 2 (df = 1, n =
significant variability in the frequency of types of recommen- 130) = .359, p = .549).
dations across the categories X2 (df = 4, n = 101) = 37.40, Being identified as SLD or not also did not significantly
p < .01). An additional 12 reports (11.9%) recommended spe- affect the frequency of types of recommendations across the
cific special education services. Among the recommendations categories X2 (df = 4, n = 377) = 3.04, p = .551). Of the 377
for interventions, the plurality was for graphic organizers (n = recommendations described in the 130 reports, most were
13, 10.0%), followed by direct instruction (n = 7, 5.3%), in- accommodations for both groups (44.6% for SLD and
cremental rehearsal (n = 6, 4.6%), behavior intervention plan 50.9% for not SLD). Interventions were suggested in 20.1%
(n = 6, 4.6%), direct instruction (n = 5, 4.0%), and repeated of the recommendations for students who were identified with
reading (n = 4, 3.1%). Among the recommendations for ac- SLD and 21.8% of the recommendations for the students not
commodations, the plurality was for providing extra time for identified as SLD. Of the remaining recommendations, 16.7%
tests and assignments (n = 27, 20.8%), followed by breaking (SLD) and 13.6% (not SLD) regarded communication, 14.1%
down tasks into smaller units (n = 19, 14.6%), preferential (SLD) and 11.8% (not SLD) were areas on which to focus,
seating (n = 15, 11.5%), and reading tests and directions to and 4.5% (SLD) and 1.8% (not SLD) were assessments.
students (n = 10, 7.7%). Among the recommendations to fo-
cus on a specific area, the plurality was for general reading
(n = 13, 10.0%), followed by reading decoding and accuracy Recommendations Based on Data
(n = 7, 5.3%), reading fluency (n = 6, 4.6%), general math
(n = 5, 3.8%), math procedures (n = 3, 2.3%), study skills Of the 377 recommendations described in the 130 reports, 183
(n = 3, 2.3%), writing transcription (n = 2, 1.5%), and atten- (48.5%) were rated as directly aligned with the student evalu-
dance (n = 1, 0.8%). Among recommendations for communi- ation data and 194 (51.5%) were not. As shown in Table 5,
cation, the plurality was for discussing the problem with the recommendations were more frequently aligned with data for

Table 4 Frequency of recommendations for reports that identified a Table 5 Frequency with which recommendations were aligned with
learning disability and those that did not data according to whether or not the student was identified a learning
disability
Included recommendations
Aligned with data
No Yes Total
No Yes Total
Learning disability No 10 20 30 Learning Disability No 67 43 110
Yes 40 60 100 Yes 127 140 267
Total 50 80 130 Total 194 183 377

X2 (df = 1, n = 130) = .43, p = .510) X2 (df = 1, n = 377) = 5.55, p < .05)


Author's personal copy
484 Contemp School Psychol (2020) 24:478–487

students identified with SLD (52.4%) than for those not iden- Types of Recommendations
tified as SLD (39.1%) X2 (df = 1, n = 377) = 5.55, p < .05).
At its core, SLD reflects achievement difficulties in at least
one of eight academic areas outlined in IDEA (P.L. No. 108–
446 § 300.309[a][1]). Thus, the students whose reports were
Discussion analyzed in this study all likely demonstrated academic diffi-
culties whether they were identified with SLD or not. It is
This study contributed to the literature by examining the rec- therefore interesting that relatively few of the recommenda-
ommendations made within school psychological reports. tions directly addressed specific academic difficulties and that
School psychological reports offer the unique opportunity only 33.0% of the recommendations were for interventions
for teachers to use data to drive educational practice as the generally. For students demonstrating academic difficulties,
reports are timely, data are synthesized and interpreted, and it is important to provide systematic, explicit intervention to
recommendations may outline evidence-based interventions develop the academic skills (Burns et al. 2014a, b). School
and accommodations for improving student outcomes. The psychologists likely demonstrate unique skills regarding aca-
study found that 61.5% of the reports included recommenda- demic intervention supports for students (National
tions, most of which were related to interventions or accom- Association of School Psychologists 2020) and thus can use
modations. There were no differences in the frequency or these skills to develop evidence-based interventions or recom-
types of recommendations between reports that did and did mendations to support students’ academic strengths and
not identify an SLD, although recommendations were more needs.
frequently based on data for students that did have an SLD Given that reading difficulties represent the most common
compared with those who did not. referral for special education (Bramlett et al. 2002) and that
most students receiving special education services under SLD
have a reading disability (Cortiella and Horowitz 2014), it is
Use of Recommendations interesting that relatively few of the recommendations specif-
ically addressed reading. Early intervention targeting reading
It is perhaps surprising that only 61.5% of reports in- is particularly important because early reading skills predict
cluded recommendations. Assessment data should always later academic achievement, high school graduation, and em-
be gathered for a purpose (Salvia et al. 2012), and al- ployment (Hernandez 2011). Thus, evidence-based targeted
though special education eligibility reflects one purpose reading interventions could be an important area in which to
for the assessment data included in these reports, ulti- provide report recommendations for the large number of stu-
mately, assessment data should be used to support stu- dents who demonstrate those needs.
dents’ educational functioning (Newton 2007). Given
that there was a large number of reports in this study Recommendations Based on Data
that did not include recommendations, it seems unlikely
that the assessment data gathered as part of the special Of particular importance, only slightly less than half (48.5%)
education evaluation were used to drive support services of the recommendations identified in this study were based on
for students because the data were not transformed into the student evaluation data in the reports. School psycholo-
actionable items with recommendations. Special educa- gists should use data to drive decision-making (National
tion and general education teachers cannot implement Association of School Psychologists 2020), but these findings
recommendations that are not made. Special education suggested that school psychologists may not consistently use
eligibility decisions should be made by a multidisciplin- data-based decision-making to inform evaluation recommen-
ary team (P.L. 108–446 § 303.24); however, school psy- dations. It may also suggest that school psychologists are fre-
chologists still hold considerable weight in making deci- quently including generic recommendations that are not based
sions from assessment data (Becker et al. 2014; Burns on the student’s unique needs, strengths, or contexts, which is
et al. 2014a, b), which is likely a reflection of school the most important characteristic of a recommendation
psychologists’ expertise in assessment administration and (Mastoras et al. 2011). Such practice may be problematic giv-
i n t e r p r e t a t i o n ( N a t io n a l A s s o c i a t i o n o f Sc h o o l en the importance of matching interventions and other sup-
Psychologists 2020; Ysseldyke et al. 2008). Given ports with students’ specific strengths and needs (Burns et al.
school psychologists’ important role on the multidisci- 2014a, b). Research has suggested that special education ser-
plinary team and unique assessment interpretation skills, vices are not particularly effective (Fuchs et al. 2010; Kavale
ensuring that assessment data result in appropriate report and Forness 2000). Although many hypotheses have been
recommendations is necessary to help students receive suggested to explain this lack of effectiveness, the data from
appropriate support in school. this study may suggest that students do not receive appropriate
Author's personal copy
Contemp School Psychol (2020) 24:478–487 485

instruction for their specific strengths and difficulties. Report Implications


recommendations could serve as an important starting point to
drive implementation of evidence-based instructional prac- This study has potentially significant implications for the pro-
tices for students demonstrating severe difficulties. vision of school psychological service delivery. This study
Perhaps the link between SLD identification and recom- offers a rationale for the importance of including recommen-
mendations being based on data was because students identi- dations in school psychological reports, a framework for cat-
fied with a disability will receive an IEP with individualized egorizing types of recommendations, and highlights the need
goals and objectives. The school psychological reports pro- for practicing school psychologists to ensure that recommen-
vided data on which the goals and objectives could be built dations are based on assessment data collected through the
(Macy and Hoyt-Gonzales 2007). Data-based interventions evaluation process. School psychologists may wish to reflect
are critical for successful prevention efforts (Herman et al. upon or monitor their own practice to increase the quantity
2012; McKenna and Stahl 2015) as well as for developing and quality of their recommendations. At the systems level,
IEP goals and objectives. Tier 2 interventions are more effec- school districts or RESAs may wish to engage in a similar
tive if they address specific student strengths and needs, as process and periodically review reports for the number and
opposed to a comprehensive intervention received by all stu- types of recommendations, and then provide professional de-
dents getting a tier 2 intervention that addresses multiple needs velopment or coaching for school psychologists to support
(Hall and Burns 2018). Data from school psychological re- them in making effective, data-based recommendations.
ports could help inform tier 2 intervention efforts, which sug- The current data may also have implications for training
gests a potential need for more data-based recommendations school psychologists. Future practitioners could be directly taught
in school psychological reports. how to use data to construct specific recommendations based on
individual student strengths and needs. Additionally, given that
Limitations and Suggestions for Future Research extra time on tests, breaking tasks into smaller units, and prefer-
ential seating were the three most commonly listed recommenda-
Despite the merits of the study, there were limitations that lend tions, training programs could also teach additional interventions
themselves to suggestions for future research. First, although to more effectively address student strengths and needs.
reports were randomly sampled from one RESA, which in-
creases generalizability to the entire population of reports
within the service area, results may not be generalizable to Conclusion
other regions of the country. Future researchers may wish to
examine regional differences in recommendations, as regional School psychologists are in a unique position to provide school-
differences have been found to be related to the identification based recommendations to effectively assist with service deliv-
of SLDs and special education decision making (Barrett et al. ery. As school psychological reports provide teachers and edu-
2015). Second, there was limited information about the school cators with critical knowledge about student strengths and
psychologists who conducted the evaluations and wrote the needs, the current study examined the types and frequency of
reports. Research has suggested there are differences between recommendations made within school psychological reports to
how school psychologists assess and identify SLDs (Cottrell address referral concerns related to specific learning disabilities.
and Barrett 2016, 2017), which may be related to the recom- Although a nontrivial number of reports did not include any
mendations that are put forth based on data. Future researchers recommendations (38.5%), findings showed that the majority
may wish to include a greater number or more diverse sample of reports that did include recommendations were typically re-
of school psychologists and their reports. Third, it is possible lated to interventions or accommodations. There were negligi-
that some school districts do not allow school psychologists to ble differences in the frequency of recommendations provided
include recommendations in their report, which could affect between those who qualified and those who did not, although
the results of this research. Additional research is likely need- those identified had recommendations that were more likely to
ed regarding why school psychologists do and do not include be aligned with actual student data. Finally, of the 377 recom-
recommendations in their reports. Fourth, the study did not mendations provided across 130 reports, only about half includ-
consider the effect that the referral question had on the assess- ed recommendations that were specifically linked to student
ment or resulting disability identification decision, which sug- evaluation data. This study adds empirical data to the literature
gests an area for future research. Finally, it was unclear the regarding the types and frequency of school-based recommen-
extent to which the recommendations were subsequently im- dations. Studies should be conducted with other regional school
plemented by general or special education teachers. Future districts to help determine generalizability of results. Given the
researchers may wish to examine whether or not recommen- importance of assessment to any prevention or intervention
dations are included in IEPs, implemented, and ultimately able model, and the data presented here, the additional research
to improve student outcomes. seems warranted.
Author's personal copy
486 Contemp School Psychol (2020) 24:478–487

Compliance with Ethical Standards Fuchs, L. S., & Fuchs, D. F. (1986). Effects of systematics formative
evaluation: a meta-analysis. Exceptional Children, 53, 199–208.
Fuchs, L. S., Fuchs, D., & Capizzi, A. M. (2005). Identifying appropriate
The authors do not have any potential conflicts of interest, and all research
test accommodations for students with learning disabilities. Focus
was approved by a university Institutional Research Board. The research
on Exceptional Children, 37(6), 1–8.
and informed consent process was consistent with ethical standards
outlined by the American Psychological Association and the approving Fuchs, D., Fuchs, L. S., & Stecker, P. M. (2010). The “blurring” of special
IRB. education in a new continuum of general education placements and
services. Exceptional Children, 76, 301–323. https://doi.org/10.
1177/001440291007600304.
Gersten, R., Chard, D. J., Jayanthi, M., Baker, S. K., Morphy, P., & Flojo,
References J. (2009). Mathematics instruction for students with learning disabil-
ities: a meta-analysis of instructional components. Review of
Adelman, H. S., & Taylor, L. L. (1994). On understanding intervention in Educational Research, 79, 1202–1242.
psychology and education. Westport: Praeger. Graham, S., Hebert, M., & Harris, K. R. (2015). Formative assessment
Barrett, C. A., Cottrell, J. M., Newman, D. S., Pierce, B. G., & Anderson, and writing: a meta-analysis. The Elementary School Journal, 115,
A. (2015). Training school psychologists to identify specific learn- 523–547.
ing disabilities: a content analysis of syllabi. School Psychology Hall, M. S., & Burns, M. K. (2018). Meta-analysis of targeted small-
Review, 44, 271–288. group reading interventions. Journal of School Psychology, 66,
Becker, S. P., Paternite, C. E., & Evans, S. W. (2014). Special educators’ 54–66.
conceptualizations of emotional disturbance and educational place- Harvey, V. S. (2006). Variables affecting the clarity of psychological
ment decision making for middle and high school students. School reports. Journal of Clinical Psychology, 62, 5–18.
Mental Health, 6, 163–174. https://doi.org/10.1007/s12310-014- Hattie, J., & Timperley, H. (2007). The power of feedback. Review of
9119-7. Educational Research, 77, 81–112.
Berkeley, S., Scruggs, T. E., & Mastropieri, M. A. (2010). Reading com- Herman, K. C., Riley-Tillman, T. C., & Reinke, W. M. (2012). The role
prehension instruction for students with learning disabilities, 1995— of assessment in a prevention science framework. School
2006: a meta-analysis. Remedial and Special Education, 31, 423– Psychology Review, 41, 306–314.
436. Hernandez, D. J. (2011). Double jeopardy: how third-grade reading skills
Bradley-Johnson, S. & Johnson, C. M. (2006). A handbook for effective and poverty influence high school graduation. Annie E. Casey
report writing (2nd ed). PRO-ED. Foundation.
Bramlett, R. K., Murphy, J. J., Johnson, J., & Wallingsford, L. (2002). Individuals with Disabilities Education Improvement Act of 2004, Pub.
Contemporary practices in school psychology: a national survey of L. No. 108–446,118Stat. 2647; 2004 Enacted H.R. 1350; 108
roles and referral problems. Psychology in the Schools, 39, 327–335. Enacted H.R. 1350. Final regulations implementing IDEA 2004
https://doi.org/10.1002/pits.10022. were published in the Federal Register, Monday, August 14, 2006,
Burns, M. K., Kanive, R., & Karich, A. C. (2014a). Best practices in pp. 46540–46845.
implementing school-based teams within a multitiered system of Kavale, K. A., & Forness, S. R. (2000). Policy decisions in special edu-
support. In A. Thomas & J. Grimes (Eds.), Best practices in school cation: the role of meta-analysis. In R. Gersten, E. P. Schiller, & S.
psychology VI, (pp. 569–582). National Association of School Vaughn (Eds.), Contemporary special education research: synthe-
Psychologists. sis of the knowledge base on critical instructional issues (pp. 281–
Burns, M. K., VanDerHeyden, A. M., & Zaslofsy, A. F. (2014b). Best 326). Lawrence Erlbaum Associates.
practices in delivery intensive academic interventions with skill-by- Kingston, N., & Nash, B. (2011). Formative assessment: a meta-analysis
treatment interaction. In A. Thomas & J. Grimes (Eds.), Best prac- and a call for research. Educational Measurement: Issues and
tices in school psychology VI, (pp. 129–142). National Association Practice, 30, 28–37.
of School Psychologists. Lang, S. C., Elliott, S. N., Bolt, D. M., & Kratochwill, T. R. (2008). The
Byrnes, M. (2008). Educators' interpretations of ambiguous accommoda- effects of testing accommodations on students' performances and
tions. Remedial and Special Education, 29, 306–315. reactions to testing. School Psychology Quarterly, 23, 107–124.
Cortiella, C., & Horowitz, S. H. (2014). The state of learning disabilities: Lichtenstein, R., & Ecker, B. (2019). High-impact assessment reports for
facts, trends and emerging issues. National Center for Learning children and adolescents: a consumer-responsive approach. Guilford
Disabilities. Publication.
Cottrell, J. M., & Barrett, C. A. (2016). Defining the undefinable: Macy, M., & Hoyt-Gonzales, K. (2007). A linked system approach to
operationalizing methods to identify specific learning disabilities. early childhood special education eligibility assessment. Teaching
Psychology in the Schools, 53, 143–157. https://doi.org/10.1002/ Exceptional Children, 39(3), 40–44.
pits.21892. Marsh, J. A. (2012). Interventions promoting educators’ use of data:
Cottrell, J. M., & Barrett, C. A. (2017). Examining school psychologists’ research insights and gaps. Teachers College Record, 114(11), 1–
perspectives about specific learning disabilities: implications for 48.
practice. Psychology in the Schools, 54, 294–308. https://doi.org/ Mastoras, S. M., Climie, E. A., McCrimmon, A. W., & Schwean, V. L.
10.1002/pits.21997. (2011). A c.l.e.a.r. approach to report writing: a framework for im-
Daly, E. J., & Kupzyk, S. (2012). An investigation of student-selected and proving the efficacy of psychoeducational reports. Canadian
parent-delivered reading interventions. Journal of Behavioral Journal of School Psychology, 26, 127–147.
Education, 21, 295–314. McKenna, M. C., & Stahl, K. A. D. (2015). Assessment for reading
Dexter, D. D., & Hughes, C. A. (2011). Graphic organizers and students instruction. Guilford.
with learning disabilities: a meta-analysis. Learning Disability National Association of School Psychologists (2020). The professional
Quarterly, 34, 51–72. standards of the National Association of School Psychologists.
Feldman, E., Kim, J. S., & Elliott, S. N. (2011). The effects of accommo- National Center for Education Statistics (2018). Children and youth with
dations on adolescents’ self-efficacy and test performance. The disabilities. Retrieved from http://nces.ed.gov/programs/coe/
Journal of Special Education, 45, 77–88. indicator_cgg.asp
Author's personal copy
Contemp School Psychol (2020) 24:478–487 487

Newton, P. E. (2007). Clarifying the purposes of educational assessment. Publisher’s Note Springer Nature remains neutral with regard to jurisdic-
Assessment in Education, 14, 149–170. tional claims in published maps and institutional affiliations.
Rahill, S. A. (2018). Parent and teacher satisfaction with school-based
psychological reports. Psychology in the Schools, 55, 693–706.
Rucker, C. N. (1967). Report writing in school psychology a critical Matthew K. Burns Ph.D. is a Professor of Special Education at the
investigation. Journal of School Psychology, 5, 101–108. University of Missouri, and Director of the Center for Collaborative
Salvia, J., Ysseldyke, J., Bolt, S., & Witmer, S. (2012). Assessment in Solutions for Kids, Practice, and Policy. Dr. Burns is one of the leading
special and inclusive education. Wadsworth. researchers regarding the use of assessment data to determine individual
Sanches-Ferreira, M., Lopes-dos-Santos, P., Alves, S., Santos, M., & or small-group interventions, and has published extensively on response
Silveira-Maia, M. (2013). How individualised are the individualised to intervention, academic interventions, and facilitating problem-solving
education programmes (IEPs): An analysis of the contents and qual- teams.
ity of the IEPs goals. European Journal of Special Needs Education,
28, 507–520. Courtenay Barrett Ph.D. is an Assistant Professor in the School
Scammacca, N., Roberts, G., Vaughn, S., Edmonds, M., Wexler, J., Psychology program at Michigan State University, and is both a licensed
Reutebuch, C. K., & Torgesen, J. K. (2007). Interventions for ado- psychologist and a Nationally Certified School Psychologist. Her re-
lescent struggling readers: a meta-analysis with implications for search interests include coaching and consultation within multi- tiered
practice. RMC Research Corporation, Center on Instruction. system of supports, data-based decision making and contextual factors
Scammacca, N. K., Roberts, G., Vaughn, S., & Stuebing, K. K. (2015). A that influence the provision of school psychology service delivery.
meta-analysis of interventions for struggling readers in grades 4–12:
1980–2011. Journal of Learning Disabilities, 48, 369–390. Kathrin E. Maki Ph.D. is an Assistant Professor of School Psychology in
Sénéchal, M., & Young, L. (2008). The effect of family literacy interven- the School of Special Education, School Psychology, and Early
tions on children’s acquisition of reading from kindergarten to grade Childhood Studies at the University of Florida. Her research centers on
3: a meta-analytic review. Review of Educational Research, 78, the conceptual, psychometric, and decision-making issues related to
880–907. Specific Learning Disabilities (SLD) identification, and the use of assess-
ment data to drive academic intervention implementation for students
Shapiro, E. S. (2011). Academic skill problems: direct assessment and
with SLD and other academic difficulties.
intervention. Guilford.
Stoiber, K. C., & DeSmet, J. L. (2010). Guidelines for evidence-based
Daniel B. Hajovsky Ph.D. is an Assistant Professor of School Psychology
practice in selecting interventions Practical handbook of school psy-
and Chair of the Division of Counseling and Psychology in Education at
chology: Effective practices for the 21st century, 213-234.
the University of South Dakota. Dr. Hajovsky primarily researches
Thompson, S. J., Morse, A. B., Sharpe, M., & Hall, S. (2005). neurocognitive, social cognitive, and social dyadic influences on reading,
Accommodations manual: how to select, administer, and evaluate writing, and math achievement in youth and adolescent children.
use of accommodations for instruction and assessment of students
with disabilities (2nd). Council of Chief State School Officers. McKinzie Duesenberg is a third-year student in the School Psychology
Thurlow, M. L., Lazarus, S. S., Thompson, S. J., & Morse, A. B. (2005). Ph.D. program at the University Missouri and is an Associate Director of
State policies on assessment participation and accommodations for A Way With Words and Numbers. Her research interests include academ-
students with disabilities. The Journal of Special Education, 38, ic and community based interventions specifically geared towards stu-
232–240. dents with developmental and intellectual disabilities and families from
Young, V. M., & Kim, D. (2010). Using assessments for instruction lower socioeconomic backgrounds.
improvement: a literature review. Educational Policy Analysis
Archives, 18(19), 1–40. Monica Romero is a third-year student in the School Psychology Ph.D.
Ysseldyke, J., Burns, M., Dawson, P., Kelley, B., Morrison, D., Ortiz, S., program at the University of Missouri. Her research interests include early
& Telzrow, C. (2008). The blueprint for training and practice as the identification and intervention/assessments for Emerging Bilinguals,
basis for best practices. In A. Thomas & J. Grimes (Eds.), Best Latinx, and undocumented immigrant youths with academic difficulties,
Practices in School Psychology V, (pp. 37–69). National language development, bilingual school psychology training and practice,
Association of School Psychologists. and family-school partnerships.

View publication stats

You might also like