1 s2.0 S0361476X18300183 Main

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 21

Contemporary Educational Psychology 55 (2018) 63–83

Contents lists available at ScienceDirect

Contemporary Educational Psychology


journal homepage: www.elsevier.com/locate/cedpsych

Educational placement and achievement motivation of students with special T


educational needs☆

Aleksander Kocaja, , Poldi Kuhlb, Malte Jansena, Hans Anand Pantc, Petra Stanata
a
Institute for Educational Quality Improvement, Humboldt-Universität zu Berlin, Unter den Linden 6, 10099 Berlin, Germany
b
Institute of Educational Science, Leuphana University of Lüneburg, Universitätsallee 1, 21335 Lüneburg, Germany
c
Department of Education Studies, Humboldt-Universität zu Berlin, Unter den Linden 6, 10099 Berlin, Germany

A R T I C LE I N FO A B S T R A C T

Keywords: The present study investigated how the educational placement in special education schools or regular schools is
Special educational needs related to the achievement motivation of students with special educational needs (SEN). Furthermore, we ex-
Educational placement amined whether the classroom social environment (i.e., class-average achievement and social support) explains
Academic self-concept potential placement differences. We compared the academic self-concept and enjoyment of learning of SEN
Enjoyment of learning
students in special education schools (n = 420) and regular schools (n = 678) at the end of 4th grade. In line
Classroom composition
with social comparison theory, SEN students in special education schools reported higher academic self-concepts
and enjoyment of learning than their peers in regular schools. Examining underlying mechanisms, class-average
achievement was negatively related to SEN students’ academic self-concept and enjoyment of learning. In
contrast, individually perceived social support by classmates—but not class-average social support—was posi-
tively associated with SEN students’ achievement motivation. After controlling for individual and class-average
achievement, no relationship between SEN students’ educational placement and achievement motivation was
found. Results indicate that social comparisons with classmates may result in placement differences in SEN
students' academic self-concept and enjoyment of learning.

1. Introduction schools vs. regular schools) and the type of classroom where SEN stu-
dents receive instruction. There is a lively debate among policy makers,
Separate but equal is never equal (Brown v. Board of Education, school practitioners, and educational researchers (Hocutt, 1996;
1954). But for students with special educational needs (SEN), potential Lindsay, 2007): Should students with SEN be educated in regular
benefits and drawbacks of separate schools specialized to their needs classrooms or in separate schools or classrooms specifically targeted to
are still widely debated. With the ratification of the UN Convention on their needs?
the Rights of Persons with Disabilities (United Nations, 2006), several The trend towards a more inclusive school system is accompanied
countries have committed to implementing a more inclusive school by intensified research on its effectiveness for SEN students (Bakker,
system and to increasing the proportion of SEN students in regular Denessen, Bosman, Krijger, & Bouts, 2007; Lindsay, 2007; Ruijs &
schools. Although inclusive schooling involves a number of organiza- Peetsma, 2009). This research has not revealed consistent associations
tional features, teaching practices, and student groups, one central as- between SEN students’ educational placement and aspects of their
pect concerns the educational placement of students with SEN. Edu- school development. With regard to cognitive outcomes, the majority of
cational placement refers to the school type (e.g., special education studies point to higher achievement levels of SEN students in regular


The present study is part of a doctoral dissertation. Data were made available by the Research Data Centre (Forschungsdatenzentrum, FDZ) at the Institute for
Educational Quality Improvement (Institut zur Qualitätsentwicklung im Bildungswesen, IQB) in Berlin (Germany). The FDZ at the IQB is part of the Centre for
International Student Assessment (ZIB). During the work on his dissertation, Aleksander Kocaj was also a pre-doctoral fellow of the International Max Planck
Research School on the Life Course (LIFE, http://www.imprs-life.mpg.de; participating institutions: MPI for Human Development, Freie Universität Berlin,
Humboldt-Universität zu Berlin, University of Michigan, University of Virginia, University of Zurich).

Corresponding author.
E-mail addresses: a.kocaj@iqb.hu-berlin.de (A. Kocaj), poldi.kuhl@leuphana.de (P. Kuhl), malte.jansen@iqb.hu-berlin.de (M. Jansen),
hansanand.pant@hu-berlin.de (H.A. Pant), petra.stanat@iqb.hu-berlin.de (P. Stanat).

https://doi.org/10.1016/j.cedpsych.2018.09.004

Available online 07 September 2018


0361-476X/ © 2018 Elsevier Inc. All rights reserved.
A. Kocaj et al. Contemporary Educational Psychology 55 (2018) 63–83

schools compared to their peers in special education schools (Kocaj, Supporters of an inclusive education, in contrast, suggest that SEN
Kuhl, Kroth, Pant, & Stanat, 2014; Ruijs & Peetsma, 2009).1 However, students in regular schools could feel more appreciated as capable
findings on placement differences for psychosocial (Bakker et al., 2007; learners (Bakker & Bosman, 2003). This, in turn, may increase SEN
Pijl & Frostad, 2010) and motivational outcomes (Elbaum, 2002; Salend students’ achievement motivation (Vaughn et al., 1996; Wiener &
& Duhaney, 1999) are inconclusive or tend to favor special education Tardif, 2004). According to this view, teachers in regular schools have
schools. Consequently, the benefits and drawbacks of inclusive higher expectations and place stronger emphasis on academic progress
schooling for SEN students seem to depend on the outcome under (Diamond, Randolph, & Spillane, 2004; Hornstra, Denessen, Bakker,
consideration and the attached importance of this outcome. Bergh, & Voeten, 2010). By belonging to a learning group that is po-
SEN students’ achievement motivation is generally an important aspect sitively valued, SEN students in regular schools may develop higher
of their school development (Elbaum, 2002; Grolnick & Ryan, 1990; achievement motivation through basking in reflected glory of the per-
Möller, Streblow, & Pohlmann, 2009). SEN students are especially at risk ceived accomplishments of their peers (Marsh, Kong, & Hau, 2000). In
of developing low levels of achievement motivation because they are more addition, SEN students in regular schools might benefit from higher-
likely to experience academic failure than their peers without SEN (Allodi, achieving classmates through social learning mechanisms (Barth,
2000; Grolnick & Ryan, 1990). Peetsma, Vergeer, Roeleveld, and Karsten Dunlap, Dane, Lochman, & Wells, 2004): Higher-achieving classmates
(2001) suggested that academic failures and consequent declines in mo- could function as role models for SEN students and initiate upward
tivation could trigger a vicious circle preventing SEN students from comparisons associated with increases in achievement motivation
overcoming their learning difficulties. For example, SEN students may (Corcoran, Crusius, & Mussweiler, 2011; Wheeler & Suls, 2005).
develop negative self-evaluations and consider their own abilities as un- Placement differences might vary for different motivational factors.
changeable after experiencing repeated failure at school (Deci & Chandler, According to expectancy-value theory, two central antecedents of stu-
1986; Eccles, Wigfield, & Schiefele, 1998). As a consequence, they might dents' achievement motivation are academic self-concept and enjoy-
decrease their effort in school work and their persistence in solving de- ment of learning (Nagengast et al., 2011; Wigfield & Eccles, 2000). The
manding tasks. This, in turn, could have a negative bearing on their sub- academic self-concept is defined as students' self-evaluation in a specific
sequent school achievement (Deci & Chandler, 1986). Research on stu- academic domain or subject (Marsh, et al., 2000; Trautwein, Lüdtke,
dents without SEN revealed that low achievement motivation is also Marsh, Köller & Baumert, 2006). Enjoyment of learning reflects stu-
linked to higher rates of depression, disengagement, and school dropout dents’ intrinsic value and subjective interest in school-related tasks.
(Elbaum, 2002; Reyes, Brackett, Rivers, White, & Salovey, 2012). There- Both of these motivational variables influence school achievement and
fore, promoting SEN students’ achievement motivation is important for task persistence as well as educational choices and career aspirations
their success in school. (Eccles et al., 1983; Nagengast et al., 2011; Pekrun, Goetz, Titz, & Perry,
Learning environments differ between educational settings and 2002; Wang & Eccles, 2013).
these differences (e.g., in curricula, teaching methods, and student In the majority of the studies, SEN students in special classes or
composition) can shape students’ achievement motivation (Urdan & special education schools reported higher academic self-concepts than
Schoenfelder, 2006; Wang & Eccles, 2013). Although previous studies SEN students in inclusive settings (Bear et al., 2002; Chapman, 1988;
explored placement differences in SEN students’ achievement motiva- Crabtree & Meredith, 2000; Renick & Harter, 1989). Bear et al. (2002)
tion (Bear, Minke, & Manning, 2002; Chapman, 1988; Elbaum, 2002; concluded in their meta-analysis that a more restrictive learning en-
Forman, 1988; Pijl & Frostad, 2010), researchers have rarely examined vironment for students with learning disabilities (i.e., separated classes)
characteristics of the learning environments that might underlie those is associated with higher academic self-concepts. However, they also
differences. The purpose of this study is to investigate if SEN students’ reported considerable heterogeneity in the effect sizes across studies
achievement motivation differs between special education schools and associated with the specific educational setting SEN students experi-
regular schools and to examine if the classroom social environment enced. In contrast, a meta-analysis by Elbaum (2002) found no con-
(i.e., social comparisons and social support) explains possible place- sistent relationship between educational placement and SEN students’
ment differences. academic self-concept. Peetsma et al. (2001) confirmed results from
previous cross-sectional studies by applying a longitudinal design: SEN
students’ teacher-rated achievement motivation was significantly
1.1. Educational placement and SEN students’ achievement motivation
higher in special education schools than in regular schools. Over a
period of two years, there was also a less pronounced decrease in SEN
The educational placement of SEN students in special education
students’ achievement motivation in special education schools than in
schools or in regular schools could affect their achievement motivation
regular schools. After four years, however, no placement differences in
in different ways. Proponents of special education schools argue that
SEN students’ achievement motivation were found.
these settings provide a protected learning environment for SEN stu-
Despite the large number of studies investigating placement effects on
dents. It includes adapted and less demanding curricula, individualized
SEN students’ motivational outcomes, studies have rarely explored char-
feedback, and a less competitive climate in the classroom (Chapman,
acteristics of the classroom social environment potentially underlying
1988; Peetsma et al., 2001). From a person-environment fit perspective,
those placement differences (e.g., Nusser & Wolter, 2016). Furthermore,
students should be more motivated if the learning material is adapted to
the majority of the studies focused on the academic self-concept of stu-
their competence level (Eccles, 2004; Vaughn, Elbaum, & Schumm,
dents with learning disabilities. Although some studies included other
1996). Thus, the adaptation of the curricula should increase the chances
aspects of achievement motivation (Fulk, Brigham, & Lohman, 1998;
that SEN students experience feelings of success. Furthermore, the
Grolnick & Ryan, 1990; Peetsma et al., 2001), research on intrinsic value
achievement motivation of SEN students can be expected to benefit
components—such as enjoyment of learning—is scarce.
from comparisons with peers with similar performance levels and si-
milar difficulties (Chapman, 1988). Performance comparisons with si-
1.2. Mechanisms underlying placement differences
milar achieving peers should decrease SEN students’ feelings of in-
feriority and school stress due to evaluative anxiety (Dijkstra, Kuyper,
Special educational schools and regular schools provide different
van der Werf, Buunk, & van der Zee, 2008; Renick & Harter, 1989).
social environments that could contribute to differences in SEN stu-
dents’ achievement motivation. Research on students without SEN has
1
The cited studies on the effects of educational placement on SEN students’ shown that achievement motivation is influenced by the classroom
academic outcomes were carried out mainly in European countries including social environment (Patrick, Ryan, & Kaplan, 2007; Urdan &
Germany, the Netherlands, and Norway. Schoenfelder, 2006; Wang & Eccles, 2013). Two important features of

64
A. Kocaj et al. Contemporary Educational Psychology 55 (2018) 63–83

the classroom social environment are social comparisons and social teachers and classmates (Urdan & Schoenfelder, 2006; Wentzel, 1998).
support structures. Students’ individual perception of social support is shaped by the
classroom social environment which includes dyadic interactions be-
1.2.1. Social comparisons as underlying mechanism of placement tween students and teachers, group interactions, as well as shared
differences learning values and expectations (Russell, 2012). Moreover, the class-
SEN students in regular schools learn together with higher- room social environment may influence students’ achievement moti-
achieving classmates without SEN whereas SEN students in special vation over and above perceived social support on the individual level
education schools learn together with other SEN students with similar (Wentzel, Battle, Russell, & Looney, 2010). It is therefore important to
difficulties. Differences between special education schools and regular consider both individual and class-level indicators of social support
schools in classmates’ achievement levels might result in differences in (Russell, 2012).
SEN students’ achievement motivation. According to social comparison Social support might contribute to academic self-concept and en-
theory, students compare themselves with classmates to gain an accu- joyment of learning in different ways (Forman, 1988; Wentzel et al.,
rate self-view and to adjust their self-evaluation (Festinger, 1954; 2010): First, classrooms where students experience support by teachers
Marsh et al., 2008). Drawing on this assumption, Marsh (1987) postu- and classmates should provide opportunities to participate in lessons
lated the big-fish-little-pond effect (BFLPE; Marsh, 1987), suggesting without anxieties of being teased or ridiculed (Patrick et al., 2007). The
that social comparisons within the external frame of reference are a opportunity to ask questions and reflect on one’s own understanding in
central source of students’ academic self-concept. The BFLPE hypothe- a safe learning environment supports students’ feelings of confidence
sizes that individual achievement is positively related to academic self- and expectations for success (Furrer & Skinner, 2003; Patrick et al.,
concept, whereas the average achievement of the reference group is 2007). Social support thus serves as resource for maintaining positive
negatively related to academic self-concept. Specifically, given similar emotions towards learning (Furrer & Skinner, 2003). Second, social
individual achievement, students in classrooms (or schools) with high- support can reduce detrimental effects of stressful experiences on stu-
achieving peers (big ponds) will show lower academic self-concepts dents’ achievement motivation (Allodi, 2000; Wentzel, 1998). The
than students in classrooms with low-achieving peers (little ponds). perceived availability of social support in particular serves as a buffer
This negative overall effect of class-average achievement re- against stressful events (Demaray & Malecki, 2002; Furrer & Skinner,
presents the net-effect of two counterbalancing processes: assimilation 2003). Students who feel supported should be less prone to potential
and contrast. On the one hand, assimilation effects (also referred to as rejection or failure during class discussions or exams. They may also
labeling effects or basking in reflected glory) pertain to students’ spend less time ruminating about their social standing in the classroom
tendency to form academic self-concepts that are congruent with the and instead focus their attention on the learning content (Song, Bong,
perceived ability level of their peers (Corcoran et al., 2011; Dijkstra Lee, & Kim, 2015).
et al., 2008). Attending prestigious schools or classrooms with high- SEN students in special education schools and regular schools may
achieving students—such as regular schools for SEN students—should differ in their perceived social support by classmates, which in turn
therefore lead to more positive self-concepts. In contrast, membership could contribute to differences in their achievement motivation. On the
in low-achieving or stigmatized learning groups—such as special one hand, SEN students might benefit from placement in special edu-
education schools—should be associated with more negative self- cation schools. As SEN students in special education schools receive
concepts. instruction together with classmates with similar difficulties and
On the other hand, contrast effects (also referred to as reference achievement levels, their social standing might be less salient than in
group effects) are the result of social comparisons emphasizing dis- regular schools. This could lead to stronger feelings of relatedness and
similarity between oneself and the local reference group (Corcoran increase SEN students’ achievement motivation. In contrast, SEN stu-
et al., 2011). Contrast effects occur if students’ academic self-concept is dents’ academic difficulties in regular schools were found to be asso-
enhanced by lower achievement levels and decreased by higher ciated with lower levels of social support by classmates (Bakker et al.,
achievement levels of classmates (Marsh et al., 2000). The low- 2007; Savage, 2005; Vaughn, Haager, Hogan, & Kouzekanani, 1992). In
achieving reference group in special education schools could lead SEN addition, deficiencies in social competencies (Bauminger, Edelsztein, &
students to the self-evaluation that they are doing just as well acade- Morash, 2005) and behavioral problems (Margalit & Efrati, 1996;
mically as their classmates (Renick & Harter, 1989). This comparison Vaughn et al., 1992) might be more salient for SEN students in regular
with low-achieving classmates boosts their academic self-concept. SEN schools leading to lower acceptance and social support by classmates.
students in regular schools, in contrast, compare their achievement to On the other hand, proponents of an inclusive education argue that the
more able classmates. As a consequence, their academic self-concept SEN status could have a protective function for SEN students in regular
should decrease (Marsh et al., 2000). schools (Vaughn et al., 1992). Furthermore, research indicates that
For students without SEN, the empirical evidence clearly suggests classmates in regular schools have higher social competencies and
that negative contrast effects are stronger than positive assimilation display lower rates of bullying than classmates in special education
effects, leading to an overall negative BFLPE (Marsh et al., 2000). Al- schools (Rose, Monda-Amaya, & Espelage, 2011) which should be as-
though most studies on the BFLPE focus on the academic self-concept, sociated with higher levels of social support for SEN students in regular
there is some evidence that the BFLPE also generalizes to other moti- schools.
vational outcomes including enjoyment of learning (Goetz et al., 2004),
interest (Köller, Trautwein, Lüdtke, & Baumert, 2006; Schurtz, Pfost, 1.3. The German special education system
Nagengast, & Artelt, 2014; Trautwein et al., 2006), and test anxiety
(Zeidner & Schleyer, 1999). The BFLPE on other motivational outcomes The present study is based on data from the German special edu-
has been shown to be mediated by academic self-concept (Köller et al., cation system. Germany has implemented a dichotomous special edu-
2006; Trautwein et al., 2006). cation system placing students with SEN either in special education
schools or in regular schools (Authoring Group Educational Reporting,
1.2.2. Social support as underlying mechanism of placement differences 2016; Powell, 2009; Sansour & Bernhard, 2018). Students with SEN in
In addition to social comparisons, social support is a second char- regular schools spend most of the school day together with students
acteristic of the classroom social environment that affects students’ without SEN (Authoring Group Educational Reporting, 2016). Despite a
achievement motivation (Eccles, 2004; Patrick et al., 2007; Wang & trend towards a more inclusive education accompanied by more diverse
Eccles, 2013). Social support can be described as students’ perception of organizational forms of special support in regular schools, the majority
a caring classroom in which they experience affiliation and help by of students with SEN still receives instruction in special education

65
A. Kocaj et al. Contemporary Educational Psychology 55 (2018) 63–83

schools (KMK, 2016; KMK, 2017).2 educational placement per se—are related to SEN students’ achieve-
The process of assigning special educational needs and deciding on ment motivation (Grolnick & Ryan, 1990; Ruijs, Peetsma, & van der
the educational placement is initiated and supervised by school su- Veen, 2010). It has been argued that research should examine specific
pervisory authorities in cooperation with parents, teachers, and special characteristics of the learning environment that might explain place-
educators (Sälzer, Gebhardt, Müller, & Pauly, 2015). Low school per- ment differences in SEN students’ outcomes (Lindsay, 2007; Zigmond,
formances, behavioral problems, and other indications suggesting that 2003). In this study, we address two research questions:
students might need additional support to achieve educational goals are
often taken as starting point for the assessment of special educational 1. Do SEN students in special education schools and regular schools
needs (KMK, 2017; Sansour & Bernhard, 2018). Decisions about the differ in their academic self-concept and enjoyment of learning?
educational placement are based on students’ individual needs as well 2. Are class-average achievement and class-average social support re-
as resources available at the school (KMK, 2017; Powell, 2009; Sälzer lated to variation in SEN students’ academic self-concept and en-
et al., 2015). For example, students with less special educational needs joyment of learning over and above the variation described by
are more likely to be referred to a regular school instead of a special school type?
education school (Sälzer et al., 2015).
SEN students in regular schools receive access to the general educa- Regarding the first research question, we expected SEN students in
tion curriculum with additional support by educational personnel (e.g., special education schools to report higher academic self-concept and
special educators, teaching assistants, mobile services) to facilitate in- enjoyment of learning than SEN students in regular schools. Regarding
clusion in the regular classroom (KMK, 2017; Sansour & Bernhard, the second research question, we expected that class-average achieve-
2018). Special education teachers might work together with regular ment and class-average social support are related to academic self-
teachers during lessons (e.g., co-teaching, Scruggs, Mastropieri, & concept and enjoyment of learning of SEN students over and above the
McDuffie, 2007) or individual support is provided after class to monitor variation described by school type. After controlling for individual
SEN students’ learning progress and adapt learning goals if necessary achievement, SEN students in lower-achieving classrooms should report
(KMK, 2017; Sansour & Bernhard, 2018). Special needs support in reg- higher academic self-concept and enjoyment of learning. Furthermore,
ular schools during joint lessons is more common than pull-out programs SEN students’ who feel socially supported by their classmates should
with separate instruction in resource rooms (KMK, 2017). also report higher academic self-concept and enjoyment of learning. In
Students with speech or language impairment and students with addition, high class-average social support should boost SEN students’
emotional disorders in special education schools receive the same academic self-concept and enjoyment of learning. We hypothesized that
curricula and educational goals as students in regular schools (KMK, the effect of educational placement would no longer be significant
2017). However, teaching methods and materials are adapted to stu- when differences between special education schools and regular schools
dents’ needs (KMK, 2017). In contrast, students with learning dis- in class-average achievement and class-average social support are taken
abilities in special education schools receive alternate curricula with into account.
reduced lesson content and performance requirements compared to
regular schools (KMK, 2017). In special education schools, lessons are
held in smaller learning groups compared to regular schools (KMK, 2. Method
2017). Also, therapeutic support (e.g., behavioral or speech therapy)
can be included during instruction (KMK, 2017). 2.1. Participants and procedure
The dichotomous special education system in Germany facilitates
the examination of contrast and assimilation effects on SEN students’ We analyzed data from a nationally representative cross-sectional
achievement motivation (Chmielewski, Dumont, & Trautwein, 2013; assessment study of German fourth-graders that was carried out in
Trautwein et al., 2006). First, placing students with SEN into different spring 2011 (IQB National Assessment Study 2011, Stanat, Pant, Böhme,
school types determines their social reference group as they rarely in- & Richter, 2012; Stanat et al., 2014). The study aimed at measuring
teract with students from different tracks during their school day. students’ levels of proficiency with standardized achievement tests
Second, status differences between learning groups are more pro- based on the German national educational standards. Furthermore,
nounced and visible for students in dichotomous systems compared to questionnaires were used to gather data on students’ academic self-
continuous special education systems (Powell, 2009). concept and enjoyment of learning, perceived social support, and
background characteristics.
In this study, we examined the subsample of classrooms with at least
1.4. The present study one SEN student. The resulting student sample consisted of 8692 stu-
dents from 451 schools (one class was chosen randomly from each
The purpose of this study is to investigate the relationship between school, see Table 1) including 1098 students with SEN (Mean
the educational placement of SEN students and their achievement age = 10.90 years, SD = 0.63; 32.7% girls; 24% students with at least
motivation. Furthermore, we examine if the classroom social environ- one parent born abroad). Class size and number of SEN students dif-
ment (i.e., class-average achievement and social support) underlies fered between special education schools and regular schools (see
potential placement differences. Although research points to higher Table 1). In regular schools, classrooms consisted of both students with
achievement motivation in special education schools, meta-analyses and students without SEN. In contrast, only SEN students were enrolled
(Bear et al., 2002; Elbaum, 2002) revealed considerable variability in in special education schools.
the magnitude of placement differences. An explanation for the varia- Students with learning disabilities (n = 550), speech or language
bility in effect sizes could be that aspects of the social environment in impairment (n = 311) and emotional disorders (n = 237) were part of
special education schools and regular schools—rather than the the sample (see Table 1).3 Students with learning disabilities show

2 3
Note that special education systems vary across German states as respon- SEN categories overlap partially between Germany and the U.S. (Gebhardt,
sibility is determined by the federal structure of the German education system Sälzer, Mang, Müller, & Prenzel, 2015). SEN categories in Germany describe
(KMK, 2017). For example, in some German states, students with learning educational supports intended to help children with disabilities advance in their
disabilities can attend special education schools in third grade at the earliest school career and master the curriculum. Conversely, SEN categories in the U.S.
whereas in other German states, special education schools start in first grade focus on individual disabilities (Powell, 2009). In this article, we use the names
(Sälzer et al., 2015). of the U.S. categories to align with the international literature. However, there

66
A. Kocaj et al. Contemporary Educational Psychology 55 (2018) 63–83

Table 1 Table 2
Sample sizes and descriptive statistics by educational placement. Item wordings and descriptive statistics for academic self-concept, enjoyment of
learning, and perceived social support.
Educational placement
Educational placement
Special education Regular schools
schools Special education Regular schools
schools
Student level
N SEN students overall 420 678 Item wordingsa M SD M SD
n SEN students with learning disabilities 261 289
n SEN students with speech or language 140 171 Academic self-concept in German
impairment I am satisfied with my achievement in 3.14 1.05 2.76 1.01
n SEN students with emotional disorders 19 218 German
Average number of SEN students per 9.84 (4.05) 1.90 (1.36) I understand most of the things we 3.13 1.00 2.92 0.92
classroom (SD) have to learn in German
Range number of SEN students per 2–26 1–9 I am usually good at solving exercises 3.13 1.03 2.89 0.94
classroom in German lessons
N Students overall 420 8272
Academic self-concept in mathematics
Classroom level I am satisfied with my achievement in 3.18 1.09 2.86 1.09
a
N Classrooms 49 402 mathematics
Average class size (SD) 9.84 (4.05) 20.58 (4.25) I understand most of the things we 3.16 1.03 2.95 1.00
Range class size 2 – 26 6 – 33 have to learn in mathematics
I am usually good at solving exercises 3.24 1.01 2.95 1.00
Note. SEN = special educational needs. in mathematics lessons
a
One classroom per school was chosen randomly to participate in the study. Enjoyment of learning
I enjoy acquiring new knowledge in 3.26 1.04 3.05 0.97
impairments in their learning and school achievement that can be school lessons
caused by a multitude of factors reaching from problems in basic psy- I enjoy some school topics so much that 3.29 1.04 3.13 1.00
I am looking forward to them in
chological processes and sensory impairment to social and emotional
advance
difficulties (KMK, 1999). Children with speech or language impairment I am often excited about school lessons 3.02 1.11 2.67 1.03
exhibit specific language-related deficits pertaining to receptive and/or
Perceived social support
productive abilities (KMK, 1998). Students with emotional disorders My classmates are nice to me 3.26 0.99 3.06 0.96
experience difficulties in their regulation of emotions and their social My classmates cheer me up when I am 2.98 1.16 2.81 1.07
behavior in interactions with peers and teachers (KMK, 2000). Students sad
with functional or intellectual disabilities as well as non-native German I have few friends in my class [inverted 2.02 1.24 2.10 1.15
item]
language speakers who had attended German schools for less than one
Others start arguments with me 1.87 1.15 1.77 1.02
year and had very low levels of language proficiency were not tested. [inverted item]
This is in line with the testing guidelines of other educational large-
scale assessments (see Joncas & Foy, 2012; OECD, 2014). Note. Responses were given by students on a 4-point scale (1 = do not agree;
4 = strongly agree).
a
Items translated from German by the authors.
2.2. Measures
Table 3
Academic self-concept. Academic self-concept as one antecedent Correlations between educational placement, achievement, and social support.
of achievement motivation was measured with four items separately for 1 2 3
German and mathematics (see Table 2 for item wordings and de-
scriptive statistics). The scale was adopted from the TIMSS 2007 study, Student level
1 Educational placementa (1 = special education
an international large-scale assessment in primary schools (Martin &
school)
Preuschoff, 2008), and had been tested in field trials and other large- 2 Reading achievement (WLE) –.46***
scale assessments demonstrating good measurement properties and 3 Mathematics achievement (WLE) –.51*** .66***
predictive validity (Martin, Mullis, & Foy, 2008; Mullis, Martin, Foy, & 4 Social support .08 .05 .04
Arora, 2012). Item construction was based on theoretical assumptions b
Classroom level
on the multidimensional structure of the self-concept (Shavelson, 1 Educational placementa (1 = special education
Hubner, & Stanton, 1976) and item wording was influenced by the Self- school)
2 Reading achievement (WLE) –.83***
Description Questionnaire I (SDQ I, Marsh, 1990). Responses were
3 Mathematics achievement (WLE) –.81*** .91***
given on a 4-point scale (1 = do not agree; 4 = strongly agree). We ex- 4 Social support –.31*** .32*** .34***
cluded one item because of a low corrected part-whole correlation with
the scale and a small factor loading in confirmatory factor analyses. Note. WLE = weighted likelihood ability estimates (Warm, 1989).
This item has a reverse phrasing which may be difficult to understand *p < .05. **p < .01. ***p < .001.
a
for SEN students (Marsh, 1986; Nusser, Carstensen, & Artelt, 2015). The Point-biserial correlations are reported for educational placement.
b
internal consistencies of both scales were reasonably high for SEN Correlations on the classroom level are based on unstandardized aggrega-
tions of individual characteristics.
students in special education schools (German: α = .71; mathematics:
α = .79) and SEN students in regular schools (German: α = .71;
Enjoyment of learning. Self-reported enjoyment of learning is the
mathematics: α = .79).
second antecedent of achievement motivation in our study. The scale
was developed by Pekrun (1992) and consists of three items assessing
(footnote continued) students' global enjoyment in school lessons (see Table 2 for item
are subtle differences between the German and U.S. categories which should be wordings and descriptive statistics). Scale construction was based on
noted. For example, a diagnosed dyslexia or dyscalculia alone is not sufficient the control-value theory of achievement emotions (Pekrun, 2000)
for the identification of SEN in Germany (Gebhardt et al., 2015).

67
A. Kocaj et al. Contemporary Educational Psychology 55 (2018) 63–83

which is related to expectancy-value theories (Wigfield & Eccles, 2000) distributed across test booklets and those test booklets were assigned
in that it views competence appraisals (e.g., academic self-concept) and randomly to students (for details, see Weirich, Haag, & Roppelt, 2012).
value appraisals (e.g., intrinsic value) as antecedents for achievement- This design increases the content coverage of the test construct while
related emotions (Pekrun, Goetz, Frenzel, Barchfeld, & Perry, 2011). decreasing the test burden for students, allowing for accurate profi-
Furthermore, items of the enjoyment of learning scale resemble items ciency estimations on a group level (Gonzalez & Rutkowski, 2010).
assessing intrinsic interest value (e.g., “I enjoy school classes”, Wigfield, Similar to test administration in other large-scale assessments (e.g.,
1994). The scale was used in previous large-scale assessments Heydrich, Weinert, Nusser, Artelt, & Carstensen, 2013; LeRoy, Samuel,
(Jerusalem, et al., 2009) and is also part of an established and validated Deluca, & Evans, 2018), two test accommodations were used for stu-
questionnaire on achievement-related emotions (Achievement Emotions dents in special education schools. First, students in special education
Questionnaire, Pekrun et al., 2011). In previous studies, the scale de- schools received test booklets for which pretests showed that they were
monstrated good measurement properties (Jerusalem et al., 2009; on average easier than test booklets in regular schools. This accom-
Pekrun et al., 2011) and predictive validity (e.g., positive relations to modation was used to increase the fit between item difficulties and
intrinsic motivation, effort, and achievement, Pekrun et al., 2011; anticipated student abilities leading to better measurement properties
Pekrun, et al., 2002). Students responded on a 4-point scale (1 = do not of the achievement tests (Lane and Leventhal, 2015). It is important to
agree; 4 = strongly agree). The scale showed a satisfactory internal note that the test content was not changed for students in special
consistency for SEN students in special education schools (α = .78) and education schools as items from those test booklets were drawn from a
SEN students in regular schools (α = .73). common item pool and were therefore also administered to students in
Perceived social support. Self-reported social support was assessed regular schools.
with four items (see Table 2 for item wordings and descriptive statis- Second, test booklet length and testing time was shorter in special
tics). The scale focuses on emotional aspects of social support by education schools (40 min instead of 80 min per domain). Reducing
classmates. Items were selected from an established questionnaire overall testing time might help students in special education schools to
(FEESS 3–4, Rauer & Schuck, 2003) assessing children’s emotional and take the achievement tests because they might have steeper attention
social school experiences in primary school. Scale construction has declines and lower abilities to sustain concentration over time
drawn from self-determination theory which emphasizes the important (Heydrich et al., 2013). As test booklet length was also decreased, the
role of warm and positive relationships in the classroom for students’ average time given to answer test items was comparable for SEN stu-
motivation (Deci & Chandler, 1986). The scale has been validated in dents in special education schools and regular schools.
prior studies including students with SEN (Rauer & Schuck, 2003). It is To evaluate the structural validity and comparability of the
widely used in German large-scale assessments, studies on inclusion in achievement tests for SEN students in special education schools and
education (Schwab, 2015; Spörer et al., 2015), and studies on students regular schools, missing patterns, Rasch model fit, differential item
with specific learning disabilities or learning difficulties (Fischbach, functioning, and correlations of the test scores were analyzed. Items
Schuchardt, Mähler, & Hasselhorn, 2010). The scale demonstrated good used in both special education schools and regular schools had similar
measurement properties (Schwab, 2015; Spörer et al., 2015) and psychometric properties. The results suggest that test scores for both
plausible correlational patterns with relevant student outcomes (e.g., groups are comparable and can be reported on a common scale (for
well-being, academic self-concept, and achievement, Rauer & Schuck, details, see Kocaj et al., 2016). Achievement tests for reading compre-
2003) in previous studies. Students responded on a 4-point scale hension and mathematics were scaled using a 1-parameter logistic item
(1 = do not agree; 4 = strongly agree). The scale showed an internal response theory (IRT) model (Rasch model). The expected a-posteriori
consistency of α = .54 for SEN students in special education schools (EAP) reliabilities of the test scores were comparable for SEN students
and α = .68 for SEN students in regular schools. in special education schools (reading comprehension: EAP relia-
School achievement. Standardized achievement tests in mathe- bility = .75; mathematics: EAP reliability = .89) and SEN students in
matics and reading comprehension were used to assess students’ levels regular schools (reading comprehension: EAP reliability = .73; mathe-
of proficiency (for a detailed description, see Stanat et al., 2012). Test matics: EAP reliability = .92). Weighted likelihood ability estimates
items are based on national educational standards for students at the were used as achievement scores in the analyses (WLE, Warm, 1989).
end of 4th grade (Böhme & Bremerich-Vos, 2012; Roppelt & Reiss,
2012). These standards define skills and competencies in form of edu- 2.3. Statistical analyses
cational goals that students should have acquired by a certain point in
their school career (Stanat et al., 2012). Although German states differ Prior to addressing our research questions, we checked the fit of the
in their educational system, the educational standards provide man- measurement model for each motivational outcome separately by
datory guidelines for curricula development and skills that should be conducting confirmatory factor analyses (CFAs). First, for SEN students
taught in all schools (KMK, 2017). According to the educational stan- in each school setting (special education school vs. regular school), a
dards for mathematics, students at the end of 4th grade should be able two-level measurement model with equal factor loadings on the student
to apply mathematical processes (e.g., problem solving, communica- level (L1) and on the classroom level (L2) was specified. Second, we
tion) to solve real-life problems from different content areas (e.g., tested for measurement invariance for each motivational outcome be-
number & operations, algebra, geometry, measurement, data analysis & tween SEN students in special education schools and regular schools.
probability, for details, see Roppelt & Reiss, 2012). Educational stan- Comparable measurement models and measurement invariance are
dards for the school subject German focus on multidimensional aspects necessary requirements for valid comparisons of the latent factor means
of reading comprehension as well as skills and competencies in lis- across both student groups (Van de Schoot, Lugtig, & Hox, 2012).
tening, speaking, and writing (Böhme & Bremerich-Vos, 2012). Reading We conducted multilevel regression analyses in Mplus 7.31 (Muthén
comprehension is conceptualized as the ability to comprehend age-ap- & Muthén, 1998–2015) to predict SEN students’ academic self-concept
propriate narrative and expository texts (Böhme & Bremerich-Vos, and enjoyment of learning. Both dependent variables were modeled as
2012). This includes the ability to extract and report central messages latent variables (Lüdtke et al., 2008). School achievement (reading
from a text, to make connections between different information of a text comprehension and mathematics respectively) and perceived social
and connect them to prior knowledge, and to draw conclusions about support were entered in the model as manifest predictors on the in-
the intention of a text (Böhme & Bremerich-Vos, 2012). dividual level; school type (special education school vs. regular school),
A large sample of items was used to cover the content of each test class-average achievement, and class-average social support were en-
domain. Applying a multiple matrix design (Gonzalez & Rutkowski, tered as manifest predictors on the classroom level. We included in-
2010), students only respond to a subset of those items. Test items were dividual achievement and individual perceived social support as

68
A. Kocaj et al. Contemporary Educational Psychology 55 (2018) 63–83

predictors for three reasons: (a) to estimate the effects of interindividual enjoyment of learning. In Model 5 (Tables 4–6), class-average social
differences in both predictors on motivational outcomes, (b) to account support was entered as predictor on the classroom level (instead of
for potential differences in those predictors between SEN students in class-average achievement) together with school type. In Model 6
special education schools and regular schools, and (c) to estimate the (Tables 4–6), social support and achievement were included simulta-
contextual effect of class-average achievement and class-average social neously with school type as predictors in order to examine their specific
support on SEN students’ motivational outcomes (Marsh et al., 2008). contributions to placement differences in academic self-concept and
Furthermore, gender was included as a covariate on the individual level enjoyment of learning.
because of its association with motivational outcomes (Frenzel, Pekrun,
& Goetz, 2007; Marsh, Trautwein, Lüdtke, Köller, & Baumert, 2005; 3. Results
Marsh & Yeung, 1998).
We standardized all continuous variables (M = 0, SD = 1) across 3.1. Preliminary analyses: Model fit and measurement invariance
the SEN student sample to facilitate the interpretation of the regression
coefficients (Trautwein et al., 2006). In a first step, the aggregation of Prior to the analyses, two CFAs were conducted for SEN students in
class-average achievement and class-average social support was based special education schools and SEN students in regular schools for each
on the unstandardized values of all students in the classroom. That is, in motivational outcome separately. The measurement models showed a
regular schools, the achievement and perceived social support of stu- reasonable fit for each group (see Model 0 in Appendix A1–A3). Next,
dents without SEN are also included in the class-average variables. In a we tested for measurement invariance (see Model 1–4 in Appendix
second step, only students with SEN were analyzed in the multilevel A1–A3 for the fit indices). We established partial invariance for each
analyses (for a similar approach, see Ruijs et al., 2010). The class- motivational outcome respectively by allowing the intercept of one
average variables were standardized (M = 0, SD = 1) across all class- item to differ between SEN students in special education schools and
rooms in the sample. Multilevel regression analyses were specified as regular schools (see Model 1–4 in Appendix A1–A3). For each moti-
random intercept models using the robust maximum likelihood (MLR) vational outcome, there were three factor loadings and at least two
estimator. Missing data (ranging from 22.1% to 26.1% for the moti- intercepts that were constrained equal across groups. This allows valid
vational variables, from 23.0% to 25.2% for the social support vari- inferences about differences in the latent means between groups (Byrne,
ables, and from 2.6% to 4.2% for the school achievement tests) were Shavelson, & Muthén, 1989; Steinmetz, 2013). We refrain from com-
handled by applying full information maximum likelihood (FIML) in paring the manifest factor means, however, because full scalar
Mplus. equivalence could not be established (Steinmetz, 2013).
We chose a step-wise approach of entering class-level predictors into
the multilevel regression model to explain potential placement differ- 3.2. Placement differences in class-average achievement and class-average
ences by differences in class-average achievement and class-average social support
social support (for a similar approach, see Trautwein et al., 2006). First,
school type (Model 1 in Tables 4–6) and class-average achievement To examine placement differences in the classroom social environ-
(Model 2 in Tables 4–6) were entered separately as predictors of aca- ment, we analyzed the pattern of correlations between school type,
demic self-concept or enjoyment of learning. In Model 3 (Tables 4–6), achievement, and social support (Table 3). As expected, there were
school type and class-average achievement were entered simulta- substantial negative associations between educational placement and
neously as predictors to test if differences in class-average achievement achievement: class-average achievement was higher in regular schools
explain variation in motivational outcomes over and above the varia- than in special education schools (r = –.83, p < .001 for reading
tion explained by school type. In Model 4 (Tables 4–6), social support comprehension and r = –.81, p < .001 for mathematics achievement,
was entered separately as predictor of academic self-concept or Table 3). The same pattern of results emerged for the individual level

Table 4
Predicting SEN students' academic self-concept in German.
Model 1 Model 2 Model 3 Model 4 Model 5 Model 6

B SE B SE B SE B SE B SE B SE

Student level (L1)


Reading achievement 0.11*** 0.03 0.16*** 0.03 0.15*** 0.04 0.15*** 0.03
Perceived social support 0.15*** 0.03 0.14*** 0.03 0.13*** 0.03
* * *
Gender (1 = female) 0.12 0.05 0.11 0.05 0.11 0.05 0.09 0.05 0.09 0.05 0.09 0.05

Classroom level (L2)


School type (1 = special education school) 0.31*** 0.07 0.09 0.08 0.21*** 0.06 0.07 0.08
Class-average reading achievement –0.20 ***
0.05 –0.16** 0.06 –0.16** 0.06
Class-average social support –0.06 0.03 –0.02 0.03 –0.01 0.03

Model fit
Chi-Square test of model fit (df) 35.94*** (9) 38.45*** (9) 39.09*** (11) 39.28*** (9) 41.97*** (11) 49.48*** (17)
Bayesian Information Criteria (BIC) 9668.56 10604.50 9665.25 9016.24 9010.61 12022.62
Akaike Information Criteria (AIC) 9578.72 10504.47 9570.41 8930.03 8919.62 11908.03
Comparative Fit Index (CFI) 0.95 0.95 0.95 0.95 0.95 0.95
Root Mean Square Error (RMSEA) 0.05 0.06 0.05 0.06 0.06 0.04

Described variance
R2 on student level (L1) 4.40% 7.90% 7.50% 7.20% 6.10% 11.50%
R2 on classroom level (L2) 26.80% 46.80% 46.60% 6.20% 21.10% 46.60%

Note. SEN = special educational needs. Intraclass correlation (ICC) = .09.


* p < .05.
** p < .01.
*** p < .001.

69
A. Kocaj et al. Contemporary Educational Psychology 55 (2018) 63–83

Table 5
Predicting SEN students' academic self-concept in mathematics.
Model 1 Model 2 Model 3 Model 4 Model 5 Model 6

B SE B SE B SE B SE B SE B SE

Student level (L1)


Mathematics achievement 0.30*** 0.04 0.41*** 0.04 0.41*** 0.05 0.40*** 0.04
Perceived social support 0.13*** 0.04 0.12** 0.04 0.10** 0.04
Gender (1 = female) –0.13* 0.06 –0.12 0.06 –0.11 0.06 –0.26*** 0.06 –0.26*** 0.06 –0.15* 0.06

Classroom level (L2)


School type (1 = special education school) 0.48*** 0.08 0.07 0.08 0.27*** 0.07 0.06 0.08
Class-average mathematics achievement –0.35 ***
0.05 –0.32*** 0.06 –0.34*** 0.06
Class-average social support 0.01 0.04 0.06 0.04 0.07 0.04

Model fit
Chi-Square test of model fit (df) 46.79*** (10) 46.34*** (10) 47.09*** (12) 24.27** (10) 28.47** (12) 62.45*** (18)
Bayesian Information Criteria (BIC) 9595.29 10510.38 9568.8 9056.32 9050.50 11941.62
Akaike Information Criteria (AIC) 9510.61 10415.39 9484.13 8975.00 8964.40 11832.16
Comparative Fit Index (CFI) 0.95 0.95 0.96 0.98 0.98 0.95
Root Mean Square Error (RMSEA) 0.06 0.06 0.05 0.04 0.04 0.05

Described variance
R2 on student level (L1) 17.10% 28.10% 27.60% 6.20% 5.50% 29.10%
R2 on classroom level (L2) 24.60% 55.40% 55.40% 0.20% 12.10% 58.30%

Note. SEN = special educational needs. Intraclass correlation (ICC) = .14.


* p < .05.
** p < .01.
*** p < .001.

(r = –.46, p < .001 for reading comprehension and r = –.51, p < .001 3.3. Placement differences in academic self-concept and enjoyment of
for mathematics, Table 3). The correlation between class-average social learning and their relationship with class-average achievement and class-
support and educational placement also favored regular schools but it average social support
was considerably lower than for achievement (r = –.31, p < .001).
Furthermore, there was no substantial relationship between educa- Results of the multilevel analyses are presented in Tables 4–6 for
tional placement and social support on the individual level (r = .08, academic self-concept in German and mathematics, as well as enjoy-
p = .20). These correlations indicate that SEN students in regular ment of learning, respectively. To address our first research question,
schools are, on average, surrounded by higher-achieving classmates academic self-concept and enjoyment of learning were regressed on
that also perceive higher levels of social support than SEN students in school type, individual achievement, and gender (Model 1, Tables 4–6).
special education schools. When controlling for individual achievement and gender, academic

Table 6
Predicting SEN students' enjoyment of learning with reading achievement.
Model 1 Model 2 Model 3 Model 4 Model 5 Model 6

B SE B SE B SE B SE B SE B SE

Student level (L1)


Reading achievement 0.09* 0.04 0.13** 0.04 0.13** 0.04 0.12** 0.04
Perceived social support 0.23*** 0.03 0.21*** 0.03 0.20*** 0.03
** ** **
Gender (1 = female) 0.20 0.07 0.19 0.07 0.19 0.07 0.14* 0.07 0.14* 0.07 0.14* 0.07

Classroom level (L2)


School type (1 = special education school) 0.30*** 0.08 0.09 0.11 0.24** 0.07 0.08 0.10
Class-average reading achievement –0.18 ***
0.05 –0.14* 0.07 –0.16* 0.07
Class-average social support 0.02 0.04 0.06 0.04 0.08 0.04

Model fit
Chi-Square test of model fit (df) 58.40*** (9) 55.13*** (9) 54.68*** (11) 29.47*** (9) 33.83*** (11) 64.55*** (17)
Bayesian Information Criteria (BIC) 9694.95 10635.45 9696.43 8997.11 8992.37 12015.39
Akaike Information Criteria (AIC) 9605.13 10535.42 9601.62 8911.07 8901.55 11900.80
Comparative Fit Index (CFI) 0.92 0.92 0.93 0.97 0.97 0.93
Root Mean Square Error (RMSEA) 0.07 0.07 0.06 0.05 0.05 0.05

Described variance
R2 on student level (L1) 3.90% 5.70% 5.50% 12.30% 10.90% 13.40%
R2 on classroom level (L2) 12.30% 20.50% 20.00% 0.50% 12.70% 24.70%

Note. SEN = special educational needs. Intraclass correlation (ICC) = .15.


* p < .05.
** p < .01.
*** p < .001.

70
A. Kocaj et al. Contemporary Educational Psychology 55 (2018) 63–83

self-concepts in German (b = 0.31, p < .001) and mathematics mathematics: b = 0.12, p = .006). However, class-average social sup-
(b = 0.48, p < .001) were higher for SEN students in special education port was not significantly related to academic self-concept (German:
schools than for their peers in regular schools. SEN students in special b = –0.02, p = .97; mathematics: b = 0.06, p = .17) after accounting
education schools also reported higher enjoyment of learning than SEN for the positive effect of educational placement in special education
students in regular schools after taking individual differences in reading schools (German: b = 0.21, p < .001; mathematics: b = 0.27,
comprehension and gender differences into account (b = 0.30, p < .001). SEN students with higher levels of perceived social support
p < .001).4 These results reflect the anticipated placement differences also reported more enjoyment of learning (b = 0.21, p < .001). Fur-
in favor of special education schools. thermore, SEN students in special education schools reported more
In Model 2, individual achievement and class-average achievement enjoyment of learning than their peers in regular schools (b = 0.24,
were entered to predict academic self-concept and enjoyment of p = .001). Class-average social support had no additional effect on SEN
learning (Tables 4–6). The regression coefficients of this model were in students’ enjoyment of learning (b = 0.06, p = .16). Thus, in contrast to
accordance with the expected BFLPE: individual achievement was po- class-average achievement, class-average social support could not ex-
sitively related to academic self-concept (German: b = 0.16, p < .001; plain variations in SEN students’ academic self-concept and enjoyment
mathematics: b = 0.41, p < .001) whereas class-average achievement of learning over and above the variation explained by school type.
was negatively related to academic self-concept (German: b = –0.20, In Model 6 (Tables 4–6), social support and achievement were in-
p < .001, ES25 = –0.48; mathematics: b = –0.35, p < .001, cluded simultaneously with gender and school type as predictors of
ES2 = –0.64). In other words, SEN students with similar individual academic self-concept and enjoyment of learning. On the individual
achievement reported lower academic self-concepts in higher-achieving level, higher levels of both perceived social support (German: b = 0.13,
classrooms. Individual achievement in reading comprehension p < .001; mathematics: b = 0.10, p = .003) and individual achieve-
(b = 0.13, p = .001) was also positively related to SEN students’ en- ment (German: b = 0.15, p < .001; mathematics: b = 0.40, p < .001)
joyment of learning (Model 2, Table 6). After individual differences in contributed to higher levels of academic self-concept. On the classroom
achievement and gender differences were taken into account, the re- level, only class-average achievement (German: b = –0.16, p = .004;
gression coefficient for class-average reading comprehension achieve- mathematics: b = –0.34, p < .001) predicted SEN students' academic
ment was negative (b = –0.18, p < .001) —that is, the BFLPE was self-concept. Educational placement (German: b = 0.07, p = .38;
detected (albeit weaker, ES2 = –0.40) not only for academic self-con- mathematics: b = 0.06, p = .45) and class-average social support
cept, but also for enjoyment of learning. (German: b = –0.01, p = .87; mathematics: b = 0.07, p = .07) had no
In Model 3, school type and characteristics of the classroom social additional effect on academic self-concept. With regard to enjoyment of
environment were included simultaneously as predictors (Tables 4–6). learning, both students with higher achievement in reading compre-
The regression coefficients of class-average achievement on academic hension (b = 0.12, p = .001) and students with higher perceived social
self-concept remained significantly negative (German: b = –0.16, support (b = 0.20, p < .001) on the individual level reported higher
p = .008; mathematics: b = –0.32, p < .001), whereas the regression enjoyment of learning (Model 6, Table 6). Similar to academic self-
coefficients of school type were no longer significant (German: concept, class-average achievement in reading comprehension had a
b = 0.09, p = .26; mathematics: b = 0.07, p = .34). Similar results negative effect on students' enjoyment of learning (b = –0.16, p = .02).
were obtained for enjoyment of learning (Model 3, Table 6): Controlling After controlling for class-average achievement, neither school type
for individual reading comprehension and gender, SEN students re- (b = 0.08, p = .44) nor class-average social support (b = 0.08, p = .08)
ported lower levels of enjoyment of learning in classrooms the higher were significantly associated with SEN students’ enjoyment of learning
class-average achievement in reading comprehension (b = –0.14, (Model 6, Table 6). These findings indicate that class-average
p = .03) was. Educational placement had no additional effect on SEN achievement is decisive for explaining placement differences; class-
students’ enjoyment of learning (b = 0.09, p = .40). average social support does not additionally describe differences in SEN
In Model 4 (Tables 4–6), gender, perceived social support by students’ achievement motivation. We did not find differential re-
classmates on the individual level (L1), and class-average social support lationships between educational placement and motivational outcomes
(L2) were entered as predictors of SEN students’ academic self-concept for students with learning disabilities and students with speech or
and enjoyment of learning. SEN students' individual-level perceived language impairment (see Appendix B). We also applied propensity
social support was positively related to their academic self-concept score matching to control for a multitude of potentially confounding
(German: b = 0.15, p < .001; mathematics: b = 0.13, p < .001) and variables influencing the relationship between educational placement
enjoyment of learning (b = 0.23, p < .001). In contrast, class-average and SEN students’ achievement motivation which yielded similar re-
social support was not related to SEN students’ academic self-concept sults (see Appendix C).
(German: b = –0.06, p = .09; mathematics: b = 0.01, p = .74) and en-
joyment of learning (b = 0.02, p = .62). 4. Discussion
In Model 5 (Tables 4–6), gender and perceived social support by
classmates on the individual level (L1), and class-average social support 4.1. Summary and interpretation
and school type (L2) were entered as predictors of SEN students’ aca-
demic self-concept and enjoyment of learning. SEN students' individual- The purpose of the study was to examine how educational place-
level perceived social support was positively related to their academic ment and characteristics of the classroom social environment are re-
self-concept in both domains (German: b = 0.14, p < .001; lated to SEN students’ achievement motivation. Our findings support
previous research showing that SEN students in special education
schools report a more positive academic self-concept and higher levels
4
Analyses with achievement in mathematics as predictor yielded similar of enjoyment of learning than SEN students in regular schools (Bear
results and are presented in Appendix A, Table A4. et al., 2002; Chapman, 1988; Renick & Harter, 1989). After taking
5
ES2 is a measure of effect size in multilevel structural equation modeling
differences in class-average achievement into account, no association
and comparable to Cohen’s d for continuous class-level predictors (Lüdtke et al.,
between educational placement and SEN students’ achievement moti-
2008; Marsh et al., 2009). ES2 was computed according to Marsh et al. (2009):
ES2 = (2 * B * SDx)/Var(y), where B is the unstandardized regression coeffi- vation was found.
cient of the class-level predictor (i.e., class-average achievement), SDx is the Our results are in line with social comparison theory and research
standard deviation of the class-level predictor (i.e., class-average achievement) on the big-fish-little-pond effect (Marsh et al., 2000). SEN students in
and Var(y) is the total variance of the individual-level criterion (i.e., academic special education schools can compare their achievement with that of
self-concept) (Marsh et al., 2009). low-achieving classmates which benefits their academic self-concept

71
A. Kocaj et al. Contemporary Educational Psychology 55 (2018) 63–83

and enjoyment of learning. This contrast effect—being a big fish in a on their future educational outcomes: SEN students in special education
small pond—seems to be more important than the potential negative schools frequently leave school without a formal educational attain-
labeling effect of being placed in a stigmatized school type (i.e., as- ment (Authoring Group Educational Reporting, 2016; Pfahl & Powell,
similation effect). The effect sizes of the negative relationship between 2011). Taken together, tracking and status differences between school
class-average achievement and academic self-concept after controlling types are highly visible for students, teachers, and parents in the
for individual achievement are similar to those from samples of stu- German special education system. This differentiating system facilitates
dents without SEN (for a review, see Marsh et al., 2008). the examination of contrast and assimilation effects (Trautwein et al.,
Also, the absence of assimilation effects in our study reflects pre- 2006). Therefore, the present study adds to the debate on tracking and
vious findings on the relation between school tracking and antecedents strengthens the external validity of the BFLPE for students with SEN.
of achievement motivation in general (Chmielewski et al., 2013; Third, our analyses are based on a large sample of classrooms and
Trautwein et al., 2006). The interpretation of the present findings, students with SEN from a representative study. Fourth, we employed
however, is limited by the substantial relationship between class- sophisticated statistical methods (i.e., multilevel models with latent
average achievement and school type which makes it difficult to se- measures) to estimate the relationship between educational placement,
parate assimilation and contrast effects as described by social com- classroom composition, and achievement motivation. We also applied
parison theory (see Table 3). A direct assessment of assimilation, i.e., propensity score matching (Rosenbaum & Rubin, 1983, 1985) with
asking SEN students about the perceived standing or prestige of their numerous covariates (e.g., individual achievement, cognitive abilities,
school would help to separate contrast and assimilation effects socio-economic and cultural background) to control statistically for
(Trautwein, Lüdtke, Marsh, & Nagy, 2009). potential selection biases (Appendix C) as SEN students cannot be
In contrast to class-average achievement, class-average social sup- randomly assigned to special education schools or regular schools
port was unrelated to SEN students’ achievement motivation over and (Lindsay, 2007). In our analyses, we included class-average achieve-
above individual-level perceptions of emotional support from peers. ment instead of school-average achievement to capture the natural
The perceived achievement of classmates seems to be the primary frame of reference for SEN students (Marsh et al., 2008). This approach,
characteristic of the social environment in the classroom contributing to together with the large sample size and inclusion of covariates in our
placement differences in achievement motivation. Our results indicate analyses, allows for a more accurate estimation of the BFLPE (Dicke
that class-average social support by classmates does not alleviate the et al., 2018).
negative effect of classmates’ perceived achievement level on SEN Fifth, whereas most studies focus on students with learning dis-
students’ achievement motivation (but see Allodi, 2000). On the in- abilities, we examined if placement effects generalize to both students
dividual level, however, higher perceived social support by peers con- with learning disabilities and students with speech or language im-
tributed to higher academic self-concept and enjoyment of learning. pairment. In supplementary analyses, we tested if the relation between
This finding is consistent with results from previous studies (e.g., educational placement and motivational outcomes differs between
Forman, 1988) and might have several reasons: First, perceived social students with learning disabilities and students with speech or language
support and associated feelings of relatedness can help SEN students to impairment (Appendix B).
deal with challenging situations in school and to maintain their moti- Several methodological limitations of our study are worth men-
vation (Furrer & Skinner, 2003). The individually perceived availability tioning. First, questionnaires in the present educational large-scale as-
of social support might be more relevant as a buffer against stressful sessment were developed for students without SEN. In the present
events in school than the class-average support structures (Furrer & study, measures of academic self-concept and social support showed
Skinner, 2003). Second, SEN students’ individual perceptions of a lower internal consistencies for students with SEN than for the student
caring classroom environment could lead to positive self-perceptions population without SEN (see Richter, Böhme, Bastian-Wurzel, Pant, &
and to active participation in school lessons (Grolnick & Ryan, 1990; Stanat, 2014). The moderate internal consistency of the social support
Pijl & Frostad, 2010). scale as one central predictor in our study limits the interpretation of
our results. This is even more relevant for aggregated variables of in-
4.2. Strengths, limitations, and future research dividual social support. The aggregation of unreliable measures on the
individual level could lead to spurious effects of the corresponding
The present study extends previous studies and contributes to the measures on the classroom level (Televantou et al., 2015). Additionally,
research field in the following ways. First, we included both educational only partial measurement invariance could be established for the mo-
placement and class-average achievement in our analyses. Previous tivational outcomes. Placement differences in those motivational out-
studies focused either on educational placement (Bakker et al., 2007; comes might therefore be partly due to differences in the measurement
Bear et al., 2002; Crabtree & Meredith, 2000; Elbaum, 2002; Forman, quality between both groups.
1988) or on class-average achievement (Dixon, Seaton, & Dixon, 2008) A second limitation is the substantial amount of missing data for
to predict SEN students’ academic self-concept. Including both educa- self-reports of achievement motivation and social support (approxi-
tional placement and class-average achievement allowed us to separate mately 25%). One reason for lower response rate might be that students
the negative assimilation effect of being placed in special education participated voluntary in the questionnaires. In contrast, participation
schools from the positive contrast effect of being educated together in the achievement tests was mandatory. While this is a global ex-
with students with lower achievement levels in special education planation for higher missing rates, students with SEN also showed
schools. Furthermore, we extend prior research on classroom compo- higher missing rates than students without SEN. This might be due to
sition effects by including enjoyment of learning as additional outcome higher levels of fatigue and distraction as well as reduced attentional
besides academic self-concept as well as class-average social support capacities (Händel, Artelt, & Weinert, 2013; Heydrich et al., 2013;
besides class-average achievement. Nusser, Heydrich, Carstensen, Artelt, & Weinert, 2016). Furthermore,
Second, our sample was drawn from Germany where the majority of difficulties in understanding and following instructions, lower language
states implement a dichotomous special education system (see Section skills, and less experience with standardized assessments might con-
1.3). Placing students with SEN to different school types based on prior tribute to lower response rates for students with SEN (Marsh, Tracey, &
achievement or abilities is considered to be the most pronounced type Craven, 2006; Nusser et al., 2016). Another potential explanation is
of tracking because students have no opportunities to compare them- that the assessment situation might differ from their regular school
selves to students from different tracks during the school day routines. For example, SEN students can receive additional support
(Chmielewski et al., 2013). Furthermore, placing students with SEN in during instruction by special needs teachers or teaching assistants
either special education schools or regular schools has a strong impact which is not possible during the standardized assessment session.

72
A. Kocaj et al. Contemporary Educational Psychology 55 (2018) 63–83

Related to that, data collection during the assessment session could in a small pond even if you don't learn to swim as well?”
have influenced students’ self-reported motivation compared to as- A potential explanation for these opposite placement effects might
sessments during a regular school day. Self-reports of academic self- be that social comparisons are based on different motives that affect
concept have shown to be influenced by item wording and the assess- motivational and cognitive outcomes in different ways. Self-enhance-
ment context (Dijkstra et al., 2008; Marsh et al., 2008). For example, ment motives might trigger downward comparisons with lower-
data collection during assessment sessions might bias students’ self- achieving classmates that result in more positive academic self-concepts
evaluations towards a stronger reliance on their test experiences (Dijkstra et al., 2008). Self-improvement motives, in contrast, might
whereas alternative sources of social comparison information (espe- lead to upward comparisons with higher-achieving classmates and
cially school grades, but also classroom discussions, group work, and subsequently boost future performance (Dijkstra et al., 2008). Higher-
presentations during class) might be considered more strongly by stu- achieving classmates may serve as role models and may positively affect
dents in assessments during regular school days (Marsh et al., 2008). students’ persistence and effort (Gamoran, 1986; Slavin, 1996). How-
Nonetheless, asking students about their achievement motivation ever, the downsides of upward comparisons are lower self-evaluations
during an assessment session has advantages. Questionnaires are ad- and negative affective consequences (Dijkstra et al., 2008).
ministered anonymously (e.g., teachers do not receive feedback about Overall, there seems to be a positive net effect of attending a regular
students’ responses) and students do not receive any rewards or grades school on SEN students’ achievement. The positive direct effect on SEN
for their participation which might decrease social desirability bias in students’ achievement outweighs the negative indirect effect on SEN
their responses (Fredricks & McColskey, 2012). students’ achievement motivation. These contrasting effects are also
Third, our study is limited by the cross-sectional design and it is reflected in the opposed relationship of class-average achievement with
therefore not possible to draw conclusions about the directionality of SEN students’ cognitive and motivational outcomes. Whereas class-
our results. We proposed that social support has an influence on SEN mates’ higher achievement levels promote SEN students’ individual
students’ academic self-concept and enjoyment of learning. Although achievement (Justice, Logan, Lin, & Kaderavek, 2014), social compar-
students who feel rejected might develop lower academic self-concept isons with more able classmates lead to lower levels of achievement
and enjoyment of learning as a consequence of low social support, it is motivation. However, more longitudinal studies considering different
also reasonable to argue that students with negative self-concepts and aspects of the learning environment in special education schools and
low enjoyment of learning tend to refrain from social interactions and regular schools are necessary to shed light on the interplay between
activities in the classroom (Pijl & Frostad, 2010). Another limitation of SEN students’ motivational and cognitive development (Bakker et al.,
the cross-sectional design is that we were only able to examine be- 2007).
tween-person relationships and interpret differences between groups. Conclusions about the optimal placement for SEN students are dif-
Longitudinal studies are necessary to examine within-person relation- ficult to draw because schools vary in their implementation of inclusive
ships, such as whether SEN students’ achievement motivation increases education (Lindsay, 2007). However, examining the learning environ-
after experiencing social support by peers. Longitudinal designs would ment in special education schools could help to promote SEN students’
also allow for testing reciprocal effects between SEN students’ achievement motivation in inclusive school settings. SEN students
achievement motivation and social support (Skinner & Belmont, 1993). might benefit from a less competitive classroom environment where
Finally, cross-sectional studies tend to overestimate placement differ- teachers do not emphasize social comparisons but instead rely on in-
ences and the effects of classroom composition because researchers dividually oriented feedback with a focus on students’ individual im-
cannot adequately control for differences in prior motivation, provement over time (Chapman, 1988, Lüdtke, Köller, Marsh, &
achievement, and the selectivity of different school types (Baumert, Trautwein, 2005). Besides individualized feedback, individualized in-
Stanat, & Watermann, 2006). struction (e.g., alternative learning goals, learning tasks, and teaching
In the present study, we focused on emotional social support by materials matching students’ achievement levels) might also promote
classmates. Future studies should include measures of social support by SEN students’ achievement motivation (Deci & Chandler, 1986; Eccles,
teachers, parents, and friends and examine their interplay with support 2004; McLeskey & Waldron, 2002; Roy, Guay, & Valois, 2015). Roy
by classmates in shaping SEN students’ achievement motivation et al. (2015) found that the BFLPE on academic self-concept was atte-
(Patrick et al., 2007; Song et al., 2015) as well as differential effects of nuated for low-achieving students in primary schools who received
emotional and academic components of social support (Wentzel et al., differentiated instruction more frequently. Individualized instruction
2010). We would expect that social support by teachers, parents, and might activate students’ internal frame of reference instead of com-
friends play a distinctive role for SEN students’ achievement motivation parisons to classmates and consequently lead to more positive self-
(Song et al., 2015; Wentzel et al., 2010). Furthermore, academic sup- evaluations. However, teachers need resources and additional training
port, such as help and instruction to meet educational expectations, to implement instructional adaptations for students with SEN (Scruggs,
might differ from emotional support in predicting SEN students’ Mastropieri, & Marshak, 2012).
achievement motivation (Wentzel et al., 2010). A central question for school practitioners is how teachers, school
administrators, and parents can cooperate to create a learning en-
4.3. Conclusions for the educational placement of students with SEN vironment that fosters students’ academic progress and achievement
motivation. Studies on inclusive school development highlight the im-
Despite its limitations, the findings of the present study contribute portant role of an inclusive culture to establish supportive and stimu-
to the empirical debate on educational placement of students with SEN. lating learning environments (Booth & Ainscow, 2011; Downes, Nairz-
On the one hand, educating SEN students in special education schools Wirth, & Rusinaitė, 2017). This inclusive school culture includes shared
together with students with similar challenges seems to be beneficial for beliefs to value diversity in school, to enhance students’ participation,
their achievement motivation. On the other hand, the majority of the and to acknowledge students’ individual strengths and needs (Downes
studies reports cognitive benefits for SEN students in regular schools et al., 2017; Dyson, Howes, & Roberts, 2002). Additionally, schools
(Ruijs & Peetsma, 2009). Previous analyses with the present data also might implement inclusive policies that revolve around reducing
revealed higher achievement levels for SEN students in regular schools structural barriers to learning and participation and around promoting
compared to special education schools (Kocaj et al., 2014). These di- cooperative classroom structures (e.g., increase school staff collabora-
verging results regarding motivational and cognitive outcomes lead to tion, Booth & Ainscow, 2011; Dyson et al., 2002). Finally, schools might
the question why motivational benefits of special education schools are change practices towards a more holistic approach to students’ devel-
not reflected in higher achievement levels for SEN students? Or, as opment and emphasize the role of positive relationships and social
Marsh and Parker (1984) put it: “Is it better to be a relatively large fish support for students’ motivation and school success (Downes et al.,

73
A. Kocaj et al. Contemporary Educational Psychology 55 (2018) 63–83

2017; Dyson et al., 2002; Forman, 1988). This might be especially re- might be most successful in a supportive classroom climate where
levant for students with SEN because high levels of social support may contributions of every student are valued and opportunities for co-
help them to compensate for academic difficulties and to preserve a operative learning, peer tutoring, and social learning are provided.
positive self-view (Allodi, 2000; Lindsay, 2007). Inclusive education

Appendix A. Testing for measurement invariance and predicting enjoyment of learning with mathematics achievement

In supplementary analyses, we first checked the fit of the measurement model for each motivational outcome separately and second, we tested for
measurement invariance between students with special educational needs (SEN) in special education schools and regular schools. Comparable
measurement models and measurement invariance are necessary requirements for valid comparisons of the latent factor means across both student
groups. First, for SEN students in each school setting (special education school vs. regular school), a two-level measurement model with equal factor
loadings on the student level (L1) and on the classroom level (L2) was specified (see Model 0 in Tables A1–A3). Second, we ran different models
constraining (1) all factor loadings to be equal for SEN students in special education schools and regular schools (metric invariance, see Model 1 in
Tables A1–A3), (2) all intercepts to be equal across both groups (intercept-only invariance, see Model 2 in Tables A1–A3), (3) all intercepts and all
factor loadings to be equal across both groups (scalar invariance, see Model 3 in Tables A1–A3), and (4) allow one intercept to vary between groups
while constraining the other intercepts and all factor loadings to be equal (partial invariance, see Model 4 in Tables A1–A3). The measurement
models showed a reasonable fit for SEN students in special education schools and regular schools (see Model 0 in Tables A1–A3). Furthermore, we
established partial invariance for each motivational outcome allowing valid inferences about differences in the latent means between groups. Table
A4 shows that analyses with mathematical achievement predicting students’ enjoyment of learning yielded results similar to analyses with reading
achievement as predictor.

Table A1
Testing measurement invariance for academic self-concept German.
χ2 (df) p CFI TLI RMSEA BIC AIC Δχ2 (df) p (Δχ2)

Model 0a: Configural invariance (regular school) 0.90 (2) .64 1.00 1.00 .00 4084.38 4028.54 – –
Model 0a: Configural invariance (special education school) 9.23 (2) .01 .96 .89 .11 2573.14 2524.19 – –
Model 1: Metric invariance (equal factor loadings) 3.49 (3) .32 1.00 1.00 .02 6610.31 6538.94 – –
Model 2: Intercept-only invariance (equal intercepts) 26.36 (3) .00 .95 .90 .14 6633.18 6561.81 22.87 (0) .00
Model 3: Scalar invariance (equal factor loadings & intercepts) 30.71 (6) .00 .95 .95 .10 6617.26 6560.16 4.35 (3) .23
Model 4b: Partial invariance 30.61 (8) .00 .95 .96 .08 6603.63 6556.05 4.24 (5) .52

a
Model 0 refers to a two-level measurement model with equal factor loadings on student level (L1) and classroom level (L2).
b
Model 4 allows differences in the intercept of item 1 between special education and regular schools and restricts residual variances to be equal across both
groups. The fit of Model 4 does not differ significantly (p = .52) from Model 2.

Table A2
Testing measurement invariance for academic self-concept mathematics.
χ2 (df) p CFI TLI RMSEA BIC AIC Δχ2 (df) p (Δχ2)

Model 0a: Configural invariance (regular school) 2.24 (2) .33 1.00 1.00 .02 4225.63 4169.75 – –
Model 0a: Configural invariance (special education school) 1.88 (2) .39 1.00 1.00 .00 2497.57 2448.58 – –
Model 1: Metric invariance (equal factor loadings) 0.48 (3) .92 1.00 1.01 .00 6686.29 6614.87 – –
Model 2: Intercept-only invariance (equal intercepts) 19.75 (3) .00 0.98 0.96 .11 6705.56 6634.14 19.27 (0) .00
Model 3: Scalar invariance (equal factor loadings & intercepts) 20.38 (6) .00 0.98 0.98 .07 6685.91 6628.77 0.63 (3) .89
Model 4b: Partial invariance 15.91 (5) .01 0.99 0.98 .07 6688.20 6626.30 3.84 (2) .15

a
Model 0 refers to a two-level measurement model with equal factor loadings on student level (L1) and classroom level (L2).
b
Model 4 allows differences in the intercept of item 1 between special education and regular schools. The fit of Model 4 does not differ significantly (p = .15) from
Model 2.

Table A3
Testing measurement invariance for enjoyment of learning.
χ2 (df) p CFI TLI RMSEA BIC AIC Δχ2 (df) p (Δχ2)

Model 0a: Configural invariance (regular school) 3.81 (2) .15 .99 .98 .04 4168.72 4112.91 – –
Model 0a: Configural invariance (special education school) 0.70 (2) .71 1.00 1.01 .00 2526.17 2477.15 – –
Model 1: Metric invariance (equal factor loadings) 4.02 (3) .26 1.00 1.00 .03 6661.89 6590.50 – –
Model 2: Intercept-only invariance (equal intercepts) 19.43 (3) .00 .97 .94 .11 6677.30 6605.91 15.41 (0) .00
Model 3: Scalar invariance (equal factor loadings & intercepts) 24.24 (6) .00 .97 .97 .08 6661.83 6604.72 4.81 (3) .19
Model 4b: Partial invariance 13.97 (5) .02 .98 .98 .07 6658.32 6596.45 5.46 (2) .07

a
Model 0 refers to a two-level measurement model with equal factor loadings on student level (L1) and classroom level (L2).
b
Model 4 allows differences in the intercept of item 3 between special education and regular schools. The fit of Model 4 does not differ significantly (p = .07) from
Model 2.

74
A. Kocaj et al. Contemporary Educational Psychology 55 (2018) 63–83

Table A4
Predicting SEN students' enjoyment of learning with mathematics achievement.
Model 1 Model 2 Model 3 Model 4 Model 5 Model 6

B SE B SE B SE B SE B SE B SE

Student level (L1)


Mathematics achievement 0.09* 0.04 0.14** 0.05 0.13* 0.05 0.12** 0.05
Perceived social support 0.23*** 0.03 0.21*** 0.03 0.21*** 0.03
Gender (1 = female) 0.22** 0.07 0.22** 0.07 0.22** 0.07 0.14* 0.07 0.14* 0.07 0.17* 0.07

Classroom level (L2)


School type (1 = special education school) 0.30*** 0.08 0.13 0.10 0.24** 0.07 0.09 0.09
Class-average mathematics achievement –0.19 ***
0.05 –0.13* 0.06 –0.16** 0.06
Class-average social support 0.02 0.04 0.06 0.04 0.08 0.04

Model fit
Chi-Square test of model fit (df) 88.66*** (9) 82.45*** (9) 84.01*** (11) 29.47*** (9) 33.83*** (11) 90.57*** (17)
Bayesian Information Criteria (BIC) 9645.42 10582.22 9629.75 8997.11 8992.37 11953.59
Akaike Information Criteria (AIC) 9555.74 10482.24 9535.11 8911.07 8901.55 11839.13
Comparative Fit Index (CFI) 0.87 0.88 0.89 0.97 0.97 0.90
Root Mean Square Error (RMSEA) 0.09 0.09 0.08 0.05 0.05 0.06

Described variance
R2 on student level (L1) 4.30% 6.80% 6.30% 12.30% 10.90% 14.10%
R2 on classroom level (L2) 12.20% 21.10% 20.40% 0.50% 12.70% 27.00%

Note. SEN = special educational needs. Intraclass correlation (ICC) = .15.


* p < .05.
** p < .01.
*** p < .001.

Appendix B. Testing for differential effects of type of special educational needs on students’ achievement motivation

In supplementary analyses, we tested if the relation between educational placement and motivational outcomes differs between students with
learning disabilities and students with speech or language impairment. The small amount of students with emotional disorders in special education
schools prevented differential analyses of placement differences in academic self-concept and enjoyment of learning for this group. To test for
differential effects of classroom composition on the relationship between type of SEN and academic self-concept and enjoyment of learning, re-
spectively, random slope models were run in a first step. In the case of classrooms differing in the magnitude of the relation between type of SEN and
both motivational outcomes (i.e., significant slope variation), we planned to apply cross-level-interaction to test whether those differences could be
explained by classroom composition (Aguinis, Gottfredson, & Culpepper, 2013). After accounting for differences in individual achievement, no
significant main effects of type of SEN were found (see Model 1 and Model 3 in Tables B1 and B2). Random slope models were then estimated to test

Table B1
Testing for differential effects of type of SEN on academic self-concept.
Academic self-concept German Academic self-concept mathematics

Model 1 Model 2 Model 3 Model 4

B SE B SE B SE B SE

Student level (L1)


Reading achievement 0.16*** 0.04 0.16*** 0.04
Mathematics achievement 0.39*** 0.05 0.39*** 0.05
Type of SEN1: Learning disabilities (1 = yes) –0.01 0.07 –0.01 0.07 –0.05 0.09 –0.06 0.09
Type of SEN1: Speech or language impairment (1 = yes) –0.09 0.07 –0.09 0.07 0.11 0.08 0.12 0.09
Gender (1 = female) 0.12* 0.05 0.12* 0.05 –0.12 0.06 –0.12* 0.06

Classroom level (L2)


School type (1 = special education school) 0.13 0.09 0.11 0.09 0.01 0.09 –0.02 0.09
Class-average reading achievement –0.14* 0.06 –0.15* 0.07
Class-average mathematics achievement –0.35 ***
0.07 –0.36 ***
0.07

Variance components
Slope (L2) variance: Learning disabilities 0.04 0.27 0.12 0.22
Slope (L2) variance: Speech or language impairment 0.02 0.18 0.02 0.17
Intercept-slope (L2) covariance: Learning disabilities –0.01 0.13 –0.001 0.12
Intercept-slope (L2) covariance: Speech or language impairment –0.01 0.10 –0.02 0.10

Model fit
Bayesian Information Criteria (BIC) 9677.06 9702.82 9582.05 9595.96
Akaike Information Criteria (AIC) 9572.25 9578.04 9482.45 9476.44

Note. SEN = special educational needs. Intraclass correlation (ICC) = .09 for self-concept German and ICC = .14 for self-concept mathematics.
** p < .01.
* p < .05.
*** p < .001.

75
A. Kocaj et al. Contemporary Educational Psychology 55 (2018) 63–83

Table B2
Testing for differential effects of type of SEN on enjoyment of learning.
Enjoyment of learning Enjoyment of learning

(Reading achievement) (Mathematics achievement)


Model 1 Model 2 Model 3 Model 4

B SE B SE B SE B SE

Student level (L1)


Reading achievement 0.14*** 0.04 0.13** 0.04
Mathematics achievement 0.15** 0.05 0.15** 0.05
Type of SEN1: Learning disabilities (1 = yes) 0.10 0.08 0.10 0.08 0.13 0.08 0.13 0.09
Type of SEN1: Speech or language impairment (1 = yes) 0.11 0.08 0.10 0.08 0.11 0.08 0.10 0.09
Gender (1 = female) 0.18** 0.06 0.18** 0.07 0.21** 0.07 0.21** 0.07

Classroom level (L2)


School type (1 = special education school) 0.06 0.12 0.07 0.11 0.10 0.11 0.12 0.12
Class-average reading achievement –0.15* 0.07 –0.16* 0.07
Class-average mathematics achievement –0.14 *
0.07 –0.13 *
0.07

Variance components
Slope (L2) variance: Learning disabilities 0.05 0.19 0.04 0.22
Slope (L2) variance: Speech or language impairment 0.10 0.21 0.11 0.21
Intercept-slope (L2) covariance: Learning disabilities –0.002 0.10 –0.003 0.12
Intercept-slope (L2) covariance: Speech or language impairment –0.08 0.12 –0.09 0.12

Model fit
Bayesian Information Criteria (BIC) 9708.44 9728.01 9641.11 9661.29
Akaike Information Criteria (AIC) 9603.64 9603.25 9536.51 9536.76

Note. SEN = special educational needs. Intraclass correlation (ICC) = .15.


* p < .05.
** p < .01.
*** p < .001.

if the relation between type of SEN and motivational outcomes varied between classrooms. The slope variance was not statistically different from
zero for both academic self-concept and enjoyment of learning (see Model 2 and Model 4 in Tables B1 and B2). Therefore, no additional cross-level
interaction effects between class-average achievement and type of SEN were considered.

Appendix C. Propensity score matching analyses to control for differences in background variables between students with SEN in special
education schools and regular schools

In the present study, we compared the academic self-concept and enjoyment of learning of students with SEN in special education schools and
regular schools. However, students with SEN are not randomly assigned to different school types. They are selected to special education schools or
regular schools based on their prior achievement and other background variables (Peetsma et al., 2001; Zigmond, 2003) as well as based on variables
on the federal state level as the German federal states differ in their implementation of inclusive schooling. Therefore, pre-existing group differences
might influence the association between school type and SEN students’ achievement motivation (selection bias; Duncan, Magnuson, & Ludwig, 2004).
In supplementary analyses, we applied propensity score matching (PSM; Rosenbaum & Rubin, 1983, 1985) to control for differences between SEN
students in special education schools and regular schools in confounding background variables. PSM combines relevant background variables into
one single measure that indicates the probability of receiving a treatment (in the present study: attending a regular school). Then, SEN students in
special education schools and regular schools are matched based on their propensity score. Subsequently, only students with similar propensity
scores are compared in their achievement motivation. Differences in SEN students’ achievement motivation could therefore be attributed more
validly to their educational placement.
We applied a full matching procedure (Hansen, 2004; Stuart, 2010), in which the sample was divided into subgroups consisting of at least one
student from a regular school (treatment group) and at least one student from a special education school (control group). The number of subgroups
was estimated in a way that minimizes the differences in the propensity scores in each subgroup (Stuart, 2010). SEN students from the treatment
group (regular schools) received a weight of 1 whereas SEN students from the control group (special education schools) received a weight pro-
portional to the number of SEN students from the treatment group (Stuart & Green, 2008). The selection of relevant background variables for our
matching model (see Fig. C1) was based on a previous study (Kocaj et al., 2014). Our matching model includes 16 variables: students’ verbal and
numeric cognitive abilities (derived from an established test inventory for grade 4 to 12, KFT 4-12 + R; Heller & Perleth, 2000), various indicators of
students’ socio-economic and cultural background (number of books at home; parents’ socio-economic status as operationalized by the international
socio-economic index of occupational status, Ganzeboom, De Graaf, & Treiman, 1992; parents’ educational background as operationalized by the
international standard classification of education, OECD, 1999), parents’ educational aspirations (parents’ desired and anticipated degree for their
child), parents’ educational goals (see Baumert et al., 2008), parents born in Germany, language at home, students’ gender, age, school entrance age,
years spent in kindergarten, diagnosed learning disability, and the German federal state where the student attends school (not depicted in Fig. C1).
Full matching was implemented in R (R Development Core Team, 2015) using the package MatchIt (Ho, Imai, King, & Stuart, 2011). After the full
matching, both groups of SEN students were more similar with regard to the propensity score and the background variables. The full matching
substantially reduced group differences in the propensity score and in the background variables (Fig. C1). Furthermore, the distributions of the
propensity scores were more similar for both groups and the matching resulted in a large reduction in standardized bias (Fig. C2 & Table C1).
Subsequently, we replicated the central analyses of our study by running multilevel regression analyses in Mplus 7.31 with the matched sample using
the weights from the full matching procedure. The results were similar to those from the unmatched sample analyses (Table C2–C5). However, the

76
A. Kocaj et al. Contemporary Educational Psychology 55 (2018) 63–83

Fig. C1. Standardized mean differences in background variables and in the propensity score between students with SEN in special education schools and regular
schools before (white dots) and after (black dots) full matching. Results are based on the first imputation for all students with SEN participating in the achievement
tests in German (n = 1071). HISEI = highest international socio-economic index of occupational status (Ganzeboom, De Graaf, & Treiman, 1992). HISCED = highest
international standard classification of education (OECD, 1999). a1 = yes. b1 = always or almost always German. c1 = yes. d1 = male. e1 ≤ 1 year. f1 = at least
Hauptschule leaving certificate (after 9 years). g1 = Realschule leaving certificate (after 10 years).

Fig. C2. Distribution of propensity scores before and after full matching. In the left figure, each point represents the weight given to that particular student from the
full matching procedure. All students from regular schools (treatment group) received a weight of one; larger points for students in special education schools (control
group) indicate larger weights. SEN = special educational needs.

77
A. Kocaj et al. Contemporary Educational Psychology 55 (2018) 63–83

Table C1
Distribution of propensity scores and standardized bias before and after full matching.
School type N Min Max M SD Skewness Excess kurtosis Standardized bias

Before matching Special education school 413 –4.92 4.38 –0.65 1.53 0.12 –0.10 1.47
Regular school 658 –2.71 6.64 1.57 1.48 0.13 0.10
After matching Special education school 389 –3.09 4.16 1.39 1.30 –0.23 0.01 –0.01
Regular school 622 –3.10 4.14 1.38 1.29 –0.28 –0.02

Note. The standardized bias for the propensity score is calculated by dividing the weighted difference in means by the standard deviation in the full group of students
with SEN (Rosenbaum & Rubin, 1985). A standardized bias smaller than 0.25 is considered to reflect a successful matching on the propensity score (Stuart & Green,
2008).

Table C2
Predicting SEN students' academic self-concept in German.
Model 1 Model 2 Model 3 Model 4 Model 5 Model 6

B SE B SE B SE B SE B SE B SE

Student level (L1)


Reading achievement 0.12** 0.04 0.16*** 0.04 0.15*** 0.04 0.15*** 0.04
Perceived social support 0.17*** 0.04 0.15*** 0.04 0.14** 0.04
Gender (1 = female) 0.10 0.06 0.09 0.07 0.09 0.07 0.07 0.07 0.06 0.07 0.06 0.07

Classroom level (L2)


School type (1 = special education school) 0.38*** 0.09 0.09 0.12 0.29** 0.09 0.07 0.12
Class-average reading achievement –0.24*** 0.05 –0.20** 0.07 –0.19* 0.07
Class-average social support –0.08 0.04 –0.03 0.04 –0.04 0.05

Model fit
Chi-Square test of model fit (df) 16.70 (8) 21.54* (9) 23.29* (10) 16.68 (8) 18.97 (10) 28.06* (14)
Bayesian Information Criteria (BIC) 6159.41 10034.06 6154.43 5861.75 5852.95 5838.68
Akaike Information Criteria (AIC) 6084.43 9935.78 6074.76 5787.68 5774.25 5750.72
Comparative Fit Index (CFI) 0.97 0.96 0.96 0.98 0.98 0.96
Root Mean Square Error (RMSEA) 0.04 0.04 0.04 0.04 0.03 0.04

Described variance
R2 on student level (L1) 4.91% 8.24% 8.03% 8.76% 7.18% 13.85%
R2 on classroom level (L2) 19.43% 32.68% 33.00% 5.03% 16.24% 33.65%

Note. SEN = special educational needs.


* p < .05.
** p < .01.
*** p < .001.

Table C3
Predicting SEN students' academic self-concept in mathematics.
Model 1 Model 2 Model 3 Model 4 Model 5 Model 6

B SE B SE B SE B SE B SE B SE

Student level (L1)


Mathematics achievement 0.31*** 0.05 0.42*** 0.05 0.42*** 0.05 0.41*** 0.05
Perceived social support 0.12** 0.04 0.10* 0.04 0.08* 0.04
Gender (1 = female) –0.18* 0.07 –0.16* 0.07 –0.17* 0.07 –0.31*** 0.07 –0.32*** 0.07 –0.19** 0.07

Classroom level (L2)


School type (1 = special education school) 0.52*** 0.10 0.02 0.12 0.33*** 0.09 –0.003 0.12
Class-average mathematics achievement –0.39*** 0.06 –0.38*** 0.08 –0.40*** 0.08
Class-average social support –0.01 0.05 0.03 0.05 0.06 0.05

Model fit
Chi-Square test of model fit (df) 9.90 (9) 43.45*** (10) 11.25 (11) 7.47 (9) 11.12 (11) 14.89 (15)
Bayesian Information Criteria (BIC) 6052.40 9693.73 6027.37 5872.57 5863.86 5779.56
Akaike Information Criteria (AIC) 5982.09 9600.57 5952.37 5802.99 5789.65 5696.07
Comparative Fit Index (CFI) 1.00 0.94 1.00 1.00 1.00 1.00
Root Mean Square Error (RMSEA) 0.01 0.06 0.01 0.003 0.01 0.01

Described variance
R2 on student level (L1) 20.88% 30.54% 30.84% 7.19% 6.68% 31.57%
R2 on classroom level (L2) 19.97% 45.28% 46.14% 0.20% 11.44% 53.22%

Note. SEN = special educational needs.


* p < .05.
** p < .01.
*** p < .001.

78
A. Kocaj et al. Contemporary Educational Psychology 55 (2018) 63–83

Table C4
Predicting SEN students' enjoyment of learning with reading achievement.
Model 1 Model 2 Model 3 Model 4 Model 5 Model 6

B SE B SE B SE B SE B SE B SE

Student level (L1)


Reading achievement 0.12** 0.05 0.16** 0.05 0.16** 0.05 0.15** 0.05
Perceived social support 0.21*** 0.04 0.20*** 0.04 0.19*** 0.04
Gender (1 = female) 0.21** 0.08 0.21* 0.08 0.21* 0.08 0.15 0.09 0.14 0.08 0.15 0.08

Classroom level (L2)


School type (1 = special education school) 0.33*** 0.09 0.12 0.14 0.27** 0.09 0.12 0.13
Class-average reading achievement –0.20*** 0.05 –0.15 0.08 –0.15 0.08
Class-average social support 0.01 0.05 0.05 0.05 0.06 0.05

Model fit
Chi-square test of model fit (df) 37.43*** (8) 39.56*** (9) 38.47*** (10) 13.13 (8) 15.21 (10) 39.09** (14)
Bayesian Information Criteria (BIC) 5772.65 8535.33 5773.88 5664.30 5659.06 5653.48
Akaike Information Criteria (AIC) 5699.16 8443.47 5695.80 5591.06 5581.24 5566.50
Comparative Fit Index (CFI) 0.94 0.93 0.94 0.99 0.99 0.95
Root Mean Square Error (RMSEA) 0.07 0.07 0.06 0.03 0.02 0.05

Described variance
R2 on student level (L1) 5.39% 8.21% 7.12% 12.94% 11.26% 15.22%
R2 on classroom level (L2) 14.72% 21.29% 21.59% 0.33% 14.21% 26.35%

Note. SEN = special educational needs.


* p < .05.
** p < .01.
*** p < .001.

Table C5
Predicting SEN students' enjoyment of learning with mathematics achievement.
Model 1 Model 2 Model 3 Model 4 Model 5 Model 6
B SE B SE B SE B SE B SE B SE

Student level (L1)


Mathematics achievement 0.12* 0.05 0.18*** 0.05 0.17** 0.06 0.16** 0.05
Perceived social support 0.22*** 0.04 0.21*** 0.04 0.20*** 0.04
* ** **
Gender (1 = female) 0.21 0.08 0.22 0.08 0.22 0.08 0.12 0.08 0.11 0.08 0.16 0.08

Classroom level (L2)


School type (1 = special education school) 0.37*** 0.10 0.16 0.15 0.29** 0.09 0.13 0.14
Class-average mathematics achievement –0.23*** 0.06 –0.17 0.09 0.05 0.05 –0.18* 0.08
Class-average social support 0.01 0.05 0.06 0.05

Model fit
Chi-Square test of model fit (df) 30.48** (8) 64.66*** (9) 31.62** (10) 13.48 (8) 15.66 (10) 30.03* (14)
Bayesian Information Criteria (BIC) 5792.00 8508.21 5792.46 5678.56 5671.40 5669.10
Akaike Information Criteria (AIC) 5718.47 8416.29 5714.34 5605.27 5593.53 5582.08
Comparative Fit Index (CFI) 0.95 0.88 0.95 0.99 0.99 0.97
Root Mean Square Error (RMSEA) 0.06 0.09 0.05 0.03 0.03 0.04

Described variance
R2 on student level (L1) 4.07% 8.91% 6.53% 13.26% 11.54% 15.26%
R2 on classroom level (L2) 16.30% 26.70% 26.72% 0.29% 14.89% 32.15%

Note. SEN = special educational needs.


* p < .05.
** p < .01.
*** p < .001.

negative effect of class-average achievement on SEN students’ enjoyment of learning was not significant after the matching (Model 3 & Model 6,
Table C4: b = –0.15, p = .07; Model 3, Table C5: b = –0.17, p = .06). In the analyses without matching, the effect was quite similar in magnitude but
significant (Model 3, Table 6: b = –0.14, p = .03; Model 6, Table 6: b = –0.16, p = .02; Table A4, Model 3: b = –0.13, p = .04). One explanation for
this diverging result pattern might be an increase in the standard error because of the slightly reduced size of the matched sample.

Appendix D. Supplementary material

Supplementary data associated with this article can be found, in the online version, at https://doi.org/10.1016/j.cedpsych.2018.09.004.

79
A. Kocaj et al. Contemporary Educational Psychology 55 (2018) 63–83

References of the Humanities, 5, 151–157.


Downes, P., Nairz-Wirth, E., & Rusinaitė, V. (2017). Structural indicators for inclusive
systems in and around schools, NESET II report. Luxembourg: Publications Office of the
Aguinis, H., Gottfredson, R. K., & Culpepper, S. A. (2013). Best-practice recommendations European Union.
for estimating cross-level interaction effects using multilevel modeling. Journal of Duncan, G. J., Magnuson, K. A., & Ludwig, J. (2004). The endogeneity problem in de-
Management, 39, 1490–1528. https://doi.org/10.1177/0149206313478188. velopmental studies. Research in Human Development, 1, 59–80. https://doi.org/10.
Allodi, M. W. (2000). Self-concept in children receiving special support at school. 1080/15427609.2004.9683330.
European Journal of Special Needs Education, 15, 69–78. https://doi.org/10.1080/ Dyson, A., Howes, A., & Roberts, B. (2002). A systematic review of the effectiveness of school-
088562500361718. level actions for promoting participation by all students (EPPI-Centre Review, version 1.1).
Authoring Group Educational Reporting. (2016). Bildung in Deutschland 2016. Ein London: EPPI-Centre, Social Science Research Unit, Institute of Education.
indikatorengestützter Bericht mit einer Analyse zu Bildung und Migration [Education in Eccles, J. S. (2004). Schools, academic motivation, and stage-environment. In R. M.
Germany 2016. An indicator-based report including an analysis of education and migra- Lerner, & L. Steinberg (Eds.). Handbook of Adolescent Psychology (pp. 125–153).
tion]. Bielefeld: W. Bertelsmann Verlag. Hoboken, NJ: John Wiley & Sons.
Bakker, J. T. A., & Bosman, A. M. T. (2003). Self-image and peer acceptance of Dutch Eccles (Parsons), J., Adler, T. E., Futterman, R., Goff, S. B., Kaczala, C. M., Meece, J. L., &
students in regular and special education. Learning Disability Quarterly, 26, 5–14. Midgley, C. (1983). Expectancies, values, and academic behaviors. In J. T. Spence
https://doi.org/10.2307/1593680. (Ed.), Achievement and achievement motives. Psychological and sociological approaches
Bakker, J. T. A., Denessen, E., Bosman, A. M. T., Krijger, E.-M., & Bouts, L. (2007). (S. 75–146). San Francisco, CA: W. H. Freeman.
Sociometric status and self-image of children with specific and general learning Elbaum, B. (2002). The self–concept of students with learning disabilities: A meta–ana-
disabilities in Dutch general and special education classes. Learning Disability lysis of comparisons across different placements. Learning Disabilities Research &
Quarterly, 30, 47–62. https://doi.org/10.2307/30035515. Practice, 17, 216–226. https://doi.org/10.1111/1540-5826.00047.
Barth, J. M., Dunlap, S. T., Dane, H., Lochman, J. E., & Wells, K. C. (2004). Classroom Festinger, L. (1954). A theory of social comparison processes. Human Relations, 7,
environment influences on aggression, peer relations, and academic focus. Journal of 117–140. https://doi.org/10.1177/001872675400700202.
School Psychology, 42, 115–133. https://doi.org/10.1016/j.jsp.2003.11.004. Fischbach, A., Schuchardt, K., Mähler, C., & Hasselhorn, M. (2010). Zeigen Kinder mit
Baumert, J., Blum, W., Brunner, M., Dubberke, T., Jordan, A., Klusmann, U., ... Tsai, Y.-M. schulischen Minderleistungen sozio-emotionale Auffälligkeiten? [Do children with
(2008). Professionswissen von Lehrkräften, kognitiv aktivierender Mathematikunterricht low scholastic achievement show social-emotional problems?]. Zeitschrift für
und die Entwicklung von mathematischer Kompetenz (COACTIV): Dokumentation der Entwicklungspsychologie und Pädagogische Psychologie, 42, 201–210.
Erhebungsinstrumente [Professional competence of teachers, cognitively activating in- Forman, E. A. (1988). The effects of social support and school placement on the self-
struction, and development of studentś mathematical literacy (COACTIV): Scale doc- concept of LD students. Learning Disability Quarterly, 11, 115–124. https://doi.org/10.
umentation]. Berlin: Max-Planck-Institut für Bildungsforschung. 2307/1510989.
Baumert, J., Stanat, P., & Watermann, R. (2006). Schulstruktur und die Entstehung dif- Fredricks, J. A., & McColskey, W. (2012). The measurement of student engagement: A
ferenzieller Lern- und Entwicklungsmilieus [School structure and the emergence of comparative analysis of various methods and student self-report instruments. In S. L.
differential learning and developmental milieus]. In J. Baumert, P. Stanat, & R. Christenson, A. L. Reschly, & C. Wylie (Eds.). Handbook of research on student en-
Watermann (Eds.). Herkunftsbedingte Disparitäten im Bildungswesen: Differenzielle gagement (pp. 763–782). Boston, MA: Springer.
Bildungsprozesse und Probleme der Verteilungsgerechtigkeit (pp. 95–188). Wiesbaden: VS Frenzel, A. C., Pekrun, R., & Goetz, T. (2007). Girls and mathematics —A “hopeless”
Verlag für Sozialwissenschaften. issue? A control-value approach to gender differences in emotions towards mathe-
Bauminger, N., Edelsztein, H. S., & Morash, J. (2005). Social information processing and matics. European Journal of Psychology of Education, 22, 497–514. https://doi.org/10.
emotional understanding in children with LD. Journal of Learning Disabilities, 38, 1007/BF03173468.
45–61. https://doi.org/10.1177/00222194050380010401. Fulk, B. M., Brigham, F. J., & Lohman, D. A. (1998). Motivation and self-regulation: A
Bear, G. G., Minke, K. M., & Manning, M. A. (2002). Self-concept of students with learning comparison of students with learning and behavior problems. Remedial and Special
disabilities: A meta-analysis. School Psychology Review, 31, 405–427. Education, 19, 300–309. https://doi.org/10.1177/074193259801900506.
Böhme, K., & Bremerich-Vos, A. (2012). Die im Ländervergleich 2011 in den Fächern Furrer, C., & Skinner, E. (2003). Sense of relatedness as a factor in children’s academic
Deutsch und Mathematik untersuchten Kompetenzen: Beschreibung der im Fach engagement and performance. Journal of Educational Psychology, 95, 148–162.
Deutsch untersuchten Kompetenzen [Competencies in German and mathematics ex- https://doi.org/10.1037/0022-0663.95.1.148.
amined in the National Assessment study 2011: Description of the competencies in Gamoran, A. (1986). Instructional and institutional effects of ability grouping. Sociology of
German]. In P. Stanat, H. A. Pant, K. Böhme, & D. Richter (Eds.). Kompetenzen von Education, 59, 185–198. https://doi.org/10.2307/2112346.
Schülerinnen und Schülern am Ende der vierten Jahrgangsstufe in den Fächern Deutsch und Ganzeboom, H. B. G., De Graaf, P. M., & Treiman, D. J. (1992). A standard international
Mathematik: Ergebnisse des IQB-Ländervergleichs 2011 (pp. 19–33). Münster: socio-economic index of occupational status. Social Science Research, 21(1), 1–56.
Waxmann. Gebhardt, M., Sälzer, C., Mang, J., Müller, K., & Prenzel, M. (2015). Performance of
Booth, T., & Ainscow, M. (2011). Index for inclusion: Developing learning and participation in students with special educational needs in Germany: Findings from Programme for
schools. Bristol: Centre: for Studies on Inclusive Education (CSIE). International Student Assessment 2012. Journal of Cognitive Education and Psychology,
Brown v. Board of Education, 347 U.S. 483 (1954). 14, 343–356. https://doi.org/10.1891/1945-8959.14.3.343.
Byrne, B. M., Shavelson, R. J., & Muthén, B. (1989). Testing for the equivalence of factor Goetz, T., Pekrun, R., Zirngibl, A., Jullien, S., Kleine, M., vom Hofe, R., & Blum, W.
covariance and mean structures: The issue of partial measurement invariance. (2004). Leistung und emotionales Erleben im Fach Mathematik. Längsschnittliche
Psychological Bulletin, 105, 456–466. https://doi.org/10.1037/0033-2909.105.3.456. Mehrebenenanalysen [Academic achievement and emotions in mathematics: A
Chapman, J. W. (1988). Learning disabled children’s self-concepts. Review of Educational longitudinal multilevel analysis perspective]. Zeitschrift für Pädagogische Psychologie,
Research, 58, 347–371. https://doi.org/10.3102/00346543058003347. 18, 201–212. https://doi.org/10.1024/1010-0652.18.34.201.
Chmielewski, A. K., Dumont, H., & Trautwein, U. (2013). Tracking effects depend on Gonzalez, E. J., & Rutkowski, L. (2010). Principles of multiple matrix booklet designs and
tracking type: An international comparison of students’ mathematics self-concept. parameter recovery in large-scale assessments. In M. Von Davier, & D. Hastedt (Vol.
American Educational Research Journal, 50, 925–957. https://doi.org/10.3102/ Eds.), IERI monograph series: Issues and methodologies in large-scale assessments: Vol. 3,
0002831213489843. (pp. 125–156). Princeton, NJ: IEA-ETS Research Institute Monograph.
Corcoran, K., Crusius, J., & Mussweiler, T. (2011). Social comparison: Motives, standards, Grolnick, W. S., & Ryan, R. M. (1990). Self-perceptions, motivation, and adjustment in
and mechanisms. In D. Chadee (Ed.). Theories in social psychology (pp. 119–139). children with learning disabilities: A multiple group comparison study. Journal of
Oxford, UK: Wiley-Blackwell. Learning Disabilities, 23, 177–184.
Crabtree, J. W., & Meredith, C. (2000). Self-concept and social comparisons in learning Händel, M., Artelt, C., & Weinert, S. (2013). Assessing metacognitive knowledge:
disabled students attending mainstream and special schools: Does integration have an Development and evaluation of a test instrument. Journal of Educational Research
impact? In R. G. Craven, & H. W. Marsh (Eds.). Self-Concept Theory, Research and Online, 5, 162–188.
Practice: Advances for the New Millennium (pp. 187–193). Sydney: SELF Research Hansen, B. B. (2004). Full matching in an observational study of coaching for the SAT.
Centre, University of Western Sydney. Journal of the American Statistical Association, 99, 609–618. https://doi.org/10.1198/
Deci, E. L., & Chandler, C. L. (1986). The importance of motivation for the future of the 016214504000000647.
LD field. Journal of Learning Disabilities, 19, 587–594. Heller, K. A., & Perleth, C. (2000). KFT 4–12+R: Kognitiver Fähigkeitstest für 4. bis 12.
Demaray, M. K., & Malecki, C. K. (2002). The relationship between perceived social Klassen, Revision. Göttingen: Beltz Test.
support and maladjustment for students at risk. Psychology in the Schools, 39, Heydrich, J., Weinert, S., Nusser, L., Artelt, C., & Carstensen, C. H. (2013). Including
305–316. https://doi.org/10.1002/pits.10018. students with special educational needs into large-scale assessments of competencies:
Diamond, J. B., Randolph, A., & Spillane, J. P. (2004). Teachers’ expectations and sense of Challenges and approaches within the German National Educational Panel Study
responsibility for student learning: The importance of race, class, and organizational (NEPS). Journal for Educational Research Online, 5, 217–240.
habitus. Anthropology & Education Quarterly, 35, 75–98. https://doi.org/10.1525/aeq. Ho, D. E., Imai, K., King, G., & Stuart, E. A. (2011). MatchIt: Nonparametric preprocessing
2004.35.1.75. for parametric causal inference. Journal of Statistical Software, 42(8), 1–28.
Dicke, T., Marsh, H. W., Parker, P. D., Pekrun, R., Guo, J., & Televantou, I. (2018). Effects Hocutt, A. M. (1996). Effectiveness of special education: Is placement the critical factor?
of school-average achievement on individual self-concept and achievement: The Future of Children, 6(1), 77–102. https://doi.org/10.2307/1602495.
Unmasking phantom effects masquerading as true compositional effects. Journal of Hornstra, L., Denessen, E., Bakker, J., van den Bergh, L., & Voeten, M. (2010). Teacher
Educational Psychology. https://doi.org/10.1037/edu0000259. attitudes toward dyslexia: Effects on teacher expectations and the academic
Dijkstra, P., Kuyper, H., van der Werf, G., Buunk, A. P., & van der Zee, Y. G. (2008). Social achievement of students with dyslexia. Journal of Learning Disabilities, 43, 515–529.
comparison in the classroom: A review. Review of Educational Research, 78, 828–879. https://doi.org/10.1177/0022219409355479.
https://doi.org/10.3102/0034654308321210. Jerusalem, M., Drössler, S., Kleine, D., Klein-Heßling, J., Mittag, W., & Röder, B. (2009).
Dixon, R. M., Seaton, M., & Dixon, R. J. (2008). The big fish strikes again but in a different Förderung von Selbstwirksamkeit und Selbstbestimmung. Skalen zur Erfassung von Lehrer
place: Social comparison theory and children with special needs. International Journal und Schülermerkmalen im Unterricht [Promoting self-efficacy and self-determination.

80
A. Kocaj et al. Contemporary Educational Psychology 55 (2018) 63–83

Documentation of survey instruments for teacher and student characteristics]. Berlin: be a relatively large fish in a small pond even if you don’t learn to swim as well?
Humboldt-Universität zu Berlin. Journal of Personality and Social Psychology, 47, 213–231. https://doi.org/10.1037/
Joncas, M., & Foy, P. (2012). Sample design in TIMSS and PIRLS. In M. O. Martin, & I. V. 0022-3514.47.1.213.
S. Mullis (Eds.). Methods and procedures in TIMSS and PIRLS 2011 (pp. 1–21). Chestnut Marsh, H. W., Seaton, M., Trautwein, U., Lüdtke, O., Hau, K. T., O’Mara, A. J., & Craven,
Hill, MA: TIMSS & PIRLS International Study Center, Boston College. R. G. (2008). The big-fish–little-pond-effect stands up to critical scrutiny:
Justice, L. M., Logan, J. A. R., Lin, T.-J., & Kaderavek, J. N. (2014). Peer effects in early Implications for theory, methodology, and future research. Educational Psychology
childhood education: Testing the assumptions of special-education inclusion. Review, 20, 319–350. https://doi.org/10.1007/s10648-008-9075-6.
Psychological Science, 25, 1722–1729. https://doi.org/10.1177/0956797614538978. Marsh, H. W., Tracey, D. K., & Craven, R. G. (2006). Multidimensional self-concept
KMK = Sekretariat der Ständigen Konferenz der Kultusminister der Länder in der structure for preadolescents with mild intellectual disabilities: A hybrid
Bundesrepublik Deutschland. (1998). Empfehlungen zum Förderschwerpunkt multigroup–MIMC approach to factorial invariance and latent mean differences.
Sprache [Recommendations on special educational support in speech]. Beschluss vom Educational and Psychological Measurement, 66, 795–818. https://doi.org/10.1177/
26.06.1998. Retrieved from < http://www.kmk.org/fileadmin/pdf/ 0013164405285910.
PresseUndAktuelles/2000/sprache.pdf > . Marsh, H. W., Trautwein, U., Lüdtke, O., Köller, O., & Baumert, J. (2005). Academic self-
KMK = Sekretariat der Ständigen Konferenz der Kultusminister der Länder in der concept, interest, grades, and standardized test scores: Reciprocal effects models of
Bundesrepublik Deutschland. (1999). Empfehlungen zum Förderschwerpunkt Lernen causal ordering. Child Development, 76, 397–416. https://doi.org/10.1111/j.1467-
[Recommendations on special educational support in learning]. Beschluss vom 01.10. 8624.2005.00853.x.
1999. Retrieved from < http://www.kmk.org/fileadmin/pdf/PresseUndAktuelles/ Marsh, H. W., & Yeung, A. S. (1998). Longitudinal structural equation models of academic
2000/sopale.pdf > . self-concept and achievement: Gender differences in the development of math and
KMK = Sekretariat der Ständigen Konferenz der Kultusminister der Länder in der English constructs. American Educational Research Journal, 35, 705–738. https://doi.
Bundesrepublik Deutschland. (2000). Empfehlungen zum Förderschwerpunkt emo- org/10.3102/00028312035004705.
tionale und soziale Entwicklung [Recommendations on special educational support in Marsh, H. W. (1990). Self Description Questionnaire – I (SDQ I). Manual. Macarthur, N.S.W.
emotional and social development]. Beschluss vom 10.03.2000. Retrieved from < Australia: University of Western Sydney.
http://www.kmk.org/fileadmin/pdf/PresseUndAktuelles/2000/emotsozentw. Martin, M. O., Mullis, I. V. S., & Foy, P. (Eds.). (2008). TIMSS 2007 international mathe-
pdf > . matics report. Findings from IEA’s Trends in International Mathematics and Science Study
KMK = Sekretariat der Ständigen Konferenz der Kultusminister der Länder in der at the fourth and eighth grades. Chestnut Hill, MA: TIMSS & PIRLS International Study
Bundesrepublik Deutschland. (2016). Sonderpädagogische Förderung in Schulen Center, Boston College.
2005 bis 2014 [Special educational needs support in schools from 2005 to 2014]. Martin, M. O., & Preuschoff, C. (2008). Creating the TIMSS 2007 background indices. In J.
Retrieved from < https://www.kmk.org/fileadmin/Dateien/pdf/Statistik/ F. Olson, M. O. Martin, & I. V. S. Mullis (Eds.). TIMSS 2007 Technical Report (pp. 281–
Dokumentationen/Dok_210_SoPae_2014.pdf > . 338). Chestnut Hill, MA: TIMSS & PIRLS International Study Center, Boston College.
KMK = Sekretariat der Ständigen Konferenz der Kultusminister der Länder in der McLeskey, J., & Waldron, N. L. (2002). Inclusion and school change: Teacher perceptions
Bundesrepublik Deutschland. (2017). The education system in the Federal Republic regarding curricular and instructional adaptations. Teacher Education and Special
of Germany 2014/2015. A description of the responsibilities, structures and devel- Education, 25, 41–54.
opments in education policy for the exchange of information in Europe. Retrieved Möller, J., Streblow, L., & Pohlmann, B. (2009). Achievement and self-concept of students
from < https://www.kmk.org/fileadmin/Dateien/pdf/Eurydice/Bildungswesen- with learning disabilities. Social Psychology of Education, 12, 113–122. https://doi.
engl-pdfs/dossier_en_ebook.pdf > . org/10.1007/s11218-008-9065-z.
Kocaj, A., Haag, N., Weirich, S., Kuhl, P., Pant, H. A., & Stanat, P. (2016). Aspekte der Mullis, I. V. S., Martin, M. O., Foy, P., Arora, A., & (Eds.). (2012). TIMSS 2011 international
Testgüte bei der Erfassung schulischer Kompetenzen von Schülerinnen und Schülern results in mathematics. Chestnut Hill, MA: TIMSS & PIRLS International Study Center,
mit sonderpädagogischem Förderbedarf [Test quality of school achievement tests for Boston College.
students with special educational needs]. In V. Moser & B. Lütje-Klose (Eds.), Muthén, L. K., & Muthén, B. O. (1998–2015). Mplus User’s Guide. Seventh Edition. Los
Schulische Inklusion. 62. Beiheft der Zeitschrift für Pädagogik (p. 212–234). Weinheim: Angeles, CA: Muthén & Muthén.
Beltz Juventa. Nagengast, B., Marsh, H. W., Scalas, L. F., Xu, M. K., Hau, K.-T., & Trautwein, U. (2011).
Kocaj, A., Kuhl, P., Kroth, A. J., Pant, H. A., & Stanat, P. (2014). Wo lernen Kinder mit Who took the “×” out of expectancy-value theory? A psychological mystery, a sub-
sonderpädagogischem Förderbedarf besser? Ein Vergleich schulischer Kompetenzen stantive-methodological synergy, and a cross-national generalization. Psychological
zwischen Regel- und Förderschulen in der Primarstufe [Where do children with Science, 22, 1058–1066. https://doi.org/10.1177/0956797611415540.
special educational needs learn better? A comparison between regular primary Nusser, L., Carstensen, C. H., & Artelt, C. (2015). Befragung von Schülerinnen und
schools and special schools]. Kölner Zeitschrift für Soziologie und Sozialpsychologie, 66, Schülern mit sonderpädagogischem Förderbedarf Lernen: Ergebnisse zur
165–191. https://doi.org/10.1007/s11577-014-0253-x. Messinvarianz [Questionnaires for students with special educational needs in the area
Köller, O., Trautwein, U., Lüdtke, O., & Baumert, J. (2006). Zum Zusammenspiel von of learning: Results from multi-group analysis]. Empirische Sonderpädagogik, 7,
schulischer Leistung, Selbstkonzept und Interesse in der gymnasialen Oberstufe [On 99–116.
the interplay of academic achievement, self-concept, and interest in upper secondary Nusser, L., Heydrich, J., Carstensen, C. H., Artelt, C., & Weinert, S. (2016). Validity of
schools]. Zeitschrift für Pädagogische Psychologie, 20, 27–39. https://doi.org/10.1024/ survey data of students with special educational needs— results from the National
1010-0652.20.1.27. Educational Panel Study. In H.-. P. Blossfeld, J. von Maurice, M. Bayer, & J. Skopek
Lane, S., & Leventhal, B. (2015). Psychometric challenges in assessing English language (Eds.). Methodological issues of longitudinal surveys: The example of the National
learners and students with disabilities. Review of Research in Education, 39, 165–214. Educational Panel Study (pp. 251–266). Wiesbaden: Springer VS. https://doi.org/10.
https://doi.org/10.3102/0091732X14556073. 1007/978-3-658-11994-2_15.
LeRoy, B. W., Samuel, P., Deluca, M., & Evans, P. (2018). Students with special educa- Nusser, L., & Wolter, I. (2016). There’s plenty more fish in the sea: Das akademische
tional needs within PISA. Assessment in Education: Principles, Policy & Practice. doi: Selbstkonzept von Schülerinnen und Schülern mit sonderpädagogischem
10.1080/0969594X.2017.1421523. Förderbedarf Lernen in integrativen und segregierten Schulsettings [There’s plenty
Lindsay, G. (2007). Educational psychology and the effectiveness of inclusive education/ more fish in the sea. Academic self-concept of students with special educational needs
mainstreaming. British Journal of Educational Psychology, 77, 1–24. https://doi.org/ in the area of learning in inclusive and segregated school settings]. Empirische
10.1348/000709906X156881. Pädagogik, 30, 130–143.
Lüdtke, O., Köller, O., Marsh, H. W., & Trautwein, U. (2005). Teacher frame of reference OECD (1999). Classifying educational programmes. Manual for ISCED-97 implementation in
and the big-fish–little-pond effect. Contemporary Educational Psychology, 30, 263–285. OECD countries. Paris: Organisation for Economic Co-operation and Development.
https://doi.org/10.1016/j.cedpsych.2004.10.002. OECD (2014). PISA 2012 technical report. Paris: OECD Publishing.
Lüdtke, O., Marsh, H. W., Robitzsch, A., Trautwein, U., Asparouhov, T., & Muthén, B. Patrick, H., Ryan, A. M., & Kaplan, A. (2007). Early adolescents’ perceptions of the
(2008). The multilevel latent covariate model: A new, more reliable approach to classroom social environment, motivational beliefs, and engagement. Journal of
group-level effects in contextual studies. Psychological Methods, 13, 203–229. https:// Educational Psychology, 99, 83–98. https://doi.org/10.1037/0022-0663.99.1.83.
doi.org/10.1037/a0012869. Peetsma, T., Vergeer, M., Roeleveld, J., & Karsten, S. (2001). Inclusion in education:
Margalit, M., & Efrati, M. (1996). Loneliness, coherence and companionship among Comparing pupils’ development in special and regular education. Educational Review,
children with learning disorders. Educational Psychology, 16, 69–79. https://doi.org/ 53, 125–135. https://doi.org/10.1080/00131910125044.
10.1080/0144341960160106. Pekrun, R. (1992). The impact of emotions on learning and achievement: Towards a
Marsh, H. W. (1986). Verbal and math self-concepts: An internal/external frame of re- theory of cognitive/motivational mediators. Applied Psychology, 41, 359–376.
ference model. American Educational Research Journal, 23, 129–149. https://doi.org/ https://doi.org/10.1111/j.1464-0597.1992.tb00712.x.
10.3102/00028312023001129. Pekrun, R. (2000). A social-cognitive, control-value theory of achievement emotions. In J.
Marsh, H. W. (1987). The big-fish-little-pond effect on academic self-concept. Journal of Heckhausen (Ed.). Advances in psychology, 131. Motivational psychology of human de-
Educational Psychology, 79, 280–295. https://doi.org/10.1037/0022-0663.79.3.280. velopment: Developing motivation and motivating development (pp. 143–163). New York,
Marsh, H. W., Kong, C. K., & Hau, K. T. (2000). Longitudinal multilevel models of the big- NY: Elsevier.
fish-little-pond effect on academic self-concept: Counterbalancing contrast and re- Pekrun, R., Goetz, T., Frenzel, A. C., Barchfeld, P., & Perry, R. P. (2011). Measuring
flected-glory effects in Hong Kong schools. Journal of Personality and Social emotions in students’ learning and performance: The Achievement Emotions
Psychology, 78, 337–349. https://doi.org/10.1037/0022-3514.78.2.337. Questionnaire (AEQ). Contemporary Educational Psychology, 36, 36–48. https://doi.
Marsh, H. W., Lüdtke, O., Robitzsch, A., Trautwein, U., Asparouhov, T., Muthén, B., & org/10.1016/j.cedpsych.2010.10.002.
Nagengast, B. (2009). Doubly-latent models of school contextual effects: Integrating Pekrun, R., Goetz, T., Titz, W., & Perry, R. P. (2002). Academic emotions in students’ self-
multilevel and structural equation approaches to control measurement and sampling regulated learning and achievement: A program of qualitative and quantitative re-
error. Multivariate Behavioral Research, 44, 764–802. https://doi.org/10.1080/ search. Educational Psychologist, 37, 91–105. https://doi.org/10.1207/
00273170903333665. S15326985EP3702_4.
Marsh, H. W., & Parker, J. W. (1984). Determinants of student self-concept: Is it better to Pfahl, L., & Powell, J. J. W. (2011). Legitimating school segregation. The special

81
A. Kocaj et al. Contemporary Educational Psychology 55 (2018) 63–83

education profession and the discourse of learning disability in Germany. Disability & 10.3102/00346543046003407.
Society, 26, 449–462. https://doi.org/10.1080/09687599.2011.567796. Skinner, E. A., & Belmont, M. J. (1993). Motivation in the classroom: Reciprocal effects of
Pijl, S. J., & Frostad, P. (2010). Peer acceptance and self-concept of students with dis- teacher behavior and student engagement across the school year. Journal of
abilities in regular education. European Journal of Special Needs Education, 25, Educational Psychology, 85, 571–581. https://doi.org/10.1037/0022-0663.85.4.571.
93–105. https://doi.org/10.1080/08856250903450947. Slavin, R. E. (1996). Research on cooperative learning and achievement: What we know,
Powell, J. J. W. (2009). To segregate or to separate? Special education expansion and what we need to know. Contemporary Educational Psychology, 21, 43–69. https://doi.
divergence in the United States and Germany. Comparative Education Review, 53, org/10.1006/ceps.1996.0004.
161–187. https://doi.org/10.1086/597816. Song, J., Bong, M., Lee, K., & Kim, S. (2015). Longitudinal investigation into the role of
R Core Team. (2015). R: A language and environment for statistical computing. Vienna, perceived social support in adolescents’ academic motivation and achievement.
Austria: R Foundation for Statistical Computing. Retrieved from URL < https:// Journal of Educational Psychology, 107, 821–841. https://doi.org/10.1037/
www.R-project.org/ > . edu0000016.
Rauer, W., & Schuck, K. D. (2003). Fragebogen zur Erfassung emotionaler und sozialer Spörer, N., Maaz, K., Vock, M., Schründer-Lenzen, A., Luka, T., Bosse, S., ... Jäntsch, C.
Schulerfahrungen von Grundschulkindern dritter und vierter Klassen (FEESS 3–4) (2015). Lernen in der inklusiven Grundschule: Zusammenhänge zwischen fachlichen
[Questionnaire assessing emotional and social experiences of third and fourth graders]. Kompetenzen, Sozialklima und Facetten des Selbstkonzepts [Students’ learning in
Göttingen: Beltz Test. inclusive primary schools: Relations between academic performance, social climate,
Renick, M. J., & Harter, S. (1989). Impact of social comparisons on the developing self- and academic and social self-concept]. Unterrichtswissenschaft, 43, 22–35.
perceptions of learning disabled students. Journal of Educational Psychology, 81, Stanat, P., Pant, H. A., Böhme, K., Richter, D., Weirich, S., Haag, N., Roppelt, A.,
631–638. https://doi.org/10.1037/0022-0663.81.4.631. Engelbert, M. & Reimers, H. (2014): IQB Ländervergleich Primarstufe 2011 (IQB-LV
Reyes, M. R., Brackett, M. A., Rivers, S. E., White, M., & Salovey, P. (2012). Classroom 2011). Version: 2. IQB – Institut zur Qualitätsentwicklung im Bildungswesen.
emotional climate, student engagement, and academic achievement. Journal of Dataset. http://doi.org/10.5159/IQB_LV_2011_v2.
Educational Psychology, 104, 700–712. https://doi.org/10.1037/a0027268. Stanat, P., Pant, H. A., Böhme, K., & Richter, D. (Eds.). (2012). Kompetenzen von
Richter, D., Böhme, K., Bastian-Wurzel, J., Pant, H. A., & Stanat, P. (2014). IQB- Schülerinnen und Schülern am Ende der vierten Jahrgangsstufe in den Fächern Deutsch und
Ländervergleich 2011. Skalenhandbuch zur Dokumentation der Erhebungsinstrumente Mathematik: Ergebnisse des IQB-Ländervergleichs 2011 [Student competencies in German
[IQB National Assessment Study 2011. Documentation of survey instruments]. Berlin: and mathematics at the end of the 4th grade: Results of the IQB National Assessment Study
Humboldt-Universität zu Berlin, Institut zur Qualitätsentwicklung im Bildungswesen. 2011]. Münster: Waxmann.
Roppelt, A., & Reiss, K. (2012). Die im Ländervergleich 2011 in den Fächern Deutsch und Steinmetz, H. (2013). Analyzing observed composite differences across groups: Is partial
Mathematik untersuchten Kompetenzen: Beschreibung der im Fach Mathematik un- measurement invariance enough? Methodology: European Journal of Research Methods
tersuchten Kompetenzen [Competencies in German and mathematics examined in the for the Behavioral and Social Sciences, 9, 1–12. https://doi.org/10.1027/1614-2241/
National Assessment Study 2011: Description of the competencies in mathematics]. a000049.
In P. Stanat, H. A. Pant, K. Böhme, & D. Richter (Eds.). Kompetenzen von Schülerinnen Stuart, E. A. (2010). Matching methods for causal inference: A review and a look forward.
und Schülern am Ende der vierten Jahrgangsstufe in den Fächern Deutsch und Mathematik: Statistical Science, 25, 1–21. https://doi.org/10.1214/09-STS313.
Ergebnisse des IQB-Ländervergleichs 2011 (pp. 34–44). Münster: Waxmann. Stuart, E. A., & Green, K. M. (2008). Using full matching to estimate causal effects in
Rose, C. A., Monda-Amaya, L. E., & Espelage, D. L. (2011). Bullying perpetration and nonexperimental studies: Examining the relationship between adolescent marijuana
victimization in special education: A review of the literature. Remedial and Special use and adult outcomes. Developmental Psychology, 44, 395–406. https://doi.org/10.
Education, 32, 114–130. https://doi.org/10.1177/0741932510361247. 1037/0012-1649.44.2.395.
Rosenbaum, P. R., & Rubin, D. B. (1983). The central role of the propensity score in Televantou, I., Marsh, H. W., Kyriakides, L., Nagengast, B., Fletcher, J., & Malmberg, L.-E.
observational studies for causal effects. Biometrika, 70, 41–55. https://doi.org/10. (2015). Phantom effects in school composition research: Consequences of failure to
1093/biomet/70.1.41. control biases due to measurement error in traditional multilevel models. School
Rosenbaum, P. R., & Rubin, D. B. (1985). Constructing a control group using multivariate Effectiveness and School Improvement, 26, 75–101. https://doi.org/10.1080/
matched sampling methods that incorporate the propensity score. The American 09243453.2013.871302.
Statistician, 39, 33–38. https://doi.org/10.1080/00031305.1985.10479383. Trautwein, U., Lüdtke, O., Marsh, H. W., Köller, O., & Baumert, J. (2006). Tracking,
Roy, A., Guay, F., & Valois, P. (2015). The big-fish–little-pond effect on academic self- grading, and student motivation: Using group composition and status to predict self-
concept: The moderating role of differentiated instruction and individual achieve- concept and interest in ninth-grade mathematics. Journal of Educational Psychology,
ment. Learning and Individual Differences, 42, 110–116. https://doi.org/10.1016/j. 98, 788–806. https://doi.org/10.1037/0022-0663.98.4.788.
lindif.2015.07.009. Trautwein, U., Lüdtke, O., Marsh, H. W., & Nagy, G. (2009). Within-school social com-
Ruijs, N. M., & Peetsma, T. T. D. (2009). Effects of inclusion on students with and without parison: How students perceive the standing of their class predicts academic self-
special educational needs reviewed. Educational Research Review, 4, 67–79. https:// concept. Journal of Educational Psychology, 101, 853–866. https://doi.org/10.1037/
doi.org/10.1016/j.edurev.2009.02.002. a0016306.
Ruijs, N., Peetsma, T., & van der Veen, I. (2010). The presence of several students with United Nations General Assembly (UN). Convention on the Rights of Persons with
special educational needs in inclusive education and the functioning of students with Disabilities, Pub. L. No. A/RES/61/106, Annex I (2006). Retrieved from < http://
special educational needs. Educational Review, 62, 1–37. https://doi.org/10.1080/ www.refworld.org/docid/4680cd212.html > .
00131910903469551. Urdan, T., & Schoenfelder, E. (2006). Classroom effects on student motivation: Goal
Russell, S. L. (2012). Individual- and classroom-level social support and classroom behavior in structures, social relationships, and competence beliefs. Journal of School Psychology,
middle school (Doctoral dissertation). Retrieved from < http://drum.lib.umd.edu/ 44, 331–349. https://doi.org/10.1016/j.jsp.2006.04.003.
handle/1903/13204 > . Van de Schoot, R., Lugtig, P., & Hox, J. (2012). A checklist for testing measurement
Salend, S. J., & Duhaney, L. M. G. (1999). The impact of inclusion on students with and invariance. European Journal of Developmental Psychology, 9, 486–492. https://doi.
without disabilities and their educators. Remedial and Special Education, 20, 114–126. org/10.1080/17405629.2012.686740.
https://doi.org/10.1177/074193259902000209. Vaughn, S., Elbaum, B. E., & Schumm, J. S. (1996). The effects of inclusion on the social
Sälzer, C., Gebhardt, M., Müller, K., & Pauly, E. (2015). Der Prozess der Feststellung functioning of students with learning disabilities. Journal of Learning Disabilities, 29,
sonderpädagogischen Förderbedarfs in Deutschland [The process of determining 598–608.
special educational needs in Germany]. In P. Kuhl, P. Stanat, B. Lütje-Klose, C. Vaughn, S., Haager, D., Hogan, A., & Kouzekanani, K. (1992). Self-concept and peer ac-
Gresch, H. A. Pant, & M. Prenzel (Eds.). Inklusion von Schülerinnen und Schülern mit ceptance in students with learning disabilities: A four- to five-year prospective study.
sonderpädagogischem Förderbedarf in Schulleistungserhebungen (pp. 129–152). Journal of Educational Psychology, 84, 43–50. https://doi.org/10.1037/0022-0663.84.
Wiesbaden: Springer VS. 1.43.
Sansour, T., & Bernhard, D. (2018). Special needs education and inclusion in Germany Wang, M.-T., & Eccles, J. S. (2013). School context, achievement motivation, and aca-
and Sweden. Alter, European Journal of Disability Research, 1–13. https://doi.org/10. demic engagement: A longitudinal study of school engagement using a multi-
1016/j.alter.2017.12.002. dimensional perspective. Learning and Instruction, 28, 12–23. https://doi.org/10.
Savage, R. (2005). Friendship and bullying patterns in children attending a language base 1016/j.learninstruc.2013.04.002.
in a mainstream school. Educational Psychology in Practice, 21, 23–36. Warm, T. A. (1989). Weighted likelihood estimation of ability in item response theory.
Schurtz, I. M., Pfost, M., Nagengast, B., & Artelt, C. (2014). Impact of social and di- Psychometrika, 54, 427–450.
mensional comparisons on student’s mathematical and English subject-interest at the Weirich, S., Haag, N., & Roppelt, A. (2012). Testdesign und Auswertung des
beginning of secondary school. Learning and Instruction, 34, 32–41. https://doi.org/ Ländervergleichs: Technische Grundlagen [Test design and scaling of the National
10.1016/j.learninstruc.2014.08.001. Assessment Study: Technical foundations]. In P. Stanat, H. A. Pant, K. Böhme, & D.
Schwab, S. (2015). Social dimensions of inclusion in education of 4th and 7th grade Richter (Eds.). Kompetenzen von Schülerinnen und Schülern am Ende der vierten
pupils in inclusive and regular classes: Outcomes from Austria. Research in Jahrgangsstufe in den Fächern Deutsch und Mathematik: Ergebnisse des IQB-
Developmental Disabilities, 43–44, 72–79. https://doi.org/10.1016/j.ridd.2015.06. Ländervergleichs 2011 (pp. 277–290). Münster: Waxmann.
005. Wentzel, K. R. (1998). Social relationships and motivation in middle school: The role of
Scruggs, T. E., Mastropieri, M. A., & Marshak, L. (2012). Peer-mediated instruction in parents, teachers, and peers. Journal of Educational Psychology, 90, 202–209. https://
inclusive secondary social studies learning: Direct and indirect learning effects. doi.org/10.1037/0022-0663.90.2.202.
Learning Disabilities Research & Practice, 27, 12–20. https://doi.org/10.1111/j.1540- Wentzel, K. R., Battle, A., Russell, S. L., & Looney, L. B. (2010). Social supports from
5826.2011.00346.x. teachers and peers as predictors of academic and social motivation. Contemporary
Scruggs, T. E., Mastropieri, M. A., & McDuffie, K. A. (2007). Co-teaching in inclusive Educational Psychology, 35, 193–202. https://doi.org/10.1016/j.cedpsych.2010.03.
classrooms: A metasynthesis of qualitative research. Exceptional Children, 73, 002.
392–416. https://doi.org/10.1177/001440290707300401. Wheeler, L., & Suls, J. (2005). Social comparison and self-evaluations of competence. In
Shavelson, R. J., Hubner, J. J., & Stanton, G. C. (1976). Self-concept: Validation of con- A. J. Elliot, & C. S. Dweck (Eds.). Handbook of competence and motivation (pp. 566–
struct interpretations. Review of Educational Research, 46, 407–441. https://doi.org/ 578). New York, NY, US: Guilford Publications.

82
A. Kocaj et al. Contemporary Educational Psychology 55 (2018) 63–83

Wiener, J., & Tardif, C. Y. (2004). Social and emotional functioning of children with Contemporary Educational Psychology, 25, 68–81. https://doi.org/10.1006/ceps.1999.
learning disabilities: Does special education placement make a difference? Learning 1015.
Disabilities Research & Practice, 19, 20–32. https://doi.org/10.1111/j.1540-5826. Zeidner, M., & Schleyer, E. J. (1999). The big-fish–little-pond effect for academic self-
2004.00086.x. concept, test anxiety, and school grades in gifted children. Contemporary Educational
Wigfield, A. (1994). Expectancy-value theory of achievement motivation: A develop- Psychology, 24, 305–329. https://doi.org/10.1006/ceps.1998.0985.
mental perspective. Educational Psychology Review, 6, 49–78. https://doi.org/10. Zigmond, N. (2003). Where should students with disabilities receive special education
1007/BF02209024. services? Is one place better than another? The Journal of Special Education, 37,
Wigfield, A., & Eccles, J. S. (2000). Expectancy–value theory of achievement motivation. 193–199. https://doi.org/10.1177/0022466903037003090.

83

You might also like