Download as pdf or txt
Download as pdf or txt
You are on page 1of 11

International Journal of Educational Development 46 (2016) 103–113

Contents lists available at ScienceDirect

International Journal of Educational Development


journal homepage: www.elsevier.com/locate/ijedudev

Students’ skipping behavior on truancy items and (school) subjects


and its relation to test performance in PISA 2012
Christine Sälzer *, Jörg-Henrik Heine
TUM School of Education, Center for International Student Assessment (ZIB), Munich, Germany

A R T I C L E I N F O A B S T R A C T

Article history: Most large-scale student assessments focus on cognitive competences which are assumed to be acquired
Received 2 July 2015 at school. This study investigates how skipping lessons on purpose is related to student achievement in
Received in revised form 30 October 2015 the PISA 2012 competence test (mathematics, reading and science). First, a Rasch-residual factor analysis
Accepted 31 October 2015
is carried out on the truancy scale in order to discover the dimensionality of truancy as a latent construct.
Available online 2 December 2015
Second, the PISA proficiency score in each of the three competence domains is predicted using a set of
control variables plus the subject-specific truancy. The main findings are that subject-specific truancy
Keywords:
comprises four dimensions and that skipping certain school subjects goes along with a lower proficiency
Subject-specific truancy
Dimensionality
in the corresponding PISA domains. This is most obvious in mathematics and science, where students
PISA who choose the most extreme response category (skipped ‘3 times and more’) score about 40 or,
Achievement respectively, 38 points less than their non-truant classmates.
ß 2015 Elsevier Ltd. All rights reserved.

Most large-scale student assessments implicitly make two So far, the association between class attendance and student
assumptions: first, they suppose that the proficiency measured by performance has mostly been studied using school grades or
the achievement tests is mainly acquired at school. This holds exams as a measure for student achievement (e.g. Malcolm et al.,
especially true when student assessments focus on competencies 1996; Stamm, 2010). Nevertheless, using school exams may
relating to school subjects, such as mathematics or science. Second, generate biased outcomes because they depend on national or
these studies mostly measure cognitive outcomes like student regional curricula. In our study, we measure student achievement
achievement and assume that this is a valid measure of school by the PISA 2012 proficiency scales in mathematics, science and
effectiveness. While both assumptions are plausible and true in reading as standardized, cross-curricular scales. Our leading
many cases, there is more to large-scale student assessments as we research question is whether subject-specific truancy is related
have them today. For one, they measure more than just cognitive to student achievement in the corresponding competence domains
outcomes and the role of context questionnaires is nowadays more in PISA 2012. First, we determine whether subject-specific truancy
important than it used to be (OECD, 2013a) and will become even as a scale comprises more than one dimension by a Rasch-residual
more important in the future (OECD, 2013c). These assumptions are factor analysis. Subsequently, we predict student achievement in
further limited by the fact that when students skip classes on purpose the PISA competence domains of mathematics, science and reading
(i.e. they play truant), they refrain from taking the opportunity to by linear regression models including subject-specific truancy in
learn subject matters at school. Other than days at school missed due the corresponding school subjects.
to illness, skipped classes are missed intentionally and the subjects
students select for skipping may be related to students’ achievement 1. Truancy: declining school classes as an opportunity to learn
in these subjects, but also to individual characteristics such as
subject-specific self-concept or effort. At the same time, students Skipping classes or skipping school is generally referred to as
who skip one subject may be more likely to skip other subjects as truancy or truant behavior (Malcolm et al., 1996; Veenstra et al.,
well. And yet, students who play truant achieve not necessarily lower 2010). This usually involves an active decision of the student
than students who do not (Renzulli and Park, 2000). without having an acceptable or legally justified reason such as an
illness or a family emergency. In line with Wilson et al. (Wilson
et al., 2008), we define truancy as ‘‘absences which pupils
* Corresponding author. themselves indicated would be unacceptable to teachers’’ (p. 3).
E-mail address: christine.saelzer@tum.de (C. Sälzer). Most studies capture student truancy as a global behavior that has

http://dx.doi.org/10.1016/j.ijedudev.2015.10.009
0738-0593/ß 2015 Elsevier Ltd. All rights reserved.
104 C. Sälzer, J.-H. Heine / International Journal of Educational Development 46 (2016) 103–113

a certain degree, e.g. never, occasional or frequent, but they do not From a methodological point of view, studies dealing with
distinguish single school subjects (Vaughn et al., 2013). Consider- student truancy often face two major challenges: first, students’
ing that skipping single lessons is quite common among students self-reports are the most reliable source of data since only the
at the lower secondary level (Veenstra et al., 2010), the need for students themselves know when they have played truant. Other
disentangling the broad concept of truancy and taking a closer look data sources, such as observations or school records, bear quite a
into subject-specific truancy is obvious. high risk of being biased. This implies that the students to be
Conceptualizing lessons at school as an offer that can be used by surveyed need to be non-truant at the time of the data collection
students, we refer to a model often used in large-scale student and researchers have to rely on the students answering honestly.
assessments (e.g. Helmke and Schrader, 2013). Key to this concept Second, most studies at hand define truancy quite broadly and
is that lessons take place while students have to actively make use merely use single items to ask whether or not a student has played
of them and learn. Of course, students have to attend the lessons in truant within a given period of time (e.g. two school weeks, as
order to be able to do so. This assumption that lessons are an offer implemented in the PISA study in OECD, 2013b). When researchers
holds true, even though in many countries schooling is compulsory want to know more about student truancy and its relatedness to
for a certain age range. Taking into account the legal norm of school several factors within and around the student, measuring the
attendance only, truancy should not exist. However, numerous concept of truant behavior becomes difficult. To date, only little is
studies have shown that students skip classes without a proper known both about the subject-related dimensionality of truancy as
leave all over the world (e.g. OECD, 2013b; Reid, 2003; Veenstra a scale and the association of subject-specific truancy and student
et al., 2010). achievement in these skipped school subjects. Among the
As students in the PISA cohort are 15 years old and have been assessment domains in PISA (Reading, Mathematics and Science),
attending school for about a decade, truancy cannot be reasonably we find that reading competence is by far more general and
studied without considering a certain selectivity of students’ ubiquitous than mathematical or scientific competence. Due to
truant behavior. This selectivity is prone to have at least two this broad variance with regard to opportunities to learn inside and
implications: First, students have developed preferences regarding outside school, we chose the PISA domains in order to compare
their school subjects, they have selected their favorite subjects and their relationship with subject-specific truancy in Mathematics,
teachers and other subjects which they like less or even dislike. Science and Reading in the language of test (in our case, German).
These preferences may be reflected by students’ academic
achievement or performance at school. Student performance or 2. Sample and sampling procedure
academic achievement is a part of students’ school biography that
intuitively seems to be negatively related to truant behavior: The The participants of our study were the PISA 2012 sample of 15-
worse a student does at school, the more he or she will play truant year-old students in Germany (n = 5001). Students were sampled
(Vaughn et al., 2013). Second, this selectivity may bias the results as a stratified random sample according to the international
of studies tackling the association between truancy and academic sampling definitions (Heine et al., 2013). First, a so-called sampling
achievement or even alter the interpretation of empirical findings. frame consisting of a complete list of all schools possibly attended
When truancy is studied empirically by collecting students’ by 15-year-old students was established. In order to obtain a
answers to a questionnaire, one obvious problem is that those sample representative for the population of 15-year-old students
students who are absent during the time when the questionnaire is attending a school in their respective country of test, each country
completed will not be included in the database although their non- is divided into several areas, so-called explicit strata. A stratum is a
attendance indicates that they are exactly in the focus of the study. partition of the population which is defined according to national
When students with a possibly high score on truancy are not specifications that may have an impact on the representativity of
present in the database, the results are likely to be underestimated the results (OECD, 2014a). In Germany, the federal structure of the
due to an artificially reduced variance. Another issue that needs to educational system made it necessary to define a stratum for each
be taken into account is that truancy is a behavior that is socially of the 16 federal states. The participating students attended one of
undesirable on the one hand and a prevalent part of adolescent five lower secondary school types: a Gymnasium, which is the only
behavior on the other (Sälzer et al., 2012), and may therefore secondary school type that is prevalent in all 16 federal states in
involve both concealment and exaggeration by the respondents. Germany and represents a merely academic track, a Realschule
Furthermore, the association of truant behavior and student (middle school), a Hauptschule (lower secondary school) or one of
academic achievement needs to be carefully investigated so that a two comprehensive school types (integrated or cooperative
possible collinearity does not affect the results. While student comprehensive school with within-school tracking or within-
performance can often not be fully separated from immigration school streaming).
status or SES, the predictive value of academic achievement as an Conceptually, only Gymnasium schools have a common history
indicator of truancy is highly dependable on the model and and curriculum within Germany, whereas the other four school
technique used for data analysis. Especially two studies carefully types vary in terms of their history and curricula across the
examined the relationship of academic achievement and truancy, 16 federal states. According to this multi-tier school system, the
controlling for a differentiated background model. Henry and explicit strata representing federal states were subdivided into
Huizinga (2007) looked at the characteristics of 8th and 10th graders implicit strata so that in each federal state, all prevalent school
who were playing truant and showed that high academic types were present in the sample (OECD, 2014a) and Gymnasium
achievement was related to low truancy rates. In a recent schools were separated from non-Gymnasium schools.
longitudinal study, Veenstra et al. (2010) investigated a sample of Based on this stratification, a random sample of schools was
2230 Dutch students, five percent of which were persistent truants, drawn within each stratum (federal state). Within each school,
their parents and teachers. The authors were able to show that most 25 students were randomly selected for participation. All students
of the persistent truants had low academic achievement. Referring were born in the year 1996, as per birth cohort definition of the PISA
to this finding, we tackle two research questions in the current 2012 assessment framework (OECD, 2013a). 51 percent of the
study: (1) Is truancy a multidimensional construct that can be students were female and 14 percent had an immigrant background.
captured by students selectively skipping certain school subjects? More than half of the students born in 1996 attended grade 9,
(2) How does subject-specific truancy relate to student achievement 37 percent attended grade 10 and only small proportions attended
in the corresponding competence domains in the PISA 2012 test? grade 7, 8 or 11. This relatively high range recurs to the
C. Sälzer, J.-H. Heine / International Journal of Educational Development 46 (2016) 103–113 105

grade-retention policy in Germany, where according to the PISA and science according to the international scaling procedures. All
2012 data, one in five students at age 15 has at least once repeated a other variables were collected through the student questionnaire
grade during their school career (OECD, 2014b; Sälzer et al., 2013). and, where possible, compared to the student tracking form, which
Student participation in the PISA test was completely tracked and had been filled out by the PISA school coordinator. In addition to the
documented. While a student tracking form collected demographic internationally administered questions asking students about (a)
and school-related information for each student (e.g. grade, sex, arriving late for school, (b) skipping single lessons or (c) skipping
school track), test administrators completed so-called session school days within the last two full school weeks prior to the PISA
reports to document the participation in both the PISA test and test, the German sample was asked more specifically about their
the following student questionnaire. Absent or non-participating playing truant. All the truancy questions referred to the current
students received a respective code in the session report to indicate school year, which at the time of data collection had been going on
the reason for their non-participation. Such reasons included for approximately 8 months. This takes into account that in order to
student mobility and thus enrollment at a different school, late obtain valid data, students must have had a realistic chance to skip
arrival, illness or general absence. In cases where students were not classes before completing the questionnaire. Students were asked to
present at the PISA testing day, follow-up sessions were scheduled to indicate the number of times they had intentionally skipped certain
finally include the missing students. Out of the originally drawn school subjects in the current school year. Subject-specific truancy
5454 students, 389 were coded as absent both at the PISA testing day was measured by questions referring to six subjects. Five of them
and the follow-up session, 182 girls and 207 boys. Since the risk of correspond to the PISA assessment domains of reading, mathematics
biased results in international large-scale assessments like PISA is and science. Science in Germany is taught as three separate subjects,
quite high due to several factors related to student non-participa- i.e. biology, chemistry and physics. Taking into account that physical
tion, the data in PISA are weighted to compensate for non- education (PE) lessons are usually the most ‘popular’ subject to
participation both at the student and the school level. In doing so, truant from (Fischer, 1989), we also included PE in our list. In order to
the fact that a random sample means that students in larger schools operationalize students’ socio-economic status, we used Ganze-
have a lower probability of being drawn into the sample than boom’s International Socio-Economic Index (ISEI) (Ganzeboom, 2010),
students in smaller schools can be controlled for. By weighting the applying the highest value per family (either mother or father,
data, they are adjusted according to the sampling procedure and HISEI). Since student self-reports on their parent’s occupation bears
the actual participation of schools and students drawn into the some uncertainty with regard to the validity of the data (Wardle,
sample. In other words, when less students than originally planned 2002), several instances of control are used in PISA. First, the student
participate in PISA, selection bias can be minimized by assigning responses are to be coded according to the ISCO system (Interna-
each of the participating students a weight indicating how many tional Standard Classification of Occupations, Ganzeboom, 2010)
other students in their stratum they represent (OECD, 2014a). That and the coders undergo a thorough training. Each student response
way, one can assume that the final database for the German PISA is coded by two coders and then refereed by an expert coder. Second,
sample is not biased due to students not participating at the PISA in order to take into account that the mentioned validity issues recur
2012 survey as a whole. However, carrying out these weighting not only to the coding, but to the student responses as well, the
procedures does not automatically mean that no additional bias German student questionnaire added two more questions about
might occur due to students selectively skipping specific parts (e.g. what exactly parents do in their professional occupation. This
some items or even whole subscales) of the questionnaires. Thus, information can be used to generate EGP-classes (named after
prior to any analyses, one has to examine carefully all possibly Erikson et al., 1979) expressing social situations depending on
existing patterns of missing values on the scales under study, which income, education and recognition, but also to validate student
is discussed and outlined in the third part of the subsequent method responses about parental occupation that otherwise would be
section of this paper (Section 3.3). ambivalent.
As to the immigrant status, we used the students’ response
3. Method indicating whether they were born in Germany or abroad and
defined three groups: students without immigrant status, students
3.1. Procedure with immigrant status and students with unspecified immigrant
status (i.e. missing values).
In order to collect self-reported data on truancy, the PISA
2012 student questionnaire that followed the PISA test session was 3.3. Handling of missing data on the truancy scale
enhanced by a set of national extra questions on truancy. Trained
test administrators guided the students through the survey Since truancy is a research topic that is sensitive to social
following a standardized manual that is binding for all countries desirability and individual response behavior, a closer look into
participating in PISA. Students were informed that their names and possible patterns of missing data is required. After adjusting
data are at no point retrievable by the PISA project management, so students who were fully absent during the PISA test by the
that they felt free to answer honestly. Teachers that were in the weighting procedure described above, one needs to take into
room to support the test administrator in case of emergency were account that missing values within participating students are likely
asked not to walk around in the classroom and avoid contact with to occur. In case there are certain response patterns, they need to be
students in order not to interfere with their completing the test taken into account for all related data analyses. Therefore, we
and questionnaire. Immediately after finishing the questionnaire, screened the data matrix with regard to missing responses, i.e.
the test administrator collected all documents and packed them for truancy items which have been skipped. The analysis of missing
shipping to the PISA National Center. values on the six subject-specific truancy items was conducted
according to two different approaches. Precedent to both
3.2. Instruments approaches, a dichotomous indicator variable for missing values
on every truancy item was formed and coded ‘1’ for a missing value
The students’ proficiency level in PISA mathematics, reading and and ‘0’ for a valid response. Based on these indicator variables, we
science was measured using the PISA 2012 competence test. Five first analyzed the structure of the potential patterns of missing
plausible values (PV) were assigned to each student (OECD, 2012) in values following the person-centered statistical approach of the
order to estimate the average competence in mathematics, reading Configural Frequency Analysis (CFA – cf. Krauth, 1973; Lienert and
106 C. Sälzer, J.-H. Heine / International Journal of Educational Development 46 (2016) 103–113

Krauth, 1975; Stemmler, 2014). Based on the results indicating these two categories were collapsed prior to IRT scaling.
the dimensionality of subject-specific truancy, the analysis of the Cronbach’s alpha as an indicator of internal consistency based
missing data patterns were conducted in two steps using the on Classical Test Theory (CTT) was computed as well as the
R-package confreq (Heine, 2015) of the statistical software R coefficient of the weighted least square estimates’ (WLE) reliability
(R Development Core Team, 2014). Initially, the missing pattern based on the assumptions of IRT scaling. Following the one-
for the set of the three science-subject truancy items was analyzed. dimensional scaling approach, we conducted a Rasch-residual
Based on these results, the missing pattern for the set of the truancy factor analysis (Linacre, 1998) using the scale measuring truancy
items for German, mathematics and physical education followed, by a set of subject-specific items in order to analyze the
including a new missing indicator variable related to the truancy dimensionality of truancy. Rasch-residual factor analysis is an
(sub-)scale consisting of the three science truancy items (biology, approach looking for patterns in the part of the data which does not
chemistry and physics). conform to the Rasch-measures and is thus unexpected. The main
The second approach to handle the missing truancy data was to objective is to see whether groups of items have the same patterns
analyze the correlation between the prevalence of missing data on of unexpectedness. If this is the case, the respective items probably
subject specific truancy and the respective achievement outcome also have a substantive attribute in common. The interpretation of
on the three PISA proficiency scales (mathematics, reading and the Rasch-residual factor analysis is based on the contrast between
science). positive and negative loadings.
Based on the finding that omitting truancy items is inter- Referring to research question 1, we hypothesized that truancy
correlated with the outcome on the respective PISA proficiency is a multidimensional construct with regard to different subjects
scale (cf. Table 1), item omission on the subject-specific truancy that are intentionally skipped by students (hypothesis 1). We
scale was included as an independent variable in the regression assumed that students who skip certain subjects may be more
analyses predicting the corresponding PISA proficiency value. In likely to skip other subjects as well, but not necessarily any subject.
order to do so, student responses have been dummy-coded, Accordingly, if the truancy scale is multidimensional, this could
including a category for item omission. For science, dummy coding mean that students select their subjects to skip according to
was based on the categorized WLE outcome resulting from a prior different criteria instead of generally choosing to play truant and
IRT-based scaling approach including the three science truancy then skip whichever subject. Consequently, the latent construct we
items. Thus, the resulting dummy variables used for prediction of suspect behind the students’ selection of subjects to skip is a
the reading, mathematics and science proficiency represent the subject-specific selectivity that emerges in a multidimensionality
following coding scheme. The most frequently chosen category, of the truancy scale.
dummy (1) – ‘‘not playing truant at all’’ in the respective subject –
was used as the reference category. Dummy (2) meant playing 3.3.2. Research question 2
truant in the respective subject ‘‘once or twice’’, dummy (3) stood With regard to our second research question referring to the
for playing truant in the respective subject ‘‘three times and more’’ association of skipping certain subjects and achievement in the
and dummy (0) meant omitting the item of the respective subject. corresponding PISA competence domain, we predicted student
All analyses were undertaken with the PISA replication methodol- achievement in the PISA 2012 literacy test using three separate
ogy in mind, considering the stratified nature of the sampling linear regression models. We specified one regression model per
design using the R-package ‘survey’ (Lumley, 2014). competence domain, i.e. mathematics, reading and science.
Besides a set of control-variables including the school type,
3.3.1. Research question 1 subject-specific truancy was used as a predictor, matching the
In order to answer our first research question about truancy respective competence domain. For mathematics and reading,
being a multidimensional construct that can be represented by the collapsed and then dummy-coded responses (see section on
students selectively skipping certain school subjects, we per- missing data above) on the respective truancy item was used for
formed an IRT-based (Item Response Theory) pairwise comparative prediction. For science, the student responses to the three
scaling approach with six subject-specific truancy items. This science items (biology, chemistry and physics) were aggregated
comparative scaling approach called ‘pairwise’ was originally by conducting an IRT-based scaling approach first, followed by a
introduced by Choppin (1968, see also McArthur and Wright, categorization of the resulting WLE estimates. This categorical
1985) within the context of sample-free calibration of item banks science truancy scale was dummy-coded considering the
for large-scale assessments. We used the R-package pairwise missing data structure (see section on missing data above)
(Heine, 2014), which implemented Choppin’s approach and has and then in turn used as an explaining variable. Thus, student
been shown to yield rather unbiased IRT measures under the achievement in PISA 2012 mathematics was explained by
condition of higher rates of missing data (Heine and Tarnai, 2015). skipping mathematics classes and so forth. We assumed that
Due to the empirically sparse use of the two topmost categories skipping school subjects is negatively associated with student
(third category: ‘‘Three or four times’’; fourth category: ‘‘Five times achievement in the corresponding PISA competence domains
and more’’) and the therefore skewed distribution of the responses, (hypothesis 2).

Table 1
Intercorrelations of the PISA proficiency scales and missing indices for subject-specific truancy items.

Variable 1 2 3 4 5 6

1 Mathematics proficiency – .92 .87 .23 .23 .23


2 Science proficiency .00 – .89 .36 .26 .26
3 Reading proficiency .01 .00 – .29 .29 .29
4 Omitting truancy item mathematics .03 .02 .02 – .98 .98
5 Omitting truancy item science .03 .02 .02 .00 – .98
6 Omitting truancy item German .03 .02 .02 .00 .00 –

Note. Numbers above the diagonal indicate the Pearson correlation (taking into account the stratified sampling design). Numbers below the diagonal represent the respective
standard error.
C. Sälzer, J.-H. Heine / International Journal of Educational Development 46 (2016) 103–113 107

4. Results Table 2
Proportions (%) of students who reported to having played truant; n = 5001.

4.1. Descriptives Subjects skipped Missing Score 0 Score 1 Score 2


‘‘Not playing ‘‘Once ‘‘Three times
The proportions of students reporting to have skipped classes in truant at all’’ or twice’’ and more’’
the current school year revealed that the vast majority of 15 year- (collapsed)

olds has never played truant in this period of time (cf. Table 2). Biology 21.6 72.6 4.2 1.6
Apparently, most students who choose to not attend a class, select PE Chemistry 21.5 71.8 4.9 1.8
Physics 21.9 72.3 3.8 2.0
lessons for skipping (n = 463). The other subjects in our list are almost
Mathematics 21.7 71.4 4.3 2.6
equally ‘popular’ with regard to student truancy (191 < n < 243). Physical 21.4 64.0 9.3 5.3
Overall, we see for all subject-specific items that most of the students education
who indicate to play truant do so only once or twice. German 21.8 72.6 3.8 1.8
Table 2 indicates that the proportion of missing student
responses within the truancy scale is quite high. Given that
students’ response behavior is likely to be affected by the implied subjects, the clearer is the distinction of several dimensions.
social desirability of the topic, this is in line with most recent Subjects close to each other indicate a common dimension. When
studies on truancy (e.g. Vaughn et al., 2013; Veenstra et al., 2010). a subject appears isolated in this kind of plot, this means that
With regard to the weighting of the data in order to correct for students who skip this subject are unlikely to skip other subjects as
possible bias due to student non-participation (maybe due to well. Whereas subjects plotted close to each other indicate that a
truant behavior), missing values on the truancy scale indicate that student who skips one of these has a certain tendency to skip
those students who were present and participated in PISA ‘neighboring subjects’ as well.
2012 and chose not to respond to the items measuring truancy, Fig. 1 indicates that the truancy items differ both in their
did so on purpose. All students have been asked to complete the loadings and their difficulty. With regard to their loadings, the
truancy scale and according to the test session reports, it is unlikely items split into four groups suggesting a four-dimensional
that time constraints or overlooking the respective pages of structure of the construct ‘subject-specific truancy’. Considering
the questionnaire may have hindered students from completing their difficulty, we see that PE (physical education) is the most
the items. Nevertheless, such high rates of missing values require popular subject to play truant from and thus the ‘easiest’ of the six
appropriate handling to avoid bias caused by methodological items for 15-year-old students. Playing truant in PE lessons seems
imprecision. We chose to explicitly model the ‘missingness’ of to be an outstanding student characteristic, since the loading of
responses on the truancy items by including ‘missing’ as a separate this truancy item is plotted far away from the other items and thus
response category within each subject-specific item for further both less difficult than other items and a completely separate
analyses. Especially with regard to the fact that each participating dimension. Considering possible explanations for the relative
student has had the opportunity to either respond to these items or isolation of skipping PE lessons compared to the other subjects, one
not, this seems appropriate. In doing so, each student was assigned plausible argument is that in Germany, low achievement in PE does
either their selected response code or the code for a missing not affect the students’ advancement into the next grade level at
response. the end of the school year, so some students may consider it less
Analyses based on CTT (Classical Test Theory, e.g. Kline, 2005) important than other subjects. Overall low achievement usually
yielded an internal consistency of ra = .84 for the scale of six items, means that students have to repeat a grade, which is still quite
which could be increased to ra = .87 by eliminating the truancy common in Germany (OECD, 2014b; Sälzer et al., 2013). In contrast,
item for physical education. Thus, the results suggest to proceed lessons in German and mathematics form two more dimensions of
with a one-dimensional IRT based scaling approach. However, truancy. Both subjects are core subjects and therefore considered
calibrating those six items and computing WLE person estimates to be playing a key role within the students’ schedule. Low
(Warm, 1989) using the IRT-based pairwise comparison approach, performance in more than one of these core subjects is commonly
as implemented in the R-package pairwise (Heine, 2014), resulted followed by grade repetition as well. Interestingly, the three
in a somewhat low coefficient for WLE reliability of rWLE = .37. This science subjects of biology, chemistry and physics built up to a
result supports our hypothesis of truancy being a heterogeneous – common dimension with regard to subject-specific truancy,
or multidimensional – construct. The nature of this construct is supporting our approach to proceed with an aggregated index
examined in more detail in the following paragraph. for skipping science lessons in the subsequent regression analyses.
All in all, we find four dimensions within the truancy scale:
4.2. Hypothesis 1, dimensionality of truancy three single-subject domains (PE, German, mathematics), where
PE is isolated from the other dimensions and the most popular and
The factor analysis of the Rasch-residuals resulting from the hence the ‘easiest’ among the subjects to be skipped. This means
pairwise scaling procedure indicated the assumed (sub-)dimension- that, for most students who play truant, PE is the only subject they
ality of the truancy construct. Fig. 1 shows the item loadings (y-axis) avoid. Both German and mathematics in their role as core subjects
on the first main component of the Rasch-residual-factor analysis form separate dimensions still relatively far away from each other
(Linacre, 1998), plotted against the item difficulties (x-axis) obtained in the plot, meaning that students who skip German do not
from the pairwise IRT scaling approach of the six truancy items. The necessarily skip mathematics and vice versa. The fourth dimension
plot indicates the difficulty of each truancy item, where the leftmost is a conglomerate of the three science-related subjects which are
school subject is the easiest and the rightmost is the hardest to play taught in secondary schools in Germany: physics, chemistry and
truant. In other words, when many students respond positively to a biology. This means that students who choose to skip one science
question asking about truancy in the respective subject, this item subject tend to skip another science subject as well.
will be classified as easy. When only a small group of students
responds positively, the item will be classified as hard. The loadings 4.3. Missing data analyses on the truancy scale
on the y-axis of Fig. 1 indicate the dimensionality of the truancy scale
with regard to the similarity or closeness of the different school Investigating our second research question, we needed to be
subjects investigated. The greater the distance between two aware that missing data could bias our regression analyses. In
108 C. Sälzer, J.-H. Heine / International Journal of Educational Development 46 (2016) 103–113

Physical Education

0.6
0.4
0.2
loadings

German
0.0
−0.2

Mathematics

Biology
−0.4

Physics
Chemistry

−2.0 −1.5 −1.0 −0.5 0.0 0.5 1.0

logits

Fig. 1. Item loadings on the first main component of the Rasch residual factor analysis plotted against the item difficulties obtained from the one-dimensional pairwise scaling
approach; PISA 2012 sample of Germany; n = 5001.

order to take into account that the data set contained missing possibly biasing the results of significance testing of the other cells,
values, we handled missing data as follows. In a first step, the Victor (1989) suggested to anticipate the existence of certain
response patterns of the dichotomous indicator variables of configurations as ‘types’ within the definition of the base model.
missing values relating to the truancy items in the three science This approach is generally discussed under the term ‘functional
subjects were included in a first-order Configural Frequency CFA’ (Eye and von Mair, 2001). In our results, we took into account
Analysis (CFA). With regard to eight possible patterns of missing the two most prevalent types of missing data patterns (‘omit all
data, the results yielded a significant global likelihood ratio x2-test items’ vs. ‘omit no item’) and conducted a subsequent functional
(LR = 9932.366, df = 4, p < .05; x2 = 23,701.53, df = 4, p < .05) with CFA in order to test the assumption of a ‘quasi independence’ in the
two significant types (fobserved > fexpected): ‘omitting none of the presence of the two most prevalent types of missing data patterns.
three items’ (pattern ‘000’; fobserved = 3891, x2z-approximated ¼ 30:389, This analysis revealed no significant global tests (LR = 0.09, df = 2,
pBonferroni adjusted < .00625) and ‘omitting all of the three items’ p = .96; x2 = 0.09, df = 2, p = .96), while the local tests resulted in no
(pattern ‘111’; fobserved = 1069, x2z-approximated ¼ 142:516, additional significant types or antitypes (pbinomial-test > .4, for all
pBonferroni adjusted < .00625). This means that the students in our patterns; aBonferroni adjusted = .00625) besides the two anticipated
sample either responded to all of the science truancy items or to structural types.
none of them. At the same time, all the other emerging patterns of Taking into account both these results and those from the
item omission were classified to be ‘antitypes’ (fobserved < fexpected) Rasch-residual factor analysis, a one-dimensional truancy WLE-
based on the respective local binomial-test as well as the z- scale for science was formed, consisting of the three truancy items
approximation test. Antitypes are missing data patterns which referring to the science subjects of biology, chemistry and physics.
appeared less frequently than expected with regard to the basic Additionally, a variable indicating missing values on this scale (i.e.
model. Response patterns in which students omitted single items skipping all three truancy items) was defined.
of the science truancy subscale have thus been defined as The second step of our missing data analyses was to repeat the
antitypes, since they are less prevalent than expected with regard first-order and functional CFA for the remaining subject-specific
to the basic model. truancy items. In analogy to the analyses of the science-subjects, a
According to Victor (1989), the main problem with such a result first-order and functional CFA analysis was conducted including the
is the assumption of total independence with regard to the whole missing indicator variables for the three subject specific truancy
contingency table within the basic model, implying that these items (German, mathematics and PE) and the science-truancy WLE-
assumptions are correct for most of all possible configurations scale, derived from the preceding analyses described above. The
following a common multinomial distribution (see also Krauth and first-order CFA now including four variables indicating missing
Lienert, 1973; Lienert and Krauth, 1975). A problem that may occur values and thus accounting for 16 possible patterns confirmed the
is that certain patterns of missing values appear unexpectedly two significant types of missing patterns previously found for the
frequently or rarely. Such cases may be theoretically plausible, e.g. three science-subjects. Students were either omitting no items at all
that students filling in a questionnaire will skip whole scales rather and had only valid data on the truancy scale (pattern ‘0000’;
than single items within a scale. This could result in extreme fobserved = 3882, x2z-approximated ¼ 45:794, pBonferroni adjusted < .003125)
groups, producing either none or merely missing values. In order to or they omitted all items and had only missing data on the truancy
account for this problem of ‘structurally’ extreme cell frequencies, scale (pattern ‘1111’; fobserved = 1059, x2z-approximated ¼ 318:108,
C. Sälzer, J.-H. Heine / International Journal of Educational Development 46 (2016) 103–113 109

pBonferroni adjusted < .003125). Again, all the other patterns where less on the PISA mathematics scale than students who do not skip
classified to be ‘antitypes’ (fobserved < fexpected). The subsequent mathematics classes (Table 3). According to a German longitudinal
functional CFA, anticipating these two most prevalent missing study from PISA 2003, this discrepancy corresponds to one to two
data patterns resulted in no additional significant missing school-years of learning (Ehmke et al., 2006). Given that there is a
patterns (0.02 < pbinomial-test > .44, for all patterns; aBonferroni wide consensus about schools being the main learning environ-
adjusted = 0.0031). ment for mathematics, this finding is not surprising.
To summarize the results of the person-centered approach of It becomes, however, highly relevant when compared to the
the missing data analyses, one can state that the tendency to omit association of skipping German lessons and reading achievement
any of the six truancy items can be assumed to be independent in PISA 2012. Assuming that there are numerous opportunities to
from the subject addressed in the respective item. acquire and practice reading outside school, we see that even
In order to investigate whether the students’ tendency to omit missing German classes is significantly associated with reading
truancy items is related to their performance in the PISA competence in PISA 2012 (Table 4). However, this correlation is
competence test, bivariate correlations of omitting truancy items only significant for occasional truancy in German lessons, not for
and the respective PISA proficiency scale were calculated. The more frequent absences (three times and more). With regard to the
correlations between any of the indices for truancy item omission PISA-shock that emerged after the results of the first PISA study in
and any of the three PISA competence domains range between 2000 were published and more than one in five 15 year-old
r = .23 and r = .36 (see Table 1 in the previous section) and thus students in Germany was classified ‘‘at risk’’ due to an alarmingly
corresponds to a shared variance of at least 5% up to 12%. This can low competence level in reading (Baumert et al., 2001), this finding
be interpreted as a substantial relation between the omission of is highly relevant. The development of reading proficiency is
truancy items and achievement on the PISA competence scales. apparently not completed at the primary school level, it is
Given that we found two types of missing data patterns for each continued at the secondary level and German lessons may offer
of the subject-specific truancy items plus substantial correlations a significant opportunity for improving one’s reading proficiency.
between omitting subject-specific truancy items and student At the same time, students weak in reading may skip German
proficiency in the respective PISA competence domain, we needed lessons on purpose in order to avoid failure when asked to read and
to account for both the rather large proportion of students work with a text more frequently than accomplished readers. This
systematically skipping the truancy items and the relationship of differential finding may be explained by the fact that even though
skipping these items and achievement. Hence, omitting truancy there are numerous opportunities to practice reading and improve
items is explicitly modeled in the regression analyses testing our one’s proficiency by reading for pleasure (Aarnoutse and van
second hypothesis. Leeuwe, 1998), students skipping German classes on purpose make
differential use of these opportunities. The pattern found in Table 4
4.4. Hypothesis 2, subject-specific truancy and achievement in the indicates that low reading competence is associated with
respective PISA domain occasional truancy in German lessons (‘‘once or twice’’), but not
with more frequent truancy (‘‘three times and more’’).
Our regression analyses indicated that for the three PISA For science lessons as an aggregate of biology, chemistry and
competence domains, all control variables are significant pre- physics, we find that skipping science classes also correlates with
dictors. Girls outperform boys in reading, while boys do better in low achievement (Table 5). As opposed to the correlation of
mathematics and science. This latter finding is likely to be attending German lessons and PISA reading competence, skipping
attributable to the inclusion of attending a Gymnasium school science lessons on purpose is only negatively associated with
in the regression analysis, since in the overall German PISA sample, students’ achievement in the PISA science test when they skip
no gender differences in science are found (OECD, 2014b). Students classes at least three times (B = 37.55; SE = 12.20).
with an immigrant background achieve significantly lower than In sum, our findings suggest that being present in mathematics,
their classmates in both assessment domains and students’ socio- German and science lessons correlates with a higher competence
economic status is positively correlated to their achievement. in those assessment domains. Skipping lessons in these subjects
Taking into account subject-specific truancy, we see that students purposefully goes along with a lower proficiency level in the
skipping mathematics classes scored between 21 and 39 points corresponding assessment domains.

Table 3
Regression model: covariates, truancy in mathematics and PE (dummy coded), predicting PISA mathematics competence.

Variable Model 1: individual Model 2: subject-specific Model 3: subject-specific


characteristics truancy truancy and skipping PE

B SE B SE B SE

Intercept 424.96*** 4.93 440.18*** 4.37 440.21*** 4.36


Gymnasium 105.51*** 3.89 101.17*** 3.88 101.18*** 3.89
Male 21.22*** 2.22 23.01*** 2.16 23.02*** 2.14
Immigrant status 23.38*** 5.00 27.23*** 4.24 27.43*** 4.24
HISEI 0.82*** .08 0.75*** .07 0.75*** .07
Truancy Math omitted 39.91*** 4.31 26.99* 11.87
Truancy Math (‘‘Once or twic’’) 20.97*** 5.62 21.05*** 6.08
Truancy Math (‘‘Three times and more’’, collapsed) 39.68*** 7.55 39.93*** 8.16
Truancy PE omitted 13.21 12.15
Truancy PE (‘‘Once or twic’’) 0.22 4.14
Truancy PE (‘‘Three times and mor’’, collapsed) 0.74 5.93
R2 .52 .59 .64

Note: *PE = physical education.


*
p < .05.
**
p < .01.
***
p < .001.
HISEI values are z-standardized.
110 C. Sälzer, J.-H. Heine / International Journal of Educational Development 46 (2016) 103–113

Table 4
Regression model: covariates, truancy in German and PE (dummy coded), predicting PISA reading competence.

Variable Model 1: individual Model 2: subject-specific Model 3: subject-specific


characteristics truancy truancy and skipping PE

B SE B SE B SE

Intercept 454.11*** 4.90 471.09*** 4.08 471.30*** 4.20


Gymnasium 95.89*** 3.82 91.33*** 3.68 91.22*** 3.70
Male 37.10*** 2.12 35.17*** 2.04 35.19*** 2.06
Immigrant status 17.62*** 4.28 23.18*** 4.10 23.32*** 4.11
HISEI 0.77*** .08 0.69*** .07 0.69*** .07
Truancy German omitted 46.89*** 4.33 25.88* 11.47
Truancy German (‘‘Once or twic’’) 23.18*** 5.54 22.71*** 5.61
Truancy German (‘‘Three times and more’’, collapsed) 22.13** 9.44 20.06 10.19
Truancy PE omitted 21.55 11.76
Truancy PE (‘‘Once or twic’’) .81 3.54
Truancy PE (‘‘Three times and more’’, collapsed) 3.01 5.03
R2 .56 .65 .74

Note: *PE = physical education.


*
p < .05.
**
p < .01.
***
p < .001.
HISEI values are z-standardized.

Taking into account that all our regression models comprise a found that truancy measured by the truancy scale we administered
dummy variable to split students attending a Gymnasium school is a four-dimensional construct, yielding three single-subject
(merely academic track) from non-Gymnasium schools, the overall dimensions (PE, German, mathematics) and one three-subject
high proportion of explained variance indicated by the R-square is dimension (science, composed of biology, chemistry and physics).
not surprising. Given that students in Germany are sorted into This indicates that truancy is indeed a subject-specific and hence a
different secondary school tracks at age 10 after four years of multidimensional behavior, where PE-lessons are the most
elementary schooling due to their prior achievement, the variance frequently skipped subject. Furthermore, our results point out
in student achievement between schools is about as high as the that skipping classes in German, mathematics and science is
overall variance within schools. Gymnasium schools have very low related to a significantly lower competence level according to the
between-school variance (6 percent; Sälzer et al., 2013), while the PISA 2012 reading, mathematics and science test, respectively. In
overall within-school variance is 47 percent. For this reason, the other words, students selecting themselves into the truancy-group
stratification during the sampling procedure needed to take into achieve lower in the respective subject domain than other
account the difference between Gymnasium schools and non- students. We are able to describe this group of students as a
Gymnasium schools which are confirmed in our regression self-selective one, since the PISA test is mandatory in Germany and
analyses. students who are absent at the PISA testing day will have to
participate in a follow-up session. Those who are finally absent will
5. Discussion be controlled for by a weighting procedure comprising non-
response at both the school and the student level. It can thus be
This study aimed on answering two research questions: first, assumed that our data are not biased by students who are likely to
we investigated the dimensionality of truancy with regard to score high on truancy have missed the test session. Collecting data
subject-specificity of truant behavior and second, we explored on a topic sensitive to be biased by absenteeism in the context of a
whether subject-specific truancy relates to student achievement in publicly renowned and mandatory large-scale assessment is very
the corresponding competence domains in the PISA 2012 test. We promising with regard to the quality of the data.

Table 5
Regression model: covariates, truancy in science and PE (dummy coded), predicting PISA science competence.

Variable Model 1: individual Model 2: subject-specific Model 3: subject-specific


characteristics truancy truancy and skipping PE

B SE B SE B SE
*** *** ***
Intercept 447.97 5.06 464.89 4.40 465.07 4.35
Gymnasium 96.90*** 3.86 92.47*** 3.76 92.44*** 3.75
Male 6.42* 2.46 8.25** 2.44 8.19** 2.41
Immigrant status 33.94*** 4.60 39.04*** 4.38 39.11*** 4.38
HISEI 0.81*** .08 0.73*** .07 0.73*** .07
Truancy Science omitted 46.47*** 4.69 32.96* 14.40
Truancy Science (‘‘Once or twic’’) 9.62* 4.01 9.34* 4.69
Truancy Science (‘‘Three times and more’’, collapsed) 37.87** 11.38 37.55** 12.20
Truancy PE omitted 13.80 14.49
Truancy PE (‘‘Once or twic’’) 0.56 3.89
Truancy PE (‘‘Three times and more’’, collapsed) 0.34 6.58
R2 .49 .57 .64

Note: *PE = physical education.


*
p < .05.
**
p < .01.
***
p < .001.
HISEI values are z-standardized.
C. Sälzer, J.-H. Heine / International Journal of Educational Development 46 (2016) 103–113 111

One finding that we had not hypothesized was the role of between unharmful skipping of lessons and the beginning of truancy
omitting truancy items. Modeling omitted items in contrast to the to be a ‘slippery slope’ into a problematic behavior jeopardizing
other response categories in our regression analyses revealed some students’ achievement (Sälzer et al., 2012). While students omitting
noticeable predictive patterns. Our findings suggest that students’ the truancy item for science lessons achieve significantly lower than
proficiency in PISA mathematics is about 21–39 score points less non-truant students, omitting items related to truancy in PE is not
for those who truant mathematics classes – and about the same associated with students’ science achievement. In other words,
amount less for students who skip the item measuring truancy in students skip the item measuring truancy in PE lessons regardless
mathematics classes (26 points, see Table 3). This finding is all the their achievement in science. One tentative explanation could be the
more prominent since the regression model shows that skipping differential role of science subjects within the curriculum. In some
the truancy items referring to physical education classes are not school years or within-school streams, science is a core subject and
predicting students’ performance in the PISA mathematics test. in others, it is not. Therefore it is quite unlikely to find response
Furthermore, we assume that there is a considerable group of patterns indicating an association of skipping truancy items and
students who skip mathematics, but refuse to answer the achievement in science-related subjects.
corresponding truancy items. Since students who omit the Considering the findings described so far, it must be kept in
mathematics truancy item achieve about as low as those who mind that truancy is a research topic that is commonly seen as very
choose the lower of two response categories indicating truancy in relevant and interesting, yet hard to do sound empirical research
mathematics and there can be no overlap between these groups, on. Hence, representative and large-scale studies hardly exist.
this conclusion seems plausible. Enhancing the PISA 2012 study, which is representative for
With regard to the reading proficiency, skipping German classes Germany and a mandatory study, yielded an innovative and
is associated with the students’ reading achievement only for differentiated dataset. Information on subject-specific truancy
students who skip German lessons occasionally (once or twice). For could be collected and analyzed with regard to student achieve-
students who chose the most extreme category of the item ment. As student achievement is measured by an IRT-based
measuring skipping German classes, there is no association with competence test, one can assume to have highly objective, reliable
reading competence in the PISA test. Since a key feature of reading and valid data at an aggregate level. In order to understand the
competence is that it is ubiquitous in the sense that it is not limited meaning of these results, there is a number of limitations to our
to German as a school-subject, this association needs to be study that need to be considered.
interpreted with care. On the one hand, German lessons offer the First of all, PISA is designed as a cross-sectional study and does
main opportunity to acquire and deepen reading competence, not yield causal results or effects in a sense that one could
since both text comprehension and reading aloud is practised. On determine antecedents and consequences of certain variables. PISA
the other hand, reading takes place in most other school subjects as is a regular educational monitoring with a benchmarking function
well, so the link between a lower reading proficiency score and and every three years, the cohort of 15 year-olds is tested in
missed German classes is not obvious. A tentative interpretation of numerous countries. This cyclic design allows for the description of
this finding is – along with the research literature on reading trends over time. However, the enhancement of the German
competence – that reading is only partially learned and acquired at student questionnaire has uniquely been part of PISA 2012 and is
school (e.g. Aarnoutse and van Leeuwe, 1998; Artelt et al., 2007; not available over time or across countries.
Schiefele et al., 2004). Reading is mostly learned and improved Second, we do not have information about the number of
through practice which is sought by students according to their lessons missed due to illness or other reasons that are not within
interest and motivation for reading for pleasure. It seems plausible students’ control. Actually, when the role of missed lessons for
that those students who are accomplished readers are not student achievement is to be investigated, one should differentiate
dependent from attending German lessons in order to develop between classes missed to exogenous factors such as emergencies
their proficiency in reading. As for the other two competence or illness and classes missed on purpose, which are defined as
domains, skipping the truancy item referring to PE lessons is not truancy. In our study, we clearly interpret our findings with regard
predicting students’ reading achievement in the PISA test. to intentionally skipped classes that are explicitly classified as
Finally, students skipping science lessons only once or twice have truancy. In future studies, however, other reasons for missing
a similar level of proficiency resulting from the PISA test to their school classes should be controlled for.
classmates who never skip science lessons. One very likely Third, our data lack information about the amount of time
explanation to this finding lies in the structure of science lessons students spend with reading for pleasure. Arguing that the
in Germany. More than in other school subjects, science lessons are significant role of attending German lessons for the reading
organized in topic-related blocks comprising several weeks. competence of 15 year-old students is surprising given that there
Students get familiar with conceptual characteristics of such topics are numerous opportunities to practice reading outside school, our
and gain insights at different levels. Learning is frequently study could not control for this aspect statistically.
stimulated and scaffolded by student activation through experi- Fourth, our data have only been collected in one country and
ments, research tasks or other activities involving interaction with only once. Information from students in several countries would be
others. Thus, it seems plausible that students who skip only one or useful to find cross-cultural differences and possible variables
two science lessons will be updated by their classmates while in the affecting students’ choice to skip classes in certain subjects.
process of learning together. In such cases, the student can catch up Repeated measures and hence a longitudinal design would allow
with what they missed without exposing themselves as truants in for causal analyses. There would still be a non-negligible selection
front of the teacher, it is fairly easy to just dive back into the flow of bias of students selecting themselves into the group of truants (as
the lessons. However, with regard to students who skip more than opposed to other students who do not) that could not be solved by
just one or two science lessons, the association with science a repeated survey. Depending on the research questions to be
achievement is very strong. Those students who report to have answered, methods controlling for selection bias (e.g. the bounds
skipped science lessons to a higher degree in the current school year methods or propensity score matching) are appropriate.
achieve significantly lower than students who have not skipped In sum, our study sheds light on the dimensionality of truancy
science lessons at all. Following the assumption above that science as a construct describing a subject-specific student behavior and
lessons are organized in thematic blocks, this item measuring the our findings reveal an association between subject-specific truancy
frequency of truancy could have identified a critical threshold and a significantly lower competence level in the corresponding
112 C. Sälzer, J.-H. Heine / International Journal of Educational Development 46 (2016) 103–113

PISA assessment domains. Considering the limitations mentioned truancy is an innovative approach and our data set is of excellent
above, the study is one step toward knowing more about truancy quality. But the limitations reveal that some necessary next steps
as an unwanted student behavior. Applying the Rasch-residual toward understanding truancy are already sketched and need to be
factor analysis to a six-item scale measuring subject-specific addressed.

Appendix 1

Zero-order correlations of all predictors used in the regression model predicting student competence in PISA mathematics.

Mathematics Gymnasium Male Immigrant SES Truancy Truancy Truancy Truancy Truancy Truancy
status Math Math Math PE PE (‘‘once PE (‘‘three
omitted (‘‘once (‘‘three omitted or twic’’) times and
or twic’’) times and more’’)
mor’’)

Mathematics – .59 .07 S.15 .39 S.23 S.02 S.06 S.23 .01 S.03
Gymnasium .59 – S.07 S.07 .39 S.14 S.00 S.03 S.13 .02 S.03
Male .07 S.07 – S.01 S.01 .05 .01 .03 .04 S.09 S.03
Immigrant status S.15 S.07 S.01 – S.20 S.06 .02 .02 S.07 .03 .02
SES .39 .39 S.01 S.20 – S.11 S.00 S.00 S.11 .01 S.00
Truancy Math omitted S.23 S.14 .05 S.06 S.11 – S.11 S.08 .97 S.15 S.11
Truancy Math (‘‘once or twic’’) S.02 S.01 .01 .02 S.00 S.11 – S.03 S.10 .18 .14
Truancy Math (‘‘three times S.06 S.03 .03 .02 S.00 7 S.03 – S.08 .03 .36
and more’’)
Truancy PE omitted S.23 S.13 .04 S.07 S.11 .97 S.10 S.08 – S.16 S.12
Truancy PE (‘‘once or twice’’) .01 .02 S.09 .03 .01 S.15 .18 .03 S.16 – S.07
Truancy PE (‘‘three times and S.03 S.03 S.03 .02 S.00 S.11 .14 .36 S.12 S.07 –
more’’)

Appendix 2

Zero-order correlations of all predictors used in the regression model predicting student competence in PISA reading.

Reading Gymnasium Male Immigrant HISEI Tru. Truancy Truancy Truancy Truancy Truancy
status German German German PE PE (‘‘once PE (‘‘three
omitted (‘‘once or (‘‘three omitted or twice’’) times and
twice’’) times and more’’)
more’’)

Reading – .58 S.24 S.12 .38 S.29 S.03 S.04 S.29 .05 S.01
Gymnasium .58 – S.07 S.07 .39 S.13 S.00 S.03 S.13 .02 S.03
Male S.24 S.07 – S.01 S.01 .04 .02 .04 .04 S.09 S.03
Immigrant status S.12 S.07 S.01 – S.12 S.07 .01 .02 S.07 .03 .02
HISEI .38 .39 S.01 S.20 – S.11 .00 S.00 S.11 .01 S.00
Truancy German omitted S.29 S.13 .04 S.07 S.11 – S.10 S.07 .98 S.16 S.11
Truancy German (‘‘once or twic’’) S.03 S.00 .02 .01 .00 S.10 – S.02 S.09 .20 .15
Truancy German (‘‘three times and mor’’) S.04 S.03 .04 .020 S.00 S.07 S.02 – S.06 .02 .37
Truancy PE omitted S.29 S.13 .04 S.07 S.11 1 S.09 S.06 – S.16 S.12
Truancy PE (‘‘once or twic’’) .05 .02 S.09 .03 .01 S.16 .20 .02 S.16 – S.07
Truancy PE (‘‘three times and more’’) S.01 S.03 S.03 .02 S.00 S.11 .15 .37 S.12 S.07 –

Appendix 3

Zero-order correlations of all predictors used in the regression model predicting student competence in PISA science.

Science Gymnasium Male Immigrant HISEI Truancy Truancy Truancy Truancy Truancy Truancy
stauts Science Science Science PE PE (‘‘once PE (‘‘three
omitted (‘‘once or (‘‘three omitted or twice’’) times and
twice’’) times and more’’)
more’’)

Science – .56 S.00 S.18 .38 S.26 .04 S.06 S.26 .02 S.02
Gymnasium .56 – S.07 S.07 .39 S.14 .06 S.04 S.13 .02 S.03
Male S.00 S.07 – S.01 S.01 .05 S.01 .03 .04 S.09 S.03
Immigrant status S.18 S.07 S.01 – S.20 S.07 .00 .04 S.07 .03 .02
HISEI .38 .39 S.01 S.20 – S.11 .04 S.02 S.11 .01 S.00
Truancy Science omitted S.26 S.14 .05 S.07 S.11 – S.16 S.07 .98 S.16 S.11
Truancy Science (‘‘once or twic’’) .04 .06 S.01 .00 .04 S.16 – S.04 S.15 .21 .25
Truancy Science (‘‘three times and mor’’) S.06 S.04 .03 .04 S.02 S.07 S.04 – S.06 .05 .28
Truancy PE omitted S.26 S.13 .04 S.07 S.11 .98 S.15 S.06 – S.16 S.12
Truancy PE (‘‘once or twic’’) .02 .02 S.09 .03 .01 S.16 .21 .05 S.16 – S.07
Truancy PE (‘‘three times and more’’) S.02 S.03 S.03 .02 S.00 S.11 .25 .28 S.12 S.07 –
C. Sälzer, J.-H. Heine / International Journal of Educational Development 46 (2016) 103–113 113

References Linacre, J.M., 1998. Detecting multidimensionality: which residual data-type


works best? J. Outcome Meas. 2, 266–283.
Aarnoutse, C., van Leeuwe, J., 1998. Relation between reading comprehension, Lumley, T., 2014. Analysis of Complex Survey Samples. Retrieved from: http://
vocabulary, reading pleasure and reading frequency. Educ. Res. Eval. 4, cran.r-project.org/package=survey.
143–166. Malcolm, H., Thorpe, G., Lowden, K., 1996. Understanding Truancy: Links
Artelt, C., McElvany, N., Christmann, U., Richter, T., Groeben, N., Köster, J., Ring, Between Attendance, Truancy and Performance. Scottish Council for
K., 2007. Förderung von Lesekompetenz: Expertise. Bildungsforschung, vol. Research in Education, Edinburgh.
17. Bundesministerium für Bildung und Forschung (BMBF), Bonn, Berlin. McArthur, D.L., Wright, B.D., 1985. Bruce Choppin on measurement and
Baumert, J., Klieme, E., Neubrand, M., Prenzel, M., Schiefele, U., Schneider, W. education. Eval. Educ. 9 (1), 1–107, http://dx.doi.org/10.1016/0191-
(Eds.), 2001. PISA 2000. Basiskompetenzen von Schülerinnen und Schülern 765X(83)90005-8.
im internationalen Vergleich. Leske + Budrich, Opladen. OECD., 2012. PISA 2009 Technical Report. OECD Publishing, Paris.
Choppin, B., 1968. Item bank using sample-free calibration. Nature 219 (5156), OECD., 2013a. PISA 2012 Assessment, Analytical Framework: Mathematics, Reading,
870–872, http://dx.doi.org/10.1038/219870a0. Science, Problem Solving and Financial Literacy. OECD Publishing, Paris.
Ehmke, T., Blum, W., Neubrand, M., Jordan, A., Ulfig, F., 2006. Wie verändert sich OECD., 2013b. PISA 2012 Results: Ready to Learn: Students’ Engagement, Drive
die mathematische Kompetenz von der neunten zur zehnten Klassenstufe? and Self-beliefs (Volume III). OECD Publishing, Paris.
In: Prenzel, M., Baumert, J., Blum, W., Lehmann, R., Leutner, D., Neubrand, OECD., 2013c. PISA 2015 Draft Questionnaire Framework. Retrieved from: http://
M., Schiefele, U. (Eds.), PISA 2003. Untersuchungen zur www.oecd.org/pisa/pisaproducts/PISA-2015-draft-questionnaire-framework.
Kompetenzentwicklung im Verlauf eines Schuljahres. Waxmann, Münster, pdf.
pp. 63–86. OECD., 2014a. PISA 2012 Technical Report. OECD Publishing, Paris.
Erikson, R., Goldthorpe, J.H., Portocarero, L., 1979. Intergenerational class OECD., 2014b. PISA 2012 Results: What Students Know and Can Do: Student
mobility in three Western European societies: England, France and Sweden. Performance in Mathematics, Reading and Science, Revised ed. OECD
Br. J. Sociol. 30, 341–415. Publishing, Paris.
Eye, A., von Mair, P., 2001. A Functional Approach to Configural Frequency R Development Core Team., 2014. R: A Language and Environment for Statistical
Analysis (Technical Report No. 48). Vienna. Computing [Computer software], In: http://www.r-project.org/.
Fischer, B., 1989. Einstellungen zum Sport. Eine empirische Untersuchung über Reid, K., 2003. The search for solutions to truancy and other forms of school
Einstellungen von Schülern zu Lernfeldern des Sportunterrichts in der absenteeism. Pastor. Care Educ. 21 (1), 3–9, http://dx.doi.org/10.1111/1468-
Sekundarstufe II. Waxmann, Münster. 0122.00248.
Ganzeboom, H.B.G., 2010, May. A New International Socio-economic Index (ISEI) Renzulli, J.S., Park, S., 2000. Gifted dropouts: the who and the why. Gifted Child
of Occupational Status for the International Standard Classification of Quart. 44 (4), 261–271, http://dx.doi.org/10.1177/001698620004400407.
Occupation 2008 (ISCO-2008) Constructed with Data from the ISSP 2002– Sälzer, C., Prenzel, M., Klieme, E., 2013. Schulische Rahmenbedingungen der
2007; with an Analysis of Quality of Occupational Measurement in ISSP. Kompetenzentwicklung. In: Prenzel, M., Sälzer, C., Klieme, E., Köller, O.
Paper Presented at Annual Conference of International Social Survey (Eds.), PISA 2012. Fortschritte und Herausforderungen in Deutschland.
Programme, Lisbon. Retrieved from: http://www.harryganzeboom.nl/isco08/ Waxmann, Münster, pp. 155–187.
index.htm. Sälzer, C., Trautwein, U., Lüdtke, O., Stamm, M., 2012. Predicting adolescent
Heine, J.-H., 2014. pairwise: Rasch Model Parameters by Pairwise Algorithm R truancy: the importance of distinguishing between different aspects of
Package Version 0.2.5. Retrieved from: http://CRAN.R-project.org/ instructional quality. Learn. Instr. 22 (5), 311–319, http://dx.doi.org/10.1016/
package=pairwise. j.learninstruc.2011.12.001.
Heine, J.-H., 2015. confreq: R-Project. Retrieved from: http://cran.r-project.org/ Schiefele, U., Artelt, C., Stanat, P., Schneider, W. (Eds.), 2004. Struktur,
web/packages/confreq/index.html. Entwicklung und Förderung von Lesekompetenz – Vertiefende Analysen im
Heine, J.-H., Sälzer, C., Borchert, L., Sibberns, H., Mang, J., 2013. Technische Rahmen von PISA 2000. VS Verlag für Sozialwissenschaften, Wiesbaden.
Grundlagen des fünften internationalen Vergleichs. In: Prenzel, M., Sälzer, C., Stamm, M., 2010. Dropouts am gymnasium. Z. Erzieh. 13 (2), 273–291, http://
Klieme, E., Köller, O. (Eds.), PISA 2012. Fortschritte und Herausforderungen dx.doi.org/10.1007/s11618-010-0121-z.
in Deutschland. Waxmann, Münster, pp. 309–346. Stemmler, M., 2014. Person-Centered Methods. Springer International Publishing,
Heine, J.-H., Tarnai, C., 2015. Pairwise Rasch model item parameter REcovery Cham.
under sparse data conditions. Psychol. Test Assess. Model. 57 (1), 3–36. Vaughn, M.G., Maynard, B.R., Salas-Wright, C.P., Perron, B.E., Abdon, A., 2013.
Helmke, A., Schrader, F.-W., 2013. Angebots-Nutzungs-Modell. In: Wirtz, M.A. Prevalence and correlates of truancy in the US: results from a national
(Ed.), Dorsch – Lexikon der Psychologie. 16th ed. Huber, Bern, pp. 147–148. sample. J. Adolesc. 36 (4), 767–776, http://dx.doi.org/10.1016/
Henry, K.L., Huizinga, D.H., 2007. School-related risk and protective factors j.adolescence.2013.03.015.
associated with truancy among urban youth placed at risk. J. Prim. Prevent. Veenstra, R., Lindenberg, S., Tinga, F., Ormel, J., 2010. Truancy in late elementary
28 (6), 505–519. and early secondary education: the influence of social bonds and self-control –
Kline, T.J.B., 2005. Psychological Testing: A Practical Approach to Design and the TRAILS study. Int. J. Behav. Dev. 34, 302–310, http://dx.doi.org/10.1177/
Evaluation. Sage, New York. 0165025409347987.
Krauth, J., 1973. Die Konfigurationsfrequenzanalyse (KFA) und ihre Anwendung Victor, N., 1989. An alternative approach to configural frequency analysis.
in Psychologie und Medizin: Ein multivariates nichtparametrisches Methodika 3, 61–73.
Verfahren zur Aufdeckung von Typen und Syndromen (Configural Frequency Wardle, J., 2002. Assessing socioeconomic status in adolescents: the validity of a
Analysis (CFA) and its Application in Psychology and Medicine: A home affluence scale. J. Epidemiol. Commun. Health 56 (8), 595–599, http://
Multivariate Nonparametric Method for Uncovering Types and Syndroms). dx.doi.org/10.1136/jech.56.8.595.
Alber Karl, Freiburg. Warm, T.A., 1989. Weighted likelihood estimation of ability in item response
Krauth, J., Lienert, G.A., 1973. Nichtparametrischer Nachweis von Syndromen theory. Psychometrika 54 (3), 427–450.
durch simultane Binomialtests. Biom. Z. 15 (1), 13–20. Wilson, V., Malcolm, H., Edward, S., Davidson, J., 2008. ‘Bunking off’: the impact
Lienert, G.A., Krauth, J., 1975. Configural Frequency Analysis as a statistical tool of truancy on pupils and teachers. Br. Educ. Res. J. 34, 1–17, http://
for defining types. Educ. Psychol. Meas. 35 (2), 231–238. dx.doi.org/10.1080/01411920701492191.

You might also like