Professional Documents
Culture Documents
The Relationship Between Strategic Readi
The Relationship Between Strategic Readi
The Relationship Between Strategic Readi
ABSTRACT. In the present article, we investigate the degree to which 15-year-old students
in regular secondary education in the Netherlands (N = 144) master four strategic reading
activities and the relationship of the mastery to their first-language reading comprehension,
preference for self-direction and in-depth information processing, and attitude towards
reading and strategic reading activities. Students’ mastery of strategic reading activities
appears to be strongly related to reading comprehension. Differences in reading compre-
hension between school types are not completely explained by differences in mastery of
strategic reading activities. No relationship was found between students’ preference for
self-direction or in-depth processing of information on the one hand and mastery of stra-
tegic reading activities or reading comprehension on the other. Students’ attitudes towards
the usefulness of strategic reading activities appear to be negatively related both to their
mastery of these activities and to their reading comprehension. We suggest that mastery of
strategic reading activities probably influences reading comprehension, and that strategy
training appears to be less suitable for students with well-developed reading skills.
1. I NTRODUCTION
Like Westhoff (1991b: 28) and Mulder (1996: 29), we distinguish three
main groups: (a) readers’ linguistic and non-linguistic use of prior knowl-
edge, including textual knowledge constructed while reading (for instance,
predicting text content on the basis of pictures, titles and headings, or the
beginnings and ends of paragraphs); (b) readers’ use of textual elements
with high informational value (e.g., looking for key fragments, or self-
questioning); and, (c) use of structure-marking elements in the text (for
instance, punctuation, connecting words, graphical structure character-
istics) (see also Goldman & Rakestraw, 2000).
Research into the relationships between strategic reading activities and
reading comprehension has been carried out in different ways: (1) think-
aloud research (see the reviews by Pressley & Afflerbach, 1995; Fitzgerald,
1995; Kucan & Beck, 1997) which shows that experienced and successful
readers have a wider and more varied repertoire of strategic reading activ-
ities than weak, inexperienced ones. These studies also show that weak,
inexperienced readers are less likely than their stronger and more exper-
ienced counterparts to apply strategic reading activities (such as taking
notes, underlining text passages, deriving the meaning of words from the
context and predicting text content); (2) numerous intervention studies
have been conducted in both the first language (L1) – especially with
young and weak readers – and in foreign language study (L2), in which
students are trained in strategic reading activities (both with and without
a training component focused on enhancing metacognitive competence).
Reviews of intervention studies (e.g., Pearson & Dole, 1987; Paris, Wasik
& Van der Westhuizen, 1988; Alvermann & Moore, 1991; Pearson &
Fielding, 1991; Rosenshine & Meister, 1993; Pressley & Afflerbach, 1995;
National Reading Panel, 2000) indicate that L1 reading strategy training
can have positive effects, especially with young and poor readers, at
least when the effect measurements occur through programme specific
reading tests. On the other hand, little use seems to be made of standard
reading tests to measure the transfer effects of reading strategy training to
reading comprehension. Reviews show, however, an increase in transfer
effects to reading comprehension when teaching attends specifically to
metacognitive competence.
Both types of research (i.e., think-aloud protocols and intervention
studies) show that the extent to which readers act strategically relates to
reading comprehension: experienced and successful readers use a wider
repertoire of strategic reading activities and use them more frequently than
less experienced and less successful readers. In short, research suggests a
connection between reading comprehension and the frequency readers use
and vary their strategic reading activities. What we do not know, however,
STRATEGIC READING ACTIVITIES AND READING COMPREHENSION 89
2. M ETHOD
2.2. Subjects
Participants of the study are 15-year-old students (grade 9) of all four
tracks of secondary education (vocational, lower general, higher general
and academic) from fifteen schools in Amsterdam. Mother Tongue
teachers of these 15 schools asked about 2,500 students to voluntarily
participate. Of 480 students who volunteered, we selected a non-random
sample of 144. In selecting students we aimed at an equal distribution of
vocational and lower general students on the one hand (N = 65) and higher
general and academic students (N = 79) on the other. Next we selected
equal numbers of girls and boys and of students with low, average and good
marks for Dutch. Students with very weak or very high marks were not
included in the selection to avoid threshold or ceiling effects. To exclude a
possible first-language effect, we included only native speakers of Dutch.
Since the sample is not random, we cannot interpret mean scores as
estimates of population means. Our research questions however pertain
to relationships between variables and not at generalizing mean scores.
Relationships between variables are less influenced by non-randomness
of the sample. If variances of variables are sufficiently large, relation-
ships can be detected. Since students with extreme marks for Dutch were
92 PETER BIMMEL AND ERIK VAN SCHOOTEN
excluded, variances in our study are probably smaller than population vari-
ances. Therefore, relationships found in the study will probably be smaller
than those found in a random sample of 15-year-old students in Dutch
secondary education.
2.3. Instruments
Below, we describe the selection and development of the instruments for
measuring reading comprehension, mastery of each of the four strategic
reading activities, attitude towards reading, attitude towards usefulness of
strategic reading activities, and the degree of meaning orientation in the
learning style.
Reading Comprehension
For measuring reading comprehension we selected parts of national final
mother-tongue exams for lower general secondary education from the
1987–1994 period. These exams consist of texts with multiple-choice
questions, and some open questions scored with answer keys. The 7 texts
selected each contain 7–9 items, all expected to measure reading compre-
hension at text or paragraph level. In addition to these exams, we used one
text from the IEA research, also intended to measure reading comprehen-
sion in secondary education (Elley, 1992). We altered some of the selected
instruments. First, we changed or excluded items that previously appeared
unreliable. Next, together with a bold-typeface introduction, we added
headings and some illustrations to make the Skimming strategy (see below)
possible.
group ‘Use of text elements with a high informational value’. BEP also
concerns prediction on the basis of prior knowledge. Hinge words is one
of the strategies from the group ‘Use of structure-marking elements in the
text’. For each of the four instruments measuring the ability to use strategic
reading activities we developed answer keys with instructions on how the
instruments should be scored.
The Skimming instrument shows the title, headings and illustrations of
four texts and 52 items. For each item participants indicate the probability
that the item is in one of the texts.
The BEP instrument (39 items) consists of parts of four texts: the illus-
trations and their captions, the introduction, the first and last paragraph,
and the beginning and end of all other paragraphs. For some items parti-
cipants indicated whether a certain sentence could occur in the text; other
items consisted of multiple-choice questions on paragraph content.
In the Key fragments instrument (33 items), participants underlined key
fragments in two texts and indicated in two other texts whether given
fragments are key fragments.
Finally, the Hinge words instrument offers 27 multiple-choice items.
For some items participants chose the connecting word (i.e., a conjunction
or a pronominal adverb) belonging in the text. Other items consisted of
questions concerning connecting words used in the text.
The face and content validity of instruments measuring mastery of
strategic reading activities are discussed above. Other indications of
validity have not as yet been investigated for these instruments. If one or
more instruments measuring mastery of strategic reading activities also
measures reading proficiency, the correlation between reading proficiency
and mastery of strategic reading activities will be spuriously high (and
meaningless). This begs the question: to what extent do the instruments for
measuring strategic reading comprehension also (partly) measure reading
proficiency?
The reading comprehension items measure the extent of students’
ability to extract and understand information including the main idea of a
text, the meaning of paragraphs, and links between paragraphs. The instru-
ments for strategic reading activities requires students to: (a) predict text
content on the basis of titles, headings, illustrations or the beginnings and
ends of paragraphs; (b) identify text passages with a high informational
value; and, (c) indicate which structure markers fit in the text in certain
places. These tasks differ from those in the reading comprehension instru-
ment. Only a small number of items in the Hinge words instrument, asking
for text meaning, show some overlap with the reading comprehension
instrument.
94 PETER BIMMEL AND ERIK VAN SCHOOTEN
Learning Styles
The learning style instrument is an adaptation of the Inventory Learning
Styles for academic secondary education (ILS-VWO) (Vermunt & Van
Rijswijk, 1992). The different scales used in the instrument are based on
student interviews. We used two of the ILS scales; in-depth processing
and self-direction. The in-depth processing scale measures to what extent
students seek connections within the text itself, and between textual
information and their own prior knowledge (Vermunt, 1992: 86). The self-
direction scale measures to what extent the learning process is directed by
the individual student. Vermunt (1992) used exploratory factor analysis to
support the discriminant validity of the different scales used in the ILS.
Also, the stability of the ILS scales was demonstrated.
Attitude
To answer the fourth research question, we constructed two attitude ques-
tionnaires: affective attitude towards reading (10 items) and cognitive atti-
tude towards usefulness of strategic reading strategies (12 items) (Ajzen,
1988, 1991). Students indicated the degree to which items applied to them
on Likert-scales (1 = totally disagree; 5 = totally agree). Examples of items
are ‘I hate reading’, ‘Reading is fun’ (affective attitude towards reading),
and ‘For me to understand a text properly, I think it is useful to first read the
beginnings and ends of paragraphs’ (cognitive attitude towards usefulness
of strategic reading activities).
2.4. Reliabilities
For analyses aimed at detecting relations between constructs at group level,
a reliability of 0.70 is regarded as acceptable, 0.80 and higher is regarded
as good (De Groot & Van Naerssen, 1969). Only the self-direction learning
style instrument has a rather low reliability (0.64). Reliabilities of all other
instruments are larger than 0.70 (see Table 1).
3. R ESULTS
The average score for reading comprehension is 29.7, with a standard devi-
ation of 8.1 (N = 141). Table 2 shows that, as expected, higher tracks of
secondary education have higher mean reading comprehension scores (see
‘observed means’). These mean scores cannot be seen as estimates of the
respective scores in the populations under consideration, but the magnitude
of the scores support the validity of the reading comprehension instrument.
STRATEGIC READING ACTIVITIES AND READING COMPREHENSION 95
TABLE 1
Test reliabilities (α = Cronbach’s alpha, k = number of items, N = number of subjects).
Test α k N
TABLE 2
Analysis of covariance with reading comprehension in Dutch as the dependent variable,
school type as factor and strategic reading activities as covariates.
df F P
(1) N = 125. (2) Adjusted R2 = 0.71. (3) Assumption of parallel regression lines (school
type x covariates): df = 12; F = 1.39; P = 0.185. Huitema’s inequality = 7/125 = 0.06. (4)
Maximum score to be obtained in reading comprehension = 47.
ments in the text, (b) predicting text content on the basis of the beginning
and end of paragraphs, (c) recognizing text passages with a high informa-
tion value, and (d) predicting text content on the basis of titles, headings
and illustrations.
The answer to the second research question is also in Table 2. After
correcting for the effects of students’ mastery of strategic reading activities
on reading comprehension, the factor ‘school type’ remains significant.
Based on differences between uncorrected averages, the difference in
reading comprehension between students of the lowest and the highest
school type is 16.75, i.e., more than two standard deviations (using the
standard deviation of the general average, which is 8.1). After correc-
tion for the effects of mastery of strategic reading activities, we still
have a difference of more than one standard deviation. Clearly no more
than half the difference in reading comprehension between students of
STRATEGIC READING ACTIVITIES AND READING COMPREHENSION 97
TABLE 3
Product-moment-correlations.
different school types can be traced to mastery of the four strategic reading
activities.
The answer to the second part of research question 2 (whether the
relations between reading comprehension and mastery of strategic reading
activities are equal for the four tracks of secondary education) is found
in the results of testing the assumption of parallel regression lines (see
Table 2, note 3). If an interaction effect occurs between the covariates
(the scores on the tests for strategic reading activities) on the one hand,
and the factor (school type) on the other, the regression lines do not run
parallel. Since the interaction is not significant (P = 0.185), we conclude
that relations between reading comprehension and mastery of strategic
reading activities are equal for the four tracks of secondary education.
In Table 3, product-moment correlations are presented between reading
comprehension and mastery of each of the four strategic reading activities
on the one hand, and the different attitude and learning style variables
on the other. We do not find a significant connection between learning
98 PETER BIMMEL AND ERIK VAN SCHOOTEN
style (self-direction and in-depth processing) on the one hand, and reading
comprehension and mastery of strategic reading activities on the other.
The strength of the relationships between attitudes towards reading
and usefulness of strategic reading activities on the one hand and reading
comprehension and mastery of strategic reading activities on the other
(fourth research question) can be found in Table 3. The relationship
between reading comprehension and attitude towards reading is low but
significant (r = 0.26, P < 0.05). Attitude towards the usefulness of stra-
tegic reading activities correlates negatively with all four indications of
mastery of strategic reading activities, although only for Skimming and
BEP correlation (respectively –0.25 and –0.26) are significant at 5%. We
did not perform regression or covariance analyses, since a precondition for
such analyses is that the independent variables are meaningfully related to
the dependent variable. Stevens (1986) mentions a correlation of 0.40 as
lower boundary.
Second, the results of our study do not support the claims of the
beneficial effects of ‘catering to student learning styles’. We found no rela-
tionship between reading comprehension and a meaning-oriented learning
style. This could mean that the level of meaning orientation in learning
style does not affect reading comprehension, or that the learning style
measurement is invalid. Prins, Busato, Hamaker and Visser (1996) and
Prins, Busato, Elshout and Hamaker (1998) used think aloud protocols
of first-year students of psychology learning content material and found
that Vermunt’s ILS has little connection to differences in strategic activ-
ities. Indeed, these researchers question the validity of the ILS. Phifer and
Glover (1982) had similar results; that is, students do not consistently apply
the strategies they say they use, and are not very proficient in applying the
strategies they say they use. The negative relationship we found between
students’ attitudes towards usefulness of strategic reading activities on the
one hand and their reading comprehension and mastery of strategic reading
activities on the other supports Lohman (1990) that training thinking skills
negatively affects the performance of students with high scores.
The causal chain appears to run from students’ reading comprehension
to their attitude towards usefulness of strategic reading activities. After
all, it seems unlikely that students’ reading comprehension is negatively
influenced by a positive attitude towards the usefulness of strategic reading
activities, or, conversely, that reading comprehension improves because of
a negative attitude. So, although more able students do seem to benefit
from the use of strategic reading activities, designing reading strategy
instruction for students with a high level of reading comprehension must
recognise average negative attitudes. One might say these students are
right. Why should they change their approach to reading texts if their
current approach is satisfactory? Since these competent students appear
to resist strategic reading activities and in fact, require less instruction for
reading improvement, it appears sensible to direct explicit teaching of the
strategies to students with lower reading proficiencies (and a positive atti-
tude toward strategic reading strategies). We suggest that, while all readers
could benefit from explicit teaching of the strategies, those less competent
will gain most substantially.
R EFERENCES
Ajzen, I. (1988). Attitudes, personality and behavior. Buckingham, UK: Open University
Press.
Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human
Decision Processes, 50, 179–211.
Alexander, P.A., Graham, S. & Harris, K.R. (1998). A perspective on strategy research:
Progress and prospects. Educational Psychology Review, 10, 129–154.
Alexander, P.A. & Jetton, T.L. (2000). Learning from text: A multidimensional and
developmental perspective. In R. Barr (Ed.), Handbook of reading research, Vol. III
(pp. 285–310). Hillsdale, New Jersey: Lawrence Erlbaum Associates.
Alvermann, D.E. & Moore, D.W. (1991). Secondary school reading. In R. Barr, M.L.
Kamil, P.B. Mosenthal & P.D. Pearson (Eds), Handbook of reading research, Vol. II
(pp. 951–983). New York: Longman.
Baker, L. & Brown, A.L. (1984). Metacognitive skills and reading. In P.D. Pearson (Ed.),
Handbook of reading research (pp. 353–394). New York: Longman.
Bereiter, C. & Bird, M. (1985). Use of thinking aloud in identification and teaching of
reading comprehension strategies. Cognition and Instruction, 2(2), 131–156.
Bimmel, P.E. (1999). Training en transfer van leesstrategieën. Training in de moedertaal
en transfer naar een vreemde taal – een effectstudie bij leerlingen uit het voortgezet
onderwijs. [Training and transfer of reading strategies. Training in the first language
and transfer to a foreign language – an intervention study with students in secondary
education.] ’s-Hertogenbosch, The Netherlands: Malmberg.
Bimmel, P., van den Bergh, H. & Oostdam, R. (2001). Effects of strategy training on
reading comprehension in first and foreign language. European Journal of Psychology
of Education, 16(4), 509.
Elley, W.B. (1992). How in the world do students read? IEA study of reading literacy. The
Hague: IEA.
Ellis, R. (1985). Understanding second language acquisition. Oxford: Oxford University
Press.
Fitzgerald, J. (1995). English-as-a-second-language learners’ cognitive reading processes:
a review of research in the United States. Review of Educational Research, 65(2), 145–
190.
Garner, R. (1987). Metacognition and reading comprehension. Norwood, New Jersey:
Ablex.
Goldman, S.R. & Rakestraw, J.A. (2000). Structural aspects of constructing meaning from
text. In R. Barr (Ed.), Handbook of reading research, Vol. III (pp. 311–335). Hillsdale,
New Jersey: Lawrence Erlbaum Associates.
Groot, A.D. de & Naerssen, R.F. van (1969). Studietoetsen. Construeren, afnemen, analys-
eren. [Educational testing. Construction, administration, analysis.] The Hague, The
Netherlands: Mouton.
Hoogeveen, M. & Bonset, H. (1998). Het schoolvak Nederlands onderzocht. Een inventar-
isatie van onderzoek naar onderwijs Nederlands als eerste en tweede taal in Nederland
en Vlaanderen. [An inventory of research into the teaching of Dutch as a first and second
language in the Netherlands and Flanders.] Apeldoorn, The Netherlands: Garant.
Hout-Wolters, B.H.A.M. van (1992). Cognitieve strategieën als onderwijsdoel. [Cognitive
strategies as an instructional aim.] Groningen, The Netherlands: Wolters-Noordhoff.
Kucan, L. & Beck, I.L. (1997). Thinking aloud and reading comprehension research:
Inquiry, instruction and social interaction. Review of Educational Research, 67(3),
271–299.
STRATEGIC READING ACTIVITIES AND READING COMPREHENSION 101
Lightbown, P.M. & Spada, N. (1999). How languages are learned. Oxford: Oxford
University Press.
Lohman, D.F. (1990). When good programs have bad effects on good students: Under-
standing mathemathanic effects in thinking skills programs. In M.J. Ippel & J.J. Elshout
(Eds), Training van hogere-orde denkprocessen (pp. 21–30). Amsterdam/Lisse, The
Netherlands: Swets & Zeitlinger.
Miller, C.D., Miller, H.F. & Rosen, L.A. (1988). Modified reciprocal teaching in a regular
classroom. Journal of Experimental Education, 56, 183–186.
Mulder, H.B.G.W.J. (1996). Training in leesstrategieën: vorm en rendement. Een
onderzoek naar het effect van vier trainingsvarianten op leesvaardigheid Frans als
vreemde taal. [Training of reading strategies – methods and effects. A study into the
effects of four training methods on reading comprehension in French as a foreign
language.] Amsterdam: Meulenhoff Educatief.
National Reading Panel (2000). Teaching children to read: an evidence-based assess-
ment of the scientific research literature on reading and its implications for reading
instruction. Retrieved from www.nichd.nih.gov/publications/nrp.
OECD (1998). Literacy, economy and society. Results of the first International Adult
Literacy Survey. Ontario: OECD/Statistics Canada.
OECD (2000). Literacy in the information age. Final report of the International Adult
Literacy Survey. Paris: OECD.
Paris, S.G., Wasik, B.A. & Turner, J.C. (1991). The development of strategic readers. In R.
Barr, M.L. Kamil, P.B. Mosenthal & P.D. Pearson (Eds), Handbook of reading research,
Vol. II (pp. 609–640). New York: Longman.
Paris, S.G., Wasik, B.A. & Van der Westhuizen, G. (1988). Meta-metacognition: A review
of research on metacognition and reading. In J. Readence & S. Baldwin (Eds), Dialogues
in literacy research. The 37th yearbook of the National Reading Conference (pp. 143–
166). Chicago, Illinois: National Reading Conference.
Pearson, P.D. & Dole, J.A. (1987). Explicit comprehension instruction: a review of research
and a new conceptualization of instruction. Elementary School Journal, 88(2), 151–165.
Pearson, P.D. & Fielding, L. (1991). Comprehension instruction. In R. Barr, M.L. Kamil,
M., P.B. Mosenthal & P.D. Pearson (Eds), Handbook of reading research, Vol. II
(pp. 815–860). New York: Longman.
Phifer, S.J. & Glover, J.A. (1982). Don’t take students’ word for what they do while
reading. Bulletin of the Psychonomic Society, 19(4), 194–196.
Pressley, M. (2000). What should comprehension instruction be the instruction of? In R.
Barr (Ed.), Handbook of reading research, Vol. III (pp. 545–561). Hillsdale, New Jersey:
Lawrence Erlbaum Associates.
Pressley, M. & Afflerbach, P. (1995). Verbal protocols of reading: the nature of construc-
tively responsive reading. Hillsdale, New Jersey: Lawrence Erlbaum Associates.
Prins, F.J., Busato, V.V., Hamaker, C. & Visser, K.H. (1996). Een bijdrage tot de validatie
van het (meta)cognitieve deel van de Inventaris Leerstijlen. [A contribution to the valida-
tion of the (meta)cognitive part of the Learning Styles Inventory.] Pedagogische Studiën,
73, 108–122.
Prins, F.J., Busato, V.V., Elshout, J.J. & Hamaker, C. (1998). Een nieuwe bijdrage tot de
validatie van het (meta)cognitieve deel van de Inventaris Leerstijlen (ILS). [A new contri-
bution to the validation of the (meta)cognitive part of the Learning Styles Inventory.]
Pedagogische Studiën, 75, 73–93.
Riding, R.J. (1997). On the nature of cognitive style. Educational Psychology, 17(1–2),
29–49.
102 PETER BIMMEL AND ERIK VAN SCHOOTEN
PETER BIMMEL
Graduate School of Teaching and Learning (ILO)
Amsterdam University
Wibautstraat 2–4
1091 GM Amsterdam
E-mail: pbimmel@wxs.nl