Graphic Organizers and Their Effects On The Reading Comprehension of Students With LD

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 14

Graphic Organizers and Their

Effects on the Reading


Comprehension of Students
with LD:
A Synthesis of Research

Ae-Hwa Kim, Sharon Vaughn, Jeanne Wanzek, and Shangjin Wei

Abstract
Previous research studies examining the effects of graphic organizers on reading comprehension for students with learning disabilities
(LD) are reviewed. An extensive search of the professional literature between 1963 and June 2001 yielded a total of 21 group design in-
tervention studies that met the criteria for inclusion in the synthesis. Using graphic organizers (i.e., semantic organizers, framed outlines,
cognitive maps with and without a mnemonic) was associated with improved reading comprehension overall for students with LD. Com-
pared to standardized reading measures, researcher-developed comprehension measures were associated with higher effect sizes. Initial
gains demonstrated when using graphic organizers were not revealed during later comprehension tasks or on new comprehension tasks.

G
raphic organizers are visual and the utility of graphic organizers by ex- pose more challenges than other read-
spatial displays designed to fa- amining reading as an information ing assignments (e.g., fiction). For
cilitate the teaching and learn- processing and storage process during example, expository text is more infor-
ing of textual material through the “use which graphic organizers may be used mation driven and may contain unfa-
of lines, arrows, and a spatial arrange- to display connections among concepts. miliar technical vocabulary. Moreover,
ment that describe text content, struc- Within the reading process, Mayer such text is often organized poorly
ture, and key conceptual relationships” suggested that the use of such organiz- and, consequently, requires students to
(Darch & Eaves, 1986, p. 310). Graphic ers may better allow readers to connect perform complex cognitive tasks in
organizers include semantic maps, se- their existing knowledge base with the order to comprehend the material
mantic feature analysis, cognitive maps, text information. (Lapp, Flood, & Ranck-Buhr, 1995).
story maps, framed outlines, and Venn By using graphic organizers, educa- Many students with LD who may al-
diagrams. tors hope to facilitate the readers’ un- ready have difficulty with reading and
Ausubel (1963) originally rational- derstanding of the text through visual study skills are challenged by the aca-
ized the use of graphic organizers by depictions of key terms and concepts demic domains of reading and inter-
speculating that a learner’s existing and the relationships among them preting expository text (Bryant, Ugel,
knowledge, which he referred to as (Simmons, Griffin, & Kame’enui, 1988). Thompson, & Hamff, 1999; Bryant
cognitive structure, greatly influences Of course, enhancing all students’ et al., 2000). Therefore, these students
his or her learning. When the cognitive reading comprehension is valuable, can benefit from learning strategies
structure expands and strengthens by but making such improvements is par- that facilitate the comprehension of
incorporating new information, learn- ticularly important and demanding this type of text. One strategy that has
ing occurs. To facilitate this process, when focusing on students with learn- often been recommended to assist stu-
graphic organizers provide learners ing disabilities (LD). As students dents with LD in learning from expos-
with a meaningful framework for re- progress through school, reading in- itory text is the use of graphic organiz-
lating their existing knowledge to the creasingly involves expository text ers (Bos & Vaughn, 2002; Rivera &
new information (Ausubel, 1963; Witt- from which students are expected to Smith, 1997; Taylor, Harris, & Pearson,
rock, 1992). Mayer (1984) reaffirmed learn; however, this type of text may 1988).

Downloaded from ldx.sagepub.com


JOURNAL OF atLEARNING
PENNSYLVANIA STATE UNIV on March 6, 2016
DISABILITIES
VOLUME 37, NUMBER 2, MARCH/APRIL 2004, PAGES 105–118
106 JOURNAL OF LEARNING DISABILITIES

Although practitioner journals or using graphic organizers constructed searchers to better understand the ef-
texts recommend the use of graphic or- by teachers, positioned before the text, fects of using graphic organizers to im-
ganizers as an effective strategy to pro- and used for a shorter time (Dunston, prove the reading comprehension of
mote the comprehension of expository 1992; Moore & Readence, 1980, 1984)— students with LD.
text (Blachowicz & Ogle, 2001; Boyle & overall, the effects of using graphic or-
Yeager, 1997; Hudson, Lignugaris- ganizers still appear to be inconclusive
Kraft, & Miller, 1993), the accumulated due to the variations in operational Method
body of research demonstrates incon- criteria in studies using graphic orga-
clusive findings for supporting such a nizers.
Study Selection
recommendation. Over the past 3 dec- In general, previous syntheses fo-
ades, researchers have conducted sev- cused on examining the effect of using We used a three-step process to iden-
eral syntheses of the research literature graphic organizers on the reading com- tify studies to include in the synthesis.
to analyze how the use of graphic or- prehension of students without LD. First, journal articles and dissertations
ganizers with expository text affects The one review that examined the ef- that met specific criteria were selected
students’ comprehension (Griffin & fect of using graphic organizers specif- from a meta-analysis by Swanson,
Tulbert, 1995; Moore & Readence, 1980, ically on the reading comprehension of Hoskyn, and Lee (1999), in which they
1984). In general, these syntheses re- students with LD (Griffin & Tulbert, systematically scanned online data-
vealed that using graphic organizers 1995) only included three studies. Be- bases (i.e., PsycINFO, MEDline, ERIC,
has small overall effects on students’ cause of this limited number of studies, and Dissertation Abstracts) for studies
comprehension of expository text. For it is not possible to reach definitive from 1963 to 1997. Criteria used to se-
example, Moore and Readence (1980, conclusions from the findings for stu- lect the studies for our synthesis in-
1984) conducted two meta-analyses to dents with LD. cluded the following:
examine the effects of graphic organiz- Although students with LD have dif- 1. Students in K–12. Participating stu-
ers on the comprehension of exposi- ficulty organizing and recalling verbal dents must have been in Grades K–12.
tory text. Their findings revealed small information (Wong, 1978), they may 2. Identified disability. Participants
overall effect sizes (.30 and .22, respec- perform nonverbal tasks fairly suc- must have included students with LD.
tively), which suggests a somewhat cessfully (Vellutino, Harding, Stager, & We used the same definition for LD as
limited value of using graphic organiz- Phillips, 1975). Similarly, researchers Swanson et al. (1999) provided in their
ers to promote comprehension. have argued that students with LD meta-analysis (i.e., average intelli-
In addition to these earlier analyses, have strengths in spatial or visual gence and poor performance in at least
Griffin and Tulbert (1995) reviewed modes of conceptualization (Pirozzolo one academic or related behavioral do-
several studies relating the use of & Rayner, 1979; Witelson, 1977). Thus, main).
graphic organizers to reading compre- one can hypothesize that visual dis- 3. Design. Research design must have
hension that yielded inconclusive find- plays of information, such as graphic been either a treatment–comparison de-
ings, which they attributed to varia- organizers, may help students with LD sign or a single-group design. Single-
tions in intervention designs and circumvent their difficulties with orga- subject design studies were not in-
instructional processes and to con- nizing and recalling verbal informa- cluded; however, we searched for such
founds with methodology. Similarly, tion, thereby enhancing their reading studies during a hand search of 10
Rice (1994) argued that the lack of con- comprehension. To determine how ef- journals and present these studies’
sistent operational criteria in studies fective the use of graphic organizers is findings in the discussion.
using graphic organizers contributed for enhancing the reading comprehen- 4. Independent variable. Intervention
to inconclusive findings. For example, sion of students with LD, a systematic must have been the use of graphic
instructional procedures for using synthesis of research is needed. Al- organizers (i.e., semantic feature analy-
graphic organizers varied by such fac- though most research on graphic orga- sis, semantic maps, or other visual or-
tors as text variables (e.g., type, con- nizers has focused on students without ganizers) either displaying concept re-
tent, level), originators (e.g., teachers LD, quite a few research studies have lationships discussed within the text or
vs. students), position relative to the been conducted specifically with stu- providing an outline/overview of the
text (e.g., before or after the text), and dents with LD. text. Graphic organizers not serving
outcome measures. Although several The purpose of this article is to sys- one of these purposes were not in-
reviews provided tenuous results on tematically review the findings of cluded (e.g., Bergerud, Lovitt, & Hor-
the differential effects of various graphic group design intervention studies ex- ton, 1988).
organizers—using graphic organizers amining the effect of graphic organiz- 5. Dependent variable. Reading com-
constructed by students, positioned ers on comprehension for students prehension must have been one of the
after the text, and used for a longer with LD. This synthesis is intended dependent measures, and this measure
time demonstrated greater effects than to assist practitioners and future re- had to assess students’ silent or oral

Downloaded from ldx.sagepub.com at PENNSYLVANIA STATE UNIV on March 6, 2016


VOLUME 37, NUMBER 2, MARCH/APRIL 2004 107

reading and their ability to answer ing questionable codes, the researchers same two studies were reported in
questions about the passage. For ex- met to resolve the ambiguities and more than one journal (Bos et al., 1985,
ample, several studies conducted by reach a decision by consensus. 1989). One article was excluded from
Bos and colleagues included a concept our synthesis because, although the use
measure, which assessed students’ Effect Size Calculation. For inter- of graphic organizers was mentioned
ability to apply the concepts presented vention studies with sufficient statisti- in the abstract, the authors did not in-
in the passage to real-life situations cal information, we calculated the ef- clude such an implementation in either
(Anders, Bos, & Filip, 1984; Bos & An- fect size, d. For treatment–comparison the intervention’s description or the re-
ders, 1990, 1992; Bos, Anders, Filip, & design studies, the effect size was cal- sults or discussion sections (Weisberg
Jaffe, 1985, 1989). The concept measure culated as the difference between the & Balajthy, 1990). These results led us
included passages for the students to intervention group’s mean posttest to review a total of 15 journal articles
read and demonstrate their under- score and the comparison group’s mean containing 21 separate intervention
standing by answering questions; posttest score divided by the pooled studies. Each study’s purpose, partici-
therefore, we considered this instru- standard deviation. A standardized pants, interventions, measures, and find-
ment a reading comprehension mea- mean change measure, on the other ings (i.e., effect sizes or descriptive
sure. hand, was used to calculate effect sizes findings) are described in Table 1 for
After the initial search, we con- for the single-group design studies the treatment–comparison design stud-
ducted a second set of computer (Becker, 1988). When the researchers ies and in Table 2 for the single-group
searches in PsycINFO and ERIC to lo- reported only a t or an F statistic, we es- design studies.
cate studies published between 1996 timated effect size by applying the fol-
and June 2001 that also met these crite- lowing formulas derived by Rosenthal
ria. Key words or root forms of them and colleagues (Rosenthal, 1991; Ro- Features of the
(i.e., reading comprehension, comprehen- senthal & Rosnow, 1984): Intervention Studies
sion, reading, learning disab*, reading
All of the studies included in this syn-
disab*, dyslex*) were entered in various d= 2t
thesis reported on interventions using
combinations to capture the greatest √ df
graphic organizers to improve the read-
possible number of articles. A final
ing comprehension of students with
search was conducted by hand in 10 d = 2√F LD. In the following sections, we de-
major journals related to the topic from √df (error)
scribe the interventions’ features in-
1996 through June 2001. Journals used
cluding participants, research designs,
in this final search included Applied When authors reported statistically
intervention variables, and compre-
Psycholinguistics, Exceptional Children, nonsignificant results with no addi-
hension measures.
Journal of Educational Psychology, Jour- tional information, we assigned 0 as
nal of Learning Disabilities, The Journal of the effect size (Bos et al., 1985, 1989).
Special Education, Learning Disability Assigning 0 to nonsignificant results Participants
Quarterly, Learning Disabilities Research has a conservative impact on the re-
& Practice, Remedial and Special Edu- sults (Cooper, 1998). We calculated ef- The 21 studies included a total of 848
cation, Reading Research Quarterly, and fect sizes for all but one study (i.e., students with LD. Moreover, 16 stu-
Reading and Writing. Boyle & Weishaar, 1997). We inter- dents with educable mental retarda-
preted effect sizes according to Co- tion were included in two of the stud-
hen’s (1988) guidelines: 0.2 as a small ies (Boyle, 1996, 2000). Four studies
Data Analysis
effect size, 0.5 as a medium one, and 0.8 also included students without disabil-
Coding Procedures. Through the as a large one. ities (n = 724; Horton et al., 1990, Stud-
use of extensive coding, we organized ies 1, 2, & 3; Lovitt, Rudsit, Jenkins,
the pertinent information from each Pious, & Benedetti, 1986); however,
intervention study, including age of Results when a study included such students,
participants, stated purpose, research the findings were disaggregated for
design, intervention variables, and re- A total of 21 intervention studies, students with LD (Horton et al., 1990,
ported findings. After this information which were all reported in journal arti- Studies 1, 2, & 3; Lovitt et al., 1986). Of
was double-coded for all of the articles, cles, met our criteria for inclusion in the 21 studies, 6 included high school
an interrater reliability of .96 (range = the synthesis. Six of these studies were students, another 6 included junior
.75 to 1.00) was found. Furthermore, reported in one article (Bos & Anders, high school students, and 5 included
the first author reviewed all code 1992), whereas another journal article elementary school students. Further-
sheets for comprehensiveness and ac- contained three studies (Horton, Lov- more, both elementary and junior high
curacy, and for the few cases contain- itt, & Bergerud, 1990). Moreover, the school students participated in one

Downloaded from ldx.sagepub.com at PENNSYLVANIA STATE UNIV on March 6, 2016


108

TABLE 1
Summary of Interventions: Treatment–Comparison Design Studies
Study/Participants Intervention Dependent measures Key findings (effect size)

Anders, Bos, & • T (Semantic feature analysis): A relationship ma- • Researcher-developed T vs. C (posttest): ES =
Filip (1984) trix with the major concepts and vocabulary from multiple-choice com- 1.52, p < .001
62 high school the passages. prehension test
students with LD • C (Dictionary instruction): Looking up difficult
words in the dictionary, writing their definitions,
and writing a sentence using each word.
• Duration/Intensity: Two 50-minute practice ses-
sions and two 50-minute experimental sessions
over 2 weeks.

Bos & Anders • T1 (Semantic mapping): A hierarchical relation- • Researcher-developed T1 vs. C (posttest): ES =
(1990) ship map from the vocabulary list. multiple-choice com- 1.31, p < .05
61 junior high • T2 (Semantic feature analysis): A relationship prehension test T1 vs. C (follow-up): ES =
students with LD matrix with the major concepts and vocabulary 0.50, ns
from the passages. T2 vs. C (posttest): ES =
• T3 (Semantic/syntactic feature analysis): Same 1.49, p < .05
as T2, but in this condition, using the matrix to T2 vs. C (follow-up): ES =
answer cloze-type sentences. 0.47, ns
• C (Definition instruction): Direct instruction on T3 vs. C (posttest): ES =
the definitions of the vocabulary terms. 1.22, p < .05
• Duration/Intensity: Three practice sessions and T3 vs. C (follow-up): ES =
three 50-minute experimental sessions over 1.43, p < .05
2 weeks.

Bos & Anders Phase I: Researchers implemented interventions • Researcher-developed T1, T2, T3 vs. C (posttest):
(1992) Study 1 in whole groups. multiple-choice com- ES = 0.81a
42 bilingual elementary • T1 (Semantic mapping) prehension test T1, T2, T3 vs. C (follow-up):
students with LD • T2 (Semantic feature analysis) ES = 0.86a
• T3 (Semantic/syntactic feature analysis)
• C (Definition instruction)
• Duration/Intensity: Three 50-minute practice ses-
sions and three 50-minute experimental ses-
sions over 2 weeks.

Bos & Anders (1992) Phase I: Researchers implemented interventions • Researcher-developed T1, T2, T3 vs. C (posttest):
Study 2 in whole groups. multiple-choice com- ES = 1.22a
61 junior high • Same as Study 1 prehension test T1, T2, T3 vs. C (follow-up):
students with LD ES = 0.78a

Bos & Anders (1992) Phase II: Special education teachers implemented • Researcher-developed T1, T2, T3 vs. C (posttest):
Study 3 interventions in whole groups. multiple-choice com- ES = 1.46a
47 bilingual elementary • T1 (Semantic mapping) prehension test
students with LD • T2 (Semantic feature analysis)
• T3 (Semantic/syntactic feature analysis)
• C (Definition instruction)
• Duration/Intensity: Three 50-minute practice ses-
sions and three 50-minute experimental ses-
sions over 2 weeks

Bos & Anders (1992) Phase II: Special education teachers implemented • Researcher-developed T1, T2, T3 vs. C (posttest):
Study 4 interventions in whole groups. multiple-choice com- ES = 1.51a
53 junior high • Same as Study 3 prehension test T1, T2, T3 vs. C (follow-up):
students with LD ES = 1.51a

Bos & Anders (1992) Phase III: Special education teachers implemented • Researcher-developed T1 vs. C (posttest): ES =
Study 5 interventions in small cooperative learning multiple-choice com- 0.48a
26 bilingual elementary groups. They acted as facilitators and coaches. prehension test T1 vs. C (follow-up): ES =
students with LD • T1 (Semantic mapping) 0.64a
(table continues)

Downloaded from ldx.sagepub.com at PENNSYLVANIA STATE UNIV on March 6, 2016


109

(Table 1 continued)

Study/Participants Intervention Dependent measures Key findings (effect size)

Bos & Anders (cont’d) • T2 (Semantic feature analysis) T2 vs. C (posttest): ES =


• C (Normative group): Average-achieving stu- 0.31a
dents who read same passages. T2 vs. C (follow-up): ES =
• Duration/Intensity: Three 50-minute practice ses- 0.06a
sions and three 50-minute experimental ses-
sions over 2 weeks.

Bos & Anders (1992) Phase III: Special education teachers implemented • Researcher-developed T1 vs. C (posttest): ES =
Study 6 interventions in small cooperative learning multiple-choice com- 2.25a
22 junior high groups. They acted as facilitators and coaches. prehension test T1 vs. C (follow-up): ES =
students with LD • Same as Study 5 0.81a
T2 vs. C (posttest): ES =
0.18a
T2 vs. C (follow-up): ES =
0.76a

Bos, Anders, Filip, & • T (Semantic feature analysis) • Researcher-developed T vs. C (posttest): ES =
Jaffe (1985); • C (Dictionary instruction) multiple-choice com- 1.69, p < .001
Bos, Anders, Filip, & • Duration/Intensity: Four 50-minute experimental prehension test T vs. C (follow-up): ES = 0,
Jaffe (1989) sessions over 2 weeks. ns
50 high school
students with LD

Boyle (1996) • T (Cognitive mapping strategy–TRAVEL): • Formal Reading Inven- T vs. C (posttest): ES =
30 sixth, seventh, and Topic –Write down the topic and circle it. tory : Comprehension 0.35, ns
eighth graders with Read–Read a paragraph. • CB: Below grade level, ES = 0.89, p < .05
LD or EMR (20 with Ask–Ask what the main idea and three details are literal
LD) and write them down. • CB: Below grade level, ES = 0.78, p < .05
Verify–Verify the main idea by circling it and linking inferential
its details. • CB: On grade level, ES = 1.37, p < .05
Examine–Examine the next paragraph and ask literal
and verify again. • CB: On grade level, ES = 0.98, p < .05
Link–When finished with the story, link all of the inferential
circles. • SDRT ES = 0.48, ns
• C: Typical reading techniques.
• Duration/Intensity: Six 50-minute sessions over
two weeks.

Boyle (2000) • T (Cognitive mapping strategy–RELATE): • CB with two-topic pas- T vs. C (posttest): ES =
24 ninth and tenth Read quickly to locate each topic. sage, literal 1.22, p < .05
graders with LD or Etch out one circle for each topic. • CB with two-topic pas-
EMH (18 with LD) Look for ideas unique to each topic and those sage, inferential ES = 0.78, ns
related to more than one topic as you start to • CB with two-topic pas-
read. sage, relational ES = 1.03, p < .05
Anchor three unique ideas for each topic in each • CB with three-topic
circle. passage, literal ES = 1.18, p < .05
Tie together two or three ideas related to two of • CB with three-topic
the topics. passage, inferential ES = 0.36, ns
Enclose three ideas related to all three topics. • CB with three-topic
• C: Typical reading techniques. passage, rational ES = 0.87, p < .05
• Duration/Intensity: Two 50-minute sessions over
1 week.

Boyle & Weishaar • T1 (Student-generated cognitive organizer– • CB: Below grade level, T1 vs. T2 vs. C (posttest):
(1997) TRAVEL): Students learned the cognitive map- literal, Below grade • T1 > C on all four mea-
39 tenth, eleventh, ping strategy TRAVEL (see Boyle, 1996). level, inferential, On sures, p < .05
and twelfth graders • T2 (Expert-generated cognitive organizer– grade level, literal, On • T2 > C on one of four
with LD TRAVEL): Students used organizers created by grade level, inferential measures (below grade
• SDRT level literal), p < .05

(table continues)

Downloaded from ldx.sagepub.com at PENNSYLVANIA STATE UNIV on March 6, 2016


110 JOURNAL OF LEARNING DISABILITIES

(Table 1 continued)

Study/Participants Intervention Dependent measures Key findings (effect size)

Boyle & Weishaar the researchers using the TRAVEL strategy to • T1 > T2 group on one of
(cont’d) guide them during reading. four measures (below
• C: Typical reading techniques. grade level, literal), p <
• Duration/Intensity: Eight 50-minute sessions over .05
2 weeks. Overall ns

Darch & Carnine • T (Visual display): A visual display of the concept • Researcher-developed T vs. C (posttest): ES =
(1986) relationships within each unit. multiple-choice com- 1.79, p < .01
24 fourth, fifth, and • C (Text): Typical teacher-initiated group instruc- prehension test T vs. C (transfer test): ES =
sixth graders with LD tion. 0.67, ns
• Duration/Intensity: Nine 50-minute sessions over
2 weeks.

Darch & Eaves (1986) • T (Visual display): Same as Darch & Carnine • Researcher-developed T vs. C (posttest): ES =
22 high school (1986) multiple-choice com- 1.34, p < .01
students with LD • C (Text): Same as Darch & Carnine (1986) prehension test T vs. C (follow-up): ES =
• Duration/Intensity: Twelve 50-minute sessions 0.36, ns
over 3 weeks. T vs. C (transfer test): ES =
−0.67, ns

Darch & Gersten • T (Advanced organizer): An outline or overview • Researcher-developed T vs. C (posttest): ES =
(1986) of facts and concepts from a lesson that showed multiple-choice com- 1.78, p < .01
24 high school the relationships among the concepts. prehension test
students with LD • C (Basal reading): Lesson through a lecture and
discussion format with students’ independent
reading and self-study.
• Duration/Intensity: Nine 50-minute sessions over
2 weeks.

Griffin, Simmons, & • T (Graphic organizers): Graphic organizers re- • Researcher-developed T vs. C (posttest): ES =
Kame’enui (1991) flecting the hierarchical relationships among the oral free retell 0.47, ns
28 fifth and sixth ideas in the chapters. • Researcher-developed T vs. C (posttest): ES =
graders with LD • C (List of facts): Vertical lists of information. production compre- 0.43, ns
• Duration/Intensity: Four 45-minute sessions over hension test T vs. C (follow-up): ES =
1 week. • Researcher-developed −0.16, ns
multiple-choice com- T vs. C (posttest): ES =
prehension test 0.59, ns
T vs. C (follow-up): ES =
0.32, ns

Note. T = treatment; C = comparison; ES = effect size; ns = nonsignificant; LD = learning disabilities; EMR = educable mental retardation; EMH = educable mental
handicapped; CB = curriculum-based measure; SDRT= Stanford Diagnostic Reading Test.
aES was reported in an original study, but the study did not provide results from significant tests.

study (Sinatra, Stahl-Gemake, & Berg, Intervention Variables tic/syntactic feature analysis (n = 9;
1984), whereas Horton et al. (1990, Anders et al., 1984; Bos & Anders, 1990;
Studies 1, 2, & 3) examined both junior Types of Interventions. Although Bos & Anders, 1992, Studies 1, 2, 3, 4, 5,
high and high school students in three all of the studies used graphic organiz- & 6; Bos et al., 1985, 1989).
of their studies. ers in their interventions, researchers 2. Cognitive maps with a mnemonic are
chose a variety of graphic organizers. implemented by a teacher/researcher
A cross-study analysis revealed four or student to construct a cognitive map
Research Design
types of graphic organizers; through the use of a mnemonic (e.g.,
All of the studies employed group de- 1. Semantic organizers represent rela- TRAVEL, RELATE) that displays con-
signs. More specifically, studies em- tionships between concepts and fea- cept relationships in a unit (n = 3; Boyle,
ployed either a treatment–comparison tures of concepts (e.g., related vocabu- 1996, 2000; Boyle & Weishaar, 1997).
design (n = 16) or a single-group with lary) and include semantic mapping, 3. Cognitive maps without a mnemonic
multiple treatments design (n = 5). semantic feature analysis, and seman- display the various concept relation-

Downloaded from ldx.sagepub.com at PENNSYLVANIA STATE UNIV on March 6, 2016


VOLUME 37, NUMBER 2, MARCH/APRIL 2004 111

TABLE 2
Summary of Interventions: Single-Group Design Studies
Study/Participants Intervention Dependent measures Key findings (effect size)

Horton, Lovitt, & • T (Teacher-directed graphic organizer): Students • Analysis of student- T vs. C (posttest): ES =
Bergerud (1990) read a passage, and the teacher provided mod- generated graphic 1.85a, p < .01
Study 1 eling and guided practice on constructing a organizers
8 students with LD graphic organizer.
(5 middle school • C (Self-study): Students’ independent reading
and 3 high school and self-study by taking notes.
students); 163 • Duration/Intensity: Two 45-minute sessions over
students without 1 week.
disabilities

Horton, Lovitt, & • T (Student-directed graphic organizer with refer- • Analysis of student- T vs. C (posttest): ES =
Bergerud (1990) ential cues): Students read a passage and inde- generated graphic 5.07a, p < .01
Study 2 pendently completed a graphic organizer with organizers
8 students with LD text references.
(5 middle school • C (Self-study): Same as Study 1.
and 3 high school • Duration/Intensity: Same as Study 1.
students); 163
students without
disabilities

Horton, Lovitt, & • T (Student-directed graphic organizer with • Analysis of student- T vs. C (posttest): ES =
Bergerud (1990) clues): Students read a passage and indepen- generated graphic 3.22a, p < .05
Study 3 dently completed the graphic organizer with a organizers
4 students with LD list of clues.
(3 middle school • C (Self-study): Same as Study 1.
students and 1 high • Duration/Intensity: Same as Study 1.
school student);
226 students
without disabilities

Lovitt, Rudsit, Jenkins, • T (Adapted text): Each adapted chapter con- • Laidlaw comprehen- T vs. C (posttest): ES =
Pious, & Benedetti tained three framed outlines and two vocabulary sion test (i.e., match- 0.80, p < .05
(1986) exercises. ing and multiple-
30 seventh graders • C (Regular text): No modification on text. choice questions)
with LD; • Duration/Intensity: More than 12 weeks.
172 seventh graders
without disabilities

Sinatra, Stahl-Gemake, • T (Mapping readiness approach): Three types of • Researcher-developed T vs. C (posttest): ES =
& Berg (1984) maps: (a) episodic webs, (b) thematic or descrip- multiple-choice com- 0.96, p < .05
27 students with LD tive maps, and (c) classification maps. prehension test
from second to • C (Verbal readiness approach): A traditional di-
eighth grades rect-teaching reading lesson.
• Duration/Intensity: More than 16 weeks.

Note. T = treatment; C = comparison; ES = effect size; LD = learning disabilities.


aES was calculated based on disaggregated findings for students with LD.

ships in a unit (n = 7; Darch & Carnine, dents identify main ideas and impor- The interventions in the other two stud-
1986; Darch & Eaves, 1986; Griffin, tant facts (n = 2; Darch & Gersten, 1986; ies lasted 12 to 16 weeks with an unre-
Simmons, & Kame’enui, 1991; Horton Lovitt et al., 1986). ported total number of sessions (Lovitt
et al., 1990, Studies 1, 2, & 3; Sinatra et al., 1986; Sinatra et al., 1984).
et al., 1984). Duration/Intensity of Interventions.
4. Framed outlines consist of graphi- In 19 of the studies, the interventions Persons Implementing Interven-
cally represented lesson outlines or lasted between 1 week and 3 weeks, re- tions. Across the studies, either teach-
overviews that help teachers and stu- sulting in a range of 2 to 12 sessions. ers (n = 13), researchers (n = 6), or

Downloaded from ldx.sagepub.com at PENNSYLVANIA STATE UNIV on March 6, 2016


112 JOURNAL OF LEARNING DISABILITIES

teachers–researcher (n = 2) delivered fects by type of graphic organizers, effects of cognitive maps with mne-
the interventions. grade levels of participants (i.e., ele- monics in comparison with conven-
mentary, junior high, or high school), tional reading techniques to read the
Persons Generating Graphic Orga- persons implementing interventions, passage (e.g., taking notes; Boyle, 1996,
nizers. Teachers and researchers gen- persons generating graphic organizers, 2000). The results revealed that stu-
erated the graphic organizers in 16 of types of measurements, and additional dents who used cognitive maps with
the studies. The graphic organizers in measures (i.e., follow-up tests and mnemonics outperformed those using
these studies included two types: transfer tests). We reviewed treatment– conventional reading techniques on a
comparison design studies first, and reading comprehension test (d = 0.91
1. those generated prior to instruction then single-group design studies were and 0.81, respectively). In the third
and used during instruction (e.g., reviewed to confirm or disconfirm study, the effects of using student-
Darch & Gersten, 1986; Horton these initial findings. generated versus expert-generated
et al., 1990, Study 1), and cognitive organizers with mnemonics
2. those generated prior to instruction Types of Graphic Organizers. The were compared with each other and
but left incomplete for the teacher use of different graphic organizers (i.e., with a comparison condition in which
or researcher to fill out with the semantic organizers, cognitive maps the students used conventional read-
students during instruction (e.g., with and without a mnemonic, and ing techniques to read the passage
Anders et al., 1984). framed outlines) and the effect sizes as- (Boyle & Weishaar, 1997). Overall, the
sociated with the use of each organizer student-generated cognitive organizer
In four other studies, the students are presented. was more effective in improving stu-
themselves generated one of two dif- Semantic organizers. Nine treatment– dents’ reading comprehension than the
ferent types of graphic organizers: comparison design studies by Bos and expert-generated cognitive organizer
colleagues revealed consistent findings and the comparison condition. Although
1. independently student-generated for the effects of semantic organizers the students who used the student-
ones (Boyle, 1996, 2000), or on reading comprehension. Students generated cognitive organizer outper-
2. blank ones designed by the teacher with LD who used semantic organiz- formed the students in the comparison
and filled in by the students inde- ers demonstrated significantly higher condition on four comprehension mea-
pendently (Horton et al., 1990, scores on researcher-developed com- sures (p < .05), the students who used
Studies 2 & 3). prehension measures than students in the expert-generated cognitive orga-
comparison groups (i.e., receiving dic- nizer outperformed the students in the
One final study included both teacher- tionary instruction, normative compa- comparison condition on one compre-
generated and student-generated rison group). In eight of the nine hension measure (p < .05). The student-
graphic organizers and compared their studies, semantic organizers were as- generated cognitive organizer group
effects (Boyle & Weishaar, 1997). sociated with large effect sizes (d = outperformed the expert-generated
0.81–1.69). Semantic organizers in the cognitive organizer group on one com-
ninth study were associated with a prehension measure (p < .05).
Comprehension Measures
small to medium effect size (d = 0.40; Cognitive maps without a mnemonic.
Across the studies, several different Bos & Anders, 1992, Study 5). The rel- Seven studies examined the effects of
types of measures were used to assess atively small effect size in this study cognitive maps without a mnemonic
reading comprehension. In a majority (Bos & Anders, 1992, Study 5), how- on students’ reading comprehension
of the studies (n = 18), only researcher- ever, may have been caused by the (Darch & Carnine, 1986; Darch &
developed tests were used. Two stud- comparison group being composed of Eaves, 1986; Griffin et al., 1991; Horton
ies included both researcher-developed students without LD and actually rep- et al., 1990, Studies 1, 2, & 3; Sinatra
tests and standardized reading tests resents a more positive outcome—stu- et al., 1984). The use of cognitive maps
(Boyle, 1996; Boyle & Weishaar, 1997), dents with LD using semantic orga- was associated with higher compre-
and one study used a curriculum- nizers performed slightly better than hension scores than comparison condi-
based assessment developed by a text- typically developing students. tions (i.e., typical reading instruction)
book publishing company (Lovitt et al., Cognitive maps with a mnemonic. in two treatment–comparison group
1986). Three treatment–comparison design design studies (d = 1.79 and 1.34 re-
studies by Boyle and colleagues exam- spectively; Darch & Carnine, 1986; Darch
ined the effects of using cognitive & Eaves, 1986). Four single-group de-
Findings
maps with mnemonics on students’ sign studies also demonstrated the
We summarized the findings from in- reading comprehension. In two of the positive effects of using cognitive
tervention studies by examining the ef- studies, the researchers examined the maps on students’ reading compre-

Downloaded from ldx.sagepub.com at PENNSYLVANIA STATE UNIV on March 6, 2016


VOLUME 37, NUMBER 2, MARCH/APRIL 2004 113

hension (d = 0.96–5.07; Horton et al., ies and with a mean ES of 0.80 (k = 1) ated the graphic organizers (i.e., teach-
1990, Studies 1, 2, & 3; Sinatra et al., in a single-group design study. Finally, ers, researchers, or students), groups
1984). On the other hand, Griffin et graphic organizers were associated using such visual displays signifi-
al. (1991) found that such cognitive with a mean ES of 0.79 (k = 7) for ele- cantly outperformed those in compar-
maps did not significantly enhance the mentary school students in treatment– ison conditions (i.e., conventional
reading comprehension of students comparison design studies. reading techniques, self-study) in these
with LD (d = 0.50, p > .05); however, two studies (Horton et al., 1990, Stud-
this nonsignificant finding may have Persons Implementing Interven- ies 1 & 2).
resulted from the comparison condi- tions. Whether researchers, teachers,
tion in this study being very similar to or researcher–teachers implemented Types of Measures. Twenty of the
the intervention condition. For instance, the intervention, the use of graphic or- 21 studies used researcher-developed
both groups received similar instruc- ganizers was associated with large ef- comprehension tests as their primary
tion (i.e., a structured overview) in the fect sizes in treatment–comparison de- dependent measures, and only 2 of
Griffin et al. (1991) study, whereas in sign studies (d = 0.96, k = 17; d =1.05, these 20 studies also included stan-
other studies, students in the compari- k = 12; and d = 1.61, k = 2; respectively). dardized reading tests (Boyle, 1996;
son groups received different instruc- A mean ES of 2.38 (k = 5) was also Boyle & Weishaar, 1997). Intervention
tion (e.g., using dictionaries, reading found for the single-group design effects based on researcher-developed
basals) from those in the intervention studies in which a teacher led the reading tests were significantly larger
groups using cognitive maps. graphic organizer instruction. than those based on standardized tests.
Framed outlines. Two studies exam- In fact, neither of the two studies
ined the effects of using framed out- Persons Generating Graphic Orga- using standardized reading tests re-
lines on the reading comprehension of nizers. Regardless of who generated ported significant differences between
students with LD. One treatment– the graphic organizers (i.e., teachers, the graphic organizer intervention (i.e.,
comparison group design study found researchers, or students), large effect cognitive maps with mnemonics) and
that students using framed outlines sizes were found. For studies in which comparison conditions (Boyle, 1996;
significantly outperformed those in teachers or researchers generated the Boyle & Weishaar, 1997). However,
comparison conditions (i.e., reading graphic organizers, the mean effect when researcher-developed tests were
basals) on a reading comprehension sizes ranged from 1.15 (k = 19) for used as the comprehension measures,
test (d = 1.78; Darch & Gersten, 1986). treatment–comparison design studies students using cognitive maps per-
This finding was confirmed by a single- to 1.20 (k = 3) for single-group design formed significantly better than stu-
group design study that demonstrated studies. Similarly, large effect sizes dents in the comparison group (Boyle,
positive effects of using framed out- were found for studies using student- 1996; Boyle & Weishaar, 1997).
lines on students’ reading comprehen- generated graphic organizers: 0.86 (k =
sion (d = 0.80; Lovitt et al., 1986). 12) for treatment–comparison design Additional Measures. In addition
studies and 4.15 (k = 2) for single-group to posttest comprehension measures,
Participants’ Grade Levels. For this design studies. One study compared eight of the treatment–comparison de-
particular analysis, we included only the effects of using a student-generated sign studies conducted follow-up tests
those studies conducted at one school graphic organizer with those of using a that contained questions similar to those
level (i.e., elementary, junior high, or researcher-generated graphic orga- on the posttests about the reading
high school). We found no significant nizer (Boyle & Weishaar, 1997). The re- passage used in the intervention. Al-
differences across grade levels for the sults revealed that the use of a student- though the differences between the
effects of using graphic organizers on generated graphic organizer yielded graphic organizer and comparison
students’ reading comprehension scores. higher comprehension scores than did groups were greater on posttests (d =
The use of graphic organizers consis- the implementation of a researcher- 1.04) than on follow-up tests (d = 0.60),
tently related to large effect sizes across generated graphic organizer on one of the mean effect size obtained on follow-
grade levels. For example, high school four comprehension measures ( p < up tests was still large.
students using graphic organizers re- .05). Two additional single-group de- Two treatment–comparison design
ceived higher comprehension scores sign studies also demonstrated that studies included transfer tests, which
than those in comparison conditions using student-generated graphic orga- assessed students’ abilities in applying
(e.g., using dictionaries, self-study; d = nizers was associated with larger effect a graphic organizer to a new reading
1.18; k = 10). For junior high school stu- sizes than using teacher-generated passage (Darch & Carnine, 1986; Darch
dents, graphic organizer use was asso- graphic organizers (Horton et al., 1990, & Eaves, 1986). No statistically signifi-
ciated with a mean ES of 1.08 (k = 13) Studies 1 & 2). It is important to note, cant differences between graphic orga-
in treatment–comparison design stud- however, that regardless of who gener- nizer groups and comparison groups

Downloaded from ldx.sagepub.com at PENNSYLVANIA STATE UNIV on March 6, 2016


114 JOURNAL OF LEARNING DISABILITIES

on transfer tests were found for either ceive such training—a comparison that In addition to analyzing the effects
study. yielded small to medium effect sizes. by grade levels, we examined the in-
Due to the differences in the general fluence that those implementing the
academic achievement of these two intervention had on the outcomes.
Discussion groups, it is difficult to interpret these Both teacher- and researcher-directed
results. A better test of the effectiveness graphic organizer interventions were
Our examination of the effects of of using graphic organizers would be associated with large effect sizes. In
graphic organizers on the reading to assign students with LD randomly fact, higher effect sizes resulted from
comprehension of students with LD re- to either the graphic organizer or the teachers rather than researchers lead-
vealed overall beneficial outcomes comparison condition and not to in- ing the graphic organizer instruction in
across the studies. In general, our find- clude other types of students. treatment–comparison design studies
ings support the use of semantic orga- The third study (Griffin et al., 1991) (d = 0.96 and 1.05 respectively)—a find-
nizers, cognitive maps with and with- in which nonsignificant results were ing that is slightly different from a pre-
out mnemonics, and framed outlines found included a comparison group vious synthesis that examined the
to promote these students’ reading com- who received similar instruction (i.e., a effects of multiple interventions on
prehension. Across the board, when structured overview) to the interven- students with LD and revealed that
the students were taught to use tion group but in a different format. researcher-directed interventions were
graphic organizers, large effect sizes The intervention group received the in- generally associated with more posi-
were demonstrated on researcher- formation in the form of a graphic tive outcomes than teacher-directed
developed reading comprehension post- organizer, whereas the comparison ones (Swanson et al., 1999). Rather
tests. Thus, visual displays of informa- group was given a list format. It is im- than having a researcher or a teacher
tion such as those provided by graphic portant to note that this was the only lead the intervention, a few of the stud-
organizers enhance the reading com- study reviewed in which the compari- ies included what they called a teacher–
prehension of students with LD, possi- son group received the same key in- researcher as the director of the inter-
bly by helping these students organize formation from the text as the inter- vention (Anders et al., 1984; Bos et al.,
the verbal information and thereby im- vention group. Based on this study’s 1985, 1989). Although the interventions
proving their recall of it. results, it may be the practice of ex- under the teacher–researcher’s direc-
The results reported in this synthesis tracting important information from tion resulted in higher effect sizes than
are impressive given that a majority of the text that promotes reading compre- the teacher-directed interventions, these
the 21 studies reviewed included both hension, and not the specific graphic studies did not provide a clear defini-
treatment and comparison conditions. organizer per se; however, further re- tion of what they meant by teacher–
The inclusion of comparison condi- search on specific graphic organizer researcher, which makes the difference
tions makes it possible for significantly features is needed to support this in- between these studies and the other
higher effects to be due to the inter- terpretation. ones difficult to understand. Neverthe-
vention (i.e., using graphic organizers) With respect to the effectiveness of less, the high effect sizes obtained from
rather than to general learning or fac- using graphic organizers across grade the teacher-directed interventions show
tors other than the intervention. The levels, our analysis demonstrated ef- the feasibility of implementing graphic
changes in comprehension reported in fective outcomes at the elementary and organizer techniques in the classroom
these treatment–comparison design secondary levels for the use of graphic setting.
studies, therefore, are greater than organizers. Only one study (Sinatra Although all of these different analy-
what would be expected from stan- et al., 1984) included students at the ses revealed positive effects of using
dard instruction. lower elementary level (i.e., second and graphic organizers to improve the read-
Of the three studies reviewed that third grades), and the researchers did ing comprehension of students with
did not yield significantly more posi- not disaggregate the data for this sam- LD, it is important to note that the
tive effects for the intervention group ple of students from that of older ele- reading comprehension measures that
than for the comparison group, two mentary students, thereby making a a majority of these studies used were
studies (Bos & Anders, 1992, Studies 5 separate interpretation of the benefits developed by the researchers them-
& 6) included average achievers in their for lower elementary students diffi- selves and were aligned closely with
comparison groups instead of students cult. Due to the lack of focus that this the intervention content. In fact, only
with LD. In these two studies, the re- and other studies placed on lower ele- two studies included standardized
searchers trained the intervention mentary school students, the positive reading tests, and neither of these stud-
group (i.e., students with LD) to use outcomes demonstrated for the use of ies reported statistically significant dif-
graphic organizers and then compared graphic organizers in our analysis are ferences between the intervention and
their performance to that of average- limited to the upper elementary and comparison conditions when such
achieving students who did not re- secondary grade levels. tests were used. Furthermore, despite

Downloaded from ldx.sagepub.com at PENNSYLVANIA STATE UNIV on March 6, 2016


VOLUME 37, NUMBER 2, MARCH/APRIL 2004 115

the findings that students participating graphic organizers to new reading sit- the comprehension of the content
in the interventions outperformed those uations—a hypothesis supported by taught, but whether such gains would
in comparison groups on reading com- other research showing that students generalize to other independent read-
prehension assessments, few partici- with LD often have difficulty learning ing situations and what part the
pants reached comprehension levels to generalize without specific instruc- graphic organizers played in this
above 80% on the measures. In studies tion (Deshler & Schumaker, 1993). process are not clear.
yielding significant effect sizes, the A second issue relates to the compar-
mean posttest scores ranged from 48% ison conditions used in the treatment–
Methodological Issues
to 83% correct, with 15 of the 29 comparison design studies and whether
posttests yielding means below 70%. Findings from this synthesis confirmed they were robust enough to provide
Based on these findings, then, the use the findings of previous reviews on high standards against which the ef-
of graphic organizers is not sufficient graphic organizers used with students fects of graphic organizer interven-
for ensuring that students will obtain without disabilities showing that there tions could be measured (Gersten,
acceptable levels of understanding. has been a lack of consistent opera- Baker, & Lloyd, 2000; Pressley & Har-
Related to this finding, high effect tional criteria for what constitutes a ris, 1994). Only one study compared
sizes were found on posttests and graphic organizer. In our corpus of the use of graphic organizers to other
follow-up tests but not on transfer studies, the graphic organizers varied specific comprehension strategies (i.e.,
tests. In a majority of the studies using by type (e.g., semantic organizers, a structured overview) that might be
follow-up tests, both these and the framed outlines), originators (i.e., considered comparable with the inter-
posttests addressed the specific pas- teacher, researcher, or student), and vention condition. In all of the other
sages that students had been taught person implementing the intervention studies, the researchers compared their
previously, which means essentially (Dunston, 1992; Moore & Readence, interventions with much more distal
that the use of graphic organizers was 1980, 1984). However, the duration of forms of instruction (e.g., typical read-
an effective instructional tool for teach- the interventions and outcome mea- ing instruction) and, thereby, demon-
ing the content of specific passages. sures were fairly consistent across the strated only that using graphic orga-
However, these studies provided no studies; a majority of them lasted for a nizers is superior to typical instruction
evidence to show that students could short time and assessed students’ read- in reading or content-area comprehen-
transfer the use of graphic organizers ing comprehension with researcher- sion. Research comparing graphic or-
to understand other passages. In fact, developed posttests. ganizer interventions to other, more
no statistically significant differences Whereas our overall findings are specific reading comprehension strate-
were found when researchers used positive, several methodological issues gies would help educators to ascertain
transfer assessments—meaning that in the studies limit the practical im- whether using graphic organizers is a
students did not transfer their skills plications of these results. First, the less strong, equally strong, or superior
(i.e., using graphic organizers) to novel type of measures used to assess strategy for comprehending text.
reading situations. These findings are comprehension performance was one A third issue relates to the duration
supported by similar results reported major concern of the study. All of of the interventions. The duration of
in another synthesis focusing on read- the studies yielding significant results most of the interventions was short,
ing comprehension strategies in gen- used researcher-developed assess- ranging between 1 week and 3 weeks,
eral (Gersten, Fuchs, Williams, & Baker, ments, whereas none of the studies with only two interventions lasting
2001). One explanation for the findings using standardized reading tests re- longer than 10 weeks (Lovitt et al.,
in our synthesis might be these studies’ ported significant results on such tests. 1986; Sinatra et al., 1984; 12 weeks and
short intervention times (i.e., 1–3 weeks Paralleling these findings, previous 16 weeks, respectively). Such short in-
in 19 studies). Longer intervention du- meta-analyses revealed that higher ef- tervention periods may relate to the
rations may be necessary for students fect sizes were more likely to be ob- limited effects found for the use of
to use graphic organizers more easily tained on nonstandardized measures graphic organizers on more general-
and independently in novel situations. developed by researchers than on stan- ized measures such as standardized
To support this hypothesis, the use dardized tests (Elbaum, Vaughn, reading tests and transfer tests.
of graphic organizers related to more Hughes, & Moody, 2000; Swanson et A fourth issue is that a majority of
positive outcomes when the interven- al., 1999). Furthermore, most of the the interventions used graphic orga-
tion offered longer instruction and train- studies used the same passage for both nizers generated by teachers or re-
ing (Alvermann & Boothby, 1986; Bean, the intervention’s implementation and searchers, instead of teaching students
Singer, Sorter, & Frazee, 1986). Along its assessment. Taking our findings in to generate their own graphic organiz-
with longer interventions, researchers conjunction with these meta-analyses’ ers. Only four studies implemented the
may need to include specific instruc- results, we can conclude that partici- use of graphic organizers as a student-
tion on how to generalize the use of pants in our synthesis made gains in directed strategy. Rather than focusing

Downloaded from ldx.sagepub.com at PENNSYLVANIA STATE UNIV on March 6, 2016


116 JOURNAL OF LEARNING DISABILITIES

on how graphic organizers act as learn- (Gardill & Jitendra, 1999). Interest- lower elementary students). Related to
ing tools to help students become more ingly, this study did not focus on using this, it is unknown if students need to
independent readers, most of the stud- such graphic organizers to aid stu- read at a certain level before being able
ies in this synthesis focused on how dents with the comprehension of ex- to use graphic organizers effectively. If
graphic organizers can act as instruc- pository text, like the studies included this is the case, future lines of research
tional tools for teachers to improve in our synthesis, but instead related might include examining the effects of
their students’ reading comprehension this strategy to understanding narra- using graphic organizers with students
of specific texts. tive text. at various reading levels and on
Finally, the same research teams con- younger students’ listening compre-
ducted the research on particular types hension (i.e., a possible precursor to
of graphic organizers (e.g., semantic Implications for Future Research reading comprehension).
organizers by Bos and colleagues; cog- Third, as discussed earlier, the lit-
nitive maps using mnemonics by Boyle Although the current literature pro- erature has focused more on improv-
and colleagues). Such a lack of corrob- vides evidence supporting the use of ing students’ reading comprehension
oration across research teams and their graphic organizers to promote reading through teacher instruction with graphic
interventions limits the reported evi- comprehension among students with organizers than through students’ in-
dence supporting the use of graphic LD, future research on such graphic or- dependent use of graphic organizers.
organizers. Replication of the interven- ganizer use should focus on several Further research needs to clarify
tions by other researchers would help factors including measuring compre- whether students’ use of graphic orga-
to ascertain whether the use of specific hension with standardized reading nizers independently is an effective
types of graphic organizers is an effec- tests, examining interventions with strategy to enhance their reading com-
tive strategy for improving students’ lower elementary school students, prehension. Researchers must also
reading comprehension. using graphic organizers with inde- keep in mind both the type of graphic
pendent reading, comparing the use of organizers (e.g., semantic organizers,
complex versus simple graphic orga- framed outlines) and the duration of
Limitations nizers, comparing graphic organizer instruction as factors influencing how
interventions with other comprehen- effective students’ use of graphic or-
In this synthesis, we included the find- sion strategies, and replicating the ganizers independently can be at im-
ings from all of the group design stud- present research findings. proving students’ reading comprehen-
ies conducted between 1963 and June As described in our results, the first sion.
2001 that examined how effective the of these factors—measuring reading A fourth potentially important re-
use of graphic organizers is at improv- comprehension with standardized read- search area involves examining the
ing the reading comprehension of stu- ing assessments—was not addressed effectiveness–efficiency ratio for spe-
dents with LD. Our synthesis did not, in a majority of studies included in our cific types of graphic organizers. Spe-
however, include single-subject design synthesis. Furthermore, the two stud- cifically, researchers must further in-
studies. Although we recognize the im- ies that included standardized reading vestigate the differential effects of
portance of examining such studies, tests did not demonstrate positive ef- using complex versus simple graphic
previous syntheses of interventions fects for the use of graphic organizers organizers on students’ comprehen-
have reported separate summaries for on such tests. Thus, further research sion and the differences in teacher sus-
group design and single-subject design examining the effects of using graphic tainability of using complex versus
studies (e.g., Swanson et al., 1999), and organizers on reading comprehension simple graphic organizers in their in-
we chose to model our synthesis after as measured by standardized tests is struction. For example, some graphic
these previous syntheses. Future re- warranted to ascertain whether graphic organizers (i.e., semantic feature analy-
search to address single-subject design organizers are effective tools for im- sis) take a long time to teach from or
studies on graphic organizers is war- proving scores on more distal compre- complete, and if student gains in com-
ranted to extend this current finding. hension measures. prehension are minimal, the use of
Despite the lack of a formal search for A second area for future research fo- such organizers may be of little value.
and analysis of such studies, we did in- cuses on the types of students who can A fifth area on which future research
clude them during our hand search of benefit from using graphic organizers. might focus lies in comparing the ef-
10 journals to make an informal com- The reviewed studies conducted graphic fects of using graphic organizers with
parison between this study’s findings organizer interventions with upper el- other comprehension strategies. Knowl-
and our synthesis’ findings. We uncov- ementary, junior high, and high school edge of the conditions under which
ered one article examining the effects students, which demonstrates a lack of graphic organizer use is superior or in-
of using story maps on the reading information about how to use graphic ferior to other reading strategies will
comprehension of students with LD organizers with younger students (i.e., assist educators in choosing the appro-

Downloaded from ldx.sagepub.com at PENNSYLVANIA STATE UNIV on March 6, 2016


VOLUME 37, NUMBER 2, MARCH/APRIL 2004 117

priate comprehension instruction for Anders, P. L., Bos, C. S., & Filip, D. (1984). Boyle, J. R. (1996). The effects of a cognitive
students with LD. Furthermore, stud- The effect of semantic feature analysis on mapping strategy on the literal and infer-
ies using these types of comparisons the reading comprehension of learning ential comprehension of students with
and demonstrating positive effects for disabled students. In J. A. Niles & L. A. mild disabilities. Learning Disability Quar-
Harris (Eds.), Changing perspectives on terly, 19, 86–98.
using graphic organizers will generate
reading/language processing and instruction Boyle, J. R. (2000). The effects of a Venn di-
greater confidence in such interven-
(pp. 162–166). Rochester, NY: National agram strategy on the literal, inferential,
tions as helpful instructional practices Reading Conference. and relational comprehension of students
for teaching students with LD. Ausubel, D. P. (1963). The psychology of with mild disabilities. Learning Disabili-
In addition to more in-depth studies meaningful verbal learning. New York: ties: A Multidisciplinary Journal, 10(1), 5–
of graphic organizer use within these Grune & Stratton. 13.
different areas, future research needs Bean, T. W., Singer, H., Sorter, J., & Frazee, Boyle, J. R., & Weishaar, M. (1997). The ef-
to replicate the specific graphic orga- C. (1986). The effect of metacognitive in- fects of expert-generated versus student-
nizer methods explored in the present struction in outlining and graphic orga- generated cognitive organizers on the
studies. Only three studies examining nizer construction on students’ compre- reading comprehension of students with
the use of graphic organizers with stu- hension in a tenth-grade world history learning disabilities. Learning Disabilities
dents with LD have been conducted in class. Journal of Reading Behavior, 18, 153– Research & Practice, 12, 228–235.
the last 10 years. Moreover, generally 169. Boyle, J. R., & Yeager, N. (1997). Blueprints
speaking, each research team studied Becker, B. J. (1988). Synthesizing standard- for learning: Using cognitive frameworks
ized mean-change measures. British Jour- for understanding. Teaching Exceptional
one type of graphic organizer. Repli-
nal of Mathematical and Statistical Psychol- Children, 29(4), 26–31.
cation of these studies by various re-
ogy, 41, 257–278. Bryant, D. P., Ugel, N., Thompson, S., &
searchers across different settings is Hamff, A. (1999). Instructional strategies
Bergerud, D., Lovitt, T. C., & Horton, S.
necessary in order to generalize about (1988). The effectiveness of textbook for content-area reading instruction. In-
the benefits of the intervention tech- adaptations in life science for high school tervention in School and Clinic, 34, 293–302.
niques. students with learning disabilities. Jour- Bryant, D. P., Vaughn, S., Linan-Thompson,
nal of Learning Disabilities, 21, 70–76. S., Ugel, N., Hamff, A., & Hougen, M.
Blachowicz, C., & Ogle, D. (2001). Reading (2000). Reading outcomes for students
ABOUT THE AUTHORS with and without reading disabilities in
comprehension: Strategies for independent
readers. New York: Guilford Press. general education middle-school content
Ae-Hwa Kim, PhD, is a member of the faculty area classes. Learning Disability Quarterly,
Bos, C. S., & Anders, P. L. (1990). Effects of
in the Dept. of Special Education at Dankook 23(3), 24–38.
interactive vocabulary instruction on the
University in Seoul, Korea. Her research inter-
vocabulary learning and reading com- Cohen, J. (1988). Statistical power analysis for
ests include effective reading interventions and
prehension of junior-high learning dis- the behavioral sciences. Hillsdale, NJ: Erl-
technology applications for students with learn-
abled students. Learning Disability Quar- baum.
ing disabilities. Sharon Vaughn, PhD, is the
terly, 13, 31–42. Cooper, H. (1998). Synthesizing research: A
H. E. Hartfelder/Southland Corp. Regents Pro-
Bos, C. S., & Anders, P. L. (1992). Using in- guide for literature reviews (3rd ed.). Thou-
fessor and director of The University of Texas at
teractive teaching and learning strategies sand Oaks, CA: Sage.
Austin Center for Reading and Language Arts.
to promote text comprehension and con- Darch, C., & Carnine, D. (1986). Teaching
Her research addresses social and academic out-
tent learning for students with learning content area material to learning disabled
comes for students with learning disabilities
disabilities. International Journal of Disabil- students. Exceptional Children, 53, 240–
and reading difficulties. Jeanne Wanzek, MA,
ity, Development, and Education, 39, 225– 246.
is a doctoral student in special education at The
University of Texas at Austin. Her research in- 238. Darch, C., & Eaves, R. (1986). Visual dis-
terests include effective instructional practices Bos, C. S., Anders, P. L., Filip, D., & Jaffe, plays to increase comprehension of high
for students with learning disabilities. Shang- L. E. (1985). Semantic feature analysis school learning-disabled students. The
jin Wei, MA, is a doctoral student in special and long-term learning. In J. A. Niles & Journal of Special Education, 20, 309–318.
education at The University of Texas at Austin. R. V. Lalik (Eds.), Issues in literacy: A re- Darch, C., & Gersten, R. (1986). Direction-
Address: Ae-Hwa Kim, Dankook University, search perspective (pp. 42–47). Rochester, setting activities in reading comprehen-
Department of Special Education, San #8, NY: National Reading Conference. sion: A comparison of two approaches.
Hannam-dong, Yongsan-gu, Seoul, Korea 140- Bos, C. S., Anders, P. L., Filip, D., & Jaffe, Learning Disability Quarterly, 9, 235–243.
714; aehwa@dankook.ac.kr L. E. (1989). Effects of an interactive in- Deshler, D. D., & Schumaker, J. (1993). Strat-
structional strategy for enhancing read- egy mastery by at-risk students: Not a
ing comprehension and content learning simple matter. Elementary School Journal,
REFERENCES for students with learning disabilities. 94, 153–167.
Journal of Learning Disabilities, 22, 384– Dunston, P. J. (1992). A critique of graphic
Alvermann, D. E., & Boothby, P. R. (1986). 390. organizer research. Reading Research and
Children’s transfer of graphic organizer Bos, C. S., & Vaughn, S. (2002). Strategies for Instruction, 31(2), 57–65.
instruction. Reading Psychology, 7(2), 87– teaching students with learning and behavior Elbaum, B. E., Vaughn, S., Hughes, M. T., &
100. problems (5th ed.). Boston: Allyn & Bacon. Moody, S. W. (2000). How effective are

Downloaded from ldx.sagepub.com at PENNSYLVANIA STATE UNIV on March 6, 2016


118 JOURNAL OF LEARNING DISABILITIES

one-to-one tutoring programs in reading Karlsen, B., & Garduel, E. F. Stanford Di- Rosenthal, R. (1991). Meta-analytic proce-
for elementary students at risk for read- agnostic Reading Test (4th ed.). San An- dures for social research. Thousand Oaks,
ing failure? Journal of Educational Psychol- tonio, TX: Harcourt Educational Mea- CA: Sage.
ogy, 92, 605–619. surement. Rosenthal, R., & Rosnow, R. L. (1984). Es-
Gardill, M. C., & Jitendra, A. K. (1999). Ad- Lapp, D., Flood, J., & Ranck-Buhr, W. sentials of behavioral research: Methods and
vanced story map instruction: Effects on (1995). Using multiple text formats to ex- data analysis. New York: McGraw-Hill.
reading comprehension of students with plore scientific phenomena in middle Simmons, D. C., Griffin, C. C., &
learning disabilities. The Journal of Special school classrooms. Reading and Writing Kame’enui, E. J. (1988). Effects of teacher-
Education, 33, 2–17. Quarterly: Overcoming Learning Difficul- constructed pre- and post-graphic orga-
Gersten, R., Baker, S., & Lloyd, J. W. (2000). ties, 11, 173–186. nizer instruction on sixth-grade science
Designing high-quality research in spe- students’ comprehension and recall. Jour-
Lovitt, T., Rudsit, J., Jenkins, J., Pious, C., &
cial education: Group experimental de- nal of Educational Research, 82(1), 15–21.
Benedetti, D. (1986). Adapting science
sign. The Journal of Special Education, 34, Sinatra, R. C., Stahl-Gemake, J., & Berg,
materials for regular and learning dis-
2–18. D. N. (1984). Improving reading compre-
abled seventh graders. Remedial and Spe-
hension of disabled readers through
Gersten, R., Fuchs, L. S.,Williams, J. P., & cial Education, 7(1), 31–39.
mapping. The Reading Teacher, 38(l), 22–
Baker, S. (2001). Teaching reading com- Mayer, R. E. (1984). Aids to text compre- 29.
prehension strategies to students with hension. Educational Psychologist, 19(1), Swanson, H. L., Hoskyn, M., & Lee, C.
learning disabilities: A review of re- 30–42. (1999). Interventions for students with learn-
search. Review of Educational Research, 71,
Moore, D. W., & Readence, J. E. (1980). A ing disabilities. New York: Guilford Press.
279–320.
meta-analysis of the effects of graphic or- Taylor, B., Harris, L., & Pearson, P. D. (1988).
Griffin, C. C., Simmons, D. C., & Kame’- ganizers on learning from text. In M. L. Reading difficulties: Instruction and assess-
enui, E. J. (1991). Investigating the effec- Kamil & A. J. Moe (Eds.), Perspectives in ment. New York: Random House.
tiveness of graphic organizer instruction reading research and instruction: Twenty- Vellutino, F., Harding, C., Stager, J., &
on the comprehension and recall of sci- ninth yearbook of the National Reading Con- Phillips, F. (1975). Differential transfer in
ence content by students with learning ference (pp. 213–217). Washington, DC: poor and normal readers. Journal of Ge-
disabilities. Reading, Writing, and Learning National Reading Conference. netic Psychology, 126, 3–18.
Disabilities, 7, 355–376.
Moore, D. W., & Readence, J. E. (1984). A Weisberg, R., & Balajthy, E. (1990). Devel-
Griffin, C. C., & Tulbert, B. L. (1995). The ef- quantitative and qualitative review of opment of disabled readers’ metacompre-
fect of graphic organizers on students’ graphic organizer research. Journal of Ed- hension ability through summarization
comprehension and recall of expository ucational Research, 78, 11–17. training using expository text: Results of
text: A review of the research and impli- three studies. Journal of Reading, Writing,
Pirozzolo, F. J., & Rayner, K. (1979). Cere-
cations for practice. Reading and Writing and Learning Disabilities International, 6(2),
bral organization and reading disability.
Quarterly: Overcoming Learning Difficul- 117–136.
Neuropsychologia, 17, 485–491.
ties, 11, 73–89. Witelson, S. (1977). Developmental dys-
Horton, S. V., Lovitt, T. C., & Bergerud, D. Pressley, M., & Harris, K. R. (1994). More
lexia: Two right hemispheres and none
(1990). The effectiveness of graphic orga- about increasing the quality of educa-
left. Science, 195, 309–311.
nizers for three classifications of sec- tional intervention research: A synthesis.
Wittrock, M. C. (1992). Knowledge acquisi-
ondary students in content area classes. Educational Psychology Review, 6, 191–208.
tion and comprehension. In M. C. Alkin
Journal of Learning Disabilities, 23, 12–22. Rice, G. E. (1994). Need for explanations in (Ed.), Encyclopedia of educational research
Hudson, P., Lignugaris-Kraft, B., & Miller, graphic organizer research. Reading Psy- (6th ed., pp. 699–705). New York: Mac-
T. (1993). Using content enhancements to chology: An International Quarterly, 15, 39– millan.
improve the performance of adolescents 67. Wong, B. (1978). The effects of directive
with learning disabilities in content Rivera, D. P., & Smith, D. (1997). Teaching cues on the organization of memory and
classes. Learning Disabilities Research & students with learning and behavior prob- recall in good and poor readers. Journal of
Practice, 8, 106–126. lems (3rd ed.). Boston: Allyn & Bacon. Educational Research, 72, 32–38.

Downloaded from ldx.sagepub.com at PENNSYLVANIA STATE UNIV on March 6, 2016

You might also like