Oliver-InvestigationConceptMapping-2009

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 14

An Investigation of Concept Mapping to Improve the Reading Comprehension of Science

Texts
Author(s): Kevin Oliver
Source: Journal of Science Education and Technology , Oct., 2009, Vol. 18, No. 5 (Oct.,
2009), pp. 402-414
Published by: Springer

Stable URL: https://www.jstor.org/stable/20627720

REFERENCES
Linked references are available on JSTOR for this article:
https://www.jstor.org/stable/20627720?seq=1&cid=pdf-
reference#references_tab_contents
You may need to log in to JSTOR to access the linked references.

JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide
range of content in a trusted digital archive. We use information technology and tools to increase productivity and
facilitate new forms of scholarship. For more information about JSTOR, please contact support@jstor.org.

Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
https://about.jstor.org/terms

Springer is collaborating with JSTOR to digitize, preserve and extend access to Journal of
Science Education and Technology

This content downloaded from


140.122.53.95 on Mon, 20 Nov 2023 09:04:13 +00:00
All use subject to https://about.jstor.org/terms
J Sei Educ Technol (2009) 18:402-414
DOI 10.1007/s 10956-009-9157-3

An Investigation of Concept Mapping to Improve the Reading


Comprehension of Science Texts
Kevin Oliver

Published online: 4 March 2009


? Springer Science+Business Media, LLC 2009

Abstract This study investigated how well 74 6th-grade expository textbooks. Graphic organizers are recom
science students represented text structures from a 900 mended because they provide visual scaffolds that
word textbook chapter on soil conservation, given a con encourage students to extract and represent key details in
cept map template with four superordinate terms and 24 their texts (e.g., sequences, causes and effects, problems
unsorted concepts. Findings suggest students were more and solutions, points of view). While several types of
successful at classifying pre-selected terms under given graphic organizers exist, the concept map is a particularly
superordinate categories than they were at fully identifying useful graphic because it requires students to express in
relevant concept sets and articulating three different rela writing how two linked concepts are related. This relating
tionship types between terms. No significant differences of concepts may aid in reading comprehension, since
were noted in the mapping performance of students at expository texts are often embedded with relational struc
different reading levels. About two-third of students indi tures, including comparative (X is different from Y),
cated they enjoyed concept mapping and would prefer to causative (X results in F), explanatory (X is also known as
both read and map rather than just read without mapping. y), and sequential (X precedes Y). For example, a student
Students also expressed a strong preference for mapping in may be more likely to comprehend the embedded causative
pairs or small groups compared to mapping alone. Multiple relationship between low potassium and high blood pres
recommendations are provided for improving the relational sure, if they are encouraged by the graphic organizer to
thinking of students tasked with concept mapping exposi read for how these concepts might be related and write
tory science texts, including bridging to more open-ended "results in" between them. More simplistic graphic orga
maps, embedding mapping in longer-term inquiry projects, nizers might only require students to connect these
and leveraging collaborative and tool-based scaffolds. concepts or group them in a visual display, with the precise
nature of the relationship remaining undefined or implicit
Keywords Concept mapping Reading comprehension at best. The purpose of this preliminary study is to inves
Literacy Science education tigate the effectiveness of concept mapping on student
comprehension of specific text structures from a repre
sentative chapter of a sixth grade science text. Research
Introduction questions include:

1. Is a computer-based concept map template with given


Reading comprehension strategies are recommended for
superordinate terms and underlying concepts effective
students struggling to construct meaning from unfamiliar
at helping students reconstruct different text structures
from their science textbook?
2. Does student mapping performance vary by reading
ability?
K. Oliver (El) 3. What are student and teacher reactions to the concept
North Carolina State University, Raleigh, NC, USA mapping task?
e-mail: kevin_oliver@ncsu.edu

_} Springer

This content downloaded from


140.122.53.95 on Mon, 20 Nov 2023 09:04:13 +00:00
All use subject to https://about.jstor.org/terms
J Sei Educ Technol (2009) 18:402^14 403

Literature Review cutting?causes?erosion). This combination of concepts


and linking words creates a "proposition" that may be
Teachers and researchers have observed for decades that evaluated for accuracy (Cardellini 2004).
students lack strategies to effectively read and comprehend Written propositions are the key to distinguishing a
textbooks (Berkowitz 1986; Carnine and Carnine 2004; concept map from other graphic organizers. This is an
Rivard and Yore 1992). To improve reading comprehension, important distinction in studies of reading comprehension,
the National Reading Panel (2000) recommends teaching given the extra step of articulating relationships between
comprehension strategies in the content areas and conduct concepts may impact on the comprehension and recall of
ing additional research on the effectiveness of strategies for embedded text structures. Authors of expository texts use
comprehending texts, including expository or fact-based specific text structures to organize material, and concept
texts. Expository texts are considered more difficult for maps may assist readers in recognizing and understanding
learners to comprehend than familiar narrative material, and these structures (Burdumy et al. 2006; Harniss et al. 1994;
science teachers in particular whose expository texts contain Meyer et al. 1980). Compare-contrast, cause-effect,
unfamiliar facts, processes, and vocabulary, should be explanation, and sequencing are four commonly used
cognizant of strategies to support student reading compre structures to organize text (Burdumy et al. 2006). By
hension (Burdumy et al. 2006; Miller 2006; Rivard and Yore examining student use of relational language in a concept
1992). map, one can infer how well a student comprehends spe
Reading comprehension is defined as the active process of cific structures in a text (e.g., a student may use the
"simultaneously extracting and constructing meaning relational words "is different from" when conveying a
through interaction and involvement with written language" compare-contrast text structure, or "results in" when
(Snow 2002, p. 11). It is recommended that students be conveying a cause-effect text structure).
taught multiple strategies to improve their reading compre The concept map is not the only map type that can teach
hension, including predicting and summarizing, questioning, students about relationships, but it has its advantages.
and using graphic organizers (Burdumy et al. 2006; Zmach Using diagrams such as "double bubble maps" where
et al. 2007). Research indicates seven categories of text students compare and contrast two key concepts such as
comprehension instruction are effective, including the "use mammals and amphibians by filling-in "bubbles" or empty
of graphic and semantic organizers... where readers make circles clustered around those concepts, students can infer
graphic representations of the material to assist compre concepts on one side of the map are different from concepts
hension" (National Reading Panel 2000, p. 15). on the other side of the map without actually writing the
relational words "is different from" (Piercy and Hyerle
Graphic Organizers and Reading Comprehension 2004, p. 68). Likewise, with "multi-flow maps" where
students write causes such as plate tectonics on the left side
The Institute for the Advancement of Research in Educa of a map and effects such as earthquakes and volcanoes on
tion (2003) reviewed nine scientifically based research the right side of a map, students can infer certain concepts
studies conducted in grades K-12 since 1984 on the use of lead to or result in other concepts/effects without actually
graphic organizers to improve reading comprehension. writing the relational word "causes." These maps, how
Results affirm graphic organizers can be a useful aid to ever, tend to emphasize one relationship type while the
improve reading comprehension. It should be noted, how concept map is more flexible for representing multiple
ever, the term "graphic organizer" is used loosely to relationship types a student would likely encounter in texts
describe semantic maps, story maps, Venn diagrams, (i.e., comparative, causative, explanatory, sequential).
occasionally concept maps, and more. Other common maps include tree maps, mind maps, and
The concept map is a specific type of graphic organizer semantic maps, but these associate concepts in "like"
students can use to understand text structures and improve categories without requiring the learner to articulate precise
reading comprehension. In a typical concept mapping relationships between pairs of terms. Concept mapping has
activity, the instructor selects a limited domain of knowl additional value as one of few approaches that can be
edge to be mapped (Novak and Gowin 1984). This domain applied to pre-reading, during reading, and post-reading
is tied to course material such as a required reading, a lab phases (Chang et al. 2002).
experiment, or an applied problem. The student is given or
identifies their own key concepts in the domain and Studies of Concept Mapping and Reading
arranges them from general to specific and by type. The Comprehension
student draws lines between concepts to illustrate rela
tionships and writes linking words on these connecting Concept mapping is generally thought to hold diagnostic
lines to describe the nature of the relationship (e.g., clear value for reading comprehension. For example, Anderson

Springer

This content downloaded from


140.122.53.95 on Mon, 20 Nov 2023 09:04:13 +00:00
All use subject to https://about.jstor.org/terms
404 J Sei Educ Technol (2009) 18:402-414

and Huang (1989) found 131 eighth grade students' scores and Vee diagramming were study strategies given to a
on a concept mapping test that followed a 500-word treatment group compared to a more typical outlining
reading on leaf processes and functions correlated better method applied by a control group (Lehman et al. 1985). A
with standardized vocabulary and reading comprehension test of students' understanding of 32 key relationships in
tests, as well as reading and science grades in school, than the material approached significance favoring a better
did a more traditional short answer test that was also understanding of relationships by the treatment group. No
administered following the reading. Other studies have significant differences in content understanding were noted
demonstrated how concept mapping in specific forms may between the two groups.
support aspects of reading comprehension. Chang et al. (2002) compared three methods of concept
Schmid and Telaro (1990) compared a group of high mapping on the text comprehension and summarization
school biology students that created multiple concept maps abilities of 125 fifth grade students across seven science
across a 4-week unit of instruction against a comparison readings. A scaffold fading group studied or completed a
group that did not. No significant differences were noted sequence of maps beginning with expert maps containing
between groups on test items that measured knowledge and all concepts and links, moving to skeletal maps containing
comprehension. However, significant differences were partial structure, and finishing with more complex open
noted on items that measured relational thinking for stu ended maps that required the student to provide all struc
dents of low reading ability who outperformed their low ture. A map correction group was given a complete
ability counterparts and performed as well as their high structure, but one that was partially incorrect requiring
ability counterparts in the comparison group. The authors them to process and correct the map. Finally, a map gen
suggest it may be important to test for higher-ability rela eration group was required to provide the structure for all
tional thinking to observe the potential effects of mapping. of their open-ended maps. Text comprehension and sum
To foster relational thinking, researchers suggest it may marization ability scores were significantly higher for the
help to give students a specific learning goal as they engage map correction group. The strategy was suggested to pro
their reading. In a study with 50 university students, Curry vide the scaffolding benefits of a partially correct map,
et al. (1999) presented learners with a 60-page hypertext while incorrect elements encouraged students to actively
program on Lyme disease structured in six sections (e.g., process text to identify errors. The text comprehension
history, transmission). Students in a general condition were scores of scaffold fading and map generation groups were
asked to read the hypertext and later represent the infor not significantly different from those of a control group,
mation they had accessed as an open-ended concept map. suggesting how a concept map task is structured may
Students in a learning goal condition were asked to read a influence the degree to which reading comprehension can
scenario about a man with Lyme disease, access the be influenced. The summarization ability of the scaffold
hypertext to determine how accurately the scenario fading group was greater than the control group, though,
depicted the disease, then create a concept map. While suggesting some benefits for this approach, if somewhat
there were no significant differences in the details recalled less than the map correction approach. It should be noted
in students' maps, findings suggest the readers given a this study also employed a unique computer-based map
learning goal were significantly more likely to generate ping system that provided learners with a limited amount of
relational maps with unique cross links that informed the system feedback on the correctness of a map (e.g., per
goal, compared to students in the general condition who centage of right corrections).
tended to create hierarchical maps similar to the original Concept maps are a promising strategy for improving
hypertext. This finding suggests a goal paired with text may reading comprehension, particularly for helping learners
help readers focus on important text and provide "a understand relationships used by the authors of expository
framework on which to make new connections in their texts. As noted by Chang et al. (2002), p. 6, however,
reading that may not have been apparent had the text been concept mapping has been successfully applied to the
presented without goals and objectives" (p. 50). learning of science, but only "a limited amount of research
Stice and Alvarez (1987) investigated concept mapping has been conducted on its application to linguistic con
with nine elementary school teachers and their students. tent." A recent review of graphic organizer studies to
Teachers discovered that mapping helped students better improve reading comprehension listed semantic matrices
understand relationships between concepts such as com and hierarchies as the intervention of choice without a
pare-contrast and cause-effect. Further, students who had single concept map study reviewed (Kim et al. 2004). Even
difficulty reading incomplete texts were able to identify when "concept mapping" is cited as a treatment to improve
gaps in these selections through concept mapping. reading comprehension, researchers haven't always
In a study with 250 urban high school students studying required subjects to supply relational language between
biology texts and laboratory exercises, concept mapping concepts?an important step suggested to assist students in

Springer

This content downloaded from


140.122.53.95 on Mon, 20 Nov 2023 09:04:13 +00:00
All use subject to https://about.jstor.org/terms
J Sei Educ Technol (2009) 18:402-414 405

comprehending specific text structures (see, for example, participating teacher. Student participants were 57% male,
Berkowitz 1986; Boyle and Weishaar 1997; Brookbank 43% female, 74% Caucasian, 14% African-American, and
et al. 1999; Guastello et al. 2000; Prater and Terry 1988). 11% Hispanic. Eight English as a Second Language (ESL)
One possible explanation for the limited number of students and four Exceptional Children (EC) with behav
concept mapping studies for improved reading compre ioral or social disabilities were included in the population
hension may be the tendency for concept maps to be consistent with county immersion policies.
employed more frequently as instructional tools than as The average student percentile score on the state's end
assessment tools (Ruiz-Primo and Shavelson 1996), with of fifth grade reading comprehension test was low at 40
few teachers able to invest the significant time that is (n = 60 available scores), suggesting this was a group that
required to score student maps as a form of alternative could benefit from reading comprehension intervention
assessment. With new computer tools that scaffold both strategies such as concept mapping. The distribution of test
efficient student generation of maps and in some cases scores placed 18 students in the lowest quartile, 23 in the
teacher scoring of the map as it relates to an expert crite second quartile, 13 in the third quartile, and 5 in the highest
rion, the strategy is becoming more approachable to quartile.
educators and worthy of continued study. Regarding prior experience with concept maps, 60% of
Given the great variability in concept mapping methods participants indicated they had previously created concept
that employ multiple task structures and scoring systems maps with relational language, 90% indicated they had
(Ruiz-Primo and Shavelson 1996), it is important to created maps on computers, but no student indicated they
bracket the mapping conditions that are unique to this had ever used Cmap software.
particular study in helping students reconstruct different
text structures from science texts. Since providing students Procedures
with some scaffolds rather than completely open-ended
map tasks may lead to better reading comprehension The researcher received human subjects approval from the
(Chang et al. 2002), the conditions in this study include a university Institutional Review Board (IRB). Students were
concept map template given to students with both super trained to use Cmap Tools (IHMC 2007) concept mapping
ordinate terms and a list of underlying concepts to arrange software during two 45-min class periods. Training con
and relate. Results are specific to these conditions. sisted of a brief demonstration of the software where the
researcher constructed a concept map about birds using
input from students in a whole-class discussion format,
Method followed by students individually creating a biographical
concept map about themselves on day one. On day two,
This study of concept mapping for reading comprehension students individually completed a training map similar to
is based on a mixed methods concurrent nested design with the map task they would encounter in the actual study by
a quantitative strand (research question two) embedded in a mapping 14 pre-selected terms from a short reading on the
predominantly qualitative case study. The researcher's role game of basketball.
was that of participant-observer, on-site at the school and To begin the actual study, students read a 900-word
assisting teacher and students in the computer lab textbook chapter on soil conservation in their regular
throughout the study period. classroom. Students then spent an additional two 45-min
class periods individually mapping 24 pre-selected terms
Participants and Setting from the textbook chapter in the computer lab. The training
and mapping period lasted 1 week, with data from a tea
This study took place in a suburban public middle school in cher interview and student survey collected the following
the southern United States in 2007. Specifically, students week.
completed their concept maps in the 6th grade computer
lab with 30 Internet-connected iMacs. The school serves Materials
~650 students in grades 6-8 with 34% of students on free/
reduced lunch. This school was chosen for research based Students utilized Cmap Tools software (IHMC 2007) to
on interest expressed in concept mapping by the partici edit concept maps. This freeware product was selected
pating teacher. The teacher had applied and attended a 2 from among other network-enabled and web-based map
day concept-mapping seminar led by the researcher the ping tools because it prompts students to input a
summer prior to the study. relationship statement between every pair of linked con
Student participants included three 6th grade earth sci cepts. Finding a tool that required relationship writing was
ence classes with 74 students, all taught by the same key, since scientific reading material emphasizes cause

_} Springer

This content downloaded from


140.122.53.95 on Mon, 20 Nov 2023 09:04:13 +00:00
All use subject to https://about.jstor.org/terms
406 J Sei Educ Technol (2009) 18:402-414

effect and explanatory relationships, and it was desirous to on site, a semi-structured teacher interview recorded at the
know how well students comprehended those relationships. end of the study period, and an 18-item student survey.
Other tools allow students to cluster hierarchies and flow Researcher field notes served to document study proce
charts, or brainstorm mind maps, without explicitly stating dures, student behaviors, and personal assumptions that
how term sets are related. were challenged by emerging data. The semi-structured
All students read a 900-word chapter from their state interview documented the teacher's opinions on how well
science textbook on soil conservation. Students were given concept mapping aided student comprehension, how
a concept map template to sort and relate 24 pre-selected interested she thought her students were in the activity, and
terms drawn from the chapter under four superordinate changes to the procedure she would implement on future
headers that were also provided. The student template was activities. The 18-item survey served to document such
based on an expert map the researcher and teacher created factors as students' prior exposure to mapping, enjoyment
in advance of the study (see Fig. 1). In the student tem of mapping, difficulty of mapping, the estimated value of
plate, concept groupings and relationships were removed mapping for understanding readings, preference for map
which the students would need to provide to complete the ping alone or collaboratively, and preference for reading
map task (see Fig. 2). with or without Cmap.
The students' concept map template was specifically
designed to include a range of text structures present in the Data Analysis
reading selection, including sequential (e.g., humans?
depend on?plants), explanatory (e.g., conservation plow To determine how well students developed individual
ing?is also known as?no till) and cause-effect (e.g., concept maps, a "combination" scoring protocol was
plowing grass in the Great Plains?led to?the Dust Bowl). applied comparing the student-created map to an expert
The expert map shown in Fig. 1 includes five sequential, map and computing a score based on similar map elements
seven explanatory, and nine cause-effect relationships (Ruiz-Primo and Shavelson 1996). As an example of
from the reading selection. scoring, Fig. 3 illustrates an excerpt from one student's
map contrasted with the same portion of the expert's map.
Data Sources In this excerpt, the student received six out of nine possible
points for classifying terms under the correct header
Aside from student concept map artifacts, other data "conserved" in any way, and another two out of three
sources included researcher field notes recorded each day points for identifying correct sets (i.e., one point for

v_J
damaged
and lost
through

/
such as/for example
[ humans J
? S I contour
plowing
ffo^d>?for<?{
^-r-^ plants
u. )<?-depend
A onj_
!
depend on loss of soil
depend on soil to fertility which is plowing
t along the curves of a

occurred in
f live and grow j the south with
^ slope j
for<4 -[ animalsj A_
soils for cotton
in late 1800s

Fig. 1 Expert map on soil conservation with concepts and relationships from reading

Springer

This content downloaded from


140.122.53.95 on Mon, 20 Nov 2023 09:04:13 +00:00
All use subject to https://about.jstor.org/terms
J Sei Educ Technol (2009) 18:402-414
407

Fig. 2 Unsorted map template


provided to students
can be

[ conserved^)

plowing grass soils for cotton


crop in Great Plains in late 1800s low-till or nutrient
live and grow
rotation no-till supply

conservation contour
topsoil
plowing [food] [plants] [bacteria] erosion [ Dust Bowl ] plowing

soil is peanut different


plants nitrogen nutrients amounts of
I exposed [ s?ope ] [ animals ] for plants nutrients

loss of soil previous different crops


year's crops each year
fertility [plant cover] [humans)

Fig. 3 Comparison of excerpts


from student map (left) with
expert map (right)

is leaving plow their fields needs which is plowing which is leaving which is
behind along the
4 along the curves of a
_*
in the ground the planting
t
different crops
previous
each year slope previous different crops
year's crops ^ slope ] year's crops each year

also known as that absorb that restore


i different
low-till or nutrient
no-till amounts of
nutrients supply

correctly associating contour plowing with slope, and a concepts were reliable (a = .68). Multiple raters were not
half-point each for the remaining two incomplete sets). utilized in scoring maps, given the expert map was used as
Four points were assigned for writing correctly stated an objective standard or criterion to which all student maps
propositions when linking concepts together. were held.
Since student understanding of specific text structures To determine if student mapping performance varied by
was also of interest, the number of correctly written rela reading ability, students were divided into quartiles based
tionships of each type were also noted on each student map on their performance on the state's end of fifth grade test of
(i.e., sequential, explanatory, cause-effect). Researchers reading comprehension. A multiple analysis of variance
have argued a closer analysis of the types of relationships (MANOVA) was employed to show any differences
written is a more precise measure of conceptual under between students at different reading levels on the three
standing than a traditional computed score based on all map concept map variables?number of general concepts clas
components combined (Kharatmal and Nararjuna 2006). sified, concept sets identified, and correctly written
Across all student maps, Cronbach's alpha indicated the relationships. Further MANOVAs were run to determine
overall student proposition score with the three subtype any differences in survey results between students at dif
proposition scores were reliable (a = .79). Cronbach's ferent reading levels (e.g., perceived difficulty of task). It
alpha also indicated the scores for classifying and grouping was hypothesized that students in better reading groups

Springer

This content downloaded from


140.122.53.95 on Mon, 20 Nov 2023 09:04:13 +00:00
All use subject to https://about.jstor.org/terms
408 J Sei Educ Technol (2009) 18:402-414

would perform better on their map task, particularly in Table 2 Overall mean scores for writing d
regards to correctly written relationship statements. Sequencing Explanatory
Finally, to determine overall student and teacher reac statements statements statements
tions to concept mapping, descriptive statistics were N 74 74 74
computed from student survey data, and the teacher's
transcribed interview and researcher field notes were Mean 2.5/5 (50%) 3.4/7 (49%) 4.0/9 (44.4%)
SD 1.35 1.87 2.18
imported into Nvivo qualitative analysis software and
open-coded. Categories were created from single codes
where relationships were evident.
Does student mapping performance vary by reading
ability?
Results
Students were divided into four reading subgroups based
Is a computer-based concept map template with given on quartiles from the state's end of 5th grade reading
superordinate terms and underlying concepts effective comprehension test. In order to determine if the reading
at helping students reconstruct different text structures subgroups differed significantly with respect to the three
from their science textbook? mapping outcomes (i.e., # of concepts classified, sets
identified, relationships written), a multivariate analysis of
Table 1 summarizes overall student performance on the variance (MANOVA) was conducted. Results from this
concept map template. Next to each mean number of analysis revealed no significant main effect for reading
concept classifications, sets, and relationships, is the related subgroup, F(3, 56) = .38, p = .94, rj2 = .02. Students of
number from the expert's map. For example, the overall all reading abilities performed similarly on the assigned
mean number of student concept classifications was 18.9 mapping task.
out of a possible 24 on the expert's map or 79% of the total To determine if the reading subgroups differed signifi
possible. While no correct number of relationships was cantly with respect to how well they identified and wrote
assumed, since that variable could fluctuate depending on the three main types of relationships in the map
how students structured terms, a percentage (44%) is given (sequencing, explanatory, cause-effect), a second MA
as an indicator of how many correct relationship statements NOVA was conducted, again revealing no significant main
students wrote compared to those in the expert map. effect for reading subgroup, F(3, 56) = .97, p = .47,
Students were generally more successful at classifying n2 = .05. Further, student scores on writing the three types
sub-concepts under superordinate headers than they were at of relationships had no significant correlations with their
identifying more specific sets of two and three sub-con percentile scores on the state reading comprehension test.
cepts within those categories. Identifying concept sets is a Students of all reading abilities articulated the three dif
necessary precursor to phrasing specific concept relation ferent text structures similarly.
ships beyond more general relationships with superordinate It should be noted that the mapping performance of stu
headers. Thus, it is not surprising an average performance dents in special populations was comparable to the general
on identifying concept sets was followed by an average population. While not significantly different, eight English
performance on writing correct relationship statements. as a Second Language (ESL) students and four special
Relationship writing was further broken down into the education (EC) inclusion students had comparable averages
specific text structures students identified (see Table 2). on all three map outcomes?correctly classified concepts,
Students identified a similar percentage of sequencing and grouped sets, and written relationships (see Table 3). This
explanatory statements, with slightly more difficulty iden finding was unexpected given the average percentile score
tifying cause-effect statements. on the state's end of 5th grade reading comprehension test

Table 3 Mean concept map scores of ESL and EC students


Table 1 Overall mean concept map scores
Group # of concepts # of concept sets # of correct
# of concepts # of concept # of correct classified identified relationships
classified sets identified relationships
ESL students 19.6/24 (82%) 5.6/10 (56%) 10.9/22 (50%)
N 74 74 74 (? = 8)
Mean 18.9/24 (79%) 5/10 (50%) 9.7/22
EC students 23.3/24 (97%) (44%)
5.8/10 (58%) 11.3/22 (51%)
SD 5.98 2.08 4.29 (n = 4)

Springer

This content downloaded from


140.122.53.95 on Mon, 20 Nov 2023 09:04:13 +00:00
All use subject to https://about.jstor.org/terms
J Sei Educ Technol (2009) 18:402-414 409

was only 18 and 15.5 for the ESL and EC students, respec equally likely to be from any reading subgroup, not just
tively, compared to 40 for the entire population. These weaker readers as might be expected.
results further illustrate that mapping performance did not Students worked individually to complete their Cmaps in
vary by reading ability with poor readers showing similar this study, but were later asked if they would prefer to work on
capabilities compared to better readers. Cmaps collaboratively. Students expressed a strong prefer
ence for collaborative work as shown in Table 5. Fifty-nine
What are student and teacher reactions to the concept percent of students indicated they would like to work on maps
mapping task? in pairs, and 45.5% believed they would learn more working
in pairs. The notion of mapping in small groups was also well
Student reactions to the concept mapping task were received. Students were asked on their survey the extent to
examined with survey data. Questions asked students which they talked with peers around them in the computer lab
to report on the difficulty of concept mapping with Cmap. while working on maps in a typical day?never, one to four
Students were mixed in their overall assessment of map times, five to eight times, or nine or more times. Only 12% of
ping difficulty with a majority at 44% finding the task students indicated they never spoke with others, while a
neither difficult nor easy (see Table 4). About one quarter majority of students at 46% admitted to between five and
of students found it somewhat or very difficult to take the eight contacts per day. Thus, despite being an individual
pre-selected terms from Cmap and find those in their activity, many students did not work entirely alone on the
reading, and a quarter found it somewhat or very difficult task. When the teacher was asked if she would replicate
to write relationships between linked concepts. As expec individual mapping on future projects or move toward a more
ted, the procedural aspects of mapping (i.e., making new collaborative structure, she indicated:
concept boxes and drawing lines) were perceived as easier
I think working in pairs first, and then making them
overall than the more academic task of relating concepts.
do individual maps would be a better idea, because
To determine if the reading subgroups differed signifi
when they are working together two brains are
cantly with respect to perception of mapping difficulty, a
working together, so they can give ideas to each
MANOVA was conducted revealing no significant main
other. From there, we can move on to individual
effect for reading subgroup, F(3, 49) = .97, p = .49,
Cmaps.
r\2 = .08. Students who found mapping to be difficult were

Table 4 Perceptions of mapping difficulty (n = 66)

Mean SD Very difficult or Neither difficult Somewhat easy


somewhat difficult (%) nor easy (%) or very easy (%)
1. Overall, how difficult or easy was 3.26 19.7 44.0 36.4
Cmapping for you? 93
2. How difficult or easy was it to take 3.33 25.8 21.2 53.0
the terms from your Cmaps and find j j
them in the assigned readings?
3. How difficult or easy was it to write the 3.45 25.8 19.7 54.6
words between two concepts to make a | j
sentence structure?

4. How difficult or easy was it to make new 3.95 12.1 19.7 68.2
concepts and draw arrows between concepts? gQ

Table 5 Collaboration
Alone (%) With one other With a small
preferences (n = 66)
student (%) group (%)
On future projects, would you rather continue to 15.2 59.1 25.8
work on Cmaps alone, or would you rather share a
computer and work collaboratively on a Cmap
with another student or group?
Do you think you would learn more working alone 16.7 45.5 37.9
or working collaboratively?

Springer

This content downloaded from


140.122.53.95 on Mon, 20 Nov 2023 09:04:13 +00:00
All use subject to https://about.jstor.org/terms
410 J Sei Educ Technol (2009) 18:402-414

Table 6 Student reactions to . ^. . _


P Items Disagree or Neutral Strongly agree n
strongly disagree (%) or agree (%)
(%)
I enjoyed working with Cmap 13 25 62 63
If given a choice, I would rather read and 20 11 68 63
use Cmap than just read
Cmap helped me to identify more details in the reading 21 31 48 67
than I would have identified without mapping

Table 6 summarizes student reactions to Cmap They


from haven't gone as far as we hoped they would
have, but at the same time, for many of these students
their post-survey. A majority of students generally liked
working with Cmap, and if given a choice of usingthis
Cmapis probably the first time they have done anything
like this, so I do think they would get better at it over
with their readings, would opt to use the software. About
time.
half of the students surveyed believed Cmap helped them
to identify more details in their assigned reading than if
More frequent application of concept mapping across
they had just read without mapping. To determine if the
grade levels was recommended to avoid retraining students
reading subgroups differed significantly with respect to
and to make the strategy more viable.
their reactions to Cmap, a MANOVA was conducted
revealing no significant main effect for reading subgroup,
F(3, 46) = .76, p = .66, rj2 = .05. Discussion
The participating teacher expressed both positive and
cautious reactions to Cmap during her post-interview. She were moderately successful at classifying terms
Students
found the mapping of reading material to be an effective
under the correct superordinate headers, but struggled to
strategy for improving students' attention: "I like place
the many
idea terms in the correct sets and to articulate key
of them reading the lesson, paying attention, and then
relationships. Several explanations are possible for why
connecting those words together. That was a good thing
students did not excel beyond classifying information to
for me, because usually when you are reading in group
better the and relate information as well.
classroom, they would not be as attentive." When asked
if her students' performance on concept maps wasDesign
on par,
of the Mapping Activity
better, or worse than their typical performance in the
classroom, the teacher noted, "I think better than they students may have generated only partial
One reason
usually perform, because some of them are really trying
relational understanding is the pre-selected term task
hard and trying to get things right, and that was whatemployed in the study. Student results can be
structure
made me happy." influenced by the nature of the concept mapping task.
Regarding sustainability of the approach, theKinchin
teacher et al. (2005) found individual undergraduate stu
noted she would continue to use Cmap to support reading
dents given lectures on taxonomies and tasked with
comprehension: generating unstructured maps with the superordinate term
"microbiology" focused on classes more than processes. In
I will use it. I will be doing it for biomes. We are
comparison, collaborative groups given pre-selected terms
going to move on to that lesson, and I will tell them to
and no superordinates better integrated concepts and
make a concept map about a biome they select, and it
avoided simple concept associations with headers. While
will be through reading from a book and making a
Kinchin et al. (2005), p. 13 recommend "well-defined
concept map based on that.
concepts as starting points" to manage cognitive load and
She expressed concern, however, that it would be dif
challenge on mappers, they suggest the addition of super
ficult to support students in creating complicatedordinate headers to that mix, such as those used in this
hierarchical maps without a second assistant in study,
the commay constrain student thinking about relationships in
puter lab to answer student questions: "It's easierlieu
toofdo
classifications.
a
star map or a string map, but if you're going to do aInnet
this study, both superordinate terms and pre-selected
work map, it's always better to have some help."
conceptsThe
were employed with predictable results. Students
teacher did think students would get better at mapping over
excelled at classifying information, but struggled to detail
time, possibly reducing the need for extra help: more specific relationships among terms. It is unclear

Springer

This content downloaded from


140.122.53.95 on Mon, 20 Nov 2023 09:04:13 +00:00
All use subject to https://about.jstor.org/terms
J Sei Educ Technol (2009) 18:402-414 411

whether students tasked with selecting and mapping their extract and relate concepts they find most important under
own concepts would have developed better relational each header (Education Development Center 1995). Using
understanding or if a more open-ended task structure would this recommended approach, a common set of superordi
have benefited only the best readers capable of identifying nates would provide some structure for the map that the
key terms and relationships. In her interview, the partici teacher could readily assess for accuracy, while still
pating teacher was asked if her students could be successful allowing students the flexibility to extract and construct the
with open-ended maps instead of pre-selected term maps, subordinate relationships they find most important. The
and she indicated their lack of interest and ability in teacher noted in her interview that students were familiar
reading would be barriers to developing open-ended maps: with extracting text structures such as subheadings that
provided them with a type of advance organizer to the
About 80% of them don't want to read, and that's the
material they would be reading:
biggest challenge. You have to tell them again and
again that you have to read to make some connec They are used to looking for subheadings, like I
tions, you have to read to find out what is going to be usually have an activity where I tell them to write the
related to this term, and if they can read I don't think heading and then what pictures they saw and how that
it would be hard for them to make that kind of map. picture was important for the heading, and that helps
them to understand what we are going to talk about.
Open-ended or "low-directed" maps have been found to
elicit more explaining and opportunities for students to Regarding advance organizers, one could also take the
externalize their understanding than highly structured maps approach of Curry et al. (1999) who found a learning goal
(Ruiz-Primo et al. 2001, p. 100), but they likely increase tied to text led students to create more relational under
cognitive load for both learner and scorer as well (Chang standing in their maps. The soil conservation text in this
et al. 2002). In one study of 7th grade concept mapping, study, for example, could be preceded by a problem stu
students were divided into structured construet-on-scaffold dents respond to in their maps, providing them with a
and unstructured mapping groups (Chang et al. 2001). The framework for interacting with the text (e.g., Shady Acres
group provided with a partially structured map and terms/ Farm is suffering from soil loss and generating fewer crops
relation statements to fill-in, outperformed the group pro each year; read your text and use your map to explain what
vided with no structure and terms/relation statements to fill may be causing the farm's soil loss and what solutions can
in. The effect was partially attributed to a reduction in be implemented to limit this problem.).
cognitive load by the scaffold. In another study, Chang et al.
(2002) found a completed map in which students had to Depth of Task
correct errors led to better text comprehension and sum
marization than requiring students to complete open-ended Aside from the influence of task structure on map perfor
maps or gradually fading students toward open-ended maps. mance, other mediating factors may include the
Chang et al. (2001) recommend caution in providing overly authenticity of the task and the amount of time students
structured maps, however, suggesting the scaffold may be have been mapping.
effective in the short-term but a constraint to higher-level The mapping task in this study followed one short
processing that must be faded and removed over time. reading. It was not part of an inquiry project where students
The scaffolded task structure in this study likely aided created and edited a concept map to document cause-effect
the low ability readers whose map scores were equivalent findings from one or more experiments or labs (see, for
to higher ability readers. Research suggests low ability example, Berionni and Baldon 2006). Science educators
students may respond better than high ability students to recommend using graphic organizers to analyze textual
strategy instruction, since concept maps "force the gener material, but they also suggest student prediction, obser
ation of a coherent organizational structure, a process vation, questioning, and interpretation in the process of
[already] common to more capable students" (Pressley inquiry may aid reading comprehension (Miller 2006). One
et al. 1989; Schmid and Telaro 1990, p. 79). When using priority area for reading comprehension research is to
scaffolded, pre-selected term maps, the effect on low determine how to best embed comprehension instruction in
ability learners may be amplified since the structure being recommended teaching contexts such as inquiry-based
"forced" is even more organized than the structure one learning in science (Snow 2002). Relational comprehen
would have to induct on an open-ended map. sion might be improved by embedding mapping in longer
Since a gradual removal of scaffolds toward a more term inquiry projects where relationships are not just
open-ended map is desirable, teachers could employ a interpreted and mapped from readings, but predicted,
hybrid structure where students first place the boldface observed, and interpreted from experiments and labs with
headings and subheadings from texts on their maps, then mapping ongoing throughout the process.

Springer

This content downloaded from


140.122.53.95 on Mon, 20 Nov 2023 09:04:13 +00:00
All use subject to https://about.jstor.org/terms
412 J Sei Educ Technol (2009) 18:402-414

The need to gain expertise with new strategies or tools not only benefited from constructing individual maps to
before one can focus on higher-level processing of content express their own understanding of experimental processes
may also be a cause for students' average relating of but also from discussing their individual representations as
information on the mapping task. Numerous researchers they created a group map based on the concepts under
have argued the process of acquiring mapping and/or tool study.
fluency may slow mapping groups at first, but mapping Second, system scaffolds may also help learners manage
students eventually show greater gains on outcome mea the increased cognitive load associated with unstructured
sures than comparative non-mapping students (Hsu 2004; maps. Researchers have found scaffolds embedded in
Kimber et al. 2007; Lehman et al. 1985; Schmid and Telaro computer mapping systems can help students generate
1990). In this study, all students were trained to use Cmap more complete maps than students not provided with
and to develop concept maps based on reading material, scaffolds (Chang et al. 2001). Scaffolds may include hints,
but additional opportunities to use the tool over several evaluation scores that indicate degree of agreement
weeks may have helped some students focus more on between student and expert maps, and a copy of the expert
relating reading material than on manipulating a new tool map to compare with one's own map after 30 min of
on a time-restricted task. The teacher concurred that stu mapping (Chang et al. 2002). Scaffolds may also include
dents may get better at mapping over time. system affordances to encourage collaboration. Germann
et al. (2001) suggest the degree to which the chosen
medium supports social interaction may play a role in how
Leveraging Collaborative and Tool-Based Scaffolds far the student can be challenged. Cheung (2006) describes
the MindNet concept mapping tool, for example, that
To build toward greater relational thinking in increasingly includes a concept library and map analyzer allowing stu
unstructured concept maps, teachers may leverage addi dents to review relationships and cluster maps from other
tional collaborative strategies and tool-based scaffolds. teams, promoting reflection and discussion of divergent
First, collaborative mapping may be more powerful than perspectives.
individual mapping, since students must converse and
come to some agreement on terms and relationships for Supplementing Concept Maps
their maps (Freeman and Jessup 2004; Schmid and Telaro
1990). Germann et al. (2001) found mapping helped stu Finally, it should be noted that while this study investigated
dents organize and develop ideas, while shared journaling concept mapping as a singular strategy to improve reading
on a listserv led to the questioning of ideas. DeSimone comprehension, past studies have illustrated a combination
et al. (2001) echo the complementary nature of mapping of reading comprehension strategies that pair concept
and collaborating, suggesting mapping can help students mapping with other techniques such as group inquiry
represent ideas while collaborating can help students approaches to reading and partner retelling may prove
elaborate on externalizations. more effective than concept mapping alone (Draheim
Students in this study desired collaboration with 85% 1986). To help science students comprehend complex
indicating they would prefer to map with at least one other expository texts, Carnine and Carnine (2004) call for
person. Despite mapping individually, students were reg instructional designs that involve not only graphic orga
ularly observed talking with one another about their maps. nizers such as concept maps, but also the teaching of big
Students were observed helping each other find specific ideas, reuse of concepts across units, mnemonics, and
terms in readings, classify terms appropriately on maps, hands-on activities.
and write relationships correctly in sentence form. In her
follow-up interview, the teacher recommended starting
with collaborative mapping and building to individual Conclusions
mapping once students had developed their skills.
Danish and Enyedy (2006), p. 22 discuss potential This study is situated in a large body of research suggesting
benefits associated with such "open interactions" in their graphic organizers are useful interventions to improve
study of a K-l class creating tangible, computer-based, and student reading comprehension. Since student-generated
drawn representations of pollination. When given access to relational statements include information about one's
peers, a student's knowledge and competencies can be comprehension of different text structures (e.g., cause
transformed by others' ideas, social norms for what con effect, explanatory), this study contributes findings to the
stitutes a good representation, and the teacher's mediation field regarding an intervention that is potentially valuable
of those norms. Berionni and Baldon (2006) likewise found in promoting reading comprehension of texts, particularly
middle grades students working in groups on science labs expository texts in science known to embed multiple

Springer

This content downloaded from


140.122.53.95 on Mon, 20 Nov 2023 09:04:13 +00:00
All use subject to https://about.jstor.org/terms
J Sei Educ Technol (2009) 18:402^14 413

structural forms. Findings suggest pre-selected term con Chang KE, Sung YT, Chen SF (2001) Learning through computer
based concept mapping with scaffolding aid. J Comput Assist
cept mapping is a promising strategy to help students of all
Learn 17(l):21-33
reading abilities better comprehend reading material in Chang KE, Sung YT, Chen ID (2002) The effect of concept mapping
science texts. The students' map scores depict successful to enhance text comprehension and summarization. J Exp Educ
classification of pre-selected terms under superordinate 71(l):5-23
headers and modest success with grouping terms into sets Cheung LS (2006) A constructivist approach to designing computer
supported concept-mapping environment. Int J Instr Media
and articulating different types of relationships represented 33(2): 153-164
in the reading. Curry J, Haderlie S, Ku TW, Lawless KA, Lemon M, Wood R (1999)
To encourage better student understanding of the higher Specified learning goals and their effect on learners' represen
level relationships found in science texts, some modifica tations of a hypertext reading environment. Int J Instr Media
26(0:43-51
tions to the task and conditions applied in this study may Danish JA, Enyedy N (2006) Negotiated representational mediators:
prove beneficial. For example, researchers may find strate how young children decide what to include in their science
gies that require students to select their own superordinate representations. Sei Educ 91(1): 1-35
headers from a text, or to create a map in response to some DeSimone C, Schmid RF, McEwen LA (2001) Supporting the
learning process with collaborative concept mapping using
problem, provide students with a type of conceptual scaffold computer-based communication tools and processes. Educ Res
that can support more desirable open-ended mapping and Eval 7(2-3):263-283
relating. Mapping during longer-term inquiries or labs that Draheim ME (1986) Directed reading-thinking activity, conceptual
mapping, and underlining: their effects on expository text recall
allow students to discover and see relationships in action
in a writing task. Paper presented at the Annual Meeting of the
may also impact performance. Finally, small group discus National Reading Conference, Austin
sions, and/or advanced tool affordances may also support Education Development Center (1995) Organizing information with
students as they transition to open-ended mapping and face software tools. (NCIP Profiles No. 4). National Center to
Improve Practice, Newton
increased challenges related to selecting the most important
Freeman LA, Jessup LM (2004) The power and benefits of concept
information from readings and inducing key relationships. mapping: measuring use, usefulness, ease of use, and satisfac
tion. Int J Sei Educ 26(2): 151-169
Germann P, Young K, Patton M (2001) Heightening reflection
through dialogue: a case for electronic journaling and electronic
References concept mapping in science. Contemp Issues Technol Teach
Educ l(3):321-333
Guastello EF, Beasley TM, Sinatra RC (2000) Concept mapping
Anderson TH, Huang SCC (1989) On using concept maps to assess effects on science content comprehension of low-achieving
the comprehension effects of reading expository text. (Technical inner-city seventh graders. Remedial Spec Educ 21(6):356-364
Report No. 483). Center for the Study of Reading, Champaign Harniss MK, Hollenbeck KL, Crawford DB, Carnine D (1994)
Berionni A, Baldon MO (2006) Models of social constructivism, Content organization and instructional design issues in the
laboratory teaching, and concept maps to build scientific development of history texts. Learn Disabil Q 17(3):235-248
knowledge and organize concept network. In: Canas AJ, Novak Hsu LL (2004) Developing concept maps from problem-based
JD (eds) Concept maps: theory, methodology, technology. learning scenario discussions. J Adv Nurs 48(5):510-518
Proceedings of the Second International Conference on Concept IHMC (2007). Cmap tools: knowledge modeling kit. Retrieved 10/06/
Mapping, University of Costa Rica, San Jose, pp 449-456 2007 from http://cmap.ihmc.us/
Berkowitz SJ (1986) Effects of instruction in text organization on Institute for the Advancement of Research in Education (2003)
sixth-grade students' memory for expository reading. Read Res Graphic organizers: a review of scientifically based research.
Q 21(2):161-178 (Technical Report). Appalachian Regional Educational Labora
Boyle JR, Weishaar M (1997) The effects of expert-generated versus tory, Charleston
student-generated cognitive organizers on the reading compre Kharatmal M, Nararjuna G (2006). A proposal to refine concept
hension of students with learning disabilities. Learn Disabil Res mapping for effective science learning. In: Canas AJ, Novak JD
Pract 12(4):228-235 (eds), Concept maps: theory, methodology, technology. Pro
Brookbank D, Grover S, Kullberg K, Strawser C (1999) Improving ceedings of the Second International Conference on Concept
student achievement through organization of student learning. Mapping, University of Costa Rica, San Jose, pp 1-7
Unpublished master's thesis, Saint Xavier University, Chicago Kim AH, Vaughn S, Wanzek J, Wei S (2004) Graphic organizers and
Burdumy SJ, Myers D, Mansfield W, Gersten R, Dimino J, Dole J, their effects on the reading comprehension of students with LD:
Liang L, Vaughn S, Edmonds M (2006) The national evaluation a synthesis of research. J Learn Disabil 37(2): 105-118
of reading comprehension interventions: design report. (Report Kimber K, Pillay H, Richards C (2007) Technoliteracy and learning:
No. ED01CO0039/0010), Mathematica Policy Research, an analysis of the quality of knowledge in electronic represen
Princeton
tations of understanding. Comput Educ 48(l):59-79
Cardellini L (2004) Conceiving of concept maps to foster meaningful Kinchin IM, De-Leij FAAM, Hay DB (2005) The evolution of a
learning: an interview with Joseph D. Novak. J Chem Educ collaborative concept mapping activity for undergraduate micro
81(9):1303-1308 biology students. J Furth High Educ 29(1):1-14
Carnine L, Carnine D (2004) The interaction of reading skills and Lehman JD, Carter C, Kahle JB (1985) Concept mapping, Vee
science content knowledge when teaching struggling secondary mapping, and achievement: results of a field study with black
students. Read Writ Q 20(2):203-218 high school students. J Res Sei Teach 22(7):663-#73

Springer

This content downloaded from


140.122.53.95 on Mon, 20 Nov 2023 09:04:13 +00:00
All use subject to https://about.jstor.org/terms
414 J Sei Educ Technol (2009) 18:402-414

Meyer BJF, Brandt DM, Bluth GJ (1980) Use of top-level structure in of the National Association for Research in Science Teaching,
text: key for reading comprehension of ninth grade students. Boston
Read Res Q 16(1):72-103 Ruiz-Primo MA, Shavelson RJ (1996) Problems and issues in the use
Miller RG (2006) Unlocking reading comprehension with key science of concept maps in science assessment. J Res Sei Teach
inquiry skills. Sei Scope 30(1):30-33 33(6):569-600. doi: 10.1002/(SICI)1098
National Reading Panel (2000) Teaching children to read: an evidence 2736(199608)33:6<569::AID-TEA1>3.0.CO;2-M
based assessment of the scientific research literature on reading Ruiz-Primo MA, Shavelson RJ, Li M, Schultz SE (2001) On the
and its implications for reading instruction. National Institute of validity of cognitive interpretations of scores from alternative
Child Health and Human Development, Washington, DC concept-mapping techniques. Educ Assess 7(2):99?141.
Novak JD, Gowin DB (1984) Learning how to learn. Cambridge doi: 10.1207/S15326977EA0702_2
University Press, New York Schmid RF, Telaro G (1990) Concept mapping as an instructional
Piercy TD, Hyerle D (2004) Maps for the road to reading compre strategy for high school biology. J Educ Res 84(2):78-85
hension. In: Hyerle D (ed) Student successes with thinking maps. Snow C (2002) Reading for understanding: toward an R&D program
Corwin Press, Thousand Oaks, pp 63-73 in reading comprehension. (Technical Report). RAND Reading
Prater DL, Terry CA (1988) Effects of mapping strategies on reading Study Group, Santa Monica
comprehension and writing performance. Read Psychol Stice CF, Alvarez MC (1987) Hierarchical concept mapping in the
9(2): 101-120 early grades. Child Educ 64(2):89-96
Pressley M, Goodchild F, Fleet J, Zajchowski R, Evans ED (1989) Zmach CC, Sanders J, Patrick JD, Dedeoglu H, Charbonnet S, Henkel
The challenges of classroom strategy instruction. Elem Sch J M, Fang Z, Lamme LL, Pringle R (2007) Infusing reading into
89(3):301-342 science learning. Educ Leadersh 64(4):62-66
Rivard L, Yore LD (1992) Review of reading comprehension
instruction: 1985-1991. Paper presented at the Annual Meeting

Springer

This content downloaded from


140.122.53.95 on Mon, 20 Nov 2023 09:04:13 +00:00
All use subject to https://about.jstor.org/terms

You might also like