Professional Documents
Culture Documents
Odom Et Al-2007-School Science and Mathematics
Odom Et Al-2007-School Science and Mathematics
Arthur L. Odom
University of MissouriKansas City
Lloyd H. Barrow
University of MissouriColumbia
The purpose of this study was to investigate students understanding about scientifically acceptable content
knowledge by exploring the relationship between knowledge of diffusion and osmosis and the students certainty
in their content knowledge. Data was collected from a high school biology class with the Diffusion and Osmosis
Diagnostic Test (DODT) and Certainty of Response (CRI) scale. All data was collected after completion of a unit
of study on diffusion and osmosis. The results of the DODT were dichotomized into correct and incorrect answers,
and CRI values were dichotomized into certain and uncertain. Values were used to construct a series of 2 X 2
contingency tables for each item on the DODT and corresponding CRI. High certainty in incorrect answers on
the DODT indicated tenacious misconceptions about diffusion and osmosis concepts. Low certainty in incorrect
or correct answers on the DODT indicated possible guessing; and, therefore no understanding, or confusion
about their understanding. Chi-square analyses revealed that significantly more students had misconceptions
than desired knowledge on content covering the Influence of Life Forces on Diffusion and Osmosis, Membranes,
the Particulate and Random Nature of Matter, and the Processes of Diffusion and Osmosis. Most students were
either guessing or had misconceptions about every item related to the concepts osmosis and tonicity. Osmosis
and diffusion are important to understanding fundamental biology concepts, but the concept of tonicity not be
introduced to high school biology students until effective instructional approaches can be identified by researchers.
Biology teachers are continually frustrated when students demonstrate errors about topics covered earlier
in the year. It is especially frustrating when students
appear to understand the concept during instruction yet,
when applying their knowledge later in the year appear
surprised when their knowledge was incorrect. They
were certain that their answers were correct, but they
werent. The purpose of this study was to identify high
school biology students knowledge and certainty
about diffusion and osmosis concepts. More specifically, we examined students knowledge and certainty
about concentration and tonicity, influence of life
forces on diffusion and osmosis, membranes, particulate and random nature of matter, the process of diffusion, and the process of osmosis.
Background
Confidence in Content Knowledge: Recently, Mangione-Leslie, Dockers, and Wavering (2005) reported
that a group of 85 pre-service teachers had a significant
correlation in their confidence and knowledge of earth
science concepts, as confidence decreased their content
knowledge decreased. Clough, Olsen, Madsen, and
Taylor (2005) compared adults perceptions of how
94
well they understood science content and nature of science. Most of the 291 participants admitted they had
poor science content knowledge, but were confident
they understood the nature of science.
Pallier et al. (2002), found that self-assessment in the
cognitive domain produced overconfidence, whereas
self-assessment of visual perceptual judgments resulted
in under-confidence. Pallier et al. also noted that individual differences provided a source of overconfidence
and that a metacognitive trait might mediate that effect,
and that cognitive ability appeared to play only a small
role in determining the accuracy of self-assessment.
Similarly, Lundeberg (1994) assessed individuals degree of confidence in their ability to answer test questions. After answering each item on course exams,
college students indicated their confidence that their
answer to that item was correct. Both men and women
were overconfident, undergraduate men were especially overconfident in incorrect answers.
Wandersee, Mintzes, and Novak (1994) summarized
a large body of research on science misconceptions (alternative conceptions) providing a comprehensive review of the literature on what was called the
Alternative Conceptions Movement (ACM). The reVolume 107 (3)
methodology had its strengths and had contributed significantly to improving science achievement and the
promotion of the active role of the learner and facilitative role of the teacher. However, teachers use of a single methodology, either learning cycle or concept
mapping alone, provides the learner with only a partial
framework of knowing.
Difficulties teaching Diffusion and Osmosis. Sanger,
M. J., Brecheisen, D. M., & Hynek, B. M. (2001) used
the Diffusion and Osmosis Diagnostic Test (DODT) to
assess freshman college students understanding of diffusion and osmosis after instruction with computer
animations and drawings. They reported that
instructors may encounter difficulties because of the
challenge of creating particulate drawings that
faithfully represent the scientific phenomena. Another
problem is that because students are unfamiliar with
particulate drawings, they may misinterpret these
drawings. For example, students in this study
misinterpreted the drawings in the computer animation
depicting the osmosis of water through a semipermeable membrane into a syrup solution as
suggesting that sugar particles do not dissolve in water.
Tekkaya (2003) noted that misconceptions about diffusion and osmosis are not easy to eliminate employing
traditional instructional methods because of the interdisciplinary nature of the topic. Most of the concepts in
diffusion and osmosis are closely related to concepts
present both in chemistry and in physics, such as solutions, particulate nature of matter, and permeability.
Therefore understanding of these concepts requires the
understanding and application of knowledge in physics
and chemistry as well as biology.
Purpose
As indicated above the purpose of this study was to
investigate students understanding about scientifically
acceptable content knowledge by exploring the relationship between knowledge of diffusion and osmosis
and a students confidence in their content knowledge
following instruction.
Methods
Instruments
The DODT is a validated two-tier diagnostic test designed to assess understanding of diffusion and osmosis concepts. Each item on the DODT has two tiers.
The first tier consists of a content question with two,
three or four choices. The second tier consisted of four
possible reasons for the first part: three alternative reasons and one scientifically accepted reason (Figure 1).
95
The DODT has 12 items that assess understanding corresponding to the particulate and random nature of
matter, concentration and tonicity, influence of life
forces on diffusion and osmosis, membranes, the
process of diffusion, the process of osmosis, and the
kinetic energy of matter. Items were scored correct on
the DODT if both the desired first tier answer and second tier reason were selected. If an undesired answer
was selected in either tier the item was scored as incorrect (Odom & Barrow, 1995).
Adjacent to each DODT item was a statement in
which students were asked to indicate the level of their
confidence in their selection for each tier of the DODT
with the following statement: I am ___ sure about my
answer-100% 80% 60% 40% 20% 0% (please circle
one).
For example, in Appendix A there would be a corresponding confidence selection for the first tier, and another corresponding confidence selection for the
second tier.
Initially, selecting 80% or above on the confidence
statement was defined as being confident in an answer,
and selecting 60% or below on the confidence statement was defined as being not confident in an answer.
I am ___ sure about my answer-100% 80% 60%
40% 20% 0% (please circle one). Average of both tiers
of the DODT combined.
0-19
20-39
40-59
2 Not sure
60-79
3 Sure
80-99
4 Almost certain
100
5 Certain
Figure 2. Confidence selection conversion to Certainty of Response.
96
Certain
CRI (>3.0)
Uncertain
CRI(<3.0)
CRI
Incorrect
DODT Answer
Correct
Misconception
Table 1. Chi square analysis for Certainty of Response Index (CRI) by correct and incorrect answer
selection of the Diffusion and Osmosis Diagnostic Test (DODT).
contingency tables
Content area
DODT
CRI
Incorrect Correct Totals
Chi Square
Chi Square StaItem
Statistics for
tistics for ConExpected*
tiguous
Subset**
Concentration
4
Certain
27
19
46
X2(3,
X2(1,
and Tonicity
N=58)=24.3
N=46)=4.2,
Uncertain
10
2
12
p<.000
p=.24
9
Certain
17
11
28
X2(3,
X2(1,N=28)=1.
N=58)=10.1
3
Uncertain
23
7
30
p=.017
p=.26
Influences of Life
11
Certain
24
10
44
X2(3,
X2(1,
Forces on DiffuN=58)=17.3
N=44)=5.8
sion and Osmosis
Kinetic Energy of
Matter
Uncertain
Certain
20
8
4
30
24
38
Membranes
12
Uncertain
Certain
14
39
6
6
20
45
Particulate and
Random Nature
of Matter
Uncertain
Certain
21
41
1
4
22
45
Uncertain
Certain
37
13
Uncertain
Certain
19
21
0
22
19
43
Uncertain
Certain
10
30
5
16
15
46
Uncertain
Certain
10
41
2
7
12
48
Uncertain
Certain
9
24
1
12
10
36
10
Uncertain
Certain
19
23
3
14
21
37
Uncertain
19
21
Process of
Diffusion
Process of Osmosis
39
p=.001
X2(3,
N=58)=24.5
p<.000
X2(3,
N=58)=59.4
p<.000
X2(3,
N=58)=65.7
p=.016
X2(1,
N=38)=12.7
p<.000
X2(1,
N=45)=24.2,
p<.000
X2(1,
N=45)=30.4,
p<.000
p<.000
X (3,
N=58)=31.7
p<.000
X2(3,
N=58)=14.4
P=.002
X2(3,
N=58)=28.9
p<.000
X2(3,
N=58)=66.9
p<.000
X2(3,
N=58)=17.2
p=.001
X2(3,
N=58)=17.2
p=.001
2
X2(1, N=39,
=31.41, p<.000
X2(1,
N=43)=.023,
p=.88
X2(1,
N=46)=4.3,
p=.03
X2(1,
N=48)=24.1
p<.000
X2(1,
N=36)=4.0,
p=.04
X2(1,
N=37)=2.8
p=.14
Table 2. Decision matrix for class average values by content area and item number
Content Area
4
9
11*
0.47
0.29
0.41
Desired Knowledge of
Concepts
0.33
0.19
0.17
7*
0.14
0.52
0.34
2**
3**
6
1*
0.71
0.64
0.36
0.52
0.07
0.03
0.38
0.28
0.22
0.33
0.26
0.21
12*
5**
8*
0.67
0.71
0.41
10
0.40
*p<.05**p<.01 desired knowledge compared to misconceptions
0.10
0.12
0.21
0.24
Guess
0.21
0.52
0.41
0.22
0.17
0.38
0.36
suppose you kill the plant cells, would osmosis continue? This question may lead to predictions and hypotheses. If the observations fit the expected outcomes,
then the observations are assimilated into the current
mental structure. If, however, observations do not fit
the expected outcomes disequilibrium results and accommodation is needed. As a consequence of accommodation, alternative mental structures are selected or
constructed, driven by disequilibrium, until a good
match between expected and actual outcomes occurs
to restore equilibrium (Lawson, 1995). The ability to
generate declarative knowledge depends on procedural
knowledge, which is dependent on the ability to generate and test hypotheses.
Finally, the large majority of students were either
guessing or had misconceptions about every item related to the concepts osmosis and tonicity. We believe
that osmosis and diffusion are important to understanding many biological processes, but that great caution
should be taken when the concept of tonicity is introduced to high school biology students until effective
instructional approaches can be identified by researchers.
Recommendations for Future Study. First, researchers should examine the relationship between
self-efficacy and confidence in content knowledge, and
student understanding of diffusion and osmosis concepts. Bong (1997) reported that academic self-efficacy was related to confidence ratings toward high
school problem solving questions, and that the self-efficacy scale was more predictive in verbal subjects than
in quantitative domains.
Second, Pallier et al. (2002), research on confidence
judgments can be extended to this study and DODT.
This study can be replicated with an overall/total certainty rating. The certainty could be correlated with individual concepts of DODT.
Third, an understanding of the particulate and random nature of matter is important to understanding of
diffusion and osmosis. The results of the assessment
could be used to determine the starting point on instruction about diffusion and osmosis concepts.
Fourth, researchers need to explore the influence of
scientific terminology on learning diffusion and osmosis concepts. Are terms related to relative concentration, like tonicity and osmotic pressure required to
understand osmosis?
Fifth, additional studies should be conducted to see
if CRI documents tenacity for other science concepts.
Sixth, CRI of >3 was used to operationally define
Volume 107 (3)
References
Ausubel, D. (1968). Educational psychology: A cognitive view. New York: Holt, Rinehart and Winston.
Biological Science: A Molecular Approach. (1990).
Lexington, Massachusetts: D.C. Heath and Company.
Bong, M. (1997). Generality of academic self-efficacy judgments: Evidence of hierarchical relations.
Journal of educational psychology, 89(4), 696-709.
Christianson, R. G., & Fisher, K. M. (1999). Comparison of student learning about diffusion and osmosis
in constructivist and traditional classrooms. International Journal of Science Education, 21(6), 687-698.
Ferguson, G.A. & Takane, Y. (1989). Statistical
analysis in psychology and education. New York: McGraw-Hill Book Company.
Friedler, Y., Amir, R. & Tamir, P. (1987). High
school students difficulties in understanding osmosis.
International Journal of Science Education, 9, 541551.
Hasan, S., Bagayoko, D., & Kelley, E. L. (1999).
Misconceptions and the certainty of response index
(CRI). Physics Education, 34(5), 294-299.
Lawrenz, F., Cochran, C. & Simpson, P. (1992). Research matters...To the science teacher. National Association of Research in Science Teaching Monograph,
5, 29-40.
Lawson, A.E. (1995). Science teaching and the development of thinking. Belmont, CA: Wadsworth Publishing Company.
Lundeberg, M. A. (1994). Highly confident but
wrong: Gender differences and similarities in confidence judgments. Journal of educational psychology,
86(1), 114-121.
Marek,
E.
(1986).
Understandings
and
misunderstandings of biology concepts. American
Biology Teacher, 48, 37-40.
National Research Council (1996). National Science
101