Professional Documents
Culture Documents
Understanding 85
Understanding 85
net/publication/274616722
Understanding Understanding
CITATIONS READS
69 384
1 author:
Raymond Nickerson
Tufts University
169 PUBLICATIONS 8,455 CITATIONS
SEE PROFILE
All content following this page was uploaded by Raymond Nickerson on 20 October 2015.
Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at .
http://www.jstor.org/page/info/about/policies/terms.jsp
JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of
content in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms
of scholarship. For more information about JSTOR, please contact support@jstor.org.
The University of Chicago Press is collaborating with JSTOR to digitize, preserve and extend access to
American Journal of Education.
http://www.jstor.org
Understanding Understanding
RAYMOND S. NICKERSON
Bolt Beranek and Newman Inc.
Projectile Motion
Problem I Problem 2
Problem 3 Problem 4
-
?
FIG. 1.-Illustrations for the curved tube and orbiting ball problems (from McCloskey,
Caramazza, & Green 1980).
head.) The subject was asked to imagine that the string breaks when
the ball is in the position shown in problem 4 and to draw the resulting
path of the ball in the horizontal plane, ignoring air resistance.
For all of these problems, the correct answer is a straight line tangent
to the curve of motion at the point where the ball emerges from the
tube or the string is cut. About a third of the paths drawn by subjects
who had completed a high school physics course were curved, the
direction of curvature being the same as that followed when the ball
was in the tube or before the string was cut. Many of the subjects
appear to have believed that a ball forced to move in a curved trajectory
will continue to do so even after external forces no longer act upon
it and that the degree of the trajectory's curvature will depend on the
specifics of the trajectory when those forces were active or perhaps
on the length of time they were active.
In another study, Caramazza, McCloskey, and Green (1981) showed
undergraduate college students drawings of a pendulum ball swinging
on the end of a string. The students were asked to draw the path the
ball would take if the string were cut when the ball was located at the
points indicated and moving in the directions specified in figure 2.
About a third of the subjects who had at least one physics course at
either the high school or college level produced responses that were
consistent with a basic understanding of projectile motion. Common
misconceptions included the following beliefs: (1) the ball would continue
moving to the left if the string were cut when the pendulum was at
the extreme left in its swing, as shown in problem A; (2) the ball would
fall straight down under the condition shown in problem C; (3) the
path of the ball would follow a straight-line extension of the string
irrespective of when the string was cut; (4) the ball would continue
the arc of the pendulum briefly and then fall straight down. Some of
the subjects believed the ball would drop vertically if the string were
cut when it was exactly vertical, suggesting, as in 3 above, confusion
between the path of the ball and the direction in which the string was
"pointing" at the instant it was cut.
We should note that error rates obtained in such studies, high as
they are, may underestimate the amount of confusion in the minds
of the students. An incorrect answer is reasonably good evidence of
a lack of understanding; however, an ability to trace the correct tra-
jectories in these problems is no assurance that one understands pro-
jectile motion very deeply. For example, one might trace parabolic
curves for problems B, C, and D of the second study, believing that
the ball travels at constant speed along those curves rather than realizing
that such curves are traced because the ball accelerates vertically while
maintaining a relatively constant velocity horizontally.
Problem A Problem B
/\ f\
'
\,, - /
S
/. ~/
I
\
S
Problem C Problem D
/ '\
Greenlead1981).
naurallyto devlopmen
of nl afwbsimoesfmton
Some
of the modelsI evdneS eesmlr nsm
ytersbet
respects,topre-Newtonia cocp iossugtighaschmdl
Caramazza et al. (1981, p. 121) concluded that "real-worldexperience
be a
may
naural outcom of exe iec wihtewrd."otoh
with moving objects does not lead naturally to the extraction of principles
that are consistent with the formal laws of motion."They noted, however,
that the misconceptions of their subjects fell into a relatively small
number of classes and concluded that experience with the world does
lead naturally to development of only a few basic models of motion.
Some of the models evidenced by their subjects were similar, in some
respects, to pre-Newtonian conceptions, suggesting that such models
may be a natural outcome of experience with the world. "Most of the
subjects who drew curved pathways [in the first study] believed that
an object moving through a curved tube (or otherwise forced to travel
in a curved path) acquires a 'force' or 'momentum' that causes it to
continue in curvilinear motion for some time after it emerges from
the tube. However, the force or momentum eventually dissipates, and
the object's trajectory gradually becomes straight" (Caramazza et al.
1981, p. 114). The investigators noted the correspondence between
these beliefs and the medieval theory of impetus, which held that an
Rate of Change
Force
discuss the various forces involved. By the time the sequence of dem-
onstrations was finished, most of the students were convinced that the
table does exert an upward force on the book.
Understanding the effect of force on bodies in motion has proven
to be no less problematic than understanding the role of force on
bodies at rest. For example, Clement (1981b, 1982b) has presented
evidence showing that many students believe continuing motion implies
the presence of a continuing force in the direction of motion. As
already mentioned, this belief, which Clement refers to as the "motion-
implies-a-force" misconception, was noted by McCloskey et al. (1980)
in their study of students' understanding of projectile motion.
In a particularly compelling demonstration of this misconception,
Clement (1982b, p. 3) gave subjects the following problem, which is
illustrated in figure 3: "A coin is tossed from point A straight up into
the air and caught at point E. On the dot to the left of the drawing,
draw one or more arrows showing the direction of each force acting
on the coin when it is at point B. (Draw longer arrows for larger
forces.)" A large majority of college students, most of whom had taken
high school physics, answered this question incorrectly. The most com-
mon incorrect answer showed one force operating in the direction of
the motion of the coin and another operating in the opposite direction.
The first force typically was identified as the force applied originally
to get the coin moving upward and the second one was identified as
gravity. Clement also presented evidence that the "motion-implies-a-
force" misconception is highly resistant to change; even a large per-
centage of students who have completed a college-level course in me-
chanics with good grades are likely to have it.
Typical incorrect
Fh answer
Physicist's answer
T F D
Fg Fg
A *E
(Ignoring
air friction)
FIG. 3.-Illustration of the coin-toss problem (from Clement 1982b).
Elementary Mathematics
Many studies have shown that errors that students make on procedural
(e.g., mathematical) tasks are often the consequence of rule-determined
behavior (Asklock 1976; Brown and Burton 1978; Davis 1980; Lankford
1972; Young and O'Shea 1981). Sometimes mistakes result from the
application of an incorrectly coded procedure-a procedure with a
flaw or "bug" in it-and sometimes they result from the application
of a perfectly good procedure in an inappropriate context. In the
latter case, one might say the individual has learned the procedure
well but does not understand the conditions under which it should be
applied.
Several investigators have cataloged the errors that are commonly
encountered with various types of problems in elementary mathematics.
One better-known effort is that of Bennett (1976) who analyzed nearly
1,600 subtraction problems performed by 33 10-year-old schoolchildren.
All of the problems involved subtracting two-digit numbers. In a recent
analysis of Bennett's data, Young and O'Shea (1981) classified 36 percent
of all errors as algorithmic errors. These errors were subclassified into
categories such as the following: (1) borrow when the subtrahend digit
is less than the minuend digit; (2) subtract the smaller number from
the larger; (3) always borrow; (4) write down zero if the subtrahend
is larger than the minuend.
The strategy used by Young and O'Shea to account for the algorithmic
errors they identified was to define a production system (Newell 1973)
that would produce correct answers and then make selective deletions
from the rule set or add rules that were appropriate to other arithmetical
tasks. They could account for about two-thirds of the algorithmic
errors in this fashion. They were also able to account for 15 common
errors identified by Brown and Burton (1978) with a correct production
system from which some rules had been deleted and others appropriate
for addition problems had been added. They claimed there was no
need to assume "wrong" rules in order to account for the types of
errors that were identified.
Arithmetic errors commonly made by schoolchildren have also been
studied by Davis (1980), who has postulated four specific "frames"that
in combination, he believes, predict many of these errors. These four
frames are as follows:
Matz (1980) has also used common errors as a basis for building a
theory of how high school students solve (correctly or incorrectly)
algebra problems. Errors are assumed, in many cases, to be the result
of reasonable attempts to apply previously acquired knowledge to new
situations. Her theory of high school algebra problem solving distin-
guishes two components: (1) base rules (rule knowledge that the student
has already acquired); and (2) extrapolation techniques (methods for
bridging the gap between known rules and unfamiliar problems).
Extrapolation techniques typically are used to find a way either to see
an unfamiliar problem as a familiar one or to revise a known rule so
it is applicable in a new situation. Sometimes these techniques work,
and sometimes they do not.
Two extrapolation techniques, generalization and linear decom-
position, seem to be the most frequently used and misused. For example,
an inappropriate use of generalization as an extrapolation technique
is failing to understand that the equation (X - 3) (X - 4) = 0 is
solvable because the right-hand term is zero and attempting to apply
the same process to (X - 5) (X - 7) = 3, obtaining X = 8 or X =
10. Linearity refers to decomposing a problem into components and
treating each component independently. Linear decomposition often
works as, for example, in the distributive law of multiplication over
addition. However, it does not always work; for example, if we de-
compose the expression VA + B by distributing its topmost operator
(square root) across its component terms, we obtain an erroneous
result. But the same operation (linear decomposition) is perfectly valid
Equations
Comment
The reader is invited to order the statements from most to least completely
understood.
Some bacteria are chemotactic, some are phototactic, and some are
magnetotactic.
Unavoidability and reducibility are two key ideas that were used in a
proof of the theorem that four colors are sufficient.to color any planar
map so that no two adjacent countries have the same color.
Brothers and sisters have I none, but this man's father is my father's son.
Nickerson
Bg = BS-P,
where G is the group for which chainsand homology groups are defined.
feel that they understand some assertions much more completely than
others.
For another example of the fact that understanding can vary in
degree or completeness, consider the familiar "equals"sign (=), which
surely must be one of the most widely used of all mathematical symbols.
It is among the first mathematical symbols students encounter, and it
is used extensively in mathematics courses at all levels. Understanding
the meaning of this symbol would seem to be a fundamental requirement
for mathematical competence, even at introductory levels of mathe-
matics. However, there is reason to believe that many students, even
after several year of mathematics courses, do not have a very complete
understanding of what the equals sign means or can mean. This lack
of understanding can lead to serious conceptual confusion in the inter-
pretation of rather simple equations, as the findings described in an
earlier section of this paper demonstrate.
Realization that the expression to the left of an equals sign is, in
some sense, equal to the expression to the right constitutes some
understanding of the meaning of the sign. Certainly this is better than
thinking it means that one is to add the expression on the left of the
sign to the expression on the right of the sign. However, there is more
to understanding this sign than that.
In fact the equals sign has several meanings, even in elementary
mathematics. To illustrate, in each of the three following expressions,
the symbol means something distinctly different from what it means
in the others:
X2 + X - 12 = (X + 4)(X - 3)
Y = 2X + 3
X2 + 3X - 10 = 0.
Understandingand Expertise
asked to specify problem features that led them to adopt their chosen
approaches, novices and experts gave quite different answers. Novices
mentioned literal objects and terms contained in the problem statement;
experts were much more likely to mention both states and conditions
of the physical situation described by the problem and derived or
"second order" features not mentioned explicitly in the problem state-
ment.
The expert brings to a problem situation a repertoire of useful
hypotheses about problem types, knowledge about how to test those
hypotheses efficiently, and knowledge about what to do if and when
a hypothesis is confirmed or supported (Chase and Simon 1973; Hayes-
Roth 1978). There is some evidence that experts focus quickly on one
or more hypotheses as they begin to process (e.g., read) a problem
description and that, once formed, a tentative hypothesis guides the
acquisition and processing of additional descriptive information. In
other words, compared to novices, experts look for specific information
much earlier in the process. To use a distinction that is currently
popular, one might say that the expert's approach involves more "top-
down" processing than the novice's.
A way to characterize the difference between an expert's under-
standing of a problem and that of a novice is with respect to the
richness of the knowledge base from which the understanding derives.
While both novices and experts must make use of the memory's stored
knowledge to solve problems, findings showing that experts tend to
obtain solutions faster and typically verbalize a smaller number of
steps in the solution process (Larkin, McDermott, Simon and Simon
1980) suggest that the relevant knowledge they possess may be stored
in larger chunks. The fact that experts have a wealth of knowledge
about a problem domain permits them to classify problems as abstractly
defined types, to select and apply approaches known to be appropriate,
to anticipate the types of solutions that must be obtained, and to judge
the plausibility of solutions that have been found. Novices cannot do
these things as effectively as experts because they lack the concepts
and procedural knowledge on which these abilities are based.
However, the question arises whether experts differ from novices
in their ability to deal with problems that are not represented in their
prototype repertoires. Johnson et al. (1980) have been able to identify
certain physics problems that appear to represent "holes" in typical
physics curricula in the sense that problems of these types are not
covered in widely used texts. Some of these problems have a garden-
path aspect inasmuch as the "obvious"solutions turn out to be incorrect;
even physics professors often were found to have difficulties with
them.
on the general skills that the problem solver has learned to process
in English prose. A scientific representation of the same problem
would contain entities representing principles, operations, or rela-
tionships that define physics as a discipline or area of knowledge. The
construction of such a representation requires not only knowledge of
how to process English prose but also knowledge of the entities typically
found in physics problems and of their relationships.
A scientific representation is more abstract than a naive representation
because a single scientific representation can accommodate many naive
representations. An object or collection of objects that might appear
in a naive representation can be treated as a system in a scientific
representation. Larkin suggests that the greater degree of abstraction
in scientific representations is central to what understanding means.
Within a specific area of knowledge, the difference between an expert
and a novice lies in the fact that the expert is more likely than the
novice to be able to cast a new problem into a familiar scientific rep-
resentation. Two problems that look very different in terms of naive
representations may be identical in terms of their scientific represen-
tations, and the expert, by virtue of having the knowledge required
to construct scientific representations, is more likely than the novice
to be able to deal with new problems as familiar ones to which known
and proven techniques may be applied.
Mathematical representations are even more abstract than scientific
representations since one equation can characterize several scientific
representations. Although expert problem solvers, at least in the physical
sciences, use mathematical representations effectively, Larkin argues
that the key difference between expert and novice problem solvers
lies in the ability to construct and use scientific representations. Evidence
suggests that scientists typically do a large amount of thinking about
a problem in terms of scientific representations before getting to the
point of writing equations. Indeed, several investigators of the differences
between expert and novice problem solvers have noted the greater
tendency of experts to analyze a problem qualitatively before attempting
a quantitative representation (Larkin et al. 1980; McDermott and Larkin
1978; Simon and Simon 1978; Chi et al. 1981). Novices appear to be
more likely than experts to try to translate a problem directly into
quantitative equations.
How can one be sure that someone else understands a concept? Perhaps
one cannot. For that matter, how can one be sure that one understands
a concept oneself? Again, perhaps one cannot. A fundamental limitation
on our ability to assess understanding stems from the difficulty we
encounter in trying to define the concept in a completely satisfactory
way.
On the one hand, we might insist that one cannot really understand
anything very deeply without understanding its relationships, and
especially its cause-effect relationships. If this is the case, one would
have to conclude that one cannot understand hearing without un-
derstanding the physics of sound, or biology without understanding
the chemistry of the living cell, or biochemistry without a knowledge
of molecular, atomic, and subatomic structures and processes. Could
one be said to understand physics in the absence of a theory of ep-
istemology and an appreciation of the roles of observation, perception,
and inference as determining our conceptions of the nature of things?
On the other hand, this seems a bit extreme. Would we insist that
a computer programmer does not understand a program he has written
unless he understands how the high-level language code will be translated
into a binary code, how that code will be represented in the machine's
memory, and how the computer hardware will access, decode, and
execute the individual instructions? Would we not be willing to say
that a programmer understands his program if he can describe what
it does at the level of the symbols he has written and can predict the
consequences, again at a macroscopic level, of running it under specified
conditions or with specified inputs?
The problem of arriving at an adequate definition of understanding
remains a challenge, and until such a definition is developed, it will
be difficult to have a methodology for determining whether, or the
degree to which, understanding has been attained in any particular
instance. For practical purposes, however, we may be willing to finesse
the definitional problem and work on the assumption that the concept
is meaningful enough intuitively to permit us to accept various things
as evidences of understanding: the ability to communicate effectively
with people who are knowledgeable with respect to a given domain;
the ability to apply a principle consistently in a variety of contexts;
the ability to carry out a process or procedure in such a way as to
obtain consistently the desired results; the feeling or subjective con-
fidence that one understands ("sees")a principle or relationship (perhaps
not strong evidence but not unimportant either); the ability to draw
analogies that are considered appropriate by people who are presumed
to be knowledgeable with respect to the domain.
Perhaps the most important point is that if one deeply understands
a concept, principle, or process, that understanding should be de-
monstrable in a variety of ways. Conversely, to conclude that one
understands something well on the basis of a single test may, in general,
be a risky practice. Certainly, the fact that one can use a word appro-
priately in context does not demonstrate a very deep understanding
of the meaning(s) of the word; nor does the fact that physics students
use formulas and equations correctly to solve textbook problems con-
stitute good evidence that they understand the concepts involved in
more than a superficial way.
Conceptual Complexity
Summary
Evidence is good that students often get through many years of formal
education without acquiring a sufficiently deep understanding of some
of the fundamental concepts they have studied; they are not able to
apply those concepts effectively in new contexts. Our ability to design
educational policies and procedures that will ensure understanding is
constrained by our limited knowledge of what it means to understand
and how to determine whether, or the extent to which, understanding
has been attained. The concept of understanding is a fundamental
one for education, however, and it deserves more attention than it
has received. In this essay I have made and tried to illustrate some
points about the concept, including the following:
the conceptual context in which one can embed a new fact, the more
one can be said to understand the fact. An obvious objection to this
position is that it simply displaces our original problem by raising the
question of what it means to know, but there may be no way out of
this bind.
At root, understanding is a true paradox: the more one learns about
some aspect of the world, the more aware one is likely to become of
the depth of one's ignorance of it. That does not necessarily mean
that as a consequence of learning, one's understanding actually decreases,
but simply that one's appreciation of the complexity of that aspect of
the world is likely to increase-which may be, after all, a better un-
derstanding of a fundamental sort. Certainly, what it means to un-
derstand is itself much more complex than might at first appear. But
recognition of this fact may be a step in the direction of better un-
derstanding not only what it means to understand but also how to
promote understanding more effectively and how to determine the
extent to which understanding has been attained.
References
Stevens, Albert L., and Allan Collins. "The Goal Structure of a Socratic Tutor."
In Proceedings of the Associationfor ComputingMachineryAnnual Conference,
Seattle, 1977.
Stevens, Albert L., and Allan Collins. "Multiple Conceptual Model of a Complex
System. In Aptitude,Learning, and Instruction,2, edited by Richard E. Snow,
Patrick A. Federico, and W. E. Montague. Hillsdale, N.J.: Lawrence Erlbaum
Associates, 1980.
The WayThings Work:An IllustratedEncyclopediaof Technology.New York: Simon
& Schuster, 1967.
Trowbridge, D. E., and L. C. McDermott. "Investigation of Student Under-
standing of the Concept of Velocity in One Dimension." AmericanJournal
of Physics 48, no. 12 (1980): 1020-28.
Webster'sNew CollegiateDictionary. Springfield, Mass.: Merriam-Webster, Inc.,
1976.
Whimbey, Arthur, and Jack Lochhead. Problem Solving and Comprehension:A
Short Course in Analytic Reasoning. Philadelphia: Franklin Institute Press,
1979.
Wittrock, Merlin C. "Learning as a Generative Process."EducationalPsychologist
11 (1974): 87-95.
Wittrock, Merlin C. "The Cognitive Movement in Instruction." Educational
Psychologist13 (1978): 15-29.
Wittrock, Merlin C. "Reading Comprehension." In Neuropsychologicaland Cogni-
tive Processesin Reading, edited by F. J. Pirozzolo and Merlin C. Wittrock.
New York: Academic Press, 1981.
Young, Richard M., and Tim O'Shea. "Errorsin Children's Subtraction."Cognitive
Science 5 (1981): 153-77.