Professional Documents
Culture Documents
Effect of Explicit Problem Solving Instruction On High School Students' Problem-Solving Performance and Conceptual Understanding of Physics
Effect of Explicit Problem Solving Instruction On High School Students' Problem-Solving Performance and Conceptual Understanding of Physics
Effect of Explicit Problem Solving Instruction On High School Students' Problem-Solving Performance and Conceptual Understanding of Physics
551–570 (1997)
Douglas Huffman
Department of Curriculum and Instruction, 150 Peik Hall, University of Minnesota,
159 Pillsbury Drive SE, Minneapolis, Minnesota 55455
Abstract: In this study a two-sample, pre/posttest, quasi-experimental design was used to investigate
the effect of explicit problem-solving instruction on high school students’ conceptual understanding of
physics. Eight physics classes, with a total of 145 students, were randomly assigned to either a treatment
or comparison group. The four treatment classes were taught how to use an explicit problem-solving strat-
egy, while the four comparison classes were taught how to use a textbook problem-solving strategy. Stu-
dents’ problem-solving performance and conceptual understanding were assessed both before and after in-
struction. The results indicated that the explicit strategy improved the quality and completeness of students’
physics representations more than the textbook strategy, but there was no difference between the two strate-
gies on match of equations with representations, organization, or mathematical execution. In terms of con-
ceptual understanding, there was no overall difference between the two groups; however, there was a signif-
icant interaction between the sex of the students and group. The explicit strategy appeared to benefit female
students, while the textbook strategy appeared to benefit male students. The implications of these results for
physics instruction are discussed. © 1997 John Wiley & Sons, Inc. J Res Sci Teach 34: 551–570, 1997.
One instructional method that has been used to address both problem-solving performance
and conceptual understanding is explicit problem-solving instruction. Explicit problem solving
is instruction that directly teaches students how to use more advanced techniques for solving
problems. Textbook problem solving, on the other hand, often provides only a general outline
of steps to follow for solving problems and does not usually provide explicit instruction on how
to apply those steps. Textbook problem solving also tends to emphasize primarily the quantita-
tive aspects of problem solving, while explicit problem solving tends to emphasize both the
qualitative and quantitative aspects of problem solving. This emphasis on the qualitative aspects
of problem solving may help students not only to improve their problem-solving performance,
but also to better understand the concepts and principles of physics. Therefore, to test the effect
of explicit problem-solving instruction, this study was designed to determine if high school stu-
dents who were taught how to use an explicit problem-solving strategy exhibited more im-
provement in problem-solving performance and more improvement in conceptual understand-
ing of physics than students who were taught how to use a textbook problem-solving strategy.
instruction. Another important goal of physics instruction is to help students develop an under-
standing of the concepts and principles of physics. It is clear that beginning physics students
have great difficulty learning physics concepts. Numerous studies have documented the alter-
native conceptions held by beginning physics students; in fact, there have been over 300 stud-
ies devoted to the conceptual understanding of mechanics alone (Wandersee et al., 1994). Much
of the work on students’ conceptual understanding has focused on identifying and documenting
the extent to which students’ understanding of mechanics deviates from accepted scientific un-
derstanding. Research indicates that alternative conceptions of mechanics are very prevalent
among high school and college students, and that they are highly resistant to change (diSessa,
1982; Clement, 1982; Minstrell, 1982; McClosky, 1983; McDermott, 1984; Gunstone, 1987).
One technique that has been used to address both problem solving and conceptual under-
standing is explicit problem solving. Explicit problem solving tends to emphasize both the qual-
itative and quantitative aspects of problem solving, and it is this dual emphasis which may help
students not only to improve their problem-solving performance, but also to better understand
concepts. Textbook problem solving, on the other hand, tends to emphasize primarily the quan-
titative aspects of problem solving, and some physics educators claim that an emphasis on the
quantitative aspects of problem solving may actually obscure students’ understanding of the
physics (Hewitt, 1992).
Classroom-based experimental studies that focus specifically on the effect of problem-solv-
ing instruction on students’ conceptual understanding of physics are relatively rare in the prob-
lem-solving literature. The majority of research related to problem solving and conceptual un-
derstanding focuses on the relationship of conceptual understanding on problem-solving
performance, rather than vice versa. In one of the few studies on the effect of problem solving
on students’ physics knowledge, Heller et al. (1992) reported that during the group problem-
solving process of justifying statements, clarifying ideas, and elaborating on explanations, stu-
dents appeared to be deepening their understanding of physics concepts and principles. How-
ever, this claim has not been formally tested.
There is also a lack of research on the differences between male and female problem-solv-
ing performance and conceptual understanding. In a study with introductory university physics
students, Heller and Hollabaugh (1992) investigated the impact of homogeneous and heteroge-
neous cooperative group structures on physics problem-solving performance. They reported that
the best problem-solving performance was achieved with cooperative groups of three students
that were composed of either all male students or 1 male and 2 female students. It was observed
that male students tend to dominate the group problem-solving process, and this domination did
not necessarily lead to better group problem-solving performance. When male students were
placed in groups with a female majority, the groups tended to demonstrated better problem-solv-
ing performance. Heller and Lin (1992) conducted one of the only analyses of problem solving
and conceptual understanding by sex in physics. They found that male and female introductory
physics students performed equally well on physics problems after students were taught how to
use an explicit problem-solving strategy in a cooperative group environment. In terms of con-
ceptual understanding, they reported that among those students who had taken high school
physics, the male students scored significantly higher than female students at the beginning of
the course, but by the end of the course there were no significant differences between male and
female scores on a multiple-choice test of conceptual understanding. It was reported that a cog-
nitive apprenticeship instructional approach using cooperative group instruction, and an explic-
it problem-solving strategy appeared to help close the gap between male and female physics stu-
dents. In both of these studies using the explicit problem-solving strategy (Heller & Hollabaugh,
1992; Heller & Lin, 1992), it was reported that there appeared to be differences in male and fe-
554 HUFFMAN
male students’ willingness to use the explicit problem-solving strategy, with a larger proportion
of women than men adopting the explicit strategy.
All in all, the research on physics problem solving and conceptual understanding has im-
portant implications regarding the design of the present study. The research on expert and novice
problem solving indicates there are distinct differences in the procedures novices and experts
use to solve problems. This research in turn has led to the development of instructional meth-
ods to help students develop more advanced problem-solving techniques. The research on prob-
lem solving indicates that instruction can help students to use more expertlike techniques; how-
ever, there is a noticeable lack of classroom-based research on the role of problem-solving
instruction in students’ conceptual understanding of physics.
Given the need for more instructional studies of problem solving, the lack of research on
the effect of physics problem solving on students’ understanding of concepts, and the hypothe-
sis that explicit problem solving may actually enhance students’ conceptual understanding of
physics, this study was designed to test the effect of explicit problem solving on high school
students’ conceptual understanding of physics. Specifically, this study was designed to deter-
mine if students who were taught how to use an explicit problem-solving strategy exhibited
more improvement in problem-solving performance and conceptual understanding of physics
than students who were taught how to use a textbook problem-solving strategy.
Method
Research Design
This study was conducted during an 18-week-long semester at a large suburban high school
in the midwest. In this study, a two-sample, pretest/posttest, quasi-experimental design was used
to determine whether students who were taught how to use an explicit problem-solving strate-
gy exhibited more improvement in problem-solving performance and conceptual understanding
of physics than students who were taught how to use a textbook problem-solving strategy.
This study included two phases: problem-solving instructional and conceptual instruction.
During the problem-solving instructional phase, eight physics classes, with a total of 145 stu-
dents, were randomly assigned to either the treatment or comparison group. For each of the two
teachers who participated in this study, two of their classes were randomly assigned to the treat-
ment group and two of their classes were randomly assigned to the comparison group. The four
treatment classes were taught how to use an explicit problem-solving strategy, while the four
comparison classes were taught how to use a textbook problem-solving strategy. Throughout the
problem-solving phase, students practiced solving problems using their respective strategies in
weekly group problem-solving sessions using cooperative learning as defined by Johnson, John-
son, and Holubec (1986).
The background characteristics of the students were analyzed to establish the quasi-equiva-
lence of the two groups. The results of this analysis indicated that there were no significant dif-
ferences between the background characteristics of the two groups. The students were similar
in terms of their grade point averages, science and mathematics course backgrounds, and in-
tention to enroll in college.
After the students learned how to use their respective problem-solving strategies, Phase two
of the study began. During this phase, students in both groups were taught an identical unit on
Newton’s laws. Both groups continued to solve problems in weekly cooperative group problem-
solving sessions using their respective strategies. At the end of Phase two, the conceptual un-
derstanding and problem-solving performance of students who used the explicit strategy was
compared to that of students who used the textbook strategy.
EFFECT OF EXPLICIT PROBLEM SOLVING 555
starts with the second equation and progresses backward to the target variable. The fourth step
is to execute the plan. In this step, the equations are combined algebraically according to the
plan, to produce an equation with a single unknown target variable. The units of each term in
this equation are checked to make sure they are correct, and are converted if necessary. Final-
ly, the known quantities are inserted into the equation to calculate the value of the target vari-
EFFECT OF EXPLICIT PROBLEM SOLVING 557
able. The final step is to evaluate the solution. In this step, the solution is checked to ensure that
it is properly stated, reasonable, and complete. In the example solution, the units are checked to
confirm that they are in units of distance, the magnitude of the answer is checked to ensure that
it is reasonable, and the answer is checked to confirm that the original question has indeed been
answered.
Although on the surface the explicit strategy appears to be quite similar to the textbook
strategy, the explicit strategy provides a much more detailed series of instructions for students
to follow, including bridging steps that help students move from one step to the next. The ex-
plicit strategy can be viewed as a systematic series of translations, in which each step requires
the student to translate the problem into increasingly more abstract and mathematical represen-
tations of the problem. In contrast, the textbook strategy merely provides a general framework
for solving a problem and provides fewer specific instructions on how to perform each step and
how to make the translation from one step to the next.
Another component of the explicit problem-solving strategy is the use of context-rich, real-
world problems. Table 1 includes an example of a textbook problem and a context-rich prob-
lem. Context-rich problems are real-world problem situations that tend to have the following
characteristics: (a) real-world contexts, (b) problem statements that do not explicitly identify
what one needs to find, (c) extra information that may not be necessary for solving the prob-
lem, and (d) a lack of explicitness that requires the student to make reasonable assumptions to
solve the problem (Heller et al., 1992). They tend to be much more complex than traditional
textbook problems, and as a result, are much more difficult to solve.
Context-rich problems were used because the complexity of the problem played an im-
portant role in promoting the use of the strategy. When students were asked to solve tradition-
al one- or two-step textbook problems, they would often resort to their novice problem-solving
strategies, because many of the textbook problems could be successfully solved with novice
techniques. However, when students were faced with context-rich problems, their novice prob-
lem-solving techniques were not sufficient to solve the problem, and hence the students had a
need to learn more expertlike techniques (Heller & Hollabaugh, 1992). For these reasons, the
students in the explicit group solved context-rich problems rather than the one- or two-step prob-
lems found in most physics textbooks.
Table 1
Problem-solving pretest and posttest
Runner problem: Ann and Bill are practicing for their next competition race. Ann runs at a constant
speed of 3 m/s down a long, straight road. After 5 min, Bill starts from the same place and runs at a
faster constant speed of 4 m/s. How far from the starting point will the runners be when Bill catches up
to Ann?
Asteroid problem: It has been proposed that dinosaurs and many other organisms became extinct 65 mil-
lion years ago because Earth was struck by a large asteroid. The idea is that dust from the impact was
lofted into the upper atmosphere all around the globe, where it lingered for at least several months and
blocked the sunlight from reaching Earth’s surface. On the dark and cold Earth that temporarily resulted,
many forms of life then became extinct. Available evidence suggests that about 20% of the asteroid’s
mass ended up as dust spread uniformly over the earth after settling out of the upper atmosphere. About
0.020 g/cm2 of dust, which is chemically different from the earth’s rock, covered the earth’s surface.
Typical asteroids have a density of about 2.0 g/cm3. It has been suggested that such an asteroid collision
is likely to happen again, perhaps causing the extinction of the current dominant life-form on earth (us).
As we scan the space for this danger, how large an ateroid should we be watching for?
558 HUFFMAN
Instruments
Problem-solving performance was assessed before and after instruction through the use of
both a traditional textbook problem and a context-rich problem. The problems used in this study
were developed by Heller and Hollabaugh (1992) as part of their study on cooperative group
problem solving. The treatment group had more practice with context-rich problems during the
course of the study, while the comparison group had more practice with textbooks; thus, both
types of problems were included on the problem-solving test in an attempt to equalize the ad-
vantage each group may have had on the test. The two problems are presented in Table 1. They
were administered in two consecutive days during the first and last weeks of the study. Because
of the time-consuming nature of solving context-rich physics problems, students were given a
full 50 min to solve each problem.
Scoring Written Problem Solutions. The quality of the solutions was judged using the char-
acteristics of expertlike problem solving identified in the problem-solving literature (Larkin et
al., 1980; Woods, 1989). These characteristics included detailed qualitative descriptions of prob-
lems; mathematical solutions that match the qualitative descriptions; logical, well-organized so-
lutions; and correct mathematical executions. The scoring rubric used in this study was designed
to measure these general characteristics of expertlike problem solving and is presented in Table
2. Tests were originally scored using the 15-point rubric in Table 2. To make comparisons more
easily between the five different characteristics that were scored, each of the five subscores were
equally weighted by translating them to a 5-point scale for a total maximum score of 25 points.
The interrater reliability of the problem scoring was .95.
Newton’s Laws Test. To provide a more in-depth measure of students’ understanding than
could be provided with a multiple-choice test, an open-ended test was also used in this study.
Three open-ended questions that focused respectively on the three Newton’s laws were admin-
istered both before and after instruction. The Newton’s Laws Test included open-ended ques-
tions developed by Heller and Hollabaugh (1992) as part of a study of cooperative group prob-
lem solving. The Newton’s Laws Test was designed to reveal students’ understanding of
Newton’s laws by having students respond in writing to open-ended situations. Responses to the
open-ended questions were analyzed in two steps. The responses were first classified into logi-
cal categories, and then each category was assigned a ranked score. The interrater reliability of
the scoring was .95. Follow-up interviews with a sample of students were also conducted to con-
firm students’ written responses.
EFFECT OF EXPLICIT PROBLEM SOLVING 559
Table 2
Problem-solving scoring rubric
The first open-ended question involved a ball on a table and was designed to focus primarily
on students’ understanding of the first law. In this question, a ball sitting on a table is given a
quick push so that the ball rolls off the end of a table (Figure 2). Students were asked to de-
scribe the forces on the ball at four different times: before the ball was pushed, while the ball
was being pushed, while the ball was rolling across table, and when the ball was in the air.
An understanding of the first law was suggested by a response indicating that the forces on
the ball are balanced when the ball is at rest, and when the ball is rolling across the table at a
constant velocity. Responses were therefore classified into one of two categories: balanced or
unbalanced forces on the ball. Points were assigned according to the following criteria: 2 points
5 balanced forces on a ball at both rest and at a constant velocity; 1 point 5 balanced forces
on a ball at either rest or a constant velocity; and 0 points 5 unbalanced forces on a ball at rest
and at a constant velocity.
The second open-ended question was the cart and block question, designed to focus pri-
marily on the second law. The purpose of this question was to probe students’ understanding of
the relationship between force, mass, velocity, and acceleration. In this question, a mining cart
was pulled along a track by a large block that hung over the edge of a deep canyon (Figure 3).
Students were asked to describe what would happen to the velocity and acceleration of the cart
if the block were suddenly made much smaller than the cart.
560 HUFFMAN
An understanding of the second law was suggested by a response that if the mass of the
block were made much smaller, the acceleration of the cart would decrease proportionally, while
the velocity of the cart would continue to increase. Students frequently failed to discriminate
between velocity and acceleration, and often indicated that velocity is proportional to force
rather than acceleration. Responses to this question were therefore classified into three different
categories according to the relationship between acceleration, velocity, and force: (a) accelera-
tion is proportional to force, and velocity is not proportional to force; (b) acceleration and ve-
locity are both proportional to force; and (c) acceleration is not proportional to force. Points
were then assigned according to the following criteria: 2 points 5 acceleration is proportional
to force, and velocity is not proportional to force; 1 point 5 acceleration is proportional to force,
but velocity is also proportional to force; and 0 points 5 acceleration is not proportional to force.
The third open-ended question was the bug and car question, designed to focus primarily
on the third law. In this question, a car traveling at 55 mph collides with a bug (Figure 4). The
students were asked to draw all of the forces acting on the bug and the car at the moment of im-
pact, and to describe each force in words. An understanding of the third law was suggested by
a response indicating that the force of the car on the bug is equal in magnitude to the force of
the bug on the car. Students frequently wrote that the larger object exerts a larger force. Re-
sponses to this question were classified into one of two categories: (a) the force of the car on
the bug is equal to the force of the bug on the car; or (b) the force of the car on the bug is not
equal to the force of the bug on the car. A portion of the responses did not include enough in-
formation to determine the forces on the bug and the car. These responses were classified as un-
able to be coded. Scores were then assigned according to the following criteria: 1 point 5 the
force of the car on the bug is equal to the force of the bug on the car; and 0 points 5 the force
of the car on the bug is not equal to the force of the bug on the car.
Results
To determine whether students who were taught the explicit problem-solving strategy ex-
hibit more improvement in problem-solving performance than students who were taught how to
use a textbook problem-solving strategy, gain scores on both the asteroid and runner problems
were compared. Because the problem-solving scoring rubric was an ordinal scale, the nonpara-
metric Wilcoxon rank sum test was calculated on the gain scores to determine if there was a sig-
nificant difference between the two groups. The problem-solving gain scores were also analyzed
by sex within groups.
Table 3
Runner and asteroid problem pretest, posttest, and gain scores, by group
Runner problem
Explicit (n 5 86) 8.8 4.3 14.1 5.4 5.2 6.7
Textbook (n 5 59) 10.0 4.3 10.7 4.4 0.8 5.4
Asteroid problem
Explicit (n 5 86) 4.9 2.4 5.5 4.7 0.6 4.6
Textbook (n 5 59) 5.2 2.6 5.1 3.4 20.1 3.7
Subscores on the runner problem were also analyzed to compare specific characteristics of
the problem-solving solutions. The total score on the runner problem was composed of five dif-
ferent subscores: quality of the physics representation, completeness of physics representation,
match of equations with physics representation, organization of solution, and mathematical exe-
cution. The subscore gains on the runner problem by group are presented in Table 4.
The gain scores for each of these characteristics had a range from 0 to 5 points. On a per-
cent basis, the explicit group had a 46% gain in representation quality, and the textbook group
a 6% gain. On representation completeness, the explicit group had a 40% gain, and the textbook
group a 4% gain. On the match of equation, the explicit group had a 14% gain, and the text-
book group a 0% gain. On organization, the explicit group had a 0% gain, and the textbook
group a 4% gain. Finally, on mathematical execution, the explicit group had a 2% gain, and text-
book group a 0% gain.
Table 4
Runner and asteroid problem subscore gains, by group
Gain Scores
Runner problem
Representation quality 2.3 2.3 0.3 2.1 5.23 ,.0001*
Representation complete 2.0 2.3 0.2 1.8 5.04 ,.0001*
Match of equations 0.7 1.7 0.0 1.3 2.98 .003*
Organization 0.0 1.2 0.2 1.1 0.44 .66
Mathematical execution 0.1 1.8 0.0 1.8 0.29 .77
Total score 5.2 6.7 0.8 5.4 4.07 ,.0001*
Asteroid problem
Representation quality 0.8 1.6 0.1 1.5 2.24 .03*
Representation complete 0.6 1.4 0.1 0.9 2.30 .02*
Match of equations 20.4 1.3 0.1 1.1 1.27 .21
Organization 20.2 1.0 0.0 0.8 2.09 .04*
Mathematical execution 20.1 1.1 20.2 1.0 .21 .84
Total score 0.6 4.6 20.1 3.7 .79 .43
*p # .05
EFFECT OF EXPLICIT PROBLEM SOLVING 563
A Wilcoxon rank sum test on the subscores indicated that there were statistically significant
differences on 3 of the 5 problem-solving characteristics. The explicit group had significantly
higher gains on the quality of the physics representation (z 5 5.23; p , .0001), on the useful-
ness of the physics representation (z 5 5.04; p , .0001), and on the match of equations with
physics representation (z 5 2.98; p 5 .003). There were no significant differences on the orga-
nization of the solutions or the mathematical executions.
The runner problem scores were also analyzed by sex within groups and are presented in
Table 5. A Wilcoxon rank sum test by sex indicated that there was no statistically significant
difference between the two groups on the gain scores. For the explicit group, z 5 1.29, p 5 .20,
and for the textbook group, z 5 1.30, p 5 .31. It was not possible to test for interaction using
a Wilcoxon rank sum test; however, a graphic examination of gain scores was conducted and
indicated that there was no apparent interaction.
Table 5
Runner and asteroid problem gain scores, by sex, within group
Female Male
Group M SD n M SD n
Runner problem
Explicit (n 5 86) 6.8 6.0 29 4.5 7.0 57
Textbook (n 5 59) 1.3 6.0 30 0.3 4.8 29
Asteroid problem
Explicit (n 5 86) 1.0 .5 29 0.5 4.8 57
Textbook (n 5 59) 20.5 4.0 30 0.3 3.3 29
564 HUFFMAN
score differences were statistically significant. For the explicit group, z 5 .44, p 5 .66; and for
the textbook group, z 5 .76, p 5 .45.
Table 6
Force Concept Inventory pretest, posttest, and gain scores, by sex
Table 7
Two-way ANOVA of Force Concept Inventory gain scores,
by group and sex
Effects SS df MS F
*p # .05
the gain scores indicated that for the first law question, the textbook group had a significantly
higher mean gain score than the explicit group (z 5 2.25; p 5 .02); for the second law ques-
tion, there was no significant difference in the gain scores by group (z 5 .97; p 5 .33); and for
the third law question, there was no significant difference in gain scores by group (z 5 1.39; p
5 .17).
The Newton’s Laws Test was also analyzed by sex within group to determine if there was
a significant difference between the gain scores of male and female students. Gain scores on the
Newton’s Laws Test by sex within group are presented in Table 9. A Wilcoxon rank sum on the
gain scores indicated that there were no significant differences in gain scores by sex on any of
the three Newton’s laws questions. On the first law question, for the explicit group, z 5 1.62, p
5 .10; and for the textbook group, z 5 .36, p 5 .72. On the second law question, for the ex-
plicit group, z 5 1.28, p 5 .20; and for the textbook group, z 5 .06, p 5 .95. On the third law
question, for the explicit group, z 5 .92, p 5 .36; and for the textbook group, z 5 .40, p 5 .69.
A graphic analysis did not reveal any indication of an interaction between sex and group.
Table 8
Pretests, posttests, and gain scores on Newton’s Laws Test,
by group
First law
Pre .96 .94 .66 .86
Post 1.41 .90 1.47 .86
Gain .46 1.02 .81 1.22
Second law
Pre .58 .64 .64 .58
Post .71 .72 .66 .78
Gain .13 .88 .02 .78
Third law
Pre .07 .27 .10 .31
Post .35 .48 .47 .50
Gain .26 .51 .40 .58
566 HUFFMAN
Table 9
Newton’s Laws Test gain scores, by group and sex
First law .69 1.11 .32 .96 .83 1.32 .79 1.15
Second law .00 .85 .19 .90 .03 .81 .00 .76
Third law .35 .49 .21 .51 .43 .60 .36 .58
Discussion
Previous research indicates that explicit problem-solving instruction can help improve stu-
dents’ problem-solving performance more than traditional instruction (Mestre et al., 1993;
Heller et al., 1992; Van Heuvelen, 1990; Wright & Williams, 1986; Heller & Reif, 1984; Larkin
& Reif, 1979; Reif et al., 1976). The results of this study indicated that explicit problem-solv-
ing instruction can help improve some, but not all aspects of students’ problem-solving perfor-
mance. One of the primary differences between the two groups was in the qualitative descrip-
tions of the problems. The students in the explicit group demonstrated more improvement in the
quality and completeness of their physics representations; this difference appears to have been
due to the different problem-solving instruction that the students received. Both groups were
taught to draw a sketch and define variables, but in addition, the explicit group was taught to
rewrite the question, decide on an approach, draw a physics diagram, select a target variable,
and select quantitative relationships. These additional instructions appear to have helped im-
prove the explicit groups’ physics representations more than the textbook group. The problem-
solving literature suggests that improvements in problem representation can have practical im-
plications for students. Larkin (1983a) claimed that representations are one of the most crucial
aspects of problem solving, because they can determine the direction of the entire solution. Dia-
grams can be useful because of the way they help organize information into chunks that can be
used in the problem solution (Larkin & Simon, 1987).
The results on the organization of problem solutions were contrary to what was expected.
It was hypothesized that teaching students how to plan a solution to a problem would improve
their organization of the solution more than students who were not taught how to plan. How-
ever, there were no significant differences between the two groups on organization of the solu-
tions, although the explicit group was directly taught to write a plan to the solution and the text-
book group was not. The explicit group was given detailed instructions on how to construct
equations, check for sufficiency of the equations, and outline the math solution of the problem,
while the textbook group was given no instructions on how to plan a solution to the problem.
The additional planning instruction that the explicit group received apparently did not result in
greater improvement in students’ logical organization of the solution. Although these results are
surprising, they are reasonable when one considers the previous research which indicates that
planning is one of the most difficult problem-solving skills for novices to learn (Dalby, Tourni-
aire, & Linn, 1986). One of the reasons why planning may not have improved students’ orga-
nization of the solution as much as expected is that novices lack problem-solving experience,
problem-solving procedures, and an understanding of the domain, all of which are helping in
planning solutions to physics problems (Eylon & Linn, 1988). The results of the present study
EFFECT OF EXPLICIT PROBLEM SOLVING 567
appear to support the notion that planning is one of the most difficult problem-solving skills for
students to use, and one that may not improve novices’ organization of the solution.
There were also no significant differences between the two groups in terms of students’
mathematical execution. In fact, neither group gained even more than 5% on their mathemati-
cal execution score. The lack of difference in the mathematical execution gain scores is also sur-
prising, because the two groups were given different instructions on how to execute the math-
ematics. The explicit group was given instructions on how to execute the mathematics in
accordance with the plan, and how to solve algebraically for the target variable before inserting
numbers into the equations, while the students in the textbook group were merely instructed to
solve the mathematical equations any way they wanted to obtain an answer. Despite the differ-
ent instructions, there were no significant differences in the improvement of the two groups in
terms of mathematical execution.
Another purpose of this study was to determine if students who were taught how to use an
explicit problem-solving strategy exhibited more improvement in conceptual understanding of
Newton’s laws than students who were taught how to use a traditional textbook strategy. Ac-
cording to Maloney (1994), there is a lack of research on the role of problem solving in learn-
ing physics concepts, and it is important to investigate the issue given that many physics in-
structors unquestionably assume that problem solving is a vehicle for learning physics. The
results of the Force Concept Inventory and the Newton’s Laws Test both indicated that the ex-
plicit strategy did not improve students’ conceptual understanding of Newton’s laws more than
the textbook strategy. The explicit group did not gain more than the textbook group on the Force
Concept Inventory or any of the three questions on Newton’s laws. These results are surprising
given the conceptual nature of the explicit problem-solving strategy compared to the computa-
tional nature of textbook problem solving. Despite the direct steps taken to help students focus
on the conceptual aspects of the problems, it did not appear to significantly affect students’ un-
derstanding of concepts.
Although there was no significant difference in the conceptual understanding of the two
groups, there was evidence that both groups did have reasonable gains on these measures. Nu-
merous studies on high school and college students’ understanding of mechanics indicate that
even after instruction, anywhere from 25% to 50% of the students still fail to answer concep-
tual questions correctly (McDermott, 1984). In the present study, the percentage of incorrect re-
sponses on the Force Concept Inventory and the Newton’s Laws Test after instruction is simi-
lar to what has been observed in pervious research.
Despite the lack of difference between the conceptual understanding of the two groups,
there was evidence that the explicit problem-solving strategy differentially affected male and fe-
male students. An analysis of the Force Concept Inventory results by sex revealed that there
were no significant differences in the gain scores by sex; however, there was a significant in-
teraction between sex and group. The explicit strategy appeared to benefit the conceptual un-
derstanding of female students, while the textbook strategy appeared to benefit the conceptual
understanding of male students. It was hypothesized that all students in the explicit group would
gain more than students in the textbook group because of the conceptual nature of the explicit
strategy; however, this did not appear to be the case.
Previous research indicates that in high school physics, male students generally make larg-
er gains in conceptual understanding than female students. Based upon the results of the Me-
chanics Diagnostic Test (Halloun & Hestenes, 1985), which is similar to the Force Concept In-
ventory, Heller and Lin (1992) reported that in high school, male students made significant gains
in conceptual understanding, but female students did not appear to have learned anything in their
high school physics classes. In the present study, as expected, the male students in the textbook
568 HUFFMAN
group had a larger gain than the female students, while the male students in the explicit group
had surprisingly less gain than the female students. These results suggest that the explicit strat-
egy had a differential effect on the conceptual understanding of male and female students.
One possible reason for the interaction between group and sex may be the motivation of
male students. Based on discussions with the classroom teachers and observations of classes,
more male than female students appeared to dislike the new strategy and resisted its use. The
resistance to the strategy could have affected the male students’ scores on the Force Concept In-
ventory and the Newton’s Laws Test. Previous research in physics problem solving has shown
that some male students are resistant to using new techniques. For example, in a study using the
explicit problem-solving strategy with introductory university physics students, Heller and Lin
(1992) reported that a larger proportion of women than men adopted the strategy, and that a
small proportion of men were resistant to the explicit strategy. More research is still needed on
the different effects of explicit problem-solving instruction on male and female students’ levels
of motivation to better understand the interaction that was observed in this study.
Overall, the results of this study have several implications for physics instruction. The re-
sults indicated that explicit problem-solving instruction helped improve the quality and com-
pleteness of students’ problem representations more than students who used textbook tech-
niques. However, there was no evidence that explicit instruction helped improve students’
organization or mathematical execution more than textbook instruction. In terms of conceptual
understanding, the results indicated that despite the emphasis of explicit instruction on the con-
ceptual aspects of problem solving, explicit problem-solving instruction should not necessarily
be viewed as a means of helping students to improve their understanding of the concepts more
than textbook problem solving. Hewitt (1992) claimed that in high school, problem-solving in-
struction actually obscures students’ understanding of the concepts; he recommended teaching
the concepts and principles of physics instead of problem solving. If Hewitt is correct, the time
and effort that teachers devote to teaching problem solving may be better spent on the concepts
and principles of physics. More research is needed to determine if a conceptual course actually
results in more conceptual understanding than a course that combines problem solving and con-
cepts.
The results of this study also indicated that explicit problem-solving instruction may dif-
ferentially affect male and female students’ conceptual understanding. There were indications
that male students who were taught the explicit strategy did not improve their conceptual un-
derstanding as much as expected. In physics, male students typically have greater gains in con-
ceptual understanding than female students; however in this study, the male students in the ex-
plicit group had the lowest gain scores on 3 of the 4 measures of conceptual understanding.
Based on these results, physics instructors need to be aware of the potential for new problem-
solving strategies to differentially affect male and female students. If the interaction between
sex and group was due to the negative reaction of the male students toward the explicit strate-
gy, instructors that use the explicit strategy need to address students’ dislike for the strategy and
find ways of encouraging the use of more expertlike techniques without alienating groups of
students. All in all, more research is clearly needed on the differential effect of problem-solv-
ing instruction on male and female students’ conceptual understanding, to completely under-
stand the interaction that was observed in this study.
References
Chi, M.T.H., Feltovich, P.J., & Glasner, R. (1980). Categorization and representation of
physics problems by experts and novices. Cognitive Science, 5, 121–152.
EFFECT OF EXPLICIT PROBLEM SOLVING 569
Mestre, J.P., Dufresne, R.J., Gerace, W.J., Hardiman, P.T., & Touger, J.S. (1993). Promot-
ing skilled problem-solving behavior among beginning physics students. Journal of Research in
Science Teaching, 30, 303–317.
Minstrell, J. (1982). Explaining the “at rest” condition of an object. The Physics Teacher,
January, 10–14.
Reif, F., & Heller, J.I. (1982). Knowledge structure and problem solving in physics. Edu-
cational Psychologist, 17, 102–127.
Reif, F., Larkin, J., & Brackett, G.C. (1976). Teaching general learning and problem solv-
ing skills. American Journal of Physics, 44, 212–217.
Schoenfeld, A.H. (1985). Mathematical problem solving. San Diego, CA: Academic Press.
Van Heuvelen, A. (1990). Overview—Case-study approach to introductory physics instruc-
tion. Paper presented at the meeting of the American Association of Physics Teachers, Min-
neapolis, MN.
Wandersee, J., Mintzes, J., & Novak, J. (1994). Research on alternative conceptions in sci-
ence. In D. Gabel (Ed.), Handbook of research on science teaching and learning. Washington,
DC: National Science Teachers Association.
Woods, D.R. (1989). Problem solving in practice. In D. Gabel (Ed.), What research says to
the science teacher. Vol. 5: Problem solving. Washington, DC: National Science Teachers As-
sociation.
Wright, D.S., & Williams, C.D. (1986). A WISE strategy for introductory physics. The
Physics Teacher, 24, 211–216.