Introduction to Research in Education

9th Edition Ary Test Bank

Visit to Download in Full: https://testbankdeal.com/download/introduction-to-research-
in-education-9th-edition-ary-test-bank/
Chapter 10—Experimental Research

MULTIPLE CHOICE

1. Which variable does the experimental researcher manipulate?

a. Independent c. Extraneous
b. Attribute d. Dependent
ANS: A PTS: 1

2. Which of the following is not a characteristic of an experiment in its simplest form?

a. A dependent variable is manipulated.
b. All variables except the independent variable are held constant.
c. The effect of manipulating the independent variable is observed.
d. Extraneous variables are controlled.
ANS: A PTS: 1

3. The variable upon which the effects of the experimental treatment are observed is called the
____variable.
a. independent c. extraneous
b. dependent d. control
ANS: B PTS: 1 OBJ: WWW

4. In an experiment, a researcher believes that by manipulating Variable A he can cause changes in

Variable B. However, Variable C is actually causing changes in Variable B. Variable C is a(n) ____
variable.
a. independent c. extraneous
b. dependent d. attribute
ANS: C PTS: 1

5. Which would be the least appropriate way to assign subjects to experimental groups?
a. Rolling a die c. Teacher assignment
b. Flipping a coin d. Using a table of random numbers.
ANS: C PTS: 1

6. The purpose of matching individual subjects before randomly assigning one to Group A and the other
to Group B is to
a. assure that the groups are truly random.
b. assure that the groups are equivalent on the dependent variable.
c. control as many extraneous variables as possible.
d. assure that the groups are not equivalent on the dependent variable.
ANS: C PTS: 1

170
Exhibit 10.1: A third grade teacher feels that vocabulary instruction will help her children improve their
reading scores. Half of her class receives vocabulary instruction, while the other half has a library period. She
will compare reading scores after four months.

7. Refer to Exhibit 10-1. This study would be classified as

a. correlational
b. causal-comparative
c. experimental
d. survey research.
e. trend research
ANS: C PTS: 1

8. Refer to Exhibit 10-1. In order to test her hypothesis the teacher should have which group receive
vocabulary instruction?
a. Those who volunteer
b. The best students
c. The poorest students
d. A randomly selected group
e. Good students who show poor concentration
ANS: D PTS: 1

9. Refer to Exhibit 10-1. The control group would be those who

a. are in the class.
b. are willing to cooperate in the research.
c. have a library period.
d. have high grade averages in reading.
e. receive vocabulary instruction.
ANS: C PTS: 1

10. Refer to Exhibit 10-1. The external validity question in this study would be:
a. is vocabulary instruction worth the time it involves?
b. was vocabulary instruction really responsible for the observed difference in reading
scores?
c. would vocabulary instruction improve reading scores for all third graders?
d. should the teacher have exposed all the students to vocabulary instruction?
ANS: C PTS: 1

11. Refer to Exhibit 10-1. The Hawthorne effect would be most likely to increase the scores of
a. all the students.
b. the best students.
c. the poorest students.
d. the students with vocabulary instruction.
e. the students without vocabulary instruction.
ANS: D PTS: 1

12. Refer to Exhibit 10-1. The independent variable in this study is

a. reading scores. c. gender.
b. vocabulary instruction. d. the size of the sample.
ANS: B PTS: 1

171
13. Refer to Exhibit 10-1. Suppose the group with vocabulary instruction ends up with statistically higher
reading scores than those without vocabulary training. Assuming that there are no problems of internal
validity, the teacher should
a. reject the null hypothesis. c. reject the experimental hypothesis.
b. retain the null hypothesis. d. declare the hypothesis as proven.
ANS: A PTS: 1

14. The fact that people may learn from test taking is an experimental validity threat known as ____; the
fact that the measurement scale may change over the course of the experiment is called ____.
a. instrumentation; testing effect c. testing effect; instrumentation
b. maturation; testing effect d. instrumentation; selection
ANS: C PTS: 1 OBJ: WWW

15. In order to apply the law of the single significant independent variable to a study, a researcher should
a. choose a single test for the dependent variable.
b. determine which single test is most related to the independent variable by using several
tests as possible dependent variable.
c. determine which single variable makes the most difference by varying the independent
variable in many different ways.
d. establish two groups that are as alike as possible, except one is exposed to the independent
variable while the other is not.
ANS: D PTS: 1

16. The set of varied conditions that the experimenter imposes on the subjects is referred to as the
a. independent variable.
b. treatment variable.
c. experimental variable.
d. extraneous variable.
e. a, b, and c
ANS: E PTS: 1

17. A researcher wants to determine the cause of intoxication. On successive days, he consumed large
quantities of scotch and water, bourbon and water, and vodka and water. Becoming very intoxicated in
each case, he concluded, "It's the water that makes one drunk." The researcher should have consumed
pure water on one of his test days. The water alone test would be called a
a. double blind. c. prediction.
b. hypothesis. d. control.
ANS: D PTS: 1

18. The most important criterion of an experimental design is that the design be
a. complex.
b. simple.
c. an extension of theory.
d. appropriate for testing the hypothesis.
e. based on experience.
ANS: D PTS: 1 OBJ: WWW

172
 19. An experimental design must provide __________, so that the effects of the independent variable can
be evaluated unambiguously.
a. control c. variability
b. hypotheses d. external validity
ANS: A PTS: 1

20. Any type of attention may lead the subjects in the experimental group to respond in an other-than-
normal manner. This phenomenon is called
a. closure.
b. Hawthorne effect.
c. Premack principle.
d. John Henry effect
e. perception effect.
ANS: B PTS: 1

Exhibit 10-2: In its simplest form, an experiment has three characteristics. Choose the characteristic that
corresponds with each example.

21. Refer to Exhibit 10-2. Two classes were randomly selected and randomly assigned to be the
experimental and control groups.
a. The effect of the independent variable is measured through observation of the dependent
variable.
b. Extraneous variables are held constant.
c. An independent variable is manipulated.
ANS: B PTS: 1

22. Refer to Exhibit 10-2. A posttest of the groups' intrinsic and extrinsic motivation is given.
a. The effect of the independent variable is measured through observation of the dependent
variable.
b. Extraneous variables are held constant.
c. An independent variable is manipulated.
ANS: A PTS: 1

23. Refer to Exhibit 10-2. One group had been rewarded with candy for turning in homework, while the
other had verbal praise.
a. The effect of the independent variable is measured through observation of the dependent
variable.
b. Extraneous variables are held constant.
c. An independent variable is manipulated.
ANS: C PTS: 1

24. Which question expresses concern for the internal validity of a design?
a. Is the selected setting representative?
b. To what extent can the research findings be generalized?
c. Was the change in the dependent variable really due to the treatment?
d. What characteristics of the setting allow the findings to be generalized?
ANS: C PTS: 1 OBJ: WWW

173
25. Selection bias is a threat to internal validity arising from failure to use
a. a control group. c. reliable measuring instruments.
b. counterbalancing across conditions. d. random assignment.
ANS: D PTS: 1 OBJ: WWW

26. The factor most crucial in determining the effectiveness of the matching procedure for developing
equivalent groups is whether
a. the matching variable is significantly related to the study's dependent variable.
b. the matching variables were assigned to both groups.
c. the sample is random and representative of the larger population.
d. the study is causal-comparative or experimental.
ANS: A PTS: 1

27. When a pretest and posttest are used on all subjects in the experimental and control groups
a. the pretest may influence posttest results.
b. the experimenter knows whether it is reasonable to assume that both groups began at a
similar point.
c. there may be interaction between pretest and treatment effects.
d. a and b
e. a, b, and c
ANS: E PTS: 1

28. The most effective way to limit the effects of extraneous variables in an experiment is to use
a. randomization. c. homogeneous selection.
b. matched groups. d. subjects as their own control.
ANS: A PTS: 1 OBJ: WWW

29. If the John Henry effect were exerting an influence in an experiment, one would expect
a. poor performance in the control group.
b. better performance in the control group.
c. poor performance in the treatment group.
d. better performance in the treatment group.
ANS: B PTS: 1

30. Events or influences other than the experimental treatment itself may occur between a pretest and a
posttest that may affect the dependent variable. This threat is called
a. mortality.
b. history.
c. regression.
d. diffusion.
e. Hawthorne effect.
ANS: B PTS: 1

31. If a researcher makes a generalization from a study about apes to a human population, what type of
validity problem might he/she have?
a. Internal b. External
ANS: B PTS: 1

174
32. Consider the following: "To what group of subjects can the research results based on this particular
sample be generalized?" This question is concerned with
a. selection-maturation interaction.
b. reactive effect.
c. internal validity.
d. experimenter effect.
e. external validity.
ANS: E PTS: 1

33. Counterbalancing is a technique that controls for

a. lack of random assignment.
b. failure to use a double blind technique.
c. experimenter effect.
d. order and carryover effects.
e. diffusion.
ANS: D PTS: 1

34. The major benefit of random assignment is it

a. reduces the plausibility of alternative explanations for the observed effects.
b. makes it possible to observe the effects of an independent variable on another variable.
c. ensures that the sample chosen for a study is similar to the population from which the
sample was drawn.
d. equates the groups before the experimental treatment begins.
e. a and d
ANS: E PTS: 1

35. A lack of original equivalency between two preexisting groups can be partly compensated for by using
a pretest, posttest, and a/an
a. analysis of covariance. c. factorial design.
b. analysis of variance. d. randomization procedure.
ANS: A PTS: 1

36. The experimenter effect as an internal validity threat is concerned most directly with
a. matching.
b. novelty.
c. expectations.
d. compensation.
e. selection interaction.
ANS: C PTS: 1

37. The internal validity threat that randomization eliminates in an experimental study is
a. selection bias. c. instrumentation.
b. subject effects. d. history.
ANS: A PTS: 1

175
38. The major threat to the internal validity of research on articulation problems in young children is
a. regression.
b. instrumentation.
c. mortality.
d. maturation.
e. selection.
ANS: D PTS: 1

39. Hypothesis testing is most characteristic of

a. survey research.
b. experimental research.
c. qualitative research.
d. historical research.
e. the case study.
ANS: B PTS: 1

40. The control of experimenter effect in a research study can be accomplished by

a. randomization.
b. matching.
c. double blinding
d. single blinding.
e. counterbalancing.
ANS: C PTS: 1

41. Select the term which least belongs with experimental research.
a. Treatment group
b. Manipulation
c. Randomization
d. Description
e. Control
ANS: D PTS: 1

42. Which of the following is an internal validity question in experimental research?

a. Does the sample represent the population?
b. Has statistical regression influenced the dependent variable?
c. Does the design provide adequate control of the dependent variable?
d. Can the experiment's results be generalized to other settings?
e. Is the study's cost worth the time and effort?
ANS: B PTS: 1

43. Which of the following is the appropriate description of "statistically significant"?

a. "Important and powerful"
b. "Theoretically important"
c. "Probably not due to chance"
d. "Worthy of recognition"
e. "Momentous and substantial"
ANS: C PTS: 1

176
44. A researcher wishes to study the effects of a concentrated remedial reading program on the reading
achievement of disadvantaged children. A large number of children are available for assignment to
groups. Since intelligence is an important relevant variable in any research on reading, the investigator
wants to make sure that it is controlled as well as the reading pretest scores. What would be the most
effective way for the researcher to control these variables?
a. Set up groups and then check to make sure that there are no significant differences
between the groups on intelligence and reading pretest scores.
b. Randomly assign children to experimental and control groups.
c. Match the children on intelligence test and reading pretest scores and then randomly
assign the matched pairs to experimental and control groups.
d. Randomly assign children to experimental and control groups and use intelligence test and
reading pretest scores in an analysis of covariance.
ANS: D PTS: 1

45. The fact that young children's articulation problems often disappear by themselves over time indicates
why researchers must use ____in order to have internal validity.
a. control groups
b. informed consent
c. objective measurement
d. pre- and postmeasures
e. statistical analysis
ANS: A PTS: 1

46. Randomization in an experimental design assures

a. external validity of the findings.
b. the relevance of the hypothesis in question.
c. accurate observation of the dependent variable.
d. statistical equivalence of groups.
e. lack of pretest sensitivity.
ANS: D PTS: 1

47. The most powerful control technique, given the number of influences potentially controlled, is
a. matching. c. counterbalancing.
b. random assignment. d. homogeneous selection.
ANS: B PTS: 1

48. When a researcher is confident that results can be attributed to a treatment's influence and nothing else,
it is said that the study is ____ valid.
a. externally
b. empirically
c. intrinsically
d. internally
e. statistically
ANS: D PTS: 1

177
 49. The type of control problem that can occur when volunteers are compared with nonvolunteers is
a. history.
b. pretesting.
c. regression.
d. posttesting.
e. selection-maturation interaction.
ANS: E PTS: 1

50. "Statistical regression" refers to the tendency of extreme scores to ____ the common mean on
subsequent measurement.
a. move toward c. stay the same distance from
b. move away from d. move randomly toward or away from
ANS: A PTS: 1

Exhibit 10-3: Choose the type of experimental validity that is being referred to in the following questions.

55. Refer to Exhibit 10-3. Were the tests used for analysis appropriate and sufficiently powerful to
correctly estimate the size and significance of the effect?
a. Internal c. Construct
b. External d. Statistical Conclusion
ANS: D PTS: 1

56. Refer to Exhibit 10-3. Is the causal relationship demonstrated in the study generalizable to other
persons and settings?
a. Internal c. Construct
b. External d. Statistical Conclusion
ANS: B PTS: 1

57. Refer to Exhibit 10-3. Did the experimental treatment cause the observed change in the dependent
variable, or was a spurious factor operating to cause the change?
a. Internal c. Construct
b. External d. Statistical Conclusion
ANS: A PTS: 1

58. Internal validity is not concerned with

a. maturation
b. generalization.
c. experimental mortality.
d. statistical regression.
e. interaction of pretest and treatment.
ANS: B PTS: 1

178
Exhibit 10-5: Choose the internal validity problem that is associated with the situations listed.

59. Refer to Exhibit 10-5. Extreme scores move toward the mean.
a. history
b. maturation
c. experimenter effect
d. statistical regression
e. diffusion
ANS: D PTS: 1

60. Refer to Exhibit 10-5. Presence of the observer increases scores.

a. history
b. maturation
c. experimenter effect
d. statistical regression
e. diffusion
ANS: C PTS: 1

61. Refer to Exhibit 10-5. Entirely a function of the passage of time

a. history
b. maturation
c. experimenter effect
d. statistical regression
e. diffusion
ANS: B PTS: 1

62. Refer to Exhibit 10-5. Specific events between the measurements

a. history
b. maturation
c. experimenter effect
d. statistical regression
e. diffusion
ANS: A PTS: 1

63. To be useful in an analysis of covariance design, a covariate should have

a. high positive correlation with the dependent variable.
b. low positive correlation with the dependent variable.
c. low negative correlation with the dependent variable.
d. zero correlation with the dependent variable.
e. high positive correlation with the main independent variable.
ANS: A PTS: 1 OBJ: WWW

179
 64. A teacher was surprised to find a negative correlation between pretest scores and the amount of change
in a pretest-posttest design. How would you explain the negative correlation to the teacher?
a. The students who did well on the pretest did not learn as much during the instructional
period.
b. The method of instruction was not appropriate for those students who had high pretest
scores.
c. Students who have high scores on the pretest can be expected to have low change scores
because of the ceiling effect on the posttest.
d. The negative correlation is due to the low reliability of the pretest and the posttest.
ANS: C PTS: 1

65. A researcher investigating the effect of a new drug administers a placebo to the control group in order
to
a. eliminate the Hawthorne effect.
b. provide better matching of subjects in the experimental and control groups.
c. minimize the experimenter effect.
d. separate the psychological aspects of the treatment from other effects.
ANS: D PTS: 1

66. A confounding variable is one which

a. has no relationship with the dependent variable.
b. is controlled and does not affect the outcome.
c. is not controlled and affects the outcome.
d. a and b
ANS: C PTS: 1 OBJ: WWW

67. The term "control" in research generally refers to controlling

a. dependent variable measurement. c. extraneous variables.
b. design selection. d. independent variable manipulation.
ANS: C PTS: 1

68. The term "randomization" refers to

a. random assignment of subjects into groups.
b. random selection of subjects for the sample.
c. sampling techniques in general.
d. All of these are true.
ANS: A PTS: 1

Exhibit 10-6: Choose the intersubject difference control that best corresponds with the following statements.

69. Refer to Exhibit 10-6. A teacher flips a coin for each child to determine if the child will be in the
control or experimental group.
a. ANCOVA
b. Homogeneous selection
c. Randomized matching
d. Random assignment
e. Use subjects as their own controls
ANS: D PTS: 1

180
70. Refer to Exhibit 10-6. Each subject in the control group has a corresponding subject in the
experimental group who has the same IQ score within three points.
a. ANCOVA
b. Homogeneous selection
c. Randomized matching
d. Random assignment
e. Use subjects as their own controls
ANS: C PTS: 1

71. Refer to Exhibit 10-6. Assigning the same subjects to all experimental conditions and obtaining
measurements under all conditions.
a. ANCOVA
b. Homogeneous selection
c. Randomized matching
d. Random assignment
e. Use subjects as their own controls
ANS: E PTS: 1

72. Refer to Exhibit 10-6. This procedure eliminates some matching problems but makes generalization
harder to do.
a. ANCOVA
b. Homogeneous selection
c. Randomized matching
d. Random assignment
e. Use subjects as their own controls
ANS: B PTS: 1

73. Refer to Exhibit 10-6. Last year's math grades are taken into consideration when analyzing the posttest
scores following the use of a new math teaching method.
a. ANCOVA
b. Homogeneous selection
c. Randomized matching
d. Random assignment
e. Use subjects as their own controls
ANS: A PTS: 1

74. Refer to Exhibit 10-6. Only boys of ages 6-8 from an urban community were selected for a study.
a. ANCOVA
b. Homogeneous selection
c. Randomized matching
d. Random selection
e. Use subjects as their own controls
ANS: B PTS: 1

75. Generalization from the accessible population to the target population is assessed
a. statistically.
b. judgmentally.
c. through hindsight.
d. through the use of the generalization coefficient.
ANS: B PTS: 1

181
Exhibit 10-7: Identify the threats to internal validity illustrated in the example below.

76. Refer to Exhibit 10-7. The experimental group had a higher learning/growth rate than the control
group even before the experiment began.
a. Instrumentation
b. Experimental mortality
c. Selection-maturation interaction
d. Statistical regression
e. Diffusion
ANS: C PTS: 1

77. Refer to Exhibit 10-7. The students scored much higher on the posttest because the posttest was easier
than the pretest.
a. Instrumentation
b. Experimental mortality
c. Selection-maturation interaction
d. Statistical regression
e. Diffusion
ANS: A PTS: 1

78. Refer to Exhibit 10-7. Some students left the experimental program because of a conflict with sports.
a. Instrumentation
b. Experimental mortality
c. Selection-maturation interaction
d. Statistical regression
e. Diffusion
ANS: B PTS: 1

79. Refer to Exhibit 10-7. The students who scored extremely high on a test would score lower if given the
test again.
a. Instrumentation
b. Experimental mortality
c. Selection-maturation interaction
d. Statistical regression
e. Diffusion
ANS: D PTS: 1

80. An experiment conducted in a highly controlled lab setting is more likely to have problems with ____
than is an experiment conducted in a classroom setting.
a. external validity c. statistical conclusion validity
b. internal validity d. internal consistency
ANS: A PTS: 1

81. In a study of aggression, the instrument used may not really measure aggression but rather
assertiveness. If so, this would most likely affect the ____validity of the study.
a. internal c. external
b. construct d. statistical conclusion validity.
ANS: B PTS: 1

182
 82. The group to which a researcher wants the findings to ultimately apply is the
a. accessible population. c. target population.
b. sample. d. probability sample.
ANS: C PTS: 1

83. A pretest may be used in an experiment

a. as a matching variable. c. when change is being investigated.
b. to assess group equivalence. d. All of these are true.
ANS: D PTS: 1

Exhibit 10-8: Choose the term that is described in each of the phrases below.

84. Refer to Exhibit 10-8. Removes the part of each subject's posttest score that is in common with his/her
pretest score.
a. random assignment
b. randomized matching
c. homogeneous selection
d. analysis of covariance
e. use of subjects as their own controls
ANS: D PTS: 1

85. Refer to Exhibit 10-8. Considers groups to be statistically equivalent

a. random assignment
b. randomized matching
c. homogeneous selection
d. analysis of covariance
e. use of subjects as their own controls
ANS: A PTS: 1

86. Refer to Exhibit 10-8. Can reduce sample size and introduce bias into the sample.
a. random assignment
b. randomized matching
c. homogeneous selection
d. analysis of covariance
e. use of subjects as their own controls
ANS: B PTS: 1

87. Refer to Exhibit 10-8. Not recommended in situations where there could be a "learning to learn" effect.
a. random assignment
b. randomized matching
c. homogeneous selection
d. analysis of covariance
e. use of subjects as their own controls
ANS: E PTS: 1

183
88. Refer to Exhibit 10-8. Is a statistical procedure which provides control and improves the precision of
research.
a. random assignment
b. randomized matching
c. homogeneous selection
d. analysis of covariance
e. use of subjects as their own controls
ANS: D PTS: 1

89. Refer to Exhibit 10-8. All subjects have IQ scores in the average range (90-110).
a. random assignment
b. randomized matching
c. homogeneous selection
d. analysis of covariance
e. use of subjects as their own controls
ANS: C PTS: 1

90. Refer to Exhibit 10-8. All subjects receive all of the experimental treatments.
a. random assignment
b. randomized matching
c. homogeneous selection
d. analysis of covariance
e. use of subjects as their own controls
ANS: E PTS: 1

91. Refer to Exhibit 10-8. Subjects are assigned to treatments using a table of random numbers.
a. random assignment
b. randomized matching
c. homogeneous selection
d. analysis of covariance
e. use of subjects as their own controls
ANS: A PTS: 1

92. Refer to Exhibit 10-8. Decreases the ability of the experimenter to generalize his findings.
a. random assignment
b. randomized matching
c. homogeneous selection
d. analysis of covariance
e. use of subjects as their own controls
ANS: C PTS: 1

93. Refer to Exhibit 10-8. Assigns subjects randomly to groups after subjects are paired on qualities that
could affect the dependent variable.
a. random assignment
b. randomized matching
c. homogeneous selection
d. analysis of covariance
e. use of subjects as their own controls
ANS: B PTS: 1

184
 94. A researcher plans a special series of classroom lessons designed to increase students' verbal skills. A
control group does not have the lessons. Which of the following would most likely be threats to
internal validity?
a. History
b. Hawthorne effect
c. Teacher expectations effect
d. Mortality
e. b and c
ANS: E PTS: 1

95. Research has ____ validity when it accurately infers a significant relationship between the treatment
and the dependent variable of the study.
a. statistical c. external
b. construct d. internal
ANS: A PTS: 1

96. Research has ____ validity when it shows the findings can be generalized beyond the limits of the
study.
a. internal c. construct
b. external d. operational
ANS: B PTS: 1

97. Volunteers for a research study could introduce bias because

a. they are less likely to show change than subjects who are required to participate.
b. they may be different from nonvolunteers on important variables.
c. they are more subject to the Hawthorne effect than nonvolunteers.
d. Al of these are true.
ANS: B PTS: 1

98. A researcher is interested in whether playing soft music increases worker productivity in a factory.
This illustrates ____ research, and music is the ____.
a. correlational; dependent variable c. experimental; independent variable
b. correlational; independent variable d. experimental; dependent variable
ANS: C PTS: 1

99. If faced with the dilemma of choosing between internal validity and external validity, an experimenter
should give priority to
a. internal validity. b. external validity.
ANS: A PTS: 1

100. In experimental research, a random procedure is recommended for the

a. selection of subjects. c. ordering of multiple treatments.
b. assignment of subjects to treatments. d. Al of these are true.
ANS: D PTS: 1 OBJ: WWW

185
 101. Matching subjects in the experimental and control groups is useful when
a. small samples are to be used.
b. large differences between the groups on the dependent variable are likely.
c. random assignment to groups is not possible.
d. All of these are true.
e. a and c
ANS: E PTS: 1

102. Matching of experimental and control subjects, homogeneous selection, and analysis of covariance can
all be used to
a. reduce the effects of statistical regression.
b. reduce initial differences between treatment groups.
c. counterbalance the effects of experimental treatments.
d. control the "learning to learn" effect.
ANS: B PTS: 1 OBJ: WWW

103. Which of the following would represent a variable that could be manipulated in an experiment?
a. Lecture vs. discussion method of teaching
b. High vs. low socioeconomic status of subjects
c. Male vs. female subjects
d. College prep vs. vocational curriculum
e. High vs. low scorers on an aptitude test
ANS: A PTS: 1

Exhibit 10-9: Identify the threats to internal validity illustrated in the examples below.

104. Refer to Exhibit 10-9. Students falling below the 10th percentile on a reading achievement test later
receive higher scores on a similar test; students above the 90th percentile receive lower scores on the
second test administration.
a. experimental mortality
b. reactive effect of testing
c. statistical regression
d. maturation
e. instrumentation
ANS: C PTS: 1

105. Refer to Exhibit 10-9. More low achievers than other students drop out of an individualized reading
program designed to lead to gains in reading achievement.
a. experimental mortality
b. reactive effect of testing
c. statistical regression
d. maturation
e. instrumentation
ANS: A PTS: 1

186
106. Refer to Exhibit 10-9. Preschoolers who received treatment for stuttering during the year show a
significant improvement in articulation.
a. experimental mortality
b. reactive effect of testing
c. statistical regression
d. maturation
e. instrumentation
ANS: D PTS: 1

107. Refer to Exhibit 10-9. Students were given a pretest measuring attitudes toward a minority group and
then viewed a film on the accomplishments of members of the minority. The students showed
significantly more favorable attitudes after viewing the film.
a. experimental mortality
b. reactive effect of testing
c. statistical regression
d. maturation
e. instrumentation
ANS: B PTS: 1

108. In experiments, the Hawthorne effect has its impact on the ____ group, while the John Henry effect
impacts the group.
a. experimental, control b. control, experimental
ANS: A PTS: 1

109. The finding that individuals' performance may be altered if they are subjects in an experimental
treatment is known as the
a. treatment effect. c. placebo effect.
b. experimenter effect. d. Hawthorne effect.
ANS: D PTS: 1

110. A university researcher who wanted to determine the effectiveness of new technology in the teaching
of freshman psychology used the new technology in one section, while a second section had the
conventional lecture method. When the two sections were compared on final exam scores, the
researcher was surprised to find that the conventional classroom actually had slightly higher scores.
This finding may be an example of the
a. Hawthorne effect. c. Pygmalion effect.
b. John Henry effect. d. reactive effect.
ANS: B PTS: 1 OBJ: WWW

111. An internal validity threat in which the researcher's expectations concerning the outcome of an
experiment actually contribute to producing certain outcomes is known as the ____ effect.
a. Hawthorne
b. John Henry
c. Diffusion
d. Pygmalion
e. Experimenter effect
ANS: E PTS: 1

187
112. An experimenter bias effect operates when an experimenter
a. deliberately manipulates subjects' behavior or falsifies data in order to obtain an"expected"
finding.
b. inadvertently transmits his/her expectancies about the outcome of an experiment in a way
that affects subjects' behavior.
c. deliberately selects a sample that he/she knows will perform in the "expected" way.
d. All of these are true.
ANS: B PTS: 1

113. The most useful technique to minimize the effects of experimenter bias on the outcome of an
experiment is to
a. conduct a double-blind experiment.
b. discuss thoroughly the expected findings with those in charge of data collection.
c. use a variety of more subjective measuring instruments.
d. let the experimenter in charge of data collection have more leeway in choosing procedures
for administering the treatments.
ANS: A PTS: 1

114. The use of a placebo in an experiment on the side effects of a new drug is an example of a ____
experiment.
a. single-blind
b. double-blind
c. meta-analytic
d. counterbalanced
e. repeated measures
ANS: A PTS: 1

115. If a researcher wishes to generalize the results of a study to a specifically defined population, he/she
should arrange a research study in which
a. subjects from the specific population are required to participate in the study.
b. a table of random numbers is used.
c. only a few variables are investigated.
d. subjects are selected randomly from the specific population.
ANS: D PTS: 1

116. Sampling bias would most likely not be a problem in which of the following situations?
a. A purposive sampling design was used to select the subjects.
b. Volunteers are recruited to serve as subjects.
c. Randomization was used to assign subjects to experimental and control groups.
d. Subjects who differ in the independent variable are also different in other important
aspects.
ANS: C PTS: 1

188
 117. A researcher who wants to conduct a study in the local high school finds that she must use volunteers
rather than intact class groups. In this case, the researcher should
a. make sure to use a sample of at least 30 or more subjects.
b. control for the subjects' willingness to volunteer.
c. keep the volunteer subjects naive as to the purpose of the study.
d. determine the extent to which volunteers may differ from nonvolunteers on important
variables.
ANS: D PTS: 1

118. The school newspaper reports that the GPA of athletes is slightly higher than the GPA of
undergraduates in general. Suppose you want to use these data to argue that athletes are smarter than
the average student. Someone else points out that intelligence ("smartness") is only one of several
factors influencing GPA; others are self-discipline, tutoring, pressure from coaches, required class
attendance, and so on. Each of these latter factors is a potential ____ in any simple explanation of
GPA.
a. exogenous variable
b. moderator variable
c. placebo
d. confounding variable
e. discriminant variable
ANS: D PTS: 1 OBJ: WWW

Exhibit 10-10: Identify the major threat to internal validity in the following research studies.

119. Refer to Exhibit 10-10. A researcher used two classrooms in an experimental study. It was found that
the E group had more high ability students than the C group before the study began.
a. Regression
b. Diffusion
c. Mortality
d. Selection bias
e. History
ANS: D PTS: 1

120. Refer to Exhibit 10-10. A teacher researcher randomly assigned students within a classroom to two
groups, one of which received some special instructional materials to take home with them to study
and to use with homework assignments. The C group did not get the special materials. The researcher
was surprised to find that there weren't significant differences between the two groups on achievement
tests and other selected measures.
a. Regression
b. Diffusion
c. Mortality
d. Selection
e. History
ANS: B PTS: 1

189
 121. Refer to Exhibit 10-10. Students who had low scores on a reading pretest were chosen for a special
instructional program. This group showed significant gains on a reading achievement test administered
after a period of four months.
a. Regression
b. Diffusion
c. Mortality
d. Selection
e. History
ANS: A PTS: 1

122. Refer to Exhibit 10-10. A researcher conducted a semester-long experiment comparing two
instructional programs in math. During the administration of tests during the semester, the researcher
found that about ten percent of the experimental group and about five percent of the control group
were absent for each administration.
a. Regression
b. Diffusion
c. Mortality
d. Selection
e. History
ANS: C PTS: 1

123. The relationship between internal and external validity in research can best be described as
a. If an experiment lacks external validity, it cannot have internal validity.
b. If an experiment lacks internal validity, it cannot have external validity.
c. Internal and external validity are independent of each other.
ANS: B PTS: 1 OBJ: WWW

Exhibit 10-11: Indicate whether the following statements relate to internal validity, external validity, construct
validity, or statistical conclusion validity.

124. Refer to Exhibit 10-11. Can the results of the study conducted in a suburban school be applied to
elementary school students in rural settings?
a. internal validity c. construct validity
b. external validity. d. statistical conclusion validity
ANS: B PTS: 1

125. Refer to Exhibit 10-11. Was the experimenter correct in reporting that the treatment had no significant
effect? Would a more powerful test have lead to a different conclusion?
a. internal validity c. construct validity
b. external validity. d. statistical conclusion validity
ANS: D PTS: 1

126. Refer to Exhibit 10-11. Are the findings of this study a result of the experimental treatment?
a. internal validity c. construct validity
b. external validity. d. statistical conclusion validity
ANS: A PTS: 1

190
Exhibit 10-12: A researcher investigated the effect of aerobic exercise on depression. He randomly assigned
subjects previously identified as depressed to one of three groups. Choose the correct group for each question.

127. Refer to Exhibit 10-12. Which is the true control group?

a. aerobic exercises five days per week c. no aerobic exercise
b. aerobic exercises three days per week
ANS: C PTS: 1

128. Refer to Exhibit 10-12. Which is the comparison group?

a. aerobic exercises five days per week c. no aerobic exercise.
b. aerobic exercises three days per week
ANS: B PTS: 1

129. An experimenter was interested in the effect of caffeine on a performance test. Three equivalent
groups consumed high, moderate, or low amounts of caffeine before taking the performance test. This
experiment had
a. three independent variables.
b. one independent variable with three levels.
c. three dependent variables.
d. one dependent variable with three levels.
ANS: B PTS: 1

130. Which of the following measures would be most susceptible to "reactive" effect?
a. Rating scale
b. Aptitude test
c. Attitude scale
d. Teacher-made achievement test
e. Standardized achievement test
ANS: C PTS: 1 OBJ: WWW

SHORT ANSWER

1. What are the three essential requirements for an experiment?

ANS:
Control, manipulation of an independent variable, and observation/measurement

2. Name the four types of validity that are important in experimental research.

ANS:
Internal, statistical conclusion, construct, and external

OBJ: WWW

3. List five threats to the internal validity of an experimental design.

ANS:
History, maturation, instrumentation, regression, and selection bias

191
4. Distinguish the Hawthorne effect from the John Henry effect in experimental research.

ANS:
Both are subject effects that threaten internal validity. The Hawthorne effect refers to the tendency for
subjects in the experimental group to change their behavior because of the attention gained from
participating in an experiment. The John Henry effect refers to the tendency of control group subjects
who know they are in an experiment to exert extra effort and perform above their typical average.

5. Distinguish between random selection and random assignment.

ANS:
Random selection refers to the process of selecting a sample from a population by chance means so
that every member of the population has an equal probability of being chosen. Random assignment is
the assignment of subjects to groups in such a way that, for any given placement, every member of the
population has an equal probability of being assigned to any of the groups.

OBJ: WWW

6. What is meant by statistical equivalence? How does a researcher achieve it?

ANS:
Statistical equivalence means that any difference between the groups in an experiment is a function of
chance alone. When subjects are randomly assigned to groups, the groups can be considered
statistically equivalent.

7. Why is construct validity essential in an experiment?

ANS:
If one wants to draw conclusions from an experiment, one has to know that the study manipulates and
validly measures the underlying psychological construct that he or she claims to be measuring and
manipulating within the study. For example, if anxiety is the independent variable in a study, the
researcher must be certain that the instrument validly measures anxiety and not some other construct.

8. What is the relationship between statistical conclusion validity and internal validity in experimental
research?

ANS:
Internal validity is concerned with the validity of the inferences about whether the effect of the
independent variable on the dependent variable reflects a causal relationship; statistical conclusion
validity is concerned with the validity of the inferences about the covariation between treatment and
outcome. A study may be carefully designed and well controlled, but an error in the statistical analysis
would lead to incorrect conclusions about statistical significance and effect size. Thus, internal validity
depends to a great extent on statistical conclusion validity.

9. How does replication of experiments contribute to external validity?

ANS:
If experiments are repeated and the outcome is the same, one has more confidence in generalizing the
findings to other subjects and settings.

192
 10. Identify the threat to internal validity in each of the following:
a. Some researchers who were given rats to train were told incorrectly that the rats had been
bred for intelligence; other researchers were told that their rats were especially dull. The
experimenters who had the "smart" rats reported faster learning than did the experimenters
with the "dull" rats.
b. After the first exam, a professor divided his statistics class into high performers and low
performers. The low performers were invited to attend special tutoring sessions where the
professor not only reviewed lecture material but also discussed how to take notes and how
to study for a statistics test. On the second test, the professor found that the students who
received the tutoring improved considerably. The professor concluded that the tutoring
sessions were effective in improving the test performance of those students.
c. A researcher divided people attending a weight control clinic into two groups. Both
groups were given the same diet to follow, but the experimental group was also asked to
keep a record of everything they ate, to weigh all the food in grams, and to count the
calories. At the end of the study, the researcher found that the experimental group had lost
more weight. The researcher concluded that the experimental treatment was more
effective than diet alone.

ANS:
a. Experimenter effect
b. Regression; Hawthorne effect
c. Experimental mortality may account for the finding. Because of the greater demands in
the experimental group, not all subjects stayed in the program. Only those who were
highly motivated to lose weight persisted in the program and were present for the post-
treatment.

ESSAY

1. Name and distinguish among the four types of validity in experimental research.

ANS: Responses will vary.

2. How would you distinguish between construct validity of tests (measurement) and construct validity of
experiments.

ANS: Responses will vary.

EE

193