Understanding The Social World Research Methods For The 21st Century 1st Edition Schutt Test Bank

Understanding the Social World
Research Methods for the 21st Century

1st Edition Schutt Test Bank
Visit to download the full and correct content document: https://testbankdeal.com/dow
nload/understanding-the-social-world-research-methods-for-the-21st-century-1st-editi
on-schutt-test-bank/
Understanding the Social World 1st Edition
Russell K. Schutt
Chapter 10: Evaluation and Mixed-Methods Research

Test Bank
1. To know if social programs work, we have to evaluate them __________ and fairly, whether
we personally think the program sounds like a good idea or not.
*a. Varies. Systematically
Learning Objective: Define each of the types of evaluation research and explain when each is
appropriate
Cognitive Domain: Reevaluating
Answer Location: Evaluation and Mixed Methods Research
Question Type: F
2. Resources, raw materials, clients and staff that go into a program are known as ________.
*a. Varies. Inputs
Learning Objective: Diagram the evaluation research process as a feedback system
Cognitive Domain: Knowledge
y
Answer Location: Evaluation Research Basics
Question Type: F
nl
3. The new products produced by the program process are known as ___________.
*a. Varies. Outputs
tO
Question Type: F
f
4. Any social program is likely to have multiple ________. Some intended and some unintended.
ra
*a. Varies. Outcomes

D

Question Type: F
5. _________ is the information about the service delivery system outputs, outcomes, or
operations that can guide program input.
*a. Varies. Feedback
Cognitive Domain: Application
Question Type: F
6. A type of evaluation research that attempts to determine the needs of some population that
might be met with a social program is known as a ___________.
*a. Varies. Needs assessment
Russell K. Schutt

Test Bank
appropriate
Cognitive Domain: Comprehension
Answer Location: Needs Assessment
Question Type: F
7. ___________ evaluation is even more important when more complex programs are evaluated.
*a. Varies. Process
appropriate
Answer Location: Process Evaluation
Question Type: F
y
8. A process evaluation that is used to shape and refine program operations is known as a
nl
____________ evaluation.
*a. Varies. Formative
tO
appropriate
Question Type: F
f
9.__________ evaluation compares what happened after a program with what would have
ra
happened had there been no program.

*a. Varies. Summative
D
appropriate
Answer Location: Impact Analysis
Question Type: F
10. Amie Schuck (2013) at the University of Illinois at Chicago focused on the impact of
program _____________ on students’ attitudes toward the police in the evaluation of D.A.R.E.
*a. Varies. Participation
Learning Objective: Write an argument supporting or opposing research to evaluate social
programs
Question Type: F
11. As in other areas of research, a(n) _____________ design is the preferred method for
Russell K. Schutt

Test Bank
maximizing internal validity.

*a. Varies. Experimental
appropriate
Question Type: F
12. An evaluation research that compares program costs with the economic value of program
benefits is known as a _____________ analysis.
*a. Varies. Cost-benefit
appropriate
y
Answer Location: Efficiency Analysis
nl
Question Type: F
13. Evaluation research projects often combine qualitative and quantitative methods to provide a
tO
more comprehensive picture of a program operation. This is also known as using _______
methods.
*a. Varies. Mixed
Learning Objective: Compare and contrast different mixed methods designs
f
Answer Location: Mixed Methods

ra
Question Type: F
14. When qualitative and quantitative methods are used concurrently in the research but one is
D
given priority, you are using a(n) ______________ design.

*a. Varies. Embedded mixed-methods
Answer Location: Embedded Designs
Question Type: F
15. It is costly to society and potentially harmful to participants to maintain ___________

programs.
*a. Varies. Ineffective
Learning Objective: Write an argument supporting or opposing research to evaluate social
programs
Answer Location: Conclusion
Question Type: F
Russell K. Schutt

Test Bank
16. _____________ must be given special attention when evaluation research projects involve
members of vulnerable populations as subjects.
*a. Varies. Ethical concerns
Learning Objective: Discuss potential strengths and weaknesses of mixed methods studies
Answer Location: Ethics in Evaluation
Question Type: F
17. ______________ is enhanced when measures using different methods result in a similar
picture.
*a. Varies. Measurement validity
Learning Objective: Identify the circumstances that make qualitative methods most useful
y
Answer Location: Strengths and Limitations of Mixed Methods
Question Type: F
nl
18. If qualitative and quantitative methods are used in sequence in the research and one is given
priority, you are using a _____________ design.
tO
*a. Varies. Staged mixed-methods
Answer Location: Staged Designs
Question Type: F
f
ra
19. In a(n) ______________ design, qualitative and quantitative methods are used concurrently
and both given equal importance.
*a. Varies. Integrated mixed-methods
D

Answer Location: Integrated Designs
Question Type: F
20. The complete treatment or service delivered by the program is known as __________.
*a. Varies. Program Process
appropriate
Question Type: F
21. Compare and contrast integrated mixed-methods research design with embedded mixed-
methods research design, and be sure to provide a diagram describing each such design.
Russell K. Schutt

Test Bank
*a. Varies.
-Integrated mixed-methods research design
-Qualitative and quantitative methods are used concurrently and both are given equal
importance, QUAL+QUAN or QUAN+QUAL
-Embedded mixed-methods research design
-Qualitative and quantitative methods are used concurrently but one is given priority,
QUAN(qual), qual(QUAN), QUAL(quan), quan(QUAL)
Question Type: ESS
22. Identify at least two ethical concerns with using mixed method research design, taking care
y
to define each such concern.
*a. Varies.
nl
-For example, defining the researcher’s role in relation to research participants, Qualitative
researcher as someone working in collaboration with a community, Quantitative researcher as an
outside expert who designed research and who collects data using objective procedures, best
tO
done without participant involvement, how to find the appropriate relationship between these
roles? Might use different researchers for qualitative and quantitative components
-Complex mixed-methods projects in which quantitative surveying is interspersed with
observational research or intensive interviews may also require renegotiations of participant
consent to the particular research procedures at each stage.
f
ra

Question Type: ESS
D
23. Identify the strengths and limitations of using mixed-research design.

*a. Varies. Strengths:
-Measurement validity enhanced when:
-using qualitative methods to clarify meaning of numerical scores after quantitative measures
employed
-Using different methods results in a similar picture
-Example of triangulation; if people are observed to do what they say they do
-But if measures do not reinforce each other, may use discrepant findings as way to explain
different measures
-Causal (internal) validity enhanced when:
-Qualitative interviews or observations are used to explore the mechanism involved in a causal
effect
-External validity enhanced when, for example:
-A quantitative study is repeated in different contexts, then using qualitative comparisons to
make sense of similarities and differences, thereby leading to conditions for such effects
Russell K. Schutt

Test Bank
-Generalizability enhanced when, for example:

-A quantitative design is used to identify cases to study more intensively with qualitative
methods
-Authenticity enhanced when also looking at measurement validity, generalizability or causal
validity
Limitations:
-Naïve to think that using mixed methods to overcome problems with a research design limited
to one method
-Tough to compare findings
-Tough to interpret discrepancies that arise with such a comparison
-Different types of expertise are required for effective use of quantitative and qualitative
measures.
y
nl
Question Type: MC
24. A _____ analysis must identify the specific program costs and the procedures for estimating
tO
the economic value of specific program benefits.
*a. Cost-benefit analysis
b. Efficiency analysis
c. Impact evaluation
f
appropriate
ra

Question Type: MC
D
25. When qualitative and quantitative methods are used in sequence in the research and one is
given priority:
a. Input design
*b. Staged mixed-methods design
c. Program process design
d. Formal feedback design
appropriate
Question Type: MC
26. Individuals and groups who have some basis of concern with a program in relation to a
research study:
Russell K. Schutt

Test Bank
*a. Stakeholders
b. Respondents
c. Participants
d. Informants
Learning Objective: Present arguments for and against stakeholder-driven evaluation
Question Type: MC
27. A _______ assessment is a type of evaluation research that attempts to determine the needs
of some population that might be met with a social program
a. Survey
b. Research
y
*c. Needs
d. Empirical
nl
appropriate
tO
Question Type: MC
28. A _____ evaluation is a processes evaluation that is used to shape and refine program
operations.
f
a. needs
ra
*b. formative
c. feedback
d. output
D

Question Type: MC
29. QUAN→QUAL means:

*a. Quantitative methods of measurement came before qualitative methods
b. The primary method used in a mixed-methods project was quantitative
c. The secondary method used in a mixed-methods project was qualitative
d. The two methods were used concurrently and had equal priority
Question Type: MC
Russell K. Schutt

Test Bank
30. If a researcher uses a structured survey and in-depth interviews in an integrated mixed-
method design that can be written as:
a. QUAN→QUAL
b. QUAL→QUAN
*c. QUAN+QUAL
Question Type: MC
31. An in-depth interview that used only open-ended questions but not closed-ended questions is:
a. Quantitative
*b. Qualitative
y
c. Both
d. Neither
nl
tO
Question Type: MC
32. If a measurement is written as (QUAN) qual, it means that:

a. The qualitative measure is primary
b. The quantitative measure is secondary
f
c. The quantitative and qualitative measures are concurrent

ra
*d. The qualitative measure is secondary

D

Question Type: MC
33. Types of mixed methods that rank the method used by priority do NOT include:
a. Integrated
b. Embedded
c. Staged
*d. Statistical analysis
Question Type: MC
34. If research uses one method of analysis and the results raise questions about the same
research that used a different research method of analysis, then this is research that used what
kind of design?
Russell K. Schutt

Test Bank
a. Staged mixed-methods
b. Integrated mixed-methods
c. Embedded mixed-methods
*d. Mixed methods
Question Type: MC
35. Prioritized is to equal as staged method is to:

*a. Research program with mixed method
b. Embedded method
c. Integrated method
y
d. Unified method
nl
Question Type: MC
tO
36. According to basic conventions for naming research methods, a way to indicate that the two
methods are used concurrently but that one has priority is to write it as:
a. QUAN+QUAL
b. QUAL↔QUAN
f
c. qual(QUAL)
ra
*d. (QUAN)qual
D

Question Type: MC
37. When comparing research where one used an integrated mixed-methods design with one that
used an embedded mixed-methods design, the significant difference that arose involved:
a. That in both research projects, the methods were of equal importance
b. That in both research projects, both methods used were concurrent
*c. That in one research project, one methodology was given priority
d. That in one research project, one methodology was concurrent
appropriate
Question Type: MC
Russell K. Schutt

Test Bank
38. With a staged mixed-methods design:

a. Qualitative and quantitative methods are used concurrently in the research but one is given
priority
*b. Qualitative and quantitative methods are used in sequence in the research and one is given
priority
c. Qualitative and quantitative methods are used concurrently in the research and both are given
equal importance
appropriate
Question Type: MC
y
39. A researcher had 500 people complete a survey, and then engaged in interviews with every
50th person, with the researchers giving a higher priority to the interviews, the researcher
nl
engaged in what kind of design?
a. Concurrent mixed-methods
b. Universal mixed-methods
tO
c. Integrated mixed-method
*d. Staged mixed-methods
appropriate
f

ra
Question Type: MC
40. Staged method is to embedded method as QUAN→Qual is to:

D
a. QUAN+QUAL
*b. (QUAN)qual
c. QUAL+QUAN
d. QUAL↔QUAN
Question Type: MC
41. If a researcher used a sample then interviewed part of that sample, leading to the
development of a structure questionnaire and then administered it to a different random sample,
the diagram for that research would be written as:
a. (QUAL+QUAN)→(QUAL+QUAN)
b. (QUAL→QUAN)→(QUAL→QUAN)
c. (QUAL+QUAN)→(QUAL→QUAN)
*d. (QUAL→QUAN)→(QUAL+QUAN)
Russell K. Schutt

Test Bank

Question Type: MC
42. A researcher who diagrams her research as (QUAL→QUAN)+(QUAL+QUAN) has used

what type of research design?
a. Staged
b. Embedded
c. Integrated
*d. Complex
y
Question Type: MC
nl
43. If quantitative measures are first enhanced by using qualitative measures, then that could be
written as:
tO
a. QUAN+QUAL
b. (QUAN)qual
*c. QUAL→QUAN
d. QUAL↔QUAN
f

ra

Question Type: MC
D
44. How can mixed-methods increase the likelihood that what is being reported as the findings
are what is being reported?
a. they can enhance the reliability
b. they can help to identify the sequence of the research being conducted
c. they can suggest alternative research designs
*d. they can increase the validity
Question Type: MC
45. Another way of describing how the use of different methods of measurement can result in
more valid results is to call it:
*a. triangulation
b. statistical enhancement
c. mutual attraction
Russell K. Schutt

Test Bank
d. generalizability
appropriate
Question Type: MC
46. If the use of alternative measures means that the results do not converge, then that:
a. means that only quantitative or qualitative measures should be used
*b. could provide insights that could have been generated only through the use of mixed methods
c. demonstrates a failure to generate statistically significant results
d. shows that the wrong type of mixed-methods research design was used
y
nl
Question Type: MC
47. Mixed methods create extra challenges for researchers:

tO
a. because of the incompatibility of the measures
b. because of the difference in methods of measurements
c. due to rarity of use of such methods
*d. because of the need for expertise in using mixed methods
f

ra

Question Type: MC
D
48. Believing that using mixed methods would overcome problems that can occur when a
research design is limited to one method is:
*a. naive
b. shrewd
c. pessimistic
d. balanced
Question Type: MC
49. Ethical challenges that arise because of the use of mixed methods includes:
*a. The mixing of roles that researchers have working with research participants
b. The inability to identify which role should be used throughout the research
c. That engaging as a researcher who collaborates with the participants being studied contrasts
with being a researcher who see themselves as outside experts
Russell K. Schutt

Test Bank
d. that the researcher has to choose among too many different roles to be able to conduct the
research
Question Type: MC
50. A way for research that uses mixed-methods can reduce potential ethical concerns:
*a. is to have researchers who do only the qualitative work and researchers to do only the
quantitative work.
b. involves insuring that all research participants have provided informed consent
c. is to properly sequence the different methods for conducting the research
d. involves giving equal weight to the findings generated using the qualitative and the
y
quantitative methods
nl
Question Type: MC
tO
51. Why might a researcher be inclined to use a mixed-methods design?
a. Cost
b. increases opportunities for collaborative research
*c. allows for the answering of multiple research questions
f
D. obscures obvious results to reveal more obscure findings

ra
D
Question Type: MC
52. Define complex mixed-methods research design.

*a. Varies. Qualitative and quantitative methods are combined in a research project that uses
more than one of the four basic types of mixed-methods designs or that repeats at least one of
those basic types
appropriate
Question Type: SA
53. Explain the difference between the sequencing of a research method and a prioritizing of a
research method.
*a. Varies. Sequencing relates to when the method of research was done; i.e., a relationship
based upon time. Priority relates to which method is given preference; i.e., a relationship based
Russell K. Schutt

Test Bank
upon importance.
appropriate
Question Type: SA
54. Diagram at least three methods of research where the sequence of methods is sequential and
they are prioritized using a staged mixed method research design.
*a. Varies. QUAN→Qual; QUAL→Quan; Qual→ QUAN; Quan→ QUAL
y
Question Type: SA
nl
55. Evaluation research is not a method of data collect, it is social research that is conducted for a
distinctive purpose.
*a. True
tO
b. False
Answer Location: Evaluating Research Basics
Question Type: TF
f
ra
56. The direct product of a program’s service deliver is its input.

a. True
*b. False
D

Answer Location: Evaluating Research Basics
Question Type: TF
57. Quantitative methods are often a key component of process evaluation studies because they
can be used to understand internal program dynamics.
a. True
*b. False
appropriate
Question Type: TF
58. Stakeholders are those individuals and groups who have some basis of concern with the
Russell K. Schutt

Test Bank
program.
*a. True
b. False
Learning Objective: Present arguments for and against stakeholder-driven evaluation
Question Type: TF
59. Need cannot be assessed by social indicators such as focus groups composed of community
residents.
a. True
*b. False
y
nl
Question Type: TF
60. Cost-benefit analysis uses a random perspective to determine what can be considered a
tO
benefit rather than a cost.
a. True
*b. False
appropriate
f

ra

Question Type: TF
D
61. A cost-benefit analysis must be able to make some type of estimation of how clients benefit
from the program.
*a. True
b. False
appropriate
Question Type: TF
62. Evaluation research projects rarely combine qualitative and quantitative methods when
conducting research.
a. True
*b. False
Russell K. Schutt

Test Bank
appropriate
Question Type: TF
63. The primary method used in a QUAN(qual) mixed-methods project is quantitative.

*a. True
b. False
Question Type: TF
y
64. Due to an ambitious program of evaluation research, the popularity of home visiting
nl
programs for young mothers has increased dramatically.
*a. True
b. False
tO
Answer Location: In The News—Can We Same (More) Babies?
Question Type: TF
f
65. The most common way that internal validity is strengthened with mixed-methods design is
ra
when qualitative interviews are used to explore the mechanism involved in a causal effect.
*a. True
b. False
D
Question Type: TF
66. Mixed methods create less challenges for researchers because the same type of expertise are
required for effective use of qualitative and quantitative methods.
a. True
*b. False
Answer Location: Careers and Research
Question Type: TF
Russell K. Schutt

Test Bank
67. Evaluation research can only make a difference in people’s lives after the results are
reported.
a. True
*b. False
Question Type: TF
68. When program impact is the focus, human subject considerations multiply.
*a. True
b. False
y
nl
Question Type: TF
69. It is important to be aware that several federal statues have been passed specifically to protect
tO
research data about vulnerable populations from legal disclosure requirements.
*a. True
b. False
f

ra
Question Type: TF
70. In the long run, it is less ethical to conduct an evaluation study than to let the status quo
D
remain in place.
a. True
*b. False
Question Type: TF
71. When an evaluation research project is designed to answer multiple research questions and
investigate a complex social setting, a mixed-methods design is often beneficial.
*a. True
b. False
Russell K. Schutt

Test Bank
Question Type: TF
72. Researchers using qualitative methods often define themselves as outside experts who design
a research project and collect research data using objective procedures that are best carried out
without participant involvement.
a. True
*b. False
Answer Location: Ethics of Evaluation
Question Type: TF
73. To conduct research on children, parental consent can usually be attained after the child has
y
been approached directly about the research.
a. True
nl
*b. False
tO
Answer Location: Ethics of Evaluation
Question Type: TF
74. Impact analyses that do not use an experimental design can still provide useful information
and may be all that is affordable or ethically feasible in many circumstances.
f
*a. True
ra
b. False
appropriate
D

Question Type: TF

Understanding The Social World Research Methods For The 21st Century 1st Edition Schutt Test Bank

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Understanding The Social World Research Methods For The 21st Century 1st Edition Schutt Test Bank

Uploaded by

Copyright:

Available Formats

Understanding the Social World

Research Methods for the 21st Century

Chapter 10: Evaluation and Mixed-Methods Research

*a. Varies. Outcomes

Answer Location: Evaluation Research Basics

Chapter 10: Evaluation and Mixed-Methods Research

happened had there been no program.

Chapter 10: Evaluation and Mixed-Methods Research

maximizing internal validity.

Answer Location: Mixed Methods

given priority, you are using a(n) ______________ design.

15. It is costly to society and potentially harmful to participants to maintain ___________

Chapter 10: Evaluation and Mixed-Methods Research

Learning Objective: Compare and contrast different mixed methods designs

Chapter 10: Evaluation and Mixed-Methods Research

Cognitive Domain: Application

23. Identify the strengths and limitations of using mixed-research design.

Chapter 10: Evaluation and Mixed-Methods Research

-Generalizability enhanced when, for example:

Cognitive Domain: Knowledge

Chapter 10: Evaluation and Mixed-Methods Research

Learning Objective: Diagram the evaluation research process as a feedback system

29. QUAN→QUAL means:

Chapter 10: Evaluation and Mixed-Methods Research

32. If a measurement is written as (QUAN) qual, it means that:

c. The quantitative and qualitative measures are concurrent

*d. The qualitative measure is secondary

Answer Location: Mixed Methods

Chapter 10: Evaluation and Mixed-Methods Research

35. Prioritized is to equal as staged method is to:

Answer Location: Mixed Methods

Chapter 10: Evaluation and Mixed-Methods Research

38. With a staged mixed-methods design:

Answer Location: Staged Designs

40. Staged method is to embedded method as QUAN→Qual is to:

Chapter 10: Evaluation and Mixed-Methods Research

Learning Objective: Diagram the evaluation research process as a feedback system

42. A researcher who diagrams her research as (QUAL→QUAN)+(QUAL+QUAN) has used

Cognitive Domain: Application

Answer Location: Mixed Methods

Chapter 10: Evaluation and Mixed-Methods Research

47. Mixed methods create extra challenges for researchers:

Cognitive Domain: Knowledge

Answer Location: Strengths and Limitations of Mixed Methods

Chapter 10: Evaluation and Mixed-Methods Research

D. obscures obvious results to reveal more obscure findings

52. Define complex mixed-methods research design.

Chapter 10: Evaluation and Mixed-Methods Research

56. The direct product of a program’s service deliver is its input.

Learning Objective: Diagram the evaluation research process as a feedback system

Chapter 10: Evaluation and Mixed-Methods Research

Cognitive Domain: Application

Answer Location: Efficiency Analysis

Chapter 10: Evaluation and Mixed-Methods Research

63. The primary method used in a QUAN(qual) mixed-methods project is quantitative.

Chapter 10: Evaluation and Mixed-Methods Research

Answer Location: Ethics in Evaluation

Chapter 10: Evaluation and Mixed-Methods Research

Cognitive Domain: Comprehension

You might also like