Research Methodology and

Academic Writing

Mixed Methods Research Designs

Iraj Ratnayake, PhD

Department of Tourism Management
Sabaragamuwa University of Sri Lanka
 Lecture Outline

§ Introduction
§ Definition and purpose of mixed methods research
§ Steps in the process of designing a mixed methods
study – mixing or linking data
§ Mixed methods designs
§ Starting your mixed methods study

2
 Introduction

What is mixed methods research?

Tashakkori, A., & Teddlíe, C. (1998). Mixed methodology: Combining qualitative and
quantitative approaches. Thousand Oaks, CA: Sage.

Tashakkori, A., & Teddlíe, C. (Eds.) (2010). SAGE Handbook of mixed methods in
social and behavioural research, Thousand Oaks, CA: Sage.

Creswell, JW (2014). Research Design: Qualitative, Quantitative and Mixed Methods

Approaches. Thousand Oaks, CA: Sage

3
 Combining Two Types of Data

Qualitative Text Data Quantitative Numeric Data

• This is a sample of a text file of • 2342523112342332

words that might be collected 1115341231445541
on interview transcripts, 2143351423155221
observation field notes, or 5351315322513244
optically-scanned documents.
31242241554215

4
 Framework for Viewing Perspectives on
Mixed Methods

Quantitative Data Qualitative Data

Mixed Methods

Method Methodology

Paradigm Use of mixed methods

Perspective in other designs

5
 Determine Your Worldview…

Post-positivism Constructivism
• Determination • Understanding
• Reductionism • Multiple participant meanings
• Empirical observation and • Social and historical construction
measurement • Theory generation
• Theory verification

Advocacy/Participatory
• Political
• Empowerment issue-oriented
• Collaborative
• Change-oriented
Pragmatism
• Consequences of actions
• Problem-centered
• Pluralistic
• Real-world practice oriented

6
 A Mixed Methods Researcher…

– Collects both quantitative and qualitative data

– “Mixes” them

– “Mixes” them at the same time (concurrently) or one

after the other (sequentially)

– Emphasizes both equally or unequally

7
 Mixed Methods Research:
definition and purpose

Mixed methods research is both a method and

methodology for conducting research that involves
collecting, analyzing, and integrating quantitative and
qualitative research in a single study (cross sectional) or a
longitudinal program of inquiry.

The purpose of this form of research is that both qualitative

and quantitative research, in combination, provide a better
understanding of a research problem or issue than either
research approach alone.

8
 Collecting Quantitative and Qualitative Data

Quantitative Data:
– Close-ended scales
– Attitudinal/behavioral scales
– Behavioral checklists
– Census, attendance records

Qualitative Data:
– Open-ended responses
– Semi-structured interviews
– Semi-structured observations
– Records/documents
– Videotapes
– Images such as pictures or drawings

9
 Analysing Quantitative and Qualitative Data

Quantitative Analysis: Use statistical analysis: for description; for

comparing groups; and for relating variables
– Numeric data
– Descriptive trend analysis
– Hypothesis testing, effect size, interval estimates

Qualitative Analysis
– Text/image data
– Coding
– Themes
– Description
– Interrelated themes to build a picture of the phenomenon.

10
 Mixing the Quan and Qual Data

Type of Design Type of Mixing Why Mixing Where Mixing Occurs in

Occurs Research Process

Sequential Connecting One phase builds Between data analysis

on the other (Phase 1) and data collection
(Phase 2)

Concurrent Merging Bring results After analysis of both quan

together and qual – typically in
discussion

Sequential or Embedding Either building or Either between phases or in

Concurrent bringing results discussion after analysis
together

11
 Mixing or Linking the Data

1. Connecting Data:

Qual Data Quan Data Results

12
 Mixing or Linking the Data

2. Merging Data:

Qual Data Results Quan Data

13
 Mixing or Linking the Data

3. Embedding Data:

QUAN
Results
Qual

QUAL
Results
Quan

14
 Mixed Methods Research Designs

1. Convergent Parallel Mixed Methods Design

2. Explanatory Sequential Methods Design

3. Exploratory Sequential Methods Design

4. Transformative Mixed Methods Design

5. Embedded Mixed Methods Design

6. Multi Phase Mixed Methods Design

15
 Convergent Parallel Mixed Methods Design

The convergent mixed design approach is probably the

most familiar of the basic mixed methods strategy.
Researchers new to mixed methods typically first think of
this approach because they feel that mixed methods only
consists of combining the qualitative and quantitative
data.

In this approach, a researcher collects both quantitative and

qualitative data, analyses them separately, and then
compares the results to see if the findings confirm or
disconfirm each other.

16
 Convergent Parallel Mixed Methods Design

Quantitative
Data Collection
and Analysis
(QUAN)

Compare Interpretation
or relate

Qualitative
Data Collection
and Analysis
(QUAL)

17
Explanatory Sequential Mixed Methods Designs

This method appeals to individuals with a strong quantitative

background or from fields relatively new to qualitative
approaches.

It involves a two-phase project in which the researcher

collects quantitative data in the first phase, analyses the
results, and then uses the results to plan (or build on to)
the second, qualitative phase. The quantitative results
typically inform the types of participants to be purposefully
selected to the qualitative phase and types of questions
that will be asked of the participants.

18
Explanatory Sequential Mixed Methods Designs

Quantitative Qualitative
Data Data
Collection Collection
Follow Interpretation
and Analysis and Analysis
(QUAN) up with
(qual)

19
 Exploratory Sequential Mixed Methods Designs

The researcher first begins by exploring with qualitative

data analysis and then uses the findings in a second
quantitative phase.

The intent of the strategy is to develop better

measurements with specific samples of populations and
to see data from few individuals can be generalized to a
large sample of a population.

20
Exploratory Sequential Mixed Methods Design

Qualitative Quantitative
Data collection Data Collection
and Analysis Builds to and Analysis Interpretation
(QUAL) (quan)

21
 Embedded Mixed Methods Designs

The embedded mixed methods design nests one or more

forms of data (quantitative or qualitative or both) within a
larger design (e.g., a narrative study, an ethnography, an
experiment).

For example, within an experiment, the researcher can

collect qualitative data and collect it during the
experiment (convergent) or before the experiment begins
(sequentially) or after the experiment ends (sequentially).

22
 Embedded Mixed Methods Designs

Quantitative (or Qualitative)

Qualitative (or Quantitative)
Data Collection and Analysis (QUAN or
QUAL)

Interpretation

Qualitative (or Quantitative)

Data Collection and Analysis
(before, during, or after) (quan or
qual)

23
 Transformative Mixed Methods Designs

The strategy that incorporates the elements of the

convergent, explanatory sequential, or exploratory
sequential approaches within a social justice framework
to help marginalized group.

24
 Transformative Mixed Methods Designs

Transformative Framework (e.g. feminist, racial, disability)

Convergent, Explanatory,
Exploratory, or
Embedded Mixed Interpretation
Methods

25
 Multiphase Mixed Methods Designs

Researchers conduct several mixed methods projects,

sometimes including mixed methods convergent or
sequential approaches, sometimes including only
quantitative or qualitative studies in a longitudinal study
with a focus on a common objective for the multiple
projects.

26
 Multiphase Mixed Methods Designs

Overall Study 1: Study 2: Study 3:

program MM, MM, MM,
Informs QUAL, or Informs QUAL, or
objective QUAL, or
QUAN QUAN QUAN

(e.g., longitudinal, multi-project, large-scale)

27
 Choosing Mixed Methods Projects,
Expected Outcomes and Type of Design
Reasons for Choosing Mixed Expected Outcomes Recommended Mixed
Methods Methods Design
Comparing different Merging the two databases to Convergent parallel mixed
perspectives drawn from quan show how the data convergent methods design
and qual data or diverge
Explaining quan results with A more in-depth Explanatory sequential mixed
qual data understanding of the quan methods design
results (often cultural
relevance)
Developing better A test of better measures for a Exploratory sequential mixed
measurement instruments sample of a population methods design
Understanding experimental An understanding of Embedded mixed methods
results by incorporating participant views within the design
perspectives of individuals context of an experimental
intervention
Developing an understanding A call for action Transformative mixed
of needed changes for a methods design
marginalised group
Understanding the need for an A formative and summative Multiphase mixed methods
impact of an intervention evaluation design
programme
Source: Creswell, 2014: 231 28
 Designing a Mixed Methods Study

• Preliminary considerations
• Creating a title
• Posing a general question
• Listing the types of data collection and analysis
• Making explicit your worldview
• Identifying your research design
• Drawing a figure of your design
• Writing a purpose statement
• Writing research questions
• Completing a research plan

29
 Preliminary Considerations
(before you begin to design)

1. Research problem
• Content – any topic
• Fit the problem to mixed methods (arguments)

2. Access to both qualitative and quantitative data

3. Background and resources

4. Receptive audience

30
 Create a Working Title

• Writing the title

– Short
– Topic
– Participants
– Include the words– “mixed methods”
– Neutral– neither quan nor qual

31
 Pose the General Question to be Answered

• Write it as a question
• Look to see how it is phrased
• Make sure that it is specific enough and focused (an
answerable question)
• Ask yourself, “when I end the study, what question
would like to have answered?”

32
 List Your Types of Data Collection

• Quantitative data • Qualitative data (open-

(closed-ended) ended)
– Interviews
– Instruments
– Observations
– Behavioral – Documents
checklists – Audio-visual materials
– Records

33
 List Your Approach to Data Analysis

— Quantitative analysis — Qualitative analysis

— Use statistical — Use text and images,
analysis, — For coding
— For description — For theme
— For comparing groups development
— For relating variables — For relating themes
— Design-type — Design-type

34
 State Your Procedures (methods)

Procedures for handling your qualitative and quantitative

data

• Sequence – concurrent or sequential or both

• Emphasis – emphasis on qualitative or quantitative
• Sometimes both concurrent and sequential phases are
used
• Designs may include more than two phases
• Think about using a simple, elegant design

35
 Write a Purpose Statement for an
Explanatory Design

This study will address _______________ (content-aim of the study). An

explanatory sequential mixed methods design will be used, and it will involve
collecting qualitative data after a quantitative phase in order to explain or follow
up on the quantitative data in more depth. In the first quantitative phase of the
study, ______________ (instrument) data to be collected from
_______________ (participants) at ___________ (research site) to test
_______ (the theory) that explains why ______________ independent
variables) relate to the ____________ (dependent variables). The second
qualitative phase will be conducted because ______________ (intent of the
qualitative phase). In this exploratory follow-up, the ______________ (central
phenomenon) will be tentatively explored with ___________ (participants) at
_____________ (the research site). The reason for the exploratory follow-up is
to _______________ (e.g., to help explain or build upon initial quantitative
results).

37
 Write a Purpose Statement for an
Exploratory Design

This study addresses _________________ (content-area of the study). The

purpose of this exploratory sequential design will be to __________________
(e.g., develop an test an instrument, generate a taxonomy). The first phase of
the study will be a qualitative exploration of ________________ (the central
phenomenon) by collecting ___________________ (types of data) from
_________________ (participants) at _____________ (the research site). The
second quantitative phase will follow up on the qualitative phase for the purpose
of __________(intent of this followup). In the quantitative phase, ___________
(instrument data) will be collected from ____________ (participants) at
______________ (research site). Quantitative research questions/hypotheses
will be formulated after the completion of the initial qualitative phase. The reason
for collecting qualitative data initially is that _____________________ (e.g.,
instruments are not available, variables are not known, there is little guiding
theory).

38
 Qualitative Research Questions

• Qualitative central question

– Begin with “what” or “how”
– Focus on single phenomenon
– Use exploratory verbs (discover, understand,
explore)
– Non-directional language
– A general question (allowing participants’
perspectives to emerge)

39
 Quantitative Research Questions

• Can be hypotheses or questions

• State variables– independent, dependent, mediating,
covariates
• Develop from theory
• Use distinct measures for independent and dependent
variables
• Order variables from independent to dependent

40
 Writing Research Questions/Hypotheses in Mixed
Methods Research

• Write qualitative research questions and write

quantitative research questions/hypotheses

• Also write a mixed methods research question

• Write these questions separately

41
 A New Type of Research Question:
A Mixed Methods Question

Three ways to write this question:

1. Methodologically-focused:

– What extent do the qualitative results confirm the

quantitative results?

42
 A New Type of Research Question:
A Mixed Methods Question

2. Content-focused:

– How do the interviews with adolescent boys support the

quantitative results that their self-esteem changes during
the middle school years?

3. Hybrid of quantitative and qualitative elements:

– What results emerge from comparing the exploratory

qualitative data about boy’s self-esteem with outcome
quantitative instrument data measured on a self-esteem
instrument?

43
 Order the Topics for Your Plan
— Title
— Introduction
— (Problem)
— Worldview/theoretical lens
— Audience
— Purpose Statement
— Research Questions
— (Literature Review)
— Methods
— Type of Mixed Methods Design (also add definition of mixed methods)
— Types of Data Collection
— Types of Data Analysis
— Sequence/Emphasis/ Mixing Procedures
— Figure of procedures
— Anticipated methodological issues
— Ethical issues anticipated
— Validity and reliability issues
— Researcher resources and skills
— References
— Appendices 44
 Assignment

1. Identify a research problem that is prevailing in your

sector.
2. Justify your problem identification.
3. Select appropriate methodology and research design.
Justify your selection.
4. Develop a research proposal for implementation.

45