Professional Documents
Culture Documents
Mixed Methods Research - 56362402
Mixed Methods Research - 56362402
Copyright © eContent Management Pty Ltd. Contemporary Nurse (2006) 23: 3–11.
ABSTRACT Mixed methods research is becoming increasingly popular in the health and
social science disciplines.The aim of this article is to give an overview of the
Key Words varieties of mixed methods designs.We begin by situating mixed methods
research in the context of a paradigmatic framework which assists a researcher
mixed methods;
qualitative in making decisions concerning the design of their study. Although the most
research; commonly used mixed methods designs are underpinned by positivist/
quantitative postpositivist assumptions, the combination of qualitative and quantitative
CN
research; methods can be used within any research paradigm.
paradigms;
postpositivism Received 24 January 2006 Accepted 27 July 2006
BARBARA M GRANT
Senior Lecturer
LYNNE S GIDDINGS Centre for
Associate Professor Professional
School of Nursing Development
Auckland University The University of
of Technology Auckland
Auckland, Aotearoa Auckland, Aotearoa
New Zealand New Zealand
others. When undertaking a mixed methods combining methodologies from different para-
study careful consideration needs to be given to digms) without getting into contradiction.
the assumptions underpinning the research We argue that postpositivism is a shift from
approach so there is congruence between the within the positivist paradigm. It developed dur-
chosen methods and the research question. A ing the 1960s, largely from the increasing
fundamental assumption underpinning this arti- recognition without and within science of the ide-
cle is that mixed methods is a research tool ological and practical limitations of certain
rather than a methodology in its own right. designs and strategies. The prefix ‘post’, when
attached to words like positivism, modernism,
A researcher’s worldview and colonialism for example, indicates a further
or paradigm development of the original concept, but one
In this paper we focus on the most commonly that is fundamentally critical of it. So postposi-
used approach to mixed methods research, a tivism continues most of the key philosophical
combination of qualitative and quantitative assumptions of positivism but in a changed or
methods for collecting and analysing data under- more moderate form. For example, a core
pinned by postpositivist assumptions. We view fundamental positivist assumption is that of
postpositivism as an extension of the traditional determinism, the belief that effects have a
scientific worldview or paradigm known as posi- determinable cause and actions have predictable
tivism (as we will shortly explain). In our view outcomes. Postpositivists maintain this assump-
(described in detail in Grant & Giddings, 2002), tion in a modified form: rather than assuming a
the main health and social science research linear process of cause and effect, they perceive
paradigms are four: the positivist/scientific, outcomes as the result of a complex array of
interpretivist/constructivist, radical/critical and causative factors that interact with each other.
poststructural. A researcher’s paradigm reflects Mixed methods researchers are not always
their beliefs about what reality is (ontology), aware of the postpositivist underpinning of their
what counts as knowledge (epistemology), how studies. By omission, their work may reflect an
one gains knowledge (methodology), and the assumption of being paradigm free or they may
values one holds (axiology). The first three make unsupported claims of creating the ‘best
terms may be scarily familiar to you but the last of both worlds’ by incorporating other para-
is likely to be new.Yet the axiological position- digms such as interpretive or radical/critical.
ing of a researcher is often the determining fac- One of us has described such mixed methods
tor in the research decision-making process. For studies as ‘positivism dressed in drag’ (Giddings
instance, a person who has strong values on 2005: 195).
issues of social justice and equity is likely to be In what follows we begin by clarifying the
drawn to the radical/critical paradigm because terms methodology/methods and qualitative/
it focuses on social action and social change.The quantitative.We then offer some guidelines on
emergence of Kaupapa Maori research (indige- how to decide when to use a mixed methods
nous within Aotearoa New Zealand) may be design, followed by a description of the various
understood in part as driven by profound designs we consider most useful in health
axiological differences embedded in different research. Illustrative examples from nursing
cultures.Taken together, paradigm assumptions research studies and references for further read-
and beliefs indicate the proper kind of ing are provided along the way. Although mixed
researcher–researched relationship. Important- methods research is largely located in post-
ly, paradigms are incommensurate, that is you positivism, we suggest that it can be used by
cannot easily work across them (for instance by researchers situated within other paradigms.
takes more time, both at the beginning for pre- qualitative method collect the most perti-
planning and negotiation (because of the mix of nent data? This decision and the way you decide
researcher skills needed) and at the end for to analyse your data are most likely to reveal the
coming to agreement as to how the findings fit underpinning research paradigm that will guide
together (or not) and what they ultimately the research process.
mean. For these reasons, we suggest graduate 6. How does the secondary data collection
students – especially in masters by research pro- method complement the primary? What
grammes – approach the use of mixed methods does it contribute to the purpose of your
with caution. However, its usefulness is such study?
that it may be the best design to answer your 7. How will you sequence the methods? What
question.We suggest if you decide to carry out needs to be known first?
a mixed methods study that you find a sponsor 8. Do you have the skills to collect and analyse
or a community of practice with others under- both data sets? Do you need to consult a
taking the same research approach. Make sure methodological expert or include a co-
as well that your supervisor is supportive of this researcher to complement your skills?
approach and, even better, experienced with 9. How much time do you have to carry
using it. out this study? (This is very relevant for
As noted earlier, most mixed methods research students who often have a very
research reflects postpositivist assumptions. limited time-frame.)
Mixed methods research, however, is certainly
not confined to this paradigm. It can be located Once you have answered these questions, you
within others. For example, feminist researchers will have thought through most of the issues
have long shown creative flexibility in their that bear on how you will carry out your mixed
approaches to collecting and analysing data, able methods study. You will have begun to realise
to utilise quantitative methods in the service of that you may not have a free choice in this
radical/critical or poststructuralist paradigms. matter – that strong personal preferences
Deciding where to locate your mixed meth- (yours but also your supervisor’s), as well as
ods research is a process requiring some thought perhaps even pressures from your clinical
– and probably discussion with others. Here are practice area, all have to be dealt with.
some questions that can guide your thinking,
writing, reading and talking at this time: MAIN DESIGNS OF MIXED
1. What is your issue/problem and what do METHODS RESEARCH
you want to know about it? (This is your Various typologies have been developed to help
research question and you may refine it over understand the many design possibilities in
time as you collect and analyse data.) mixed methods research (Creswell 2003; Morse
2. What is your personal research orientation: 1991; Tashakkori & Teddlie 1998). The one
what values, attributes, abilities, and research offered here in Table 1 is based on those but
skills do you bring to the study? departs from them too. In our typology (as in
3. What are the dominant research traditions Creswell 2003) there are two main designs:
in your academic discipline/s? sequential (➔) and concurrent (+). We have
4. What methods best suit your research pur- abbreviated quantitative to QUANT or quant
pose (aim or objective) and context (institu- and qualitative to QUAL or qual.
tional, social, cultural, political)?
5. Which method is going to be the primary Sequential mixed methods designs
data gatherer? Would a quantitative or a In sequential designs, one method is used first,
followed then by the other: QUANT ➔ QUAL interviews to gather data from her students. It is
or QUAL ➔ QUANT. In the analysis and inter- not until the presentation of the findings that it
pretation phase, the data may be treated equally is clear that a sequential mixed methods design
(as suggested by the notation above) or one set was used, with the data from both methods
of data may be seen as secondary as suggested by treated equally (QUANT ➔ QUAL): Ironside
use of lower-case letters in these notations: first sets out the student responses to various
QUANT ➔ qual, quant ➔ QUAL, QUAL items on the questionnaire giving some of the
➔ quant, or qual ➔ QUANT.We have cho- statistical results in support of conclusions
sen as our exemplars two QUANT ➔ QUAL made. The qualitative data are then presented
studies to show the variety of ways such studies thematically. In her analysis she attempts
can be designed, and one QUANT ➔ qual to integrate the findings from the two data
study. The last combination is one of the more sources. The quantitative findings were in a
commonly used sequential designs in health and number of instances incongruent and inconsis-
social science research. Nursing research articles tent with the qualitative findings. Most of the
are used for the exemplars. discussion in the article arises from the mis-
match between these findings.This outcome of a
Sequential exemplar 1 mixed methods study is one of its strengths.
QUANT ➔ QUAL (integrated), New questions are posed and new ways to
summarised in Table 2 explore them become possible.
Comment • Shared primary objective but different research questions and different primary investigators.
• Both parts of study treated equally but separately with the findings presented as stand-alone
studies and published in different journals.
design but separated the quantitative and quali- people with visible disfigurement, does not indicate
tative parts of their study. They researched the that it is a mixed methods study. Neither do the
topic of addressing family violence in the health- key words. From the title, the reader may won-
care setting and described their design as mixed der if it is an interpretive qualitative study.
methods. There was one research team, one Although not directly stated, it is the abstract
ethics proposal, and a primary objective – to that situates the study firmly in the postposi-
create change. They carried out their study tivist paradigm with the qualitative component
sequentially. First they studied the prevalence of clearly secondary. The words that clue you in
violence among women seeking health care by are ‘establish extent and type of psychosocial
administering a questionnaire. They then con- needs’ and ‘little is known about levels of dis-
ducted semi-structured telephone interviews tress’ (2004: 443); these are phenomena that
with a sub-sample of those women, inquiring can be measured and described with quantita-
about what the experience of being asked ques- tive methods. The study used cross-sectional
tions about family violence in the healthcare set- survey design followed by semi-structured
ting was like and if it made a difference for them interviews to ‘generate further quantitative and
and/or their children. Both parts of the study qualitative data about individual concerns, and
were treated equally but separately.They had a satisfaction with the provision of care’ (2004:
shared primary objective but different research 443).This is a sequential mixed methods design
questions, different members of their team were in which the qualitative component comple-
primary investigators, the findings were pre- ments the quantitative (QUANT ➔ qual):
sented as stand-alone studies, and submitted to statistical results are reported in text and in
different journals for publication. tables with various findings being echoed by the
interview data (2004: 450).
Sequential exemplar 3
QUANT ➔ qual (integrated), Concurrent mixed methods designs
summarised in Table 4 In the concurrent design, both methods are
used at the same time. In some studies, both are
The title of Rumsey et al.’s (2004) article, of equal importance to answering the research
Altered body image: Appearance-related concerns of question but, like sequential designs, most often
during the interview process’ (p. 64) – (an 1950s the design consist of a survey question-
attempt to control for bias and variability). naire using measurable items to produce quanti-
5. Although in the methods section reference tative (hard) data with either some open-ended
was made to purposive sampling, in the questions or a space for comments to enable the
conclusion the authors of the study noted collection of qualitative (soft) data. Borjesson et
that a limitation was that the women ‘were al. (2004) questionnaire consisted of 37 items
not randomly selected’ (p. 64) (would have (demographic details, Likert scales and multiple
enabled a more representative sample to choice questions) with space underneath each
ensure generalizability of the findings). for respondents to write comments. An open-
ended question asking for their views on soci-
The study by Somervell et al. (2005) highlights ety’s contribution to supporting mothers in
some of the strengths of combining qualitative their parenting role was included at the end.
and quantitative methods (a broad focus and a The qualitative data was clearly being used to
variety of data collection approaches enables the support the quantitative findings. This nestled
gathering of rich descriptions of a phenome- positioning of the qualitative component of the
non), but also some of the ‘messiness’ that can study is evident too in the way the findings are
occur when the paradigmatic positioning is not presented; the quantitative results are given first
acknowledged or clearly understood.The use of with explanatory, descriptive, or supportive
qualitative methods with a dusting of interpre- quotes from the respondents’ written com-
tive (qualitative) concepts in a research report ments. Unlike the Somervell et al. (2005) study
do not make a positivist/scientific study inclu- there was paradigmatic congruence. Although
sive of the interpretive paradigm (the ‘best of the methodology was not specifically named as
both worlds’); rather the qualitative methods descriptive mixed methods, its descriptive
are used in the service of the scientific method. nature was consistent within and between each
As demonstrated in Somervell et al. (2005) section as was the use of postpositivist language.
research report, if the paradigmatic assumptions
are not made explicit, the ensuring analysis may Reflections on mixed methods
contain contradictory statements that challenge typologies
the theoretical and methodological rigour of the Our typology shares many similarities with
research. Creswell’s (2003). The major difference bet-
ween our view and his arises around his
Concurrent exemplar 2 categories of sequential and concurrent trans-
QUANT + qual (nestled), summarised in Table 6 formative mixed methods designs. The key
feature of transformative designs according to
The QUANT + qual nestled design used by Creswell is that they are underpinned by ‘a the-
Borjesson, Paperin and Lindell (2004) in their oretical perspective’ (p. 216) that guides the
study of maternal support during the first year research and is more important than the choice
of infancy, is the classical mixed methods of methods. In our view all research is theoreti-
design. Used by health professionals since the cally guided but, as we have said, it is common
Borjesson et al. (2004) Maternal support during the first year of infancy