Professional Documents
Culture Documents
Maxwelland Mittapalli Realismand Mixed Methods
Maxwelland Mittapalli Realismand Mixed Methods
net/publication/235930763
CITATIONS READS
844 24,108
1 author:
SEE PROFILE
All content following this page was uploaded by Joseph Alex Maxwell on 22 June 2016.
Objectives
◆ 145
146–––◆–––Conceptual Issues: Philosophical, Theoretical, Sociopolitical
Example 1
On the basis of 5 years of ethnographic research, including coaching swimming teams at dif-
ferent levels and observing and interviewing swimmers, Chambliss argued that there is no such
thing as talent as an explanation of high performance; it is a myth that romanticizes and mys-
tifies what he called “the mundanity of excellence.” He supported this claim with detailed evi-
dence from his observations and interviews, showing that high performance is simply the result
of dozens of specific skills, learned or stumbled upon, that are repeatedly practiced and syn-
thesized into a coherent whole. Abbott saw this as a constructivist move in the debate over
sports performance; it asserted that talent is a social construction that does not refer to any
real causal factor but is simply a vacuous explanation for high performance.
This move was consistent with the field of sociology of sport, which was generally seen as
constructionist in orientation. However, underlying Chambliss’s argument for a constructivist
interpretation of talent was a realist move, identifying actual skills and practices and excel-
lence as the outcome of these, as real phenomena rather than simply constructions. As a result,
his work was attacked by others in this field for not treating winning, and the skills that led to
this, as themselves social constructions. Chambliss’s reply was that while selecting winners on
the basis of elapsed times, rather than the beauty or precision of their strokes, was certainly a
social construction, once that construction was made, the factors that lead to success in terms
of that standard, and the outcomes of races, have a real existence independent of how they
are construed by participants and judges.
150–––◆–––Conceptual Issues: Philosophical, Theoretical, Sociopolitical
Example 2
A particularly detailed and sophisticated statement of the sort of realism we adopt here was
presented by the physicist and historian of science Evelyn Fox Keller (1992), with the assump-
tion that this viewpoint is so widely shared that it needs no explicit defense. She stated,
“I begin with a few philosophical platitudes about the nature of scientific knowledge upon which
I think we can agree, but which, in any case, will serve to define my own point of departure”:
(Continued)
theories do in fact “work”—that is, lead to action on things and people that, in extreme
cases (for example, nuclear weaponry), appear to be independent of any belief system—
they must be said to possess a kind of “adequacy” in relation to a world that is not itself
constituted symbolically—a world we might designate as “residual reality.”
I take this world of “residual reality” to be vastly larger than any possible representation
we might construct. Accordingly, different perspective, different languages will lead to
theories that not only attach to the real in different ways (that is, carve the world at
different joints), but they will attach to different parts of the real—and perhaps even
differently to the same parts. (pp. 73–74)
Such versions of realism share many reality independent of our theories can
characteristics with philosophical pragma- serve no useful function because there is no
tism. It is worth noting, therefore, that way to employ this that will avoid the con-
some of the major figures in pragmatism straints of a relativist epistemology. They
were also ontological realists (Maxcy, concluded that “Maxwell is unable to show
2003, p. 56; see also Biesta, 2010). Buchler us how to get reality to do some serious
(1940) said of Peirce, the founder of work” (p. 883). In what follows, therefore,
American pragmatism, that we attempt to show how a realist ontology
can do useful work in the methodology and
Underlying every phase of Peirce’s practice of mixed methods research, if it is
thought is his realism. The supposition taken seriously and its implications system-
that there are real things—the real is atically developed. We do so by describing
“that whose characters are independent some specific implications of critical realism
of what anybody may think them to for quantitative, qualitative, and mixed
be”—he regards as the “fundamental methods research, showing how a realist
hypothesis” of science, for it alone perspective can provide new and useful
explains the manner in which minds are ways of approaching problems and impor-
compelled to agreement. (p. xiv). tant insights into social phenomena.
Given the prominence of realist views in
Contemporary philosophers who inte- philosophy, it is puzzling that realism has
grate pragmatism and realism include not had a greater influence on research
Haack (2006) and Putnam (1990; Conant methodology. Despite the contributions to
& Zeglen, 2002); Putnam once commented a realist approach to social research by
that he should have called his version of Campbell (1988), Huberman and Miles
realism pragmatic realism. (1985), Sayer (1992, 2000), Hammersley
Despite the widespread commonsense (1992), House (1991), and others, philo-
acceptance of combining ontological real- sophic realism seems still to be largely
ism and epistemological constructivism, the unnoticed by most researchers (one excep-
application of this perspective to qualitative tion is the field of program evaluation,
research, as advocated by Hammersley where realist approaches developed by
(1992) and Maxwell (1992), was chal- Pawson and Tilley (1997) and Henry et al.
lenged by Smith and Deemer (2000), who (1998; Mark et al., 2000) have had a sig-
asserted that the ontological concept of a nificant impact). Even when realism is
Realism as a Stance for Mixed Methods Research–––◆–––153
Example 3
Becker et al. (1961/1977) begin their chapter on the “Design of the Study” by stating:
In one sense, our study had no design. That is, we had no well-worked-out set of
hypotheses to be tested, no data-gathering instruments purposely designed to secure
information relevant to these hypotheses, no set of analytic procedures specified in
advance. Insofar as the term “design” implies these features of elaborate prior planning,
our study had none.
If we take the idea of design in a larger and looser sense, using it to identify those ele-
ments of order, system, and consistency our procedures did exhibit, our study had a
design. We can say what this was by describing our original view of the problem, our the-
oretical and methodological commitments, and the way these affected our research and
were affected by it as we proceeded. (p. 17)
A second example of the application of a entities and mechanisms. This view treats
realist perspective to research design is to the actual process of causality as unob-
view the relationships that a researcher servable, a “black box,” and focuses
establishes with participants and other simply on discovering whether there is a
stakeholders in a study as a real component systematic relationship between inputs
of the “design-in-use” of a study, one that and outputs. This conception of causality
is rarely addressed in discussions of is “the basis of ordinary quantitative research
research design and that often is critical to and of the stricture that we need compar-
the actual functioning of a study (Maxwell, ison in order to establish causality”
2002, 2005). (Mohr, 1996, p. 99).
In what follows, we focus on four issues In quantitative research, the regularity
for which we feel realism can make a par- theory of causation is intrinsic to an
ticularly important contribution to mixed approach to explanation that Mohr (1982)
methods research: causal explanation, mind called variance theory. Variance theory
and reality, validity, and diversity. deals with variables and the correlations
among them; it is based on an analysis of
the contribution of differences in measured
A PROCESS APPROACH values of particular variables to differences
TO CAUSALITY in values of other variables. The compari-
son of conditions or groups in which the
For most of the 20th century, the dom- presumed causal factor takes different val-
inant conception of causality in the phi- ues, while other factors are held constant or
losophy of science was based on David statistically controlled, is central to this
Hume’s analysis, generally known as the approach to causation. Thus, variance
regularity theory of causation (House, theory tends to be associated with research
1991; Salmon, 1989). Hume argued that that employs experimental or correlational
we can’t directly perceive causal relation- designs, quantitative measurement, and sta-
ships, only the observed regularities in tistical analysis. As Mohr (1982) noted,
associations of events, and he rejected “the variance-theory model of explana-
any reference to hypothesized or inferred tion in social science has a close affinity to
Realism as a Stance for Mixed Methods Research–––◆–––155
not entail materialism, nor is it simply a cover thus their role as essential components of
for a reductionist agenda that would attempt any full explanation of human action.
to eliminate mental concepts from scientific Realism can deal with the apparent dissimi-
discourse (Putnam, 1999, p. 74 ff.). larity of reason explanations and cause
However, realists are not dualists, postu- explanations by showing that reasons can
lating two different realms of reality, the plausibly be seen as real events in a causal
physical and the mental. In our view, the nexus leading to the action.
clearest and most credible analysis of this Realism also supports the idea that indi-
issue has been that of Putnam (1990, viduals’ social and physical contexts have a
1999), who argued for the legitimacy of causal influence on their beliefs and per-
both mental and physical ways of making spectives. While this proposition is widely
sense of the world. He advocated a distinc- accepted in everyday life, constructivists
tion between mental and physical perspec- have tended to deny the reality of such influ-
tives or languages, both referring to reality, ences, while positivism and some forms of
but from different conceptual standpoints. postpositivist empiricism tend to simply dis-
He argued that “the metaphysical realign- miss the reality or importance of individuals’
ment we propose involves an acquiescence perspectives, or to “operationalize” these to
in a plurality of conceptual resources, of behavioral variables. From a realist perspec-
different and mutually irreducible vocabu- tive, not only are individuals’ perspectives
laries . . . coupled with a return not to dual- and their situations both real phenomena,
ism but to the ‘naturalism of the common but they are separate phenomena that
man.’” (1999, p. 38) causally interact with one another.
Thus, while realism rejects the idea of Thus, a realist perspective can provide a
“multiple realities” in the sense of indepen- framework for better understanding the
dent and incommensurable worlds in which relationship between individuals’ perspec-
different individuals or societies live, it is tives and their actual situations. This issue
quite compatible with the idea that there has been a prominent concern in the philos-
are different valid perspectives on the ophy of social science for many years
world. However, it holds that these per- (e.g., MacIntyre, 1967/1970; Menzel, 1978),
spectives, as held by the people we study as and is central to “critical” approaches to
well as ourselves, are part of the world that qualitative research. Critical realism treats
we want to understand, and that our under- both individuals’ perspectives and their sit-
standing of these perspectives can be more uations as real phenomena that causally
or less correct (Phillips, 1987). interact with one another. In this, realism
A realist approach thus recognizes the real- supports the emphasis that critical theory
ity and importance of meaning, as well as of places on the influence that social and eco-
physical and behavioral phenomena, as hav- nomic conditions have on beliefs and ide-
ing explanatory significance, and the essen- ologies. Sayer (1992, pp. 222–223) stated
tially interpretive nature of our understanding that the objects of “interpretive” under-
of the former (Sayer, 2000, pp. 17–18). standing (meanings, beliefs, motives, and so
Combining this view with a process-oriented on) are influenced both by the material cir-
approach to causality can resolve the long- cumstances in which they exist and by the
standing perceived contradiction between cultural resources that provide individuals
“reason” explanations and “cause” explana- with ways of making sense of their situa-
tions and integrate both in explanatory theo- tions. However, critical realism approaches
ries. Weber’s (1905/1949) sharp distinction the understanding of this interaction with-
between causal explanation and interpretive out assuming any specific theory of the rela-
understanding obscured the importance of tionship between material and ideational
reasons as causal influences on actions, and phenomena, such as Marxism.
158–––◆–––Conceptual Issues: Philosophical, Theoretical, Sociopolitical
A realist perspective also legitimates validity. Both focus largely on the proce-
and clarifies the concept of “ideological dures used in collecting data and drawing
distortion”—that cultural forms may obscure inferences from these data. This is particu-
or misrepresent aspects of the economic or larly obvious in the movement for evidence-
social system or the physical environment— based research, which relies almost entirely
while affirming the causal interaction on the type of research design as the basis
between the physical and social environ- for assessing the validity of the results, with
ment and cultural forms. In particular, real- randomized experiments as the gold stan-
ism is compatible with what have been dard for design quality. However, it also
called ideological or non-reflectionist characterizes prominent approaches to
approaches to culture, in which cultural validity (or its analogues) in qualitative
forms that contradict aspects of social research.
structure may serve ideological functions A realist concept of validity is quite
that act to sustain the social system or con- different from these procedure-based
stitute adaptive responses to the physical or approaches. Validity, from a realist per-
social environment (e.g., Maxwell, 1978). spective, is not a matter of procedures,
An emphasis on causal processes rather but of the relationship between the claim
than regularities or laws in explaining and the phenomena that the claim is
sociocultural phenomena also allows expla- about (Hammersley, 1992; House, 1991;
nations to be tailored to single cases and Maxwell, 1992; Norris, 1983). Shadish
unique circumstances, so that different indi- et al. (2002) in what is currently the
viduals or social groups may have different definitive work on experimental and quasi-
responses to similar situations, depending experimental research, state:
on differences in specific personal or cul-
tural characteristics that are causally rele- Validity is a property of inferences. It is
vant to the outcome. not a property of designs or methods, for
the same designs may contribute to more
or less valid inferences under different
VALIDITY AND circumstances. . . . No method guaran-
INFERENCE QUALITY tees the validity of an inference. (p. 34;
italics in original)
Validity and quality are issues about which
qualitative and quantitative researchers Also, as argued by Keller in the passage
have had substantial disagreements. The types quoted in Example 2, a realist approach to
of validity (many qualitative researchers validity does not entail that concepts, theo-
don’t even use this term) employed in each ries, or claims “reflect” or “correspond to”
tradition have little overlap (Teddlie & reality, only that whether these claims
Tashakkori, 2003), and the basic assump- “work” depends on their relationship to a
tions involved in the two approaches are reality independent of our constructions
radically different. Teddlie and Tashakkori (cf. Barad, 2007). While critical realism
went so far as to recommend abandoning denies that we can have any objective per-
the term validity entirely in mixed methods ception of these phenomena to which we
research, arguing that the term has taken can compare our claims, it does not aban-
on such diverse meanings that it is losing don the possibility of testing these claims
its ability to communicate anything against evidence about the nature of the
(pp. 12, 36–37). phenomena.
Despite these differences, there is an We see this process of testing claims
important similarity between the typical against the evidence that is relevant to the
quantitative and qualitative approaches to claims as fundamental to a scientific
Realism as a Stance for Mixed Methods Research–––◆–––159
(Maxwell, 1999). Methodologically, the sam- than an acknowledgment that realism has
ple size and sampling strategies used in quali- informed the research. For example,
tative studies are often inadequate to fully Weisner (2005), in his introduction to a col-
identify and characterize the actual diversity lection of papers on mixed methods studies
that exists in the setting or population studied of children’s development and family life,
and can lead to simplistic generalizations or paid homage to Campbell’s realist and mul-
the assumption of greater uniformity or agree- tiplist approach, saying that this skeptical
ment than actually exists. realism and holism “provides the context
Mixed methods research provides one and tradition for much of our work”
way to help overcome the theoretical and (pp. 5–6), but he doesn’t discuss how,
methodological characteristics that lead to specifically, realism did so.
the neglect of diversity. Qualitative methods As noted above, the one area in which
and approaches, which focus on particular realist perspectives have had a major influ-
phenomena and processes and their unique ence on mixed methods studies is in pro-
contexts, can help to overcome the biases gram evaluation. The work of Tilley
inherent in universalizing, variable-oriented (described in Pawson & Tilley, 1997) and
quantitative methods. Conversely, quantita- Mark et al. (2000; Henry et al., 1998),
tive methods can provide systematic evidence much of which combined qualitative and
for diversity and can help to correct a ten- quantitative approaches, has provided a
dency to ignore complexity and to focus on realist alternative to traditional ways of
typical characteristics and shared concepts conceptualizing program evaluations. In
and themes. However, doing so effectively addition, Pawson’s (2006) analysis of liter-
requires recognizing the reality of diversity. ature reviews for evidence-based policy
To sum up this section, we are not simply constitutes a major critique of standard
claiming that realism is a productive stance ways of integrating qualitative and quanti-
for mixed method research because it is com- tative results in a literature synthesis, and
patible with both qualitative and quantita- presents a realist alternative to these
tive research and treats the two perspectives approaches.
as equally valid and useful. We have also There is also the potential within realist
argued that realism has important implica- approaches for incorporating features high-
tions for both approaches, ones that push lighted by an emancipatory paradigm and
both qualitative and quantitative researchers promoting social justice (House, 1991); this
to examine more closely some issues that is a significant aspect of Bhaskar’s version
they typically dismiss or ignore. Realism can of critical realism, which has been more
therefore not only help to integrate the two prominent in Europe than in the United
approaches into a more coherent combina- States. Some important advances based on
tion, and promote closer and more equal critical realism have recently been made in
cooperation between qualitative and quanti- mixed methods research in accounting
tative researchers, but can serve to increase (Brown & Brignall, 2007; Covaleski &
the usefulness of both approaches. Dirsmith, 1983, 1990), operations manage-
ment (Mingers, 2000, 2006; Reed, 2005),
economics (Downward, Finch, & Ramsay,
♦ Applications of 2002; Fleetwood, 1999; Lawson, 1989,
Critical Realism in 1997, 1998, 2001; Olsen, 2004), political
Mixed Methods Practice science (Patomäki, 2002), medicine (Clark,
MacIntyre, & Cruikshank, 2007), and
nursing (Lipscomb, 2008; Stickley, 2006).
Explicit use of realist perspectives in mixed Modell (2007) used critical realism to
methods research is still relatively uncom- develop a unified approach for validating
mon and sometimes involves little more mixed methods research in accounting
Realism as a Stance for Mixed Methods Research–––◆–––161
management. He argues that whereas critical first and the gendered nature of poverty in
realism shows many similarities to, and has the second. She used both theoretical and
indeed borrowed key concepts from the methodological triangulation in these stud-
pragmatist tradition, it constitutes a more ies. Theoretically, she combined neoclassi-
relevant philosophical foundation to this cal, Marxist political economy and feminist
end. Based on examples from the field of political economy perspectives; method-
management accounting and budgeting in ologically, she used a survey of a random
the U.S. nursing area and the jute industry in sample of farmers, ethnographic observa-
Bangladesh (see Covaleski & Dirsmith, tions, in-depth interviews, family histories,
1983; Hoque & Hopper, 1994, 1997), and the analysis of documents and sec-
Modell’s work explicates how critical real- ondary data. Her results exposed deficien-
ism may inform management accounting cies in both the neoclassical and Marxist
research by effectively integrating qualitative approaches and showed the necessity of
and quantitative methods. The examples adding qualitative to quantitative methods
illustrate the role of context-specific condi- to understand the phenomena studied. She
tions that may be captured only through concludes with three rules of thumb for
deeper empirical probing and reconceptual- realist research: a complex and stratified
ization. In a later study, Covaleski and ontology, explicit value analysis, and get-
Dirsmith (1990) conceded that their quest ting behind the numbers and mathematical
for a deeper understanding of budgeting was models to causal mechanisms.
derived from a growing realization of the Within the field of psychiatry, where
problematic nature of the traditional, posi- hierarchy and control prevail, a critical real-
tivist approach. The authors describe ist perspective offers a model that does not
“freeing” themselves from a priori theories submit to the dominant discourse but
to develop a more contextualized understand- rather recognizes that service users now
ing of the lived experiences of interviewees, possess decision-making power, especially
and to produce a more multifaceted concep- in terms of being able to provide services
tualization of budgeting (Covaleski & that statutory services providers now
Dirsmith, 1990). require (Stickley, 2006). Based on a
In economics, critical realism points power/knowledge discourse, Stickley sug-
to the main limitations of neoclassical gested a critical realist framework that
economics (based on econometrics prin- offers a theoretical explanation for cause
ciples that are reductionist in nature and and change with an argument for an alter-
presuppose that concepts can be mea- native to accepted models of service user
sured, counted, manipulated, and cross- involvement. He argued that because men-
classified), and it provides a philosophical tal health nurses are often the workers who
and methodological foundation for a have the most contact with service users, it
broad set of alternative approaches (see is essential that they give consideration to
Downward et al., 2002; Downward & the philosophies and approaches that
Mearman, 2007; Fleetwood, 1999; underpin these models, which are emanci-
Lawson, 1989, 1997, 1998, 2001). In patory for people who use mental health
this regard, within economics, critical services.
realism supports Lawson’s view that the McEvoy and Richards (2006) justified
exclusive dependence on mathematical/ using a critical realist framework for mixed
statistical modeling in economics is mis- methods in a case study in nursing of how
guided (Castellacci, 2006). and why gatekeeping decisions emerge at
Olsen (2004) illustrated some of the lim- the interface between primary care and
itations of the latter approach in two stud- community mental health teams. The quan-
ies of Indian grain markets and peasant titative survey helped them to identify pat-
farmers, focusing on distress sales in the terns of practice, which were confirmed and
162–––◆–––Conceptual Issues: Philosophical, Theoretical, Sociopolitical
elaborated by the findings from semistruc- analysis (Bollingtoft, 2007), leading to the
tured interviews. Using mixed methods development of a theoretical model that
gave the inquiry a “better sense of balance explained why gatekeeping decisions tended
and perspective” (p. 66). In addition, the to emerge in the way they did.
findings from both approaches stimulated In summary, we believe that realist
retroductive reasoning, a process that perspectives and approaches can make
involves the construction of hypothetical important contributions to mixed methods
models as a way of uncovering the real research. These contributions involve not
structures, contexts, and mechanisms that simply an overall perspective within which
are presumed to produce empirical phe- qualitative and quantitative methods and
nomena (Bhaskar, 1978, 1986, 1989). In assumptions can be better integrated, but
addition, reliance on retroduction necessi- also specific insights and strategies that can
tates that the researcher is being explicit enable mixed methods researchers to better
about what is being done during the understand the contexts and processes they
process, including data collection and study.
1. How does the realist perspective presented in this chapter fit with your own assumptions
about qualitative, quantitative, and mixed methods research? Has the chapter changed your
thinking about any of these? Do you disagree with any of the chapter’s arguments? Why?
2. How could you apply the specific realist approaches described here to an actual study
that you might conduct? What difference would these make in how you design and carry out
the study?
3. How does the perspective on mixed methods research presented in this chapter differ
from that in other chapters of the Handbook? How are these different views helpful to you in
understanding mixed methods research publications or thinking about how to do mixed
methods research?
M. Bergman (Ed.), Advances in mixed meth- Conant, J., & Zeglen, U. M. (2002). Hilary
ods research (pp. 11–21). London: Sage. Putnam: Pragmatism and realism. London:
Bernstein, R. (1992). The new constellation: The Routledge.
ethical-political horizons of modernity- Covaleski, M. A., & Dirsmith, M. W. (1983).
postmodernity. Cambridge MA: MIT Press. Budgets as a means of control and loose
Bhaskar, R. (1978). A realist theory of science coupling. Accounting, Organizations and
(2nd ed.). Brighton, UK: Harvester. Society, 8, 323–340.
Bhaskar, R. (1986). Scientific realism and Covaleski, M. A., & Dirsmith, M. W. (1990).
human emancipation. London: Verso. Dialectical tension, double reflexivity and
Bhaskar, R. (1989). Reclaiming reality: A critical the everyday accounting researcher: on
introduction to contemporary philosophy. using qualitative methods. Accounting,
London: Verso. Organizations and Society, 15, 543–547.
Biesta, G. (2010). Pragmatism and the philo- Denzin, N. K., & Lincoln, Y. S. (2005).
sophical foundations of mixed methods Introduction: The discipline and practice of
research. In A. Tashakkori & C. Teddlie qualitative research. In N. K. Denzin &
(Eds.), SAGE handbook of mixed methods Y. S. Lincoln (Eds.), Handbook of qualita-
in social and behavioral research (2nd ed.). tive research (3rd ed., pp. 1–42). Thousand
Thousand Oaks, CA: Sage. Oaks, CA: Sage.
Bollingtoft, A. (2007). A critical realist approach to Downward, P., Finch, J. H., & Ramsay, J.
quality in observation studies. In H. Neergaard (2002). Critical realism, empirical meth-
& J. P. Ulhoi (Eds.), Handbook of qualita- ods and inference: A critical discussion.
tive research methods in entrepreneurship. Cambridge Journal of Economics, 26,
Northampton MA: Edward Elgar. 481–500.
Brown, R., & Brignall, S. (2007). Reflections on Downward, P., & Mearman, A. (2007).
the use of a dual-methodology research Retroduction as mixed-methods triangula-
design to evaluate accounting and manage- tion in economic research: reorienting eco-
ment practice in UK university central admin- nomics into social science. Cambridge
istrative services, Management Accounting Journal of Economics, 31, 77–99.
Research, 18, 32–48. Ezzy, D. (2002). Qualitative analysis: Practice
Buchler, J. (1940). Introduction. In J. Buchler and innovation. London: Routledge.
(Ed.), The philosophy of Peirce: Selected Fielding, N. (2008). Analytic density, postmod-
writings. New York; Routledge & Kegan ernism, and applied multiple method
Paul. research. In M. Bergman (Ed.), Advances in
Campbell, D. T. (1988). Methodology and epis- mixed methods research (pp. 37–52).
temology for social science: Selected papers London: Sage
(S. Overman, Ed.). Chicago: University of Fleetwood, S. (1999). Critical realism in eco-
Chicago Press. nomics: Development and debate, London:
Castellacci, F. (2006). A critical realist inter- Routledge.
pretation of evolutionary growth theoriz- Geertz, C. (1973). The interpretation of cultures.
ing. Cambridge Journal of Economics, 30, New York: Basic Books.
861–880. Greene, J. (2000). Understanding social pro-
Chambliss, D. (1989). The mundanity of excel- grams through evaluation. In N. K. Denzin
lence: An ethnographic report on stratifica- & Y. S. Lincoln (Eds.), Handbook of qual-
tion and Olympic swimmers. Sociological itative research (2nd ed., pp. 981–1000).
Theory 7, 70–86. Thousand Oaks, CA: Sage.
Clark, A. M., MacIntyre, P. D., & Cruickshank, J. Greene, J. (2007). Mixed methods in social
(2007). A critical realist approach to inquiry. San Francisco: Jossey-Bass.
understanding and evaluating heart health Greene, J., & Hall, J. (2010). Dialectics
programmes. Health, 11(4), 513–539. and pragmatism: Being of consequence.
164–––◆–––Conceptual Issues: Philosophical, Theoretical, Sociopolitical