Download as pdf or txt
Download as pdf or txt
You are on page 1of 6

Dunn and Dunn Model of

Learning-Style Preferences:
Critique of Lovelace Meta-Analysis
KENNETH A. KAVALE
GRETCHEN B. LEFEVER
Regent University

ABSTRACT The authors critiqued the M. K. Lovelace omission of studies that focused on the specific variables
(2005) meta-analysis of the Dunn and Dunn Model of purportedly investigated, and (c) assumption that specific
Learning-Style Preferences (DDMLSP). The conclusion that terms were defined and treated similarly in the included
Lovelace reported in her meta-analysis that learning-style studies. However, such criticisms are not warranted because
instruction is a beneficial form of instructional delivery is
unjustified because of critical conceptual and practical prob-
they ignore the primary purpose of meta-analysis. As a
lems. Those problems surround interpretation of effect size, research synthesis technique, meta-analysis combines stud-
narrow focus on a single model, missing information, and, ies that may vary across a number of dimensions to achieve
most notably, a sampling bias. Meta-analysis relies on the generalizations across an entire research domain. Although
synthesis of many different types of studies. However, 96% of one may perceive that process as “mixing apples and
studies cited in the Lovelace meta-analysis were dissertations
(70% with authors of the DDMLSP), leading to potential
oranges,” Glass, McGaw, and Smith (1981) commented
“home-team” bias. The proponents of the DDMLSP must that “the claim that only studies which are the same in all
address such concerns before the DDMLSP can be accepted respects can be compared is self-contradictory; there is no
by the education community. need to compare them since they would obviously have the
same findings within statistical error” (pp. 22–23).
Keywords: Dunn and Dunn Model of Learning-Style Prefer- The Dunn et al. (1995) and Lovelace (2005) meta-
ences, learning-style instruction, Lovelace meta-analysis
analyses did not synthesize different studies (i.e., studies
investigating models other than the DDMLSP). That prob-
lem, along with other difficulties, raises questions about the

I
positive conclusions offered in the two meta-analyses. Our
n a meta-analysis investigating the Dunn and Dunn purpose was to elucidate the problems and demonstrate
Model of Learning-Style Preferences (DDMLSP), Dunn, that the recent Lovelace meta-analysis does not offer fur-
Griggs, Olson, Beasley, and Gorman (1995) concluded ther validation of the DDMLSP.
that “providing educational interventions that are compat-
ible with students’ learning-style preferences is beneficial”
(p. 357). Ten years later, in a similar meta-analysis, Lovelace The Lovelace Meta-Analysis
(2005) affirmed the Dunn et al. findings: “The results from In her meta-analysis, Lovelace (2005) investigated “the
the current and previous meta-analyses were consistent and overall effectiveness of the model and [examined] moderat-
robust. . . . I strongly suggest that learning-style responsive ing variables that might affect outcomes resulting from use
instruction would increase the achievement of and improve of the model” (p. 178). On the basis of 76 “original research
the attitudes toward learning” (p. 181). investigations” (p. 179) and 168 effect sizes, Lovelace found
The positive conclusions about the importance of learn- a weighted d of .67 for achievement and a weighted d of .80
ing-styles instruction stand in contrast to an earlier meta- for improved attitude toward learning. Her interpretation
analysis by Kavale and Forness (1987) who found little of effect-size (ES) magnitudes was that they demonstrated
empirical support for learning-style instruction and con- that “The data overwhelmingly supported the position that
cluded that “learning appears to be really a matter of matching students’ learning style preferences with comple-
substance over style” (p. 238). Dunn et al. (1995; see also mentary instruction improved academic achievement and
Dunn, 1990) contended that the Kavale and Forness (1987)
meta-analysis was flawed because of a number of limita-
Address correspondence to Kenneth A. Kavale, School of Educa-
tions, including the (a) addition of studies from diverse tion, Regent University, 1000 University Drive, Virginia Beach, VA
models in which researchers used different populations and 23464. (E-mail: kkavale@regent.edu)
identification assessments than used in the DDMLSP, (b) Copyright © 2007 Heldref Publications
94
November/December 2007 [Vol. 101(No. 2)] 95

student attitudes toward learning” (p. 181). Although the Dunn and Dunn model fare in the context of instructional
Lovelace meta-analysis is well done and possesses no major effectiveness? When compared with other instructional
methodological difficulties, several conceptual and practi- practices, the DDMLSP reveals more modest efficacy.
cal problems significantly limit findings. Consequently, we For example, Kavale (2007) showed that practices like
do not believe that the Lovelace meta-analysis provides providing reinforcement (ES = 1.17), drill and practice
the intended level of support for the DDMLSP. Instead, (ES = .99), and providing feedback (ES = .97) reveal very
caution is necessary before one can accept the optimistic positive outcomes and are easier to implement than are the
picture about the nature of the DDMLSP. machinations required for assessing and matching instruc-
tion to preferred learning style. In addition, instruction
Conceptual and Practical Problems methods designed to enhance academic performance reveal
larger effects than learning-style instruction. Mnemonic
Status of the Dunn and Dunn Model of Learning-Style instruction (ES = 1.62), strategy instruction (ES = .98),
Preferences and direct instruction (ES = .93) are superior to learn-
ing-style instruction and focus immediately on teaching
Although well known and widely used, the DDMLSP content (i.e., substance). The prerequisite work required
is not the only available learning-style model. Far greater to implement the DDMLSP “will serve only to deflect
insight into the efficacy of instruction based on learning- attention away from the primary requirement for learning-
style might have been achieved if DDMLSP researchers substance” (Kavale & Forness, 1990, p. 360).
compared and contrasted the DDMLSP with other mod-
els offering divergent interpretations of the learning-style Missing Information
construct. Meta-analysis, with its comprehensive search
perspective (i.e., seeking all available empirical research) Lovelace (2005) provided a number of different inter-
offers the possibility of simultaneously investigating the pretations for the obtained ES that were useful in under-
efficacy of different learning-style models. The focus on a standing the findings. Like the Dunn et al. (1995) report,
single model in the Lovelace (2005) meta-analysis provides however, Lovelace did not report measures of variability
no context for evaluating alternative models. For example, associated with the mean values, which is a significant
would another learning-style model produce larger effect limitation.
sizes than the Dunn and Dunn model? The mean as a measure of central tendency targets the
Using Cohen’s (1988) criteria, Lovelace (2005) sug- center of a distribution but does not describe the extent
gested that the obtained ES values for achievement were to which contributing individual scores differ. Most meta-
moderate to large and that “learning-style instruction analyses, when reporting mean values, also report an asso-
might be expected to increase student achievement by ciated standard deviation (SD) that indicates the amount
25 to 30 percentile points” (p. 179). A simple “statisti- of dispersion around the mean. That statistic is important
cal” interpretation lacks a context of comparative value. because distributions may possess equal mean values but
Consequently, without comparisons to other learning-style possess significantly different shapes because of more-or-
models, it is difficult for one to judge the real importance less associated variability. When variability is comparative-
of the Lovelace findings. ly small, the contributing scores cluster around the mean,
allowing for the possibility of greater confidence about the
Meaning of ES stability of the mean value.
The lack of a reported measure of variability in the
In contrast to the moderate-to-large ES reported by Lovelace (2005) meta-analysis limits interpretation of the
Lovelace (2005), Kavale and Forness (1987) found a small mean value (see Hunter & Schmidt, 2004). Kavale and
ES (.14) across 30 studies investigating different interpreta- Forness (1990) showed that many educational interven-
tions of learning-style instruction, including the DDMLSP. tions reveal more variability than effectiveness (i.e., the
Kavale and Forness (1990) placed learning-style instruc- SD is larger than the ES). For example, Kavale and Forness
tion in the context of process training and found that it (1987) found an ES of .14 and SD of .28, indicating that
fell between perceptual-motor training (ES = .08) and learning-style instruction is twice as variable as it is effec-
social skills training (ES = .20). Any form of process tive. If the two statistics are used to represent a theoretical
training (e.g., learning-style instruction) may reveal lim- expectation (ES ± SD) about where a particular effect may
ited efficacy because of the inherent difficulties in dealing fall, then learning-style instruction may vary from negative
with hypothetical (unobservable) constructs that make to zero to positive (.14 ± .28). Theoretically, learning-
the conceptual foundation for learning-style instruction style instruction can be moderately effective (.42), very
enormously complex and not easily defined (see Cronbach ineffective (–.14; i.e., students not receiving learning-style
& Snow, 1977). instruction perform better), or something in between. The
Although one may argue that the DDMLSP represents positive skewness of achievement distribution suggests that
a special case of effective process training, how does the the ES cluster at the low end and “tail off” at the high
96 The Journal of Educational Research

end (see Lovelace, p. 179). Without a measure of vari- University, which again increases the potential for “home-
ability, one cannot place the mean in context, suggesting team” bias. Thus, questions about potential bias and reli-
that Lovelace’s interpretation of the mean ES cannot be ability of findings are equally applicable for the Lovelace
unequivocally accepted. meta-analysis.
The sampling timeframe for the Lovelace (2005) meta-
Sampling analysis raises questions about the extent to which it pro-
vides new evidence of validity for the DDMLSP. Lovelace
Locating research studies is a critical aspect of meta- searched the literature from 1980–2000 and found 76
analysis: “How one searches determines what one finds; studies that met the stipulated inclusion criteria. Of those
and what one finds is the basis of the conclusions of one’s studies, however, 36 were used previously in the Dunn et
integration of studies” (Glass et al., 1981, p. 61). Simul- al. (1995) meta-analysis, whose sampling timeframe was
taneously, “Locating studies is the stage at which the 1980–1990. Thus, Lovelace’s (2005) literature base includ-
most serious form of bias enters a meta-analysis since it is ed only 53% of “new” studies (n = 40), which suggests
difficult to assess the impact of a potential bias” (p. 57). some limits on interpretation. Given the 47% overlap in
Bias can be avoided with a comprehensive description the literature base, it is not surprising (but relatively unin-
of search procedures that permits an “assessment of the formative) that Lovelace found, “The effect-size values and
representativeness and completeness of the data base for a general findings were similar in both the previous and the
meta-analysis” (p. 57). In addition, the goal of the litera- current meta-analyses” (p. 180).
ture search should be the inclusion of every available study If Lovelace (2005) had limited the search to the years
because it “avoids the dilemma of choosing among studies 1990–2000, researchers could have compared and con-
and justifying why only some are included. It eliminates trasted findings from one time period (1980–1990) with
debates about which studies are worthy of inclusion” (Light another time period (1990–2000) and achieved greater
& Pillemer, 1984, p. 32). insight into the theoretical status of the DDMLSP. With
Kavale, Hirshoren, and Forness (1998) criticized the almost one half of the findings already known, determining
earlier Dunn et al. (1995) meta-analysis for its potentially the extent to which the Lovelace meta-analysis provided
biased sampling: “The Dunn et al. meta-analysis seems to enhanced understanding of the DDMLSP is difficult.
have a dearth of published literature [i.e., peer-reviewed The completeness of the Lovelace (2005) literature
journal articles] because 35 of the 36 studies included search is also open to question. A review of one of her
were dissertations. When 97% of included studies are dis- major sources (“Research based on the Dunn and Dunn
sertations, can we assume that a comprehensive literature model”) reveals that Lovelace included a dissertation from
search was achieved?” (p. 76). Without the level of scrutiny St. John’s University by Ciarletta (1998) titled, “Effects
offered by the peer-review process for most journal articles, on first- and second-graders’ achievement and attitudes
it is not possible for one to have confidence in the reli- through a learning-style and multicultural literature-based
ability of findings from dissertations. Regardless of whether approach” but did not include the next citation that was
the DDMLSP “has been developed, researched, and refined a dissertation from St. John’s University by Cirelli (1998)
during the past three decades by at least 18 professors and titled, “An experimental investigation of the effects of
more than 200 graduate students at St. John’s University, learning-style perceptual strengths and instructional strate-
New York” (Kritsonis, 1997–1998, p. 2), the possibility of gies on special education and general education interme-
bias exists when conducted under the direction of those diate students’ achievement and attitudes.” The Cirelli
who developed the learning-style model (see Curry, 1990). dissertation appears to meet Lovelace’s inclusion criteria
The bias becomes more probable “when it is realized that and seems as appropriate as the Ciarletta dissertation, so it
21 (58%) of the 36 studies included were completed at seems reasonable for one to ask why it was not included.
St. John’s University, where Dunn heads the Center for The sampling timeframe, however, had little influence
the Study of Learning and Teaching Styles. Some tangible on the fact that dissertations predominated the Lovelace
proof that no bias exists is absolutely necessary under such (1995) meta-analysis. Finding a predominance of unpub-
circumstances” (Kavale et al., 1998, p. 77). lished literature does not make for a better literature base
The Lovelace (2005) meta-analysis also appears to pos- because it has not undergone the rigors of the peer-review
sess a dearth of published literature. Although Lovelace process before reaching the professional community. If
“conducted a comprehensive literature search to locate not published, dissertations do not receive a second level
published and unpublished experimental research inves- of scrutiny (i.e., independent reviewers), which ensures
tigations” (p. 178), 96% (n = 73) of the included studies greater confidence about the validity and trustworthiness
were dissertations (i.e., unpublished literature). Only three of findings.
items (i.e., two journal articles and one book chapter that Why is relatively little published research available
may or may not have been peer reviewed) represented the that investigates the DDMLSP? Several explanations
published literature on the DDMLSP. Also, 70% (n = 51) are possible. One possibility is that students have little
of the included dissertations were completed at St. John’s desire to craft journal pieces. A second possibility, more
November/December 2007 [Vol. 101(No. 2)] 97

distressing, is that journal articles are submitted for pub- REFERENCES


lication but rejected after peer review. A third possibility Ciarletta, M. (1998). Effects on first- and second-graders’ achievement
is that beyond the faculty and students at the St. John’s and attitudes through a learning-style and multicultural literature-based
University Center for the Study of Learning and Teaching approach. (Doctoral dissertation, St. John’s University). Dissertation
Abstracts International, 59(08), 2824A.
Styles, there is little interest in the DDMLSP in the wider Cirelli, M. E. (1998). An experimental investigation of the effects of learning-
educational research community. Whatever the reason, it style perceptual strengths and instructional strategies on special education and
is incumbent on Lovelace (2005) to explain why disserta- general education intermediate students’ achievement and attitudes (Doc-
toral dissertation, St. John’s University). (Pending).
tions (and particularly St. John’s dissertations) dominated Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd
the literature base. ed.). Hillsdale, NJ: Erlbaum.
Cronbach, L. J., & Snow, R. E. (1977). Aptitudes and instructional methods:
A handbook on research on interactions. New York: Irvington.
Conclusion Curry, L. (1990). A critique of the research on learning styles. Educational
Leadership, 49, 50–52, 54–56.
The Lovelace (2005) meta-analysis represents a con- Dunn, R. (1990). Bias over substance: A critical analysis of Kavale and
Forness’ report on modality-based instruction. Exceptional Children, 56,
tinuing effort to validate the DDMLSP. Like its predeces- 352–356.
sor, the Dunn et al. (1995) meta-analysis, the Lovelace Dunn, R., Griggs, S. A., Olson, J., Beasley, M., & Gorman, B. S. (1995). A
synthesis possesses a number of significant problems that meta-analytic validation of the Dunn and Dunn model of learning-style
preferences. The Journal of Educational Research, 88, 353–362.
limit confidence in the findings. The problems surround Glass, G. V., McGaw, B., & Smith, M. L. (1981). Meta-analysis in social
interpretation of effect size, narrow focus on a single model, research. Beverly Hills, CA: Sage.
missing information, and, most notably, the nature of the Hunter, J. E., & Schmidt, F.L. (2004). Methods of meta-analysis: Correcting
error and bias in research findings (2nd ed). Thousand Oaks, CA: Sage.
literature base. Kavale, K. A. (2007). Quantitative research synthesis: Meta-analysis of
None of the problems of the Lovelace synthesis are research on meeting special educational needs. In L. Florian (Ed.), The
new; an earlier critique by Kavale et al. (1998) raised Sage handbook of special education. London: Sage.
Kavale, K. A., & Forness, S. R. (1987). Substance over style: Assessing
similar issues about the Dunn et al. (1995) meta-analysis. the efficacy of modality testing and teaching. Exceptional Children, 54,
Yet, Lovelace did not address the fundamental difficulties, 228–239.
and consequently, the findings must again be called into Kavale, K. A., & Forness, S. R. (1990). Substance over style: A rejoinder
to Dunn’s animad versions. Exceptional Children, 56, 357–361.
question. Kavale, K. A., Hirshoren, A., & Forness, S. R. (1998). Meta-analytic
Although the Lovelace (2005) meta-analysis shows sev- validation of the Dunn and Dunn model of learning-style preferences:
eral technical advances (e.g., different interpretations of A critique of what was Dunn. Learning Disabilities Research and Practice,
13, 75–80.
the ES statistic), the failure to address previous concerns Kritsonis, W. (1997–1998). National learning-styles studies impact classroom
means that the Dunn and Dunn model has not yet been pedagogy. National Forum of Applied Educational Research Journal, 11, 1–3.
validated. Some answers to the questions raised in this Light, R. J., & Pillemer, D. B. (1984). Summing up: The science of viewing
research. Cambridge, MA: Harvard University Press.
article are necessary before the DDMLSP can be accepted Lovelace, M. K. (2005). Meta-analysis of experimental research based on the
by the educational community. Dunn and Dunn model. The Journal of Educational Research, 98, 176–183.
����������������������������������� ����������������������

����������������������������������� ���������������
��������������� � � �� �� �� �� �� �

� ������������������
����������
�������������� � ����� ����

�����������������
��������������������������������������������������� � ����� ����
������������

��������������������������������������������������� � �� �

��������������� � ���� ���


����������������������������������������
���������������������������������������������������

� �� �
��������������������������
��������������������������������������������������� � ����� ����

����������� � ��� �
���������������������������������������������������

� �� �

� �� �
����������������������������������������� ���������������������������������������������������
� �� �

� ��� �

� ����� ����

� ���� ���

� ����� ����

� ��� ���


������������

������������������

You might also like