Professional Documents
Culture Documents
Correlations of Mental Tests With Each Other and With Cognitive Variables Are Highest For Low IQ Groups-Detterman1989
Correlations of Mental Tests With Each Other and With Cognitive Variables Are Highest For Low IQ Groups-Detterman1989
MARK H. DANIEL
The Psychological Corporation
Two studies showed an inverse relationship between ability level and correlations among
IQ measures. Low IQ subjects showed much higher correlations than high 1Q subjects.
Intercorrelatio||s of IQ subtests, correlations of cognitive ability measures with each other,
and correlations of IQ with measures of cognitive abilities all displayed the same effect. In
the fast study, data from two experiments in which subjects took a battery of basic
cognitive tasks and a standard IQ test were analyzed. Measures from the basic tasks
correlated more highly in the low IQ group than in the high IQ group. In the second study,
data from the WAIS-R and WlSC-R standardization samples were divided into five ability
groups. Average correlations among subtests were computed for each ability group. For
both the WAIS-R and WISC-R, average subtest correlations were highest in the low
ability group. Correlations declined systematically with increasing IQ. In both studies,
correlations were found to be two times higher in low IQ groups than in high IQ groups.
Philip Vernon served as action editor for this manuscript. The WISC-R and WAIS-R analyses
were conducted on the standardization data for those tests with the permission of The Psychological
Corporation and were carried out partly by The Psychological Corporation. Parts of this work were
supported by Grants NO. HD07176 and HD15516 from the National Institute of Child Health and
Human Development, Office of Mental Retardation, the Air Force Office of Scientific Research, and
the Brooks Air Force Base Human Resources Laboratory, Project Lamp.
Correspondence and requests for reprints may be sent to D.K. Detterman, Department of Psy-
chology, Case Western Reserve University, Cleveland, OH 44106.
349
350 DETTERMANAND DANIEL
tion among mental tests would be about the same in a group of low IQ subjects as
it would be in a group of high IQ subjects. (Both groups must represent similar
ranges of ability and, so, have equal standard deviations, or differences in cor-
relations could be due to restriction of range.)
Data are reported that show the uniform distribution assumption is incorrect.
The correlations among the WAIS-R and WISC-R subtests and the correlation of
basic cognitive measures with standardized tests of intelligence and with each
other were analyzed. The data to be reported show correlations among mental
tests are higher for low IQ subjects than for high IQ subjects. This relation was
first found (Study 1) for the correlation of measures from basic cognitive tasks
with intelligence test scores and with each other. It was later confirmed (Study 2)
for subtests of the WAIS-R and WISC-R using the national standardization
samples for those tests.
STUDY 1
The data used in this study came from preliminary reports-of two experiments by
Detterman, Caruso, Mayer, Legree, and Conners (1983) and Detterman (1986).
The first experiment (MR/College) used an extreme groups design comparing
mentally retarded persons with college students. The second experiment (High
School) employed a randomly selected sample of high school students. In both
experiments, subjects were given a set of computer-administered, basic cognitive
tasks and a standardized IQ test.
Method
Subjects. The MR/College experiment compared 20 young adult mentally
retarded persons (M IQ = 67.5, SD = 7.56) with 20 college students (M IQ =
115.5, SD = 7.79). The High School experiment included 141 randomly se-
lected high school students (M IQ = 108.0, SD = 18.3). A low IQ group (M IQ
= 93.0, SD = 12.3) consisted of the 68 subjects below the mean of the entire
group. A high IQ group (M IQ = 122.0, SD = 9.9) consisted of 73 subjects
above the mean.
Tests. All subjects in both experiments were given the WAIS-R. They also
took a set of computer-administered basic cognitive tasks. In the MR/College
experiment, the battery consisted of 9 tests, one each for learning, relearning,
probe memory, Sternberg memory search, match-to-sample, tachistoscopic iden-
tification, tachistoscopic recognition, strategy development, and choice reaction
time. The High School experiment included variants of these tasks and a recogni-
tion memory task for a total of 10 tasks. All tasks were administered by computer
and all responses were made on a touch screen fitted to the computer monitor. All
the tasks used the same stimuli. Each task yielded several measures based on
latency or errors.
IQ CORRELATIONS 351
All measures had been extensively pretested and were known to have good
reliabilities (average split-half reliability = .79). For the MR/College experi-
ment, 31 measures from the basic tasks and full scale WAIS-R IQ scores were
available. For the High School experiment, 36 measures were chosen as best
representing all the measures obtained from all the basic cognitive tests. WAIS-R
full scale IQ scores were also included.
TABLE 1
The Average Correlation of Basic Cognitive Task Measures
with IQ Scores on the WAIS-R and with Each Other (Cognitive)
STUDY 2
If correlations between cognitive tasks and IQ scores are higher in low IQ
groups, then more complex mental tests should also intercorrelate more highly in
low IQ samples. To test this possibility, the standardization samples for the
WAIS-R and WISC-R were divided into subgroups and analyzed in the same way
as in Study 1.
IQ CORRELATIONS 353
Method
Standardization Samples. The WAIS-R and WISC-R standardization samples
consisted of 1,880 and 2,200 subjects, respectively. For both tests, scores stan-
dardized within age for each subtest were used to remove age variance. All 11
subtests for the WAIS-R and all 12 subtests for the WISC-R were used for
analysis. Full Scale IQ was also included for both tests.
Sample Subdivision. Each standardization sample was divided into five sepa-
rate ability groups by standard scores on one of the subtests. This was done using
the Information and Vocabulary subtests for both the WAIS-R and WISC-R.
These two subtests were selected because of their high correlation with Full Scale
IQ and because they are stable across age. The standard score range (and its IQ
equivalent) and number of cases for each subgroup is shown in Table 2 (p. 354).
TABLE 2
Number of Subjects in WAIS-R and WISC-R Subgroups Formed
by Selection on Vocabulary (Voc) and Information (Inf)
WAIS-R WISC-R
Group Range IQ Equiv. Voc Inf Voc lnf
have been obtained from the entire population if the ability subgroup was typical
of all the population.
Figure 1 shows the average correlation at each ability level. Choosing ability
subgroups by Vocabulary subtest scores is nearly identical to results when groups
are formed using Information subtest scores. The inclusion of Full Scale IQ in
these calculations has very little effect. Omission of Full Scale IQ reduced none
of the average correlations more than .04.
The most obvious and striking trend apparent in Figure 1 is that low ability
groups demonstrate correlations which are two times larger than high ability
groups. This trend is apparent in both the WAIS-R and WISC-R standardization
samples though the trend is more pronounced in the WAIS-R data. It is also
apparent that there is a systematic trend for successively lower ability levels to
show successively higher correlations.
Each point in Figure 1 is based on 78 averaged correlations for the WISC-R
and 66 averaged correlations for the WAIS-R (representing the upper triangular
portion of the matrix). Statistical analyses on these data using the same pro-
cedures as in Study 1 showed that the graphical trends were highly statistically
significant. Each correlation in a matrix was compared with the corresponding
correlation in every other matrix for each subgroup of that test and selection
method. For example, the correlations in the matrix for Group 1 of the WAIS-R
selected on Vocabulary were compared with the corresponding correlations for
all other subgroups of the WAIS-R selected on Vocabulary. As before, the cor-
relations were tested using Fisher's z and the number of statistically significant
differences was compared to differences expected by chance using ×2. This
resulted in a total of 40 ×2 statistics, 10 for each test and subtest selection
combination. Of these comparisons, only 4 ×2 values were not statistically
significant. Three of these were in comparisons among subgroups of the WISC-R
with selection by Vocabulary: Group 4 was not less than Group 3; Group 5 was
not less than Group 4; and Group 5 was not less than Group 2. The only other ×2
IQ CORRELATIONS 355
0.9 0.9
i Information Vocabulary
0.8 0.8
m
0.7 0.7
,~ 0.6 0.6
"5
._~ 0.5 "'" "'n. 0.5
~ 0.4 0.4
~ 0.3 0.3
0.2 0.2
0.1 0.1
0
<78 78-92 93-107 108-122 >122 <:78 78-92 93-107 108-122 >122
IQ Equivalent IQ Equivalent
FIG. 1. Average correlation among WAIS-R and WISC-R subtests within ability level group when
groups are selected by Vocabulary or Information subtests corrected for restriction of range.
which was not statistically significant was the comparison between Group 5 and
Group 4 on the WAIS-R with selection by Information. Figure 1 shows that all
these differences are consistent with slight deviations of a few data points from
the general trend.
For the remaining 36 comparisons between groups, the ×2 values were very
large, mostly larger than 100. An idea of the size of this effect can be had from
the number of statistically significant differences between correlations of the
lower and higher groups. The following percentage of Fisher's z comparisons
were statistically significant in the right direction: WAIS-R--Vocabulary,
78%;--Information, 72%; WISC-R--Vocabulary, 40%; Information-68%. Re-
member that this is a conservative test because a two-tailed test was used to test a
one-tailed hypothesis. Even so, the results obviously show that there is a system-
atic trend for the correlations among tests to be higher at lower ability levels.
LISREL offers another method of testing whether correlations are different
across ability level. Following the method suggested in the LISREL manual
(Joreskog & Sorbom, 1986), all five correlation matrices, uncorrected for re-
striction of range, were simultaneously compared to determine if they were
equal. This analysis was repeated for each test and for each method of selection.
LISREL gives a X2 showing the degree of fit to the hypothesis or model which
was that all five matrices were equal. The results showed that the matrices could
not be regarded as equal for any of the tests or methods of selection. For WAIS-R
selected by Vocabulary, ×2(312) = 743.95, p < .001, and selected by Informa-
tion, ×2(312) = 1015.42, p < .001. For WISC-R selected by Vocabulary,
356 DETTERMAN AND DANIEL
DISCUSSION
The general finding from both studies is that mental tests, including mental tests
measuring basic cognitive ability, have higher intercorrelations in lower ability
groups than in higher ability groups. The data analyzed showed three separate
findings. First, cognitive tasks correlate more highly among themselves at lower
ability levels than at higher ability levels. Second, cognitive tasks correlate more
highly with IQ at lower ability levels than at higher ability levels. Third, subtests
of IQ tests intercorrelate more highly at lower ability levels than at higher ability
levels. The findings from the two studies are consistent and systematic.
IQ CORRELATIONS 357
There can be little doubt of the reliability of this finding. However, further
research will be required to determine if this same relationship can be found for
other tests than those used here. Given the regularity and systematic nature of the
findings for the tests analyzed here, it would be surprising if it were not a
replicable finding with other data sets.
Considering the consistency of these results, it seems surprising that they have
not been reported before. Anastasi (1970) reviewed the literature on variables
affecting psychological trait formation. She found a few studies which reported
incidentally differences in average correlations across ability groups. It seems
that the full importance of the finding was not understood or appreciated since
none of the studies were followed up.
The most similar finding to the one reported here was in a study by Maxwell
(1972). As a part of a statistical exercise, he discovered accidently that two
groups of children divided by their scores on a reading test showed different
correlations among the subtests of the WPPSI. Correlations among subtests were
higher for the group that had low reading test scores. Maxwell proposed two ad
hoc explanations of the effect based on Thomson's sampling or bond theory.
Unfortunately, Maxwell seems not to have attempted to determine if the dif-
ferences in subtest correlations he found between high and low reading ability
subjects extended beyond the sample he analyzed. Maxwell thought the reading
test was the important variable in forming groups. Even so, it is very likely that
division by the subtests of the WPPSI would give the same results and so validate
the findings from this study.
If the finding that correlations between mental tests vary systematically by
level of ability is found to be a general one, not specific to certain tests, then the
implications of this finding are substantial. It suggests that much of what we
know about IQ would have to be reconsidered in light of this finding. Without
further verification and replication of this phenomenon, extensive theoretical
speculation is premature,. Nevertheless, there are some obvious implications.
For example, Sternberg and Salter (1982) have discussed what they call the
.30 barrier, meaning that correlations between basic cognitive tasks and IQ have
often been under .30. The reason for this is probably that most researchers
investigating the relationship between cognitive abilities and IQ do not include
low IQ subjects in their samples. Table 1 shows what happens when only high IQ
subjects are used. Average correlations between cognitive tasks and IQ remain
below .30. But if the same correlations are computed for low IQ subjects, they
are about twice as large. Studies of individual differences in cognition that have
not included a proportional representation of low IQ subjects will be very hard to
interpret. Studies done with college students alone or with other highly selected
subject groups will not be generalizable to the full spectrum of intellectual
ability. Much of experimental psychology assumes that college students repre-
sent the mental structures of all people. These results would suggest that such an
assumption may not be warranted.
358 DETTERMAN AND DANIEL
Higher correlations among low IQ subjects may also explain why IQ tests
seem to find more uses at the low end of the IQ scale than at the high end. The
WlSC-R and WAIS-R, and perhaps other tests, will be more 'g'-loaded at the
low end of the distribution that at the high end. That is, a general factor should
account for more of the total variation among low ability subjects than it does
among high. Conversely, high ability subjects will show more subtest scatter.
The interpretation of many previous findings may be altered significantly if IQ
tests have different correlations at different ability levels. For example, to what
extent will the interpretation of heritability estimates be affected by this finding?
Are heritabilities higher or lower for low IQ subjects? Can subtest scatter be a
valid clinical tool for high IQ subjects even if it could be expected to be less
useful at low IQ levels? Should different kinds of testing be done for low IQ
subjects than is done for high IQ subjects? Can one factor analytic model ade-
quately represent high and low ability subjects simultaneously? (It is possible
that average correlations can change across ability level but that factor structure
could remain unchanged.)
Finally, what causes these differences in correlation at different ability levels
may be the most interesting of all the questions presented by these findings.
Although it is not the aim of this paper to consider fully potential explanations,
one possibility is suggested by a theory of mental retardation presented by
Detterman (1987). Briefly, he suggested that intelligence is a system made up of
a small number of independent processes. Mental retardation is caused by defi-
cits in central processes, meaning processes which most heavily affect all other
processes in the system. If these central processes are deficient, they limit the
efficiency of all other processes in the system. Because of the deficit in the
central process, the entire system is brought to a uniform low level of operation.
So all processes in subjects with deficits tend to operate at the same uniform
level. However, subjects without deficits show much more variability across
processes because they do not have deficits in important central processes. This
causes high correlations among mental measures in low IQ subjects and low
correlations in high IQ subjects.
REFERENCES
Anastasi, A. (1970). On the formationof psychologicaltraits. American Psychologist, 25, 899-910.
Detterman, D.K. (1986, November).Basic cognitive processes predict IQ. Paper presented at the
PsychonomicSociety,New Orleans, LA.
Detterman, D.K. (1987). Theoreticalnotionsof intelligenceand mental retardation.American Jour-
nal of Mental Deficiency, 92, 2-11.
Detterman, D.K., Caruso, D.R., Mayer, J.D., Legree, P.J., & Conners, F.A. (1983, March).
Assessing cognitive deficits in the mentally retarded: Findings from overall analyses of tasks.
Paper presented at the GatlinburgConferenceon Mental Retardation,Gatlinburg, TN.
Gulliksen, H. (1950). Theory of mental tests. New York: Wiley
Joreskog, K.G., & Sorbom, D. (1986). LISP,EL VI. Mooresville,IN: ScientificSoftwareInc.
IQ CORRELATIONS 359
Kaiser, H.F. (1968). A measure of the average intercorrelation. Educational and Psychological
Measurement, 28, 245-257.
Maxwell, A.E. (1972). The WPPSI: A marked discrepancy in the correlations of the subtests for
good and poor readers. The British Journal of Mathematical and Statistical Psychology, 25,
283-291.
Spearman, C.E. (1904). "General intelligence" objectively determined and measured. American
Journal of Psychology, 15, 201-293.
Steinberg, R.J., & Salter, W. (1982). Conceptions of intelligence. In R.J. Steinberg (Ed.), Handbook
of human intelligence (pp. 3-28). New York: Cambridge University Press.