Professional Documents
Culture Documents
Brown 2010
Brown 2010
1
Address correspondence to Dr. Ted Brown, Associate Professor and Postgraduate Coor-
dinator, Department of Occupational Therapy, School of Primary Health Care, Faculty of
Medicine, Nursing & Health Sciences, Monash University–Peninsula Campus, Building G,
4th Floor, McMahons Road, Frankston, Victoria 3199, Australia or e-mail (ted.brown@med.
monash.edu.au).
2
Participants who volunteered their time to take part in the study are thanked for their valu-
able contribution toward this study. The Walter Cottman Endowment Fund/Equity Trustees,
Limited, and the Peninsula Health Research Development Fund are acknowledged for their
financial contribution in the form of research grants that made the completion of this study
possible.
TABLE 1
Definitions of Motor-Free Visual Perceptual Skills From the
Developmental Test of Visual Perception–Adolescent and Adult,
the Motor-Free Visual Perception Test–Third Edition, and the Test
of Visual Perceptual Skills (non-motor)–Third Edition Instruments
Maino, and Treitman (2000), and Rege and Joshi (2005). The test contains
seven subscales, each with two example and sixteen scored items arranged
in order of increasing difficulty: visual discrimination, visual memory, vi-
sual spatial relationships, visual form constancy, visual sequential memo-
ry, visual figure-ground, and visual closure (see Table 1). The test takes ap-
proximately 30 minutes to administer and requires participants to analyse
112 black-and-white designs and respond appropriately within a multi-
ple-choice format. Participants are required to point to a design they think
is the correct answer. The participant obtains a score of one for each cor-
rect answer and a score of zero for each incorrect answer. Scores are calcu-
lated for each of the seven subscales as well as an overall visual perceptual
ability index. The maximum raw score for each of the seven TVPS–3 sub-
scales is 16. The TVPS–3 manual reported Cronbach’s alpha of .96 for the
overall index and subscale coefficients of .76 for visual discrimination, .76
for visual memory, .87 for visual spatial relationships, .75 for visual form
constancy, .78 for visual sequential memory, .82 for visual figure-ground,
and .82 for visual closure (Martin, 2006). The test-retest correlation coef-
ficient for the overall index was .97, and for specific subscales .63, .82, .75,
.78, .58, .73, and .80, respectively.
Procedures
Potential participants were identified and invited to participate in the
study. After volunteering, the participants were contacted and a time and
place were arranged to administer the three instruments. Tests were ad-
ministered individually by a single trained research assistant, and the or-
der was randomized (as described in Table 2). A 5-min. break was sched-
uled between each of the three perceptual tests.
Test-retest reliability data were gathered from 46 of the 172 partici-
pants without neurological impairment. These 46 participants complet-
ed the three visual perceptual tests upon two separate occasions separat-
ed by a two-week interval. Due to the demanding nature of the retesting
process, participants with neurological impairments were not included as
advised by the two hospital ethics committees. Internal consistency data
were gathered for all participants.
Data Analysis
The Statistical Package for Social Sciences (SPSS) was used. Cron-
bach’s alpha was used to examine the internal consistency of the three vi-
sual perceptual tests and their subscales (�����������������������������
Anastasi & Urbina, 1997; Nor-
����
man & Streiner, 2000). The Spearman’s ρ correlation coefficient was used
for calculating test-retest reliabilties (Streiner & Norman, 1995). The inter-
nal consistencies were interpreted according to Nunnally and Bernstein
RELIABILITY OF THE DTVP–A, MVPT–3, AND TVPS–3 51
(1994); that is, .80 and above was considered high, .50 to .79 was consid-
ered moderate, and .49 and below was considered low.
Results and Discussion
A total of 172 participants without neurological impairment (77 men,
95 women) and 49 participants with neurological impairment (27 men,
22 women) took part in the study. Other demographic data are presented
in Table 2. There was a relatively even distribution of the order the three
tests were completed. The majority of tests were completed in the morn-
ing (59%). On average, it took the participants without neurological im-
pairment 1.5 hr. to complete the three visual perceptual tests, and those
with a neurological impairment 2 hr.
The participant group without neurological impairment achieved
higher subscale and overall scores on all tests than did the group of par-
TABLE 2
Descriptive Information For Participants Without Neurological
Impairment (n = 172) and With Neurological Impairment (n = 49)
Variable Descriptor No Impairment Neurological
Group (n = 172) Impairment Group
(n = 49)
n % n %
Age, yr. 18–25 68 39.53 0 0
26–35 32 18.60 5 10.20
36–45 19 11.05 4 8.16
46–55 32 18.60 7 14.29
56–65 9 5.23 12 24.50
66–75 8 4.65 11 22.45
76–99 4 2.33 10 20.41
Education level Primary school 0 0 10 20.41
High school 40 23.26 25 51.02
TAFE/college 24 13.95 3 6.12
Tertiary–undergraduate 73 42.44 4 8.16
Tertiary–postgraduate 35 20.35 5 10.20
Other 0 0 2 4.08
Geographical Inner city 69 40.12 11 22.45
location Suburban 72 41.86 20 40.82
Rural 31 18.02 18 36.73
Employment status Full-time 82 47.67 12 24.50
Part-time 57 33.14 2 4.08
Not working 9 5.23 3 6.12
Retired 14 8.14 29 59.18
Other 10 5.81 3 6.12
Time of day when Morning (9:00 a.m.–11:59 a.m.) 31 18.02 29 59.18
visual perceptual Early p.m. (12:00 p.m.–2:59 p.m.) 57 33.14 16 32.65
tests were Late p.m. (3:00 p.m.–5:59 p.m.) 41 23.84 4 8.16
completed Evening (6:00 p.m.–8:59 p.m.) 32 18.60 0 0
Other (9:00 p.m.–9:00 a.m.) 11 6.40 0 0
52 T. BROWN, ET AL.
TABLE 4
Internal Consistency of Visual Perceptual Tests
Visual Perceptual Test Cronbach’s Alpha
DTVP–A Total (motor-reduced) Scale .86
Figure-ground .73
Visual closure .74
Form constancy .75
MVPT–3 Total Scale .74
TVPS–3 Total Scale .80
Visual discrimination .76
Visual memory .71
Spatial relationships .76
Form constancy .76
Sequential memory .70
Figure-ground .76
Visual closure .75
Note.—DTVP–A = Developmental Test of Visual Perception–Adolescent and Adult; TVPS–
3 = Test of Visual Perceptual Skills (non-motor)–Third Edition; MVPT–3 = Motor-Free Visual
Perception Test–Third Edition.
er than those reported in the three test manuals and higher than those
reported by Brown, et al. (2008). However, with respect to the internal
consistency results, those of the current study more closely approximated
those reported within the DTVP–A, MVPT–3, and TVPS–3 test manuals
than those reported by Brown, et al. (2008). Indeed, the results of the cur-
rent study, like those reported in each of the three visual perceptual test
manuals, more often than not reflected moderate to high internal consis-
TABLE 5
Test-retest Correlations of Visual Perceptual Tests With 2-wk.
Interval Between First and Second Test Administrations (n = 46)
Visual Perceptual Test Spearman’s ρ 95%CI
DTVP–A Total (motor-reduced) Scale 0.51† .27, .86
Figure-ground 0.56† .26, .84
Visual closure 0.33† .05, .64
Form constancy 1.00† −.29, .29
MVPT–3 Total Scale 0.71† .60, 1.18
TVPS–3 Total Scale 0.72† .69, 1.27
Visual discrimination 0.55† .32, .91
Visual memory 0.44† .18, .77
Spatial relationships 0.20 −.09, .50
Form constancy 0.45† .19, .78
Sequential memory 0.42† .15, .74
Figure-ground 0.53† .30, .88
Visual closure 0.28* −.01, .88
Note.—DTVP–A = Developmental Test of Visual Perception – Adolescent and Adult; TVPS–
3 = Test of Visual Perceptual Skills (non-motor)–Third Edition; MVPT–3 = Motor-Free Visual
Perception Test–Third Edition. *p < .05. †p < .01.
54 T. BROWN, ET AL.
tency for overall test and subscale scores. In contrast, the results of the
study by Brown, et al. (2008), most often reflected low to moderate inter-
nal consistency.
Internal Consistency Analyses
DTVP–A internal consistency.—Similar to the DTVP–A test manual,
Cronbach’s alpha values obtained for each of the DTVP–A subscales were
lower than that for the DTVP–A Motor-Reduced Visual Perception Index.
Comparatively, Brown, et al. (2008) reported internal consistency coeffi-
cients of .49, .34, and .38, respectively, for the subscales, and .60 for the
DTVP–A Motor-Reduced Visual Perception Index. Brown, et al.’s values
(2008) suggest that all DTVP–A motor-reduced scales, with the exception
of the figure-ground subscale, have low internal consistency. Both the cur-
rent study and Reynolds, et al. (2002) involved participants with and with-
out some form of impairment (neurological versus cognitive impairment),
so the disparity observed between these findings and those of Brown, et
al. (2008) might be attributable to the latter study having involved only
“healthy” adults. Differences in sample size, age range, and cultural con-
text may also have affected the results; the current study involved 221
people ages 18 to 99 years, Reynolds, et al. (2002) involved 1,664 people
ages 11 to 75 years, and Brown, et al. (2008) involved 50 people ages 18
to 55 years. Furthermore, whilst Reynolds, et al. (2002) included partici-
pants from varying ethnic backgrounds and geographic locations around
the United States, the current sample and that of Brown, et al. (2008) were
more homogeneous.
MVPT–3 internal consistency.—In the current study, the internal con-
sistency coefficient for the MVPT–3 was significantly lower than those re-
ported in the MVPT–3 test manual for persons older than 11 years of age,
.86 to .90. Brown, et al. (2008) reported Cronbach’s alpha at .69 in a group
of healthy adults. Either sample size, ethnicity, or socioeconomic status
could have affected the reported values. Colarusso and Hammill (2003)
studied 670 participants from a number of different ethnic backgrounds
and geographic locations within the United States; the current sample
(N = 221) and Brown, et al.’s sample (2008; N = 50) were selected from Vic-
toria, Australia. The results from the latter two studies were more similar.
TVPS–3 internal consistency.— The TVPS–3 total scale score provides
a measure of overall visual perceptual (motor-reduced) ability, while its
subscale scores provide independent measures of distinct visual percep-
tual skills. The TVPS–3 total score had a higher internal consistency co-
efficient than its subscales. Interestingly, this trend was also apparent in
both the results reported in the TVPS–3 manual, and those reported by
Brown, et al. (2008). Internal consistency coefficients reported by Martin
(2006) were higher than both those in the current study, and those report-
RELIABILITY OF THE DTVP–A, MVPT–3, AND TVPS–3 55
Brown, et al. (2008) because the sample size, cultural context, and average
test-retest time were more similar, but this expectation was not supported.
Since Reynolds, et al. (2002) did not report the health status of the partici-
pants for test-retest measurements, it is unknown as to whether or not this
sample, like those of both the current study and the study by Brown, et al.
(2008), comprised only persons without neurological impairment.
MVPT–3 test-retest reliability.—In the current study, the test-retest re-
liability (.74) was lower than that reported by Colarusso and Hammill
(2003) in the MVPT–3 test manual for ages 11 to 84+ years (.92), yet is sub-
stantially higher than the .62 reported by Brown, et al. (2008). Indeed, the
test-retest correlation of Colarusso and Hammill (2003) reflects high test-
retest reliability, while those in both the current study and that of Brown,
et al. (2008) were moderate. This finding is interesting given that the aver-
age test-retest time period in the study by Colarusso and Hammill (2003)
was 34 days, whilst the test-retest time periods for the current study (14
days), and Brown, et al. (2008; 16 days) were half as long. Lesser time
frames may reflect practice effects (Greenwood, 2004). The observed rela-
tionship between the test-retest reliability results of the three studies may
also be attributable to the size, age, and health status of the participant
samples employed within each. Indeed, while the current study employed
a comparatively similar number of adult participants (N = 51) as Brown, et
al. (2008) (N = 46), Reynolds, et al. (2002) tested 75. Colarusso and Hammill
(2003) also employed participants who were as young as 11 years of age.
TVPS–3 test-retest reliability.—Test-retest reliability of the TVPS–3 was
statistically significant and positive (.72); test-retest for five of the sub-
scales were much lower but significant, while two others (Spatial relation-
ships and Visual closure) were not significant. Brown, et al. (2008) found
only Visual discrimination, Sequential memory, and Figure-ground had
statistically significant test-retest correlations. Brown, et al. (2008) report-
ed a much lower correlation of .59 for the total scale, as well as lower cor-
relations for each of the seven subscales (.46, .25, .08, .23, .53, .44, and .12,
respectively). In the TVPS–3 test manual, the test-retest correlation for the
total scale score was .97, with the range for subscales .43 to .81 (Martin,
2006). Interestingly, all three studies found the TVPS–3 total scale to pos-
sess higher test-retest reliability than any of its individual subscales. The
TVPS–3 may best serve as a measure of overall visual perceptual ability
as opposed to a measure of individual visual perceptual subskill deficits.
Specifically, the subscale Sequential memory has very low test-retest reli-
ability. However, it is important to note that care should be taken when
comparing the results, since in Brown, et al. (2008) and Martin (2006) the
participants were adults, but the sample reported in the test manual were
children and adolescents ages 6 to 14 years old (Martin, 2006; Brown, et
al., 2008).
RELIABILITY OF THE DTVP–A, MVPT–3, AND TVPS–3 57