Professional Documents
Culture Documents
202
202
KEY WORDS
adolescent psychology
career choice
special education
OBJECTIVE. Fostering career adaptability may improve vocational outcomes for adolescents. This study
examined the responses of adolescents on the Adolescent Role Assessment (ARA) to explore its usefulness as
a measure of career adaptability.
METHOD. The ARA was administered to 101 adolescents 12 to 17 years of age. Descriptive statistics, reliability analysis, and factor analysis were generated from the ARA scores. Dominant narrative themes were coded
into the six domains of the ARA and into the domains identified in the factor analysis.
RESULTS. The internal consistency of the ARA was low with few differences in findings across age. The identified factorsdeveloping aspirations, self-efficacy, interpersonal competencies, and autonomyare consistent with constructs of career adaptability found in the literature and differentiated low and high scorers.
CONCLUSION. Major changes to the ARA content and scaling or development of a new assessment of
career adaptability using the factor structure are recommended for clinical and research applications.
Huebner, R. A., Emery, L. J., & Shordike, A. (2002). The Adolescent Role Assessment: Psychometric properties and theoretical usefulness. American Journal of Occupational Therapy, 56, 202209.
ccupational therapists conceptualize work as contributing to health and wellbeing and believe that the acquisition and sustenance of work skills and work
behaviors is a developmental process that begins in childhood and continues
through adolescence, adulthood, and old age (American Occupational Therapy
Association, 2000, p. 626). Occupational therapy practitioners provide work-related services in many settings, including school-to-work transition programs. To
support intervention and research about practices that help adolescents develop
skills for work, assessments grounded in theory as well as reliable and sensitive to
change are needed.
The Adolescent Role Assessment (ARA; Black, 1976) is a semistructured interview that yields both narrative and quantitative data about worker role development. It was designed to measure the formation of occupational choice on the basis
of the work of Ginzberg (1972), Reilly (1974), and other career development theorists of the time. According to Black (1976), the assessment was formulated on the
premise that the acquisition of skills in the occupational choice process suggests
that deficiencies at an early stage may increase vulnerability at later stages (p. 75).
Black (1976) identified three developmental stages of occupational choice:
childhood play, adolescent socialization, and adulthood work. At the stage of childhood play, occupational choice was thought to emerge through fantasy, games,
interactions with others, role models, and individual interests. During adolescent
socialization, the adolescent explored interests, assumed responsibilities, and developed values and goals through socialization experiences in the family, at school,
and with peers. These experiences were thought to culminate in adolescent occupational choice with positive work attitudes and a plan for entering an occupation.
202
Downloaded From: http://ajot.aota.org/ on 04/19/2016 Terms of Use: http://AOTA.org/terms
work (Brollier, Shepherd, & Markley, 1994). Concepts related to developing career adaptability, such as self-determination and self-evaluation, are emerging as additional best
practices in special education (Brown, Zager, Brown, &
Price, 1998; Halpern, 1994; Morningstar, 1997).
The skills of occupational therapy practitioners complement that of special educators in developing both work
competence and career adaptability among students in the
school system (Shepherd & Inge, 1999) and enhancing
transition of adolescents into adult social roles (Henry &
Coster, 1997). This practice opportunity, in turn, suggests
the need for an instrument to measure career adaptability
and occupational role acquisition that is consistent with
occupational therapy practices. The 21-item ARA may be
the only occupational therapy instrument available to gather this information (Henry, 1998). Despite its potential
value, occupational therapy practitioners rarely use the
ARA (Vause-Earland, 1991). In the only published study
that we found, Black (1982) used the ARA to discriminate
between adolescents hospitalized with psychiatric conditions and peers without disabilities in the community. The
study reported a testretest reliability coefficient of .91.
The purpose of the current study was to investigate the
usefulness of the ARA to provide clinical and research data
about adolescent career adaptability. To achieve this purpose, the psychometric properties of the ARA were examined. Content analysis of the narrative data amplified the
factor structure themes of career adaptability.
Method
Sample
The method for this research was approved by the human
subjects committee at the institution used in the study. A
convenience sample of 101 adolescents between 12 and 17
years of age was recruited by interviewers. The interviewers
were occupational therapy students at a midwestern university enrolled in a course on adolescent assessment and treatment. As part of the course, the students were required to
use the ARA to interview an adolescent who was not a close
relative or any relative with whom they had regular contact.
Measurement
The ARA examines six domains of functioning: childhood
play, adolescent socialization in family, adolescent socialization at school, adolescent socialization with peers, adolescent occupational choice, and adulthood work. Within
each domain are two to six specific items for a total of 21
items. To score each item, two to four structured interview
questions are asked. For example, under the childhood play
domain, scoring of the interests item is based on two ques-
203
Results
Descriptive Results
Of the 121 student interviewers and adolescents invited,
101 adolescents and their parents or guardians consented to
participate in the study. Sample demographics are displayed
in Table 1.
The percentage of adolescents who scored appropriate
(+) for each ARA item is displayed by age in Table 2. The
average percentages of appropriate item scores for the total
sample ranged from a low of 68.3% for time (balancing
time with peers and other obligations), to a high of 95% for
knowledge of the community. The mean total score for the
ARA was 38.04 (SD = 3.74). Because the data were positively skewed, the median of 39.00 was deemed most representative of central tendency.
In examining the usefulness of the ARA, we wanted to
differentiate strengths and weaknesses of adolescents on
career adaptability to identify possible criteria for anchor
Table 1. Sample Characteristics
Characteristic
Data Analysis
Quantitative analysis included generating demographic
statistics and descriptive scores on the ARA by age. A
Cronbachs alpha was calculated for the entire ARA and for
each subscale. To investigate the domains of the ARA, factor
analysis was performed. The factor subscales scores were
used to compare two groups (described later), using analysis
of variance procedures with a Bonferroni correction (Kirk,
1982) of significance level to .01 for four comparisons.
Content analysis of the narrative data occurred in two
stages. In the first stage, a graduate research assistant recorded and tallied all the responses by age and category based on
the 21 items of the ARA. The narrative responses were
reviewed and compared by all three authors to quantify the
descriptions into themes. The authors then collapsed the
responses into age groups of 2 years (i.e., 1213 years
[younger adolescents], 1415 years [middle adolescents],
1617 years [older adolescents]) and compared and contrasted responses within and across each group in each
domain of the ARA.
In the second stage of content analysis, these results
were integrated with the new domains identified in the factor analysis of the ARA. The questions posed in the original
Age (years)
12
13
14
15
16
17
Ethnicity
White
Othera
Missing data
Residence
Rural (< 5,000)
Semirural (5,00010,000)
City (to 59,000)
Urban (> 60,000)
Large urban (> 500,000)
Subdivision in city (> 200,000)
Missing data
Parent marital status
Married and living together
Divorced or separated
Remarried
Single
Other
Attends special education classes
Takes medication for attention or depression
Has a physical illness or disability
Repeated a grade in school
9
25
11
18
20
18
8.9
24.7
10.9
17.8
19.8
17.8
91
3
7
90.1
3.0
6.9
16
27
40
7
1
7
3
15.8
26.7
39.6
6.9
1.0
6.9
3.0
72
11
9
6
3
3
3
4
8
71.3
10.9
8.9
5.9
3.0
3.0
3.0
4.0
7.9
204
Downloaded From: http://ajot.aota.org/ on 04/19/2016 Terms of Use: http://AOTA.org/terms
Table 2. Percentage of Sample Scored as Appropriate (+) for 21 Items on the Adolescent Role Assessment
Age Group
Item
Childhood play (developmental stage 1)a
Activities
Rules (2)b
Interactions (2)
Fantasy (1)
Role models
Interests
Adolescent socialization in family
(developmental stage 2)
Interactions
Responsibility (4)
Economics
Adolescent socialization at school
(developmental stage 2)
Consistency (3)
Responsibility (3)
Feedback (3)
Role models (3)
Activities (2)
Adolescent socialization with peers
(developmental stage 2)
Activities (2)
Time (4)
Community (4)
Adolescent occupational choice
(developmental stage 2)
Work attitudes
Stage of choice (1)
Adulthood work
(developmental stage 3)
Goals (1)
Fantasy (1)
12
13
14
15
16
17
Total
66.7
88.9
77.8
55.6
88.9
55.6
80.0
100.0
96.0
76.0
96.0
84.0
100.0
72.7
100.0
90.9
90.9
54.5
94.4
94.4
94.4
77.8
94.4
94.4
90.0
100.0
90.0
75.0
95.0
90.0
83.3
100.0
94.4
55.6
94.4
88.9
86.1
95.0
93.1
72.3
94.1
82.2
88.9
88.9
66.7
92.0
72.0
100.0
72.7
100.0
63.6
94.4
94.4
100.0
90.0
90.0
100.0
83.3
94.4
94.4
88.1
88.1
92.1
66.7
66.7
77.8
100.0
66.7
92.0
76.0
76.0
92.0
96.0
100.0
63.6
72.7
72.7
90.9
83.3
88.9
66.7
88.9
83.3
85.0
75.0
75.0
85.0
80.0
83.3
55.6
66.7
83.3
94.4
86.1
72.3
72.3
87.1
87.1
77.8
66.7
88.9
96.0
68.0
88.0
90.9
63.6
100.0
88.9
77.8
100.0
90.0
70.0
95.0
94.4
61.1
100.0
91.1
68.3
95.0
66.7
44.4
87.0
80.0
70.0
81.8
66.7
88.9
78.9
65.0
88.9
77.8
78.4
75.2
33.3
55.6
76.0
76.0
100.0
54.5
94.4
88.9
80.0
75.0
88.9
66.7
81.2
72.3
aBlack (1976) conceptualized three developmental stages of occupational choice represented by six domains on the Adolescent Role Assessment. bAfter each
item that loaded above a .40 on the factor analysis, the factor number is included in parentheses.
205
on this factor were scored as appropriate by the interviewers for between 72% and 81% of the sample (see Table 2).
The scores were based on questions about adulthood work
goals and future dreams, specific plans for occupational
choice, and childhood fantasy about growing up. On the
basis of these questions and the narrative responses,
Developing Aspirations was defined by a fundamental
future orientation with an ability to fantasize and dream
and to provide a rationale for career choice.
Total subscale scores were calculated for each factor by
summing ARA scores for the items that loaded above .40 on
the factor. The difference of 2.48 points in total scores for
Developing Aspirations between the low scoring group (M
= 4.80, SD = 2.1) and the high scoring group (M = 7.28, SD
= .99) was significant (F = 59.14, df = 1, p = < .001).
Adolescents in the low scoring group tended to have vague
Table 3. Factor Structure for the Adolescent Role Assessment
Domain and Item
Factor 1: Developing Aspirations
Adulthood workgoals
Occupational choicestage of choice
Adulthood workfantasy
Childhood playfantasy
Occupational choicework attitudes
Childhood playactivities
Factor 2: Developing Interpersonal
Competencies
Childhood playrules
Childhood playinteractions
Socialization peersactivities
Socialization schoolactivities
Socialization familyinteractions
Childhood playinterests
Factor 3: Developing Self-Efficacy
Socialization schoolrole models
Socialization schoolconsistency
Socialization schoolresponsibilities
Socialization schoolfeedback
Childhood playrole model
Factor 4: Developing Autonomy
Socialization peerstime
Socialization familyresponsibilities
Socialization peerscommunity
Socialization familyeconomics
Factors
2
3
.73*
.68*
.58*
.46*
.29
.19
.69*
.65*
.59*
.44*
.32
.26
.57*
.55*
.51*
.46*
.38
.53*
.52*
.47*
.32
*Items loaded above .40 on the factor. All Adolescent Role Assessment
items are displayed with their highest loading on a factor; items loading
below .40 on the factor analysis were not included in subsequent analysis.
206
Downloaded From: http://ajot.aota.org/ on 04/19/2016 Terms of Use: http://AOTA.org/terms
Discussion
The psychometric properties of the ARA suggest that significant revisions of the assessment or a new measure of career
adaptability are necessary for research or clinical application.
The internal consistency coefficient for each subscale and for
the overall ARA was below the alpha of .80, which is a desired
reliability index for a measurement instrument (Pedhazur &
Schmelkin, 1991). Limited internal consistency may be due
to a restricted range of scores as a result of scaling or homogeneous participants, content heterogeneity, or limited test
length. Our findings suggest that all these factors may have
diminished the reliability of the ARA. Although the total
scores ranged from 24 to 42 points, 55% of total scores fell
in the 39-point to 42-point range, restricting the top range of
scores. This restricted range is likely due to the 3-point scale
and participant homogeneity. The results of the factor analysis demonstrate that the item groupings of the ARA diverge
from the domains of the ARA identified in the new factor
structure. Such heterogeneity of items within domains or
subscales will reduce reliability. Additionally, subscales with
fewer items (e.g., occupational choice with two items) tended to have lower reliability coefficients.
The reliability of the ARA might be improved by
expanding the scaling to a 5-point scale to allow for ratings
of performance of well above average to well below average,
thus reducing the ceiling effect seen in this study. An
expanded rating scale might differentiate more accurately
and reliably among homogeneous groups as used here and
would likely be far more reliable when used with heterogeneous groups or when differentiating between groups. The
results of the factor analysis also could be used to improve
the content homogeneity of items and expand the test
length of subscales to improve their reliability.
The consistency across ages in the themes and examples
identified in the narrative responses suggests that the current ARA did not adequately differentiate tasks specific to
ages. The only developmental trend observed was that 12year-olds tended to be scored as having fewer appropriate
responses, especially in childhood play (see Table 2). The
use of introspective language in formulating a cohesive life
narrative emerges during adolescence (Habermas & Bluck,
2000); a new measure might be designed more appropriately for adolescents 13 years of age or older. Nonetheless,
the factor analysis contains insights into adolescent percep-
207
tions and experiences that occupational therapy practitioners could use to provide opportunities for students with disabilities that parallel the experiences of their peers without
disabilities (Brollier et al., 1994; Chandler et al., 1996).
The differences between the high and low scoring
groups on the ARA were most pronounced on measures of
developing aspirations and self-efficacy. Adolescents who
scored low on the ARA tended to have few aspirations, have
vague goals, and be less engaged in school; they also were
more likely to be in special education. These findings are
consistent with those of Farnsworth (2000), who found
that adolescents 13 to 18 years of age on probation were
engaged in passive leisure activities (e.g., watching television) two to three times more often with fewer productive
activities (e.g., school work, school activities) than similarage typical peers. The results of the current study suggest
criteria for anchor points on a new scale that might differentiate students at risk for career challenges.
The factor structure identified in this research is consistent with the existing literature related to career adaptability and may provide a foundation for designing a new
instrument. Savickas (1997) identified playfulness with a
future orientation and active experiences on a variety of jobs
as promoting career adaptability over the life span. These
concepts are consistent with those measured in Developing
Aspirations, a trend toward future planning in all aspects of
transition planning for persons with disabilities (e.g.,
Halpern, 1994; Morningstar, 1997), and concepts of active
engagement in occupation to promote adaptation (Schkade
& Schultz, 1992).
Henry and Coster (1997) highlighted the role of selfefficacy (the belief that one has the capacity to be successful) as influencing effort, persistence, and achievement in
academic, social, and physical spheres. For children and
adolescents with disabilities, the development of self-determination and self-evaluation is thought to be empowering,
to build a sense of self-efficacy, and to improve the quality
of life (Halpern, 1994). An assessment that includes subscales on self-efficacy might facilitate clinical intervention
and research on this important concept.
A need also exists to measure interpersonal competencies and autonomy. Adolescents with disabilities are likely to
have diminished interpersonal competence that inhibits
autonomy (e.g., Wagner et al., 1993), social skill development (Gresham & MacMillan, 1997), and working with
others (Phelps & Hanley-Maxwell, 1997). Autonomy, as
defined by Crittenden (1990) includes the adolescents
decision-making capacities and acceptance of responsibility
(p. 1). Vondracek and Skorikov (1997) found that a range of
activities, including leisure, work, and school, contribute to
both an emerging vocational identity and a self-identity, sug-
gesting the need for occupation-based practice for adolescents with disabilities and measures to guide that practice.
Several practice models illustrate the fit of the factor
structure identified in this study with best practices for
developing career adaptability. Morningstar (1997) recommended that career adaptability be enhanced by providing
opportunities for students with disabilities to develop selfknowledge, to have meaningful work experiences that
include socialization with coworkers, and to dream freely
about their futures. Jackson, Rankin, Siefken, and Clark
(1989) described a career maturation curriculum for occupational therapy that included participating in a social
leisure network, exploring employment options, developing
autonomy in job skills, and establishing linkages with community agencies. In a clinic-based program for children
with arthritis, White and Shear (1992) promoted career
aspirations and planning by asking children at each visit,
What are you going to be when you grow up, and how will
you make it happen?
The results of the present study should be interpreted
cautiously for several reasons. The exploratory factor analysis was based on a relatively small sample size given the 21
items of the ARA. Although student interviewers were
trained in the study procedures, their ratings of adolescent
responses and their interview skills may have introduced an
unknown amount of error, bias, or unreliability. The adolescents in this study were generally homogenous on the
basis of geographical, cultural, and demographic characteristics. Even so, the literature suggests a need for an instrument to measure career adaptability in adolescents with and
without disabilities. The factors identified in this study may
provide directions for new test construction or substantial
revisions of the ARA suitable for occupational therapy practice and research with subsequent psychometric study of a
new measure. s
Acknowledgments
We thank the students at Eastern Kentucky University and
the adolescents and their parents who consented to participate in this study. Kristen Pennington, MS, OTR, assisted
with coding the participant responses. Anne Blakeney,
MSOT, OTR/L, FAOTA, provided well-formulated suggestions to improve the clarity and rigor of this manuscript.
References
American Occupational Therapy Association. (2000).
Occupational therapy services in facilitating work performance (statement). American Journal of Occupational
Therapy, 54, 626628.
208
Downloaded From: http://ajot.aota.org/ on 04/19/2016 Terms of Use: http://AOTA.org/terms
209