Autotelic Personality Questionnaire

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 15

Journal of Personality Assessment

ISSN: 0022-3891 (Print) 1532-7752 (Online) Journal homepage: http://www.tandfonline.com/loi/hjpa20

The Development and Validation of the Autotelic


Personality Questionnaire

Dwight C. K. Tse, Vienne Wing-yan Lau, Rachael Perlman & Michael


McLaughlin

To cite this article: Dwight C. K. Tse, Vienne Wing-yan Lau, Rachael Perlman & Michael
McLaughlin (2018): The Development and Validation of the Autotelic Personality Questionnaire,
Journal of Personality Assessment, DOI: 10.1080/00223891.2018.1491855

To link to this article: https://doi.org/10.1080/00223891.2018.1491855

View supplementary material

Published online: 05 Sep 2018.

Submit your article to this journal

Article views: 51

View Crossmark data

Full Terms & Conditions of access and use can be found at


http://www.tandfonline.com/action/journalInformation?journalCode=hjpa20
JOURNAL OF PERSONALITY ASSESSMENT
https://doi.org/10.1080/00223891.2018.1491855

The Development and Validation of the Autotelic Personality Questionnaire


Dwight C. K. Tse1, Vienne Wing-yan Lau1, Rachael Perlman1, and Michael McLaughlin2
1
Division on Behavioral and Organizational Sciences, Claremont Graduate University; 2Claremont School of Theology

ABSTRACT ARTICLE HISTORY


Autotelic personality is a constellation of dispositional attributes that facilitate engagement and Received 23 October 2017
enjoyment in daily activities. However, there is no existing measurement directly capturing the Revised 24 May 2018
attributes of autotelic personality that are identified in the literature. In the three studies reported
here (total N ¼ 900), we developed an Autotelic Personality Questionnaire (APQ) and evaluated its
reliability and validity. Results from the studies provide support for adequate internal consistency,
longitudinal invariance, and test–retest reliability (Study 1 and Study 2). Furthermore, APQ scores
were significantly correlated with measures of conscientiousness, openness to experience, extra-
version, neuroticism, and internal locus of control. In addition, APQ scores predicted flow prone-
ness and satisfaction with life (Study 2). These results provide support for construct and criterion
validity. Finally, people high in autotelic personality experienced more flow state than those low
in autotelic personality during a word unscrambling task (Study 3), indicating good criterion valid-
ity of the APQ scores. Limitations, future research, and implications are discussed.

Flow is a type of experience characterized by complete con- motivated by intrinsic rewards” (Nakamura &
centration, heightened sense of control, loss of self-con- Csikszentmihalyi, 2002, p. 93). Note that low self-centered-
sciousness, merging of action and awareness, and distortion ness refers to a lack of occupation with thoughts of one’s
of time perception (Csikszentmihalyi, 1990, 1997). Not only image, which is not equivalent to low selfishness (M.
is flow a rewarding experience; prolonged engagement in Csikszentmihalyi, personal communication, November
flow activities also enhances well-being, personal growth, 13, 2016).
and performance in a wide variety of domains (e.g., aca- The receptive–active model proposes that highly auto-
demic performance, sports performance; Landh€auszer & telic individuals are able to identify and seek out new chal-
Keller, 2012; Shernoff, Csikszentmihalyi, Schneider, & lenges (receptively noticing challenges), as well as engage
Shernoff, 2003). Csikszentmihalyi and Csikszentmihalyi and persist in the face of challenges (actively mastering
(1988) posited that individuals who can enter flow easily challenges; Csikszentmihalyi et al., 1993; Nakamura &
possess the ability to concentrate effortlessly, coupled with a Csikszentmihalyi, 2002). With these qualities, highly auto-
heightened ability to transform boring or threatening situa- telic individuals are able to endure challenge–skill imbalan-
tions into opportunities to engage with life. They coined the ces better than their counterparts. That is, although most
term autotelic personality to refer to the collection of attrib- people feel bored when challenge is low and skill is high,
utes that facilitate individuals’ experience of flow. A highly highly autotelic people can transform and enjoy boredom
autotelic individual can, therefore, experience flow often in by being sensitive to opportunities for challenge. Similarly,
everyday activities (Ullen et al., 2012). The two most com- whereas most people feel anxious when challenge is high
monly recognized models of autotelic personality are the and skill is low, highly autotelic people can transform and
metaskills model (Nakamura & Csikszentmihalyi, 2002) and enjoy overwhelming challenges by building skills diligently
the receptive–active model (Baumann, 2012; (Csikszentmihalyi, 1975, 1990). In short, the receptive–ac-
Csikszentmihalyi, Rathunde, & Whalen, 1993). tive model acknowledges that autotelic individuals are
more likely to transform and enjoy both highly boring and
highly challenging situations.
Conceptualization of autotelic personality
In addition to the two models, Csikszentmihalyi (1997)
The metaskills model postulates that individuals who possess stressed that attentional control—the ability for an individ-
several specific attributes can enter and sustain flow state ual to focus both narrowly on the task at hand and widely
more easily. These attributes, or metaskills, include “[a] gen- on the surroundings to seek out new challenges—is an
eral curiosity and interest in life, [b] persistence, and [c] low important component of autotelic personality. Highly auto-
self-centeredness, which result in [d] the ability to be telic individuals are able to concentrate effortlessly, yet they

CONTACT Dwight C. K. Tse cheuk-kit-dwight.tse@cgu.edu Division of Behavioral and Organizational Sciences, Claremont Graduate University, Claremont,
CA 91711.
Supplemental data for this article can be accessed on the publisher’s website.
ß 2018 Taylor & Francis Group, LLC.
2 TSE, LAU, PERLMAN, MCLAUGHLIN

can also discover new challenges in their surroundings when frequency of flow experiences in daily life (Asakawa, 2004;
necessary (Baumann, 2012; Csikszentmihalyi, 1990). Csikszentmihalyi, 1990; Moneta, 2004), more flow experi-
Integrating the flow and autotelic personality literature, ence might simply be an indication that a person lives in an
we understand autotelic personality as a multifaceted con- environment that provides clear goals and proximal feed-
struct with seven attributes: (a) curiosity and interest in life, back, rather than an indication of his or her autotelic per-
(b) persistence, (c) low self-centeredness, (d) intrinsic motiv- sonality per se (see discussion in Baumann, 2012). To
ation, (e) enjoyment and transformation of boredom, (f) address this concern, we aim at providing a different
enjoyment and transformation of challenges, and (g) atten- approach to capture autotelic personality—by measuring the
tional control. These distinct attributes should contribute to attributes in light of the flow literature.
autotelic personality significantly and uniquely. However,
because research on autotelic personality has only begun to
The current studies and hypotheses
grow, we acknowledge the possibility of excluding attributes
that are potentially related to autotelic personality. We conducted three studies to develop and test the validity
of a self-report scale on autotelic personality. In Study 1, we
evaluated and revised the initial item pool. In Study 2, we
Existing measurements of autotelic personality
examined the longitudinal invariance, test–retest reliability,
Researchers have previously attempted to measure autotelic convergent validity, discriminant validity, and predictive val-
personality using a variety of methods. Baumann and idity of the revised APQ. In Study 3, we further examined
Scheffer (2010) developed the first projective measure of the criterion validity of the APQ with an experiment.
achievement flow motive as an operationalization of auto-
telic personality. In this measure, respondents are presented
Longitudinal invariance and test–retest reliability
with ambiguous pictures and asked to come up with related
stories. Autotelic personality is indicated by the extent to Autotelic personality is a constellation of dispositional
which the protagonist in respondents’ stories has positive attributes (Johnson et al., 2014) and thus remains stable
affect and is self-determined. Albeit a noteworthy attempt, across situations and over time (Hooker & McAdams, 2003;
the findings concerning the relationship between the pro- McCrae & Costa, 1987). We hypothesized that when the
jective test and its expected experiential and behavioral out- APQ was administered to the same participants over a 3-
comes (e.g., frequency or proneness of flow, job week period, its factor structure (i.e., configuration and
engagement) are mixed (Baumann & Scheffer, 2010; Young, loadings) would not vary between Time 1 and Time 2 (lon-
2011). These conflicting results bring into question the val- gitudinal invariance; Hypothesis 1). Furthermore, partic-
idity of this type of measure. ipants’ APQ scores at Time 1 and Time 2 would be
Other researchers have suggested that measuring the fre- positively correlated with one another (test–retest reliability;
quency of flow experience in daily life can serve as a proxy Hypothesis 2).
for identifying autotelic individuals (Asakawa, 2004; Ullen
et al., 2012). Two ways of measuring frequency of daily flow
Convergent and discriminant validity
experience are the experience sampling method (ESM; e.g.,
Asakawa, 2004) and self-report scales of flow proneness The Big Five personality traits
such as the Swedish Flow Proneness Questionnaire (SFPQ; The relationship between flow proneness and the Five-
Ullen et al., 2012) and the Dispositional Flow Scale–2 Factor Model of personality has been well documented (e.g.,
(DFS–2; Jackson & Eklund, 2002). With the ESM, autotelic Ross & Keiser, 2014; Ullen et al., 2012). Because autotelic
individuals are identified by their spending a large amount personality theoretically precedes flow proneness, one can
of time in high-skill, high-challenge conditions with a high examine the convergent and discriminant validity of the
level of intrinsic motivation (e.g., Asakawa, 2004; see also APQ by investigating whether autotelic personality relates to
Nakamura & Csikszentmihalyi, 2002, for a review). For the the Big Five personality factors in a similar manner as
self-report scales, the SFPQ operationalizes autotelic person- flow proneness.
ality as the frequency of flow experience in three different We begin with an examination of conscientiousness and
domains: work, leisure, and maintenance (e.g., chores; Ullen neuroticism. First, consistent with the depiction of highly
et al., 2012). The DFS–2 serves a dispositional measure of conscientious individuals as self-disciplined and achieve-
flow propensity by examining respondents’ feelings toward ment-oriented (McCrae & John, 1992), highly autotelic indi-
different dimensions of flow experience when engaging in a viduals demonstrate the persistence and self-control required
given activity (Jackson & Eklund, 2002) or in any activity in to keep attention focused on the task at hand
life (Ross & Keiser, 2014). Previous studies have shown (Csikszentmihalyi, 1997). In contrast, highly neurotic indi-
good reliability and validity of these self-report scales, such viduals might be less autotelic because they are more self-
as predicting the percentage of time spent in flow in an conscious, less persistent in the face of challenges, and
ESM study (Johnson, Keiser, Skarin, & Ross, 2014). unable to cope with daily demands (McCrae & Costa, 1987).
However, the findings of these measures might be vulnerable Empirical studies on flow proneness have consistently
to being confounded by situational factors. Given that both reported its positive correlation with conscientiousness and
contextual and dispositional factors contribute to the its negative correlation with neuroticism (e.g., Ross &
AUTOTELIC PERSONALITY QUESTIONNAIRE 3

Keiser, 2014; Ullen et al., 2012). Therefore, we hypothesized Incremental and criterion validity
that autotelic personality would be positively associated with
Flow proneness
conscientiousness (Hypothesis 3a) but negatively associated
with neuroticism (Hypothesis 3b). Highly autotelic individuals are more likely to experience
Facets of extraversion, such as high assertiveness, active- flow in daily life (Nakamura & Csikszentmihalyi, 2002),
ness, and cheerfulness, are associated with taking active con- implying that flow proneness—the tendency to experience
trol of activities and having a general interest in life flow frequently in life—is an outcome of autotelic personal-
(McCrae & Costa, 1987; Ross & Keiser, 2014). In a similar ity (Baumann, 2012). To demonstrate incremental validity,
vein, facets of openness to experience, such as broad interest autotelic personality should positively predict flow proneness
and curiosity, are associated with interest in life and enjoy- beyond the Big Five personality traits that have been
ment of challenges (McCrae & John, 1992). Whereas many employed in past studies (e.g., Ullen et al., 2012;
previous studies have reported a positive association between Hypothesis 6).
flow proneness and extraversion (e.g., Johnson et al., 2014;
Mesurado & de Minzi, 2013), only one out of five empirical Satisfaction with life
studies has reported a significant positive relationship Studies on flow and subjective well-being demonstrate that
between flow proneness and openness to experience (Bassi dimensions of flow, such as clear goals and challenge–skill
et al., 2014). One potential reason for this lack of empirical balance, are related to satisfaction with life (e.g., Collins,
support is that the measurement of flow proneness focuses Sarkisian, & Winner, 2009). Given that highly autotelic indi-
on flow experiences in daily life but not the traits supporting viduals should be more prone to experiencing flow, they
it. In particular, curiosity and interest in life are not should in turn be more satisfied with life. Therefore, we
included in any of the flow proneness measures. Given that hypothesized that autotelic personality would have a positive
some APQ factors (e.g., enjoyment and transformation of indirect effect on satisfaction with life through flow prone-
challenges, curiosity, and interest in life) were theoretically ness (Hypothesis 7).
associated with openness to experience and extraversion, we
hypothesized that autotelic personality would be positively
associated with extraversion (Hypothesis 3c) and openness Flow state
to experience (Hypothesis 3d). Highly autotelic individuals should experience more intense
Finally, facets of agreeableness, such as sympathy and flow state in general (Csikszentmihalyi, 1990). We hypothe-
altruism, are mainly socially focused (McCrae & Costa, sized that autotelic personality would be positively associated
1987). Given that autotelic personality does not concern the with the intensity of flow state regardless of the difficulty of
social environment, many studies have not found a signifi- the task (Hypothesis 8a). Furthermore, although high-chal-
cant relationship between the two (e.g., Bassi et al., 2014; lenge, low-skill activities generally induce anxiety that results
Ullen et al., 2012). Therefore, we hypothesized that agree- in a low intensity of flow state (Csikszentmihalyi, 1975),
ableness would be independent from (i.e., weakly related to) highly autotelic individuals are able to negate the negative
autotelic personality (jqj < .30; Cohen, 1988; Hypothesis 3e). impact of excess challenges on flow state by transforming
the challenges into opportunities to learn (Asakawa, 2004;
Tse, Fung, Nakamura, & Csikszentmihalyi, 2018). In other
Locus of control and implicit theories of intelligence words, the impact of task difficulty on flow state would be
Individuals with an internal locus of control (LOC) believe less pronounced among highly autotelic individuals
outcomes depend on personal efforts, as opposed to depend- (Hypothesis 8b).
ing on forces outside of personal control (Levenson, 1973).
Keller and Blomann (2008) theorized that internal LOC
would be related to autotelic personality because internal Study 1
LOC implies that individuals are sensitive to factors within
Item generation and content validity
their control and thus are sensitive to high-challenge, high-
skill situations. Given that highly autotelic individuals also To generate items that are representative of the breadth of
possess these characteristics (Asakawa, 2004), we hypothe- autotelic personality, we reviewed the existing literature on
sized that internal LOC would be positively correlated with flow theory and identified the common individual attributes
autotelic personality (Hypothesis 4). (e.g., Csikszentmihalyi, 1975, 1990, 1997). We then con-
Individuals with incremental theory of intelligence sulted two subject matter experts (SMEs) on the 13 main
(growth mindset) similarly attribute intelligence to factors themes gathered (M. Csikszentmihalyi, personal communica-
over which they have control (e.g., effort). However, auto- tion, September 20, 2016; J. Nakamura, personal communi-
telic personality encompasses all life domains, not just intel- cation, September 25, 2016) to ensure all dimensions of
ligence, and belief in the malleability of intelligence per se autotelic personality were covered. Out of the 13 themes we
should not influence one’s approach to other challenges identified, seven were identified as essential attributes of
encountered in daily life, such as challenges in athletic activ- autotelic personality by at least one of the SMEs (four were
ities (Dweck & Master, 2009). Therefore, we hypothesized identified as essential by both SMEs). The SMEs also com-
that autotelic personality would be weakly associated with mented that some of the remaining themes could be incor-
growth mindset (Hypothesis 5). porated into the seven essential attributes; for example,
4 TSE, LAU, PERLMAN, MCLAUGHLIN

“autonomous, self-chosen goals” was combined into conducted the EFA again. The decision about whether to
“intrinsic motivation.” We thus decided to eliminate the remove certain items was determined by the result of the
remaining six, striking a balance between complete coverage EFA as well as the research team’s judgment concerning the-
of the construct and parsimony (see Table 1 for the list of ory and validity. This procedure was repeated until each fac-
extracts and the identified attributes). tor contained only four items. Because of the large number
Based on the seven essential attributes of autotelic per- of attributes in autotelic personality, we decided that having
sonality, we generated more than 100 question items, four items per subscale would balance construct validity and
informed by the literature and existing scales that measure parsimony. The end result was a seven-factor solution with
similar constructs (e.g., Curiosity and Exploration Inventory; four items for each subscale. The Kaiser–Meyer–Olkin meas-
Kashdan, Rose, & Fincham, 2004). We revised the items by ure of sampling adequacy (KMO) for the 28-item scale was
following guidelines for item generation, such as the avoid- .91 and Bartlett’s test of sphericity was significant,
ance of double-barreled questions connotation (Dillman, v2(378) ¼ 4776.87, p < .001. The factor solution explained
2007). The items were further reviewed and modified based 65.66% of the variance. Table 2 shows the factor loadings of
on comments from the two SMEs and from 15 graduate stu- the items.
dents who had expertise in related areas. The initial item The scores of the 28-item APQ had good reliability
pool consisted of 45 items representing the seven attributes (a ¼ .92; Howell, 2012). The Cronbach’s alphas were satisfac-
of autotelic personality. All items were to be rated on a 7- tory for each subscale: curiosity (a ¼ .86), persistence
point Likert scale ranging from 1 (strongly disagree) to 7 (a ¼ .93), low self-centeredness (a ¼ .93), intrinsic motivation
(strongly agree). (a ¼ .70), enjoyment of challenge (a ¼ .87), enjoyment of
boredom (a ¼ .82), and attention control (a ¼ .90).
Participants and procedure
We used convenience sampling to recruit 261 participants Discussion
on Amazon Mechanical Turk (MTurk), an online crowd- Consistent with the metaskills model and the receptive–ac-
sourcing platform. Compared to the college populations tive model, (a) curiosity and interest in life, (b) persistence,
often used for psychology research, MTurk workers are con- (c) low self-centeredness, (d) intrinsic motivation, (e) enjoy-
sidered more representative of the U.S. population (Paolacci, ment and transformation of boredom, (f) enjoyment and
Chandler, & Ipeirotis, 2010). According to the U.S. Census transformation of challenges, and (g) attentional control
Bureau (2017), 50.8% of the U.S. population are female, contributed significantly and uniquely to autotelic
roughly 60% of the population are between the ages of 20 personality.
and 60, and 76.9% are White. Our sample generally resem- The Cronbach’s alpha of the intrinsic motivation subscale
bles the U.S. population in terms of race and gender. The (a ¼ .70) was lower than the other subscales. Scales measur-
mean age of the sample was 34.51 (SD ¼ 9.58), 52.48% self- ing general intrinsic motivation are often comprised of a
identified as men, and 75.90% self-identified as White. large number of items that measure intrinsic motivation in
Participants filled out the questionnaire with the initial item different domains, such as work and leisure (e.g., General
pool and demographic questions including birth year, gen- Causality Orientation Scale [GCOS–12; Deci & Ryan, 1985]).
der, race or ethnicity, and education level. We followed this approach and attempted to measure intrin-
sic motivation in different domains with only four items.
Results Although having fewer items on a multidomain construct
might hamper the internal consistency of the scale, we
We conducted an exploratory factor analysis (EFA) using strove to maintain adequate psychometric properties while
principal axis factoring (PAF) with oblique rotation to iden- keeping the scale relatively short (Sudman, Bradburn, &
tify latent factors for the 45 items in the initial APQ item Schwarz, 1996).
pool. Factor extraction was guided by (a) eigenvalues greater
than 1 (Kaiser, 1960), (b) analysis of the scree plot (Cattell,
1966), and (c) theory. We deleted items with high cross- Study 2
loading on two or more factors (i.e., .40 on more than one Method
factor) or low factor loading coefficients (i.e., .32 or lower;
Yong & Pearce, 2013). Participants and procedure
For the first round of EFA, a seven-factor structure con- We recruited a convenience sample of new participants on
verged, with two cross-loading items and one item with a MTurk who had not participated in Study 1. At Time 1, 400
low factor loading coefficient. These items were “I see chal- participants filled out a questionnaire with the revised APQ,
lenges as learning opportunities,” “I am good at handling the Big Five personality factors, flow proneness, internal
demanding situations,” and “There is little I can do when LOC, growth mindset, and social desirability. Three weeks
stuck in a boring situation,” respectively. These items were later (Time 2), 214 (54%) of the participants from Time 1
removed, leaving 42 items for the rest of the analyses. filled out the APQ again, along with the Satisfaction with
Following this, we reduced the number of items in the APQ Life Scale. The mean age of the sample was 35.54
by removing the item with the lowest factor loading and (SD ¼ 10.67), 51.25% self-identified as men, and 77.80% as
Table 1. Identified attributes and extract quotes of autotelic personality in the literature
Identified attributes Example extracts from the literature Decision in reference to subject matter experts’ (SME) comments
Curiosity and interest in life “[Autotelic individuals] are intellectually curious” (Csikszentmihalyi, Rathunde, & Whalen, 1997, p.76) Included as an essential attribute
“[Autotelic individuals] must find time in order to develop interest and curiosity to enjoy life for its own
sake.” (Csikszentmihalyi, 1997, p. 127)
Persistence “They [autotelic individuals] express an unusually strong desire to excel (achievement), [and] are willing Included as an essential attribute
to preserve in order to attain their goals (endurance).” (Csikszentmihalyi, Rathunde, & Whalen, 1997, p.76)
Low self-consciousness “A less drastic obstacle to experiencing flow is excessive self-consciousness.” (Csikszentmihalyi, 1990, p. 84) Included as an essential attribute
“[N]arcissistic preoccupation with oneself prevents people from recognizing opportunities and using skills, thereby
breeding a lifestyle characterized by boredom and anxiety.” (Csikszentmihalyi & Csikszentmihalyi, 1988, p. 371)
Intrinsic motivation “[A]utotelic people … . enjoy what he[/she/they] are doing regardless of whether he[/she/they] will get external Included as an essential attribute
rewards for it.” (Csikszentmihalyi, 2000, p. 22) “[A]utotelic denotes an individual who generally does things
for their own sake, rather than in order to achieve some later external goal.” (Csikszentmihalyi, 1997, p. 117)
Enjoyment and transformation “The ‘autotelic self’ is one that easily translates potential threats into enjoyable challenges.”
of challenges (Csikszentmihalyi, 1990, p. 209) “Some people appear to have autotelic personalities that make it easier for
them to enjoy everyday life, and to transform routine and even threatening situations into challenging
opportunities for action.” (Csikszentmihalyi & Csikszentmihalyi, 1988, p. 364)
Enjoyment and transformation “[Autotelic] individuals who habitually react to a boring situation by seeking stimulation” (Csikszentmihalyi, Included as an essential attribute
of boredom Rathunde, & Whalen, 1997, p. 157) “Why is the same homework boring to some and enjoyable to others?
… They must be looked for in the personality of the students, in their ability to recognize challenges at
a level commensurate with their skill, where others only see tiresome obstacles.” (Csikszentmihalyi &
Csikszentmihalyi, 1988, p. 32)
Attention control “Perhaps one characteristics that differentiates a person with an autotelic personality is this ability to Included as an essential attribute
concentrate more efficiently, with less effort.” (Csikszentmihalyi & Csikszentmihalyi, 1988, p. 371) “It is this
flexibility of attention, which contrasts so sharply with the helpless overinclusion of the schizophrenic, that
may provide the neurological basis for the autotelic personality." (Csikszentmihalyi, 1990, p. 88)
Autonomous/self-chosen goals “[A] self that has self-contained goals, and it reflects the idea that such an individual has relatively few Dropped because none of the SMEs indicated
goals that do not originate from within the self.” (Csikszentmihalyi, 1990, p. 209) it as essential. Combined with “intrinsic motivation”
Sense of importance in what “[Autotelic individuals] feel that most anything they do is important and valuable in its own right” Dropped because none of the SMEs indicated it as essential
they do (Csikszentmihalyi, 1997, p. 117)
Strongly directed purpose that is not “A less drastic obstacle to experiencing flow is excessive self-consciousness.” (Csikszentmihalyi, 1990, p. 84) Dropped because none of the SMEs indicated it as essential
self-seeking
Willingness to develop skills “The outcome of having an autotelic self—of learning to set goals, to develop skills, to be sensitive to Combined with “Enjoyment and transformation of challenges”
when needed feedback, to know how to concentrate and get involved” (Csikszentmihalyi, 1990, p. 213)
Recognizing challenges that “Why is the same homework boring to some and enjoyable to others? … They must be looked for Dropped because none of the SMEs indicated it as
require skills in the personality of the [autotelic] students, in their ability to recognize challenges at a level essential. Combined with “Enjoyment and
commensurate with their skill, where others only see tiresome obstacles.” (Csikszentmihalyi & transformation of boredom”
Csikszentmihalyi, p. 32)
Seeking challenges that “[T]heir [autotelic individuals’] deep sense of interest aids them in recognizing new challenges, Dropped because none of the SMEs indicated
require skills with new opportunities pitched just far enough ahead of current skills to mobilize but not it as essential. Combined with “Enjoyment and
overwhelm psychic resources.” (Csikszentmihalyi, Rathunde, & Whalen, 1997, p. 80) transformation of boredom”
AUTOTELIC PERSONALITY QUESTIONNAIRE
5
6 TSE, LAU, PERLMAN, MCLAUGHLIN

Table 2. Factor loadings of 28 APQ items in the final EFA model in Study 1. developed by Dweck, Chiu, and Hong (1995). The
Factor Cronbach’s alpha of this scale was .96. On a 6-point Likert
Item PE SC AC EB EC IM CU scale from 1 (strongly agree) to 6 (strongly disagree),
PE_1 .91 respondents expressed the degree to which they agreed or
PE_2 .83 disagreed with the statements. A higher score indicated that
PE_3 .81
PE_4 .80 the respondent had a stronger growth mindset.
SC_1 [R] .92 Flow proneness. We used the English-language version
SC_2 [R] .88 of the SFPQ (Ullen et al., 2012) to measure flow proneness.
SC_3 [R] .83
SC_4 [R] .83 The SFPQ consisted of 21 items representing different
AC_1 [R] .85 domains of life: work (a ¼ .78), leisure (a ¼ .71), and main-
AC_2 [R] .84
AC_3 [R] .82
tenance (a ¼ .73). Respondents used a 5-point Likert scale to
AC_4 .52 indicate their frequency of flow experiences mentioned in
EB_1 .83 the statements, ranging from 1 (never) to 5 (every day, or
EB_2 .79
EB_3 .70 almost every day). A high score indicated that the respond-
EB_4 .59 ent was prone to experiencing flow.
EC_1 .80
EC_2 .61
EC_3 .47 Satisfaction with life. The Satisfaction with Life Scale
EC_4 .32 (SWLS, Diener, Emmons, Larsen, & Griffin, 1985) was used
IM_1 .80
IM_2 .61
to measure participants’ global life satisfaction at Time 2
IM_3 .47 (a ¼ .95). Respondents rated each item on a 7-point Likert
IM_4 .32 scale to indicate their agreement with each statement, rang-
CU_1 .84
CU_2 .73 ing from 1 (strongly disagree) to 7 (strongly agree). A high
CU_3 .71 score indicated that the respondent was highly satisfied with
CU_4 .57 her life in general.
Proportion of variance explained (%) 32.95 10.30 6.79 6.11 3.81 3.04 2.68
Social desirability. To account for potential systematic
Note. PE ¼ persistence; SC ¼ low self-centeredness; AC ¼ attentional control;
EB ¼ enjoyment and transformation of boredom; EC ¼ enjoyment and trans- bias due to participants’ desire to be perceived more favor-
formation of challenges; IM ¼ intrinsic motivation; CU ¼ curiosity. Items with ably (Fisher, 1993), we measured social desirability with the
[R] are reversed items. Items with  are removed from the APQ in Study 2
and onward due to cross-loading issues. Factor loadings < .32
11-item short form of the Marlowe–Crowne Social
are suppressed. Desirability Scale (SDS; Ballard, 1992; Crowne & Marlowe,
1960). Respondents indicated whether each statement was
White. This sample generally resembles the U.S. population’s true or false about themselves. Respondents with more state-
demographics (see the “Participants and Procedure” section ments reported as true were considered to be more con-
for Study 1). cerned with social approval compared with those who
obtained a lower score.
Measures
Autotelic Personality Questionnaire. We used the 28-item Results
APQ generated in Study 1.
Time 2 participants and nonparticipants
Big Five personality factors. The Big Five personality
Among all demographic and psychological constructs, age
factors were measured with the Big Five Inventory (BFI;
and conscientiousness differed between Time 2 participants
John, Donahue, & Kentle, 1991). This inventory contained
eight items for extraversion (a ¼ .89), nine for agreeableness and nonparticipants. Time 2 participants (M ¼ 37.33,
(a ¼ .85), nine for conscientiousness (a ¼ .88), eight for SD ¼ 11.47), were significantly older than nonparticipants
neuroticism (a ¼ .91), and 10 for openness to experience (M ¼ 33.48, SD ¼ 9.26), t(396) ¼ 3.71, p < .001, Cohen’s
(a ¼ .86). Respondents reported the extent to which they d ¼ 0.37. In addition, Time 2 participants’ scores for con-
agreed with the statements that described themselves with a scientiousness (M ¼ 4.11, SD ¼ 0.73) were significantly
5-point Likert scale ranging from 1 (disagree strongly) to 5 higher than nonparticipants’ scores (M ¼ 3.86, SD ¼ 0.72),
(agree strongly). t(399) ¼ 3.49, p ¼ .001, Cohen’s d ¼ 0.35. This could be
Internal locus of control. Internal LOC was measured because conscientious individuals were more goal-oriented
using the internality subscale of the Internality, Powerful and organized, and thus more likely to follow through with
Others, and Chance scale developed by Levenson (1973). the second half of the study.
The Cronbach’s alpha of this scale was .83. Respondents Despite these differences, we found that Time 2 partic-
reported the extent to which they agreed with each state- ipants’ APQ scores at Time 1 (M ¼ 5.01, SD ¼ 0.80) were
ment using a 7-point Likert scale ranging from 1 (strongly not significantly different than those of nonparticipants
disagree) to 7 (strongly agree). A higher score indicated a (M ¼ 5.00, SD ¼ 0.75), t(399) ¼ 0.13, p ¼ .901, Cohen’s
stronger internal LOC. d ¼ 0.01. Therefore, we concluded that the differences
Incremental theory of intelligence. Incremental theory between participant groups in age and conscientiousness
of intelligence (growth mindset) was measured by the scale would not affect subsequent analyses.
AUTOTELIC PERSONALITY QUESTIONNAIRE 7

Confirmatory factor analysis and longitudinal invariance


In this study, we determined good model fit with v2/df ratio
<2, comparative fit index (CFI) > .95, root mean square
error of approximation (RMSEA) < .05, and standardized
root mean residual (SRMR) < .05; and acceptable model fit
with v2/df ratio <5, CFI > .90, RMSEA < .08, and
SRMR < .08 (Hooper, Coughlan, & Mullen, 2008; Hu &
Bentler, 1999; Kline, 2016). For nested model fit compari-
son, we evaluated improvement of model fit by examining
whether there was a significant Dv2 test result; for non-
nested model comparison, given that Dv2 test was not
appropriate, we evaluated improvement of model fit by
comparing the Akaike’s information criterion (AIC) of the
two nonnested models (Kline, 2016). We conducted the con-
firmatory factor analysis (CFA) and longitudinal invariance
tests with the R package “lavaan” (Rosseel, 2012) using max-
imum likelihood estimation with robust standard errors and
a scaled test statistics (MLR; Yuan & Bentler, 2000).
Before testing Hypothesis 1 (longitudinal invariance), we
conducted a CFA to examine the factor structure of the 28-
item APQ at Time 1. The model showed an unsatisfactory
fit with the data, v2(343) ¼ 1124.9, p < .001, v2/df ¼ 3.28,
CFI ¼ .88, SRMR ¼ .10, RMSEA ¼ .07, 90% CI of RMSEA
[.07, .08], AIC ¼34,973. The modification indexes suggested
that two question items—“I can turn demanding situations
into enjoyable situations” and “I can focus for a long
time”—cross-loaded on other factors and thus hampered the
model fit. After deleting these two items, the model fit of
the reduced 26-item APQ improved and became acceptable
(see Figure 1), v2(292) ¼ 844.1, p < .001, v2/df ¼ 2.89,
CFI ¼ .91, SRMR ¼ .08, RMSEA ¼ .07, 90% CI of RMSEA
[.06, .07], AIC ¼32,541, DAIC ¼2,432. We conducted all
subsequent analyses using this 26-item APQ.
To test Hypothesis 1, we evaluated the longitudinal invari-
ance of the APQ following Chen, Sousa, and West’s (2005)
invariance test procedure of second-order factor models. This
Figure 1. Confirmatory factor analysis model of autotelic personality model and
procedure includes the comparisons of seven models that test the seven first-order factors (N ¼ 401). Single-headed arrows from the first-order
the invariances of the factor structure, first- and second-order latent variable to the manifest variables (squares) represent the loadings of
factor loadings and intercepts, as well as disturbances of latent each question item onto the latent variable. Single-headed arrows from the
second-order latent variable to the first-order latent variables represent the
factors and residuals of observed items (for technical details, loadings of each first-order latent variable onto the second-order latent variable.
see Chen et al., 2005). Table 3 shows the model fit indexes and The residuals of manifest variables and the variance of latent variables are omit-
the model comparison results. The fit of the final model ted. All loadings are standardized and are significant at the p < .001 level.
AP ¼ autotelic personality; CU ¼ curiosity; PE ¼ persistence; SC ¼ low self-cen-
(Model 7) was acceptable and was not significantly different teredness; IM ¼ intrinsic motivation; EC ¼ enjoyment and transformation of chal-
from that of Model 6; for fit indexes of Model 7, lenges; EB ¼ enjoyment and transformation of boredom;
v2(1,326) ¼ 2206.7, p < .001, v2/df ¼ 1.66, CFI ¼ .911, AC ¼ attentional control.
SRMR ¼ .095, RMSEA ¼ .051, 90% CI of RMSEA [.046, .056];
for model comparison (Models 6 vs. 7), Dv2(26) ¼ 26.83, at Time 1 was positively associated with that at Time 2,
p ¼ .418, DCFI ¼ .000, DSRMR ¼ .000, DRMSEA ¼ .001. The ICC ¼ .87, p < .001. The scores of the subscales at Time 1
findings suggest that APQ at Time 1 and Time 2 shared simi- were also positively associated with their corresponding
lar factor structures, first- and second-order factor loadings,
scores at Time 2: for curiosity, ICC ¼ .71, p < .001; for per-
first- and second-order intercepts, disturbance of first-order
sistence, ICC ¼ .80, p < .001; for low self-centeredness,
latent variables, and residuals of observed items. Consistent
ICC ¼ .81, p < .001; for intrinsic motivation, ICC ¼ .67,
with Hypothesis 1, the scores of the reduced 26-item APQ
p < .001; for enjoyment and transformation of challenges,
have good longitudinal invariance.
ICC ¼ .85, p < .001; for enjoyment and transformation of
boredom, ICC ¼ .70, p < .001; and for attention control,
Test–retest reliability ICC ¼ .78, p < .001. These findings suggest that the scores of
To test Hypothesis 2, we conducted a two-way mixed intra- the 26-item APQ and its subscales have satisfactory test–ret-
class correlation (ICCconsistency[3,k]) analysis. The APQ score est reliability, providing support for Hypothesis 2.
8 TSE, LAU, PERLMAN, MCLAUGHLIN

Table 3. Longitudinal invariance models with model fit indices (N ¼ 214). Table 4. Means, Standard Deviations, Cronbach’s Alphas, Zero-order
Correlations, and Partial Correlations for all Psychological Constructs Measured
Model v2 df CFI RMSEA SRMR Dv2 Ddf DCFI DRMSEA DSRMR
in Study 2 Time 1 (N ¼ 400).
Model 1a 2089.3 1212 .912 .053 .093 –– –– –– –– ––
Variable M SD a 1 2 3 4 5 6 7 8 9 10 11
Model 2b 2112.5 1231 .912 .053 .093 23.24 19 .000 .000 .000
Model 3c 2114.7 1237 .912 .052 .093 1.70 6 .000 .001 .000 1. APQ_26 5.00 0.78 .88 –– .38 .36 .65 -.53 .51 .13 .46 .58 .41 .54
Model 4d 2135.2 1263 .912 .052 .094 28.84 26 .000 .000 .001 2. BFI_E 2.95 0.97 .89 .41 –– .17 .23 -.44 .27 .00 .31 .21 .22 .29
Model 5e 2147.9 1270 .911 .052 .094 13.53 7 .001 .000 .000 3. BFI_A 3.83 0.76 .85 .41 .24 –– .44 -.40 .26 .18 .23 .21 .20 .33
Model 6f 2156.8 1277 .911 .052 .095 7.23 7 .000 .000 .001 4. BFI_C 3.99 0.73 .88 .67 .28 .49 –– -.43 .30 .19 .33 .46 .36 .40
Model 7g 2206.7 1326 .911 .051 .095 26.83 26 .000 .001 .000 5. BFI_N 2.61 1.02 .91 -.57 -.50 -.47 -.48 –– -.21 -.08 -.37 -.33 -.23 -.39
6. BFI_O 3.72 0.70 .86 .52 .28 .28 .31 -.23 –– .11 .20 .38 .22 .32
Note. Dv2, Ddf, DCFI, and DRMSEA were obtained by comparing the target
7. Mindset 4.01 1.53 .96 .13 .01 .19 .20 -.10 .11 –– .03 .04 .03 .02
models with their previous models (e.g. Model 2 to Model 1). Models were
8. LOC 33.05 8.41 .83 .48 .33 .26 .35 -.39 .21 .03 –– .44 .44 .45
estimated with maximum likelihood function with robust (Huber-White)
9. SFPQ_L 4.96 0.87 .71 .60 .25 .27 .49 -.38 .39 .05 .45 –– .47 .54
standard errors; robust CFI and RMSEA are reported. None of the compari-
10. SFPQ_M 4.61 0.99 .73 .42 .23 .23 .37 -.25 .22 .03 .45 .48 –– .50
sons showed significant differences in model fit (all ps  .05).
a 11. SFPQ_W 5.09 0.99 .78 .55 .31 .37 .43 -.43 .33 .03 .46 .55 .50 ––
model holding factor structure constant (configural invariance).
b 12. SDS 6.50 1.82 .86 -.25 -.25 -.32 -.26 .35 -.11 -.07 -.15 -.22 -.11 -.19
model holding factor structure and first-order factor loadings constant.
c Note. Zero-order correlation coefficients are presented below the diagonal,
model holding factor structure and first- and second-order factor load-
ings constant. and partial correlation coefficients controlling for SDS are presented above
d
model holding factor structure, factor loadings, and intercepts of observed the diagonal. Correlation coefficients that are statistically significant (p < .05)
variables constant. are bolded. APQ_26 ¼ Revised 26-item APQ; BFI_E ¼ Big-Five Inventory –
e
model holding factor structure, factor loadings, and intercepts of observed Extraversion; BFI_A ¼ Big-Five Inventory – Agreeableness; BFI_C ¼ Big-Five
variables and first-order factors constant. Inventory – Conscientiousness; BFI_N ¼ Big-Five Inventory – Neuroticism;
f
model holding factor structure, factor loadings, intercepts, and disturbances BFI_O ¼ Big-Five Inventory – Openness to Experience; Mindset ¼ Incremental
of first-order factors constant. theory of intelligence (growth mindset); LOC ¼ Internal locus of control;
g
model holding factor structure, factor loadings, intercepts, disturbances of SFPQ_L ¼ Swedish Flow Proneness Scale – Leisure; SFPQ_M ¼ Swedish Flow
first-order factors, and residuals of observed variables constant. Proneness Scale – Maintenance; SFPQ_W ¼ Swedish Flow Proneness Scale –
Work; SDS ¼ Social Desirability Scale.

Convergent and discriminant validity


We then tested the convergent and discriminant validity of as an evidence of discriminant validity given the large sam-
the APQ (Hypotheses 3, 4, and 5). Table 4 shows the correl- ple size (Cohen, 1988; Howell, 2012). In short, the findings
ation matrix of the 26-item APQ, neuroticism, openness to partially support the discriminant validity of the APQ.
experience, conscientiousness, extraversion, agreeableness, We also repeated the correlation analyses while statistic-
internal LOC, growth mindset, and flow proneness. ally controlling for social desirability. Table 4 shows the par-
To test the convergent validity of the APQ, we conducted tial correlation of APQ at Time 1 with tested variables. All
a bivariate correlational analysis of autotelic personality at the partial correlation results were consistent with the zero-
Time 1 with neuroticism, r(398) ¼ .57; conscientiousness, order correlations.
r(398) ¼ .67; extraversion, r(398) ¼ .41; openness to experi-
ence, r(398) ¼ .52; and internal LOC, r(398) ¼ .48, all Incremental and criterion validity
ps < .001. Given that these correlations were statistically sig- To test the incremental validity of the APQ, we conducted
nificant and were all at least medium in size (jrj > .30;
hierarchical regression analyses using autotelic personality
Cohen, 1988), the findings support Hypotheses 3a, 3 b, 3c,
and the Big Five personality factors to predict average flow
3d, and 4. This demonstrates support for conver-
proneness across domains (Hypothesis 6). Whereas Model 1
gent validity.
had all Big Five personality factors as predictors, Model 2
To test the discriminant validity of the APQ, we corre-
included autotelic personality as an additional predictor. By
lated autotelic personality at Time 1 with agreeableness and
comparing Model 2 against Model 1, we found that autotelic
growth mindset. Contrary to Hypothesis 3e, autotelic per-
sonality was positively correlated with agreeableness with a personality explained an addition of 7.1% more variance of
medium effect size, r(398) ¼ .41, p < .001. We therefore flow proneness beyond what was already explained by all
decided to follow Ullen and colleagues’ (2012) procedure Big Five personality factors in Model 1, DR2 ¼ .071, DF(1,
and conducted a post-hoc stepwise regression analysis using 393) ¼ 48.44, p < .001. Consistent with Hypothesis 6, con-
all Big Five personality traits to predict autotelic personality. trolling for the Big Five personality factors, autotelic person-
Indeed, whereas extraversion, openness to experience, con- ality significantly predicted flow proneness, b ¼ .43, p < .001
scientiousness, and neuroticism predicted autotelic personal- (jbjs  .20 for the Big Five personality factors; see Table 5).
ity significantly (jbj ¼ .07–.44, all ps < .05), agreeableness The findings provide support for the incremental validity of
was the only predictor that did not uniquely explain vari- the APQ scores.
ance in autotelic personality, b ¼ .03, SE ¼ .04, b ¼ .03, To test the criterion validity of the APQ, we constructed
p ¼ .468. The result of the post-hoc analysis suggests that a mediation model with the 26-item APQ at Time 1 predict-
the common variance shared among the five personality ing satisfaction with life at Time 2, mediated by flow prone-
traits might have inflated the zero-order correlation between ness at Time 1 (Hypothesis 7) and tested the indirect effect
agreeableness and autotelic personality. with a path analysis. The model fit was satisfactory,
Furthermore, consistent with Hypothesis 5, autotelic per- v2(4) ¼ 8.26, p ¼ .083, v2/df ¼ 2.07, CFI ¼ .99, SRMR ¼ .02,
sonality was positively correlated with growth mindset with RMSEA ¼ .07, 90% CI of RMSEA [.00, .16]. Consistent with
a small effect size, r(398) ¼ .13, p ¼ .008. Despite statistical Hypothesis 7, the indirect effect of the APQ on satisfaction
significance, a small effect size (jrj < .30) can be considered with life through flow proneness was significant, b ¼ .74,
AUTOTELIC PERSONALITY QUESTIONNAIRE 9

SE ¼ .20, b ¼ .34, p < .001, providing support for criterion Hypothesis 3e, however, we found a significant positive rela-
validity. The APQ was positively associated with flow prone- tionship with a medium effect size between autotelic person-
ness and in turn predicted satisfaction with life (see Figure 2 ality and agreeableness, but the relationship might be due to
for a more detailed report of the model results). the common variance shared with the other four personality
traits, as suggested by the post-hoc regression analysis. After
controlling for this factor, the unique contribution of agree-
Discussion ableness on autotelic personality became negligible.
We eliminated two items from the APQ based on the initial Finally, our findings showed support for the incremental
CFA results. The factor structure of the 26-item APQ did and criterion validity of the APQ scores. Autotelic personal-
not vary when administered to the same participants 3 ity not only positively predicted flow proneness above and
weeks apart, demonstrating support for its longitudinal beyond the Big Five Personality Factors (Hypothesis 6), but
invariance (Hypothesis 1). In addition, the strong positive also predicted satisfaction with life through the mediation of
correlation between participants’ responses to the APQ in flow proneness (Hypothesis 7). In conclusion, despite only
Time 1 and Time 2 demonstrated support for its test–retest partial support for the discriminant validity of the APQ, the
reliability (Hypothesis 2). findings suggest that the APQ scores demonstrate adequate
The results from the APQ scores provide support for longitudinal variance and test–retest reliability, as well as
convergent validity. Consistent with Hypotheses 3a–d and 4, convergent, incremental, and criterion validity. Study 3 fur-
autotelic personality was negatively related to neuroticism ther investigated the criterion validity of the APQ in
and positively related to conscientiousness, extraversion, an experiment.
openness to experience, and internal locus of control.
Discriminant validity, on the other hand, was only partially Study 3
supported. Consistent with Hypothesis 5, autotelic personal-
ity was weakly associated with growth mindset. Contrary to Method
Participants and procedure
Table 5. Predictors of flow proneness.
We recruited 239 new MTurk participants who had not par-
Model 1 Model 2
ticipated in Study 1 or 2. The mean age of the sample was
Variable B SE b B SE b 37.15 (SD ¼ 11.88), with 52.30% of the participants self-iden-
Constant 2.46 .354 1.43 .366 tified as men and 82.40% as White. This sample generally
Big Five Personality
Extraversion 0.08 .040 .094 0.05 .038 .060 resembles the U.S. population’s demographics (see the
Agreeableness 0.03 .052 .028 0.04 .049 .040 “Participants and Procedure” section for Study 1).
Conscientiousness 0.39 .055 .358 0.18 .060 .166 Participants first filled out a screener survey. The survey
Openness to experience 0.21 .050 .180 0.06 .052 .048
Neuroticism 0.14 .042 -.147 0.03 .042 -.033 asked respondents to report their English proficiency on a
Autotelic personality 0.45 .064 .434 5-point scale ranging from 1 (not at all proficient) to 5
R2 .355 .426 (extremely proficient). Only the participants who scored 4 or
F 43.32 48.52
DR2 –– .071 above on the scale were invited to join Study 3. To encour-
DF –– 48.44 age honest self-reporting, we masked the inclusion–exclusion
Note. N ¼ 400. criterion by adding two filler demographic items (i.e., age
 p < .05.
and ethnicity).

Figure 2. Mediation model for autotelic personality (Time 1), flow proneness (Time 1) in maintenance, work, and leisure domains, and satisfaction with life (Time
2). Standardized path coefficients, standardized factor loadings, residual variances, and disturbances are presented. Whereas the number between autotelic person-
ality and satisfaction with life represent the standardized total effect, the number in parentheses represent the standardized direct effect. Numbers at the end of an
arrow pointing to each endogenous variable represent error/disturbance variance associated with each of them. All coefficients except for the direct effect (b ¼ .03,
p ¼ .782) are statistically significant at p < .001.
10 TSE, LAU, PERLMAN, MCLAUGHLIN

Each eligible participant was then randomly assigned to overwhelming, challenge–skill balanced, and underwhelming,
complete either (a) five three-letter anagram tasks (easy con- respectively.
dition), (b) five five-letter anagram tasks (medium condi-
tion), or (c) five seven-letter anagram tasks (hard
Criterion validity
condition). The anagram tasks in all conditions had the
same procedure: Participants were presented with scrambled We evaluated the criterion validity of the revised APQ based
letters of a word (e.g., BEAHC), and then attempted to put on how well it predicted the intensity of flow states during
the letters in the correct order (e.g., BEACH). The anagram anagram game play (Hypotheses 8a and 8b). We conducted
words have been used and validated with solution time in a hierarchical multiple regression analysis with anagram dif-
previous studies (Kaplan & Carvellas, 1968; Mayzner & ficulty (easy, medium, or hard), autotelic personality, and
Tresselt, 1958). After completing the five tasks, participants their interaction term as predictors of flow state.
filled out a short questionnaire asking about the feelings First, we predicted flow state with anagram difficulty. The
that came up during the anagram tasks. main effect of anagram difficulty was significant, R2 ¼ .084,
F(2, 236) ¼ 10.83, p < .001. We then entered the APQ into
the model and found that the APQ predicted flow state
Measures above and beyond anagram difficulty, b ¼ 0.26, SE ¼ 0.04,
Autotelic Personality Questionnaire. We used the 26-item b ¼ .41, p < .001, 95% CI of b [0.19, 0.33]. Furthermore,
APQ revised in Study 2. autotelic personality accounted for 17% of the additional
Flow state. Flow state when solving the anagrams was variance of flow state, DR2 ¼ .17, DF(1, 235) ¼ 51.64,
measured by the Flow State Scale–2 (FSS–2; Jackson & p < .001. Consistent with Hypothesis 8a, when solving the
Eklund, 2002). The scale included 36 items that represented same set of anagrams, highly autotelic people experienced
the nine dimensions of flow experience. Participants more flow state than people scoring low in autotelic
responded with the degree to which they disagreed or agreed personality.
with each statement on a 5-point Likert scale ranging from Finally, we entered the interaction term between anagram
1 (totally disagree) to 5 (totally agree). A high score indi- difficulty and autotelic personality into the model as a pre-
cated that the respondent was in an intense flow state while dictor. The interaction effect on flow state was significant,
completing the anagram tasks. The Cronbach’s alpha DR2 ¼ .02, DF(2, 233) ¼ 3.07, p ¼ .048. Figure 3 shows the
was .90. interaction effect between anagram difficulty and autotelic
Challenge and skill levels. Perceived challenge and skill personality on flow state. Specifically, the effect of autotelic
of the anagram task were measured by two items: “How personality on flow state was small in the easy condition,
challenged/skilled did you feel when you were solving the b ¼ 0.15, SE ¼ 0.06, p ¼ .019, b ¼ .23, 95% CI of b [0.02,
anagrams?” These items were rated on a 7-point Likert scale, 0.27]; but moderate in the medium condition, b ¼ 0.36,
ranging from 1 (not at all) to 7 (extremely). Challenge–skill SE ¼ 0.07, p < .001, b ¼ .56, 95% CI [0.23, 0.49]; and the
difference was computed by subtracting perceived skill score hard condition, b ¼ 0.30, SE ¼ 0.06, p < .001, b ¼ .46, 95% CI
from perceived challenge score. A positive value of challen- [0.18, 0.42]. The results support Hypothesis 8b, indicating
ge–skill difference score indicated that the person perceived that people scoring low in autotelic personality had an even
the challenges of the game to be higher than the skills lower intensity of flow state in the medium and
she had. hard conditions.

Results Discussion
Manipulation check The results support Hypotheses 8a and 8b. First, highly
To examine whether the anagram difficulty was perceived as autotelic people indeed experienced more intense flow state
intended (i.e., easy, medium, and hard), we analyzed partic- across all three conditions compared to those who were low
ipants’ perceptions of challenge and skill level in each condi- in autotelic personality. Second, the effect of autotelic per-
tion. Results from the one-way analysis of variance showed sonality on flow state was stronger in the medium and the
significant differences in challenge–skill balance among the hard conditions than in the easy condition. This means that
conditions, F(2, 221) ¼ 38.00, p < .001, g2 ¼ .26. Subsequent t compared to people low in autotelic personality, the flow
tests revealed that the perceived challenge–skill difference in state of those high in autotelic personality was less affected
the hard condition (M ¼ 1.38, SD ¼ 2.46) was significantly by high challenge, as postulated in previous literature (e.g.,
greater than zero, t(79) ¼ 4.99, p < .001, Cohen’s d ¼ 1.12; Tse et al., 2018).
challenge–skill difference in the medium condition Two of the results are surprising. First, participants
(M ¼ 0.52, SD ¼ 2.33) was not significantly different from reported the most intense flow state in the easy condition
zero, t(64) ¼ 1.81, p ¼ .075, Cohen’s d ¼ 0.45; and challen- rather than in the medium condition. Similar to our results,
ge–skill difference in the easy condition (M ¼ 1.77, a study on soccer players also found no significant differ-
SD ¼ 2.22) was significantly smaller than zero, t(78) ¼ 7.08, ence in flow state among the soccer players between the
p < .001, Cohen’s d ¼ 1.60. In short, participants indeed per- easy condition (indicated by winning a game) and the chal-
ceived the hard, medium, and easy anagrams as lenge–skill balanced condition (indicated by drawing a
AUTOTELIC PERSONALITY QUESTIONNAIRE 11

Figure 3. Flow state as a function of autotelic personality (APQ) in easy, medium, and hard conditions.

game; Bakker, Oerlemans, Demerouti, Slot, & Ali, 2011). literature (e.g., Keller & Blomann, 2008; Ullen et al., 2012),
The authors explained that the soccer players might confuse highly autotelic individuals, as identified by the APQ, are
happiness after winning a game with the implicit enjoyment more conscientious, extraverted, and open to experience;
of playing the sport. In our study, it was also possible that have a higher internal LOC; and are less likely to be neur-
participants confused enjoyment of the process of complet- otic. The findings provide support for the conver-
ing the anagrams with the enjoyment after completing the gent validity.
anagrams. Further investigation is necessary to understand The evidence regarding the discriminant validity of the
the prevalence of this confusion. APQ, however, is less clear in our study. Contrary to our
The second surprising result was that the effect size of hypothesis, the APQ was positively associated with agree-
the interaction between autotelic personality and task diffi- ableness, but this positive relationship between agreeableness
culty was small (DR2 ¼ .02). This might be explained by the and the APQ was not significant after accounting for the
fact that autotelic individuals are supposed to enjoy both other four personality factors. This finding is consistent with
easy (i.e., boring) and difficult tasks more than their coun- Ullen and colleagues’ (2012) work, in which they found
terparts, and thus the difference in the challenge level of the agreeableness did not significantly predict flow proneness
anagram tasks did not have a great impact on their flow when the other four personality traits were in the model.
states, as evidenced by the comparatively strong main effect Nonetheless, we acknowledge the shortcoming of stepwise
that autotelic personality had on flow state (DR2 ¼ .17). regression, particularly when the predictors are collinear
(Howell, 2012). Therefore, we consider this finding as only
weak evidence of discriminant validity. It is also noteworthy
General discussion
that the correlation between the APQ and growth mindset
These studies developed and assessed the reliability and val- was small despite its statistical significance (r ¼ .13), espe-
idity of a self-report scale measuring autotelic personality. cially when compared to the correlation between the APQ
We were motivated to develop the APQ because existing and internal LOC (r ¼ .48). This suggests that, whereas
operationalizations of autotelic personality either yield highly autotelic people have a strong general sense of agency
inconsistent experiential and behavioral outcomes (Young, over life events, they might not necessarily hold a specific
2011) or measure the outcomes instead of the essential fea- belief about the malleability of intelligence.
tures of autotelic personality (Baumann, 2012). Based on the Previous studies have used the Big Five personality traits
metaskills model and the receptive–active model, we devel- to predict flow proneness (Ross & Keiser, 2014; Ullen et al.,
oped a 26-item APQ that covered seven core attributes of 2012). In our study, the APQ significantly predicts flow
autotelic personality. proneness above and beyond the five personality traits, sug-
The APQ scores showed adequate longitudinal invariance gesting that the scale has good incremental validity. In add-
and test–retest reliability. Consistent with the existing ition, as suggested by the literature on flow experience and
12 TSE, LAU, PERLMAN, MCLAUGHLIN

subjective well-being (e.g., Bassi et al., 2014), APQ scores reliable results with other age groups. Future validation of
positively predict satisfaction with life through the mediation the APQ is necessary to evaluate its validity with more
of flow proneness. This also suggests good criterion validity. diverse samples, such as older adults and adolescents. In
These findings advance the literature in two ways. First, addition, we had no control over the environments of the
aside from the general traits, our results suggest a promising participants while they participated in our study on MTurk.
research direction for flow researchers to further investigate The lack of control might have, for example, affected the
the attributes in the APQ that predict flow proneness and experiment in Study 3, in which participants’ level of atten-
flow state. Second, to the best of our knowledge, our study tion would have influenced their performance in solving the
is the first to examine the relationship between individual anagrams. These factors could have altered their flow states,
attributes (autotelic personality) and satisfaction with life confounding the results (Csikszentmihalyi, 1990, 1997). A
through flow proneness. The findings suggest that, at least replication of Study 3 in a highly controlled laboratory set-
for people with certain attributes such as curiosity and per- ting would be sufficient for eliminating this poten-
sistence, being able to frequently engage in and enjoy daily tial limitation.
activities is a viable pathway for higher subjective Another limitation stemmed from the cross-sectional
well-being. design of our study. We examined the relationship between
Finally, we found that highly autotelic individuals, as the APQ and flow proneness to evaluate the criterion valid-
identified by the APQ, were more likely to enter the flow ity in Study 2. However, because flow proneness is mani-
state and consistently reported more intense flow state fested in one’s daily life, a one-time survey might not
across all three conditions of the anagram tasks than those accurately capture this construct due to potential recall bias
who were less autotelic, providing support for criterion val- (Hektner, Schmidt, & Csikszentmihalyi, 2007; Sudman et al.,
idity. It is also consistent with Tse and colleagues’ (2018) 1996). For future research, we hope to incorporate the ESM
findings; individuals who are more prone to experiencing to capture the frequency of flow experience over a long
flow are more likely to be able to enjoy difficult challenges. period of time (e.g., a week). Furthermore, ESM data will
allow us to examine participants’ flow proneness while they
are engaging in a wider range of activities over the course of
Limitations and future research
a week, yielding more ecologically valid results (Hektner
We encountered some limitations at the item generation et al., 2007). In short, the ESM will allow us to evaluate the
stage. First, there have been very few empirical studies on criterion validity of the APQ scores with enhanced precision
either the receptive–active model or the metaskills model. and ecological validity.
Second, not all seven attributes included in the APQ were
rated essential by both SMEs. These limitations suggest that
Theoretical and practical implications
although flow experience has been studied extensively
(Nakamura & Csikszentmihalyi, 2002), the advancement of The APQ is a theory-driven and cost-effective self-report
our knowledge on autotelic personality awaits. Given that measure of autotelic personality that can be administered
the literature on autotelic personality is still at its early stage relatively easily compared to some existing measurements,
of development, it is likely that other important components providing a more efficient way for researchers to study auto-
of autotelic personality are yet to be discovered or that some telic personality and thus catalyzing research in this field.
of the identified attributes of autotelic personality are With the APQ, researchers could also begin to answer ques-
deemed nonessential by others. For example, although tions about the development of autotelic personality. For
intrinsic motivation is generally considered an important example, what type of environment shapes the attributes of
component of autotelic personality, some studies have autotelic personality and to what extent are these attributes
shown that flow experience can also be induced in extrinsic- malleable (Rathunde, 1997)? An informative follow-up study
ally motivating contexts (e.g., Csikszentmihalyi, 1975, p. could examine the stability and change of autotelic personal-
133). Therefore, it is important to note that the APQ should ity throughout one’s life span, thus better informing us
not be considered a static interpretation of autotelic person- about the dynamic of life span flow development.
ality; rather, it is our hope that the APQ will ignite further In conclusion, we developed and validated the 26-item
investigation on this inherently complex construct. We rec- APQ as an alternative to measuring autotelic personality
ognize that as our understanding of autotelic personality through the existing projective test or the proxy (flow
progresses, measurements better capturing this construct’s proneness) scales. Although these three studies using the
essential attributes might emerge alongside it. APQ suggest that more evidence is required in support of
The use of an MTurk sample contributes to some limita- the discriminant validity, cohesive evidence of its reliability,
tions to these studies. Although the MTurk worker popula- structural validity, convergent validity, and criterion validity
tion is a reasonably diverse sample for this word, it does not suggest that the APQ is a promising questionnaire for study-
cover certain demographic groups adequately (e.g., adoles- ing dispositions that facilitate engagement and enjoyment in
cents; Mesurado & de Minzi, 2013). For example, although daily activities. Therefore, we believe this new measure has
we might conclude that the APQ has been validated with the potential to be a good instrument for measuring auto-
the age group of those between 20 and 60, we do not have telic personality—the essential set of attributes that facilitate
sufficient evidence to show that this scale will provide the experience of flow in daily life.
AUTOTELIC PERSONALITY QUESTIONNAIRE 13

Acknowledgments Dillman, D. A. (2007). Mail and Internet surveys: The tailored design
method (2nd ed.). Hoboken, NJ: John Wiley & Sons, Inc.
All data have been made publicly available via the Open Science Dweck, C. S., Chiu, C. Y., & Hong, Y. Y. (1995). Implicit theories and
Framework and can be accessed at osf.io/cs4xj. A portion of this article their role in judgments and reactions: A word from two perspec-
was presented at the Western Psychological Association Convention, tives. Psychological Inquiry, 6, 267–285.
April 2017, Sacramento, CA. The authors acknowledge the invaluable Dweck, C., & Master, A. (2009). Self-theories and motivation: Student’s
comments on an earlier version of this article made by Mihaly beliefs about intelligence. In K. R. Wentzel & A. Wigfield (Eds.),
Csikszentmihalyi, Jeanne Nakamura, Jason T. Siegel, Kathryn Doiron, Handbook of motivation in the school (pp. 123–140). New York, NY:
and Mark Rinella. Routledge.
Fisher, R. J. (1993). Social desirability bias and the validity of indirect
questioning. Journal of Consumer Research, 20, 303–315.
Hektner, J. M., Schmidt, J. A., & Csikszentmihalyi, M. (2007).
Experience sampling method: Measuring the quality of everyday life.
Thousand Oaks, CA: Sage.
Hooker, K., & McAdams, D. P. (2003). Personality reconsidered: A
new agenda for aging research. The Journals of Gerontology Series B:
Psychological Sciences and Social Sciences, 58, P296–P304.
Hooper, D., Coughlan, J., & Mullen, M. R. (2008). Structural equation
modeling: Guidelines for determining model fit. Electronic Journal
of Business Research Methods, 6, 53–56.
Howell, D. C. (2012). Statistical methods for psychology (8th ed.).
References Belmont, CA: Cengage Learning.
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in
Asakawa, K. (2004). Flow experience and autotelic personality in covariance structure analysis: Conventional criteria versus new alter-
Japanese college students: How do they experience challenges in natives. Structural Equation Modeling, 6(1), 1–55.
daily life? Journal of Happiness Studies, 5, 123–154. Jackson, S. A., & Eklund, R. C. (2002). Assessing flow in physical activ-
Bassi, M., Steca, P., Monzani, D., Greco, A., & Delle Fave, A. (2014). ity: The Flow State Scale-2 and Dispositional Flow Scale-2. Journal
Personality and optimal experience in adolescence: Implications for of Sport & Exercise Psychology, 24, 133–150.
well-being and development. Journal of Happiness Studies, 15, John, O. P., Donahue, E. M., & Kentle, R. L. (1991). The Big Five
829–843. Inventory–Versions 4a and 54. Berkeley: University of California,
Bakker, A. B., Oerlemans, W., Demerouti, E., Slot, B. B., & Ali, D. K. Berkeley, Institute of Personality and Social Research.
(2011). Flow and performance: A study among talented Dutch soc- Johnson, J. A., Keiser, H. N., Skarin, E. M., & Ross, S. R. (2014). The
cer players. Psychology of Sport and Exercise, 12, 442–450. Dispositional Flow Scale–2 as a measure of autotelic personality: An
Ballard, R. (1992). Short forms of the Marlowe-Crowne social desirabil- examination of criterion-related validity. Journal of Personality
ity scale. Psychological Reports, 71(3_suppl), 1155–1160. Assessment, 96, 465–470.
Baumann, N. (2012). Autotelic personality. In S. Engeser (Ed.), Kaiser, H. F. (1960). The application of electronic computers to factor
Advances in flow research (pp. 165–186). New York, NY: Springer. analysis. Educational and Psychological Measurement, 20(1), 141–151.
Baumann, N., & Scheffer, D. (2010). Seeing and mastering difficulty: Kaplan, I. T., & Carvellas, T. (1968). Effect of word length on anagram
The role of affective change in achievement flow. Cognition and solution time. Journal of Verbal Learning and Verbal Behavior, 7(1),
Emotion, 24, 1304–1328. 201–206.
Cattell, R. B. (1966). The scree test for the number of factors. Kashdan, T. B., Rose, P., & Fincham, F. D. (2004). Curiosity and explor-
Multivariate Behavioral Research, 1, 245–276. ation: Facilitating positive subjective experiences and personal growth
Chen, F. F., Sousa, K. H., & West, S. G. (2005). Teacher’s corner: opportunities. Journal of Personality Assessment, 82, 291–305.
Testing measurement invariance of second-order factor models. Keller, J., & Blomann, F. (2008). Locus of control and the flow experi-
Structural Equation Modeling, 12, 471–492. ence: An experimental analysis. European Journal of Personality, 22,
Cohen, J. (1988). Statistical power analysis for the behavioral sciences 589–607.
(2nd ed.). Hillsdale, NJ: Lawrence Earlbaum Associates. Kline, P. (2016). Principles and practice of structural equation modeling
Collins, A. L., Sarkisian, N., & Winner, E. (2009). Flow and happiness (4th ed.). New York, NY: The Gilford Press.
in later life: An investigation into the role of daily and weekly flow Landh€auszer, A., & Keller, J. (2012). Flow and its affective, cognitive,
experiences. Journal of Happiness Studies, 10, 703–719. and performance-related consequences. In S. Engeser (Ed.),
Crowne, D. P., & Marlowe, D. (1960). A new scale of social desirability Advances in flow research (pp. 65–85). New York, NY: Springer.
independent of psychopathology. Journal of Consulting Psychology, Levenson, H. (1973). Multidimensional locus of control in psychiatric
24, 349–354. patients. Journal of Consulting and Clinical Psychology, 41, 397–404.
Csikszentmihalyi, M. (1975). Beyond boredom and anxiety: Mayzner, M. S., & Tresselt, M. E. (1958). Anagram solution times: A
Experiencing flow in work and play. San Francisco, CA: Jossey-Bass. function of letter order and word frequency. Journal of Experimental
Csikszentmihalyi, M. (1990). Flow. New York, NY: Harper and Row. Psychology, 56, 376–379.
Csikszentmihalyi, M. (1997). Finding flow: The psychology of engage- McCrae, R. R., & Costa, P. T. (1987). Validation of the five-factor
ment with everyday life. New York, NY: Basic Books. model of personality across instruments and observers. Journal of
Csikszentmihalyi, M., & Csikszentmihalyi, I. S. (Eds.). (1988). Optimal Personality and Social Psychology, 52(1), 81–90.
Experience: Psychological studies of flow in consciousness. New York, McCrae, R. R., & John, O. P. (1992). An introduction to the five-factor
NY: Cambridge University Press. model and its applications. Journal of Personality, 60, 175–215.
Csikszentmihalyi, M., Rathunde, K., & Whalen, S. (1993). Talented Mesurado, B., & de Minzi, M. C. R. (2013). Child’s personality and
teenagers: The roots of success and failure. New York, NY: perception of parental relationship as correlates of optimal experi-
Cambridge University Press. ence. Journal of Happiness Studies, 14(1), 199–214.
Deci, E. L., & Ryan, R. M. (1985). The general causality orientations Moneta, G. B. (2004). The flow model of intrinsic motivation in
scale: Self-determination in personality. Journal of Research in Chinese: Cultural and personal moderators. Journal of Happiness
Personality, 19, 109–134. Studies, 5, 181–217.
Diener, E. D., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The Nakamura, J., & Csikszentmihalyi, M. (2002). The concept of flow. In
satisfaction with life scale. Journal of Personality Assessment, 49(1), C. R. Synder & S. J. Lopez (Eds.), Handbook of positive psychology
71–75. (pp. 89–105). New York, NY: Oxford University Press.
14 TSE, LAU, PERLMAN, MCLAUGHLIN

Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010). Running experiments on United States Census Bureau. (2017). Annual estimates of the resident
Amazon Mechanical Turk. Judgment and Decision Making, 5, 411–419. population by single year of age and sex for the United States:
Rathunde, K. (1997). Parent-adolescent interaction and optimal experi- April 1, 2010 to July 1, 2016. Retrieved from https://factfinder.cen-
ence. Journal of Youth and Adolescence, 26, 669–689. sus.gov/faces/tableservices/jsf/pages/productview.xhtml?pid¼PEP_
Ross, S. R., & Keiser, H. N. (2014). Autotelic personality through a 2016_PEPSYASEXN&prodType¼table
five-factor lens: Individual differences in flow-propensity. Personality Ullen, F., de Manzano, O., € Almeida, R., Magnusson, P. K. E.,
and Individual Differences, 59, 3–8. Pedersen, N. L., Nakamura, J., … Madison, G. (2012). Proneness
Rosseel, Y. (2012). lavaan: An R package for structural equation model- for psychological flow in everyday life: Associations with personal-
ing. Journal of Statistical Software, 48, 1–36. ity and intelligence. Personality and Individual Differences, 52,
Shernoff, D. J., Csikszentmihalyi, M., Schneider, B., & Shernoff, E. S. 167–172.
(2003). Student engagement in high school classrooms from the per- Yong, A. G., & Pearce, S. (2013). A beginner’s guide to factor analysis:
spective of flow theory. School Psychology Quarterly, 18, 158–176. Focusing on exploratory factor analysis. Tutorials in Quantitative
Sudman, S., Bradburn, N. M., & Schwarz, N. (1996). Thinking about Methods for Psychology, 9, 79–94.
answers: The application of cognitive processes to survey methodology. Young, S. F. (2011). A person-situation model of employee engagement.
San Francisco, CA: Jossey-Bass. Unpublished master’s thesis. Florida Institute of Technology.
Tse, D. C. K., Fung, H. H., Nakamura, J., & Csikszentmihalyi, C. (2018). Yuan, K.-H., & Bentler, P. M. (2000). Three likelihood-based methods
Teamwork and flow proneness mitigate the negative effect of excess for mean and covariance structure analysis with nonnormal missing
challenge on flow state. Journal of Positive Psychology, 13, 284–289. data. Sociological Methodology, 30(1), 165–200.

You might also like