Professional Documents
Culture Documents
MPIDevelopment and Initial Validation of TH
MPIDevelopment and Initial Validation of TH
To cite this article: Joseph G. Pont erot t o, Alexander W. Fiet zer, Est her C. Fingerhut , Scot t Woerner, Lauren St ack, Danielle
Magaldi-Dopman, Jonat han Rust , Gen Nakao, Yu-Ting Tsai, Nat asha Black, Renaldo Alba, Miraj Desai, Chant el Frazier, Alyse
LaRue & Pei-Wen Liao (2014) Development and Init ial Validat ion of t he Mult icult ural Personalit y Invent ory (MPI), Journal of
Personalit y Assessment , 96:5, 544-558, DOI: 10.1080/ 00223891.2013.843181
Taylor & Francis m akes every effort t o ensure t he accuracy of all t he inform at ion ( t he “ Cont ent ” ) cont ained
in t he publicat ions on our plat form . However, Taylor & Francis, our agent s, and our licensors m ake no
represent at ions or warrant ies what soever as t o t he accuracy, com plet eness, or suit abilit y for any purpose of t he
Cont ent . Any opinions and views expressed in t his publicat ion are t he opinions and views of t he aut hors, and
are not t he views of or endorsed by Taylor & Francis. The accuracy of t he Cont ent should not be relied upon and
should be independent ly verified wit h prim ary sources of inform at ion. Taylor and Francis shall not be liable for
any losses, act ions, claim s, proceedings, dem ands, cost s, expenses, dam ages, and ot her liabilit ies what soever
or howsoever caused arising direct ly or indirect ly in connect ion wit h, in relat ion t o or arising out of t he use of
t he Cont ent .
This art icle m ay be used for research, t eaching, and privat e st udy purposes. Any subst ant ial or syst em at ic
reproduct ion, redist ribut ion, reselling, loan, sub- licensing, syst em at ic supply, or dist ribut ion in any
form t o anyone is expressly forbidden. Term s & Condit ions of access and use can be found at ht t p: / /
www.t andfonline.com / page/ t erm s- and- condit ions
Journal of Personality Assessment, 96(5), 544–558, 2014
Copyright C Taylor & Francis Group, LLC
ISSN: 0022-3891 print / 1532-7752 online
DOI: 10.1080/00223891.2013.843181
Two studies summarize the development and initial validation of the Multicultural Personality Inventory (MPI). In Study 1, the 115-item prototype
MPI was administered to 415 university students where exploratory factor analysis resulted in a 70-item, 7-factor model. In Study 2, the 70-item
MPI and theoretically related companion instruments were administered to a multisite sample of 576 university students. Confirmatory factory
Downloaded by [Kyoto University] at 00:23 21 October 2014
analysis found the 7-factor structure to be a relatively good fit to the data (Comparative Fit Index = .954; root mean square error of approximation
= .057), and MPI factors predicted variance in criterion variables above and beyond the variance accounted for by broad personality traits (i.e., Big
Five). Study limitations and directions for further validation research are specified.
As the world becomes increasingly interconnected through ple and cultures to create multicultural coping styles, thinking
immigration trends, intercultural career opportunities, more styles, perceptions of the world (worldviews), and identities”
accessible travel, and virtual technology, psychologists have (Ramirez, 1999b, p. 30). This multicultural personality con-
devoted research attention to the personal characteristics of in- struct anchored Ramirez’s (1999b) broader model (cognitive
dividuals more likely to adapt successfully to culturally evolv- and cultural flex theory of personality) and was marked by five
ing social contexts (Arnett, 2002; Benet-Martı́nez & Hong, in personal characteristics: (a) cognitive flexibility in adapting to
press). One recent focus of attention has been the construct of the changing educational, work, and community contexts; (b) striv-
“multicultural personality” (Ponterotto, 2010a; Ramirez, 1999b; ing for self-actualization through cross-cultural interaction; (c)
van der Zee & van Oudenhoven, 2000, 2001). Although there evaluating one’s own biases and commitment to community
are three independent models of the multicultural personality, all service and social justice; (d) cultural learning through travel,
draw on the same theoretical tenet: There exists a definable set study, and novel cross-cultural interactions; and (e) creative and
of narrow personality traits that predict cultural adaptability and cognitive flexibility in solving group conflict, drawing on mul-
multicultural effectiveness, and that this subset of traits can be tiple stress coping strategies, and demonstrating high emotional
mapped onto broader trait models of personality such as the Big and social intelligence.
Five. Consistent with long-standing theory and research on the Ramirez (1991, 1999a, 1999b) developed several self-report
incremental validity of narrow personality traits over broad traits measures in an attempt to operationalize his multicultural per-
(Paunonen, Haddock, Forsterling, & Keinonen, 2003), it is ex- sonality construct; however, reports on these measures were not
pected that multicultural personality traits will predict variance published in peer-reviewed outlets and, as a result, have not
in intercultural comfort and multicultural effectiveness above seen widespread use. The construct and predictive validity of
and beyond the variance accounted for by broad trait models the Ramirez multicultural personality model awaits systematic
(Ponterotto, 2008; van der Zee & van Oudenhoven, 2000). research attention.
Ramirez (1991) was likely the first researcher to coin the term The most popular theory of the multicultural personality is
multicultural personality. Working out of the Southwest region that put forth by a team of researchers in the Netherlands whose
of the United States in clinical and educational psychology, academic anchor was personnel and industrial/organizational
Ramirez defined the multicultural personality as the “synthesis psychology. Van der Zee and van Oudenhoven’s (2000) theory
and amalgamation of the resources learned from different peo- of the multicultural personality is anchored around the construct
of “multicultural effectiveness,” which is defined “as success
in the fields of professional effectiveness, personal adjustment
and intercultural interactions” (p. 293). These authors developed
Received March 18, 2013; Revised July 18, 2013.
Gen Nakao and Yu-Ting Tsai are now at Yeshiva University in New York,
the 91-item Multicultural Personality Questionnaire (MPQ) that
NY. Miraj Desai is now at Fordham University at Rose Hill in Bronx, NY. centers around five personality traits: cultural empathy, the abil-
Chantel Frazier is now at Texas A & M University in College Station, TX. ity to empathize with culturally diverse individuals; emotional
Address correspondence to Joseph G. Ponterotto, Division of Psychological stability, the ability to stay calm and collected under stressful
and Educational Services, Graduate School of Education, Fordham University conditions; social initiative, approaching social situations in an
at Lincoln Center, 113 West 60th St., Room 1008, New York, NY 10023-7478; active manner and taking initiative in such situations; open-
Email: ponterotto@fordham.edu mindedness, being open and nonjudgmental regarding diverse
544
MULTICULTURAL PERSONALITY INVENTORY 545
cultural groups and variant worldviews; and flexibility, an at- Helms, 1990); ethnic identity development (Phinney & Ong,
titude of seeing new situations as positive challenges and the 2007); gay and lesbian identity models (McCarn & Fassinger,
ability to adapt behavior to fit cultural contexts. Recent integra- 1996); the universal-diverse orientation model (Miville et al.,
tive reviews of roughly 40 empirical studies that incorporated 1999); the expansionist theory of gender roles (Barnett & Hyde,
the MPQ have generally supported both the five-factor struc- 2001); and culturally indigenous models of mental health, par-
tural validity of the model as well as its incremental validity in ticularly African psychology (Jones, 2003; Myers, 1993), Na-
predicting score variance on cultural-related criterion variables tive American spirit perspectives (Duran, 2006), and Eastern
above and beyond the variance accounted for by the Big Five philosophy (Huang, 2010). Detailed descriptions of the mod-
(see Matsumoto & Hwang, 2013; Ponterotto, 2008; Ponterotto els and specific research emanating from them are discussed
& Fietzer, in press). in Ponterotto (2010a), as is the rationale for incorporating the
A limitation of the MPQ model is its specific focus on adult models in building his multicultural personality theory. To sum-
expatriates and international students involved in international marize the collective research briefly, those individuals who
sojourns. The model is not intended for broad applicability to score higher on measures of the constructs tend to report higher
adolescents and adults living in culturally evolving and shift- levels of multicultural exposure and competence, less prejudice,
ing communities. As such, there is a strong need for a mea- higher self-esteem and life satisfaction, and more self-efficacy,
sure of the multicultural personality applicable to individuals cognitive flexibility, and work and academic engagement.
living within their culturally diverse communities and not nec- Ponterotto’s (2010a) model assumes that its constituent fac-
essarily traveling abroad. Theory advancement and knowledge tors (personality traits) fall at a third level of the pyramid hier-
acquisition are facilitated by investigating variant models and archy of personality. At the first level is a higher order general
instruments studying the same general construct. Then, over factor of personality with a positive and negative pole (Rushton,
Downloaded by [Kyoto University] at 00:23 21 October 2014
multiple research studies, construct clarity and best instrumen- Bons, & Hur, 2008). The positive end of the continuum is most
tation emerges. Good examples of how competing models in characterized by prosocial behavior, cooperation, and emotional
multicultural psychology advance the science of psychology stability, whereas the negative end of the pole is represented
are the variations and multiple instruments measuring the con- by an overall state of inefficiency and antagonism. The second
structs of acculturation, racial and ethnic identity development, level of the personality hierarchy would be represented by broad
and multicultural counseling competence (see Gamst, Liang, models of personality such as the Big Three (Positive Emotion-
& Der-Karabetian, 2011; Ponterotto, 2008). Testing alternate ality, Negative Emotionality, and Constraint; Tellegen, 1982), or
models of the multicultural personality aimed at a broad audi- the Big Five (Extraversion, Agreeableness, Conscientiousness,
ence could markedly advance the status of theory and research Neuroticism, and Openness; Costa & McCrae, 1992). A third
on the construct. level of personality would be the narrow traits of the multicul-
The studies described herein focus on operationalizing Pon- tural personality model represented by the van der Zee and van
terotto’s (2010a) theory of the multicultural personality. Work- Oudenhoven (2000) model or Ponterotto’s (2010a) model. Mul-
ing in the Northeastern region of the United States, this model ticultural personality traits “represent expressed links between
is anchored in the specialties of counseling and positive psy- broad dispositional traits (e.g., extraversion, neuroticism) and
chology, and maintains a hygiology perspective with a focus on adaptive cognition and behavior in culturally heterogeneous so-
average (“normal,” rather than “pathological”) persons working cieties” (Ponterotto, 2010a, p. 718).
to develop social and personal resources to maximize quality of As more narrow personality traits, the multicultural personal-
life in diverse contexts (Lent, 2004; Lopez & Edwards, 2008). ity factors are akin to the constructs of characteristic adaptations
The theory is further anchored in evolutionary psychology (A. (Costa & McCrae, 1994), personal action constructs (Little,
H. Buss, 2012; D. M. Buss, 2009; Millon, 2004) and the environ- 1999), and middle-level personality units (D. M. Buss & Cantor,
ment of evolutionary adaptedness (EEA) model that specifies 1989). Among the specific characteristics of the multicultural
three human needs central to social life adaptedness: sustaining personality are emotional stability, higher levels of racial and
a basic sense of autonomy, achieving instrumental competence ethnic identity development, a desire for cross-cultural interac-
through manipulation of the environment, and forming coopera- tions, a sense of humor, a spiritual essence, and a commitment
tive relationships across a broad spectrum of humans (McAdams to social justice issues (Ponterotto, 2010a; Ponterotto et al.,
& Pals, 2006; Ponterotto, 2010a). The theory also builds on inte- 2006).
grative holistic frameworks for promoting human development The hygiology model of the multicultural personality posits
in social-cultural contexts (Bronfenbrenner, 1977; McAdams & trait relationships with proximal, medial, and distal variables
Pals, 2006). and thus provides a nomological net for model testing. At the
In addition to broad anchoring in counseling, positive, evo- proximal level, criterion variables would include extent of cross-
lutionary, and developmental psychology, Ponterotto’s model cultural interactions, multicultural awareness, and appreciating
(Ponterotto, 2010a; Ponterotto, Utsey, & Pedersen, 2006) inte- diverse cultural perspectives. At the medial level, the model pre-
grated specific bodies of multicultural theory and research iden- dicts trait correlations with nonspecific multicultural constructs
tified after an extensive literature review on cultural identity such as general self-efficacy and cognitive flexibility. Finally,
and multicultural competence. Ten specific models of research at the distal level the multicultural personality expects positive
integrated included the multicultural personality conceptions of relationships with general quality of life indicators such as self-
Ramirez (1999b) and van der Zee and van Oudenhoven (2000, esteem and life satisfaction. It is expected that trait correlations
2001), as well as the following eight content areas: the toler- with proximal variables will be strong (large effect size), with
ant personality model (Allport, 1979); the coping with cultural medial variables, moderate (medium effect size), and with distal
diversity model (Coleman, 1995); racial identity models (e.g., variables, modest (small effect size).
546 PONTEROTTO ET AL.
STUDY 1: ITEM SELECTION AND FACTOR STRUCTURE centered on item comprehension, domain representation, and
Purpose possible negative wording of some items. This process resulted
in the removal of 13 items that seemed unclear or redundant,
The purpose of Study 1 was twofold: (a) to operationalize the rewriting and clarification of a number of items, and the
the Ponterotto (2010a) model of the multicultural personality addition of four new items, resulting in a pool of 115 items.
through the development and content validation of scale items, Of this pool of items, 13 are negatively worded. The primary
and (b) to subject the initial pool of items to a development criterion in deciding on positively or negatively worded items
sample for the purpose of exploratory factor analysis (EFA) and was the comprehensibility and clarity of the item.
factor identification.
sample size when the population size is known was utilized. analyses if it was eliminated prematurely.
With the known university population size of 15,000 students, Given some overlap between factors was expected, oblique
a representative sample should include a minimum of 375 stu- rotation seemed a superior choice. Thus, the factor solution for
dents. To be on the safe side, Charter and colleagues (Charter, our data set was the PCA with the oblimin rotation and Kaiser
1999; Ponterotto & Charter, 2009) recommend sample sizes of normalization. Thirty factors reached eigenvalues above unity,
400 or more in measurement research. the scree test indicated 6 or 7 factors, and the parallel analy-
Factor extraction was guided by a theoretical-empirical ap- sis indicated 11 factors. We subsequently forced and examined
proach (Dawis, 1987) where theory guided interpretation of fac- oblimin rotations specifying 6 through 11 factors.
tors and empirical methods identified robust factors and strong The most interpretable solution was the six-factor PCA,
items. Theoretically, extracted factors should be consistent which retained 66 items and accounted for 35.2% of the vari-
with the model of multicultural personality (Ponterotto, 2010a; ance. Component 1 (11 items; eigenvalue = 15.35) explained
Ponterotto et al., 2006). Both the scree test (Cattell, 1966) and 13.3% of the common variance and included a majority of the
parallel analysis (O’Connor, 2000) were considered in deter- items focusing on racial and ethnic identity. Component 2 (14
mining the number of clearly interpretable factors. Although items; eigenvalue = 7.87; 6.9% variance) included the psycho-
parallel analysis is often an accurate estimate of the number of logical health items; Component 3 (15 items; eigenvalue = 6.71;
interpretable factors, the procedure can overestimate the num- 5.7% variance) included the social justice and activism items;
ber of factors when the sample size is large (Buja & Eyuboglu, Component 4 (10 items; eigenvalue = 3.66; 3.2% variance) in-
1992; Ruscio & Roche, 2012; Stevens, 2002). cluded the spirituality and connectedness items; Component 5
With regard to minimal component loadings, it was decided (8 items; eigenvalue = 3.53; 3.1% variance) combined items
not to limit selected items to very stringent criteria (e.g., .50) from the humor cluster and from the expanded gender role and
at this early stage of MPI development. It was expected that sexual orientation network clusters; and Component 6 (8 items;
factor loadings would be statistically significant at α = .01 eigenvalue = 3.27; 2.9% variance) included the culturally di-
(two-tailed test) and practically significant; that is, by sharing verse friendship items. Except for Component 5, which inter-
15% of variance with its factor (Stevens, 2002). For our sample mixed items from multiple constructs, the component matrix
of 400+, factor loadings of .26 are statistically significant and was theoretically consistent with the multicultural personality
loadings of .39 are practically significant (as calculated with model.
Stevens’s guidelines and formulas). It was also decided that all After close examination of Component 5, it was decided
components should contain a minimum of six items and reach to break the component into two separate factors, one deal-
a coefficient alpha of .70 or higher (Ponterotto & Ruckdeschel, ing with humor, and the other dealing with opposite-gender
2007). Finally, a goal was for the EFA solution to reach the and sexual orientation connections. Humor is an integral part
Kaiser–Meyer–Olkin measure of sampling adequacy statistic of of multicultural interactions in that it often requires an abil-
.80 or higher (considered “great or superb”; Field, 2009, p. 659), ity to view situations from different perspectives, and that an
as well as a statistically significant Bartlett’s test of sphericity ability to laugh at one’s self allows one to critique one’s own ac-
result. tions, both skills considered crucial in multicultural competency
(Allport, 1979; Ponterotto et al., 2006). Further, openness and
Factor structure and item loadings. The type of extrac- meaningful connections with members of the opposite gender
tion method used to examine latent factor structures, whether and sexual orientation are salient to higher levels of multicul-
principal axis factoring (PAF) or principal components analysis tural personality development (Ponterotto, 2010a). Items were
(PCA), is a polemical topic among statisticians. Numerous au- added to each cluster to bring each up to at least six items (the
thors (e.g., Clark & Watson, 1995; Meyers, Gamst, & Guarino, added items were among the original 115 MPI items but had not
2006; Stevens, 2002) however, have suggested that there is little reached a sufficient loading originally). Given the early stage
548 PONTEROTTO ET AL.
of the research it was important to develop potentially robust emerged as robust and independent traits. This finding is not
factors with sufficient numbers of items that could maintain in- surprising as there is considerable overlap among the models.
ternal consistency over subsequent samplings (see Ponterotto & For example, it is understandable that Allport’s (1979) tolerant
Ruckdeschel, 2007). personality would relate to higher stages of racial identity devel-
In this case the authors used theoretical judgment to modify opment (e.g., Helms’s [1990] Internalization stage). The find-
the empirical output of the factor model. The PCA was then ings reported here indicated that the seven MPI factors had sat-
rerun on the final pool of 70 items, and all loaded clearly on isfactory internal consistency. Consistent with theory, the seven
their respective assigned components. Total variance accounted factors were only minimally intercorrelated, supporting the in-
for in the revised model was 46.83%. Subscale 1 included 11 dependent value of these separate factors. As a single-campus
items (eigenvalue = 10.58; 15.11% variance) and included all study, these findings were preliminary. The goal of Study 2 was
racial and ethnic identity items (sample item: “I have given to administer the 70-item MPI to a broader and larger sample to
considerable thought to what it means to be part of my racial test convergent validity and confirm the structural model.
group(s)”); Subscale 2 included 15 items (eigenvalue = 6.34;
9.07% variance) focusing on social justice and activism (“I have STUDY 2: CONFIRMATORY FACTOR ANALYSIS,
verbally confronted a close family member or friend who has CONVERGENT VALIDITY, AND RELIABILITY PURPOSE
made racist comments or who has shared a racist joke”); Sub- The purpose of Study 2 was to assess the construct validity
scale 3 included 14 items (eigenvalue = 5.22; 7.45% variance) of the 70-item, seven-factor MPI with a larger and more di-
that all focused on psychological health (“During my life I have verse college sample than what was gathered in Study 1. More
experienced a number of serious bouts of depression” [reverse- specifically, this study (a) assessed the goodness-of-fit of the
scored]); Subscale 4 included 11 items (eigenvalue = 3.04;
Downloaded by [Kyoto University] at 00:23 21 October 2014
TABLE 1.—Pattern coefficient matrix from the principal component analysis with direct oblimin rotation, mean, standard deviation, skewness, and communality
for the Multicultural Personality Inventory.
Factor
Item RID SJA PH CS Hum OGC CDF M SD Skew Comm
114 .79 −.03 .05 .02 .05 −.06 .11 3.67 1.13 −.60 .677
45 .77 −.18 −.02 .00 .04 .07 −.04 3.51 1.22 −.43 .597
43 .73 .12 −.01 .04 −.10 −.13 −.06 3.56 1.18 −.52 .618
54 .71 −.03 .14 .02 .05 .07 .07 3.41 1.15 −.35 .574
22 .71 .09 .06 −.03 −.03 .03 −.01 3.71 1.10 −.67 .530
89 .70 .14 .08 −.09 −.05 .01 .07 3.67 1.05 −.68 .525
72 .68 .15 −.01 .09 −.11 −.06 −.03 3.57 1.19 −.51 .589
74 .66 .07 .13 .01 −.04 −.07 .16 3.86 .99 −.97 .551
40 .63 −.04 .07 .07 .08 .10 −.04 3.13 1.09 −.23 .451
17 .57 .08 .11 .02 −.03 .02 .14 4.04 .92 −1.01 .412
31 .48 −.02 −.12 −.03 .04 −.00 −.24 2.59 1.65 .47 .268
39 .03 .73 .01 −.04 .04 −.07 −.09 3.53 1.33 −.57 .535
98 −.09 .72 −.04 −.08 .14 .16 .01 3.92 1.01 −.95 .570
95 .10 .68 −.03 .05 −.02 −.21 −.12 3.69 1.22 −.80 .519
99 −.07 .67 .09 .01 .13 .28 .10 4.30 .79 −1.36 .566
106 .08 .63 .01 .07 −.14 −.08 −.06 3.87 .95 −.67 .474
28 .05 .60 −.04 .03 −.05 −.21 −.17 3.31 1.32 −.34 .432
Downloaded by [Kyoto University] at 00:23 21 October 2014
104 .02 .59 .00 .00 −.07 −.05 .05 4.01 .93 −.92 .346
90 −.25 .57 .09 −.19 .12 .40 .08 4.35 .87 −1.72 .620
67 .18 .54 −.15 −.04 −.05 −.08 .00 3.95 .92 −.72 .343
79 −.12 .51 −.01 −.17 .12 .43 .10 4.09 .99 −1.22 .514
87 .18 .48 .02 .28 −.13 −.11 .01 3.73 1.04 −.55 .460
85 .05 .41 .11 .19 −.17 .00 −.03 4.27 .65 .81 .326
37 .02 .40 −.08 .18 −.19 .00 −.06 4.49 .63 −.98 .281
32 .01 .40 .08 .13 −.07 .09 −.10 4.29 .70 −1.03 .265
71 .09 .30 .07 .19 −.23 .19 .07 4.54 .59 −1.31 .340
108 .03 −.07 .80 −.12 .01 −.02 −.07 3.99 1.02 −.75 .628
47 .06 −.00 .78 .07 −.04 −.12 .05 3.81 .93 −.78 .670
55 .14 −.06 .76 .08 −.06 .04 .13 3.94 .87 −.88 .708
42 .05 .07 .75 −.03 .02 .02 .02 4.03 .95 −.93 .573
62 .08 .03 .73 .07 −.07 −.06 .07 4.10 .80 −.84 .621
100 −.04 −.04 .69 −.04 −.01 −.05 −.06 4.00 .99 −.81 .458
96 .07 −.07 .68 −.20 .12 −.11 −.04 3.58 1.26 −.51 .489
82 .01 .05 .62 .09 −.22 .01 .11 4.19 .77 −1.23 .543
65 .01 −.06 .55 −.18 .18 −.10 −.16 3.62 1.30 −.59 .348
56 −.06 .05 .54 .35 −.12 .00 .03 4.18 .82 −1.24 .493
76 .04 −.04 .50 .04 −.06 .15 .15 3.88 .92 −.85 .337
27 −.05 .14 .45 .18 −.06 .08 −.13 3.73 .98 −.73 .325
38 .04 .02 .40 .08 −.01 .11 −.12 3.87 .96 −.80 .226
103 .00 .04 .36 .21 −.20 .10 .07 3.96 .97 −.87 .315
48 −.19 .08 −.05 .79 .10 .04 −.05 3.08 1.23 −.18 .585
109 −.16 .21 −.07 .79 .08 −.02 .01 3.12 1.29 −.21 .629
57 −.00 .13 −.02 .75 −.08 −.15 −.07 3.62 1.13 −.58 .618
19 .08 −.17 .03 .68 −.10 −.04 .03 3.40 1.24 −.44 .528
23 .12 −.12 −.03 .66 −.02 −.08 −.02 3.21 1.36 −.21 .485
26 .26 .06 .02 .51 .31 .18 .05 2.32 1.15 .58 .508
61 .05 −.02 .11 .50 −.22 .04 .03 4.04 .81 −.89 .384
6 .29 −.02 −.05 .47 .34 .26 .00 2.76 1.22 .165 .515
94 .23 −.00 .05 .45 .25 .19 .02 3.14 1.30 −.12 .399
115 .03 −.03 .07 .45 .08 −.02 −.02 2.65 1.38 .26 .217
21 .29 .01 .04 .43 .04 .03 −.06 3.22 1.20 −.27 .363
60 −.04 .02 .10 −.03 −.73 .09 −.04 4.45 .66 −1.05 .593
44 −.03 .05 .17 −.03 −.68 .09 .02 4.33 .77 −1.11 .561
1 −.02 −.03 .15 −.03 −.63 −.06 .00 4.37 .59 −.46 .440
36 .06 −.01 −.11 −.04 −.53 .08 −.10 4.16 .85 −1.22 .295
91 .09 .18 −.04 −.11 −.44 .13 .13 4.75 .48 −1.85 .300
11 −.01 .07 .12 −.05 −.42 .23 −.12 4.33 .79 −1.33 .319
59 .13 −.10 .02 .04 −.24 .68 −.01 3.99 .99 −.89 .563
24 .06 −.15 .10 .00 −.26 .66 −.06 4.11 1.10 −1.21 .537
73 −.05 −.21 −.07 .01 −.12 .53 −.18 2.43 1.18 .51 .353
86 .07 .12 .08 .12 −.26 .47 .10 4.26 .78 −1.03 .435
93 −.00 .27 −.09 −.10 .12 .45 −.25 2.71 1.35 .39 .424
5 −.14 .33 .11 −.12 .18 .41 −.26 3.38 1.35 −.28 .482
63 .05 .06 −.04 .20 −.22 .36 .14 4.31 .72 −1.13 .295
78 −.06 −.08 .01 .09 −.01 −.05 −.81 2.40 1.23 .68 .643
110 −.17 .00 .06 .02 −.04 −.05 −.71 2.75 1.25 .21 .531
12 .19 .05 .04 .06 −.08 −.07 −.69 3.87 1.11 −.75 .553
14 .26 .14 −.01 .02 −.05 .05 −.64 4.03 1.02 −.96 .524
3 −.18 .16 .03 −.05 −.07 .11 −.46 3.20 1.31 −.13 .337
81 −.10 .04 .00 −.03 .18 .28 −.32 1.85 .89 1.25 .252
Note. Factor loadings > .31 are shown in bold. RID = Racial and Ethnic Identity Development; SJA = Social Justice and Activism; PH = Psychological Health; CS = Connectedness
and Spirituality; Hum = Humor; OGC = Opposite Gender/Sexual Orientation Connection; CDF = Culturally Diverse Friendships; Comm = Communality
550 PONTEROTTO ET AL.
TABLE 2.—Multicultural Personality Inventory (MPI) subscale means, standard deviations, skewness, coefficient alpha, coefficient alpha 95% confidence interval,
coefficient alpha qualitative rating, and subscale intercorrelations.
MPI Subscales # Items M SD Skew α [95% CI] α Inter. RID SJA PH CS HUM OGC CDF
RID 11 3.52 .80 −.46 .89 [.87, .91] Good 1 .16∗∗ .27∗∗ .44∗∗ .10∗ .01 −.05
SJA 15 4.02 .56 −.58 .86 [.84, .88] Moderate −.09 1 .08 .20∗∗ .24∗∗ .36∗∗ .25∗
PH 14 3.92 .61 −.68 .88 [.86, .90] Moderate .07 −.15 1 .19∗∗ .27∗∗ .11∗ .00
CS 11 3.14 .76 −.18 .86 [.84, .88] Good .10 .02 −.07 1 .05 .09 .03
Hum 6 4.40 .47 −.83 .70 [.66, .74] Fair .19 −.25 .05 .07 1 .29∗∗ .08
OGC 7 3.60 .66 −.24 .70 [.66, .74] Poor .28 −.07 .20 .06 .14 1 .32∗∗
CDF 6 3.01 .75 −.14 .74 [.70, .78] Fair .04 .03 −.07 .07 −.03 −.01 1
Note. RID = Racial and Ethnic Identity Development; SJA = Social Justice and Activism; PH = Psychological Health; CS = Connectedness and Spirituality; Hum = Humor; OGC
= Opposite-Gender/Sexual Orientation Connection; CDF = Culturally Diverse Friendships; α Interpretation is based on classical test theory developed “Reliability Matrix for Estimating
the Adequacy of Coefficient Alpha (Ponterotto & Charter, 2009; Ponterotto & Ruckdeschel, 2007); Component correlation matrix was based on principal component extraction method
and oblimin rotation with Kaiser normalization; Subscale correlation matrix uses retained items only.
∗
p < .05. ∗∗ p < .01.
agree) that includes eight positively worded items (e.g., “I can sample (Alexopoulos & Asimakopoulou, 2009). Convergent and
Downloaded by [Kyoto University] at 00:23 21 October 2014
find workable solutions to seemingly unsolvable problems”), discriminant validity of NGSE scores was established through
and four negatively worded items (e.g., “I seldom have choices significant and theoretically expected correlations to measures
to choose from when deciding how to behave”). The CFS yields of leadership, motivation, personal self-efficacy, and self-esteem
a total score that can range from 12 to 72, with higher scores (Chen, Gully, & Eden, 2004).
indicating higher self-rated cognitive flexibility. In the CFS,
cognitive flexibility is defined as an awareness that in any given Big Five Inventory. The Big Five Inventory (BFI; Benet-
situation there are multiple alternatives, by a willingness to be Martı́nez & John, 1998; John, Donahue, & Kentle, 1991; John,
flexible and adapt to a given situation, and by a sense of self- Naumann, & Soto, 2008) is a 44-item Likert-type rating scale
efficacy in being flexible. Over a number of large sample stud- with a scoring range of 1 (strongly disagree) to 5 (strongly
ies, the internal consistency reliability (coefficient alpha) of CFS agree). Sixteen BFI items are negatively worded and distributed
scores has remained satisfactory, ranging between .72 and .83. throughout the five factors of the inventory. The BFI includes
Furthermore, CFS scores correlated significantly and positively the factors (subscales) of Extraversion (8 items; sample item:
with measures of intellectual flexibility, self-compassion, com- “Is talkative”), Agreeableness (9 items; sample item: “Tends
munication competence, and tolerance for disagreement; and to find fault with others” [reverse-scored]), Conscientiousness
they correlated negatively and significantly with measures of (9 items; “Is a reliable worker”), Neuroticism (8 items; sam-
dogmatism, verbal aggression, and Machiavellianism (Martin ple item: “Is relaxed, handles stress well” [reverse-scored]),
& Anderson, 1998; Martin, Anderson, & Thweatt, 1998; Mar- and Openness (10 items; sample item: “Is curious about many
tin & Rubin, 1995; Martin, Staggers, & Anderson, 2011). different things”). Higher scores indicate a higher level of the
self-reported trait. The BFI is a widely used measure of the Big
New General Self-Efficacy Scale. The New General Self- Five, and its subscales correlated highly with other BFI mea-
Efficacy Scale (NGSE; Chen, Gully, & Eden, 2001) scale is sures (e.g., Costa & McCrae, 1992), with rs between .75 and .80.
an 8-item, 5-point Likert-type scale ranging from 1 (strongly Coefficient alphas across the BFI scales are consistently high,
disagree) to 5 (strongly agree). All items are positively worded ranging from .75 to .90, and 3-month test–retest stability coef-
(e.g., “I believe I can succeed at most any endeavor to which ficients range from .80 to .90. Extensive factor-analytic support
I set my mind”). Total score range is 8 to 40, with high scores and criterion-related validity has been established for the BFI
indicating higher self-assessed general self-efficacy. General subscales (see reviews in Benet-Martı́nez & John, 1998; Fossati,
self-efficacy is conceptualized as a trait-like personality con- Borroni, Marchione, & Maffei, 2011; John & Srivastava, 1999).
struct rather than as a task-specific efficacy (e.g., math self-
efficacy), and the construct refers to belief in one’s ability to ac- Universality-Diversity Scale–Short Form. The
cess the motivation, cognitive resources, and specific behavioral Universality-Diversity Scale–Short Form (UDO–SF; Fuertes,
action needed to meet various situational demands as they arise Miville, Mohr, Sedlacek, & Gretchen, 2000; Miville et al.,
(Chen et al., 2001). NGSE scores have been internally consistent 1999) represents “an attitude toward all other persons that is
across multiple American samples, ranging from .85 to .90, and inclusive yet differentiating in that similarities and differences
test–retest stability coefficients across multiple samples have are both recognized and accepted; the shared experience of
averaged .73 for shorter-term intervals (2–3 weeks), and .64 for being human results in a sense of connectedness with people
moderate-length intervals (7–10 weeks; Chen et al., 2001). CFA and is associated with a plurality of diversity of interaction with
of a Greek translation of the NGSE scale administered to Greek others” (Miville et al., 1999, p. 292). The UDO–SF includes
children supported the single-factor structure (Goodness-of-Fit three subscales that assess the three components of UDO theory:
Index [GFI] = .98, Comparative Fit Index [CFI] = .94, and root Diversity of Contact (behavioral component, five items; sample
mean square error of approximation [RMSEA] = .04), although item: “I would like to join an organization that emphasizes
coefficient alphas and stability coefficients were lower with this getting to know people from different countries”), Relativistic
MULTICULTURAL PERSONALITY INVENTORY 551
Appreciation (cognitive component, five items; sample item: Crowne–Marlowe Scale of Social Desirability. The
“Persons with disabilities can teach me things I could not Crowne–Marlowe Scale (Crowne & Marlowe, 1960) is a 33-
learn elsewhere”), and Comfort with Differences (emotional item, true–false self-report measure that assesses “behaviors
component, five items; sample item: “It’s really hard for me which are culturally sanctioned and approved but which are im-
to feel close to a person from another race” [reverse-scored]). probable of occurrence” (Crowne & Marlowe, 1960, p. 350).
Both EFA and CFA supported the three-factor model of UDO. In the development study the authors reported an internal con-
Across seven studies, median coefficient alphas ranged from sistency coefficient (KR–20) of .88, and a 1-month test–retest
.70 to .78 across the three subscales. A number of studies have stability coefficient of .89. Construct validity was supported in
confirmed UDO–SF subscale criterion and incremental validity expected correlations with various Minnesota Multiphasic Per-
in predicting multicultural variables (tolerance, racism, racial sonality Inventory scales (higher for validity scales and lower for
identity level), psychological health variables, and academic pathology scales). In a reliability generalizability study of the
success variables (an integrative review and critique of UDO instrument incorporating 123 internal consistency assessments,
studies is provided in Ponterotto, 2008). Beretvas, Meyers, and Leite (2002) calculated a mean internal
consistency coefficient of .73. Although there is some debate
Utrecht Work Engagement Scale–Student version. The whether the Crowne–Marlowe items are best represented by a
Utrecht Work Engagement Scale–Student version (UWES–S; single- or a two-factor structure, Ventimiglia and MacDonald
Schaufeli & Bakker, 2003) is a 9-item Likert-type scale with (2012) found the one-factor model (used in this study) to be a
score options ranging from 0 (never) to 6 (always or every say). reasonable fit to the data (GFI = .91, RMSEA = .035).
The UWES–S yields a total score of 0 to 54, with higher scores
Downloaded by [Kyoto University] at 00:23 21 October 2014
TABLE 3.—Multicultural Personality Inventory confirmatory factor analysis fit and error indexes.
Jackson et al. (2009) means 678.759 229 3.034 .862 .912 .925 .933 .062 881.582
———————————- ———– ———- ——– ————– ——- ———– ——— ——————– ———-
7-factor model 9353.114 2,256 4.146 .610 .554 .604 .619 .074 [.072, .076] 9671.114
3-item parcels 904.446 231 3.915 .841 .873 .882 .901 .071 [.066, .076] 1042.446
5-item parcels 330.608 114 2.900 .939 .933 .939 .954 .057 [.050, .065] 444.608
Note. N = 576. AGFI = adjusted Goodness-of-Fit Index; NFI = Normed Fit Index; TLI = Tucker–Lewis Index; CFI = Comparative Fit Index; RMSEA = root mean square error of
approximation; AIC = Akaike’s Information Criterion.
indexes calculated by Jackson et al. (2009) and specified previ- Orientation Connection and Social Justice and Activism). The
ously. mean intercorrelation among MPI scales was only .21 (median
Table 3 summarizes the results of the CFA procedures in = .20), supporting the relative independence of the scales and
this study. The first model tested was the seven-factor model the construct validity of the seven-factor model.
that included all items on their assigned factors. This model The correlations between the Big Five broad measures of
achieved a poor fit to the data with low incremental fit indexes personality traits and the seven MPI narrow traits of personality
(NFI = .554, TLI = .604, CFI = .619), and a high RMSEA ranged from a low of .03 (MPI Social Justice and Activism and
(.074; see Table 3). BFI Neuroticism and MPI Opposite Gender/Sexual Orientation
Downloaded by [Kyoto University] at 00:23 21 October 2014
With so many items per factor (6–15 in the case of MPI Connection and BFI Conscientiousness) to a high of –.69 (MPI
factors) and the resultant large number of parameters to be Psychological Health and BFI Neuroticism). The mean inter-
estimated, it is common for such CFAs to evidence a poor correlation across the broad and narrow trait measures was .20
fit (Bagozzi & Heatherton, 1994; Kishton & Widaman, 1994; (median = .17), thus supporting the independence of MPI fac-
Rahim & Magner, 1995; Russell, Kahn, Spoth, & Altmaier, tors relative to the broad measures of personality operationalized
1998). To adjust for this limitation, researchers often create by the BFI. The correlations between the MPI factors and the
aggregate items, also known as item parcels, whereby individ- Crowne–Marlowe Scale of Social Desirability were low, rang-
ual items are aggregated to create a smaller number of items ing from .01 to .31. The only significant correlation reaching
before CFA procedures. The appropriateness of item parcel- a medium effect size was with the MPI Psychological Health
ing has been well articulated in the measurement literature, factor (r = .31).
where it has been noted that the procedure does not impact pa- With regard to the relationship between MPI factors and
rameter bias or standard errors of estimated factor correlations the criterion variables of interest, the pattern and magnitudes
(Nasser & Takahashi, 2003; Nasser-Abu Alhija & Wisenbaker, of correlations are generally consistent with multicultural per-
2006). sonality theory (Ponterotto, 2010a). Table 6 presents the cor-
Aggregation of items is achieved by statistically combining relation magnitudes and significance levels for all criterion
higher loading items with lower loading items in each item par- variables. The MPI Racial and Ethnic Identity factor cor-
cel. In all models, the variance of one observed variable was related most highly with the Miville–Guzman Universality-
set to 1.0 for each latent variable. There were no correlated er- Diversity Scale (MGUDS) Diversity of Contact, MGUDS Rel-
rors or cross-loadings; the pattern of fixed and freed parameters ativistic Appreciation, and General Self-Efficacy. MPI Social
followed those implied by the model. Justice and Activism correlated most highly with MGUDS
We next tested an aggregate three-item parcel model (with Diversity of Contact, MGUDS Relativistic Appreciation, and
each factor reduced to between two and five items), and an MGUDS Comfort with Differences. MPI Psychological Health-
aggregate five-item parcel model (with each factor reduced to correlated most strongly with Self-Esteem, Life Satisfac-
between two and three items). As expected the aggregate models tion, General Self-Efficacy, and Cognitive Flexibility. MPI
evidenced superior fits relative to the simple structure, with
the five-item parcel model reaching a satisfactory fit across all
parameters tested. Specifically, in this model, all fit indexes TABLE 4.—Covariance matrix of the 5-item parcel Multicultural Personality
surpassed the set criteria of matching or improving on the mean Inventory confirmatory factor analysis (variances of each factor are on the
fit indexes identified in Jackson et al.’s (2009) meta-analysis. The diagonal).
covariance matrix for the five-item parcel model is illustrated in
RID SJA PH CS HUM OGC CDF
Table 4.
Table 5 summarizes the descriptive statistics and internal con- RID .505
sistency coefficients across the seven MPI scales as well as for SJA .097 .348
the companion measures used in Study 2. Across the MPI scales, PH .114 .018 .339
coefficient alphas ranged from a low of .65 for Opposite Gen- CS .283 .079 .104 .476
HUM .094 .103 .056 .056 .213
der/Sexual Orientation Connection to a high of .89 for Psycho- OGC .057 .228 .057 .046 .128 .386
logical Health (see Table 5). The correlation matrix for the MPI CDF .036 .069 .014 .002 .028 .108 .002
factors and companion measures is presented in Table 6. MPI
factor intercorrelations with one another ranged from a low Note. RID = Racial and Ethnic Identity Development; SJA = Social Justice and Ac-
tivism; PH = Psychological Health; CS = Connectedness and Spirituality; Hum = Hu-
of .04 (between Psychological Health and Social Justice and mor, OGC = Opposite-Gender/Sexual Orientation Connection; CDF = Culturally Diverse
Activism) to a high of .51 (between Opposite Gender/Sexual Friendships.
MULTICULTURAL PERSONALITY INVENTORY 553
TABLE 5.—Mean, standard deviation, skewness, kurtosis, and coefficient alpha values on MPI subscales, BFI subscales, CMS, MGUDS subscales, CFS, GSES,
UWES, RSES, and the LSS.
MPI
RID 3.63 .76 −.46 .05 .87 [.86, .88] Good
SJA 3.94 .58 −.45 .00 .85 [.84, .86] Moderate
PH 3.90 .62 −.43 −.14 .88 [.87, .89] Good
CS 3.15 .82 −.27 −.42 .87 [.86, .88] Good
HUM 4.34 .57 −1.31 2.90 .78 [.76, .80] Moderate
OGC 3.64 .63 −.31 .01 .68 [.65, .71] Poor
CDF 3.18 .76 .07 −.46 .72 [.69, .74] Fair
BFI
Extra 3.46 .78 −.20 −.35 .83 [.81, .84] Moderate
Agree 3.91 .61 −.48 −.05 .76 [.74, .78] Fair
Consc 3.67 .67 −.23 −.27 .80 [.78, .82] Moderate
Neuro 2.89 .79 −.14 −.58 .83 [.81, .84] Moderate
Open 3.83 .60 −.23 −.38 .78 [.76, .80] Fair
CMS 15.70 5.58 .18 −.38 .80 [.78, .82] Fair
MGUDS
DIV 4.37 .96 −.48 −.16 .78 [.76, .80] Moderate
REL 4.79 .72 −.81 1.45 .73 [.71, .75] Fair
COM 4.95 .76 −.92 .73 .73 [.71, .75] Fair
Downloaded by [Kyoto University] at 00:23 21 October 2014
Note. N = 576. MPI = Multicultural Personality Inventory; BFI = Big Five Inventory; CMS = Crowne–Marlowe Scale of Social Desirability; MGUDS = Miville-Guzman
Universality-Diversity Scale; CFS = Cognitive Flexibility Scale; GSES = General Self-Efficacy Scale; UWES = Utrecht Work Engagement Scale; RSES = Rosenberg Self-Esteem
Scale; LSS = Life Satisfaction Scale; RID = Racial and Ethnic Identity; SJA = Social Justice and Activism; PH = Psychological Health; CS = Connectedness and Spirituality; HUM =
Humor; OGC = Opposite-Gender/Sexual Orientation Connection; CDF = Culturally Diverse Friendships; Extra = Extraversion; Agree = Agreeableness; Consc = Conscientiousness;
Neuro = Neuroticism; Open = Openness; DIV = Diversity of Contact; REL = Relativistic Appreciation; COM = Comfort with Differences.
Connectedness and Spirituality correlated most notably with lated most strongly with MGUDS Comfort with Differences,
MGUDS Diversity of Contact, the UWES, and General Self- MGUDS Diversity of Contact, and Cognitive Flexibility. Fi-
Efficacy. The MPI Humor factor correlated most highly with nally, MPI Culturally Diverse Friendships correlated most
Cognitive Flexibility, General Self-Efficacy, and Self-Esteem. highly with MGUDS Comfort with Differences and MGUDS
MPI Opposite Gender/Sexual Orientation Connection corre- Diversity of Contact. A review of the magnitudes of correlation
TABLE 6.—Correlation matrix of MPI subscales with the BFI subscales, CMS, MGUDS and its subscales, CFS, GSES, UWES, RSES, and LSS.
SJA .22∗∗
PH .24∗∗ .04
CS .46∗∗ .19∗∗ .20∗∗
HUM .24∗∗ .31∗∗ .23∗∗ .14∗∗
OGC .12∗∗ .51∗∗ .13∗∗ .10∗ .34∗∗
CDF .05 .23∗∗ .06 −.05 .10∗ .39∗∗
Extraversion .20∗∗ .20∗∗ .29∗∗ .18∗∗ .36∗∗ .25∗∗ .07
Agreeableness .17∗∗ .15∗∗ .39∗∗ .30∗∗ .12∗∗ .12∗∗ .08
Conscientiousness .16∗∗ .04 .45∗∗ .21∗∗ .06 .03 .05
Neuroticism −.18∗∗ .03 −.69∗∗ −.14∗∗ −.09∗ −.08∗ −.06
Openness .20∗∗ .34∗∗ .16∗∗ .24∗∗ .35∗∗ .32∗∗ .16∗∗
CMS .20∗∗ .01 .31∗∗ .18∗∗ −.01 .07 .12∗∗
DIVCON .42∗∗ .43∗∗ .13∗∗ .37∗∗ .17∗∗ .29∗∗ .31∗∗
RELAPP .27∗∗ .40∗∗ .03 .20∗∗ .13∗∗ .19∗∗ .05
COMDIF .04 .28∗∗ .20∗∗ −.02 .21∗∗ .31∗∗ .41∗∗
CFS .19∗∗ .23∗∗ .47∗∗ .16∗∗ .38∗∗ .26∗∗ .12∗∗
GSES .26∗∗ .08∗ .49∗∗ .24∗∗ .26∗∗ .16∗∗ .06
UWES .22∗∗ .12∗∗ .26∗∗ .31∗∗ .02 .07 .08
RSES .22∗∗ .06 .71∗∗ .22∗∗ .24∗∗ .12∗∗ .01
LSS .04 .05 .49∗∗ .11∗∗ .13∗∗ .17∗∗ .01
Note. N = 576. MPI = Multicultural Personality Inventory; BFI = Big Five Inventory; CMS = Crowne–Marlowe Scale of Social Desirability; MGUDS = Miville-Guzman
Universality-Diversity Scale; CFS = Cognitive Flexibility Scale; GSES = General Self-Efficacy Scale; UWES = Utrecht Work Engagement Scale; RSES = Rosenberg Self-Esteem
Scale; LSS = Life Satisfaction Scale; RID = Racial and Ethnic Identity; SJA = Social Justice and Activism; PH = Psychological Health; CS = Connectedness and Spirituality; HUM =
Humor; OGC = Opposite-Gender/Sexual Orientation Connection; DIVCON = Diversity of Contact; RELAPP = Relativistic Appreciation; COMDIF = Comfort with Differences.
∗
p < .05. ∗ ∗ p < .01.
554 PONTEROTTO ET AL.
TABLE 7.—Hierarchical multiple regression predicting CFS, GSES, LSS, RSES, DIVCON, RELAPP, COMDIF, and UWES from gender, the Big Five personality
variables, and the Multicultural Personality Inventory–70 subscales.
Outcome Variables
CFS GSES LSS RSES
Predictor R2 β R2 β R2 β R2 β
Note. CFS = Cognitive Flexibility Scale; GSES = General Self-Efficacy Scale; LSS = Life Satisfaction Scale; RSES = Rosenberg Self-Esteem Scale; DIVCON = Diversity of
Contact; RELAPP = Relativistic Appreciation; COMDIFF = Comfort with Differences; UWES = Utrecht Work Engagement Scale; RID = Racial and Ethnic Identity. SJA = Social
Justice and Activism. PH = Psychological Health. CS = Connectedness and Spirituality. HUM = Humor. OGC = Opposite Gender/Sexual Orientation Connection. CDF = Culturally
Diverse Friendships.
∗∗∗
p < .001.
coefficients reveals that the majority would be classified as were entered into Step 3. Table 7 presents a summary of the re-
reaching small to medium effect sizes (Cohen, 1988). sults across the hierarchical models. Across the eight hierarchi-
A major theoretical tenet of multicultural personality theory cal regressions, the Step 1 variables accounted for statistically
(Ponterotto, 2010a; van der Zee & van Oudenhoven, 2000, 2001) significant, although negligible amounts of variance in seven
is that the narrow multicultural adaptation traits provide incre- out of eight tests. Variance accounted for ranged from 0.9%
mental variance (validity) in predicting relationships with salient (MGUDS Relativistic Appreciation) to 10.5% for Utrecht Aca-
criterion variables above and beyond the variance accounted for demic Engagement. However, of the 16 beta weights reported
by broad measures of personality such as the Big Five. To test in Step 1, only -Social Desirability- for the Utrecht Academic
this component of Ponterotto’s (2010a) multicultural personality Engagement criterion reached statistical significance.
theory, hierarchical regression models were executed across the In Step 2, the Big Five factors added incremental variance
eight criterion variables of interest. For each regression model in the criterion measures ranging from 8.2% (MGUDS Com-
Gender and Social Desirability were entered into Step 1, the Big fort with Differences) to 33.4% for Self-Esteem. The Big Five
Five factors were entered into Step 2, and the seven MPI factors factors of Conscientiousness and Openness were the strongest
MULTICULTURAL PERSONALITY INVENTORY 555
TABLE 8.—Gender norms (means and standard deviations) for MPI subscales. 7.47, p < .001; Humor, F(4, 564) = 3.38, p < .01; Opposite-
Gender/Sexual Orientation Connection, F(4, 564) = 5.67, p <
Gender
.001; and Culturally Diverse Friendships, F(4, 564) = 11.07, p
Male Female
< .001. Table 9 presents the results of the follow-up planned
MPI Scale M SD M SD
comparisons using the Scheffé test.
RID 3.61 .75 3.64 .77
SJA 3.73∗∗∗ .59 4.03∗∗∗ .55 Discussion
PH 3.95 .62 3.87 .61
CS 3.06 .82 3.19 .82 This study found the seven-factor MPI structure to be a rea-
HUM 4.31 .62 4.35 .55 sonably good fit to a multisite college student sample. Fur-
OGC 3.58 .68 3.67 .61 thermore, the factors retained satisfactory internal consistency
CDF 3.12 .79 3.21 .75 estimates in the new sample. As in Study 1, the seven MPI
Total N 178 398
factors intercorrelated only modestly, supporting the generally
% 30.9 69.1
independent nature of each factor.
Note. MPI = Multicultural Personality Inventory; RID = Racial and Ethnic Identity; With regard to the MPI factor correlations with companion in-
SJA = Social Justice and Activism; PH = Psychological Health; CS = Connectedness and struments, the magnitude and direction of the coefficients were
Spirituality; HUM = Humor; OGC = Opposite-Gender/Sexual Orientation Connection;
CDF = Culturally Diverse Friendships.
generally consistent with multicultural personality theory pre-
∗∗∗
p < .001. dictions (see Ponterotto, 2010a). MPI factors were fairly inde-
pendent of the Big Five factors and generally free from social de-
predictors across the criterion variables. Finally, in Step 3 of the sirability contamination, save for a modest correlation with the
Downloaded by [Kyoto University] at 00:23 21 October 2014
regression models, the MPI factors added additional, incremen- Psychological Health factor. The pattern of MPI factor correla-
tal predictive variance for all eight criterion variables of inter- tions with the primary criterion variables of interest—universal-
est, ranging from 4.4% added variance for Utrecht Academic diverse orientation, cognitive flexibility, general self-efficacy,
Engagement to 20.9% added variance in predicting MGUDS academic engagement, self-esteem, and life satisfaction—were
Diversity Contact. Overall it appears that MPI Psychological in the magnitude and direction predicted by the theory. Further-
Health was the strongest predictor of the MPI’s theoretical me- more, MPI factors predicted variance in these criterion variables
dial and distal criterion variables (Cognitive Flexibility, Gen- above and beyond the variance accounted for by gender, social
eral Self-Efficacy, Life Satisfaction, and Self-Esteem), and MPI desirability, and the Big Five variables.
Racial and Ethnic Identity and Social Justice and Activism and Findings also indicated gender differences on one MPI fac-
Culturally Diverse Friendships were the strongest predictors of tor, Social Justice and Activism, which is consistent with pre-
theoretically postulated proximal criterion variables (MGUDS vious research on social justice variables (e.g., Perez-Gualdron,
Diversity Contact and MGUDS Relativistic Appreciation). 2012; Sabbagh, 2005). Furthermore, a few race-based score
Finally, Tables 8 and 9, respectively, provide normative cen- differences were also identified. The goal of the gender and
tral tendency and variance data on the MPI scores across gender racial and ethnic group comparisons was to begin to develop
and major racial and ethnic categories. T tests conducted across some normative data base for MPI factor scores. However, given
the seven MPI factors for gender revealed only one statistically the limited sites sampled and the relatively small sample sizes
significant comparison: Women (n = 398) score higher than men with the data disaggregated by demographic grouping, it is dif-
(n = 178) on the Social Justice and Activism scale, t(574) = ficult to discern any meaningful implications of these data at the
–5.95, p < .001. One-way analyses of variance across the broad present time.
racial and ethnic categories revealed statistically significant re-
sults for six of the seven MPI factors: Racial/Ethnic Identity, GENERAL DISCUSSION
F(4, 564) = 24.33, p < .001; Psychological Health, F(4, 564) The purpose of this series of studies was to develop a
= 3.70, p < .01; Connectedness and Spirituality, F(4, 564) = self-report, Likert-type measure to operationalize Ponterotto’s
TABLE 9.—Race and Hispanic-origin norms (means and standard deviations) for MPI subscales.
Race
RID 3.85a .69 3.33 .75 3.90a .64 4.00a .62 3.81a .69
SJA 3.85 .57 3.96 .59 3.90 .60 3.97 .57 4.03 .56
PH 4.04 .61 3.82 .62 3.78 .64 4.01 .55 3.95 .69
CS 3.42a .90 2.97 .81 3.27 .68 3.33a .76 3.15 .85
HUM 4.35 .58 4.39 .53 4.09a .69 4.32 .62 4.44 .54
OGC 3.55 .66 3.65 .62 3.36 .68 3.80b .57 3.79b .68
CDF 3.15 .81 3.02 .73 3.18 .79 3.35a .65 3.72abc .74
Total N 80 277 53 111 44
% 13.9 48.1 9.2 19.3 7.6
Note. MPI = Multicultural Personality Inventory; RID = Racial and Ethnic Identity; SJA = Social Justice and Activism; PH = Psychological Health; CS = Connectedness and
Spirituality; HUM = Humor; OGC = Opposite-Gender/Sexual Orientation Connection; CDF = Culturally Diverse Friendships.
a
Statistically significantly different from White participants per Scheffé test. bStatistically significantly different from Asian participants per Scheffé test. cStatistically significantly
different from Hispanic participants per Scheffé test. cStatistically significantly different from Black participants per Scheffé tests.
556 PONTEROTTO ET AL.
(2010a) theory of the multicultural personality. In Study 1, a Process-Adaptation-Generalization model (Crisp & Turner,
large number of items were written and subject to content valid- 2011), and the Multilevel Personality-in-Context (MPIC) model
ity checks and an exploratory factor analysis. A 70-item, seven- (Sheldon, Cheng, & Hilpert, 2011). All of these models deal di-
factor model of the multicultural personality emerged and the rectly or indirectly with interacting in culturally heterogeneous
factors were found to be psychometrically robust and internally societies and it would be of value to examine the shared and
consistent. In Study 2, the 70-item MPI was distributed to a unique variance among the models.
multicampus sample, and the seven-factor model proved to be Naturally, self-report measures are limited in capturing the
a good fit to the new data set. Furthermore, Study 2 demon- lived experiences of individuals, and researchers working in the
strated that the internal consistency of the seven factors held area of multicultural personality development would be wise
up with the new sample and that MPI factors correlated in ex- to also incorporate qualitative research methods such as in-
pected directions with a variety of criterion variables related depth interviews, focus groups, life story analysis, and partici-
to college student well-being, cultural openness, and academic pant observation (Mohatt & Thomas, 2006; Ponterotto, 2010b).
engagement. In-depth, small-sample qualitative research methods would en-
A central component of multicultural personality theory is hance our understanding of multicultural personality traits, their
that its defined narrow personality traits can predict variance in mechanisms of action, and their effects on social interactions
human behavior above and beyond the variance accounted for by and personality development.
demographic variables of broad-trait conceptions of personality.
Importantly, the MPI factors predicted a significant amount of ACKNOWLEDGMENTS
score variance above and beyond that accounted for by a broad An earlier version of this article was presented at the Annual
measure of personality for all criterion variables of interest. The
Downloaded by [Kyoto University] at 00:23 21 October 2014
Buss, D. M., & Cantor, N. (1989). Introduction. In D. M. Buss & N. Can- Jackson, D. L., Gillaspy, J. A., Jr., & Purc-Stephenson, R. (2009). Reporting
tor (Eds.), Personality psychology: Recent trends and emerging directions practices in confirmatory factor analysis: An overview and some recommen-
(pp. 1–12). New York, NY: Springer Verlag. dations. Psychological Methods, 14, 6–23.
Byrne, B. M. (2010). Structural equation modeling with AMOS: Basic concepts, John, O. P., Donahue, E. M., & Kentle, R. L. (1991). The Big Five
applications, and programs. New York, NY: Routledge. Inventory–Versions 4a and 54. Berkeley, CA: University of California, Berke-
Cattell, R. B. (1966). The scree test for the number of factors. Multivariate ley, Institute of Personality and Social Research.
Behavioral Research, 1, 245–276. John, O. P., Naumann, L. P., & Soto, C. J. (2008). Paradigm shift to the integrative
Charter, R. A. (1999). Sample size requirements for precise estimates of re- Big-Five trait taxonomy: History, measurement, and conceptual issues. In O.
liability, generalizability, and validity coefficients. Journal of Clinical and P. John, R. W. Robins, & L. A. Pervin (Eds.), Handbook of personality:
Experimental Neuropsychology, 21, 559–566. Theory and research (pp. 114–158). New York, NY: Guilford.
Chen, G., Gully, S. M., & Eden, D. (2001). Validation of a new general self- John, O. P., & Srivastava, S. (1999). The Big Five taxonomy: History, mea-
efficacy scale. Organizational Research Methods, 4, 62–83. surement, and theoretical perspectives. In L. A. Pervin & O. P. John (Eds.),
Chen, G., Gully, S. M., & Eden, D. (2004). General self-efficacy and self- Handbook of personality (2nd ed., pp. 102–138). New York, NY: Guilford.
esteem: Toward theoretical and empirical distinction between correlated self- Jones, J. M. (2003). TRIOS: A psychological theory of the African legacy in
evalautions. Journal of Organizational Behavior, 25, 375–395. American culture. Journal of Social Issues, 59, 217–242.
Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objec- Jöreskog, K. G., & Sörbom, D. (1984). LISREL 6: A guide to the program and
tive scale development. Psychological Assessment, 7, 309–319. applications. Chicago, IL: SPSS.
Cohen, J. (1988). Statistical power analysis for the social sciences (2nd ed.). Kahn, J. H. (2006). Factor analysis in counseling psychology research, train-
Hillsdale, NJ: Erlbaum. ing, and practice: Principles, advances, and applications. The Counseling
Coleman, H. L. K. (1995). Strategies for coping with cultural diversity. The Psychologist, 34, 684–718.
Counseling Psychologist, 23, 722–740. Kishton, J. M., & Widaman, K. F. (1994). Unidimensional versus domain rep-
Downloaded by [Kyoto University] at 00:23 21 October 2014
Corwyn, R. F. (2000). The factor structure of global self-esteem among adoles- resentative parceling of questionnaire items: An empirical example. Educa-
cents and adults. Journal of Research in Personality, 34, 357–379. tional and Psychological Measurement, 54, 757–765.
Costa, P. T., Jr., & McCrae, R. R. (1992). Revised NEO Personality Inven- Krejcie, R. V., & Morgan, D. W. (1970). Determining sample size for research
tory (NEO–PI–R) and NEO Five Factor Inventory (NEO–FFI) professional activities. Educational and Psychological Measurement, 30, 607–610.
manual. Odessa, FL: Psychological Assessment Resources. Lent, R. W. (2004). Toward a unifying theoretical and practical perspective on
Costa, P. T., Jr., & McCrae, R. R. (1994). Set like plaster? Evidence for the sta- well-being and psychosocial adjustment. Journal of Counseling Psychology,
bility of adult personality. In T. F. Heatherton & J. L. Weinberger (Eds.), Can 51, 482–509.
personality change? (pp. 21–40). Washington, DC: American Psychological Little, B. R. (1999). Personality and motivation: Personal action and the conative
Association. evolution. In L. Pervin & O. P. John (Eds.), Handbook of personality: Theory
Crisp, R. J., & Turner, R. N. (2011). Cognitive adaptation to the experi- and research (2nd ed., pp. 501–524). New York, NY: Guilford.
ence of social and cultural diversity. Psychological Bulletin, 137, 242– Lopez, S. J., & Edwards, L. M. (2008). The interface of counseling psychology
266. and positive psychology: Assessing and promoting strengths. In S. D. Brown
Crowne, D. P., & Marlowe, D. (1960). A new scale of social desirability indepen- & R. W. Lent (Eds.), Handbook of counseling psychology (4th ed., pp. 86–99).
dent of psychopathology. Journal of Consulting Psychology , 24, 349–354. New York, NY: Wiley.
Dawis, R. (1987). Scale construction. Journal of Counseling Psychology, 34, Marsh, H. W., Balla, J. R., & McDonald, R. P. (1988). Goodness-of-fit indexes
481–489. in confirmatory factor analysis: The effect of sample size. Psychological
Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The Satisfaction Bulletin, 103, 391–410.
with Life Scale. Journal of Personality Assessment, 49, 71–75. Martin, M. M., & Anderson, C. M. (1998). The Cognitive Flexibility Scale:
Duran, E. (2006). Healing the soul wound: Counseling with American Indians Three validity studies. Communication Reports, 11, 1–9.
and other native peoples. New York, NY: Teachers College Press. Martin, M. M., Anderson, C. M., & Thweatt, K.S. (1998). The relationship
Field, A. (2009). Discovering statistics using SPSS (3rd ed.). Los Angeles, CA: between the Cognitive Flexibility Scale and the Communication Flexibility
Sage. Scale with aggressive communication traits. Journal of Social and Behavioral
Flesch, R. (1948). A new readability yardstick. Journal of Applied Psychology, Personality, 13, 531–540.
32, 221–233. Martin, M. M., & Rubin, R. B. (1995). A new measure of cognitive flexibility.
Fossati, A., Borroni, S., Marchione, D., & Maffei, C. (2011). The Big Five In- Psychological Reports, 76, 623–626.
ventory (BFI): Reliability and validity of its Italian translation in three inde- Martin, M. M., Staggers, S. M., & Anderson, C. M. (2011). The relationships be-
pendent nonclinical samples. European Journal of Psychological Assessment, tween cognitive flexibility with dogmatism, intellectual flexibility, preference
27, 50–58. for consistency, and self-compassion. Communication Research Reports, 28,
Fuertes, J. N., Miville, M. L., Mohr, J. J., Sedlacek, W. E., & Gretchen, D. (2000). 275–280.
Factor structure and short form of the Miville-Guzman Universality-Diversity Matsumoto, D., & Hwang, H. (2013). Assessing cross-cultural competence: A
Scale. Measurement and Evaluation in Counseling and Development, 33, review of tests. Journal of Cross-Cultural Psychology, 44, 849–873.
157–169. Mayer, J. D., Panter, A. T., & Caruso, D. R. (2012). Does personal intelligence
Gamst, G. C., Liang, C. T. H., & Der-Karabetian, A. (Eds.). (2011). Handbook exist? Evidence from a new ability-based measure. Journal of Personality
of multicultural measures. Los Angeles, CA: Sage. Assessment, 94, 124–140.
Garrett, M. T., Garrett, J. T., Torres-Rivera, E., Wilbur, M., & Roberts-Wilbur, J. McAdams, D. P., & Pals, J. L. (2006). A new big five: Fundamental principles
(2005). Laughing it up: Native American humor as spiritual tradition. Journal for an integrative science of personality. American Psychologist, 61, 204–
of Multicultural Counseling and Development, 33, 194–204. 217.
Hatcher, J., & Hall, L. A. (2009). Psychometric properties of the Rosenberg McCarn, S. R., & Fassinger, R. F. (1996). Revising sexual minority identity
Self-Esteem Scale in African American single mothers. Issues in Mental formation: A new model of lesbian identity and its implications for counseling
Health Nursing, 30, 70–77. and research. The Counseling Psychologist, 24, 508–534.
Helms, J. E. (Ed.). (1990). Black and White racial identity: Theory, research, Meyers, L. S., Gamst, G. C., & Guarino, A. J. (2006). Applied multivariate
and practice. Westport, CT: Greenwood. research: Design and interpretation. Thousand Oaks, CA: Sage.
Huang, J. (2010). Counseling persons from Eastern religions and spiritualities. Millon, T. (2004). MIPS Revised: Millon Index of Personality Styles Revised
In J. G. Ponterotto, J. M. Casas, L. A. Suzuki, & C. M. Alexander (Eds.), (manual). Minneapolis, MN: NCS Pearson.
Handbook of multicultural counseling (3rd ed., pp. 491–501). Los Angeles, Miville, M. L., Gelso, C. J., Pannu, R., Liu, W., Touradji, P., Holloway, P.,
CA: Sage. & Fuertes, J. (1999). Appreciating similarities and valuing differences: The
558 PONTEROTTO ET AL.
Miville–Guzman Universality–Diversity Scale. Journal of Counseling Psy- A perspective of ethnic mestizo origin]. Revisita Latinoamericana de Psi-
chology, 46, 291–307. cologia, 31, 231–250.
Mohatt, G. V., & Thomas, L. R. (2006). “I wonder, why would you do it Ramirez, M., III. (1999b). Multicultural psychotherapy: An approach to indi-
that way?” Ethical dilemmas in doing participatory research with Alaska vidual and cultural differences (2nd ed.). Boston, MA: Allyn & Bacon.
Native communities. In J. E. Trimble & C. B. Fisher (Eds.), The handbook of Rosenberg, M. (1965). Society and the adolescent self-image. Princeton, NJ:
ethical research with ethnocultural populations & communities (pp. 93–115). Princeton University Press.
Thousand Oaks, CA: Sage. Ruscio, J., & Roche, B. (2012). Determining the number of factors to retain
Myers, L. J. (1993). Understanding an Afrocentric world view: Introduction to in an exploratory factor analysis using comparison data of known factorial
an optimal psychology (2nd ed.). Dubuque, IA: Kendall/Hunt. structure. Psychological Assessment, 24, 282–292.
Nasser, F., & Takahashi, T. (2003). The effect of using item parcels on ad hoc Rushton, J. P., Bons, T. A., & Hur, Y-M. (2008). The genetics and evolution
goodness-of-fit indexes in confirmatory factor analysis: An example using of the general factor of personality. Journal of Research in Personality, 42,
Saranson’s reactions to tests. Applied Measurement in Education, 16, 75–97. 1173–1185. doi:10.1016/j.jrp.2008.03.002
Nasser-Abu Alhija, F., & Wisenbaker, J. (2006). A Monte Carlo study inves- Russell, D. W., Kahn, J. H., Spoth, R., & Altmaier, E. M. (1998). Analyzing
tigating the impact of item parceling strategies on parameter estimates and data from experimental studies: A latent variable structural equation modeling
their standard errors in CFA. Structural Equation Modeling, 13, 204–228. approach. Journal of Counseling Psychology, 45, 18–29.
O’Connor, B. P. (2000). SPSS and SAS programs for determining the number Sabbagh, C. (2005). Environmentalism, right-wing extremism, and social justice
of components using parallel analysis and Velicer’s MAP test. Behavior beliefs among East German adolescents. International Journal of Psychology,
Research Methods, Instruments, & Computers, 32, 396–402. 40, 118–131.
Paunonen, S. V., Haddock, G., Forsterling, F., & Keinonen, M. (2003). Broad Schaufeli, W., & Bakker, A. (2003). UWES: Utrecht Work Engagement
versus narrow personality measures and prediction of behaviour across cul- Scale–Preliminary manual. Utrecht, The Netherlands: Utrecht University,
tures. European Journal of Personality, 17, 413–433. Occupations Health Psychology Unit.
Downloaded by [Kyoto University] at 00:23 21 October 2014
Pavot, W., & Diener, E. (1993). Review of the Satisfaction with Life Scale. Schmitt, D., & Allik, J. (2005). Simultaneous administration of the Rosenberg
Psychological Assessment, 5, 164–172. Self-Esteem Scale in 53 nations: Exploring the universal and culture-specific
Pedhazur, E. J., & Schmelkin, L. P. (1991). Measurement, design, and analysis: features of global self-esteem. Journal of Personality and Social Psychology,
An integrated approach. Hillsdale, NJ: Erlbaum. 89, 623–642.
Perez-Gualdron, L. M. (2012). A longitudinal study of a social justice orientation Sheldon, K. M., Cheng, C., & Hilpert, J. (2011). Understanding well-being and
model for Latina/o students. Dissertation Abstracts International: Section B: optimal functioning: Applying the multilevel personality in context (MPIC)
The Sciences and Engineering, 72(11-B), #3464831. model. Psychological Inquiry, 22, 1–16.
Phinney, J. S., & Ong, A. D. (2007). Conceptualization and measurement of Sinclair, S. J., Blais, M. A., Gansler, D. A., Sandberg, E., Bistis, K., & LoCi-
ethnic identity: Current status and future directions. Journal of Counseling cero, A. (2010). Psychometric properties of the Rosenberg Self-Esteem Scale:
Psychology, 54, 271–281. Overall and across demographic groups living within the United States. Eval-
Ponterotto, J. G. (2006). Multicultural personality. In Y. Jackson (Ed.), Ency- uation and the Health Professions, 33, 56–80.
clopedia of multicultural psychology (pp. 326–328). Thousand Oaks, CA: Steiger, J. H., & Lind, J. C. (1980, May). Statistically based tests for the number
Sage. of common factors. Paper presented at the annual meeting of the Psychometric
Ponterotto, J. G. (2008). Theoretical and empirical advances in multicultural Society, Iowa City, IA.
counseling and psychology. In S. D. Brown & R. W. Lent (Eds.), Handbook Stevens, J. (2002). Applied multivariate statistics for the social sciences (4th
of counseling psychology (4th ed., pp. 121–140). New York, NY: Wiley. ed.). Mahwah, NJ: Erlbaum.
Ponterotto, J. G. (2010a). Multicultural personality: An evolving theory of op- Tellegen, A. (1982). Brief manual for the Differential Personality Questionnaire.
timal functioning in culturally heterogeneous environments. The Counseling Unpublished manuscript, University of Minnesota, Minneapolis.
Psychologist, 38, 714–758. doi: 10.1177/0011000009359203 Tucker, L. R., & Lewis, C. (1973). A reliability coefficient for maximum like-
Ponterotto, J. G. (2010b). Qualitative research in multicultural psychology: lihood factor analysis. Psychometrika, 38, 1–10.
Philosophical underpinnings, popular approaches, and ethical considerations. Van der Zee, K., & Van Oudenhoven, J. P. (2000). The Multicultural Personality
Cultural Diversity and Ethnic Minority Psychology, 16, 581–589. Questionnaire: A multidimensional instrument of multicultural effectiveness.
Ponterotto, J. G., & Charter, R. A. (2009). Statistical extensions of Ponterotto European Journal of Personality, 14, 291–309.
and Ruckdeschel’s (2007) reliability matrix for estimating the adequacy of Van der Zee, K., & Van Oudenhoven, J. P. (2001). The Multicultural Per-
internal consistency coefficients. Perceptual and Motor Skills, 108, 878–886. sonality Questionnaire: Reliability and validity of self- and other ratings
Ponterotto, J. G., & Fietzer, A. W. (in press). Multiculturalism and adjustment. In of multicultural effectiveness. Journal of Research in Personality, 35, 278–
V. Benet-Martı́nez & Y-Y. Hong (Eds.), The Oxford handbook of multicultural 288.
identity: Basic and applied perspectives. New York, NY: Oxford University Van der Zee, K. I., Van Oudenhoven, J. P., Ponterotto, J. G., & Fietzer, A.
Press. (2013). Multicultural Personality Questionnaire: Development of short form.
Ponterotto, J. G., & Ruckdeschel, D. E. (2007). An overview of coefficient Journal of Personality Assessment, 95, 118–124.
alpha and a reliability matrix for estimating adequacy of internal consistency Vassar, M. (2008). A note on the score reliability for the Satisfaction with Life
coefficients with psychological research measures. Perceptual and Motor Scale: An RG study. Social Indicators Research, 86, 47–57.
Skills, 105, 997–1014. doi:10.2466/PMS.105.3.997-1014 Ventimiglia, M., & MacDonald, D. A. (2012). An examination of the factorial
Ponterotto, J. G., Utsey, S. O., & Pedersen, P. B. (2006). Preventing prejudice: dimensionality of the Marlowe–Crowne Social Desirability Scale. Personality
A guide for counselors, educators, and parents (2nd ed.). Thousand Oaks, and Individual Differences, 52, 487–491.
CA: Sage. Vereen, L. G., Butler, S. K., Williams, F. C., Darg, J. A., & Downing, T. K.
Rahim, M. A., & Magner, N. R. (1995). Confirmatory factor analysis of the E. (2006). The use of humor when counseling African American college
styles of handling interpersonal conflict: First-order factor model and its students. Journal of Counseling & Development, 84, 10–15.
invariance across groups. Journal of Applied Psychology, 80, 122–132. Worthington, R. L., & Whittaker, T. A. (2006). Scale development research:
Ramirez, M., III. (1991). Psychotherapy and counseling with minorities: A A content analysis and recommendations for best practice. The Counseling
cognitive approach to individual and cultural differences. New York, NY: Psychologist, 34, 806–838.
Pergamon. Zeigler-Hill, V., Besser, A., & King, K. (2011). Contingent self-esteem and an-
Ramirez, M., III. (1999a). El concepto de personalidad multicultural: Una per- ticipated reactions to interpersonal rejection and achievement failure. Journal
spectiva de origen etnico mestizo [The concept of multicultural personality: of Social and Clinical Psychology, 30, 1069–1096.