Professional Documents
Culture Documents
The Disgust Scale R A Valid and Reliable Index T - 2011 - Personality and Indiv
The Disgust Scale R A Valid and Reliable Index T - 2011 - Personality and Indiv
a r t i c l e i n f o a b s t r a c t
Article history: The Disgust Scale (DS; Haidt, McCauley, & Rozin, 1994) is the most widely used instrument for assessing
Received 7 October 2010 disgust propensity (i.e., individual tendency to experience disgust). Yet, psychometric evaluations of the
Received in revised form 7 February 2011 DS are scarce while the literature shows that the reliability of its subscales are unacceptably low.
Accepted 16 March 2011
Recently, it was suggested to reduce the number of subscales (Olatunji, Sawchuk, de Jong, & Lohr,
Available online 6 May 2011
2007a). This study is a first exploration of this reduced three-factor solution in an independent sample.
In study I, we examined whether a three-factor solution improves psychometric properties of the DS. Stu-
Keywords:
dents from Maastricht University (N = 535) and the University of Groningen (N = 432) completed the DS.
Disgust Scale
Trait disgust
In study II, the DS was revised by dropping redundant items and revising its scoring format. The DS-R was
Disgust propensity administered to students from the University of Groningen (N = 472) and Ghent University (N = 41) to
Reliability study its psychometric properties. The revisions improved the psychometric features of the DS, and
Validity showed that the DS-R is a valid and reliable index to establish core disgust, animal-reminder disgust,
Psychometric evaluation and contamination.
Crown Copyright Ó 2011 Published by Elsevier Ltd. All rights reserved.
1. Introduction towards stimuli that remind humans of their animal nature (Rozin
& Fallon, 1987). These two disgust types can be empirically estab-
Disgust propensity is defined as the individual tendency to lished and may be related differentially to psychopathology (de
experience disgust. Research showed that enhanced disgust pro- Jong & Merckelbach, 1998).
pensity is associated with various psychopathological conditions However, current indices generally do not measure these latent
(Olatunji & Sawchuk, 2005). It has been argued that high levels concepts (core/AR-disgust) but rather measure disgust propensity
of disgust propensity enlarge the probability of specific stimuli to for specific disgust stimuli. The Disgust Scale (DS; Haidt et al.,
acquire a disgust-evoking status (van Overveld, de Jong, & Peters, 1994) is the most widely used instrument on disgust propensity.
2010). Hence, disgust propensity is assumed to be particularly Yet, despite its widespread use, psychometric evaluations are
important to the etiology of psychopathological conditions in scarce. This is particularly troublesome, as studies consistently re-
which disgust is somehow involved. Accordingly, previous re- port that although internal consistency for the total index is good
search showed that enhanced disgust propensity is involved in spi- (a = .84; Haidt et al., 1994; .74; Olatunji, Smits, Connolly, Willems,
der phobia (Matchett & Davey, 1991), blood phobia (de Jong & & Lohr, 2007b), its subscales demonstrate low to moderate reliabil-
Merckelbach, 1998), obsessive compulsive disorder (Mancini, ity (a’s = .34–.64; Haidt et al., 1994; .40–.68; Olatunji et al., 2005).
Gragnani, & D’Olimpio, 2001; Olatunji, Williams, Lohr, & Sawchuk, Further, the DS measures disgust for specific elicitors but not
2005), and sexual dysfunctions (de Jong, van Overveld, Weijmar- explicitly core or AR-disgust. Thus, internal consistency may be im-
Schultz, Peters, & Buwalda, 2009). proved by creating subscales covering larger disgust domains
Although several disgust types have been identified in the liter- (core/AR).
ature, only two are well-examined: core and animal-reminder dis- A first exploration provided preliminary support. Earlier work
gust (AR; Rozin, Haidt, & McCauley, 2000). Core disgust involves investigated correlations between the DS and blood phobia symp-
disgust at the prospect of oral incorporation of disgusting stimuli toms (Olatunji, Sawchuk, de Jong, & Lohr, 2006). The DS-items
(e.g., rotting foods), whereas AR-disgust involves an aversion were reallocated in subscales measuring core and AR-disgust.
Structural equation modeling showed domain-specific correlations
⇑ Corresponding author. Tel.: +31 10 4081970; fax: +31 10 4089572. between these subscales and blood phobia symptoms. Moreover,
E-mail address: MOverveld@RSM.nl (M. van Overveld). the two-factor model fitted the data well (Olatunji et al., 2006).
0191-8869/$ - see front matter Crown Copyright Ó 2011 Published by Elsevier Ltd. All rights reserved.
doi:10.1016/j.paid.2011.03.023
326 M. van Overveld et al. / Personality and Individual Differences 51 (2011) 325–330
Recently, Olatunji and Sawchuk et al. (2007a) examined the DS and were administered. Participants were informed that they could
suggested several adjustments. First, seven items were removed win 50 euro through a lottery.
due to redundancy. Second, confirmatory factor analyses demon-
strated that, compared to a one- or two-factor model, a three-fac- 2.4. Data analysis
tor solution (Core, AR, Contamination) had superior fit.
Contamination can be defined as an individual’s fear of contagion The data were pooled into one sample. Regression analyses
with disgusting stimuli. Contamination potency, the ability to con- computed missing values using the Statistical Package for Social
taminate a non-disgusting object with disgust-inducing qualities, Sciences (SPSS; version 12.0.1). Overall, less than 1% missing data
is an important feature of disgust stimuli, particularly for psycho- were observed. First, descriptives of all questionnaires were calcu-
pathology (e.g., de Jong & Muris, 2002). lated for the entire research population (N = 967). Hereto, the 25
The aim of the present studies was to determine whether DS-A items were used to comprise the subscales from the two-
psychometric properties of the DS would improve following a and three-subscale solutions proposed by Olatunji et al. (2007c).
revision in accordance with earlier recommendations (Olatunji & Additionally, a version of the DS was calculated where the 25
Sawchuk et al., 2007a; Olatunji et al., 2007c). In the first study, DS-A items were assigned to their original subscales. So, compared
we investigated whether assigning DS-items into the three pro- to the original 32-item version, the Sex-subscale was deleted and
posed subscales in line with the three-factor model (Core/AR/Con- subscales Food, Body and Envelope Violations contained one item
tamination) fitted the data better than the original or a two-factor less.
solution (Core/AR). In the second study, the DS was fully revised in Second, confirmatory factor analyses (CFA) determined whether
accordance with Olatunji’s suggestions, and its psychometric prop- the three-factor model fitted significantly better than a one-, two-
erties were explored using confirmatory factor analyses. Content or seven factor model, and whether the DS-A models demonstrated
validity was examined by means of correlations with other disgust good model fit. In accordance with Olatunji et al. (2007c), in the
propensity indices. two-factor model, the Core-disgust factor comprised the items
from subscales Food, Animal, Body Products, Hygien, and Magic,
the AR-disgust factor consisted of items from Envelope and Death.
2. Study I
In the three-factor model, Contamination comprised five items (9,
11, 24, 28, 29 of the Dutch DS) which were omitted from the Core
2.1. Methods
Disgust factor. Polychoric correlation matrices and asymptotic
covariance matrices were obtained by PRELIS. Using LISREL 8.54
2.1.1. Participants
(Jöreskog & Sörbom, 2002), confirmatory factor analyses were per-
Students from the schools of Psychology, Health Sciences, and
formed with the Weighted Least-Squares estimation due to the
Medicine at Maastricht University (N = 535; 443 women) and the
discrete scoring format of the first part of the DS-A. Latent vari-
University of Groningen (N = 432; 316 women) were recruited.
ables were free to correlate. Secondary loadings of items were
Their mean age was 20.4 years (SD = 2.4; range: 17–39 years).
not permitted.
2.2. Materials
3. Results
Table 2 5. Study II
Goodness of fit indices for all DS-R models.
Table 3 Table 5
Lambda factor loading of CFA for the DS-R. Goodness of fit indices for DS-R.
DS-R item Core AR Contamination v2 d.f. v2/d.f. CFI TLI RMSEA ECVI SRMR
13 .82 One factor 881.46 275 3.21 .92 .91 .08 2.49 .07
8 .75 Two factors 607.31 274 2.27 .91 .90 .08 3.34 .08
27 .66 Three factors 708.29 272 2.60 .94 .94 .06 1.88 .06
15 .65 Valid N 472
11 .61
3 .59 Note: CFI, Comparative Fit Index; TLI, Tucker-Lewis Index; RMSEA, Root Mean
17 .54 Square Error of Approximation; ECVI, Expected Cross-Validation Index; and SRMR,
22 .53 Standardized Root Mean Square Residual.
25 .52
20 .49
1 .40 mental fit indices, model fit only approached acceptable
6 .29
parameters for the three-factor model.
2 .72
24 .72 To compare the nested models, the chi-squares difference test
19 .71 was used. Compared to the one-factor model, a two-factor model
7 .70 fitted the data significantly better (v2diff (1) = 91.10; p < .01). The
21 .68
differences were also significant when comparing the three-factor
14 .65
5 .64
model to the one-factor model (v2diff (3) = 173.20; p < .01) or the
10 .50 two-factor model (v2diff (2) = 82.12; p < .01). Thus, adding a Con-
23 .60 tamination-factor to the model appears a significant improvement.
9 .56 Additionally, to assess the fit of competing models, the Expected
26 .44
Cross-Validation Index (ECVI) was used. The ECVI was lowest for
4 .41
18 .34 the three-factor model, so, this model proved superior to a one
and two-factor solution. Finally, although SRMR demonstrated
good fit for all three models, the three-factor model fitted best.
loadings of items were not permitted. For the three factor model:
Items 1, 3, 6, 8, 11, 13, 15, 17, 20, 22, 25, 27 were used for Core Dis- 5.7. Content validity
gust, items 2, 5, 7, 10, 14, 19, 21, 24 for AR-disgust, and items 4, 9,
18, 23, 26 for Contamination. For the two-factor model, Core and Table 6 shows that although the three subscales of the DS-R
Contamination formed one factor. In the one-factor model, all were moderately to highly intercorrelated, there is enough unex-
items were regarded as reflecting one factor. Finally, bivariate cor- plained variance to conclude that the three scales measure differ-
relations were calculated in the total sample to examine conver- ent concepts. All DS-R scales correlated moderately with disgust
gent validity. Table 3 presents the factor loadings of the DS-R. propensity (DPSS-RP) and disgust sensitivity (DPSS-RS), and mod-
erately to high with the DES. Supporting the validity of the DS,
DS-R-Core correlated highest with DES-subscales Food, Odor, and
5.5. Descriptives Animals, while DS-R-AR correlated highest with Mutilation. In
other words, differential correlations were observed for the do-
In Table 4, means, standard deviations and internal consisten- main-specific DS-R subscales (Core/AR).
cies of the DS-R solutions are presented. Internal consistency was
good for the total score (a = .87) and subscales Core and AR (both
a ‘s .78), while low for Contamination (a = .54). 6. Discussion
Although the Contamination-subscale appears to measure a un- Second, although the scoring format is similar for all items, the
ique aspect of disgust, its internal consistency remained low, so fu- DS-R is still divided into two parts with different questions. Most
ture revisions of this subscale seem warranted. Nevertheless, CFA items on the first part significantly correlated low to moderate
suggests that including contamination potency appears a valuable (all r’s < .50) with domain counterparts on the second part. Only
addition to the model, and its clinical relevance is potentially for Contamination, correlations were consistently low (r’s < .27).
important (e.g., in explaining avoidance behavior in OCD). Questions of the second part directly ask for anticipated disgust
Further, the DS-R subscales correlated meaningfully with estab- levels when confronted with specific stimuli. Items of the first part
lished disgust propensity indices. More noteworthy, the DS-R dis- only indirectly reflect individuals’ disgust propensity by asking
played stronger associations than previous reports (e.g., r = .37 individuals’ anticipated tendency to avoid certain (disgust-elicit-
between DS and DPSS-R Propensity, r = .29 between DS and DPSS- ing) stimuli. Although both anticipated avoidance tendencies and
R Sensitivity; van Overveld et al., 2006). Thus, revising the scoring anticipated feelings of disgust may be relevant components of dis-
format critically improved psychometric properties of the DS. gust propensity, they could be differentially involved in guiding
people’s behavior related to potentially disgusting stimuli. If so,
7. General discussion such differential involvement could be related to various aspects
of psychopathology. For example, anticipated avoidance tenden-
Prior research showed that the psychometric aspects of the DS cies may be related to the occurrence of rituals and avoidance of
were not satisfactory. The present study is a first investigation of specific actions (e.g., entering places with spiders in spider phobia),
a version that was consistently revised in accordance with earlier while anticipated feelings may induce stronger compensation
suggestions (i.e., Olatunji et al. (2007c)) and which is proposed to behavior (e.g., washing in OCD-patients). Future research should
measure core disgust, AR-disgust and contamination. Factor analy- investigate potential predictive validity of both parts of the DS.
ses revealed that three factors can be readily distinguished in the
original DS (i.e., the 25 retained items from Olatunji et al.
7.2. Study limitations
(2007c)) and the DS-R. In both studies, the three-factor model fit-
ted better than a one- or a two-factor model. Thus, contamination Several comments apply to the present study. First, we investi-
potency (i.e., contamination-subscale) appears an essential compo- gated construct validity but not any other validity types (e.g., pre-
nent of disgust stimuli (Olatunji et al., 2005; Olatunji and Sawchuk dictive validity). It should be investigated whether higher scores on
et al. (2007a)). DS-R-subscales (Core, AR, Contamination) can predict behavioral
Further, these findings replicated earlier work (Olatunji et al., avoidance in behavioral experiments (e.g., van Overveld et al.,
2005) by showing that the DS can differentiate between core and 2010). This is important given the assumption that elevated levels
AR-disgust. DS-R Core was associated most strongly with core dis- of a propensity for specific disgust types may be related to clinical
gust-related DES-subscales Odor, Food, and Animals, whereas DS-R avoidance patterns for various stimuli (e.g., spiders, medical proce-
AR was most strongly associated with AR-related DES-Mutilation. dures, physical contact with people).
These indications that the DS-R measures distinct disgust types At this stage, the three-factor DS-R with a uniform scoring for-
are theoretically and clinically important. Theoretically, since re- mat, appears a significant improvement from a psychometric
cent disgust models propose a two-stage model (Rozin et al., stance. Yet, the contamination-subscale requires further revision.
2009). Here, core disgust is regarded as the most primal form of Nevertheless, for both theoretical and applied research on the dif-
disgust from which all other disgust types evolved (e.g., AR-dis- ferential involvements of core and AR-disgust propensities, the DS-
gust). If these disgust types indeed present distinct disgust catego- R appears a suitable index.
ries, then propensities for these disgust types may be differentially
associated with behavioral tendencies.
Previous research already indicated that these disgust types Acknowledgements
could be differentially involved in psychopathology (e.g., core dis-
gust in spider phobia, AR-disgust in blood phobia; de Jong & Merc- For their efforts with respect to data collection, the present
kelbach, 1998). Thus, from a clinical perspective, it would be authors extend their gratitude to Joëlle Janssen, Judith Deutz, Leon
pivotal to have a reliable and valid index available to examine dis- ter Hart, Janna Janssen, Julia Degner, and Julia Vogt.
gust propensities. Thus far, no instrument reliably differentiates
between individuals’ propensity for core versus AR-disgust stimuli.
References
The DS-R is the first reliable solution to assess both types of disgust
propensity separately. Additionally, current analyses confirm a de Jong, P., & Merckelbach, H. (1998). Blood-injection-injury phobia and fear of
third subscale, Contamination, which reflects the contamination spiders: Domain specific individual differences in disgust sensitivity. Personality
and Individual Differences, 24, 153–158.
potency of disgust stimuli. Contamination potency may be a likely
de Jong, P., & Muris, P. (2002). Spider phobia: interaction of disgust and perceived
candidate for explaining avoidance behavior in obsessive–compul- likelihood of involuntary physical contact. Journal of Anxiety Disorders, 16,
sive behavior. 51–65.
de Jong, P. J., van Overveld, M., Weijmar-Schultz, W., Peters, M. L., & Buwalda, F. M.
(2009). Disgust and contamination sensitivity in vaginismus and dyspareunia.
7.1. Future directions Archives of Sexual Behavior, 38, 244–252.
Fergus, T. A., & Valentiner, D. P. (2009). The Disgust Propensity and Sensitivity
Several future modifications may further improve the psycho- Scale–Revised: An examination of a reduced-item version. Journal of Anxiety
Disorders, 23, 703–710.
metric properties of the DS-R. First, the Contamination-subscale Haidt, J., McCauley, C., & Rozin, P. (1994). Individual differences in sensitivity to
was not internally consistent and correlations with other disgust disgust: a scale sampling seven domains of disgust elicitors. Personality and
indices were low. Since calculations of reliability depend heavily Individual Differences, 16, 701–713.
Hu, L.-T., & Bentler, P. M. (1999). Cut-off criteria for fit indexes in covariance
on the number of items, the low reliability of this subscale might
structure analysis: Conventional criteria versus new alternatives. Structural
simply reflect the low number of items of this scale. The low Equation Modeling, 6, 1–55.
reliability might also have suppressed correlations with other Jöreskog, K. G., & Sörbom, D. (2002). LISREL 8.54. Chicago: Scientific Software
indices of disgust. It would be interesting in future research to test International, Inc.
Mancini, F., Gragnani, A., & D’Olimpio, F. (2001). The connection between disgust
whether increasing the number of items in this subscale might be and obsessions and compulsions in a non-clinical sample. Personality and
helpful to enhance its psychometric features. Individual Differences, 31, 1173–1180.
330 M. van Overveld et al. / Personality and Individual Differences 51 (2011) 325–330
Matchett, G., & Davey, G. C. L. (1991). A test of a disease-avoidance model of animal Olatunji, B. O., Williams, N. L., Tolin, D. F., Sawchuk, C. N., Abramowitz, J. S., Lohr, J.
phobias. Behaviour Research and Therapy, 29, 333–335. M., et al. (2007c). The disgust scale: Item analysis, factor structure, and
Olatunji, B. O., Moretz, M. W., McKay, D., Bjorklund, F., de Jong, P. J., Haidt, J., et al. suggestions for refinement. Psychological Assessment, 19, 281–297.
(2009). Confirming the three-factor structure of the Disgust Scale-Revised in Rozin, P., & Fallon, A. E. (1987). A perspective on disgust. Psychological Review, 94,
eight countries. Journal of Cross-Cultural Psychology, 40, 234–255. 23–41.
Olatunji, B. O., & Sawchuk, C. N. (2005). Disgust: characteristic features, social Rozin, P., Haidt, J., & McCauley, C. R. (2000). Disgust. In Lewis, M. & Haviland
manifestations, and clinical implications. Journal of Social and Clinical Jones, J. M. (Ed.), Handbook of Emotions, 2nd edition (637-652). New York:
Psychology, 24, 932–962. Guilford Press.
Olatunji, B. O., Sawchuk, C. N., de Jong, P. J., & Lohr, J. M. (2006). The structural Rozin, P., Haidt, J., & McCauley, C. R. (2009). Disgust: The body and soul emotion in the
relation between disgust sensitivity and blood-injection-injury fears: A cross- 21st century. In B. O. Olatunji & D. McKay (Eds.), Disgust and its disorders: Theory,
cultural comparison of US and Dutch data. Journal of Behavior Therapy and assessment, and treatment implications. Washington DC: American Psychological
Experimental Psychiatry, 37, 16–29. Association.
Olatunji, B. O., Sawchuk, C. N., de Jong, P. J., & Lohr, J. M. (2007a). Disgust sensitivity Sawchuk, C. N., Lohr, J. M., Westendorf, D. H., Meunier, S. A., & Tolin, D. F. (2002).
in anxiety disorder symptoms. Journal of Psychopathology and Behavioral Emotional responding to fearful and disgusting stimuli in specific phobia.
Assessment, 19, 281–297. Behaviour Research and Therapy, 40, 1031–1046.
Olatunji, B. O., Sawchuk, C. N., Lohr, J. M., & de Jong, P. J. (2004). Disgust domains in van Overveld, M., de Jong, P. J., & Peters, M. L. (2010). The disgust propensity and
the prediction of contamination fear. Behaviour Research and Therapy, 42, sensitivity scale-revised: Its predictive value for avoidance behavior. Personality
93–104. and Individual Differences, 49, 706–711.
Olatunji, B. O., Smits, J. A., Connolly, K. M., Willems, J., & Lohr, J. M. (2007b). van Overveld, W. J. M., de Jong, P. J., Peters, M. L., Cavanagh, K., & Davey, G. C. L. (2006).
Examination of the rate of decline in fear and disgust during exposure to Disgust propensity and disgust sensitivity: Separate constructs that are
threat-relevant stimuli in blood-injection-injury phobia. Journal of Anxiety differentially related to specific fears. Personality and Individual Differences, 41,
Disorders, 21, 445–455. 1241–1252.
Olatunji, B. O., Williams, N. L., Lohr, J. M., & Sawchuk, C. N. (2005). The structure of Walls, M. M., & Kleinknecht, R. A. (1996). Disgust factors as predictors of blood-
disgust: Domain specificity in relation to contamination ideation and excessive injury fear and fainting. San Jose, CA: Paper presented at the annual meeting
washing. Behaviour Research and Therapy, 43, 1069–1086. of the Western Psychological Association.