Professional Documents
Culture Documents
Psychophysiological Responses To Happy and Sad Music
Psychophysiological Responses To Happy and Sad Music
E
MOTIONAL RESPONSES TO MUSIC LISTENING To unravel the mysteries of varying levels of psycho-
have been studied extensively over the past dec- physiological association between music materials and
ades (Juslin & Sloboda, 2010; Swaminathan & listeners’ responses, Juslin, Harmat, and Eerola (2013)
Schellenberg, 2015). Some theorists have argued that have addressed hypothetical mechanisms that mediate
music may communicate (Argstatter, 2016; Juslin, 1997; emotional responses in different ways (see also Juslin
Mohn, Argstatter, & Wilker, 2011) or even induce basic et al., 2015). For example, these authors found that
emotions including ‘‘happiness’’ and ‘‘sadness’’ (Kreutz, musically induced ‘‘happiness’’ was associated with
Ott, Teichmann, Osawa, & Vaitl, 2007). Others have a memory mechanism, whereas ‘‘sadness’’ was associ-
sought evidence to differentiate these emotions at both ated with a contagion mechanism. These mechanisms
psychological and physiological levels (Juslin, Barradas, refer to more general theories of emotion induction,
& Eerola, 2015; Kreutz, Bongard, & Jussis, 2002; Krum- which hold that elicitation of emotions may occur at
hansl, 1997; Lundqvist, Carlsson, Hilmersson, & Juslin, different levels of processing. Note that the evidence
Music Perception, VOLUM E 35, ISSU E 4, PP. 502–517, IS S N 0730-7829, EL ECTR ONI C ISSN 1533-8312. © 2018 B Y THE R E GE N TS OF THE UN IV E RS I T Y O F CA LI FOR NIA A LL
R IG HTS RES ERV ED . PLEASE DIR ECT ALL REQ UEST S F OR PER MISSION T O PHOT O COPY OR R EPRO DUC E A RTI CLE CONT ENT T HRO UGH T HE UNI VE R S IT Y OF CALI FO RNIA P R E SS ’ S
R EPR IN TS AN D P ERMISSI ONS WEB PAG E , HT T P :// W W W. UCPR ESS . E DU / JOU RNA LS . PHP ? P¼REPR IN TS . DOI: https://doi.org/10.1525/ M P.2018.35.4.502
Psychophysiology of Music Listening and Emotion 503
Preparation phase Experimental phase Debriefing phase Facial electromyography measures can be seen as reli-
Welcome (1 practice trial Detachment of sensors able indicators for discriminating between different emo-
Demographic and followed by main Mood rating tions (Ekman, Levenson, & Friesen, 1983). Musically
music questionnaires experiment = 8 trials*)
Debriefing induced facial EMG responses to different emotion cate-
(Gold-MSI)
gories were found to be in line with the predicted patterns
Application of sensors
across studies (e.g., Witvliet, 1998; Witvliet & Vrana,
Mood and emotion
ratings 2007). Lundqvist and colleagues (2009), for example,
found that ‘‘happy’’ music was associated with greater
ca. 15 minutes ca. 40 minutes ca. 5 minutes zygomatic facial muscle activity than ‘‘sad’’ music.
Skin conductance levels, respiratory rate, as well as
time finger temperature are commonly seen as indicators
0.45 (0.59)
0.00 (0.00)
0.20 (0.40)
0.10 (0.30)
2.20 (0.81)
2.25 (0.77)
2.25 (0.99)
2.65 (0.57)
‘‘sadness’’
müller, 2008). Music as a soundtrack in film is even
considered as one key factor influencing viewers’ emo-
tional responses (Cohen, 2001).
The music excerpts were tested in a pilot experiment
‘‘happiness’’
(0.68)
(0.57)
(0.77)
(0.62)
(0.36)
(0.48)
(0.22)
(0.30)
with 20 participants (10 women, age M ¼ 25.8 years, age
SD ¼ 3.19; 10 men, age M ¼ 29.7 years, age SD ¼ 3.56). In
2.20
2.65
2.00
2.10
0.15
0.35
0.05
0.10
single or group sessions, the participants rated the degree
to which each of the eight ‘‘happy’’ and eight ‘‘sad’’ excerpts
Duration
evoked emotional responses. The items included valence,
(in min)
02:22a,b
02:21a
02:27a,b
02:36b
02:21b
02:30b
02:24a
02:23a,b
arousal, pleasantness, and familiarity as well as six emo-
Note: The superscript ‘‘a’’ means that excerpts were looped to achieve a comparable duration with the other excerpts; the superscript ‘‘b’’ indicates that excerpts were faded out.
00:00-01:28
00:00-01:15
00:00-01:57
00:00-02:36
00:00-02:21
00:00-02:30
00:00-01:47
00:00-02:23
gust,’’ and ‘‘fear.’’ The ratings were recorded on 4-point
(in min)
Section
Likert scales (0 ¼ not at all, 1 ¼ slightly, 2 ¼ somewhat, 3 ¼
very strongly). In addition, listeners rated whether or not
TABLE 1. Description and Pre-test Ratings for “Happiness” and “Sadness” of Music Excerpts Used in the Main Experiment
they were familiar with each of the excerpts.
The music excerpts of highest salience with respect to
Track
10
04
02
03
04
10
21
01
the target emotion categories were selected for the main
experiment. Four of these excerpts represented ‘‘happy’’
Portrait of A Lady
Fantastic Mr. Fox
Soundtrack
that the stimuli were unfamiliar to most participants
Pan’s Labyrinth
The Fountain
The Fountain
(see Table 1 for details).
The Artist
PARTICIPANTS
Thirty-two healthy adults (16 female, age M ¼ 26.25,
age SD ¼ 2.17; 16 male; age M ¼ 26.31, age SD ¼ 3.57)
George Valentin
MEASUREMENT INSTRUMENTS
Twilight Cellos
Javier Navarrete
Ludovic Bource
Clint Mansell
Clint Mansell
Additionally, participants rated valence (pleasant – of the left musculus corrugator and the left musculus
unpleasant) and arousal (activating – calming) on bipo- zygomaticus. Ag/AgCl electrodes were placed according
lar 5-point scales. Liking (‘‘I like this piece of music’’) to standard guidelines (e.g., Fridlund & Cacioppo, 1986;
and familiarity (‘‘I know this piece of music’’) were eval- Tassinary, Cacioppo, & Green, 1989; Ekman, Hager &
uated on 5-point Likert scales ranging from 0 (not at all) Friesen, 1981). Finally, respiratory rate was measured
to 4 (very strongly). using an elastic belt in the abdominal area, which reg-
To assess mood level changes in response to the istered changes in volume. A computer, which was
experimental procedures, participants rated wakeful- placed exterior to the experimental cabin, recorded the
ness on bipolar 5-point scales (awake ¼ 1 – tired ¼ digitized signals via USB-port. Physiological measures
5), attention (attentive ¼ 1 – distracted ¼ 5), and ten- were recorded at a rate of 32 samples per second. The
sion (tensed ¼ 1 – relaxed ¼ 5). signals were monitored during the entire session.
Presentation of excerpts occurred in random order. After ANS data were first analyzed using a 2 x 2 x 2 ANOVA
the experiment, participants filled out a second question- with condition (change score for ‘‘happy’’ music, change
naire about their current mood and were debriefed after- score for ‘‘sad’’ music) as within-subjects factor and gen-
wards. Further information on psychophysiological der (female, male) and music sophistication (nonmusi-
measurements as well as the purpose of the DES was cian, musician) as between-subject factors.
provided upon request. Figure 1 presents a flow chart To consider temporal changes, ANS data were also
of the experimental sessions. Participants were tested analyzed using a 2 x 28 ANOVA, in which the change
individually. Each session lasted approximately 60 min. scores of the ‘‘happy’’ and ‘‘sad’’ music conditions rela-
tive to baseline were entered as the within-subject factor
DATA PREPARATION AND ANALYSES and time block was entered as the repeated measures
The psychophysiological data were exported using the factor. Again, sex (female, male) and music sophistica-
TABLE 2. Means and Standard Deviations of Emotional Experience Ratings (0-300) Before and After Listening to “Happy” and “Sad” Music
TABLE 3. Means and Standard Deviations of Levels of Physiological Activity at Baseline and During Listening to “Happy” and “Sad” Music
as more arousing and ‘‘sad’’ excerpts (M ¼ 3.90, SD ¼ AUTONOMIC NERVOUS SYSTEM (ANS) ACTIVITY
0.61) as more calming, t(62) ¼ 14.04, p < .001, d ¼ Table 3 summarizes the averaged physiological
2.34. The mean rating for liking was 2.63 (SD ¼ 0.64) responses with respect to the recordings of parameters
for ‘‘happy’’ excerpts and 2.20 (SD ¼ 0.84) for ‘‘sad’’ included in this study in relation to baseline values. It
music stimuli, t(62) ¼ 2.32, p < .05, d ¼ 0.44. Excerpts shows that significant physiological responses to
were highly unfamiliar to the participants (Mhappy ¼ ‘‘happy’’ music were found in two variables (skin con-
0.86, SD ¼ 0.83, Msad ¼ 0.35, SD ¼ 0.50), t(50.84) ¼ ductance, respiratory rate), whereas three parameters
2.97, p < .01, d ¼ 0.68. (skin conductance, corrugator, zygomaticus) were asso-
Neither sex nor music sophistication significantly ciated with significant changes in response to ‘‘sad’’
influenced emotion ratings, all Fs 3.67, p .06. Also, music.
general mood before and after the experiment was sta- There were variations of physiological responses in
ble and in a positive range (awake – tired: Mbefore, ¼ the time course of listening during the two music con-
1.88, SD ¼ 0.79; Mafter ¼ 2.22, SD ¼ 0.94; attentive – ditions as calculated relative to baseline. Therefore, the
distracted: Mbefore, ¼ 1.78, SD ¼ 0.71; Mafter ¼ 2.06, following analyses will address the change scores with
SD ¼ 0.76; tensed – relaxed: Mbefore, ¼ 4.00, SD ¼ respect to the ‘‘happy’’ and ‘‘sad’’ music conditions for
0.95; Mafter ¼ 4.06, SD ¼ 0.62), all ts 1.94, p .06). each physiological parameter separately.
Psychophysiology of Music Listening and Emotion 509
Happy
Sad
0,3
0,1
-0,1
-0,3
μS
-0,5
-0,9
1 20 40 60 80 100 120 140
Time (s)
FIGURE 2. Means and standard errors of the means (SEM) of changes of skin conductance levels across emotion categories averaged over all happy
respectively sad music excerpts.
Happy
Sad
2,2
1,8
1,4
breaths/min
0,6
0,2
-0,2
-0,6
1 20 40 60 80 100 120 140
Time (s)
FIGURE 3. Means and standard errors of the means (SEM) of changes of respiratory activity levels across emotion categories averaged over all happy
respectively sad music excerpts.
Skin conductance. Significant influences of order could Respiratory rate. Respiratory rate significantly increased
be observed for skin conductance, F(3.7, 111.71) ¼ when listening to ‘‘happy’’ music in comparison to ‘‘sad’’
4.74, p < .01, p2 ¼ 0.14. There was a significant dif- music, F(1, 28) ¼ 60.32, p < .001, p2 ¼ 0.68. Again, there
ference between the first and the second music excerpt, was a main effect for time block, F(14.56, 815.36) ¼
t(30) ¼ 2.85, p < .001, d ¼ 0.51. Further, there was 1.76, p < .05, p2 ¼ 0.30, indicating an overall higher
a significant main effect for condition, F(1, 27) ¼ breathing rate during music listening as compared to
15.72, p < .001, p2 ¼ 0.37. Skin conductance during baseline (see Figure 3).
listening to ‘‘happy’’ music was significantly higher
than during listening to ‘‘sad’’ music. There was also Heart rate. No significant effects of music condition were
a main effect for time block, F(4.67, 252.19) ¼ 31.46, observed for heart rate, F(1, 27) ¼ 2.14, p ¼ .15, ns, but
p < .001, p2 ¼ 0.37, indicating an overall decrease of there was a main effect for time block F(15.92, 859.58) ¼
skin conductance levels in the time course of listening 2.18, p < .005, ¼ 0.39, again indicating higher cardiac
(see Figure 2). activity during music listening as compared to baseline.
510 Antje Bullack, Niklas Büdenbender, Ingo Roden, & Gunter Kreutz
Happy
Sad
1,3
0,9
0,5
μV
0,1
-0,7
1 20 40 60 80 100 120 140
Time (s)
FIGURE 4A. Means and standard errors of the means (SEM) of changes of corrugator activity levels across emotion categories averaged over all
happy respectively sad music excerpts.
Happy
Sad
1,1
0,7
0,3
μV
-0,1
-0,5
-0,9
-1,3
1 20 40 60 80 100 120 140
Time (s)
FIGURE 4B. Means and standard errors of the means (SEM) of changes of zygomaticus activity levels across emotion categories averaged over all
happy respectively sad music excerpts.
Finger temperature. Significant influences of order were Facial electromyography. Zygomatic activity was higher
observed for temperature, F(2.07, 64.14) ¼ 3.42, p < .05, while listening to ‘‘happy’’ music, F(1, 26) ¼ 13.52, p <
p2 ¼ 0.99. Specifically, temperature increased from the .01, p2 ¼ 0.34, than when listening to ‘‘sad’’ music. An
first to the second piece of music, t(32) ¼ 3.21, p < .01, increase of corrugator activity was found for the ‘‘sad’’
d ¼ 0.57. No significant main effects of ‘‘happy’’ or music condition, F(1, 27) ¼ 6.53, p < .05, p2 ¼ 0.20.
‘‘sad’’ music on finger temperature occurred, F(1, 28) ¼ A significant main effect for time block was found for
1.72, p ¼ .20, ns. However, a significant effect of time both zygomatic, F(6.35, 330.05) ¼ 3.91, p < .001, p2 ¼
block, F(1.22, 68.26) ¼ 3.86, p < .05, p2 ¼ 0.64, was 0.07, and corrugator activity, F(5.26, 284.07) ¼ 7.05, p <
found, indicating a small decrease of finger temperature .001, p2 ¼ 0.12. Whereas zygomatic activity showed
during music listening. A nonsignificant increase of fin- a slight decrease, corrugator activity increased over time
ger temperature relative to baseline was also associated in both music conditions (cf. Figures 4a and 4b).
with exposure to ‘‘sad’’ rather than ‘‘happy’’ music (cf. Table 4 summarizes and compares the effect sizes of
Table 3). dependent measures in Lundqvist et al. (2009) and the
Psychophysiology of Music Listening and Emotion 511
TABLE 4. Comparison of Effect Sizes (p2 ) of Dependent Measures there remained a significant difference in happiness
(“Happy” versus “Sad” Music) Between Lundqvist et al. (2009) and indicating higher values after listening to ‘‘happy’’ music
Present Study
as compared to ‘‘sad’’ music. Moreover, perceived sad-
Lundqvist et al. (2009) Present study ness increased after listening to ‘‘sad’’ music, which is in
line with expectations (Lundqvist et al., 2009). Given
Skin Conductance .18" .37" that participants started the experiment in a positive
Respiration rate n/a* .68"
Heart rate n/a** .07 mood, it is not too surprising that listening to generally
Temperature .12# .06 unfamiliar music did not lead to increases in positive
Corrugator n/a** .20# affect (Hunter, Schellenberg, & Griffith, 2011). With
Zygomatic .13" .34" respect to induced sadness, ‘‘sad’’ music, again as
Note: " indicates values were significantly higher in response to ‘‘happy’’ music as expected, was highly effective in intensifying this emo-
in response to music, whereas Kreutz et al. (2007) no professional musicians represented in the study sam-
observed influences of stylistic preferences on emotional ple. In addition, listeners were recruited from a healthy
responses to music excerpts. Moreover, Liljeström et al. student population. It would be of interest to extend the
(2012) found that self-chosen music arouses more present work to other populations including children
intense emotions as randomly selected music as indicated and older adults as well as individuals suffering from
by psychological and physiological markers. By contrast, physical and/or mental health problems. Moreover, the
however, work by Iwanaga and Moroki (1999) as well as present study adds further evidence suggesting that
Bernardi et al. (2006) suggested little influence of music music listening to ‘‘sad’’ music evokes stronger and
preference on physiological measures. more complex responses than does ‘‘happy’’ music. It
would be of interest to examine more systematically
Conclusions to what extent this asymmetry arises from music-,
References
A LI , S. O., & P EYNIRCIOGLU, Z. F. (2006). Songs and emotions: B ERNARDI , L., P ORTA , C., C ASUCCI , G., B ALSAMO, R., B ERNARDI ,
Are lyrics and melodies equal partners? Psychology of Music, N. F., F OGARI , R., & S LEIGHT, P. (2009). Dynamic interactions
34, 511–534. DOI: 10.1177/0305735606067168 between musical, cardiovascular, and cerebral rhythms in
A LTENMÜLLER , E. O., S CHÜRMANN , K., L IM , V. K., & PARLITZ , D. humans. Circulation, 119, 3171–3180. DOI: 10.1161/
(2002). Hits to the left, flops to the right: Different emotions CIRCULATIONAHA.108.806174
during listening to music are reflected in cortical lateralisation B ERNARDI , L., P ORTA , C., & S LEIGHT, P. (2006). Cardiovascular,
patterns. Neuropsychologia, 40, 2242–2256. DOI: 10.1016/ cerebrovascular, and respiratory changes induced by different
S0028-3932(02)00107-0 types of music in musicians and non-musicians: The impor-
A NDERSON , C. A., C ARNAGEY, N. L., E UBANKS , J. (2003). tance of silence. Heart, 92, 445–452. DOI: 10.1136/
Exposure to violent media: The effects of songs with violent hrt.2005.064600
lyrics on aggressive thoughts and feelings. Journal of B IGAND, E., & P OULIN -C HARRONNAT, B. (2006). Are we ‘‘expe-
Personality and Social Psychology, 84, 960–971. DOI: 10.1037/ rienced listeners’’? A review of the musical capacities that do
0022-3514.84.5.960 not depend on formal musical training. Cognition, 100, 100–
A RGSTATTER , H. (2016). Perception of basic emotions in music: 130. DOI: 10.1016/j.cognition.2005.11.007
Culture-specific or multicultural? Psychology of Music, 44, B IGAND, E., V IEILLARD, S., M ADURELL , F., M AROZEAU, J., &
674–690. DOI: 10.1177/0305735615589214 DACQUET, A. (2005). Multidimensional scaling of emotional
B ARTLETT, D. L. (1996). Psychophysiological responses to music responses to music: The effect of musical expertise and of the
and sound stimuli. In D. A. Hodges (Ed.), Handbook of Music duration of the excerpts. Cognition and Emotion, 19, 1113–
Psychology (2nd ed., pp. 343–385). San Antonio, TX: Institute 1139. DOI: 10.1080/02699930500204250
for Music Research Press. B LOOD, A. J., & Z ATORRE , R. J. (2001). Intensely pleasurable
B AUMGARTNER , T., E SSLEN , M., & JÄNCKE , L. (2006). From responses to music correlate with activity in brain
emotion perception to emotion experience: Emotions evoked regions implicated in reward and emotion. Proceedings
by pictures and classical music. International Journal of of the National Academy of Sciences of the United States
Psychophysiology, 60, 34–43. DOI: 10.1016/ of America, 98, 11818–11823. DOI: 10.1073/
j.ijpsycho.2005.04.007 pnas.191355898
Psychophysiology of Music Listening and Emotion 515
B RADLEY, M. M., & L ANG , P. J. (2000). Affective reactions to E VANS , P., & S CHUBERT, E. (2008). Relationships between
acoustic stimuli. Psychophysiology, 37, 204–215. DOI: 10.1111/ expressed and felt emotions in music. Musicae Scientiae, 12,
1469-8986.3720204 75–99. DOI: 10.1177/102986490801200105
C OHEN , A. (2001). Music as a source of emotion in film. In J. F RIDLUND, A. J., & C ACIOPPO, J. T. (1986). Guidelines for human
A. Sloboda & P. N. Juslin (Eds.), Music and emotion: Theory electromyographic research. Psychophysiology, 23, 567–589.
and research (pp. 249–272). New York: Oxford University DOI: 10.1111/j.1469-8986.1986.tb00676.x
Press. G ARRIDO, S., & S CHUBERT, E. (2011). Individual differences in
C RAIG , D. G. (2005). An exploratory study of physiological the enjoyment of negative emotion in music: A literature
changes during ‘‘chills’’ induced by music. Musicae Scientiae, 9, review and experiment. Music Perception, 28, 279–296. DOI:
273–287. DOI: 10.1177/102986490500900207 10.1525/mp.2011.28.3.279
DAWSON , M. E., S CHELL , A. M., & F ILION , D. L. (2016). The G OMEZ , P., & DANUSER , B. (2004). Affective and physiological
J USLIN , P. N., H ARMAT, L., & E EROLA , T. (2013). What makes K RUMHANSL , C. L. (1997). An exploratory study of musical
music emotionally significant? Exploring the underlying emotions and psychophysiology. Canadian Journal of
mechanisms. Psychology of Music, 42, 599–623. DOI: 10.1177/ Experimental Psychology, 51, 336–353. DOI: 10.1037/1196-
0305735613484548 1961.51.4.336
J USLIN , P. N., L ILJESTRÖM , S. VÄSTFJÄLL , S. B ARRADAS , G., & L ARSEN , J. T., N ORRIS , C. J., & C ACIOPPO, J. T. (2003). Effects of
S ILVA , A. (2008). An experience sampling study of emotional positive and negative affect on electromyographic activity over
reactions to music: Listener, music, and situation. Emotion, 8, zygomaticus major and corrugator supercilii. Psychophysiology,
668–683. DOI: 10.1037/a0013505. 40, 776–785. DOI: 10.1111/1469-8986.00078
J USLIN , P. N., & S LOBODA , J. A. (2010). Handbook of music and L EVENSON , R. W. (2003). Autonomic specificity and emotion. In
emotion: Theory, research, applications. New York: Oxford R. J. Davidson, K. R. Scherer, & H. H. Goldsmith (Eds.),
University Press. DOI: 10.1093/acprof: oso/ Handbook of Affective Sciences (pp. 212–224). New York:
N YKLICEK , I., T HAYER , J. F., & VAN D OORNEN , L. J. P. (1997). T HAYER , J. F., & FAITH , M. L. (2006). A dynamic systems model
Cardiorespiratory differentiation of musicall-induced emo- of musically induced emotions. Annals of the New York
tions. Journal of Psychophysiology, 11, 304–321. Academy of Sciences, 930(1), 452–456. DOI: 10.1111/j.1749-
O PEN S CIENCE C OLLABORATION . (2015). Estimating the repro- 6632.2001.tb05768.x
ducibility of psychological science. Science, 349, aac4716. DOI: T ROCHIDIS , K., S EARS , D., T RÂN , D.-L., & M C A DAMS , S. (2013).
10.1126/science.aac4716 Psychophysiological measures of emotional response to romantic
R ICKARD, N. S. (2004). Intense emotional responses to music: orchestral music and their musical and acoustic correlates. In M.
A test of the physiological arousal hypothesis. Psychology of Aramaki, Barthet M., Kronland-Martinet R., Ystad S. (Eds.),
Music, 32, 371–388. DOI: 10.1177/0305735604046096 Lecture Notes in Computer Science (pp. 44–57). Heidelberg,
R OBAZZA , C., M ACALUSO, C., & D’U RSO, V. (1994). Emotional Germany: Springer. DOI: 10.1007/978-3-642-41248-6_3
reactions to music by gender, age, and expertise. Perceptual and V ERDUYN , P., D ELVAUX , E., VAN C OILLIE , H., T UERLINCKX , F., &