Download as pdf or txt
Download as pdf or txt
You are on page 1of 15

Article

Expression of Emotion in Voice and Music

SCHERER, Klaus R.

Abstract

Vocal communication of emotion is biologically adaptive for socially living species and has
therefore evolved in a phylogenetically continuous manner. Human affect bursts or
interjections can be considered close parallels to animal affect vocalizations. The
development of speech, unique to the human species, has relied on the voice as a carrier
signal, and thus emotion effects on the voice become audible during speech. This article
reviews (a) the evidence on listeners' ability to accurately identify a speaker's emotion from
voice cues alone, (b) the research efforts trying to isolate the acoustic features that determine
listener judgments, and (c) the findings on actual acoustic concomitants of a speaker's
emotional state (real or portrayed by actors). Finally, based on speculations about the joint
origin of speech and vocal music in nonlinguistic affect vocalizations, similarities of emotion
expression in speech and music are discussed.

Reference
SCHERER, Klaus R. Expression of Emotion in Voice and Music. Journal of Voice, 1995, vol. 9,
no. 3, p. 235-248

DOI : 10.1016/S0892-1997(05)80231-0

Available at:
http://archive-ouverte.unige.ch/unige:102028

Disclaimer: layout of this document may differ from the published version.
Journal of Voice
Vol. 9, No. 3, pp. 235-248
© 1995Lippincott-RavenPublishers. Philadelphia

Expression of Emotion in Voice and Music

K l a u s R. S c h e r e r

Department of Psychology, University of Geneva, Geneva, Switzerland

Summary: Vocal communication of emotion is biologically adaptive for so-


cially living species and has therefore evolved in a phylogenetically continuous
manner. Human affect bursts or interjections can be considered close parallels
to animal affect vocalizations. The development of speech, unique to the hu-
man species, has relied on the voice as a carrier signal, and thus emotion
effects on the voice become audible during speech. This article reviews (a) the
evidence on listeners' ability to accurately identify a speaker's emotion from
voice cues alone, (b) the research efforts trying to isolate the acoustic features
that determine listener judgments, and (c) the findings on actual acoustic con-
comitants of a speaker's emotional state (real or portrayed by actors). Finally,
based on speculations about the joint origin of speech and vocal music in
nonlinguistic affect vocalizations, similarities of emotion expression in speech
and music are discussed. Key Words: Affect vocalization--Emotional expres-
s i o n - P r o s o d y - S i n g i n g - N o n v e r b a l c o m m u n i c a t i o n - - E m o t i o n effects on
voice.

Emotions produce pervasive, although generally Thus, as first demonstrated in Darwin's classic
short-lived, changes in the organism as a whole. work on the expression of emotion in humans and
They represent reactions to events of major signif- animals (4), emotional expression serves the vital
icance to the individual and mobilize all resources function of externalizing an individual's reaction
to cope with the respective situation, positive or and action propensity and of communicating this
negative. The most significant feature of the emo- information to the social environment. Just as emo-
tion mechanism is that it produces specific action tion is phylogenetically continuous, found in more
readiness while providing a latency period that al- or less rudimentary form in many, particularly
lows adaptation of the behavioral reactions to the mammalian, species, so is emotional expression,
situational demands (I-3). One of the major uses of particularly in species in which social life is based
this latency period in socially living species is to on complex interactions among individuals. All ex-
predict the likely reaction of others to an action that pressive modalities, particularly body posture, fa-
is " r e a d y " for execution as the result of a particular cial features, and vocalization, are involved in emo-
emotional state. For example, before actually en- tion communication. As far as facial expression is
gaging in an aggressive act, I can first shout angrily concerned, behavioral and social scientists have
at someone who has offended me and back down if made much progress in gathering evidence on the
it turns out that the other is likely to retaliate vio- phylogenetic continuity (5), the universality across
lently. cultures (6,7), and the rich information content of
emotion in facial expressions (8).
Although less frequently studied than facial ex-
Accepted February 3, 1994.
Address correspondence and reprint requests to Dr. K. pression, the vocal communication of emotion has
Scherer at Department of Psychology, University of Geneva, 9, also been under scrutiny in the biological and psy-
route de Drize, CH-1227 Carouge-Geneva, Switzerland. chological sciences. The large majority of all animal
This article represents the written version of a keynote address
to the 22nd Annual Symposium on Care of the Professional vocalizations are affective in nature while, at the
Voice, Philadelphia, June 7-12, 1993. same time, serving representational functions

235
236 K. R. SCHERER

(9,10). Research on animal communication has and natural scientists, e.g., Heimholtz, that both
demonstrated that in many species affective states, protospeech and protomusic have evolved from
generally linked to changes in physiological arousal, such primitive affect vocalizations. Scherer (24) has
are externalized in vocalizations and serve specific suggested following up on these early suggestions.
communication functions, often involving acoustic He cites ethological work having shown that ex-
patterns that are similar across species (I 1-15). In pression and impression are closely linked (25,26),
close parallel to animal affect vocalizations, we still suggesting that, in the process of conventionaliza-
find rudiments of nonlinguistic human affect vocal- tion and ritualization, expressive signals may have
izations, often referred to as "interjections," such been shaped by the constraints of transmission
as " o u c h , " " a i , " " o h , " " y u c k , " etc. Kleinpaul characteristics, limitations of sensory organs, or
(16) claimed that these reflexive "nature and feeling other factors. The resulting flexibility of the com-
sounds" sound very much the same when uttered munication code may have fostered the evolution of
by speakers in different cultures. He insisted on a more abstract, symbolic language and music sys-
sharp distinction between spontaneously occurring tems. It is noted that this development is likely to
interjections or exclamations expressing an emo- have occurred in close conjunction with the evolu-
tional state and calls or shouts intentionally uttered tion of the brain. Just as newer neocortical struc-
for communicative reasons. Wundt (17) traced tures with highly cognitive modes of functioning
these vocalizations back to inarticulate screams and have been superimposed on older " e m o t i o n a l "
cries accompanying very intense feelings of aver- structures such as the limbic system, the evolution
sion, rage, and fear. He distinguished between (a) of human speech as a digital system of information
primary interjections, defined as "nature sounds" encoding and transmission (and of musical scales
and (b) secondary interjections, which become as- and conventions for singing) has made use of the
similated into the language. Kainz (18) claimed that more primitive, analogue vocal affect signaling sys-
as civilization advances, emotions are less and less tem as a carrier signal.
frequently expressed by means of pure "'nature As vocalization, which remained a major modal-
sounds" but rather by interjections that have been ity for analog emotion expression, became the pro-
assimilated into language. duction system for the highly formalized, segmental
Linguists interested in speech have also dis- systems of language and singing, both of these func-
cussed these "prelinguistic fragments" in the flow tions needed to be served at the same time. Thus, in
of speech. James (19) reviews the respective writ- speech, changes in fundamental frequency (Fo), for-
ings of some of the classic authors in the field mant structure, or characteristics of the glottal
(Bloomfield, Fries, Jespersen, Sapir) who all agreed source spectrum can, depending on the language
on the affective significance of interjections, their and the context, serve to communicate phonologi-
"primitive" and noncommunicative nature, and cal contrasts, syntactic choices, pragmatic mean-
their lack of grammatical structure. Scherer (20) fo- ing, or emotional expression. Similarly, in music,
cused on the functions of these affect vocalizations. melody, harmonic structure, or timing may reflect
One can show that these serve practically all of the the composer's intentions, depending on specific
semantic, syntactic, pragmatic, and dialogical func- traditions of music, and may simultaneously induce
tions of nonverbal behavior in conversation [see strong emotional moods (27-29). This fusion of two
Scherer (21) for a more detailed discussion of these signal systems, which are quite different in function
functions]. Goffman (22) has provided an analysis and in structure, into a single underlying production
of interjections from an interactionist view. He de- mechanism, vocalization, has proven to be singu-
fines exclamatory, nonlexicalized, discrete interjec- larly efficient for the purpose of communication.
tions as "response cries," expressions that he sees In this article it is claimed that emotions differ-
as " a natural overflowing, a flooding up of previ- entially shape human vocal expression in speech
ously contained feeling, a bursting of normal re- and music and that listeners are capable of correctly
straints, a case of being caught off-guard." An ex- inferring a speaker's emotional state (or an actor/
tensive discussion of such affect vocalizations or singer's attempt to portray such a state) from the
"facial/vocal affect bursts" can be found in Scherer voice alone. It is instructive to start with the per-
(23). ception of emotion. If it is demonstrated that emo-
Historically, there have been many suggestions tion can be correctly diagnosed from the voice, then
by both philosophers, e.g., Rousseau and Herder, clearly the emotions must differentially affect the

Journal of Voice. VoL 9. No. 3. 1995


E X P R E S S I O N OF E MO TIO N I N VOICE A N D MU SIC 237

vocalization mechanism and, in consequence, yield racy of 56%. In consequence--after correction for
demonstrable differences in acoustic patterning of chance guessing and sampling error--the recogni-
the resulting sound waves. That the human voice tion of emotion from standardized voice samples,
not only permits judging the speaker's emotion but using actor portrayals, seems to lie at -50%, ap-
can also induce affect in the listener has been held proximately four to five times higher than what
as self-evident throughout history. In particular, would be expected by chance.
ever since antiquity, different schools of rhetoric Not all of the different emotions are identified
have insisted on the powerful effect of emotional equally well. Sadness and anger are best recog-
expression in the voice on the listener (Cicero, nized, followed by fear and joy. Disgust is the
Quintilian). worst, with the accuracy barely above chance. The
Even though such effects may seem evident, be- data show the need to analyze the recognizability of
havioral scientists require empirical evidence that, different emotions separately using confusion ma-
indeed, listeners are able to correctly recognize the trices, because errors are not randomly distributed
speaker's emotional state from vocal cues alone, and the patterns of misidentification provide impor-
independent of information from situational context tant information on the judgment process. Also,
or other expressive cues, such as facial expres- cross-cultural studies are needed to elucidate the
sions, gestures, or posture. The evidence to date is role of language, and culture in this process. Frick
reviewed in the following sections. (33) reviewed work in this area and concluded on
the basis of the data that the vocal expression of at
JUDGING EMOTIONAL STATES FROM least some emotions seems to be universal.
THE VOICE

During the last 50 years, many studies have ex- IDENTIFYING THE ACOUSTIC CUES USED IN
amined listeners' ability to correctly recognize or EMOTION INFERENCE FROM VOICE
infer speaker affect state or attitude from voice
If listeners are able to recognize vocally por-
samples. In general, researchers have asked speak-
trayed emotions with better than chance accuracy,
ers (often actors, both amateur and professional) to
one should be able to determine which acoustic
vocally portray different emotional states while pro-
cues they perceive and use in the process of attrib-
ducing a standard utterance (e.g., numbers, letters
uting emotion to a speaker. In fact, even if the lis-
of the alphabet, nonsense syllables, or standardized
teners' emotion inference is inaccurate, one would
sentences). The voice samples are recorded and
still want to know which vocal cues are attended to
later presented to lay judges, who are to identify
and how they are interpreted with respect to the
which emotion is expressed in each of the different
underlying emotional state. Different research strat-
portrayals.
egies have been used to determine the importance
In a comprehensive review of these studies,
of various acoustic cues in the judgment process.
Scherer (30) reported an average accuracy of
-60%. This is well above what one would expect to 1. It is possible to use electroacoustic or digital
obtain if the listener judgments were based exclu- equipment and/or voice experts to measure
sively on guessing, i.e., on chance (-12%). The de- the acoustic and/or phonatory-articulatory
gree of recognition accuracy is impressive given characteristics of the vocal emotion portray-
that some of the studies included emotions such as als, and to then correlate these with the listen-
love, pride, or jealousy, which are not part of the ers' judgments of underlying emotion or atti-
set of basic or fundamental emotions (e.g., anger, tude of the speaker. Several studies of this
joy, sadness, fear). type have yielded information on which vocal
Two recent studies confirm the earlier estimate characteristics affect the judges' inference
on vocal emotion recognition accuracy. In a study (31,34).
of disgust, surprise, shame, interest, joy, fear, sad- 2. Another approach consists of partially or com-
ness, and anger, von Bezooijen (31) found a mean pletely masking particular verbal/vocal cues to
accuracy of 65%. Based on another recent series of identify which information is carried by these
studies of five emotions fear, joy, sadness, anger, characteristics. One of the best known tech-
and d i s g u s t - - u s i n g different types of listener niques is low-pass filtering of the speech sam-
groups, Scherer et ai. (32) reported a mean accu- ple (at -300-400 Hz, restricting the informa-

Journal of Voice, Vol. 9, No. 3, 1995


238 K. R. SCHERER

tion to the fundamental frequency range). This . The recent development of electronic sound
eliminates the intelligibility of speech and al- synthesis procedures allows systematic exper-
lows studying the extent to which vocal cues imental manipulation of different acoustic
in the very low-frequency range (particularly cues. In an early study, L i e b e r m a n and
temporal structure, dynamic loudness, and in- Michaels (39) studied the effect of systematic
tonation cues) carry affective information variations of Fo and envelope contour on emo-
(35,36). Scherer et al. (37) have compared dif- tion inference. Using the MOOG synthesizer,
ferent masking techniques (electronic filtering, Scherer and Oshinsky (40) studied the effects
randomized splicing, playing backwards, pitch of amplitude variation, pitch level, contour
inversion, and tone-silencing coding). Each of and variation, tempo, envelope, harmonic
these techniques removes and/or preserves richness, tonality, and rhythm on emotional
different combinations of acoustic character- attributions to sentence-like sound sequences
istics of a vocal expression. In consequence, and musical melodies. Table 1 shows the re-
the systematic use of several techniques per- sults of this study. The systematic design of
mit determination of which acoustic cues the study allows statistical determination of
carry which type of emotional information. the importance or power of the respective cue
Because intelligibility is removed by all of for the listener judgment. Tempo of the sounds
these masking procedures, their application in the sequence and filtration level (i.e., num-
permits the use of natural speech material in ber of audible higher harmonics) were by far
judgment and analysis studies, including ex- the most powerful cues.
cerpts from real social interactions with "real-
life" rather than artificially posed emotions.
For example, Scherer et al. (38) used a cor- TABLE 1. Emotional attributions significantly
associated with acoustic parameters (reproduced from
pus of affectively laden utterances by civil ser-
ref. 40, p. 339)
vants in interaction with citizens to determine
which acoustic cues are used by listeners to Emotion rating
Acoustic scales listed in
infer speaker emotion and attitude. Different parameters of Direction decreasing order of
groups of judges were presented with full au- tone sequences of effect associative strength
dio records, with electronically filtered, ran- Amplitude Small Happiness. pleasantness,
domly spliced, and reversed versions, as well variation Large activity
as with verbal transcripts. Virtually all of the Fear
affective information was contained in the vo- Pitch variation Small Disgust, anger, fear,
cal expression samples (textual cues allowing Large boredom
Happiness, pleasantness,
only an inference of aggressiveness contained activity, surprise
in the utterance). Arousal and uncertainty of Pitch contour Down Boredom, pleasantness,
the speakers were well captured in several Up sadness
masking conditions and seemed to be commu- Fear, surprise, anger,
potency
nicated by F 0 variability and F o mean, respec-
tively. Pitch level Low Boredom, pleasantness,
High sadness
One of the major issues explored in this Surprise, potency, anger,
study was the nature of the relationship be- fear, activity
tween vocal cues and pragmatic or semantic Tempo Slow Sadness, boredom, disgust
information. A number of acoustic parame- Fast Activity, surprise,
happiness, pleasantness,
ters, in particular F o mean or floor and Fo vari- potency, fear, anger
ability, varied quite continuously with speaker
Envelope Round Disgust, sadness, fear,
arousal, suggesting a linear covariation or cor- Sharp boredom, potency
relation between psychophysiological speaker Pleasantness, happiness,
state and listener judgment. However, this surprise, activity
was not the case for one of the prosodic vari- Filtration cutoff Intermediate Pleasantness, boredom,
(few) happiness, sadness
ables studied--intonation c o n t o u r - - w h e r e
there seemed to be an interaction with the lin- Level (number High (many) Potency, anger, disgust,
of harmonics) fear, activity, surprise
guistic form of the respective utterance.

Journal of Voice, Vol. 9, No. 3, 1995


E X P R E S S I O N OF E MO TIO N I N VOICE A N D M U S I C 239

Computer-based copy synthesis (or resynthesis) MEAN 5


IRA TING
techniques make it possible to take natural voices
and systematically change different cues via digital
manipulation of the sound waves. In a number of
recent studies by Scherer and collaborators, F o in~o~
3"
level, contour variability and range, intensity, du- ~ a ~ o g a n t

ration, and accent structure of real utterances have


been systematically manipulated (41,42). 2-
These manipulated voice samples were presented
to listeners who judged the apparent speaker atti-
tude and emotional state for each stimulus. The re-
sults showed strong direct effects for all of the vari-
ables manipulated on these ratings. Relatively few I
1
I
2 3
I
4 5
I I

effects due to interactions between the manipulated LEVEL OF" RANGE


variables were found. This implies that the synthe-
sized variables independently influenced judges'
ratings. Only very minor effects for speaker and MEAN 5
utterance content were found, indicating that the RA TING
reproQchfuI
results are likely to generalize over different speak-
ers and utterances.
Of all variables studied, F 0 range had the most
powerful effect on judgments. Narrow F o range was 3¸
seen as a sign of sadness or of absence of specific
speaker attitudes. Wide F o range was consistently
judged as expressing high arousal, producing attri-
butions of strong negative emotions such as annoy-
ance or anger, or for the presence of strongly de-
veloped speaker attitudes such as involvement, re-
proach, or emphatic stress. Furthermore, the data t o I I I
supported the hypothesis, derived from the earlier l 2 3 4 5
LEVEL OF RANGE
study by Scherer et al. (38), that these effects FIG. 1. Speaker emotionality and attitude ratings as a function
should be continuous, i.e., yielding a linear relation- of extent of resynthesized F o range (reproduced from ref. 42, p.
ship between the size of F o range and the strength of 441).
emotion attribution (Fig. l). High intensity was in-
terpreted in terms of negative affects or aggressive
speaker attitudes. Short voiced segment duration suming that there is a clear criterion for the nature
(fast tempo) was correlated with inferences of joy, of the emotion present (or, as in most research stud-
and long duration (slow tempo) was correlated with ies, of an actor's encoding intention). However, the
inferences of sadness (see refs. 41 and 42 for details early rhetoricians have claimed that powerful emo-
of the procedures and results). tional oratory, using voice effects in addition to ver-
In a further study (experiment IV in ref. 41), bal appeal, is able to induce emotion. Unfortu-
checking on the stability of the effects obtained, a nately, there has been very little research on this
highly trained speaker was asked to portray differ- issue. A possible induction mechanism might be
ent emotions while producing a standard utterance. represented by a process of empathy via motor
Emotion-specific acoustic characteristics were dig- mimicry as suggested by Lipps (43, pp. 228-231 ; see
itally resynthesized in such a way as to turn the also refs. 44, 45).
utterance into a neutral rendering. The relative suc-
cess of this procedure attests to the important role THE EXTERNALIZATION OF EMOTION IN
of F o range, intensity, and tempo on the judgment of THE VOICE
speaker emotions and attitudes by listeners.
So far, the emphasis has been placed on the rec- The review of the evidence on accurate decoding
ognition of a speaker's emotion from the voice, as- of emotion from the voice has shown that the infor-

Journal o f Voice, Vol. 9, No. 3, 1995


240 K. R. SCHERER

mation is obviously there, confirming the early pattern of the speech waveform. This is shown by
hunches from classical rhetoric. It remains to be the fact that even if a speaker attempts to reproduce
shown, then, how emotional arousal affects the vo- a particular utterance in exactly the same way im-
cal organs and to identify emotion-specific acoustic mediately after having spoken it for the first time,
patterning. some changes are likely to occur. The enormous
Emotion has been defined as consisting of a syn- sensitivity of the acoustic output to minor changes
chronization of changes in all organismic sub- in voice production settings provides a sensitive
systems, thus accounting for the pervasiveness and and rapidly responding system for monitoring emo-
power of emotional states (46). Because vocaliza- tional arousal, but also introduces a high degree of
tion reflects the activity of many different aspects of noise into the system.
the functioning of the nervous and somatic systems, So far, it may seem as though acoustic patterns
one would expect many different determinants of automatically mirror emotion-produced changes of
emotion effects on the voice. Some of the major the internal physiological system. However, be-
mechanisms involved will be briefly outlined below cause vocalization has developed in part as a social
(see refs. 3, 47, 48 for more detailed discussions). communicative signaling system, the simple exter-
Figure 2 shows some of the main effects of the nalization of internal states has been supplemented
major neurophysiological structures on the voice by display mechanisms producing a specific impres-
production mechanisms. Speech production is sion in the listener (independent of internal state).
mostly controlled by the neocortex. Specific motor For example, in highly constrained, formal situa-
commands produce appropriate phonatory and ar- tions requiring politeness or cheerfulness, one will
ticulatory movements for the desired sequence of produce the appropriate pleasant voice quality in
speech sounds, including intentionally produced spite of internally boiling with rage. In the course of
prosodic features (intonation, voice quality). The the evolution of expressive communication sys-
intended vocal effects are mostly produced by pha- tems, impression models have molded the nature of
sic activation of the muscles serving phonation and expression (see ref. 26, for a thorough discussion of
articulation. this point) and human vocalization is also partially
The effects of emotional arousal on the vocaliza- determined by such social "display rules" (8,17).
tion process are primarily controlled by the iimbic Scherer et al. (14,50,51) have introduced the dis-
system (11,49). They are generally produced via tinction between push effects and pull effects to dis-
tonic activation in the somatic nervous system (in tinguish among the determining factors that operate
particular the striated musculature) and sympa- on vocalization.
thetic as well as parasympathetic activation of the Push effects are produced by the physiological
autonomous nervous system. In addition, direct changes that accompany emotional arousal and that
sympathetic or parasympathetic effects such as res- consequently change the voice production mecha-
piration changes and the secretion of mucus can nism in predictable ways (e.g., increased tension of
affect the production of the vocalization. the laryngeal muscles producing higher fundamen-
Given the manifold determinants of voice produc- tal frequency of the voice). Pull effects, on the other
tion processes, even slight changes in physiological hand, are independent of the internal physiological
regulation will produce variations in the acoustic processes in the organism. Their origin is found in

Limbic system Neocortex

FIG. 2. Effects of neurophysiological struc-


ANS ~ SNS tures on voice production mechanisms (repro-
Sympathetic q Muscle l o n e duced from Scherer, 1989, p. 169).
activation
PorasympotheticJ Motor commands

Respiration Phonatioa Articulation

Journal of Voice, Vol. 9, No. 3, 1995


E X P R E S S I O N OF E MO TIO N I N VOICE A N D M U S I C 241

external factors, such as ritualized or conventional- directed F0 contours. The rate of articulation usu-
ized acoustic signal patterns, that are required to ally increases in anger.
ensure information transfer, constraints on the Fear: One expects a very high arousal level for
acoustic signal structure imposed by a communica- fear. Consistent with this hypothesis, the data show
tion channel or the environment, or the need for increases in mean Fo, in F 0 range, and in high-
self-presentation (given the impression formation frequency energy. Rate of articulation increases. In
rules of the listeners). In most cases, the acoustic some studies, higher mean Fo is also reported for
nature of a vocalization, particularly in humans, is the weaker forms of fear (i.e., worry or anxiety).
determined by both types of effects: the effects of Sadness: In sadness, mean F0, F0 range, and
emotion-related physiological changes internal to mean intensity all decrease, and Fo contours are
the organism, and effects of external constraints or generally downward directed. High-frequency en-
social target patterns. Given the difficulty of disen- ergy and rate of articulation decrease.
tangling the two types of effects, most studies so far Joy: Studies consistently show increases in mean
have not differentiated between push and pull ef- Fo, Fo range, F 0 variability, and mean intensity.
fects. There is some evidence of an increase in high-
Empirical studies on the acoustic patterns of frequency energy and in rate of articulation.
emotional expression in the voice, using objective Whenever the findings in the literature converge,
measurement, have been reported early on (see they are related to autonomic arousal. The vocal
refs. 3, 30, 33, 47, 48, 52, and 53 for reviews of this cues that indicate arousal or activation are similar
early work). Many of these studies have been mo- across different emotions. So far, there is relatively
tivated by the obvious diagnostic implications of little evidence for the vocal differentiation of indi-
vocal analysis, particularly with respect to detect- vidual emotions on other dimensions such as va-
ing stress (54-56), differentiating types of emotional lence (3). However, because judges are able to rec-
disorders (depression, schizophrenia), and evaluat- ognize the individual emotions on the basis of vocal
ing treatment effects (see ref. 48 for a review). cues alone, there must be acoustic characteristics
Work on the acoustic measurement of natural that differentiate the various emotions in addition to
emotion expression has been handicapped by the indicating arousal. So far, the number of acoustic
practical and ethical difficulties of producing strong cues that are measured in studies in this area has
emotions in the laboratory. There are also few ex- been very limited indeed. More parameters will
amples of impromptu recorded instances of vocal have to be assessed, particularly measures of en-
emotion expression in real life (such as the famous ergy distribution in the spectrum. Most impor-
recording of a radio reporters' emotional commen- tantly, researchers in this area need to differentiate
tary on the explosion of the Zeppelin "Hinden- emotional states much more precisely, particularly
burg" in 1937; see ref. 52). In consequence, many with respect to subdued and aroused types of the
researchers in this area have used actors as sub- same emotion family. For example, the anger fam-
jects, asking them to vocally portray different emo- ily contains both cold anger, a subdued form, and
tions, and have analyzed the acoustic features of hot anger, a highly aroused form of anger with
the recorded portrayals. Although the actors in highly different physiological and expressive char-
some of the studies used Stanislavski-like induction acteristics (3,50). It is to be expected that there will
techniques, trying to at least partially produce the be a sizable increase in the discriminative power of
emotion to be portrayed, one cannot be sure that the acoustic parameters when both of these require-
the results correspond to genuine emotion expres- meats are met.
sion in the voice (see refs. 32 and 34 for a discussion Most of the studies in this area have attempted to
of this point). The present state of the evidence, find acoustic correlates for categorically labeled af-
which is mostly based on studies with actors, can be fect states. It is possible that emotional states are
summarized as follows (see ref. 57 for details): not that clearly differentiated. In fact, many emo-
Anger: Anger is vocally expressed by an increase tion psychologists have commented on the strong
in mean Fo and mean intensity. Some studies, which probability that most real-life emotions are actually
may have been measuring " h o t " rather than blends of different basic emotions or episodic pro-
"cold" anger, also claim higher F 0 variability and a cesses with rapidly changing affective states (1,2).
wider range of F0. Further anger signs seem to be This could be equally true for emotions induced in
increases in high- frequency energy and downward- the laboratory or portrayed by actors. Cosmides

Journal of Voice, Vol. 9, No. 3, 1995


242 K. R. SCHERER

(58) has conducted a study that does not limit actors in to the temptation to speculate about a phyloge-
to portray a specific emotion label but requires netic continuity for affect expression, speech, and
them to express affective responses in complex music (24).
emotional situations taken from fiction. Her results If the origin of music is indeed to be sought in the
show that despite the absence of clear labels, the emotional expressions of the human voice, it should
specificity of the acoustic rendering of different af- be human vocal music--singingmthat should be
fect situations is far stronger than individual differ- most prone to evoke strong emotional feelings in
ences in the portrayals. This approach suggests a the listener. A special case is represented by opera
promising alternative to studying categorically la- singing. To the emotional expressivity of the musi-
beled states, an alternative that is very much in line cal score and the affective message of the singing
with recent theoretical work that views emotional voice, opera adds all the emotional power of a dra-
episodes as dynamic processes of continuous adap- matic plot and of the personality of the protagonist.
tation of the organism to a changing environment An appreciation of the emotional expressivity of op-
(as based on appraisal or evaluation of events in era can be found in the writings of many composers
terms of their significance to the individual; see and musicologists alike (27-29,63,66) and seems to
refs. 3 and 50). be shared by the opera-going public at large (al-
The need to look at emotional expression in the though there may be a category of music listeners
voice in terms of dynamic temporal sequences, who feel alienated by the musical and dramatic cir-
rather than as aggregate steady states over a com- cumstances in opera and who react more emotion-
plete utterance, is highlighted by a recent study by ally to other types of vocal music).
Tischer (59). This researcher is one of the first who There are very few studies that analyze the role
has looked in detail at the microchanges in vocal of the interpreter, the singer, in vocally projecting
expression over the course of a short utterance, the affective state of the character enacted on the
particularly with respect to effects on listener judg- operatic stage. Obviously, one of the reasons for
ments. He is able to show that for several emotions, this is that there is an enormous amount of factors
the role of the acoustic characteristics changes dra- involved: the music itself, the psychological inter-
matically depending on their temporal locations in pretation of both the action and the characters by
the utterance. the director, the timing of the conductor, as well as
the intuition of the singer, his/her empathy with the
character, and the atmosphere created by the audi-
EMOTION EXPRESSION IN VOCAL MUSIC ence. It seems difficult to approach this question via
standard research designs as they are used in the
The notion that music is "the language of the work on emotional expression in speech.
emotions" has a very long tradition. Composers, Three of the large number of potential factors will
musicologists, as well as philosophers and psychol- be outlined below. First, as in the case of a speak-
ogists interested in music, have attempted--often in er's respiration, phonation, and articulation being
a highly controversial fashionmto delineate the fac- affected by emotion-driven physiological changes,
tors that are responsible for emotional expression in we can assume that the singer's own underlying
music (60--67). emotional state during a performance will have sim-
Helmholtz, one of the pioneers of musical acous- ilar effects on the singing voice. It seems reasonable
tics, wrote: "An endeavour to imitate the involun- to assume that specific physiological changes will
tary modulations of the voice, and make its recita- have similar effects on the speaking and the singing
tion richer and more expressive, may therefore pos- voice. Unfortunately, as for affect expression in the
sibly have led our ancestors to the discovery of the speaking voice, there are virtually no systematic
first means of musical expression, just as the imita- studies on naturally occurring, strong emotional
tion of weeping, shouting, or sobbing, and other states in singers and their effects on the voice. Such
musical delineations may play a part in even culti- studies would be even more difficult to conduct
vated music (as in operas), although such modifica- than in the speech domain, because most singing
tions of the voice are not confined to the actions of activity seems to be confined to the performing
free mental motives, but embrace really mechanical arts--contrary to speech, which is used systemati-
and even involuntary muscular contractions" (68, cally for interpersonal communication in most so-
p. 371). Like Helmholtz, many scholars have given cial situations. The performance aspect of singing,

Journal of Voice, Vol. 9, No. 3, 1995


EXPRESSION OF EMOTION IN VOICE AND MUSIC 243

even if it is not necessarily linked to the stage, may work in physiology) to explain the musical expres-
limit (through regulation and control) the range and sion of emotion (with particular emphasis on the
intensity of the emotions singers may experience Wagnerian Gesamtkunstwerk).
during their vocal production; yet the singer's mo- Hausegger starts from the assumption, widely
mentary, physiologically based, emotional state held at that time, of music having evolved from non-
may be a powerful factor in determining various linguistic affect sounds (see previous discussion
vocal features. herein). Using Darwin's functional explanation of
Second, an important source of emotion effects emotional expression, he develops an argument
on the singing voice is the artist's interpretation of about the immediate and powerful effect of emo-
the mood or emotion expressed in a song or of the tional music, particularly due to the great impor-
emotionality characterizing a role in a libretto. One tance of emotional communication for humans as
of the most essential features for a successful sing- social animals. Vocal music as a language of emo-
ing performance is a credible portrayal of the emo- tion is supposed to have immediate symbolic signif-
tional stance required by the respective piece. Al- icance for affective content and can thus evoke af-
though technical prowess and beauty of the voice fective feeling.
are obviously decisive factors in a singer's career, It is particularly interesting to look at the way in
they are rarely sufficient to move the audience to which Hausegger analyzes Donna Anna's aria Or
tears---or to standing ovations. Many singers have sai qui l'onore from Mozart's Don Giovanni, bring-
commented on the fact that a particularly successful ing together elements from Darwin's explanation of
performance is often brought about by strong emo- the expression of anger and physiological evidence
tional involvement, enabling them to slip into the on the relationship between respiration and cardiac
role of the protagonist and to forcefully portray the function. Based on Mozart's score, Hausegger di-
appropriate emotional state (there is some dispute agnoses Donna Anna's state as one of sustained
on whether the emotional involvement has to be wrath rather than sudden, violent rage----citing the
genuine or can be simulated). trembling and the sudden, angular movements that
Third, emotional expression in singing is largely one would expect for the former state on the basis
determined by the musical score as written by the of Darwin's description, and showing the equiva-
composer. Although actors' performances in the lence in Mozart's music. He even computed the
speech theatre are constrained by the playwright's respiration pattern required by the timing of the
text (often highly emotional in itself), their vocal notes in the aria and claims that the state of arousal
productions with respect to voice quality and pro- of the interpreter of Donna Anna must rise to a
sodic features are largely chosen by themselves (or pulse of 120 beats/s as compared with a normal 72
the director) to portray the affective state of the (cited after ref. 63, p. 61).
character. A singer, however, particularly in the To summarize, then, the study of emotional ex-
lyric arts, is much more constrained by the compos- pression in singing needs to take into account the
er's prescription of the large majority of the acous- composer's emotional script, the singer's artistic in-
tic effects to be produced by the voice, leaving terpretation and projection of a character's person-
fewer degrees of freedom for the artist's personal ality and affective state, and, finally, the singer's
emotional interpretation of the role. own physiologically based emotional state at the
The musicological literature abounds with ac- time of the performance.
counts of how the composer manages to convey As in speech research, three separate issues need
emotional meaning through a multitude of musical to be addressed: (a) inference, i.e., the ability of the
devices including melody, temporal patterning, and listener to perceive emotional quality in a lyrical
rhythm, as well as instrumentation (see refs. 63 and piece or in the singer's performance (including the
66 for comprehensive historical surveys). To cite question concerning the ability of the performance
just one of a number of early accounts: In 1885 to induce a specific emotional state in the listener);
Hausegger published a manuscript entitled "Die (b) the nature of the acoustic cues used in this in-
Musik als Ausdruck" (Music as expression), much ference process; and (c) the underlying externaliza-
attacked by Hanslick and his school, in which he tion or encoding of the emotion, i.e., the actual co-
attempted to use the most recent psychobiological variation of a composer's emotional script, the di-
insights on emotional expression (including Dar- rector's or the performer's interpretation, and the
win's book on emotional expression and the newest singer's personal affect state and the specific vocal

Journal of Voice, Vol. 9, No. 3, 1995


244 K. R. S C H E R E R

production with its resulting acoustical waveform. performers would be asked to sing the same piece
Although empirical studies on either issue have with different emotional interpretations of the affect
been few and far between, there are a number of state of the protagonist (e.g., the different types of
studies that can be cited for each of the three issues emotional portrayals that could be given to the
mentioned: aforementioned Donna Elvira's aria---outrage, lust
for revenge, righteous anger, fury mixed with des-
Inferring emotional meaning from the singing voice peration, etc.). Again, judgment studies could be
Contrary to research on listeners' decoding of vo- used to determine to what extent listeners are able
cal expression of emotion in speech, it is less obvi- to correctly distinguish among these different pro-
ous to examine whether listeners can correctly infer jections on the basis of the acoustic cues alone.
an emotional state from vocal music. Arias and rec- It would be more difficult to settle the question
itativos, Lieder, chansons, rock music lyrics, and whether listeners can distinguish the singer's per-
even folk songs are always forms of art, removed sonal affect state from acoustic cues. As in the
from the reality of everyday emotions. Even if a speech area, it seems impossible, for practical and
particular, well-defined and labeled emotional ex- ethical reasons, to induce strong affect states in
pression were intended by the composer or by the singers experimentally to obtain the necessary ma-
performer's interpretation, the audience (or the re- terial for judgment studies. One possible avenue
searcher) would rarely have access to that inten- might be to record live performances of singers in a
tion. It is to be expected, however, that in most repertory company, asking them to keep a diary of
cases the artistic intentions are much more com- their affective states for the same performance on
plex, defying a simple labeling in terms of funda- different nights. Such material would be invaluable
mental emotion categories. Most likely, the desired for getting at the listener's ability to detect very
expression will consist of subtle, highly context- subtle variations in the singers' mood states inde-
bound mixtures or blends of different emotion cat- pendent of dramatic interpretation. It might be
egories. questionable, however, whether personal mood
However, it might be possible to design research state and dramatic interpretation can be separated
procedures with singers that mirror the designs out very cleanly. There is a high probability that the
used with actors, i.e. ask professional singers to performer's mood might interact with the dramatic
portray different types of "basic" or "fundamen- interpretation chosen for a particular performance.
tal" emotions by singing pure sounds or nonsense It is interesting to note that many more studies
syllables (69). Clearly, the choice of particular me- than in the speech area have been devoted to ex-
lodic and dynamic features, independent of varia- amining the induction of emotional states via music
tions in voice quality, could be seen as correspond- (70-74). This has become a particularly important
ing to relatively arbitrary choices (which is quite issue in the psychology of emotion, where research-
similar in speech research, given that actors are also ers are always in search of ethical methods to in-
free to choose intonation and other dynamic speech duce emotional states in the laboratory (75). An-
features in their emotion portrayals). These stimuli other important application is music therapy (76).
could then be used in judgment studies to determine An important future step in an empirical research
to what extent judges are able to infer the encoding program designed to understand how music pro-
intention of the singer. duces affect would be to go beyond verbal assess-
To study the more subtle variations in emotional ment of emotional impact by directly measuring
meaning in the context of a particular dramatic ac- affective reactions of the listenermusing micromea-
tion, one might choose different pieces of vocal mu- surement of facial expression or psychophysiologi-
sic with a large variety of affective content and use cal recording.
judgment studies to see to what extent judges are
able to infer the expressive intention of the com- Acoustic cues used in the inference process
poser. Because the criterion is not very obvious Although the study of the accuracy of the emo-
here, one would need to use agreement among lis- tion inference makes little sense in the case of vocal
tener judges rather than accuracy as a measure of music, it is possible, and most interesting, to isolate
the nature of emotional inference. the factors that determine the perception of emo-
With respect to the performer's interpretation, tional quality. What are the characteristics of the
one could think of an experiment in which several vocal performance, more specifically the acoustic

Journal of Voice, Vol. 9, No. 3, 1995


E X P R E S S I O N OF E MO TIO N IN VOICE A N D MU SIC 245

parameters in the respective voice signal, that in- speech area, systematically manipulate various ex-
duce the listener to attribute a particular emotion to pressive aspects of the singing voice and determine
the character impersonated by the singer? A num- their role on audience appreciation of affective
ber of empirical studies have been devoted to this quality. Similar techniques might become available
issue, although only a few have dealt directly with for resynthesis (copy synthesis) of natural voices.
the singing voice (64,77-84). Similar to the study by Bergmann et al. (41) men-
One possibility is to use a correlational method, tioned previously, one might use this technology to
as used in speech research, to establish the link determine which acoustic features, in a Callas aria,
among different acoustic configurations as found in for example, might need to be manipulated (and in
emotionally expressive utterances via objective which manner) to rob the interpretation of its emo-
analysis, and correlate these with listener judg- tional impact.
ments. A viable approach, although obviously lim- It seems, then, that the issue concerning the emo-
ited in scope, might be to take different recorded tional impact of music might well be amenable to
interpretations of famous scenes, preferably highly empirical study by linking listener judgments to ob-
emotional, to study the effect of different voice jective data concerning the perceptual input. This is
qualities and dramatic interpretations used by var- not to deny that cognitive, and specifically attribu-
ious performers to portray emotional states and to tional, factors need to be taken into account (as
analyze audience reactions. Siegwart and Scherer Bever suggests: See ref. 60). However, it is unlikely
(87) have conducted digital acoustic analyses of two that music, and opera in particular, will only am-
excerpts from the cadenza in the "mad scene" in plify whatever affect is felt before listening to a
Donizetti's Lucia di Lammermoor (using recorded piece.
performances by Toti dal Monte, Maria Callas, Re-
nata Scotto, Joan Sutherland, and Edita Gru- Acoustic correlates of emotional expression
berova). They are able to show that the acoustic in singing
measures allow the prediction of a high percentage As in the domain of emotion expression in
of the variability in listener judgments of preference speech, it is of major interest to describe the con-
and emotional meaning, providing some concrete figurations of acoustic cues characteristic for the
hypotheses as to how certain acoustic features expression of certain affect states in singing. One of
might affect the perception of emotional meaning in the few studies in this area has been conducted by
music. Kotlyar and Morozov (69). These researchers asked
Given that music is an art form that allows for II professional singers to sing different pieces in
virtually infinite variations, it is most productive to such a way as to portray happiness, sorrow, fear,
systematically vary different acoustic features and and anger. They then carried out acoustic anal-
determine their effect on listener evaluation. With yses of these stimuli. The results partly show pat-
respect to instrumental music, in the study by terns rather similar to what is found in speech re-
Scherer and Oshinsky (40) cited previously herein, search: fast tempo for fear, slow for sorrow, high
the MOOG synthesizer was used to vary the acous- vocal energy for anger. Other features seem quite
tic features of a small speech-like melody and of a different, such as longer pauses between syllables
Beethoven melody systematically. Very similar pat- for fear compared with other emotions. These au-
terns of emotional judgment were found for the two thors also used a synthesis procedure to evaluate
types of melodies (Table 1). For the Beethoven mel- the role of the acoustic features found to differen-
ody, major and minor mode were also manipulated. tiate the emotion encoding in decoding or inference,
As predicted on the basis of many such claims in the They used electronically generated signals to ma-
literature, major mode was shown to be seen as nipulate the respective features and found that
significantly more indicative of pleasantness and judges were able to identify the underlying affect
happiness than the minor mode, which favors im- rather well, except in the case of joy (a detailed
pressions of disgust and anger. description of the results is also provided in ref. 83,
The cleanest form of systematic variation would pp. 152-153).
obviously be achieved via synthesis or resynthesis Unless such portrayal or encoding methods are
techniques, as in speech research. Recent advances used, studies of the acoustic correlates of emotional
in the synthesis of the singing voice (85,86) might state or projection intention are difficult to do be-
allow the conducting of studies that, parallel to the cause of the lack of a clear criterion for the nature of

Journal of Voice, Vol. 9, No. 3, 1995


246 K. R. SCHERER

the underlying state or expression intention (given mals. London: Murray, 1872. (Repril,ted Chicago: Univer-
sity of Chicago Press, 1965).
the near impossibility of experimental induction); 5. Redican WK. Facial displays of emotion by monkeys and
yet some of the aforementioned sampling methods apes: an evolutionary perspective on human facial displays.
might be used to good effect to generate material In: Ekman P, ed. Emotion in the human face. Cambridge
and New York: Cambridge Univer. it" Press, 1982.
that could be used to study the acoustic correlates 6. Ekman P. Darwin and cross-cultural s~adies of facial expres-
of emotion in singing intensively. Further work in sion. In: Ekman P, ed. Darwin and facial expression. New
this rather neglected area of research is likely to York: Academic Press, 1973:1-83.
7. Izard CE. The face of emotion. New York: Appleton-
yield very promising results. Century-Crofts, 1971.
8. Ekman P, Friesen WV, Ellsworth PC. Emotion in the human
face: guidelines for research and an integration of findings.
CONCLUSIONS New York: Pergamon Pre'..s, 1972.
9. Marler P. Animal communication: affect or cognition? In:
This article has attempted to give an overview of Scherer KR, Ekman P, eds. Approaches to emotion. Hills-
the theoretical foundations and the major research dale, New Jersey: Erlbaum, 1984:345-68.
10. Scherer KR. On the symbolic functions of vocal affect ex-
trends in the vocal expression of emotion. It is ob- pression. J Lang Soc Psychol 1988;7:79-100.
vious that the voice, because of its physiological II. Jfirgens U. Vocalization as an emotional indicator: a neu-
basis and its communicative functions, is a primary roethological study in the squirrel monkey. Behaviour 1979;
69:88-117.
instrument for emotional expression. In conse- 12. Marler P, Tenaza R. Signaling behavior of apes with special
quence, from antiquity, there is no lack of literary reference to vocalization. In: Sebeok TA, ed. How animals
commentary on the importance of emotional ex- communicate. Bloomington, Indiana: Indiana University
Press, 1977:965-1033.
pression in speech and singing. Given the manifold 13. Morton ES. On the occurrence and significance of motiva-
difficulties of studying this phenomenon empiri- tional-structural rules in some bird and mammal sounds. Am
cally, or even experimentally, it is not surprising Naturalist 1977;111:855-69.
14. Scherer KR. Vocal affect signalling: a comparative ap-
that the research evidence so far is sparse. How- proach. In: Rosenblatt J, Beer C, Busnel M, Slater PJB, eds.
ever, the data that are available do show reasonable Advances in the stud), of behavior. New York: Academic
convergence and allow the formulation of concrete Press, 1985:189-244.
15. Tembrock G. Die Erforschung des tierlichen Stimmaus-
hypotheses for theory-guided research. The elec- drucks (Bioakustik). In: Trojan F, ed. Biophonetik. Man-
troacoustic instrumentarium for storing voice sam- nheim: Bibliographisches Institut, 1975:51-67.
ples and the digital methods for acoustic analysis 16. Kleinpaul R. Sprache ohne Worte. ldee einer allgemeinen
Wissenschaft der Sprache. The Hague: Mouton (Orig. ed.
are becoming extremely sophisticated and afford- Leipzig, 1888), 1972.
ablemparticularly with the marketing of personal 17. Wundt W. Vrlkerpsychologie. Eine Untersuchung der En-
computers with multimedia capacity. There are also twicklungsgesetze von Sprache, Mythos und Sitte. Leipzig:
Krrner, 1900.
signs of increasing awareness of the need for inter- 18. Kainz F. Psychologie der Sprache. 1. Band. Grundlagen der
disciplinary work in this areambringing together allgemeinen Sprachpsychologie, 3rd ed. Stuttgart: Enke,
speech scientists, psychologists, electrical engi- 1962.
19. James D. The syntax and semantics of some English inter-
neers, musicologists, and performing artists, in an jections. Papers Linguistics 1974;1:3.
attempt to better understand the many facets of the 20. Scherer KR. Affektlaute und vokale Embleme. In: Posner R,
intriguing issue of emotion expression in the voice Reinecke HP, eds. Zeichenprozesse--Semiotische Fors-
chung in den Einzelwissenschaften. Wiesbaden: Athenaion,
(88,89). In this spirit, it might well be profitable to 1977:199-214.
link the study of emotion expression in the speaking 21. Scherer KR. The functions of nonverbal signs in conversa-
and the singing voice much more closely than has tion. In: St. Clair R, Giles H, eds. The social and psycho-
logical contexts of language. Hillsdale, New Jersey: Erl-
been the case to date. baum, 1980:225--44.
22. Goffman E. Response cries. In: Cranach MV, Foppa K,
Acknowledgment: I acknowledge contributions by Ur- Lepenies W, Ploog D, eds. Human ethology: claims and
sula Scherer and Johan Sundberg. limits of a new discipline. Cambridge: Cambridge University
Press, 1979:203--40.
23. Scherer KR. Affect bursts. In: van Goozen SHM, van de
REFERENCES Poll NE, Sergeant JA, eds. Emotions: essays in emotion the-
pry. Hillsdale, New Jersey: Erlbaum 1994:161-196.
1. Frijda NH. The emotions. Cambridge and New York: Cam- 24. Scherer KR. Emotion expression in speech and music: In:
bridge University Press, 1986. Sundberg J, Nord L, Carlson L, eds. Music, language,
2. Scherer KR, Ekman P, eds. Approaches to emotion. Hills- speech, and brain. London: Macmillan, 1991:146--56.
dale, New Jersey: Erlbaum, 1984. 25. Andrews ILl. The information potentially available in mam-
3. Scherer KR. Vocal affect expression: a review and a model mal displays. In: Hinde RA, eds. Nonverbal communica-
for future research. Psychol Bull 1986;99:143-65. tion. Cambridge: Cambridge University Press, 1972:129-
4. Darwin C. The expression of the emotions in man and ani- 206.

Journal of Voice, Vol. 9, No. 3, 1995


E X P R E S S I O N OF E MO TIO N I N VOICE A N D MU SIC 247

26. Leyhausen P. Biologie von Ausdruck und Eindruck (Teil I). 51. Scherer KR, Kappas A. Primate vocal expression of affec-
Psychol Forsch 1967;31:113-76. tire states. In: Todt D, Goedeking P, Newman E, eds. Pri-
27. Copeland A. How to listen to music. New York: Bantam mate vocal communication. Heidelberg: Springer, 1988:171-
(orig. ed. 1937), 1959. 94.
28. Meyer LB. Emotion and meaning in music. Chicago: Uni- 52. Williams CE, Stevens KN. On determining the emotional
versity of Chicago Press, 1956. state of pilots during flight: an exploratory study. Aerospace
29. Seashore C. The psychology of music. New York: Dover Med 1969;40:1369-72.
(orig. ed. New York: McGraw Hill, 1938), 1967. 53. Williams CE, Stevens KN. Emotions and speech: some
30. Scherer KR. Speech and emotional states. In: Darby JK, acoustical correlates. J Acoust Soc Am 1972;52:1238-50.
ed. Speech evaluation in psychiatry. New York: Grune & 54. Hollien H, Geison L, Hicks JWJ. Vocal stress evaluators
Stratton, 1981:189--220. and lie detection. J Forensic Sci 1987;32:405-18.
31. van Bezooijen R. The characteristics and recognizability of 55. Scherer KR. Voice, stress, and emotion. In: Appley MH,
vocal expression of emotions. Dordrecht, The Netherlands: Trumbull R, eds. Dynamics of stress. New York: Plenum,
Foris, 1984. 1986:159---81.
32. Scherer KR, Banse R, Wallbott HG, Goldbeck T. Vocal 56. Tolkmitt FJ, Scherer KR. Effects of experimentally induced
cues in emotion encoding and decoding. Motiv Emotion stress on vocal parameters. J Exp Psychol Hum Percept
1991 ;15:123--48. Perform 1986;12:302-13.
33. Frick RW. Communicating emotion: the role of prosodic 57. Pittam J, Scherer KR. Vocal expression and communication
features. Psychol Bull 1985;97:412-29. of emotion. In: Lewis M, Haviland JM, eds. Handbook of
34. Wallbott HG, Scherer KR. Cues and channels in emotion emotions. New York: Guilford Press, 1993:185-98.
recognition. J Pets Soc Psychol 1986;51:690-9. 58. Cosmides L. Invariances in the acoustic expression of emo-
35. Kramer E. Elimination of verbal cues in judgments of emo- tion during speech. J Exp Psychol Hum Percept Perform
tion from voice. J Abnorm Soc Psychol 1964;68:390-6. 1983;9:864-81.
36. Starkweather JA. Content-free speech as a source of infor- 59. Tischer B. Die vokale Kommunikation yon Gefiihlen. [Ha-
mation about the speaker. J Pers Soc Psychol 1956;35:345- bilschrift], Universitfit Mfinchen, 1991.
50. 60. Bever TG. A cognitive theory of emotion and aesthetics in
37. Scherer KR, Feldstein S, Bond RN, Rosenthal R. Vocal music. Psychomusicology 1988;7:165-75.
cues to deception: a comparative channel approach. J Psy- 61. Clynes M. Sentics: the touch of emotions. New York: An-
cholinguist Res 1985;14:409-25. chor/Doubleday, 1977.
38. Scherer KR, Ladd DR, Silverman KEA. Vocal cues to 62. Cooke D. The language of music. London: Oxford Univer-
speaker affect: testing two models. J Acoust Soc Am 1984; sity Press, 1959.
76:1346-56. 63. De la Motte-Haber H. Handbuch der Musikpsychologie.
39. Lieberman P, Michaels SB. Some aspects of fundamental Laaber: Laaber-Verlag, 1985.
frequency and envelope amplitude as related to the emo- 64. Fonagy 1. Emotions, voice and music. In: Sundberg J, ed.
tional content of speech. J Acoust Soc Am 1962;34:922-7. Research aspects on singing. Stockholm and Paris: Royal
40. Scherer KR, Oshinsky J. Cue utilization in emotion attribu- Swedish Academy of Music and Payot, 1981:51-79.
tion from auditory stimuli. Motiv Emotion 1977;1:33 I--46. 65. Fonagy I. La rive voix. Paris: Payot, 1983.
41. Bergmann G. Goldbeck T, Scherer KR. Emotionale Ein- 66. Kivy P. Osmin's rage: philosophical reflections on opera,
druckswirkung von prosodischen Sprechmerkmalen. Z Exp drama, and text. Princeton: Princeton University Press,
Angew Psychol 1988;35:167-200. 1988.
42. Ladd DR, Silverman KEA, Tolkmitt F, Bergmann G, 67. Lundin RW. An objective psychology of music. New York:
Scherer KR. Evidence for the independent function of into- Ronald Press (orig. ed. 1953), 1967.
nation contour type, voice quality, and F0 range in signaling 68. Helmholtz HLF. On the sensations of tone as a psycholog-
speaker affect. J Acoust Soc Am 1985;78:435-44. ical basis for tlw theory of music. New York: Dover (Orig.
43. Lipps T. Psychologische Untersuchungen. Leipzig: Engel- German ed. Braunschweig: Vieweg, 1863), 1954.
mann, 1907. 69. Kotlyar GM, Morozov VP. Acoustical correlates of the emo-
44. Liberman AM, Cooper FS, Shankweiler DP, Studdert- tional content of vocalized speech. Soy Phys Acoust 1976;
Kennedy M. The perception of the speech code. Psychol 22:208-1 I.
Rev 1967;74:431-61. 70. Bochkaryov LL. Adequacy of perception of music depend-
45. Scherer KR. Interpersonal expectations, social influence, ing on listener's psychic condition. Novye Issledovaniya
and emotion transfer. In: Blanck PD, ed. Interpersonal ex- Psikhologii 1981 ;2:6 I-4.
pectations: theory, research, and application. Cambridge 71. Collins SC. Subjective and autonomic responses to Western
and New York: Cambridge University Press, 1993:316-36. classical music [Ph.D. Thesis]. Manchester: Department of
46. Scherer KR. Neuroscience projections to current debates in Psychology, University of Manchester, 1989.
emotion psychology. Cogn Emotion 1993;7:1-41. 72. Goldstein A. Thrills in response to music and other stimuli.
47. Soberer KR. Non-linguistic indicators of emotion and psy- Physiol Psychol 1980;8:126-9.
chopathology. In: Izard CE, ed. Emotions in personality 73. Harrer G, Harrer H. Musik, Emotion und Vegetativum.
and psychopathology. New York: Plenum Press, 1979:495- Wien Med Wochenschr 1968;45/46:966--7 I.
529. 74. Payne E. Musical taste and personality. Br J Psychol 1967;
48. Scherer KR. Vocal assessment of affective disorders. In: 58:133--8.
Maser JD, ed. Depression and expressive behavior. Hills- 75. Gerrards-Hesse A, Spies K, Hesse FW. Experimental in-
dale, New Jersey: Erlbaum, 1987:57-82. ductions of emotional states and their effectiveness: a re-
49. Robinson BW. Anatomical and physiological contrasts be- view. Br J Psychol (in press).
tween humans and other primate vocalizations. In: Dolhi- 76. Davis WB. An introduction to music therapy: theory and
now P, Washburn SL, eds. Perspectives on human evolu- practice, Dubuque, Iowa: Brown, 1992.
tion. New York: Holt, Rinehart, & Winston, 1972:438--43. 77. Brown RW. Music and language. In: Documentary Report of
50. Scherer KR. Vocal correlates of emotion. In: Manstead A, the Ann Arbor Symposium, Reston, Virginia: 1981:233--65.
Wagner H, eds. Handbook of psychophysiology: emotion 78. Gundlach RH. Factors determining the characterization of
and social behavior. London: Wiley, 1989:165-97. musical phrases. Am J Psychol 1935;47:624--43.

Journal of Voice, Vol. 9, No. 3, 1995


248 K. R. SCHERER

79. Hevner K. Expression in music: a discussion of experimen- 85. Risset JC. Speech and music combined: an overview. In:
tal studies and theories. Psychol Rev 1935;42:186--204. Sundberg J, Nord L, Carlson R, eds. Music, language,
80. Hevner H. Experimental studies of the elements of expres- speech, and bruin. London: Macmillan, 1991:368-79.
sion in music. A m J Psychol 1936;48:248--68. 86. Sundberg J. Synthesis of singing. Swed J Musicol 1978;60:
81. Osborne JW, Kennedy L. An empirical validation of I02-12.
Schopenhauer's theory of music through analysis of listen- 87. Siegwart H, Scherer KR. Acoustic concomitants of emo-
ers' experiences of Mahler's Ninth Symphony. J Phenome- tional expression in operatic singing: The case of Lucia in
nol Psychol 1985;16:13-38. Ardi gli incensi. J Voice 1995;9:000-000.
82. Petroushin VI. Simulation of emotions by means of music.
Voprosy Psikhologii 1988;5:141-4. 88. Sundberg J, Nord L, Carlson L, eds. Music, language,
83. Sundberg J. The science o f the singing voice. DeKalb. Illi- speech, and brain. London: Macmillan, 1991.
nois: Northern Illinois University Press, 1987. 89. Dalmonte R, Baroni M, eds. Secondo convegno europeo di
84. Wedin L. A multidimensional study of perceptual-emotional analisi musicale. Trento, Italia: Universit~ degli Studi di
qualities in music. Scand J Psychol 1972;13:241-57. Trento, 1992.

Journal of Voice, Vol. 9, No. 3, 1995

You might also like