Download as pdf or txt
Download as pdf or txt
You are on page 1of 15

Influence of Structural Features on Musical Tension 171

T H E I N F LU E N C E O F D I F F E R E N T S T RU C T U R A L F E AT U R E S O N F E LT M U S I C A L
T E N S I O N I N T WO P IA N O P I E C E S B Y M O Z A RT A N D M E N D E L S S O H N

A
M O R I T Z L E H N E , M A RT I N R O H R M E I E R , STRIKING FEATURE OF MUSIC IS ITS ABILITY
D O NA L D G O L L M A N N , & S T E FA N K O E L S C H to evoke strong emotional experiences in the
Freie Universität, Berlin, Germany listener (Juslin & Västfjäll, 2008; Koelsch,
2010). However, the principles underlying the evoca-
I N TONAL MUSIC , PATTERNS OF TENSION AND tion of emotions by music are still not fully under-
resolution form one of the core principles evoking emo- stood. In particular, it is not clear how structural
tions. The experience of musical tension and resolution features of a major-minor tonal piece (melody, meter,
depends on various features of the music (e.g., dynam- rhythm, harmony, loudness, and timbral stucture
ics, agogics, melody, and harmony); however, the rela- including instrumentation and texture) relate to the
tive contribution of different features to the experience emotional experience of the listener. A concept that
of tension is less clear. To investigate the influence of can help to elucidate this relationship is musical
different features on subjectively experienced musical tension.
tension, we compared continuous ratings of felt musical Musical tension refers to the continuous change of
tension for original and modified versions of two piano tension and relaxation that is usually experienced
pieces by Mendelssohn and Mozart. Modifications when listening to a piece of Western tonal music.
included versions without dynamics and without ago- Because musical tension is strongly linked to processes
gics as well as versions in which the music was reduced such as expectancy build-up, violation or fulfillment of
to its melodic, harmonic, or outer voice components. expectancies, to the anticipation of resolution after
Additionally, we compared tension ratings with a loud- a breach of expectancy, and to the eventual resolution
ness model. Tension ratings for versions without of such a breach, musical tension plays an important
dynamics, versions without agogics and without role in the emotional aspects of music listening (see
dynamics, and outer voice reductions correlated highly also Huron, 2008; Koelsch, 2012; Margulis, 2005;
with ratings for the original versions for both pieces. Meyer, 1956; Narmour, 1992; Rohrmeier & Koelsch,
Tension rating correlations between melodic or har- 2012). This is corroborated by empirical research
monic reductions and original versions, as well as loud- showing that subjective ratings of musical tension cor-
ness and original ratings, differed between pieces and relate with ratings of discrete emotions (sadness, fear,
appeared to depend on the relative importance of the and happiness) and physiological responses during
feature in the respective piece. In addition, qualitative music listening (Krumhansl, 1997). It has furthermore
analyses suggested that felt tension and resolution been shown that subjective ratings of musical tension
depend on phrase structure, local harmonic implica- correlate highly within individuals between different
tions, and global syntactic structures of the pieces. Alto- exposures to the same music piece (Krumhansl,
gether, results indicate that discarding expressive 1996) as well as between different groups of persons
features such as dynamics and agogics largely preserves such as musicians and nonmusicians or school chil-
tension-resolution patterns of the music, whereas the dren of different ages (Fredrickson, 1997, 1999, 2000),
contributions of harmonic and melodic structure suggesting relatively consistent and stable underlying
depend on the way in which they are employed in the cognitive and affective processes.
composition. Various structural features have been identified in
mediating musical tension ranging from dynamics,
Received: July 21, 2012, accepted April 10, 2013. timbre, melodic contour, harmony, tonality, repetition
(Nielsen, 1983), phrase structure, and note density
Key words: musical tension, music-evoked emotion,
(Krumhansl, 1996), to pitch height, loudness, onset
continuous rating, structural features, loudness
frequency, and tempo (Farbood, 2012). From a theoret-
ical perspective, the hierarchical structure of music

Music Perception, VOLUM E 31, ISSU E 2, PP. 171–185, IS S N 0730-7829, ELEC TR ONIC I SSN 1533-8312. © 2013 BY T HE REG ENT S O F THE U NIV E RSI T Y OF CA LI FOR NIA A LL
R IG HTS RES ERV ED . PLEASE DIR ECT ALL REQ UEST S F OR PER MISSION T O PHOT O COPY OR R EPRO DUC E A RTI CLE CONT ENT T HRO UGH T HE UNI VE R S IT Y OF CALI FO RNIA P R E SS ’ S
R IGHTS AND PER MISSION S W EBSIT E , HT TP :// W W W. U CPRESSJ OUR NAL S . CO M / REPR IN TIN FO . A S P. DOI: 10.1525/ M P.2013.31.2.171
172 Moritz Lehne, Martin Rohrmeier, Donald Gollmann, & Stefan Koelsch

(e.g., Lerdahl & Jackendoff, 1983; Rohrmeier, 2007, Method


2011; Schenker, 1935) can inform models of tension.
For instance, Lerdahl’s model of tension (Lerdahl, PARTICIPANTS
1996, 2001; Lerdahl & Krumhansl, 2007) combines Data from 28 participants (aged 20-46 years, M ¼ 25.4,
predictions based on surface structure and tonal dis- 16 female) were included in the analysis (data from
tance as well as higher order hierarchical dependency three additional participants had been excluded due to
structure. The notion of an influence of local tonal missing ratings, negative correlations between a partici-
structure on musical tension has been supported by pant’s tension rating and average tension ratings, or
behavioral studies (Bigand & Parncutt, 1999; Bigand, very fast and up-and-down slider movements of one
Parncutt, & Lerdahl, 1996). The most elaborate model participant throughout the experiment). Ten partici-
of musical tension has been devised by Farbood (2012), pants had received instrument or singing lessons in
and takes into account dynamics, pitch height of mel- addition to basic music education at school (instru-
ody, bass and inner voices, tempo, onset frequency, and ments and years of training: clarinet: 3 years; violin:
harmony. Additionally, the model accounts for the 10 and 8 years; piano: 6, 7, 7, and 8 years; guitar: 1 year;
dynamic nature of the music listening process by trumpet: 6 years; voice: 7 years). All participants gave
incorporating attentional and memory processes. their written consent and were compensated with
The aforementioned studies (Bigand & Parncutt, course credit for participation.
1999; Bigand et al., 1996; Farbood, 2012; Krumhansl,
1996) show that different structural features are related STIMULI
to the subjective experience of musical tension, and As stimulus material, Mendelssohn Bartholdy’s Vene-
that experienced tension can be modelled based on tian Boat Song (Op. 30, No. 6) and the first 24 measures
such features. However, research investigating how the of the second movement of Mozart’s Piano Sonata KV
experimental manipulation of specific structural fea- 280 were used (the music scores are included in the
tures in real music pieces affects experienced tension is Appendix). To keep the duration of the experiment
scarce. The aim of the present study, therefore, was to reasonable, repetitions indicated in the scores were
investigate how the elimination or isolation of different omitted.
structural features affected subjectively experienced The pieces were performed by a professional pianist
musical tension using ecologically valid music stimuli. on a Clavinova CLP-130 (Yamaha Corporation, Hama-
For this, a behavioral experiment was conducted in matsu, Japan) from which MIDI data were recorded.
which continuous ratings of felt musical tension were This allowed for a selective manipulation of specific
acquired for original recordings and different modified parameters of the music. From the original recordings,
versions of two piano pieces by Mendelssohn and the following five modified versions were created: 1)
Mozart. The structural features investigated were a version without dynamics, i.e., all notes were played
dynamics, agogics, harmony, melody, outer voices (as with the mean MIDI key-stroke velocity value of the
the most salient voices embodying substantial parts of piece (Mendelssohn: 42; Mozart: 36); 2) a ‘‘deadpan’’
the musical structure), and loudness. For the modified version without dynamics and without agogics (i.e., all
versions, these features were experimentally manipu- notes were played with the same MIDI key-stroke
lated yielding versions without dynamics, without velocity and without any variations in tempo); 3) a ver-
dynamics and without agogics, and versions in which sion containing only a harmonic reduction of the piece
harmony, melody, or outer voices were played in iso- (i.e., non-chord tones were eliminated and remaining
lation (without dynamics and without agogics). Apart notes of one chord were played synchronously, see
from the modified versions, a loudness model was used Figure 1), presented without dynamics and without
to investigate to which degree loudness changes agogics (henceforth referred to as harmony version);
accounted for the experienced tension in the original 4) a version containing only the outer voices (i.e., only
recording. By comparing the tension ratings of the the highest and lowest voice of the piece, see Figure 1),
different versions as well as the loudness estimated presented without dynamics and without agogics; and
by the model, the contribution of the different features 5) a version that consisted of the top voice only (i.e.,
on subjectively experienced musical tension was eval- a version that contained only the ‘‘melody part,’’ see
uated. In addition, we performed a qualitative music- Figure 1), presented without dynamics and without
theoretical analysis investigating which musical events agogics (henceforth referred to as melody version).
corresponded to the peaks and troughs of the tension That is, versions 3-5, did not vary in terms of tempo,
profiles. nor dynamics. The total length of the versions without
Influence of Structural Features on Musical Tension 173

FIGURE 1. Score excerpts of measures 6-11 of original and modified versions of the Mendelssohn piece: (a) original; (b) harmonic reduction; (c) outer
voice reduction; (d) melodic reduction.

agogics matched the ones of the original versions with EXPERIMENTAL PROCEDURE
agogics (Mendelssohn: 2:27 min; Mozart: 2:01 min). For stimulus presentation and data acquisition the soft-
All resulting MIDI files were used to trigger the VST ware Presentation (Neurobehavioral Systems, Albany,
Plugin ‘‘The Grand,’’ an authentic grand piano simula- USA) was used. Participants listened to the stimuli via
tion based on samples of real grand piano recordings, in headphones at a comfortable volume level. They were
Steinberg Cubase SL (Steinberg Media Technologies, instructed to use the slider to continuously indicate the
Hamburg, Germany). From this, audio files were gen- tension of the music as they subjectively experienced it
erated (16 bit, 44.1 kHz sampling rate) which were used (participants were explicitly instructed not to indicate
as final stimulus material. the amount of tension they thought the music was sup-
posed to express). That is, ratings of felt musical tension
EXPERIMENTAL DESIGN (in contrast to perceived tension, cf. Gabrielsson, 2002)
Original and modified versions of the two pieces were were acquired.
presented to participants in random order. In addition, To familiarize participants with the task, they com-
the original version of the Mozart piece was presented pleted a practice trial during which they could ask ques-
again at the end of the experiment to evaluate the tions concerning the task (a three minute excerpt from
within-participant consistency of the tension ratings the second movement of Schubert’s Piano Sonata D. 960
over repeated exposures to a music piece. Thus, in total was used for the practice trial). Before each stimulus
13 stimuli were presented to each participant (2 pieces x presentation, the slider was reset to the lowermost posi-
6 versions þ 1 repetition of the original Mozart piece). tion. Between stimulus presentations, participants were
Tension ratings were obtained every 10 ms from the given the opportunity to take a short rest. After finish-
position of a slider that was shown vertically on a com- ing the experiment, participants completed a short
puter screen and could be moved with the mouse questionnaire assessing previous music education,
according to the subjectively felt musical tension. A music listening habits, familiarity with the pieces, and
high position of the slider corresponded to a high degree additional demographic data (age, sex, and occupation).
of tension while lower positions indicated lower levels of In total, the duration of one experimental session was
tension. approximately 45 min.
174 Moritz Lehne, Martin Rohrmeier, Donald Gollmann, & Stefan Koelsch

DATA ANALYSIS lag behind the musical events they refer to (due to the
Each participant’s data were converted to z-scores (to time the participants need to process the stimulus, and
discard differences between participants with respect to to give a physical response on the slider). To quantify
the slider range used for the tension ratings). To com- this time lag and correct for it, cross-correlations
pare ratings of versions that contained agogics (i.e., the between loudness and the average tension ratings of the
original version and the version without dynamics) and unmodified recordings were calculated. The time point
versions with constant tempo (i.e., deadpan, harmony, with the highest cross-correlation between the two
outer voices, and melody versions), tension ratings series was then used as an estimate of the temporal lag
were temporally aligned. This was done by stretching of the tension ratings. Before calculating correlation
or compressing ratings within each measure of the ver- coefficients between loudness and tension ratings, the
sions with agogics to the length of the corresponding predictions of the loudness model were temporally
measure in the versions without agogics using linear shifted to correct for this lag. To make loudness data
interpolation. comparable to the tension ratings, loudness data were
Tension ratings were averaged across participants, temporally aligned to versions without agogics and
separately for each version. Thus, potential order downsampled to 1/3 Hz (analogous to the procedures
effects in the individual ratings were minimized and described above).
variance due to individual rating styles was reduced. To test the consistency of the tension ratings within
Comparisons between different versions were per- participants, the test-retest reliability of the tension rat-
formed on the resulting averaged tension ratings. ings was evaluated by calculating Spearman’s rank cor-
When comparing continuous rating data, it is common relation coefficients between the first and second
practice to calculate Pearson product-moment correla- presentation of the original recording of the Mozart
tion coefficients. However, this procedure has been piece. (In contrast to the other correlations, this corre-
criticized (Schubert, 2002, 2010) due to two problems. lation coefficient was not calculated on average ratings
First, continuous rating data are usually not normally but on each participant’s individual ratings.)
distributed, rendering parametric statistics inappropri- To gain a better understanding of the musical events
ate. Second, the data are serially correlated (i.e., adja- mediating the experience of musical tension, we also
cent points of the time-series have more similar values performed a post-hoc music-theoretically informed
than more distant points), which can lead to inflated qualitative analysis in which we investigated which
correlation results (this is particularly problematic musical events corresponded to the peaks and troughs
when significance tests are performed, because the of the average tension profiles.
large number of data points inflates the degrees of
freedom, thus greatly reducing the threshold at which Results
correlation results become significant). To mitigate
these problems, this study uses Spearman’s rank cor- Rating reliability within participants was assessed by
relation coefficients as a nonparametric measure of calculating the correlation between individual tension
correlation (cf. Schubert, 2010; Vines, Krumhansl, ratings of the two presentations of the Mozart piece.
Wanderley, & Levitin, 2006). To reduce serial correla- Correlation coefficients ranged from –.06 to .88 (M ¼
tions, the data were downsampled to a sampling rate of .52). For five participants rating reliability was relatively
1/3 Hz before calculating correlations between tension low (r < .30), but we nevertheless included these data
ratings (cf. Schubert, 2010). sets in the analysis so that results are representative for
In addition to the correlation between different ver- the general population (notably, excluding these parti-
sions, the correlation between loudness of the music and cipants yielded results that were highly comparable to
tension ratings for the different versions was calculated. the results reported here).
Loudness was computed from the unmodified record- Figure 2 shows individual tension ratings for the two
ings using a Matlab implementation (genesis-acoustics. original recordings as well as their average and standard
com/en/loudness_online-32.html) of the loudness deviation together with the waveform of the audio sig-
model for time-varying sounds by Zwicker and Fastl nal and loudness. The graphs reveal tension profiles
(1999). Taking a time-varying acoustical signal as input, with distinct peaks and troughs. Furthermore, visual
this model estimates the loudness of the signal as it is comparison of the tension profiles with the audio wave-
subjectively experienced (measured in sone). When form and loudness indicates a relation between tension
comparing loudness of the music to the tension ratings, and loudness (especially for the Mendelssohn piece)
it has to be considered that tension ratings temporally that will be investigated in more detail below.
Influence of Structural Features on Musical Tension 175

FIGURE 2. Top: Audio waveform (black) with predictions of the loudness model (gray) for the original recordings of the two pieces. Bottom: Individual
(gray lines) and average tension ratings (black solid line) + standard deviation (black dashed lines).

FIGURE 3. Average tension ratings for all versions of the Mendelssohn piece (ORIG: original version; NO DYN: version without dynamics; DEADP:
deadpan version without dynamics and expressive timing; HARM: harmony only; OUTER: outer voices only; MELO: melody only).

Average tension profiles for the different versions of appeared to be more pronounced for the Mendelssohn
the two pieces are shown in Figures 3 and 4. For both piece than for the Mozart piece.
pieces, the clearest and highest tension peaks were
observed for tension ratings of the original recordings, CORRELATION ANALYSIS
which on average received higher tension ratings than Figure 5 shows Spearman’s rank correlation coefficients
the versions without expressive features: for the Mozart between all possible combinations of average tension
piece, Wilcoxon signed-rank tests revealed differences ratings of the different versions (the correlation matri-
between the original and the version without dynamics ces also show correlations to the loudness model which
(z ¼ –4.06, p < .05), as well as between the original and will be treated below).
the deadpan version (z ¼ –1.98, p < .05); for the Men- For the Mendelssohn piece, the rating of the original
delssohn piece only differences between the original and recording correlated highly with the rating of the ver-
the deadpan version were significant (z ¼ –4.48, p < sion without dynamics (r ¼ .83), the deadpan version
.05). Furthermore, changes in experienced tension (r ¼ .70), and the outer voices (r ¼ .71). Correlation
176 Moritz Lehne, Martin Rohrmeier, Donald Gollmann, & Stefan Koelsch

FIGURE 4. Average tension ratings for all versions of the Mozart piece.

FIGURE 5. Spearman's r for average tension ratings of the different versions (ORIG: original version; NO DYN: version without dynamics; DEADP:
deadpan version without dynamics and expressive timing; HARM: harmony only; OUTER: outer voices only; MELO: melody only) as well as the loudness
model (LOUDN). Significant correlations (p < .05) are marked with a star (dfMendelssohn ¼ 44; dfMozart ¼ 36).

with the melody version was moderate (r ¼ .54). The virtually reversed for the Mozart piece. Here, ratings for
correlation with the harmonic reduction was negative the harmony version correlated highly with ratings for
(r ¼ –.41). A similar pattern was observed for the the other versions (except melody), while correlations
Mozart piece: The rating of the original recording cor- between ratings for the melody version and the other
related moderately to highly with the rating of the ver- versions were lower and (except for the deadpan ver-
sion without dynamics (r ¼ .71), the deadpan version sion) not statistically significant. Apart from these dif-
(r ¼ .59), and the outer voices (r ¼ .73). However, in ferences between harmony and melody, the general
contrast to the Mendelssohn piece, the harmonic reduc- pattern of the correlations between ratings for different
tion correlated highly with the original version (r ¼ .85) versions were relatively similar for the two pieces.
and the correlation with the melody version was lower Except for correlations between tension ratings of the
and not significant (r ¼ .25). This piece-dependant melody version and other versions of the Mozart piece
difference for tension ratings of harmony and melody (original, no dynamics, harmony, and outer voices), all
versions was observed consistently in the two correla- tension rating correlations were statistically significant
tion matrices: For the Mendelssohn piece, correlations (dfMendelssohn ¼ 44; dfMozart ¼ 36; p < .05).
between the rating of the melody version and ratings of Before calculating correlations between loudness and
the other versions (except harmony) were relatively tension, the temporal lag of the tension ratings to cor-
high, whereas correlation between harmony and the responding musical events was determined by comput-
other versions were all negative. This pattern was ing the cross-correlation between loudness and the
Influence of Structural Features on Musical Tension 177

average tension ratings of the original recordings. For harmony did not serve as the sole or predominant com-
the Mendelssohn piece, the highest correlation was positional device to create tension in this piece.
observed at a time lag of 3.2 s. For the Mozart piece, For the Mozart piece, tension profiles also reflect the
correlation was highest at a lag of 2.0 s. The correlation overall organization of the piece. As in the Mendelssohn
coefficients reported in the following (also shown in piece, the transitions between first, middle, and final
Figure 5) were obtained after correcting for the time lag parts are reflected in low tension ratings (mm. 9, 21).
of the tension ratings. For the Mendelssohn piece, a high The first section, mm. 1-8, features five ascending peaks
positive correlation between loudness and the average at mm. 2, 3, 4, 6, 8. Each of these peaks corresponds to
tension rating of the original recording was observed harmonic events with strong implications: II 65, V, VI 64, I 42.
(r ¼ .74). Interestingly, loudness also correlated signif- The relaxations of the tension profile correspond with
icantly with tension ratings of versions without dynam- the implied local resolution of the suspensions in mm. 5,
ics. For the Mendelssohn piece, all correlations with 7, 8. The fact that the tension profile constantly rises
loudness were positive and statistically significant towards m. 8, even though mm. 4 and 6 are musically
(df ¼ 44; p < .05). For the Mozart piece, none of the identical, seems to reflect the overarching tendency
correlations between tension ratings and loudness were towards the resolution and completion of the phrase
statistically significant. towards the final tonic. The tension profile of the mid-
dle part reflects the departure from the initial tonic to
QUALITATIVE ANALYSIS the IV as well as the half cadence with a resolution to the
For the Mendelssohn piece, the most prominent peaks dominant V 64–V 53 marking the end of the half of this
at measures 13, 30, 34, and 50 corresponded to events phrase (m. 12). Similarly to the beginning, the harmon-
with dominant function: m. 13 features the first strongly ically strongly implicative German sixth, diminished,
pronounced dominant function of the piece (with 5̂ in and dominant seventh chords (mm. 13, 15, 16) are
the bass after a long series of 1̂ pedal bass notes), mm. associated with ascending sets of peaks along with small
30-32 feature the main structural dominant, the dimin- local relaxations (reflecting melodic and harmonic
ished chord at m. 34 fulfills an applied dominant func- relaxation). The musical relaxation around the tonic at
tion to the IV, and the two chords at mm. 46, 60 mm. 17-18 (after the preceding dominants) is also
constitute dominants of the final phrase of the piece reflected by a local trough in the tension profile. The
(the second and final dominant features the stronger deceptive cadence (mm. 19) as well as the (precadential)
tension rating). However, participants did not simply turns to the relative minor (mm. 21, 23) yield a sudden
give high tension ratings to local (or applied) domi- increase in experienced tension. The subsequent resolu-
nants, because other dominants were not associated tions towards the tonic (as in mm. 19-21, 22, 24) are
with peaks, such as the dominant in m. 20 towards the reflected as a decrease in the tension profile. The caden-
end of the first phrase, m. 23 initiating the motion of the tial V 64, as well as the entire final cadential schema at
middle section, and m. 42 ending the middle section. In mm. 21-24, provide strong signals of the upcoming end
contrast, it appears that participants also attended to the (of the part) and receive the strongest and most pro-
overall organization of the piece when experiencing ten- nounced local tension ratings.
sion: The lowest rating, except ratings for the beginning,
was given at m. 21, the end of the first section and Discussion
beginning of the middle section, as well as at m. 43 at
the end of the middle section and beginning of the final The aim of the present study was to investigate how the
closure. elimination or isolation of different structural features
Many of the events associated with peaks correspond (dynamics, agogics, harmony, outer voices, and melody)
to salient events in the melody line (trills or high notes) influences felt musical tension by comparing tension rat-
as well as dynamics (e.g., sforzato or forte notes at mea- ings of ecologically valid original and modified versions
sures 13, 30, 46, and 50). However, when dynamics and of two piano pieces. Modifications featured versions
agogics were removed, most peaks remained present, without dynamics, without dynamics and without ago-
yet less pronounced. This suggests that some expressive gics, and versions in which the music was reduced to its
features employed in the piece enhance the effects of harmonic, melodic, or outer voice component. In addi-
tension that are created by melodic means. In contrast, tion, we compared tension ratings with the loudness of
the tension profile of the harmony version did not show the music estimated by a standard loudness model.
clear peaks and remained relatively flat throughout the We found that the overall shape of the profiles of
piece with a slight overall downward trend. Hence, original versions, versions without dynamics, and
178 Moritz Lehne, Martin Rohrmeier, Donald Gollmann, & Stefan Koelsch

deadpan versions (without dynamics and without ago- the lowest local bass note, and the fortissimo and sfor-
gics) resembled each other closely. This was reflected in zato of both repetitions of the chords (as well as expres-
high correlations between the tension ratings of these sive details played by the pianist) so that the co-aligned
versions, indicating that discarding dynamics and ago- combination of dynamics, melody, and harmony results
gics preserves a large part of the tension-resolution pat- in a strong experience of increasing tension apparent in
terns of the music, and that felt tension is not primarily the prominent peak in the corresponding tension pro-
governed by these expressive features. This is consistent file. The redundant use of different features as a compo-
with findings by Krumhansl (1996), who reported a high sitional device gains further support from a study by
correspondence between tension ratings of versions Lalitte, Bigand, Kantor-Martynuska, and Delbé (2009),
with and without expressive features (i.e., dynamics and who report high correlations between musical arousal
agogics). Our results support that models of tension ratings of two original Beethoven sonatas and two
based on the tonal structure of a musical piece abstract- atonal counterparts. This stability of musical arousal
ing from expressive features (e.g., Lerdahl, 1996, 2001) profiles even in absence of tonal structure indicates that
capture a large part of the information relevant for the participants responded to features that remained rela-
experience of musical tension. The high correlations tively unaltered between the two versions (such as
between tension ratings of the original recordings and rhythm, note density, or global structure). Assuming
versions reduced to the outer voices furthermore sug- that participants’ ratings to a large extent depend on
gest that even when limiting information to these most tonal structure (as suggested by our results and by pre-
salient voices, considerable parts of the tension patterns vious research, see Krumhansl, 1996; Lerdahl & Krum-
are retained. This confirms that outer voices embody hansl, 2007), this indicates that tonal aspects tend to co-
major aspects of the musical structure. vary with nontonal features of the music.
Despite the high correlations between original tension With regard to differences between pieces, our results
ratings and ratings for versions without dynamics and suggest that melody and harmony contributed differ-
agogics, discarding these features does have a notable ently to experienced tension in the two pieces. For the
effect on felt musical tension. Average tension ratings of Mendelssohn piece, correlation with the tension profile
versions without expressive features were significantly of the original version was higher for tension ratings of
lower than for original versions, and the tension profiles the melody version than for ratings of the harmony
were generally flatter, with some of the tension peaks version, whereas the reverse pattern was observed for
existent in the profiles of the original versions not pres- the Mozart piece. This difference seems to reflect a com-
ent or strongly attenuated. This indicates that musical positional difference between both pieces: Whereas the
tension can be strongly enhanced by expressive features. rate of harmonic change is slow in the Mendelssohn
For the Mendelssohn piece, we found a high correla- piece and its melody part plays a major role in shaping
tion between loudness and the tension profile of the the structure (long trills, overarching melodic ascents or
original version. Interestingly, loudness also correlated descents), dense successions of harmonic implication
significantly with versions without dynamics.1 This and resolution patterns govern the Mozart piece to
finding indicates a strong redundancy between the a larger extent. However, the qualitative analysis sug-
dynamics and other structural aspects of a music piece gested that central tension peaks in both pieces were
(such as harmony or melody). It underpins that the driven by harmonic patterns, which is inconsistent with
alignment of expressive features (e.g., dynamics and the negative correlations between the tension profile of
agogics) and tonal aspects (e.g., melodic or harmonic the harmony versions and the other versions observed
structure) can enhance the experience of tension, and is for the Mendelssohn piece. These negative correlations
a core compositional and performative device that can may have resulted from the slow rate of harmonic
help to maximize the emotional effect of the music. In change of the Mendelssohn piece, which rendered the
the Mendelssohn piece, for example, the highest tension harmonic reduction rather uninteresting to listen to,
peak (m. 29) reflects the main structural dominant and thus accounting for the relatively flat tension profile of
is prepared by a long crescendo, the rising melody line, the harmony version and its slight downward trend.
The larger contribution of harmony on experienced
1
tension observed for the Mozart piece is also in concor-
Note that even the versions without dynamics still retained some dance with results by Williams, Fredrickson, and Atkin-
minor loudness variations due to varying note density or short
intervals of silence in the music, however, these were negligible
son (2011), who showed that focusing more on
compared with the dynamic variations due to the expressive harmony of a Mozart piece was related to higher tension
performance. ratings as compared with attending more to the melody,
Influence of Structural Features on Musical Tension 179

which indicates a higher importance of harmony in exhibits recursive nesting of harmonic implications from
comparison to melody for inducing an experience of each chord to its successor by cascading syntactic depen-
tension in Mozart pieces. dencies that are all directed towards the final tonic of the
Another feature differing between pieces was loud- phrase. The tension profile shows that each of these sin-
ness, which correlated significantly with tension profiles gle implications between two chords feature a small
of the Mendelssohn piece but not of the Mozart piece. tension-release pattern which is itself embedded in the
This also seems to reflect a different importance of this overall rise of tension towards the final tonic of the
feature in the respective piece that already becomes phrase. This illustrates that experienced tension can be
apparent when comparing the scores of the pieces. governed by local and global structure at the same time.
Whereas the score of the Mendelssohn piece includes On the other hand, the finding that not all local domi-
marked crescendi and dynamic indications ranging nants—but mostly those that reflect deep structure (in
from pianissimo to fortissimo, the Mozart piece makes terms of analytic reduction)—affected the tension profile
more limited use of dynamics with indications ranging underscores that dominants do not trigger a rise in ten-
from piano to forte. It seems probable that the larger sion per se, but that their impact depends on the context
dynamic variations of the Mendelssohn piece made them of the overarching global structure. Both of these exam-
stand out more clearly against other musical features, ples demonstrate the interplay between local implications
thus accounting for the high correlations between loud- and global syntactic implications for establishing musical
ness and tension for this piece. This piece-dependant tension; both local and global implications and depen-
influence of different features on experienced tension dencies are embraced by theories of tonal syntax (cf.
indicates that it is problematic to model musical tension Lerdahl & Jackendoff, 1983, or Rohrmeier, 2011) without
based on the assumption that the contribution of differ- the need for two separate models.3
ent features on experienced tension remains constant Finally, we would like to point out some limitations of
over different pieces. Instead, to increase the accuracy the study. First, tension ratings were only tested for two
of models of musical tension, features should be weighted music pieces. To maximize the ecological validity of the
dynamically depending on the musical context (as, for study, we used stimuli based on real music pieces
example, in the model by Farbood, 2012). instead of artificial stimuli, which comes at the price
With respect to the time lag between tension ratings that stimuli had relatively long durations (thus limiting
and corresponding musical events, our results are con- the amount of different stimuli that can be delivered in
sistent with observations by Schubert (2004), who one experimental session). To investigate to which
reported emotion responses 1 to 3 seconds after the degree the results reported here can be generalized to
respective musical event. Interestingly, the time lag was other pieces, research on musical tension has to be
shorter for the Mozart than for the Mendelssohn piece, extended to stimuli differing on various dimensions
which raises the question as to how properties of the such as music genre, tempo, or orchestration. Second,
music influence the response times of participants. It the within-subjects design of the present study, which
has been conjectured that faster tempos and loud sud- exposed participants repeatedly to different versions of
den sounds decrease response times (Schubert & Duns- the same piece, may have resulted in interference effects
muir, 1999, as cited in Schubert, 2010) which is in line between different tension ratings because the tension
with our results.2 rating of a stimulus may have been influenced in part
The qualitative analysis suggests that participants’ ten- by a participant’s (implicit) memory of prior presenta-
sion ratings strongly reflected the form of the piece, i.e., tions of the stimulus in a different version (for online
different parts and sections, local harmonic implications learning during experimental tasks compare Rohrmeier,
and resolutions as well as global overarching syntactic 2009). This may have led to a slight under or overesti-
features (cf. Lerdahl & Jackendoff, 1983; Rohrmeier, mation of the correlation coefficients: Correlations
2011). For instance, the overarching tension increase between tension ratings of different versions may either
mediated by several smaller local tension-resolution pat- have become stronger (the memory of previous expo-
terns in the first phrase of the Mozart piece (mm. 1-8) sures may have made tension ratings of different ver-
reflects how local and global structure interact in forming sions more similar) or weaker (repeated exposures may
patterns of tension and release. The harmonic structure
3
Note, however, that this does not entail that the correlation of tension
2
Although the notated tempo of the Mozart piece is slower than that of profiles predicted by syntactic theories with human data provides strong
the Mendelssohn piece (Adagio vs. Allegretto tranquillo), the rate of evidence that humans do in fact employ such hierarchical representations
harmonic and melodic change is higher. in music perception.
180 Moritz Lehne, Martin Rohrmeier, Donald Gollmann, & Stefan Koelsch

have made differences between versions more apparent, 2012) is that a specific brain region (the dorsal striatum)
resulting in more dissimilar ratings). However, because is involved in emotional activity due to anticipation: In
of the randomized stimulus presentation and the aver- a functional neuroimaging study by Koelsch, Fritz, and
aging across participants, this possible bias would have Schlaug (2008) this region was activated during blocks
affected all correlations between different tension rat- of chord sequences with irregular chords evoking the
ings in the same way, keeping the relative comparisons anticipation for resolution. A study by Salimpoor, Beno-
between different correlations valid. Last, we only tested voy, Larcher, Dagher, and Zatorre (2011) showed release
the influence of one psychoacoustical feature—loud- of the neurotransmitter dopamine in this region while
ness—on experienced musical tension. However, other listeners anticipated a music-evoked frisson (an
low-level psychoacoustical features may play a role in intensely pleasurable experience often involving goose-
mediating tension. In particular, sensory dissonance is bumps or shivers down the neck, arms, or spine). Activ-
likely to have an effect on experienced tension, which is ity changes in another brain region (the amygdaloid
indicated by previous research showing that for single complex) appear to be related to the processing of
chords subjective roughness ratings correlate with ten- breaches of expectancy (Koelsch et al., 2008), and yet
sion ratings (Pressnitzer, McAdams, Winsberg, & Fine- another brain region might be involved in the proces-
berg, 2000) and that predictions of a roughness model sing of resolution: In the study by Salimpoor et al.
correlate with tension ratings of musicians (Bigand (2011), the anticipated and rewarding frisson itself
et al., 1996). To investigate whether these findings gen- evoked dopaminergic activity in another brain structure
eralize to longer music pieces, future research on musi- (the ventral striatum, presumably the so-called nucleus
cal tension should therefore consider also including accumbens). Thus, the pleasurable and rewarding expe-
measures of sensory dissonance into the analysis. rience of the resolution of a breach of expectancy might
As a critical note, and general limitation of research on involve activity in different brain structures than those
musical tension using one-dimensional tension scales, we involved in the anticipation of the resolution. Such con-
would also like to emphasize that the fine-structure of siderations illustrate that a multidimensional approach to
emotional activity underlying tension phenomena tension might be necessary for fruitful future research.
(including its neural correlates) cannot be grasped ade-
quately by one-dimensional tension values, and subjec-
Conclusion
tive ratings of high-level concepts such as tension (and
emotion ratings in general) only provide limited insight
The present study investigated the effect of different
into the multiple cognitive and affective mechanisms
structural features of music (dynamics, agogics, har-
underlying the subjective emotional experience.
mony, outer voices, melody, and loudness) on felt musi-
As laid out previously (Koelsch, 2012), this is because
cal tension. Overall, tension ratings for versions without
different structural principles with different affective
expressive features (dynamics and agogics) correlated
qualities can give rise to tension or resolution: The
highly with ratings of the original recordings, indicating
build-up of a musical structure (which may lead to a rise
that the general tension-resolution pattern of a music
in tension), a breach of expectancy (which also leads to
piece is governed essentially by its tonal structure, rather
a rise in tension), the anticipation of resolution after the
than by expressive features. Adding expressive features,
breach of expectancy (which usually either maintains,
however, can enhance the experience of musical tension.
or even increases, tension), and the resolution of a breach
The relative contribution of loudness, as well as melody
(leading to release of tension) are qualitatively different
and harmony, depended more on the special character-
phenomena, yet they are not differentiated when mea-
istics of individual pieces with more salient features
suring tension with a one-dimensional scale. Thus, for
apparently having a stronger impact on felt musical
example, the tension value of a tonic chord at the begin-
tension. A qualitative analysis suggested that partici-
ning of a harmonic sequence with a structural breach is
pants are sensitive to core features of harmonic,
similar, or even identical, to the tension value of a tonic
melodic, and global syntactic musical structure.
chord at the end of a sequence (both tonic chords have
low tension values). However, the underlying affective
phenomena are different (build-up vs. resolution). Such Author Note
differences in cognitive and affective phenomenology
are relevant for investigations in related fields such as Martin Rohrmeier is now at the Department of Linguis-
neuroscientific investigations of tension phenomena: tics and Philosophy, Massachusetts Institute of Technol-
A working hypothesis suggested recently (Koelsch, ogy, Cambridge, Massachusetts, United States.
Influence of Structural Features on Musical Tension 181

This research was supported by the Excellence Initia- Correspondence concerning this article should be
tive of the German Federal Ministry of Education and addressed to Moritz Lehne, Cluster of Excellence ‘‘Lan-
Research. We would like to thank Yu Fukuda and guages of Emotion’’, Freie Universität Berlin, Habelsch-
Vienna Dönnie for helping with the preparation of the werdter Allee 45, 14195 Berlin, Germany. E-mail:
music stimuli. We also thank the action editor, Emma- moritz.lehne@fu-berlin.de
nuel Bigand, and two anonymous reviewers for helpful
comments and suggestions.

References

B IGAND, E., & PARNCUTT, R. (1999). Perceiving musical tension L ERDAHL , F. (2001). Tonal pitch space. New York: Oxford
in long chord sequences. Psychological Research, 62, 237-254. University Press.
B IGAND, E., PARNCUTT, R., & L ERDAHL , F. (1996). Perception of L ERDAHL , F., & J ACKENDOFF, R. (1983). A generative theory of
musical tension in short chord sequences: The influence of tonal music. Cambridge, MA: MIT Press.
harmonic function, sensory dissonance, horizontal motion, and L ERDAHL , F., & K RUMHANSL , C. L. (2007). Modeling tonal
musical training. Perception and Psychophysics, 58, 124-141. tension. Music Perception, 24, 329-366.
FARBOOD, M. (2012). A parametric, temporal model of musical M ARGULIS , E. H. (2005). A model of melodic expectation. Music
tension, Music Perception, 29, 387-428. Perception, 22, 663-714.
F REDRICKSON , W. E. (1997). Elementary, middle, and high school M EYER , L. B. (1956). Emotion and meaning in music. Chicago, IL:
student perceptions of tension in music. Journal of Research in University of Chicago Press.
Music Education, 45, 626-635. NARMOUR , E. (1992). The analysis and cognition of basic melodic
F REDRICKSON , W. E. (1999). Effect of musical performance on structures: The implication-realization model. Chicago, IL:
perception of tension in Gustav Holst’s first suite in e-flat. University of Chicago Press.
Journal of Research in Music Education, 47, 44-52. N IELSEN , F. V. (1983). Oplevelse of musikalsk spaending
F REDRICKSON , W. E. (2000). Perception of tension in music musi- [The experience of musical tension]. Akademisk Forlag,
cians versus nonmusicians. Journal of Music Therapy, 37, 40-50. Copenhagen.
G ABRIELSSON , A. (2002). Emotion perceived and emotion felt: P RESSNITZER , D., M C A DAMS , S., W INSBERG , S., & F INEBERG , J.
Same or different? Musicae Scientiae, Special issue 2001-2002, (2000). Perception of musical tension for nontonal orchestral
123-147. timbres and its relation to psychoacoustic roughness.
H URON , D. (2008). Sweet anticipation: Music and the psychology Perception and Psychophysics, 62, 66-80.
of expectation. Cambridge, MA: MIT Press R OHRMEIER , M. (2007). A generative grammar approach to
J USLIN , P. N., & VÄSTFJÄLL , D. (2008). Emotional repsonses to diatonic harmonic structure. In C. Spyridis, A. Georgaki,
music: The need to consider underlying mechanisms. G. Kouroupetroglou, & C. Anagnostopoulou (Eds.),
Behavioral and Brain Sciences, 31, 559-621. Proceedings of the 4th Sound and Music Computing Conference
KOELSCH , S. (2010). Towards a neural basis of music-evoked (pp. 97-100). Athens, Greece.
emotions. Trends in Cognitive Sciences, 14, 131-137. R OHRMEIER , M. (2009). Learning on the fly. Computational
KOELSCH , S. (2012). Brain and music. West Sussex, UK: John analyses of an unsupervised online learning effect. In A.
Wiley & Sons, Ltd. Howes, D. Peebles, & R. P. Cooper (Eds.), Proceedings of the 9th
KOELSCH , S., F RITZ , T., & S CHLAUG , G. (2008). Amygdala International Conference on Cognitive Modeling - ICCM 2009
activity can be modulated by unexpected chord functions (pp. 372-377). Manchester, UK.
during music listening. NeuroReport, 19, 1815-1819. R OHRMEIER , M. (2011). Towards a generative syntax of tonal
K RUMHANSL , C. L. (1996). A perceptual analysis of Mozart’s harmony. Journal of Mathematics and Music, 5, 35-53.
piano sonata K. 282: Segmentation, tension, and musical ideas. R OHRMEIER , M., & KOELSCH , S. (2012). Predictive information
Music Perception, 13, 401-432. processing in music cognition. A critical review. International
K RUMHANSL , C. L. (1997). An exploratory study of musical Journal of Psychophysiology, 83, 164-175.
emotions and psychophysiology. Canadian Journal of S ALIMPOOR , V., B ENOVOY, M., L ARCHER , K., DAGHER , A., &
Experimental Psychology, 51, 336-353. Z ATORRE , R. J. (2011). Anatomically distinct dopamine release
Lalitte, P., Bigand, E., Kantor-Martynuska, J., & Delbé, C. (2009). during anticipation and experience of peak emotion to music.
On listening to atonal variants of two piano sonatas by Nature Neuroscience, 14, 257-262.
Beethoven. Music Perception, 26, 223-234. S CHENKER , H. (1935). Der Freie Satz. Neue Musikalische Theorien
L ERDAHL , F. (1996). Calculating tonal tension. Music Perception, und Phantasien [Free composition. New musical theories and
13, 319-363. fantasies.]. Margada, Liège, Belgium.
182 Moritz Lehne, Martin Rohrmeier, Donald Gollmann, & Stefan Koelsch

S CHUBERT, E. (2002). Correlation analysis of continuous emotional V INES , B. W., K RUMHANSL , C. L., WANDERLEY, M. M., &
response to music: Correcting for the effects of serial correlation. L EVITIN , D. J. (2006). Cross-modal interactions in the
Musicae Scientiae, Special Issue 2001-2002, 213-236. perception of musical performance. Cognition, 101, 80-113.
S CHUBERT, E. (2004). Modeling perceived emotion with contin- W ILLIAMS , L. R., F REDRICKSON , W. E., & ATKINSON , S. (2011).
uous musical features. Music Perception, 21, 561-585. Focus of attention to melody or harmony and perception of
S CHUBERT, E. (2010). Continuous self-report methods, In P. N. music tension: An exploratory study. International Journal of
Juslin & J. A. Sloboda (Eds.), Handbook of music and emotion - Music Education, 29, 72-81.
Theory, research, applications (pp. 223-253). Oxford, UK: Z WICKER , E., & FASTL , H. (1999). Psychoacoustics - Facts and
Oxford University Press. models. Berlin and Heidelberg: Springer-Verlag.
Influence of Structural Features on Musical Tension 183

Appendix

Mendelssohn Bartholdy, Venetian Boat Song (Op. 30, No. 6)


184 Moritz Lehne, Martin Rohrmeier, Donald Gollmann, & Stefan Koelsch
Influence of Structural Features on Musical Tension 185

Mozart, Piano Sonata KV 280 (Second Movement)

You might also like