Professional Documents
Culture Documents
Montoya HandbookFEofE
Montoya HandbookFEofE
Montoya HandbookFEofE
net/publication/260796947
CITATIONS READS
8 35,295
15 authors, including:
All content following this page was uploaded by Daniel Montoya on 05 February 2015.
F
The Science of Reading Human Faces
F
FEELab Science Books
www.feelab.org
Porto, Portugal
Handbook on Facial Expression of Emotion
© 2013 - A. Freitas-Magalhães, Carla Bluhm & Mark Davis
ISBN 978-989-98524-6-4
Foto “The heart of emotion” © 2013 - S. Po
All rights reserved. All reproduction or transmission in any form or by any means, mechanical, electronic, copy,
recording or any other, without written authorisation of the editors and the publisher is illegal and subjected to
judicial procedure against the infractor.
Daniel Montoya
Microexpressions are rapid facial expressions that appear when an individual is trying to
repress or conceal his/her underlying emotions. With the development of tools such as the
Micro Expression Training Tool (METT) and the Subtle Expression Training Tool (SETT) we
can now ask questions about rapid changing situations with many emotional cues on
display. In this chapter, we define micro-expressions and point to some of its main uses with
a particular focus on research applications. In the first part, we describe how METT and
SETT have become powerful tools to understand emotions and make people aware of their
own expressions. In the second part, we discuss the application of METT to the study of
emotion perception (EP) in two important pathologies: Schizophrenia and Parkinson’s
disease, with special reference to the importance of emotion recognition and its implications
in treatment efforts to improve patient’s outcome.
Introducing Microexpressions:
From the Lab to Clinical Applications
The discovery of microexpressions was the result of new technologies and
challenging questions posed by students. Paul Ekman (2007) was urged to find a way of
detecting deception by his own psychiatry students. The problem was simple: in a clinical
setting, noticing when a depressed patient is lying may represent the difference between life
and death. In this situation, a physician needs a way to know, in unambiguous terms, if a
patient could be faking her remission. In this case, important decisions such as the
continuing hospitalization, drug doses, or even if the patient constitutes a danger to themself,
may depend on the ability of the physician to weight the patient’s truthfulness.
By pure coincide, Ekman had access to a video recording of a 40-year old depressed
patient that admitted to lying in her discharge interview. She recognized she planned to kill
herself once released from the hospital. At first, watching the film, Ekman didn’t see any
evidence that the patient was lying. The woman smiled and presented an optimistic facade
that threw people off her real intentions. However, when the film was analyzed frame-by-
frame, the clear signs of hidden emotions appeared on the screen. When the patient was
specifically asked about her future plans “a strong anguish” crossed her face. Ekman
realized immediately that, at a normal film speed or in a normal interview setting, the short
expression would have been missed altogether.
This led to further analysis by Ekman and his collaborator, Wally Friesen who termed
these fleeting emotional displays “microexpressions”. They are comprised by “very fast
facial movements of about 1/25 to 1/5 of a second” (Freitas-Magalhães, 2012) (See Figure
1).
With the development of the Micro Expression Training Tool (METT) and the Subtle
Expression Training Tool (SETT) micro-expression analysis has become a powerful tool to
understand emotions and make people aware of their own expressions. In this way, micro-
expression analysis became a fertile ground for applications outside the field of psychiatry.
Today, we can see its utility in widely different research pertaining to food preference in
children (de Wijk, Kooijman, Verhoeven, Holthuysen, & de Graaf, 2012); emotion recognition
in parents at high risk for child abuse (Asla, de Paú, & Pérez-Albéniz, 2011); recognition of
faked and real pain (Hill & Craig, 2002) and clinical areas such as emotion perception in
Parkinson's disease (Mondillon, Fau-Mermillod, et al., 2012) and Schizophrenia (Russell,
Chu, & Phillips, 2006).
Figure 3.
Microexpressions and context. These are some of the elements affecting the interpretation
of micro-expressions depending on the context in which they happen.
Figure 4.
Microexpressions are buried under several kinds of signals emanating from each
participant in a conversation. Those signals, such as the tone of voice, the actual words
and and elaboration of a response, actually distract us from reading micro expressions.
The importance of context have been also highlighted by Wieser and Brosch (2012), who
point out that research in emotional expressions have been carried out using static pictures,
de-contextualized and presented in isolation. However, this is not how we process facial
expressions in the natural world. There, we receive multiple channels of information from a
sender; the interaction happens in a specific situation, and, as the authors point out, this
context is usually provided by the receiver of the emotional exchange. This brings out front
the salience of variables such as eye gaze (expressions of joy and anger seems more
intense when accompanied by direct eye gaze), facial dynamics (the time flow of facial
movements when expressing emotions), affective prosody (based on auditory cues that
accompany the facial expression), and body posture accompanying facial expressions,
among others. See (Wieser & Brosch, 2012) for a detailed review.
One study, however (Aviezer, Trope, & Todorov, 2012), pointed at the relationship
between body and facial expressions provide results that seem to underscore the
importance of the body over the emotional face. The experimenters isolated faces from body
postures (using sport images) and then combined them in new ways (i.e. combining winning
bodies with losing faces or vice versa). During high levels of emotions, participants correctly
discriminated a positive or negative emotion from isolated bodies but not isolated faces. The
participants were invited to assume the position as if they were in the same situation as the
person in the picture. The results showed that losing faces were posed as more positive
when the poser viewed them on winning bodies than on losing bodies. According to the
authors, these results seem to indicate that emotional information is not conveyed by a
transient facial expression but in relationship to an accompanying body posture. Even
though this study may present some limitations, it may lead us to reconsider in many ways
our current understanding of the methodology to study facial expressions in a
decontextualized lab setting.
Table 1.
Differences between faked pain and genuine pain.
Based on Hill & Craig (2002).
Another area where METT has proved its usefulness is the study of emotion
perception in schizophrenic patients. Schizophrenia is characterized by the presence of
psychotic episodes, which include hallucinations and delusions, as well as symptoms that
can be grouped in positive (the previously mentioned hallucinations), negative (blunted
emotional response, social withdrawal etc.) and cognitive (impairment of working memory
and executive function) (Hyman & Cohen, 2013). The diagnosis of Schizophrenia means a
lifelong disability for the patient. The etiology of Schizophrenia remains unclear, but it is
currently recognized that both genetic and non-genetic factors contribute to the development
of the disease. In addition, schizophrenic patients show a marked decrease of gray matter in
brain areas such as prefrontal, temporal and parietal cortex (van Haren, Collins, Evans,
Hulshoff Pol, & Kahn, 2011).
Schizophrenic patients show strong deficits in emotion perception. This deficit
contributes to their social dysfunction (Combs et al., 2008). Other studies show, however,
that EP deficits are associated with functional impairments in schizophrenia and moderated
by sex, race and symptoms (Irani, Seligman, Kamath, Kohler, & Gur, 2012). A pilot study
originally proposed by Russell et al (2006) explored the possibility of training schizophrenic
patients with the METT with the objective of enhancing their emotion recognition. A post-
training comparison of two groups (20 schizophrenic patients and 20 healthy controls)
showed that both improved their emotion recognition skills. Schizophrenic patients
“improved to a level that did not distinguish them from pre-trained controls” (p. 549).
In a follow-up study, Russell and colleagues (2008) examined changes in visual
attention in schizophrenic patients following training with the METT. In this study, forty out-
patients were randomly allocated to active training with METT or repeated exposure (which
does not produce changes in emotion recognition accuracy). The patients’ binocular eye
movements were recorded through a head-mounted scanner. The results indicated that the
group trained with METT increased their eyes movements toward face features such as
eyes, nose and mouth, compared to the repeated exposure group. This was associated with
an increase in emotion recognition accuracy. In addition, the effect was still present after a
week. This indicates that increases in emotion recognition accuracy after METT training are
strongly associated to the patient’s capacity to fixate his/her visual attention to specific facial
features.
Conclusions
In this chapter we endeavored to portrait some of the specific uses, and general
challenges, of the Micro Expression Training Tool (METT), developed originally by Ekman
(2007) with the main purpose of being able to identify cases of deception. However, the last
decade has seen the use of this technology grow in different directions, and, as we
described above, now its utility is clear in cases well beyond the simple detection of
suppressed emotions.
However, this briefing underscores the fact that more research is needed, especially with
the application of this technology in clinical settings. This is particularly relevant when we
discuss the effects of DBS in Parkinson’s patients, who could benefit from the same
approach tested in Schizophrenic patients. Using the METT or similar behavioral
technologies can bring important benefits. Clearly among these benefits are the positive
effects on patient’s quality of life, which could be an alternative to the plethora of
pharmacological treatments already available.
Notes
1 We have to remember that the elements described here make sense
only in a setting where the interviewer has been trained on the METT
or has access to a video recording that could be viewed at different
speeds.
2 People also lie about their thoughts, their intentions and their
attitudes.
References
4
Microexpression and Macroexpression:
View publication stats