Download as pdf or txt
Download as pdf or txt
You are on page 1of 16

Journal of Vision (2023) 23(4):1, 1–16 1

Anger is red, sadness is blue: Emotion depictions in abstract


visual art by artists and non-artists
Department of Brain and Cognition, KU Leuven,
Claudia Damiano Leuven, Belgium

Department of Design, Kala Bhavana,


Pinaki Gayen Visva Bharati University, Shantiniketan, India

Department of Psychology, University of Toronto,


Morteza Rezanejad Toronto, ON, Canada

Rekhi Centre of Excellence for the Science of Happiness,


Archi Banerjee Indian Institute of Technology, Kharagpur, India

Gobinda Banik Department of English, Basirhat College, Basirhat, India

Rekhi Centre of Excellence for the Science of Happiness,


Priyadarshi Patnaik Indian Institute of Technology, Kharagpur, India

Department of Brain and Cognition, KU Leuven,


Johan Wagemans Leuven, Belgium

Department of Psychology, University of Toronto,


Dirk B. Walther Toronto, ON, Canada

Through the manipulation of color and form, visual emotion (e.g., anger is generally redder and more
abstract art is often used to convey feelings and densely drawn than other emotions, sadness is more
emotions. Here, we explored how colors and lines are blue and contains more vertical lines). Taken together,
used to express basic emotions and whether non-artists these results imply that abstract color and line drawings
express emotions through art in similar ways as trained are able to convey certain emotions based on their
artists. Both artists and non-artists created abstract visual features, which are also used by human observers
color drawings and line drawings depicting six emotions to understand the intended emotional connotation of
(i.e., anger, disgust, fear, joy, sadness, and wonder). To abstract artworks.
test whether people represented basic emotions in
similar ways, we computationally predicted the emotion
of a given drawing by comparing it to a set of references
created by averaging across all other participants’ Introduction
drawings within each emotion category. We found that
prediction accuracy was higher for color drawings than
line drawings and higher for color drawings by People have been telling stories through art for
non-artists than by artists. In a behavioral experiment, thousands of years. In fact, some of the earliest cave
we found that people (N = 242) could also accurately paintings of animals, dating back over 45,000 years
infer emotions, showing the same pattern of results as (Aubert et al., 2014; Aubert et al., 2018; Brumm et al.,
our computational predictions. Further computational 2021), are thought to depict hunting scene narratives
analyses of the drawings revealed systematic use of and creatures that existed, or perhaps did not, in
certain colors and line features to depict each basic the world of the early human (Valladas et al., 2001).

Citation: Damiano, C., Gayen, P., Rezanejad, M., Banerjee, A., Banik, G., Patnaik, P., Wagemans, J., & Walther, D. B. (2023). Anger
is red, sadness is blue: Emotion depictions in abstract visual art by artists and non-artists. Journal of Vision, 23(4):1, 1–16,
https://doi.org/10.1167/jov.23.4.1.
https://doi.org/10.1167/jov.23.4.1 Received October 25, 2022; published April 3, 2023 ISSN 1534-7362 Copyright 2023 The Authors

This work is
Downloaded from jov.arvojournals.org onlicensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
03/23/2024
Journal of Vision (2023) 23(4):1, 1–16 Damiano et al. 2

Through the manipulation of, for example, color, as anger and joy, respectively (Jonauskaite, Parraga,
texture, and form, art communicates desired Quiblier, & Mohr, 2020). It is thus unsurprising that
information and is used to capture our rituals and we even have sayings in English that use color to
experiences of daily life. Among those experiences are represent emotions (e.g., “seeing red” to mean “being
events that trigger emotions such as anger, fear, and angry,” “feeling blue” to mean “feeling sad”). Artists
happiness. Here, we explore the visual features that allow and designers take advantage of these associations and
us to convey specific emotions and whether training in manipulate color or shape to achieve a certain reaction
the arts plays a role in one’s ability to depict emotions from the viewer or user. For example, in Disney’s
through art. film Inside Out, specific visual features are matched
Several traditional theories of emotion state that to the personalities of different emotion characters
emotions are brought about by physical processes (e.g., the Anger character is the color red, with spiky
of an animal’s brain or body and can be explained fire-like hair). This depiction seems to make intuitive
by reactions to events in the physical world (Barrett, sense to the viewer, and even children can immediately
Mesquita, Ochsner, & Gross, 2007). For example, understand the intended emotion of artworks simply
appraisal theories suggest that emotions are adaptive from visual features such as color (Pouliou, Bonoti,
responses to appraisals of the features of an organism’s & Nikonanou, 2018).
environment and that these responses are necessary for Thus, there is ample evidence that clear associations
the organism’s well-being (Moors, Ellsworth, Scherer, between certain visual features and emotions exist, but
& Frijda, 2013). Similarly, the basic emotion theory the exact nature of these associations could be explored
generally defines emotions as patterns of behavior further. For example, although certain contour features
related to certain subjective experiences (Keltner, Sauter, such as smooth long lines or short angular lines are
Tracy, & Cowen, 2019). As such, emotion judgments typically associated with a general positive or negative
are an integral part of daily life and reflect the most valence, respectively (Damiano et al., 2021a), their
basic and fundamental aspects of human behavior relation to more specific emotions such as disgust, fear,
(Ledoux, 1998). Ekman, Sorenson, and Friesen (1969) and sadness is not as well known. In the current study,
suggested that there are six basic emotion categories we asked whether there is a recognizable distinction in
that are universal in their production and recognition: line usage between multiple negative emotions, such
anger, disgust, fear, joy, sadness, and surprise. In the as anger and disgust or fear and sadness. A previous
current study, we examined how people create abstract study that did use more specific emotion labels found
drawings representing each of these emotions; however, that people indeed were successfully able to predict
we opted to replace “surprise” with “wonder” for basic emotion labels from small abstract line drawings
two reasons. First, although anger, disgust, fear, and made by artists (Stamatopoulou & Cupchik, 2017).
sadness are clearly negative emotions and joy is clearly a This result suggests that there are indeed noticeable
positive emotion, surprise does not have a clear positive differences in line drawing representations among
or negative valence (Fontaine, Scherer, Roesch, & several emotions, allowing viewers to be able to
Ellsworth, 2007). Thus, we chose to include an emotion successfully tell them apart; yet, the specific features
that was more obviously positive to balance out the associated with each emotion that allowed people
several negative emotions in the set. Second, wonder to make these predictions were neither explored nor
is an underrepresented and understudied emotion discussed.
within the field, despite its observed relationship to art In contrast to contour features, the relationship
appreciation and aesthetic pleasure (Fingerhut & Prinz, of color to basic emotion categories is much better
2018). studied (Jonauskaite et al., 2020; Mohr, Jonauskaite,
No matter the exact emotion in question, emotional Dan-Glauser, Uusküla, & Dael, 2018). We hypothesized
appraisals are often triggered quickly and automatically that we would replicate previous findings in the
(Barrett et al., 2007; Moors et al., 2013). Past research current study, with colors such as red being more
suggests that there are common visual features that often associated with anger, blue with sadness, yellow
people use as cues to infer certain emotions or to with joy, etc. What is yet to be explored, however,
make certain affective evaluations. For example, is whether colors are better than contour features
previous work has found that angularity is associated at conveying differences across emotions. On the
with negative valence and threat (Bar & Neta, one hand, the well-established associations between
2006; Damiano, Walther, & Cunningham, 2021a; certain colors and emotions potentially mean that
Larson, Aronoff, & Stearns, 2007), symmetry or color is a stronger carrier of emotion information than
repeating patterns are associated with positive aesthetic contour features. On the other hand, accurate visual
judgments (Damiano, Wilder, Zhou, Walther, & perception of objects and scenes can be achieved rapidly
Wagemans, 2021b; Pecchinenda, Bertamini, Makin, from viewing simple line drawings (Walther, Chai,
& Ruta, 2014), and certain colors, such as red and Caddigan, Beck, & Fei-Fei, 2011) completely devoid
yellow, are often linked with certain emotions, such of texture or color information. Additionally, the

Downloaded from jov.arvojournals.org on 03/23/2024


Journal of Vision (2023) 23(4):1, 1–16 Damiano et al. 3

suggested evolutionary link between contour features


and emotional appraisals (e.g., angular contours are Methods
rated as threatening because they may cue dangerous
stimuli such as thorns or fangs) (Bar & Neta, 2006; Stimulus collection
Friedenberg, Lauria, Hennig, & Gardner, 2022) could
mean that contour–emotion associations are even more Participants
fundamental than color–emotion associations. In the A group of 46 artists and another group of 45
current study, we explored whether emotions are more non-artists provided the stimuli for this study. The
easily inferred from color drawings or line drawings by artists (mean age, 23.8 years; 19 men, 26 women) were
attempting to predict emotions from these drawings recruited from the Ontario College of Art and Design
and comparing prediction accuracies across image (OCAD) University. When analyzing the data, we
types. realized that six people from the artist group did not
Another question we explored in parallel in this study fit our criteria for inclusion (i.e., having formal art
is whether artists are better than non-artists at depicting training and currently in an art-related program, such
emotions, such that other viewers can accurately infer as drawing and illustration, at OCAD University); thus,
which emotion is being depicted. Besides skill-level we excluded them from the sample. The remaining
differences in artistic tasks such as drawing, visual participants in the artist group were art students
artists tend to be better than non-artists at switching attending OCAD University in the Drawing and
between local and global processing (Chamberlain Painting or Illustration programs, and most were in
& Wagemans, 2015). Research has also shown slight their third year of study in a 4-year program (first year,
relationships between drawing ability and other three people; second year, eight people; third year, 18
visual–spatial tasks, such as the Embedded Figures people; fourth year or above, 11 people).
Test and Mental Rotation Task (Chamberlain et al., The other group consisted of 45 non-artists (mean
2019), as well as superior performance on imagery tasks age, 23.6 years; 14 men, 31 women) recruited from the
(Calabrese & Marucci, 2006). This means that not only University of Toronto. We excluded four non-artists
are artists better at drawing than non-artists but they because they had formal art training or were currently
also seemingly outperform non-artists on imagining and in an art-related program at the University of Toronto.
producing what something should look like. Therefore, a The remaining non-artists were students in STEM
reasonable hypothesis is that artists will more skillfully programs (e.g., science, technology, engineering, math),
depict emotion concepts using lines and colors, and most were in their fourth year of study in a 4-year
and thus emotions will be more easily understood program (first year, two people; second year, two
from artists’ drawings compared with non-artists’ people; third year, eight people; fourth year or above,
drawings. However, as artists gain more experience and 29 people).
training, they likely become more distinctive in their All participants across both groups were each paid
individual artistic styles. This could lead to atypical $10 Canadian for their participation. The experiment
feature usage that would make the interpretation of was approved by the ethics boards at the University of
the depicted emotions more difficult. Thus, we will Toronto and OCAD University.
compare the accuracy with which emotions can be
deciphered from artists’ drawings versus non-artists’
drawings.
To summarize our goals and approach, in the current Materials
study we used computational analysis methods to All participants were given two white letter-sized
determine how people depict and interpret emotions sheets of paper to make line drawings and color
through abstract artworks. More specifically, we drawings in designated boxes. There were six boxes per
explored the degree to which people convey emotions sheet and each box was labeled with an emotion (anger,
through art in similar ways and which specific disgust, fear, joy, sadness, or wonder) and drawing type
visual features are associated with each emotion. In (color drawing or line drawing) that should be drawn
an additional behavioral study, we asked whether in that box. Below each emotion label, participants
non-artists can successfully infer emotions from were also asked to briefly specify their reasons for using
abstract artworks and what type of information certain lines or colors in their drawings. The written
they use to be able to do so. We also compared responses are not analyzed here.
drawings made by artists and non-artists to determine Participants were given pencils (2B, 4B, and 6B)
whether artistic training changes the ways in which to create the line drawings and a pastel color set to
emotions are depicted through abstract art and whether create the color drawings. The pastel sets were Pentel
those differences, if they exist, make it easier or Oil Pastel sets consisting of 16 colors, listed here using
more difficult for viewers to understand the desired the conventional name, the closest Munsell color chip
emotion. notation, and the corresponding approximate red,

Downloaded from jov.arvojournals.org on 03/23/2024


Journal of Vision (2023) 23(4):1, 1–16 Damiano et al. 4

green, and blue (RGB) values: red (5R 5/18; [255, 0, 0]), participants from the artist group and four participants
orange (2.5YR 6/14; [255, 140, 0]), dark yellow (2.5Y from the non-artist group, subsequent analyses of the
8/12; [255, 200, 0]), yellow (7.5Y 9/12; [255, 255, 0]), drawings were conducted on a subset of the stimuli
light green (7.5GY 9/14; [150, 255, 0]), green (2.5G (972 total: 480 artists’ drawings and 492 non-artists’
6/10; [0, 200, 65]), cyan/light blue (7.5B 9/8; [80, 230, drawings). See Figure 1 for sample artworks from an
255]), blue (5PB 6/14; [0, 155, 255]), dark blue (7.5PB artist and non-artist. The full set of drawings is available
5/20; [50, 125, 255]), pink (2.5RP 9/6; [255, 200, 230]), on the OSF page for this study (https://osf.io/b6xuq/).
beige (5Y 9/2; [250, 240, 200]), light brown (2.5YR 5/15;
[200, 70, 0]), dark brown (7.5YR 3/6; [100, 60, 10]), gray
(5GY 9/1; [228, 228, 228]), black (5N 1/0; [0, 0, 0]), Computational emotion predictions
and white (5N 10/0; [255, 255, 255]). Note that we did
not use a chromameter to measure the pastel colors; In order to determine if both artists and non-artists
therefore, both the Munsell color chips and RGB values depict emotions in predictable ways, we ran a
are the closest approximations of the colors used by computational emotion prediction analysis. If we can
participants. successfully predict the depicted emotion from drawings
at an above-chance level, that tells us that people’s
drawings tend to be similar within a certain emotion
Procedure and different across emotions.
The artists’ drawings were collected in the outdoor The emotion predictions were made using a
courtyard of OCAD University. Participants were leave-one-subject-out, cross-validation procedure. In
approached individually and were seated in a location order to predict the emotion category from all drawings
where they felt comfortable drawing. Several artists of each participant, we compared each drawing, one
may have been drawing at the same time, but they at a time, to an average reference drawing made by
were seated separately from each other, with sufficient averaging all drawings by all other participants within
distance that they could neither see nor be influenced one emotion category (see Figure 1B for an example of
by each other’s drawings. The non-artists’ drawings the reference drawings). Therefore, each drawing was
were collected in a classroom setting at the University compared to six reference drawings (one per emotion)
of Toronto. Again, several participants may have been by correlating the drawing in a pixel-wise manner to
drawing at the same time, but they were seated at each reference drawing. The label of the reference that
individual tables separately from one another and could gave the highest correlation became the prediction
not see each other’s drawings. for that drawing. If the prediction matched the true
In both cases, participants were asked to sit emotion label, then that was counted as an accurate
comfortably, and all necessary art material and paper guess; otherwise, it was inaccurate. The total accuracy
were provided to them. The experimenters gave the for each participant was the proportion of correctly
following instructions, which were also written on predicted emotions (chance = 1/6 because there were six
sheets of paper given to participants: “Please make emotions). We performed this procedure four times and
one line drawing and one color drawing separately then compared the prediction results using a two-way
for each of the six emotions (anger, disgust, fear, joy, analysis of variance (ANOVA), with art experience
sadness, and wonder). You can remember previous (artists, non-artists) and drawing type (color drawing,
experiences associated with these emotions, but please line drawing) as factors.
depict all emotions only through non-representational An additional prediction procedure was performed
or abstract visual components. Do not use figurative on the line drawings only using the distributions of
art, meaningful shapes, or text in your artworks. length, orientation, and curvature features as predictor
You may use multiple lines and colors in your variables (see Visual feature analysis section below for
artworks. There is no set time limit, but it should details on how the features were computed for each
not take longer than 30 minutes to complete the line drawing, and see Figure 6 for average feature
drawings.” histograms per emotion). In this version, we once
Each participant provided one line drawing and one again predicted the emotion on an image-by-image
color drawing for each of the six emotions, providing 12 basis using a leave-one-subject-out, cross-validation
artworks in total. Overall, 552 abstract drawings of six procedure. However, instead of correlating the entire
emotions (276 line drawings + 276 color drawings) were image to a set of reference maps, we compared the
collected from the 46 artists, and 540 abstract drawings histograms of contour features on each drawing to a set
were collected from the 45 non-artists, for a total of of reference feature histograms (i.e., the average feature
1092 drawings. These drawings were then scanned histograms of all non-left-out images, per emotion)
(300 dpi) to be used digitally for computational image using chi-square distance. This time, the prediction
analyses and in an online behavioral experiment with was the label of the reference histogram that gave
a new set of participants. Due to the exclusion of six the smallest chi-square distance. Once again, if the

Downloaded from jov.arvojournals.org on 03/23/2024


Journal of Vision (2023) 23(4):1, 1–16 Damiano et al. 5

Figure 1. (A) Sample color and line drawings for each emotion, made by one artist (#2) and one non-artist (#1). (B) One example of a
set of color reference drawings used in the computational emotion prediction procedure with color drawings (top) and line drawings
(bottom).

Downloaded from jov.arvojournals.org on 03/23/2024


Journal of Vision (2023) 23(4):1, 1–16 Damiano et al. 6

prediction matched the true emotion label, then that participants simply had to indicate which of the six
was counted as an accurate prediction; otherwise, it emotions was being depicted in each drawing. Each
was inaccurate. The total accuracy for each participant trial consisted of a black fixation cross in the center of
was the proportion of correctly predicted emotions the screen shown for 500 ms, followed by a drawing
(chance = 1/6). displayed in the center of the screen against a gray
background (RGB color [128, 128, 128]). The button
options for each of the six emotions were displayed
Emotion predictions by humans horizontally below the drawing in alphabetical order,
along with the prompt, “What emotion is being
Participants depicted?” The images were displayed on screen until
A total of 244 first-year psychology students at the participant made a response. The response (i.e.,
KU Leuven (Belgium) participated in this experiment the chosen emotion) and reaction time were recorded
(39 men and 205 women; mean age of 19 years). All on each trial. The experiment was programmed using
participants could speak English and received one jsPsych (de Leeuw, 2015), and consisted of two separate
experimental credit for participation, which counted blocks with a short break given in between blocks
toward extra credit in their first-year psychology for participants to rest. Approximately half of the
course. The experiment was approved by the Social and participants saw the set of 156 color drawings first
Societal Ethics Committee at KU Leuven. To check (N = 119), and the other half (N = 125) viewed the
that participants were paying sufficient attention to the line drawings first. The experiment took an average of
task, we calculated the variance of responses within 22 minutes to complete.
a five-trial-long sliding window, as well as the mean
reaction time across all trials, for each participant.
Participants failed the attention check if their mean Visual feature analysis
variance was less than 0.2 or if their mean response time
was less than 500 ms. Two participants were excluded To quantify any differences in color and line
for failing our criteria. Thus, the data of a total of 242 usage across categories and artistic expertise, we
participants were included in further analyses. computationally extracted several features from the
drawings, such as the number of colors and lines and
the percentage of pixels used. The following sections
Stimuli detail the types of features that were extracted and how
All drawings collected from the artists and non-artists this was done.
were used as stimuli in the behavioral experiment.
Each participant viewed 312 drawings in total (156 line Color drawings
drawings and 156 color drawings) chosen randomly
from the set of 1092 drawings, with the requirement In order to analyze the color drawings, we first
that there be an equal number of drawings in each needed to label and quantify the colors that were used in
condition—that is, 13 drawings of each combination each drawing. To do this, we compared the RGB value
of art training (artists vs. non-artists) × drawing type of each pixel to a large online table of RGB values (see
(line drawing vs. color drawing) × emotion (anger, https://www.rapidtables.com/web/color/RGB_Color.
disgust, fear, joy, sadness, or wonder). Each drawing html#color-table). To obtain meaningful labels for our
was displayed at a resolution of 700 × 550 pixels. Recall drawings, we collapsed many of the color labels from
that 120 images were removed from the analyses; thus, the online table into its closest label that was present in
trials containing any of those images were not analyzed our color set; for example, crimson, red, and brick red
(an average of 2.58 trials per participant were removed). would all receive the label “red” (see the final table on
our OSF page for this study, https://osf.io/b6xuq/). The
labels we used, based on the colors that were provided
Procedure to the artists and non-artists, were red, orange, dark
As the behavioral experiment took place online, yellow, yellow, light green, green, cyan, blue, dark blue,
participants used their own computers to participate. pink, beige, light brown, dark brown, gray, black, and
Participants received a link to participate through white (see Stimulus collection section above). Violet
KU Leuven’s participant pool. Participants provided (10PB 3/10; [80, 60, 130]) was also included because
informed consent by clicking on “I agree” after participants sometimes mixed red and blue to create
reading the consent form online. Upon a participant’s violet. Any pixels labeled as white were excluded from
agreeing to participate, the experiment began with further analyses because they corresponded to the
instructions stating that participants would see abstract background of each drawing.
drawings, one at a time, depicting one of six emotions For each pixel, the comparison was done by
(anger, disgust, fear, joy, sadness, or wonder) and that subtracting the pixel values from each row in the table,

Downloaded from jov.arvojournals.org on 03/23/2024


Journal of Vision (2023) 23(4):1, 1–16 Damiano et al. 7

Figure 2. Two example line drawings and their extracted contour feature statistics. The top drawing represents anger and the bottom
drawing represents joy.

separately for the R, G, and B channels. We then took butions, we also calculated features of the line drawing
the sum of the absolute values of the differences (i.e., as a whole, such as the proportion of the drawing that
|R| + |G| + |B|). The pixel label was the color contained non-white pixels (i.e., the density of the draw-
that gave the smallest sum of differences. With this ing) and the number of individual lines present in each
analysis, we were able to extract, from each drawing, drawing.
the percentage of pixels that were a certain color,
the percentage of the drawing that contained color
(i.e., non-white pixels), and the number of different
colors used in each drawing. This approach is not
perfect, as in our study it sometimes mislabeled Results
pixels (e.g., labeling red as pink if the red is only
lightly pressed on the paper), but it provides a fairly Computational emotion predictions
good approximation of the colors present in each
drawing. To determine whether emotions are depicted
commonly across individuals, we ran a leave-one-
subject-out, cross-validation procedure on each of the
Line drawings four image types (i.e., artists’ color drawings, artists’ line
Histogram distributions of contour features were drawings, non-artists’ color drawings, and non-artists’
extracted from each line drawing using the Mid-level line drawings). In this procedure, we predicted the
Vision (MLV) Toolbox (https://mlvtoolbox.org) depicted emotion of each drawing by comparing it (i.e.,
(Rezanejad, Downs, Wilder, Walther, Jepson, correlation) to reference drawings made by averaging
Dickinson, & Siddiqi, 2019; Rezanejad & Siddiqi, all other drawings. We found that emotions are indeed
2013; Walther & Shen, 2014; Walther, Farzanfar, predictable from abstract color and line drawings at an
Han, & Rezanejad, 2023). First, each line drawing above-chance level, meaning that commonalities exist
was transformed into a vectorized version using in how individuals depict certain emotions. A 2 × 2
the traceLinedrawingFromEdgeMap function. This ANOVA with drawing type (color vs. line drawing)
function extracts each separate line present in the line and artistic training (artists vs. non-artists) as factors
drawing and turns it into a vector, or series of vectors, revealed a main effect of drawing type, F(1, 157) =
with length and direction information. Using these 61.45, p < 0.001, η2 = 0.27, and interaction, F(1, 157)
vectorized line drawings, the getContourPropertiesStats = 5.37, p < 0.05, η2 = 0.02. In general, it is easier
function calculates the angularity, length, and to predict emotions from color drawings than line
orientation statistics of each line drawing (see Figure 2 drawings. The interaction revealed that, for the color
for examples). In addition to the contour feature distri- drawings, emotions were more easily predictable from

Downloaded from jov.arvojournals.org on 03/23/2024


Journal of Vision (2023) 23(4):1, 1–16 Damiano et al. 8

Figure 3. Summary of computational and behavioral emotion prediction results. The boxes represent the means and 95% confidence
intervals. The dots in the behavioral plots represent individual (N = 242) average accuracy per condition. Significant differences in
prediction accuracy between artists’ and non-artists’ drawings are marked.

non-artists’ drawings than artists’ drawings (accuracy = observers from artists’ or non-artists’ drawings. Once
50.81% vs. 39.17%, respectively; p < 0.05). However, for again, we ran a 2 × 2 ANOVA with drawing type
the line drawings, emotion predictability did not differ and art expertise as factors. Like the computational
between artists and non-artists (accuracy = 24.58% and prediction results, we found a main effect of drawing
23.17%, respectively). type, F(1, 964) = 386.73, p < 0.001, η2 = 0.40, such
These findings suggest that non-artists’ color that human observers more easily inferred emotions
drawings are more uniform within an emotion category. from the abstract color drawings compared with the
In other words, a non-artist seems to draw emotions line drawings. Additionally, a main effect of artistic
similarly to other non-artists. In contrast, artists’ training was found, F(1, 964) = 12.26, p < 0.001, η2 =
drawings tend to be unique, which leads to lower 0.01, such that emotions were more difficult to predict
prediction accuracies, as the computational prediction from artists’ drawings than non-artists’ drawings.
method relies on similarities across individuals within Finally, the interaction was also significant, F(1, 964) =
an emotion category. 7.00, p < 0.01, η2 = 0.007, showing that participants
An additional prediction analysis was performed were better able to predict emotions from non-artists’
on the line drawings only, using contour feature drawings compared with artists’ drawings when the
distributions as predictor variables. Using this drawings contained color (accuracy = 43.06% vs. 40%,
approach, we could also predict emotions from line respectively; p < 0.001), but there was no difference in
drawings made by artists and non-artists (accuracy prediction accuracies between artists’ and non-artists’
= 25% and 23.17%, respectively) at an above-chance line drawings (31.5% vs. 31.93%, respectively). These
level (both p < 0.01). These prediction accuracies results imply that non-artists are actually better than
did not significantly differ between artists and artists at accurately depicting specific emotions in
non-artists (see Figure 3 for a summary of prediction abstract drawings, at least when using color (see
results). Figure 3).

Behavioral results: Emotion predictions by Computational and behavioral error


humans correlations
The computational results tell us that the degree The results thus far have shown that computational
of uniformity of drawings within emotion categories algorithms and human participants can accurately
is lower for artists compared to non-artists (for color predict emotions from color and line drawings of
drawings), but they do not tell us whether artists are abstract artworks. We do not yet know, however,
worse at being understood by other human viewers. whether humans and computers use the same type of
Thus, we ran a behavioral experiment to determine information to make these predictions. To explore this
whether emotions were more predictable by human question, we should not compare the accuracy scores

Downloaded from jov.arvojournals.org on 03/23/2024


Journal of Vision (2023) 23(4):1, 1–16 Damiano et al. 9

Figure 4. Average confusion matrices extracted from the behavioral and computational emotion predictions. Each cell of the
confusion matrix shows the proportion of drawings with a certain emotion label (true labels along rows) that were predicted as that
or another emotion (predicted labels along columns). The diagonal represents correct predictions, and the off-diagonal represents
errors. The gray level of a cell corresponds to the value within the cell, from white (0 = that emotion was never predicted) to black (1
= that emotion was always predicted). The correlation values shown beside the arrows represent the correlations between
off-diagonal elements (i.e., non-red cells) of behavioral and computational predictions.

but instead should compare the mistakes made by During the prediction accuracy analysis, we also
humans and our computational models. If the error collected any mistakes in categorization made by the
patterns between humans and the computer are similar, computational model and by the human participants
then we can assume that people use features similar and placed them in confusion matrices. In these
to those of the computational model to make their matrices, the diagonal elements represented accurate
emotion predictions, which is why they would make predictions (i.e., the correct answer was “anger” and
mistakes similar to those of the computer (Walther & the prediction was “anger”), and the off-diagonals
Shen, 2014). represented the confusions (i.e., the correct answer was

Downloaded from jov.arvojournals.org on 03/23/2024


Journal of Vision (2023) 23(4):1, 1–16 Damiano et al. 10

“joy” but the prediction was “wonder”). Then, for the p < 0.01; non-artists’ drawings: r = 0.47, p < 0.01). This
error correlation analysis, we averaged the confusion suggests that the people were comparing the contour
matrices across participants and computed the Pearson statistics of the drawing to an average set of statistics
correlation coefficient for correlating the off-diagonal that they associate with each emotion (e.g., anger might
elements of the confusion matrix for two types of be short and spiky, joy long and smooth), similarly
predictions (i.e., the computational predictions and to how the computational algorithm compares the
human predictions). contour statistics of one drawing to the set of reference
See Figure 4 for average confusion matrices and a histograms.
summary of the error pattern correlations. Beginning
with the color drawings, we found that the error
patterns between humans and computers were highly Visual feature descriptions across emotions and
similar for both artists’ drawings (r = 0.74, p < 0.001) artistic training
and non-artists’ drawings (r = 0.62, p < 0.001).
Conversely, for the line drawings, the error patterns of It is clear from the computational and behavioral
the computational predictions were not significantly predictions that there are similarities in color and line
similar to those of humans (artists’ drawings: r = usage across individuals within an emotion category,
0.31, p = 0.1; non-artists’ drawings: r = –0.07, p = as well as differences across emotion categories. These
0.7). Recall that the computational predictions were similarities and differences are explored in more detail
made by comparing each drawing to a set of average in the following sections. Specifically, we explore the
reference drawings using pixel-wise correlation. Thus, overall density (i.e., non-white pixels) of the drawings
the above results mean that, for the color drawings, and the number of colors and lines used and then
humans are also performing a general color comparison identify the exact colors and types of contour features
between the current drawing and a set of (internal) used to depict the different emotions.
references of known color–emotion associations and
that these known associations must somewhat match
those created by averaging all drawings within each Color drawings
emotion category. This approach did not work for Beginning with the density measure, a two-way
the line drawings, however, as the average reference ANOVA with emotion (anger, disgust, fear, sadness, joy,
maps essentially became a jumble of lines and thus or wonder) and artistic training (artists vs. non-artists)
likely measured overall pixel density rather than any as factors revealed only a main effect of emotion, F(5,
contour features. This was still somewhat effective, 474) = 2.46, p < 0.05, η2 = 0.03, but not for artistic
given that the computational predictions for the line training, F(1, 474) = 0.69, p = 0.41, η2 = 0.001. Post
drawings were above chance, but this is clearly not hoc tests revealed that the emotion anger is more
the (only) information people are using to make densely drawn than wonder (proportion of colored
their predictions, as shown by the low error–pattern pixels: anger = 0.51 vs. wonder = 0.39; p < 0.05). All of
correlations. the other emotions fell in between these two but were
Instead, when predicting emotions from line not statistically different from each other (disgust =
drawings using the histograms of contour features, 0.47; fear = 0.43; sadness = 0.50; joy = 0.43).
we found that the human–computer correlations In terms of the average number of unique colors per
were significantly similar (artists’ drawings: r = 0.47, image, the two-way ANOVA revealed a main effect of

Figure 5. Average color usage per drawing, averaged over all drawings within an emotion category, separately for artists’ and
non-artists’ drawings. See Table 1 for the percentages of each color per emotion.

Downloaded from jov.arvojournals.org on 03/23/2024


Journal of Vision (2023) 23(4):1, 1–16 Damiano et al. 11

Emotion Examining the types of colors used in each image


across emotion types revealed that certain colors are
Color Anger Disgust Fear Sadness Joy Wonder indeed related to specific emotions. Generally, red was
used to convey anger, greens and browns to convey
Artists’ drawings disgust, black and gray to convey fear, dark blue for
Black 17.9 5.8 28.8 23.2 0.6 4.2 sadness, and yellow and pink for joy and wonder
Gray 3.2 8.8 20.1 26.2 0.4 3.4 (Figure 5; Table 1). These overall patterns do not seem
Dark brown 2.1 14.2 3.0 0.0 0.0 0.2 to differ drastically between artists and non-artists,
Light brown 3.0 4.4 1.9 0.0 5.4 3.6 although on an individual basis some artists used
Beige 0.0 2.0 0.0 0.0 1.1 2.6 unconventional colors to represent emotions in their
Pink 5.4 2.9 2.0 0.0 19.6 19.2 drawings (e.g., using pink rather than green to represent
Violet 0.0 1.2 3.3 3.5 0.5 1.3 disgust, green rather than black to represent fear).
Dark blue 0.9 2.8 15.7 30.8 2.2 12.7 This atypical color usage was sometimes found in the
Blue 0.2 0.8 9.7 10.4 3.8 7.3 non-artists’ drawings, as well, but not as often as in the
Cyan 0.0 0.0 5.6 4.5 15.9 5.5 artists’ drawings.
Green 0.0 7.2 1.6 0.0 0.6 2.0
Light green 0.0 13.2 1.9 1.4 2.9 4.5 Line drawings
Yellow 0.5 13.8 0.0 0.0 25.5 18.9
Dark yellow 1.1 15.3 0.0 0.0 7.0 3.2 As with the color drawings, the two-way ANOVA
Orange 8.1 2.2 4.0 0.0 12.1 5.7 on the density of the line drawings revealed only a
Red 57.6 5.4 2.4 0.0 2.4 5.7 main effect of emotion, F(5, 474) = 7.99, p < 0.001,
Non-artists’ drawings η2 = 0.08, but not with artistic training, F(1, 474) =
3.06, p = 0.08, η2 = 0.006. Anger was more densely
Black 15.8 12.0 29.4 19.3 0.0 1.4 drawn than all other emotions (proportion of colored
Gray 3.9 5.3 33.0 26.5 1.6 4.5 pixels: anger = 0.22, disgust = 0.16, fear = 0.14,
Dark brown 3.9 18.7 0.5 2.1 1.5 3.9 sadness = 0.14, joy = 0.10, wonder = 0.12; all p <
Light brown 3.7 4.2 0.3 0.6 7.8 4.0 0.05). In terms of average number of lines per image,
Beige 0.0 8.7 1.5 0.2 5.2 6.1 the two-way ANOVA also revealed only a main effect
Pink 10.0 1.3 1.6 0.2 13.7 13.6 of emotion, F(5, 474) = 2.57, p < 0.05, η2 = 0.03, but
Violet 0.0 0.0 4.4 2.2 0.4 0.7 not artistic training, F(1, 474) = 1.45, p = 0.23, η2 =
Dark blue 0.3 0.8 10.6 28.0 1.5 6.5 0.003. Post hoc comparisons across emotions failed
Blue 0.3 0.3 4.7 11.4 2.3 4.1 to reveal significant differences, but the overall pattern
Cyan 0.3 0.2 4.5 8.9 7.7 9.6 is that the drawings conveying negative emotions
Green 0.3 7.8 0.0 0.0 0.6 2.0 contained the greatest number of contours and the
Light green 1.5 18.5 0.6 0.0 4.4 5.0 drawings conveying positive emotions contained the
Yellow 4.7 9.2 4.9 0.0 41.5 25.2 fewest (number of contours: anger = 378.12; disgust =
Dark yellow 0.6 6.7 1.1 0.0 1.8 1.2 334.77; fear = 346.49; sadness = 377.61; joy = 141.79;
Orange 5.7 3.0 0.8 0.3 5.7 6.5 wonder = 234.72).
Red 49.0 3.3 2.1 0.3 4.3 5.7 Figure 6 shows the histograms of contour feature
distributions across emotion categories, separately
Table 1. Average color usage per drawing (in percent of
for artists’ and non-artists’ drawings. With these
non-white pixels), averaged over all drawings within an emotion
histograms, we see that, once again, the general pattern
category separately for artists’ and non-artists’ drawings.
of contour feature usage between the artists and
non-artists did not differ much. Within each feature,
there are subtle differences across emotions. These
differences are likely what people were picking up
emotion, F(5, 474) = 10.66, p < 0.001, η2 = 0.10, and on to be able to successfully infer emotions from the
a main effect of artistic expertise, F(1, 474) = 31.42, line drawings. Beginning with the angularity measure,
p < 0.001, η2 = 0.06. Anger, fear, and sadness were we see that the negative emotions have pixels in the
represented with fewer colors per drawing on average highest angularity bins, meaning that the images
(2.53, 2.49, and 2.39, respectively) than disgust and representing those emotion categories contained
wonder (3.39, and 3.53, respectively; all p < 0.001). some angular (i.e., sharp) contours, but the positive
Sadness also contained significantly fewer colors than emotions do not. For the length feature, we see a skew
joy (3.02; p < 0.05). Additionally, artists tended to use toward the shorter lines for the negative emotions
fewer colors per drawings (2.55) than non-artists (3.24; and a skew toward medium to long lines for the
p < 0.001), suggesting that artists are more minimalistic positive emotions. For the orientation feature, drawings
in their color usage. representing sadness contained the most vertical lines,

Downloaded from jov.arvojournals.org on 03/23/2024


Journal of Vision (2023) 23(4):1, 1–16 Damiano et al. 12

Figure 6. Average distributions of contour features, separately for artists’ and non-artists’ drawings, for each of the six emotion
categories.

and the other emotions contained lines of various Anger is red, sadness is blue: Feature
orientations. differences across basic emotions
Taking the color and line drawing results together,
Discussion we found that the negative emotions were more densely
drawn (especially anger) with a tendency to be drawn
This study was an exploration of how certain visual in darker colors such as red, blue, brown, black, and
features, such as color and contour features, are able to gray. The positive emotions tended to be less dense
convey specific emotions through abstract visual art and and contain brighter colors. These findings are very
whether the use of these features differs between trained much in line with a study by van Paasschen, Zamboni,
artists and non-artists. To summarize, we found that Bacci, and Melcher (2014), who asked participants to
there are indeed specific color and contour features that rate a large set of abstract artworks on valence and
are used to convey different basic emotions (e.g., anger arousal and found that people consistently rated dark
is generally red and more densely drawn than other and complex pieces as negative and artworks with
emotions, whereas sadness is conveyed by blue shades bright colors and clear lines as positive. We replicated
and a higher proportion of vertical lines), allowing these findings and extended the positive versus negative
for accurate predictions of emotions from both color distinction to include color–emotion associations for
drawings and line drawings. Colors, however, seem to more specific basic emotions.
more easily convey emotions compared with contour Beginning with the color drawings, we found that
features. Additionally, although small, we did find there are clear differences in color usage across different
differences in how the trained artists versus non-artists emotions. These findings were expected based on
depicted emotions—namely, artists generally used previous work that prompted participants with a color
fewer but more unique colors (as implied by a lower label and asked them to identify all emotion labels
computational prediction accuracy) compared with that they associated with that color (Jonauskaite et
non-artists across all emotions. al., 2020). In such studies, red is typically associated

Downloaded from jov.arvojournals.org on 03/23/2024


Journal of Vision (2023) 23(4):1, 1–16 Damiano et al. 13

with anger, yellow with joy, brown with disgust, etc. human-level accuracy, but the error patterns were now
We found very similar results in the current study, significantly correlated with human error patterns. This
with almost all color–emotion associations replicating tells us that people are indeed relying on comparing
those of Jonauskaite et al. (2020), except for disgust, the contour features present in each line drawing to an
which included an additional association with green internal template of the types of visual features that
in our study. These strong color–emotion associations should be related to each emotion (e.g., vertical lines
make emotions easily predictable from color drawings, representing sadness).
both computationally and by human observers, as In fact, analyses of the contours in each line drawing
both people and computers pick up on the similarities revealed clear orientation and length differences that
within an emotion category (e.g., anger is typically distinguish among the basic emotion categories. We
depicted using red) and differences across categories found that vertical lines were mostly used to represent
(e.g., emotions other than anger are not typically sadness, longer lines to represent joy and wonder, and
depicted using red). This is revealed through the angular lines to represent negative emotions. Also, the
strong error–pattern correlations between humans and sheer number of lines helped to distinguish between
machines. This result implies that people use the same anger and other emotions (i.e., the anger drawings
types of features that our computational algorithm contained the highest number of lines and were the
uses to predict emotions from color drawings—simple most densely drawn). These results indicate that our
color comparisons. In other words, when trying to computational line drawing analysis using the MLV
infer an emotion from the color drawings, people Toolbox is an efficient way to extract and explore
presumably compare each drawing to an internal contour feature distributions in line drawings. These
template of what color they believe each emotion findings nicely replicate previous non-computational
should be and then guess the emotion based on observations (Gayen, 2021; Takahashi, 1995).
which internal template best matches the drawing in If we pit color and contour features against each
question. Of note, however, is that the computational other, we find that emotions in abstract art are
predictions on the color drawings are in fact better more easily represented by colors than by contour
(i.e., numerically higher accuracy) than the predictions features. One potential reason may be that color
made by humans, implying that people may use other drawings contain extra information, as they may
information (perhaps shape/form) that could interfere contain shape information in addition to color.
with the color information. In terms of understanding However, as mentioned above, in this study this extra
emotions through color, relying solely on color information may have actually hindered people’s ability
comparisons and ignoring other cues would seem to be to predict emotions from color drawings, and relying
most useful. solely on color would result in a higher prediction
We must note, however, that we could not ensure accuracy.
that the colors were correctly displayed on each A more likely reason emotions are easier to guess
participants’ computer in the behavioral task, given from color drawings compared to line drawings is
that the online participants used different devices and that the associations between colors and emotions
lived in different settings. Therefore, it is also possible must be stronger or more well known than the
that the human emotion predictions were numerically associations between contour features and emotions.
lower than the computational predictions simply Whether these associations are innate or culturally
due to participants not perceiving the colors as they learned is an interesting and important question that
were drawn. It would be useful to rule this possibility unfortunately cannot be addressed in the current
out in future studies by testing participants on the study. However, the simulation theory (Johnson-Laird
same device or calibrating each monitor to ensure & Oatley, 2021) states that mimesis (i.e., imitation)
that the colors are being displayed consistently across plays a role in our emotion associations, meaning
participants. that our abstract feature–emotion associations reflect
When color is absent (e.g., with line drawings), real-world feature–emotion associations, such as one’s
differences in monitor display settings are less face turning red when angry. Associations between
problematic. Instead of hue, one must now rely line features and emotions seem to not be as clear
on shape or contour cues to correctly predict the mimetically as those between colors and emotions.
displayed emotion. In the case of line drawings, our Instead, contour–emotion associations seem to rely
computational model (which uses the correlation more on the entropy of the image, with many jagged or
approach to make predictions) did not reach a high unpredictable lines simulating negative events such as
prediction accuracy, and the error patterns were not a broken mirror. Dissociating among several negative
very similar between the human and computational emotions seems to be more difficult with contours
predictions. On the other hand, when we instead than with colors, potentially explaining why emotion
predicted emotions computationally from the set of predictions were higher on color drawings than line
feature histograms, the accuracy was still lower than drawings.

Downloaded from jov.arvojournals.org on 03/23/2024


Journal of Vision (2023) 23(4):1, 1–16 Damiano et al. 14

Artists are seemingly worse than non-artists at and perhaps having a better knowledge or intuition of
depicting basic emotions these associations, may have outperformed non-artists
in their ability to depict the desired emotions.
Finally, the current study also taught us something One final possibility for why emotions were more
about the impact of artistic expertise on one’s ability difficult to predict from the artists’ drawings compared
to convey emotions through abstract art. The results to the non-artists’ drawings could be that the artists in
of our computational predictions and subsequent our sample were still students. Artists who have been
behavioral experiment suggest that differences between making art for several decades could develop better or
artists’ and non-artists’ drawings may have had a direct different ways to convey emotions that may or may
impact on the ability to infer the depicted emotion from not involve characteristic colors or shapes. Perhaps the
the artworks. It was more difficult for the new group of artists in our study were only just beginning to develop
naïve viewers to understand the depicted emotion when this skill and thus displayed more individuality, but
viewing color drawings created by artists compared they were not yet able to convey a desired emotion in a
with those created by non-artists. This was seemingly specialized way. Follow-up studies could recruit artists
due to artists being more minimalistic in their color at different stages of their careers to determine whether
usage and sometimes using unconventional colors to their unique styles eventually develop into superior
depict certain emotions. emotion transmission or whether the uniqueness
It is important to acknowledge that the drawing task remains a detriment to the depictions of basic emotion
we gave to the artists and non-artists was to only depict categories.
one basic emotion at a time. Although they were free to
be as creative as they wanted, within the confines of
the drawing space, it is possible that the artists did not
find this task stimulating enough. In general, artists Conclusions
mention items such individualism, divergent thinking,
and intrinsic motivation as being among the most Through the manipulation of color and form, visual
important factors in creating their art (Botella et al., abstract art is able to carry emotional information.
2013). Therefore, the artists’ drawings in our study Here, we explored specifically how colors and lines
were more likely unique due to each artist’s individual were used to express basic emotions. Our findings
style and self-expression, resulting in drawings that lend support to the simulation theory, as they showed
were more difficult to understand than the non-artists’ that certain visual features are related to specific
drawings. Perhaps artists’ works would indeed be more emotions based on real-world associations that can
easily understood than those of non-artists if they be “simulated” through abstract features and used by
were conveying more complex emotions of their own human observers to understand the intended emotional
choosing through their artworks. Of course, it is also a connotation of abstract artworks. These findings could
possibility that artists strive to explore the frontiers of potentially be leveraged by product or app designers,
visual communication and to challenge their viewers as well as artists, to better convey certain information
and therefore are not aiming to be understood in a to a user or viewer. Future research should expand
conventional sense. Future work could explore these on basic experiments, such as ours, using a similar
possibilities by prompting artists and non-artists with approach of emotion understanding based on contour
more complex emotion labels or allowing them to create and color features in real abstract (e.g., geometric,
artworks without prompts and asking them after the expressionist) artwork. Including artworks with more
fact which emotions they were attempting to convey, complex feature–emotion associations will lead to a
and then later testing the audience’s understanding of better understanding of the multifaceted links among
the artworks. Additionally, only psychology students visual perception, art production and appreciation, and
participated in the behavioral task. Research has shown emotional appraisals.
that artists rate abstract art as less confusing compared
with non-artists (Silvia, 2013). Perhaps a group of Keywords: art, drawing, emotions, image features,
expert participants would be better able to predict perception
emotions from their fellow artists’ drawings, which
may have been more confusing for our non-expert
participants.
Note also that we did not tell the artists and Acknowledgments
non-artists, before they drew, that another group of
people would be trying to guess the emotions from their Supported by the Shastri Indo-Canadian Institute
drawings. If we had done so, both groups may have tried Research Fellowship 2017-18 (to P.G.), a Natural
to use more obvious color–emotion associations, and Sciences and Engineering Research Council of Canada
artists, being more minimalistic in their feature usage Discovery Grant (RGPIN-2020-04097 to D.B.W),

Downloaded from jov.arvojournals.org on 03/23/2024


Journal of Vision (2023) 23(4):1, 1–16 Damiano et al. 15

and by long-term structural grants from the Flemish and global symmetry in pleasure, interest,
Government (METH/14/02 and METH/21/02 to J.W.). and complexity judgments of natural scenes
[published online ahead of print June 24, 2021].
Commercial relationships: none. Psychology of Aesthetics, Creativity, and the Arts,
Corresponding author: Claudia Damiano. https://doi.org/10.1037/aca0000398.
Email: claudia.damiano@kuleuven.be. de Leeuw, J. R. (2015). jsPsych: A JavaScript library for
Address: Department of Brain and Cognition, KU creating behavioral experiments in a web browser.
Leuven, Leuven, Belgium. Behavior Research Methods, 47(1), 1–12.
Ekman, P., Sorenson, E. R., & Friesen, W. V. (1969).
Pan-cultural elements in facial displays of emotion.
References Science, 164(3875), 86–88.
Fingerhut, J., & Prinz, J. J. (2018). Wonder, appreciation,
Aubert, M., Brumm, A., Ramli, M., Sutikna, T., and the value of art. Progress in Brain Research,
Saptomo, E. W., Hakim, B., . . . Dosseto, A. (2014). 237, 107–128.
Pleistocene cave art from Sulawesi, Indonesia.
Fontaine, J. R., Scherer, K. R., Roesch, E. B., &
Nature, 514(7521), 223–227.
Ellsworth, P. C. (2007). The world of emotions is
Aubert, M., Setiawan, P., Oktaviana, A. A., Brumm, not two-dimensional. Psychological Science, 18(12),
A., Sulistyarto, P. H., Saptomo, E. W., . . . Brand, 1050–1057.
H. E. A. (2018). Palaeolithic cave art in Borneo.
Friedenberg, J., Lauria, G., Hennig, K., &
Nature, 564(7735), 254–257.
Gardner, I. (2022). Beauty and the sharp fangs
Bar, M., & Neta, M. (2006). Humans prefer curved of the beast: degree of angularity predicts
visual objects. Psychological Science, 17(8), perceived preference and threat [preprint],
645–648. https://doi.org/10.13140/RG.2.2.35163.03366.
Barrett, L. F., Mesquita, B., Ochsner, K. N., & Gross, Gayen, P. (2021). Understanding the language of abstract
J. J. (2007). The experience of emotion. Annual paintings: An exploration of representation and
Review of Psychology, 58, 373. communication of emotions through lines and colors
Botella, M., Glaveanu, V., Zenasni, F., Storme, M., (Doctoral dissertation). Kharagpur, India: Indian
Myszkowski, N., & Wolff, M. et al. (2013). How Institute of Technology.
artists create: Creative process and multivariate Johnson-Laird, P. N., & Oatley, K. (2021). Emotions,
factors. Learning and Individual Differences, 26, simulation, and abstract art. Art & Perception, 9(3),
161–170. 260–292.
Brumm, A., Oktaviana, A. A., Burhan, B., Hakim, B., Jonauskaite, D., Parraga, C. A., Quiblier, M., & Mohr,
Lebe, R., Zhao, J. X., . . . Aubert, M. (2021). Oldest C. (2020). Feeling blue or seeing red? Similar
cave art found in Sulawesi. Science Advances, 7(3), patterns of emotion associations with colour
eabd4648. patches and colour terms. i-Perception, 11(1),
Calabrese, L., & Marucci, F. S. (2006). The influence 2041669520902484.
of expertise level on the visuo-spatial ability: Keltner, D., Sauter, D., Tracy, J., & Cowen, A. (2019).
Differences between experts and novices in imagery Emotional expression: Advances in basic emotion
and drawing abilities. Cognitive Processing, 7(1), theory. Journal of Nonverbal Behavior, 43(2),
118–120. 133–160.
Chamberlain, R., Drake, J. E., Kozbelt, A., Hickman, Larson, C. L., Aronoff, J., & Stearns, J. J. (2007). The
R., Siev, J., & Wagemans, J. (2019). Artists as shape of threat: Simple geometric forms evoke
experts in visual cognition: An update. Psychology rapid and sustained capture of attention. Emotion,
of Aesthetics, Creativity, and the Arts, 13(1), 58. 7(3), 526.
Chamberlain, R., & Wagemans, J. (2015). Visual arts LeDoux, J. (1998). The emotional brain: The mysterious
training is linked to flexible attention to local and underpinnings of emotional life. New York: Simon &
global levels of visual stimuli. Acta Psychologica, Schuster.
161, 185–197.
Mohr, C., Jonauskaite, D., Dan-Glauser, E. S.,
Damiano, C., Walther, D. B., & Cunningham, W. A. Uusküla, M., & Dael, N. (2018). Unifying research
(2021). Contour features predict valence and threat on colour and emotion. In L. W. MacDonald,
judgements in scenes. Scientific Reports, 11(1), C. P. Biggam, & G. V. Paramel (Eds.), Progress
19405. in colour studies: Cognition, language and beyond
Damiano, C., Wilder, J., Zhou, E. Y., Walther, D. (pp. 209–222). Amsterdam: John Benjamins
B., & Wagemans, J. (2021). The role of local Publishing Company.

Downloaded from jov.arvojournals.org on 03/23/2024


Journal of Vision (2023) 23(4):1, 1–16 Damiano et al. 16

Moors, A., Ellsworth, P. C., Scherer, K. R., & Frijda, Stamatopoulou, D., & Cupchik, G. C. (2017). The
N. H. (2013). Appraisal theories of emotion: State feeling of the form: Style as dynamic ‘textured’
of the art and future development. Emotion Review, expression. Art & Perception, 5(3), 262–298.
5(2), 119–124. Takahashi, S. (1995). Aesthetic properties of pictorial
Pecchinenda, A., Bertamini, M., Makin, A. D. J., perception. Psychological Review, 102(4), 671.
& Ruta, N. (2014). The pleasantness of visual Valladas, H., Clottes, J., Geneste, J. M., Garcia, M. A.,
symmetry: Always, never or sometimes. PLoS One, Arnold, M., & Cachier, H. et al. (2001). Evolution
9(3), e92685. of prehistoric cave art. Nature, 413(6855), 479.
Pouliou, D., Bonoti, F., & Nikonanou, N. (2018). Do Van Paasschen, J., Zamboni, E., Bacci, F., & Melcher,
preschoolers recognize the emotional expressiveness D. (2014). Consistent emotions elicited by low-level
of colors in realistic and abstract art paintings? The visual features in abstract art. Art & Perception,
Journal of Genetic Psychology, 179(2), 53–61. 2(1-2), 99–118.
Rezanejad, M., Downs, G., Wilder, J., Walther, D. Walther, D. B., & Shen, D. (2014). Nonaccidental
B., Jepson, A., & Dickinson, S. et al. (2019). properties underlie human categorization of
Scene categorization from contours: Medial axis complex natural scenes. Psychological Science,
based salience measures. In Proceedings of the 25(4), 851–860.
IEEE/CVF Conference on Computer Vision and
Walther, D. B., Chai, B., Caddigan, E., Beck, D. M.,
Pattern Recognition (pp. 4116–4124). Piscataway,
& Fei-Fei, L. (2011). Simple line drawings suffice
NJ: Institute of Electrical and Electronics
for functional MRI decoding of natural scene
Engineers.
categories. Proceedings of the National Academy of
Rezanejad, M., & Siddiqi, K. (2013). Flux graphs for Sciences, USA, 108(23), 9661–9666.
2D shape analysis. In S. J. Dickinson, & Z. Pizlo
Walther, D. B., Farzanfar, D., Han, S., & Rezanejad, M.
(Eds.), Shape perception in human and computer
(2023). The mid-level vision toolbox for computing
vision (pp. 41–54). London: Springer.
structural properties of real-world images. Frontiers
Silvia, P. J. (2013). Interested experts, confused in Psychology, 14, 1322.
novices: Art expertise and the knowledge emotions.
Empirical Studies of the Arts, 31(1), 107–115.

Downloaded from jov.arvojournals.org on 03/23/2024

You might also like