Download as pdf or txt
Download as pdf or txt
You are on page 1of 9

Australian Journal of Psychology 2012

doi:10.1111/j.1742-9536.2011.00048.x

Effects of immediacy of feedback on estimations and performance

Pablo Fajfar,1 Guillermo Campitelli,3 and Martin Labollita2


1
Facultad de Ciencias Empresariales, Universidad Abierta Interamericana and 2Facultad de Ciencias Economicas,
Universidad de Buenos Aires, Buenos Aires, Argentina, and 3School of Psychology and Social Science, Edith Cowan
University, Perth, Western Australia, Australia

Abstract

We investigated the role of anticipation of feedback in performance and estimation about own performance. We submitted 155
participants to a test of verbal aptitude, and we requested them to give estimations of their own performance and the performance
of other participants. There were two treatments: immediate feedback and delayed feedback. Participants in the immediate-feedback
group were informed that they would receive feedback on their performance immediately after finishing the test, whereas
participants in the delayed-feedback group were informed that they would receive feedback a week after taking the test. The
immediate-feedback group performed better than the delayed-feedback group. Furthermore, the former underestimated their own
performance. On the other hand, participants on the delayed-feedback group made unbiased estimations. We present a mathematical
model based on construal-level theory, decision affect theory, temporal discounting, and Moore and Healy’s model of overestimation.
The model suggests that the source of differences in performance and in estimations of own performance is a construal of the feedback
situation that modifies the expected utility of the task.
ajpy_48 1..9

Key words: decision affect theory, immediate feedback, judgement, overconfidence, performance, temporal discounting

People make predictions and estimations of events every Cole, & Klein, 2005; Shepperd, Ouellette, & Fernandez,
day. We predict how long errands will take in order to plan 1996).
how many of them we can do in a day. We estimate the Gilovich et al. (1993) showed that a group of students
freshness of a vegetable based on its colour. Of particular overestimated their own performance in an exam when
interest are the estimations and predictions about ourselves: their performance judgements were made in advance, and
How well did I do in a job interview? How successful will my that the overestimation significantly decreased when the
diet be? Will I be able to graduate? How successful would I performance judgements were made immediately before
be in the future? How well did I do in the midterm exam? the exam. Shepperd et al. (1996) showed that students
Research have found that we are overoptimistic on these overestimated their qualifications on a classroom exam a
types of judgement (e.g., Griffin & Tversky, 1992; Keren, month before taking the exam. However, they were more
1997; Lichtenstein, Fischhoff, & Phillips, 1982; Moore & accurate when they estimated their performance immedi-
Healy, 2008; Perloff, 1987; Weinstein, 1980; Yates, 1990). ately after taking the exam. Interestingly, they underesti-
Researchers have also found that estimations and predic- mated their performance when the estimation took place
tions about our own performance (henceforth, performance 3 days after taking the exam and seconds before receiving
judgements) depend, among other factors, on the temporal performance feedback. Shepperd et al. (2005) showed
distance between the performance judgement and the task that participant’s knowledge of when they would receive
(e.g., Gilovich, Kerr, & Medvec, 1993), or the temporal dis- feedback about a test affected performance judgements
tance between the performance judgement and the moment about that test. They asked participants to perform a verbal
in which feedback about performance (henceforth, perfor- reasoning analogies test. After taking this test, a group of
mance feedback) would be received (e.g., Shepperd, Grace, participants were told that they would receive immediate
feedback, and another group of participants were told that
they would receive feedback in 3 days. Participants in the
immediate-feedback group estimated their performance
Correspondence: Guillermo Campitelli, PhD, School of Psychology accurately, and participants in the delayed-feedback group
and Social Science, Edith Cowan University, Perth, WA 6027,
overestimated their performance. Moreover, there was a
Australia. Email: g.campitelli@ecu.edu.au
Received 11 May 2011. Accepted for publication 8 December negative significant correlation between anxiety and over-
2011. estimation (i.e., the more anxious the participants, the less
© 2012 The Australian Psychological Society they overestimated).
2 P. Fajfar et al.

These studies suggest that feedback plays an important (1996) results that participants who made their predictions
role on performance judgements. Feedback could also play in advance (15 days prior the presentation) were more opti-
an important role on performance itself. Indeed, research mistic than those who predicted their performance the day
onto the role of feedback on performance has been very before the presentation.
prolific, with several published meta-analyses (e.g., Kluger &
DeNisi, 1996) and reviews of meta-analyses (e.g., Hattie &
Timperley, 2007). A typical finding in this field of research is OVERVIEW OF THE PRESENT STUDY
that, in general, immediate performance feedback leads to
better learning than delayed performance feedback (e.g., The present study extends Shepperd et al.’s (1996, 2005)
Kulik & Kulik, 1988). There are diverse explanations for this research onto the influence of timing of feedback on per-
effect (e.g., feedback interventions lead to changes in locus formance judgements. The first aim of this study was to
of attention; Kluger & DeNisi, 1996), but they all have in replicate Shepperd et al.’s (1996, 2005) findings that the
common that they focus on how feedback interventions temporal distance between a task and feedback affects per-
about precedent trials affect performance in subsequent formance judgements. Sweeny, Carroll, and Shepperd
trials. However, it is possible that performance on a trial is (2006) proposed a number of explanations of those find-
not only influenced by the feedback received in previous ings, some of which are applicable to the present study.
trials, but also by the expectation or anticipation of the First, based on construal-level theory (CLT) (Trope &
participants regarding the feedback that they will receive Liberman, 2003), they proposed that people construe
after completing the present trial. That is, the expectation of distant events abstractly and that this construal focuses on
receiving immediate feedback may lead to a different effect what people would like to happen. On the other hand,
on performance than the expectation of receiving delayed near events are construed more concretely, and this con-
feedback. strual focuses on what is likely to happen. Second, when
These two lines of research investigate different aspects the feedback situation is immediate, people often experi-
about the timing of feedback: The first one is interested in ence an increase in anxiety and may judge their per-
the role of feedback on performance judgements, the second formance based on their current level of anxiety. Third, as
one in the role of feedback on performance. A simple change Shepperd and McNulty (2002) have shown, people feel
in the methodology used in research onto the role of feed- more disappointed when outcomes fall short of expecta-
back on performance judgements could investigate how tions than elated when outcomes exceed expectations.
anticipation of feedback could affect both performance and When feedback is immediate, people may try to avoid dis-
performance judgements. Instead of informing the parti- appointment by shifting expectations downwards. Fourth,
cipants about the timing of feedback after the task, this people may adopt the strategy of defensive pessimism
information could be given before the task. Thus, this (Norem & Cantor, 1986), which consists of feeling pessi-
information could potentially affect both performance in mistic about a future outcome in order to mobilise energy
the task and the subsequent performance judgement. Given to avoid an undesired outcome.
its important practical implications—for example, the fact Norem and Cantor (1986) suggested that adopting
that a very simple intervention may improve performance defensive pessimism sometimes leads to increase in moti-
could be applied in educational settings and to improve vation to work hard in order to avoid undesired outcomes.
performance in psychological experiments, among other If this is the case, the reduction of overconfidence observed
interventions—it is surprising that this has only been in conditions in which feedback is imminent might be
recently reported in a short article. Kettle and Häubl (2010)1 accompanied by an increase in performance. Since the
asked participants to make predictions about their future focus of previous studies has been performance judge-
performance in an oral presentation 15, 8, or 1 day before ments, the effect of anticipation of feedback on perfor-
the presentation. Before making their predictions, they were mance has not been measured until Kettle and Häubl’s
informed about the day they would receive performance (2010) study. This leads to the second goal of the present
feedback. This ranged from the same day of the presentation study. We investigated whether anticipating immediate
to 17 days after the presentation. Kettle and Häubl found a feedback leads to an increase in performance. The present
linear negative relationship between the delay of feedback study is similar to that of Kettle and Häubl: They both
and performance. Contrarily, they found a positive relation- investigated the role of anticipation of feedback in perfor-
ship between the delay of feedback and predicted per- mance judgements and in performance itself. The main
formance. That is, the participants who expected delayed difference between these studies is in the performance
feedback were more optimistic and worse performers than judgement measure. While Kettle and Häubl used predic-
those who expected immediate feedback. Moreover, this tions about future performance, we used estimations about
study replicated Gilovich et al. (1993) and Shepperd et al. previous performance.
© 2012 The Australian Psychological Society
Immediacy of feedback and estimations 3

METHOD how many correct items they had answered correctly.


Estimation (others) was measured as the estimation of the
Participants number of correct items that other participants of the experi-
ment responded correctly, on average. Difficulty was mea-
One hundred and fifty-five students (72 females) of Eco-
sured as the reported difficulty of the test on a scale from 1
nomics and Social Sciences from the Universidad of Buenos
to 10. Bias was calculated as the difference between estima-
Aires, Universidad Católica Argentina, and Universidad
tion on own performance and actual performance in each
Abierta Interamericana participated in the study. Students
participant. Positive bias values were considered overconfi-
were recruited by advertisements in web pages of these
dent estimations, 0 values were considered unbiased estima-
universities. The experimental sessions were carried out at a
tions, and negative values were considered under-confident
laboratory of the Facultad de Ciencias Economicas, Univer-
estimations. (Note that in other studies, overconfidence was
sidad de Buenos Aires.
called ‘optimism’, unbiased estimations were called ‘realis-
tic’, and underconfidence was called ‘pessimism’). Social
comparison was calculated as the difference between estima-
Material
tion of own performance and estimation of performance of
Participants were submitted to the BAIRES test of verbal others in each participant. Positive values indicate that the
aptitude (Cortada de Kohan, 2003). This test contains 34 participants believed that they performed better than the
multiple choice items with one correct option and three average of other participants, and negative values indicate
incorrect options per item. The first 17 items present a noun that the participants believed they performed worse than the
and four options of possible definitions. The 17 remaining average of other participants.
items present a noun and four options of possible synonyms.

RESULTS
Procedure
We present here the results in proportions for all the vari-
Participants were randomly allocated to two treatments:
ables, except for difficulty. However, when we fitted the
immediate feedback (79 participants; Mage = 22.2, SD = 4.28;
mathematical model to the data (see below), we used abso-
35 male) and delayed feedback (76 participants; Mage =
lute values. Performance in the verbal aptitude test was
24.81, SD = 4.9; 49 male). In both treatments, we requested
significantly higher in the immediate-feedback group
the participants to choose an option in each of the 34
(M = 0.66, SD = 0.11) than in the delayed-feedback group
BAIRES items and to indicate, after they finished the whole
(M = 0.61, SD = 0.13) (t (153) = 2.96, p = .003, Cohen’s
test, the number of items they believed they answered cor-
d = 0.48) (see Table 1 and Fig. 1). There were no significant
rectly, to estimate the number of correct answers that the
differences between treatments in the estimation of own
other participants of this study answered correctly, on
performance (immediate feedback, M = 0.57, SD = 0.12;
average, and to indicate how difficult the test was for them.
delayed feedback, M = 0.60, SD = 0.15; t (153) = 1.55,
For every correct item, participants were paid $1, without
p = .123, Cohen’s d = 0.26) and in the estimation of per-
discounting any monetary value for the incorrect items.
formance of other participants (immediate feedback,
Before starting the BAIRES test, we informed the partici-
M = 0.60, SD = 0.12; delayed feedback, M = 0.61, SD = 0.13;
pants of both groups that they would receive the money
t (153) = 0.21, p = .835, Cohen’s d = 0.03). (Note that in
they earned a week after the experiment was carried out. We
estimation of own performance, the assumption of equality
also informed the participants in the immediate-feedback
of variance was not met; however, a similar result was
group that they would receive feedback on the number of
obtained with the Welch t-test that does not assume equality
correct items immediately after finishing the test. On the
of variance). This result indicates that participants in the
other hand, participants in the delayed feedback treatment
immediate-feedback group performed better than those on
were informed that they would receive feedback on the
the delayed-feedback group, and they made similar estima-
number of correct items a week after the experiment.
tions on their performance; consequently, they underesti-
mated their own performance. This was corroborated with a
related-samples t-test comparing the actual performance and
Variables
the estimated performance in the immediate-feedback group
The dependent variables were performance, estimation (own), (t (78) = 7.27; p < .001, Cohen’s d = 0.83). The difference
estimation (others), difficulty, bias, and social comparison. Perfor- between actual and estimated performance was not signifi-
mance was measured as the number of correct items. Estima- cant in the delayed-feedback group (t (75) = 0.2; p = .84,
tion (own) was measured as the participant’s estimations on Cohen’s d = 0.02). This is also apparent in the values of bias.
© 2012 The Australian Psychological Society
4 P. Fajfar et al.

Table 1 Means, standard deviations, and comparisons between the immediate-feedback group and the delayed-feedback group
Immediate Delayed Comparison
feedback feedback immediate-delayed
Performance 0.66 (0.11) 0.61 (0.13) t (153) = 2.96; p = .003
Estimation (own) 0.57 (0.12) 0.60 (0.15) t (153) = 1.55; p = .123
Bias -0.09 (0.11) -0.00 (0.12) t (153) = 4.82; p < .001
Difficulty 6.30 (1.25) 6.05 (1.44) t (153) = 1.15; p = .250
Estimation (others) 0.60 (0.12) 0.61 (0.13) t (153) = 0.21; p = .835
Social comparison -0.04 (0.12) -0.01 (0.15) t (153) = 1.34; p = .183
Note. Means and standard deviations (in brackets) for the immediate and delayed-feedback treatments. The scale used in difficulty was 1–10; average
proportion of correct answers is reported in all the other variables.

Figure 1 Proportion of correct items as a


function of task. Performance is the actual
proportion of correct answers, Estimation
(own) and Estimation (others) is the pro-
portion of correct answers estimated by
participants on their own performance
and on the performance of others, respec-
tively. Error bars show standard errors.

The immediate-feedback group estimated, on average, that bility, we run correlational analyses between age and gender,
they answered correctly 9.1% items less than the actual and performance and estimation (own) in the whole sample.
percentage of correct items (M = -0.09, SD = 0.11), whereas None of these correlations was significant: performance-
the delayed-feedback group was, on average, unbiased gender (male 1 – female 0), r (153) = 0.13, p = .109;
(M = -0.00, SD = 0.12). The difference in bias values performance-age, r (153) = 0.14, p = .073; estimation (own)-
between treatments was significant (t (153) = 4.82, p < .001, gender, r (153) = 0.08, p = .328; estimation (own)-age,
Cohen’s d = 0.77). Therefore, the immediate-feedback group r (153) = 0.14, p = .078. Even if the correlations were signifi-
was, on average, underconfident, and the delayed-feedback cant, this would not affect our conclusions. In this sample,
group was, on average, unbiased. men and older people tended to perform better and to give
The number and percentage of overconfident, unbiased, higher estimations than women and younger people. As the
and underconfident participants in each group were 11 immediate-feedback group had more women and younger
(14%), 8 (10%), and 60 (76%), respectively, in the participants, the higher performance in this group could not
immediate-feedback group; and 35 (46%), 7 (9%), and 34 be explained by age or gender.
(45%), respectively, in the delayed-feedback group. As the There were no significant differences between groups in
average age of the immediate-feedback group was lower perceived difficulty (see Table 1). In the immediate-feedback
than that of the delayed-feedback group, and there were group, there was a worse-than-average effect (see Moore,
relatively more female in the former than in the latter, these 2007; Moore & Small, 2007 for an explanation of this
results may be accounted for by the variables age or gender, effect). That is, participants in this group estimated that their
and not by the treatments. In order to rule out this possi- performance was worse than the performance of other par-
© 2012 The Australian Psychological Society
Immediacy of feedback and estimations 5

ticipants (comparison estimation (own) vs estimation should find a reduction of overconfidence and an increase
(others) in the immediate-feedback group: t (78) = 2.59; in performance in the immediate-feedback condition. Our
p = .012, Cohen’s d = 0.30). The comparison between esti- results support this hypothesis.
mation of own performance and performance of others was Another interesting result of our study is the significant
not significant in the delayed-feedback group (t (75) = 0.33; worse-than-average effect (see Moore & Small, 2007 for an
p = .74, Cohen’s d = 0.04). On average, the social compari- explanation) in the immediate-feedback group. Participants
son in the immediate-feedback group was -0.04, whereas in this group estimated that their performance was worse
the social comparison in the delayed-feedback group was than that of the other participants. Moore (2007) presented
almost zero (-0.01). The number (and percentage) of par- a model in which estimation on our own performance
ticipants with positive, zero, and negative values in social and estimation of performance of others are related. He
comparison in each group were 23 (29%), 14 (18%), and 42 suggested that when overconfidence is observed, worse-
(53%), respectively, in the immediate-feedback group; than-average effect is expected, and when under-confidence
and 37 (49%), 5 (6%), and 34 (45%), respectively, in the is observed, better-than-average effect is expected. This is
delayed-feedback group. partly explained by Gigerenzer, Hoffrage, and Kleinbölting’s
Summing up, the participants in the immediate-feedback (1991) proposal that performance is a variable phenomenon
group performed better than those in the delayed-feedback that changes according to task characteristics, whereas esti-
group, they underestimated their own performance, and mation on own performance is less variable: It is not only
they believed that other participants performed better than influenced by current performance but also by previous
them. On the other hand, participants in the delayed- performance in similar tasks. This is what happened in our
feedback group were unbiased on their estimations, and study: There were no differences in estimations of own per-
they considered that the performance of others was similar formance between treatments even though there were dif-
to their own performance. ferences in actual performance. Moore suggested that, given
that we have less information for estimating performance of
others, our estimation of others’ performance is more regres-
DISCUSSION sive to the previous experience to similar tasks. That is, we
evaluate the performance of others based on our prior expe-
Two main results were found in this study. First, a group of rience with similar tasks, and our current performance does
participants who were informed that they would receive not affect this estimation. Our experimental manipulation
immediate performance feedback had a better performance had the opposite effect: We found underconfidence and
than a group of participants who were informed that they worse-than-average effect in the immediate-feedback group
would receive performance feedback a week after the task. that performed better than the delayed-feedback group. A
Second, the former underestimated its performance, whereas possible explanation of this result is that the anticipation of
the latter showed no bias in its performance judgement. The immediacy of feedback affects only the estimation of our
first result replicates a novel finding. Kettle and Häubl (2010) own performance because we are not expected to know how
informed students that (and when) they would receive feed- other people perform, but we are expected to know how we
back in an oral presentation before the presentation. The perform. Another possible explanation of differences with
temporal distance between the presentation and feedback Moore’s study is methodological: We asked participants to
varied from 0 to 17 days. They found that the student’s estimate the average performance of other participants of
performance in the oral presentation was negatively related the experiments, and Moore asked his participants to
to the temporal distance between the presentation and feed- estimate the performance of a random participant.
back. This result is also in accordance with the finding that, in We now propose an explanation of present results based
the majority of cases, immediate feedback leads to better on four approaches: CLT (Trope & Liberman, 2003), decision
learning than delayed feedback (e.g., Kulik & Kulik, 1988). affect theory (Mellers, Schwartz, Ho, & Ritov, 1997; Mellers,
The second result accords with previous studies on the Schwartz, & Ritov, 1999), temporal discounting (e.g., Berns,
role of anticipation of feedback in performance judgements Laibson, & Loewenstein, 2007), and Moore and Healy’s
(i.e., Shepperd et al., 1996, 2005). We presented earlier a (2008) model of overestimation. We also present a simple
number of factors that Sweeny et al. (2006) indicated as mathematical model that integrates the results. Note,
candidates to explain this effect. One of these factors, defen- however, that this model was developed after knowing the
sive pessimism (Norem & Cantor, 1986), suggests that as results, hence our conclusions should be considered with
feedback draws near, people tend to adopt pessimism about caution. The purpose of developing this model was to
their performance. One of the possible effects of this strategy formalise our account of the results and to guide future
is that people mobilise energy to work hard and avoid nega- research onto the nature and boundary conditions of the
tive feedback. We hypothesised that, if this is the case, we novel finding reported here.
© 2012 The Australian Psychological Society
6 P. Fajfar et al.

Anticipation of affect and temporal discounting: given the random allocation of the participants to the
An explanation and a mathematical model groups, differences in prior beliefs are unlikely.
The second part of the equation differentiate between
Like Sweeny et al. (2006), we suggest that the effects of
groups because the rate of temporal discount of feedback
anticipation of feedback are partly explained by a difference
differs between groups (i.e., 0 < gd < 1 in the delayed-
in the construal of the feedback situation. CLT (Trope &
feedback group, and gi = 1 in the immediate-feedback
Liberman, 2003) proposes that people construe concrete and
group). This discount rate modifies the utility of feedback
contextualised models of near-future events, and abstract
function (f(l)) by making it less extreme in the delayed-
and decontextualised models of distant-future events. In the
feedback group. This function is related to the expected
present study, participants on the immediate-feedback group
performance because in the present study, expecting to
may have construed a more concrete representation of the
obtain a certain score implies expecting to receive a certain
feedback situation than that of the delayed-feedback group.
feedback. We define the utility of feedback function as
This difference in representation of the feedback situation
follows:
may have led to a difference in the subjective expected
benefit of carrying out the task. We refer to this as the if Li ≥ 0
⎪⎧ Li ,
kp

expected utility of the task (EUT). In order to formalise the f (l ) = ⎨ kn


(2)
⎪⎩− Li , if Li < 0,
difference in representation, we use the concept of temporal
discounting. This concept refers to the fact that the utility of where 1 < kp < kn are free parameters. This formula indi-
events (e.g., receiving money) varies as a function of time. cates that expecting to perform above the global average (S)
For example, receiving $10 now is considered to have more (i.e., Li > 0) increases utility, and expecting to perform below
utility than receiving the same amount a week later. Equally, the global average (i.e., Li < 0) decreases utility. Moreover, it
losing $10 is considered to have a more negative utility than is assumed that kn > kp, thus the increase in utility due to
that of losing $10 a week later. In our study, the temporal expecting to perform a unit higher than average is lower
discount of the monetary reward should not have differed than the decrease in utility due to expecting to perform a
between groups because all the participants were informed unit lower than average. This assumption is based on the
that they would receive the monetary reward a week after decision affect theory and is in line with prospect theory
the experiment. We propose that the difference in represen- (Tversky & Kahneman, 1979), which proposes that people
tation between groups arose from the representation of the take more risks to avoid losses than risks to obtain gains (i.e.,
feedback situation. Given that the performance feedback loss aversion). Therefore, the EUT will be higher for partici-
was expected to be received at different times in each group, pants who expect to perform above average than for the
the expected benefit or displeasure of the feedback situation participants who expect to perform below average. Given
differed between groups. We formalise these hypotheses that the delayed-feedback group temporally discounts the
as follows: utility of feedback, their EUT is lower than that of the
immediate-feedback group for participants who expect to
EUT = X × δ + f ( l ) × γ , (1)
perform above average, and higher for participants who
where the EUT equals the sum of the product of the expect to perform below average.
expected score (X) and the discount rate of the monetary Given that the EUT is more extreme in the immediate-
reward (d), and the product of the utility of feedback func- feedback group, the participants in this group had more
tion (f(l)) and the temporal discount rate of feedback (g) motivation to perform above average and to avoid perform-
which, unlike d, varies between groups. This formula con- ing below average than those in the delayed-feedback group.
tains aspects of temporal discounting and aspects of Moore As suggested by Norem and Cantor (1986), this may have
and Healy’s (2008) model of overconfidence. These authors affected the energy mobilised to perform the task. We for-
proposed that just before performing a task, people form a malise this as
belief about the score they would obtain in this task. This
Ĝ = T × M (3)
belief is composed of the average global score and the varia-
tion of the individual’s scores from the global score (i.e., where the predicted performance in the task (Ĝ) in the
Xi = S + Li, where Xi represents the person i’s prior belief on delayed-feedback group equals the product of average per-
his/her performance in the task, S represents the average formance in similar tasks in the past (T) and the improve-
global score in the task, and Li represents the individual’s ment of performance due to motivation (M). M = 1 in the
belief on how much his/her score would deviate from the delayed-feedback group and M = 1/gd in the immediate-
global score). In the first part of equation 1, no differences feedback group. As 0 < gd < 1, this equation indicates that
between groups are expected because the temporal discount the immediate-feedback group performs higher than the
rate of the monetary reward is the same in both groups and, delayed-feedback group due to the increase in performance
© 2012 The Australian Psychological Society
Immediacy of feedback and estimations 7

caused by motivation, and that this is explained by the rate the feedback is lower than the performance judgement, there
of temporal discounting of feedback. would be disappointment (or decrease in utility). Equation 5
The change in the EUT produces another effect: The par- indicates that the anticipated disappointment given the inter-
ticipants in the immediate-feedback group take into account nal signal y is the summation of all the possible instances of
the anticipation of the feedback situation in their perfor- disappointment or elation that could occur if one uses y as a
mance judgements. This leads to an adjustment on their performance judgement. For example, using the internal
performance judgements to avoid the disappointment that signal y = 25 could lead to 24 instances of disappointment
could arise if they give a performance judgement that is (i.e., if the actual performance, and therefore the perfor-
higher than the performance feedback they would receive mance feedback, is between 0 and 24), one neutral instance
immediately. This is in line with Sweeny et al.’s (2006) pro- (if performance equals 25), and nine possible instances
posal that people shift their expectations downwards to elation (i.e., if the actual performance is between 26 and 34).
avoid disappointment, and with Norem and Cantor’s (1986) Put simply, giving high performance judgements has a higher
concept of defensive pessimism. We formalise this by probability of disappointment and a lower probability of
elation, and the reverse is true for low performance judge-
Jˆ = d ( y ) × α + Y × (1 − α ) , (4) ments. Equation 5 also indicates that this function varies
between groups because of the rate of temporal discounting
where the predicted performance judgement (Ĵ) equals the of feedback. Returning to equation 4, we hypothesised above
weighted sum of the anticipated disappointment (d(y)) and that the participants in the immediate-feedback group took
the belief about performance generated immediately after into consideration the feedback situation when they were
performing the task (Y), and a (0 2 a 2 1) is the relative making their performance judgements to a higher extent
weight given to the feedback situation. Y was proposed by than the delayed-feedback group. This means that a should
Moore and Healy (2008), and corresponds to an internal be higher in the immediate-feedback group.
signal or ‘gut feeling’ about our own performance that we Given that the purpose of developing the model was to
get after performing a task. For simplicity, we also follow formalise hypotheses rather than testing them, we only fit
their proposal that this signal is, on average, unbiased; the model to the data at the group level. We first solved
however, releasing this constraint does not change our con- equation 3. It was assumed that the average performance in
clusions. The interpretation of the anticipation of feedback similar tasks in the past for the whole sample (T) was the
(d(y)) is given with the following example. After performing same as the average actual performance in the delayed-
a task, a participant has the gut feeling (Y) that he/she feedback group in the present task, thus T = 20.58. As the
answered 25 questions correctly. Because he/she knows that participants were randomly allocated to groups, we assumed
this signal is not perfect, he/she would tend to adjust his/her that T was the same in both groups. Given that the
performance judgement to avoid the disappointment of immediate-feedback group received feedback immediately
receiving a feedback lower than the judgement. Thus, after the task, their temporal discount rate of feedback was 1.
instead of solely using his/her internal signal to make a We calculated gd by fitting the model to the average value
performance judgement, he/she also considers the possible of performance in each group. The obtained value was
disappointment (d(y)) that using his/her internal signal y gd = 0.916.
as a performance judgement could generate. This possible We then fitted equation 4 to the performance judgement
disappointment is represented as data at the group level using Microsoft Excel’s Solver. Before
doing this, we solved equations 5 and 6 without free para-
d ( y) = {[(Σq (h, y)) / N ] } γ ,
1/ kn
(5) meters by assuming, following Moore and Healy (2008),
that the internal signal about performance was accurate,
where N is the number of all the possible feedback (i.e., on average (i.e., internal signal in the immediate-feedback
N = 35) and group yi = 22.47, internal signal in the delayed-feedback
group yd = 20.58).We fixed the kp and kn values based on
⎧⎪ ( hj − ym )kp, if hj − ym ≥ 0 McGraw, Mellers, and Ritov (2004) results: kp was fixed on
q ( h, y ) = ⎨ (6)
⎪⎩− ( hj − ym ) , if hj − ym < 0,
kn
1.34 and kn on 1.48. We used the discount rate gd = 0.916
obtained in equation 3 and we also used gi = 1. The obtained
where q(h,y) is the function that relates each possible judge- anticipated disappointment values d(y) were -8.38 and
ment that could be made using all the possible internal signals -6.04 for the immediate-feedback group and the delayed-
y (where m = 0 to 34) and all the possible feedback to be feedback group, respectively. This indicates that the antici-
received h (where j = 0 to 34). Following decision affect pated disappointment of making a performance judgement
theory, if the feedback is higher than the performance judge- that corresponds to the internal signal (y) is higher in the
ment, there would be elation (or an increase in utility), and if immediate-feedback group. The only free parameters were a
© 2012 The Australian Psychological Society
8 P. Fajfar et al.

Table 2 Fitted, obtained, or assumed values of variables or para- ments, some of which are applicable to the present study:
meters in the mathematical model different construal of feedback situation, increase in anxiety,
Immediate-feedback Delayed-feedback avoidance of disappointment, and defensive pessimism.
Parameters group group Norem and Cantor (1986) suggested that the strategy of
X=T 20.58 20.58 defensive pessimism may lead to mobilise energy to work
d 0.916 0.916 hard in order to avoid an undesired outcome. We suggested
g 1 0.916
P = Ĝ = Y 22.47 20.58
that, if this suggestion is correct, it would be possible to find
d(y) -8.38 -6.04 pessimism (i.e., underconfidence) and increase in per-
a 0.101 0.003 formance due to anticipation of immediate feedback. Our
J = Ĵ 19.34 20.49 results support this hypothesis. We incorporated this expla-
kp 1.34 1.34
kn 1.48 1.48
nation and two of the other three explanations into a math-
ematical model that accounts for the effects of anticipation of
Note. X is the expected outcome, T is the average performance in
similar tasks in the past, d is the temporal discount rate of the monetary feedback on performance and performance judgement. We
value, g is the temporal discount rate of the feedback situation, P is the did not incorporate the anxiety explanation because we did
actual performance, Ĝ is the predicted performance, Y is the internal not measure anxiety in our experiment.
signal about performance generated immediately after finishing the task,
The model suggests that the source of both performance
d(y) is the anticipated affect of giving a performance judgement that
corresponds to y, a is the weight given to d(y) in the performance improvement and underconfidence in the immediate-
judgement, J is the actual performance judgement, Ĵ is the predicted feedback group is a representation of the feedback situa-
performance judgement, and kp and kn are the exponents that corre- tion that affected the EUT. This utility was higher in the
spond to positive and negative values, respectively, in the f(l) and q(h,y)
immediate-feedback group in comparison to the delayed-
functions.
feedback group in situations in which performance feedback
for each group. The model fitted the data perfectly with is higher than expected performance, and lower in situations
ai = 0.101 and ad = 0.003. Table 2 shows the values of all the in which performance feedback is lower than expected per-
parameters for each group. This result supports the hypoth- formance. This is because the immediate-feedback group
esis that the participants in the immediate-feedback group discounted the pleasure of the monetary reward but not the
paid relatively more attention to the possible disappointment elation/disappointment of the feedback situation, whereas
in the feedback situation. the delayed-feedback group discounted both. This had
two effects: First, the participants in the immediate-feedback
Limitations group were more motivated to perform the task, and second,
when they had to make a performance judgement, they
This model has a number of limitations. First, the goal of paid relatively more attention to the anticipation of feed-
developing the model was to give an explicit account of the back. This lead to adjusting their performance judgements
results and to guide future investigation, thus the experi- downwards.
ment was not designed to test the model. Second, given the Being aware of the limitations of this study, we suggest
descriptive nature of the model, we did not fit the model to that our results have theoretical and practical implications.
the individual data. Third, we made some assumptions based From the theoretical standpoint, we extended decision affect
on previous research, but other assumptions are probably theory (Mellers et al., 1997, 1999) to anticipation of feed-
too simplistic. Fourth, we chose a task in which an increase back. This theory indicates that the pleasure obtained by an
in motivation could lead to performance improvement. outcome is a function of the prior expected outcome and the
Although the increase in performance due to motivation is actual outcome. We proposed that people also anticipate the
possible in many tasks, it does not apply to all types of tasks. pleasure or utility of carrying out a task. We used aspects of
That is, increase in motivation does not always improve decision affect theory together with the concept of temporal
performance. These limitations should be considered in discounting, Moore and Healy’s (2008) model of overconfi-
the context of the advantages of developing a mathematical dence, and Trope and Liberman’s (2003) CLT to formalise
model to explain these results. First, no formal explanation this proposal. Our results also contribute to the field of
of this effect has been proposed earlier, and second, this research onto the effect of timing of feedback on per-
model could be used to derive experimental hypothesis in formance. We proposed that anticipation of feedback
future research. could partly explain the improvement of performance in
immediate-feedback conditions.
CONCLUSIONS The practical implication is that informing on the timing
of feedback before participating in a task could cause very
Sweeny et al. (2006) proposed a number of explanations for important effects: performance improvement and undercon-
the effect of immediate feedback on performance judge- fidence. This is relevant for educational settings. Although
© 2012 The Australian Psychological Society
Immediacy of feedback and estimations 9

future research is needed to investigate the nature and the D. Kahneman, P. Slovic, & A. Tversky (Eds.), Judgment under
boundary conditions of this effect, psychologists may find uncertainty: Heuristics and biases (pp. 306–334). New York:
Cambridge University Press.
useful to inform their participants that they would receive McGraw, A. P., Mellers, B. A., & Ritov, I. (2004). The affective costs
immediate feedback. of overconfidence. Journal of Behavioral Decision Making, 17, 281–
295.
Mellers, B. A., Schwartz, A., Ho, K., & Ritov, I. (1997). Decision
affect theory: Emotional reactions to outcomes of risky options.
NOTE Psychological Science, 8, 423–429.
Mellers, B. A., Schwartz, A., & Ritov, I. (1999). Emotion-based
1. We carried out the experiment before Kettle and Häubl’s choice. Journal of Experimental Psychology: General, 128, 332–345.
Moore, D. A. (2007). Not so average after all: When people believe
(2010) article was published; thus, our hypothesis was
they are worse than average and its implications for theories
elaborated independently from those in this study. of bias in social comparison. Organizational Behavior and Human
Decision Processes, 102, 42–58.
Moore, D. A., & Healy, P. J. (2008). The trouble with overconfi-
dence. Psychological Review, 115, 502–517.
REFERENCES
Moore, D. A., & Small, D. A. (2007). Error and bias in comparative
judgment: On being both better and worse than we think we are.
Berns, G. S., Laibson, D., & Loewenstein, G. (2007). Intertemporal Journal of Personality and Social Psychology, 92, 972–989.
choice—toward an integrative framework. Trends in Cognitive Norem, J. K., & Cantor, N. (1986). Defensive pessimism. Harnessing
Sciences, 11, 482–488. anxiety as motivation. Journal of Personality and Social Psychology,
Cortada de Kohan, N. (2003). BAIRES. Test de Aptitud verbal. Madrid: 51, 1208–1217.
TEA. Perloff, L. S. (1987). Social comparison and illusions of invulner-
Gigerenzer, G., Hoffrage, U., & Kleinbölting, H. (1991). Probabilistic ability to negative life events. In C. R. Snyder & C. E. Ford (Eds.),
mental models: A Brunswikian theory of confidence. Psychological Coping with negative life events: Clinical and social psychological pers-
Review, 98, 506–528. pectives (pp. 217–242). New York: Plenum Press.
Gilovich, T., Kerr, M., & Medvec, V. H. (1993). Effect of temporal Shepperd, J. A., Grace, J., Cole, L. J., & Klein, C. (2005). Anxiety
perspective on subjective confidence. Journal of Personality and and outcome predictions. Personality and Social Psychology Bulletin,
Social Psychology, 64, 552–560. 31, 267–275.
Griffin, D., & Tversky, A. (1992). The weighting of evidence and the Shepperd, J. A., & McNulty, J. K. (2002). The affective consequences
determinants of confidence. Cognitive Psychology, 24, 411–435. of expected and unexpected outcomes. Psychological Science, 13,
Hattie, J., & Timperley, H. (2007). The power of feedback. Review of 85–88.
Educational Research, 77, 81–112. Shepperd, J. A., Ouellette, J. A., & Fernandez, J. K. (1996).
Keren, G. (1997). On the calibration of probability judgments: Some Abandoning unrealistic optimism: Performance estimates and the
critical comments and alternative perspectives. Journal of Behav- temporal proximity of self-relevant feedback. Journal of Personality
ioral Decision Making, 10, 269–278. and Social Psychology, 70, 844–855.
Kettle, K. L., & Häubl, G. (2010). Motivation by anticipation: Sweeny, K., Carroll, P. J., & Shepperd, J. A. (2006). Is optimism
Expecting rapid feedback enhances performance. Psychological always best? Future outlooks and preparedness. Current Directions
Science, 21, 545–547. in Psychological Science, 15, 302–306.
Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interven- Trope, Y., & Liberman, N. (2003). Temporal construal. Psychological
tions on performance: A historical review, a meta-analysis, and a Review, 110, 403–421.
preliminary feedback intervention theory. Psychological Bulletin, Tversky, A., & Kahneman, D. (1979). Prospect theory: An analysis
119, 254–284. of decision under risk. Econometrica, 47, 263–292.
Kulik, J. A., & Kulik, C. L. C. (1988). Timing of feedback and verbal Weinstein, N. D. (1980). Unrealistic optimism about future life
learning. Review of Educational Research, 58, 79–97. events. Journal of Personality and Social Psychology, 39, 806–820.
Lichtenstein, S., Fischhoff, B., & Phillips, L. D. (1982). Calibration Yates, J. F. (1990). Judgment and decision making. Englewood Cliffs,
of subjective probabilities: The state of the art up to 1980. In NJ: Prentice Hall.

© 2012 The Australian Psychological Society

You might also like