Professional Documents
Culture Documents
Andiola 2014
Andiola 2014
PII: S0737-4607(14)00002-0
DOI: http://dx.doi.org/doi:10.1016/j.acclit.2014.07.001
Reference: ACCLIT 10
To appear in:
Please cite this article as: Andiola, L. M.,Performance Feedback in the Audit
Environment: A Review and Synthesis of Research on the Behavioral Effects, Journal
of Accounting Literature (2014), http://dx.doi.org/10.1016/j.acclit.2014.07.001
This is a PDF file of an unedited manuscript that has been accepted for publication.
As a service to our customers we are providing this early version of the manuscript.
The manuscript will undergo copyediting, typesetting, and review of the resulting proof
before it is published in its final form. Please note that during the production process
errors may be discovered which could affect the content, and all legal disclaimers that
apply to the journal pertain.
Performance Feedback in the Audit Environment: A Review and Synthesis of
Research on the Behavioral Effects
Lindsay M. Andiola*
Bentley University
t
Abstract: This paper synthesizes the extant feedback literature, focusing on how feedback affects
ip
an individual’s learning, performance, and motivation. Performance feedback is an important
component in the auditing environment for ensuring quality control and for developing and
cr
coaching staff auditors. However, the literature on feedback in the audit environment is fragmented
and limited making it difficult to assess the behavioral effects of feedback on auditors. This paper
has three main objectives. The first is to review some of the influential research in psychology and
us
management to identify key variables and issues that appear to be critical in the study of behavioral
consequences of feedback in organizational settings. The second is to review performance feedback
research specifically in auditing to identify the areas previously examined and synthesize the
an
findings. The third is to suggest a variety of future research opportunities that may assist in
developing an understanding and knowledge of the behavioral effects feedback has on auditors.
The compilation and integration of evidence, both inside and outside the audit discipline, reveals
significant implications for audit research and practice. This research can provide important
M
insights into understanding who, how, and when performance feedback should be given to improve
the effectiveness of feedback and coaching in the audit environment.
d
* Contact Information:
Ac
Lindsay M. Andiola
Bentley University
Accounting Department
175 Forest Street
Waltham, MA, 02452
Phone: 617-922-3791
E-mail: andiola_lind@bentley.edu
Page 1 of 69
Performance Feedback in the Audit Environment: A Review and Synthesis of
Research on the Behavioral Effects
Abstract: This paper synthesizes the extant feedback literature, focusing on how feedback affects
an individual’s learning, performance, and motivation. Performance feedback is an important
t
component in the auditing environment for ensuring quality control and for developing and
ip
coaching staff auditors. However, the literature on feedback in the audit environment is fragmented
and limited making it difficult to assess the behavioral effects of feedback on auditors. This paper
cr
has three main objectives. The first is to review some of the influential research in psychology and
management to identify key variables and issues that appear to be critical in the study of behavioral
consequences of feedback in organizational settings. The second is to review performance feedback
us
research specifically in auditing to identify the areas previously examined and synthesize the
findings. The third is to suggest a variety of future research opportunities that may assist in
developing an understanding and knowledge of the behavioral effects feedback has on auditors.
an
The compilation and integration of evidence, both inside and outside the audit discipline, reveals
significant implications for audit research and practice. This research can provide important
insights into understanding who, how, and when performance feedback should be given to improve
the effectiveness of feedback and coaching in the audit environment.
M
Key Words: Performance Feedback, Audit Review, Feedback Methods
d
p te
ce
Ac
Page 2 of 69
1. Introduction
Performance feedback is important in virtually all organizations as both a developmental
and motivational resource. Research demonstrates that performance feedback can aid in learning
t
ip
(Ilgen, Fisher, & Taylor, 1979), improve performance (London, 2003) and increase motivation and
job satisfaction (Kluger & DeNisi, 1996) of individuals. Also, of particular relevance to auditing,
cr
feedback assists in improving judgment and decision making (Bonner, 2008).
us
In the audit environment, performance feedback is quite prevalent. It is viewed as both a
quality control mechanism (Gibbins & Trotman, 2002; Rich, Solomon, & Trotman, 1997) and a tool
an
in developing and coaching auditors as they progress through the organizational hierarchy (Hunt,
1995; Westermann, Bedard, & Earley, 2014). As such, both audit quality and the development of
M
audit professionals may be affected by performance feedback. However, our knowledge of the
effects of feedback on auditor learning, performance, and motivation is fragmented and limited.
d
Audit studies to date focus primarily on knowledge acquisition, with little attention paid to the
te
motivational (or demotivational) and performance changing (both positive and negative)
p
properties of feedback (Bonner, 2008). The purpose of this paper is to synthesize the literature on
ce
performance feedback to identify the overall findings to date and suggest future research
opportunities.
Ac
This paper will accomplish this objective by first reviewing the influential research in
psychology and management to identify key variables and issues that appear to be important in the
study of the behavioral effects of feedback in organizational settings. Then, this paper reviews and
synthesizes the performance feedback research in auditing to identify the areas previously
examined and key findings. Finally, this paper suggests future research opportunities that may
Page 3 of 69
Performance feedback is defined in the extant literature in a variety of ways. For purposes
external agent(s) that provides information regarding some aspect(s) of one’s performance (Kluger
& DeNisi, 1996). While it is generally assumed that performance feedback has uniformly positive
t
effects (Ilgen et al., 1979; Taylor, Fisher, & Ilgen, 1984) systematic reviews such as Kluger and
ip
DeNisi’s (1996) meta-analysis indicate that this is not necessarily true. In fact, some research
cr
suggests performance feedback can have detrimental effects on an individual’s learning, motivation,
us
and performance (Ilgen & Davis, 2000). Therefore, it is important in the audit setting where
performance feedback is heavily relied upon to understand the factors that affect feedback seeking
an
and use.
There are several key reasons to examine the effects of performance feedback in the audit
M
setting. The first is the importance of performance feedback as a quality control mechanism in audit
firms. Feedback, through the workpaper review process, is an imbedded piece of the quality control
d
environment required by auditing standards (PCAOB, 2010c; AICPA, 2006). Supervising auditors
te
oversee and provide comments on the work product of subordinate auditors to maintain the overall
quality of the audit. Psychology and management research suggests that the source of the feedback,
p
the recipient of the feedback and the feedback message all contribute to the likelihood of
ce
subordinate auditors using the feedback. If auditors do not use the feedback to gain knowledge and
Second, the audit environment offers unique opportunities that are not otherwise
observable in many work settings, suggesting it is a context ripe to examine certain feedback
variables. For example, it is common in the audit environment for auditors to have frequent
assignment changes. This often results in staff auditors having multiple different supervisors
evaluating their performance during the year. In addition, auditors receive formal feedback more
frequently when compared to other work environments in which a semi-annual or annual review
Page 4 of 69
may be the only structured feedback received by an employee. Staff auditors (i.e., associates and
seniors associates) receive feedback in the form of coaching notes or review comments upon
completion of workpapers (i.e., a workpaper review), they receive feedback upon completion of an
audit (i.e., an engagement review), and as part of their annual assessment and goal setting
t
procedures (i.e., an annual review). Psychology and management research suggests these variations
ip
in feedback source and feedback message are likely to affect individual behavior, however prior
cr
auditing research has not examined the possible effects.
us
Third, public accounting firms are contending with a number of issues related to
performance feedback. One, the PCAOB has expressed concern regarding the sufficiency and
an
effectiveness of review of audit field work and supervision (PCAOB, 2010a, 2010b). Two,
Westermann et al. (2014) report that some partners express concern that today’s managers and
M
seniors are struggling to provide negative or critical evaluations to their staff, perhaps fearing that
this will lead to employee dissatisfaction and turnover. Three, audit staff comment that formal
d
feedback mechanisms do not represent the work actually done and often reflect more general
te
assessments (Anderson-Gough, Grey, & Robson, 1998). They also note significant delays in
receiving feedback (Lambert & Agoglia, 2011). These issues suggest further understanding of the
p
current feedback processes and the factors affecting the effectiveness of these processes could
ce
provide guidance to professional practice to improve feedback processes and auditors response to
performance feedback.
Ac
The remainder of this paper is organized into four sections. Section 2 briefly discusses
performance feedback in the audit environment. Section 3 describes the framework used for
reviewing and synthesizing the literature. Section 4 reviews and synthesizes the literature on
performance feedback within and outside of auditing, providing relevant research questions in the
Page 5 of 69
2. Performance Feedback in the Auditing Environment
In public accounting firms, multiple opportunities exist for employees to seek and receive
reviews, and annual reviews. In addition, informal feedback can be sought or provided on an ad-hoc
t
basis by peers, supervisors, or coaches/mentors during the course of an audit engagement. This
ip
variety of feedback mechanisms and the number of possible opportunities to seek and receive
cr
feedback suggests audit firms see the critical importance that feedback plays in the organization for
both quality control and employee development. However, despite the wide use of feedback
us
processes in audit firms, research is limited on the effects these feedback mechanisms have on
auditor’s behavior.1
an
Workpaper reviews are conducted by senior associates, managers, and partners, who
provide feedback on specific auditing tasks. To maintain audit quality control standards require
M
workpaper reviews to ensure auditors complete their work adequately and that the documentation
supports the audit opinion (PCAOB, 2010c; AICPA, 2006). However, audit firms also rely on the
d
workpaper review process as a key coaching tool for inexperienced auditors. This supervisory
te
review is empirically linked to important factors for career development, overall job satisfaction,
p
and turnover intentions (Vera Munoz, Ho, & Chow, 2006). Most prior research related to workpaper
ce
reviews focuses primarily on aspects of the review process as a quality control mechanism,
considering such topics as reviewer differences (Ramsay, 1994; Tan & Jamal, 2001), reviewers’
Ac
performance and judgment quality (Agoglia, Hatfield, & Brazel, 2009; Asare, Haynes, & Jenkins,
2007; Tan & Trotman, 2003), and the overall review process (Gibbins & Trotman, 2002; Rich et al.,
1997). There is little focus on the motivational and performance effects of the review on the staff
auditor.
1Luckett and Eggleton’s (1991) management accounting review of feedback similarly suggests that the
behavioral effects of feedback on employees is limited and requires further academic research.
Page 6 of 69
Performance feedback is also provided through engagement reviews, which are conducted
when an employee finishes an audit, and annual reviews, which are conducted at the end of the
performance year. Audit staff generally receive anywhere from three to eight engagement reviews
during a year, and are usually reviewed by multiple different supervisors. Annual reviews are
t
conducted once per year to assess and evaluate all of the firm’s employees to determine
ip
compensation and promotion rewards, assess development and help employees set goals for the
cr
following year. While the overall goals of the engagement and annual reviews are similar (i.e., to
us
provide developmental feedback to the auditor and to use the reviews as a method to rate the
auditor against his peers) the underlying factors that affect feedback use can vary considerably
an
between these types of reviews (e.g., who the feedback comes from, engagement reviews are
usually completed by an audit staff’s direct supervisor and annual reviews are usually conducted by
M
a performance manager or coach). Engagement and annual reviews are directly linked to an
auditor’s year-end compensation decisions and therefore are likely to have significant effects on an
d
auditor’s behavior, motivation and overall job satisfaction. Most studies on engagement and annual
te
reviews focus on the performance raters (Hirst & Luckett, 1992; Kaplan & Reckers, 1985; Kennedy
& Peecher, 1997) and the scales used to assess performance (Harrell & Wright, 1990). Very few
p
investigate the response of audit staff to the reviews, that is, the behavioral component of the
ce
review (see Hunt 1995 for a comprehensive review of the performance appraisal literature in
auditing).
Ac
In the next section, a framework is presented that will assist in reviewing and synthesizing
Page 7 of 69
imbedded in an organizational setting (Figure 1). Prior to receiving feedback an individual has a
certain level of performance, knowledge and motivation/effort. Then feedback is created through
one of two ways, either an individual can create feedback or the organization can create feedback.
t
individual to determine whether the individual’s behavior and performance is in line with the
ip
supervisor’s or firm’s expectations and one’s own goals. As an organizational resource, feedback is
cr
created though formal or informal means to motivate, direct, and instruct the performance of
us
individuals. In the audit environment, this can be done formally through workpaper reviews,
engagement reviews, and annual reviews or informally through coaching and mentoring. The
an
decision to actively seek feedback and then to use (or not use) feedback that is given is dependent
on both individual and contextual factors (Anseel, Beatty, Shen, Lievens, & Sackett, 2013; Ilgen et al.,
M
1979). This use, or lack of use, of feedback results in a change (or no change) in an individual’s level
of performance, knowledge, and motivation/effort. This cycle continues each time feedback is
d
sought or received.
te
An individual’s decision to seek and use feedback is a function of the attributes of the
p
feedback seeker/recipient, the feedback environment, the feedback source/target, and the feedback
ce
message (Figure 2). These factors are shown in the psychology and management literatures to not
only impact the decision to seek and use feedback, but to also affect the desired outcomes of giving
Ac
performance feedback (e.g., performance improvement, increased motivation and effort). The
variety of dimensions identified in this figure highlight the complexity of examining the effects of
In the following section, each of the dimensions identified in the figure are discussed in
detail, highlighting key research from both psychology and management literatures, as well as the
Page 8 of 69
research performed in the audit setting. This is not a comprehensive review; rather it is an attempt
to focus on variables that are likely to have implications in the auditing environment that appear to
t
4. Factors Affecting Feedback Seeking and Use
ip
4.1 Individual Factors
cr
An important consideration in the feedback process is the individual who is seeking or
receiving the feedback. Ashford and Cummings’ (2003) seminal work proposes that feedback
us
recipients play an active role in the feedback process. Recipients are able to shape their feedback
environment by seeking feedback, generating their own feedback, combining feedback from
an
multiple sources and deciding which feedback to respond to and use. The psychology and
management literatures recognize the moderating influence that individual differences have on the
M
outcomes of the feedback process, highlighted by the abundance of research in this area (see Ilgen
d
et al. 1979, Kluger and DeNisi 1996, Anseel et al. 2013 for comprehensive reviews of individual
te
differences). In the next couple of sections, individual factors and associated findings from the
A number of personal characteristics are shown to affect feedback seeking and use,
Ac
including a person’s self-esteem, locus of control, and goal orientation, as well as demographic
items like age and job experience. Prior research indicates that tenure, age and experience are
negatively related to both feedback seeking and use (Anseel et al., 2013; London & Smither, 2002).
The research argues that employees that are young and new to a job see feedback as more valuable,
as it helps them reduce uncertainty and adapt quicker to their new role and environment.
Alternatively, older, more seasoned employees have less role uncertainty, which reduces the
Page 9 of 69
perceived value of feedback, and increases concerns about managing others’ impressions of their
expertise.
In addition, there is some research (P. C. Earley, Gibson, & Chen, 1999; Morrison, Chen, &
Salgado, 2004) that suggests cultural differences, may play a role in feedback seeking and use.
t
Specifically, cultures with low power distance and high individualism have a higher likelihood of
ip
seeking feedback and high individualist cultures rely more heavily on individual performance
cr
feedback over group performance feedback (Morrison et al., 2004). In addition, research finds
us
Asians have stronger emotional reactions to negative feedback, but are more responsive to it than
an
Beyond demographics, there is an ever expanding list of personal characteristics that have
the potential to impact feedback behaviors. Self-esteem, a person’s overall evaluation or appraisal of
M
his worth, and self-efficacy, a context-specific assessment of a person’s competence to complete a
task or range of tasks, are the most widely researched characteristics, but the findings for these
d
characteristics along with a number of others (e.g., locus of control, tolerance for ambiguity) are
te
inconsistent (Anseel et al., 2013; Ilgen et al., 1979). Overall, the literature on personal
characteristics as they relate to feedback behaviors is criticized for lack of strong theory and a focus
p
on a limited number of broad variables that have conflicting findings (Herold & Fedor, 1998).
ce
However, more recent literature has used stronger theoretical underpinnings with personality
characteristics that are more directly linked to feedback behaviors, two such characteristics are
Ac
Goal orientation influences how people experience, manage and react to achievement-
related situations. Two distinct dimensions are identified in extant literature: 1) learning goal
orientation, where individuals want to improve competence, master new situations and acquire
new skills and 2) performance goal orientation, where individuals want to demonstrate and
validate their competence and avoid negative judgments of their ability (Dweck, 1986; Dweck &
Page 10 of 69
Leggett, 1988). The research suggests that learning goal orientation positively impacts feedback
behaviors, including feedback seeking and feedback reactions, whereas performance goal
orientation has the opposite effect (VandeWalle, 2003; VandeWalle & Cummings, 1997). However,
similar to other personal characteristics, Anseel et al.’s (2013) meta-analysis suggests there are
t
situations where goal orientation may have contradictory effects. In addition, most of the prior
ip
research examining goal orientation has examined the propensity to seek feedback, without
cr
considering the effects on a person’s response to feedback received.2
us
Current research also indicates emotional intelligence may be a key factor driving feedback
seeking and use (Ashford et al., 2003). The construct definition of emotional intelligence is still
an
heavily debated (e.g., Landy 2005), however most researchers highlight a few common abilities of
individuals with high emotional intelligence. These include an awareness of their own emotions, an
M
ability to appraise and understand others’ emotions, a capability to regulate their own emotions,
and an ability to use emotions to enable performance. While it seems clear that emotions are likely
d
to play an important role in feedback behaviors, only one study (Dahling, Chau, & O'Malley, 2012)
te
to date examines the relationship between emotional intelligence and feedback behaviors. This
study finds that emotional intelligence is positively associated with a person’s receptivity to
p
external feedback propensity, that is, an employee’s desire to obtain feedback from an external
2 Research on coaching and training indicates that goal orientation also has a state component, suggesting a
person’s orientation can be manipulated through framing of feedback and tasks or through training (Gregory,
Beck, & Carr, 2011; Kozlowski et al., 2001). For example, Cianci et al. (2010) find that individuals who are
given learning goals perform better following negative feedback, but worse after positive feedback, whereas
individuals who are given performance goals perform better following positive feedback and worse following
negative feedback. This research suggests that the manner in which tasks or evaluations are framed can
influence how an individual is likely to behave in subsequent tasks.
Page 11 of 69
source (Herold, Parsons, & Rensvold, 1996). However in response to limitations of this construct, as
well as to the general limitations of the prior research on personal characteristics, a more
characteristics with feedback seeking and use. Feedback orientation (FO) is universally defined by
t
London and Smither (2002) as a person’s overall receptivity to feedback. They indicate that FO
ip
influences an individual’s propensity to seek and process feedback mindfully, to believe in the value
cr
of feedback, to be accountable in the use of feedback, and to act on the feedback to drive behavior
us
change and performance improvement.
This construct is believed to have both a trait and a dispositional component. That is, it is
an
influenced by both individual characteristics, such as goal orientation and self-efficacy, and
organizational characteristics, such as the organizations’ influence on the quality, importance and
M
support of feedback (Dahling et al., 2012; London & Smither, 2002). Research suggests that
employees with high FOs should be better able to regulate and overcome their emotional reactions
d
to feedback (feedback receipt); process feedback more meaningfully and surmount attribution
te
errors (feedback processing); and use feedback effectively in establishing goals and improving
performance (feedback use) (Braddy, Sturm, Atwater, Smither, & Fleenor, 2013; London & Smither,
p
2002).
ce
Linderbaum and Levy (2010) build on London and Smither’s (2002) seminal work by
feedback.3 Linderbaum and Levy (2010) find that FO has a positive relationship with individual
differences like learning goal orientation, work ethic, self-efficacy and positive affect. Moreover,
their model is predictive of work-related outcomes, including role clarity, feedback environment
3 The FOS is made up of four dimensions, including utility (believing in the usefulness of feedback in achieving
goals), accountability (feeling obligated to react to and use feedback), social awareness (using feedback to be
aware of others’ views of oneself), and feedback self-efficacy (believing in one’s competence to interpret and
respond to feedback).
Page 12 of 69
perceptions, performance appraisal session satisfaction and self-reported job involvement. Braddy
et al. (2013) further validate the FOS in a leadership development context and find FO is positively
related to implicit person theory (i.e., the belief that an individual’s attributes are malleable) and
achievement motivation.
t
Researchers have identified a number of propositions related to FO (Linderbaum & Levy,
ip
2010; London & Smither, 2002); however, with the exception of a few studies the majority of these
cr
propositions remain untested. These exceptions (Braddy et al., 2013; Dahling et al., 2012; Gregory
us
& Levy, 2012) find that FO has a significant and direct effect on feedback seeking, reactions to 360-
degree feedback, and the quality of coaching relationships and an indirect effect on employee
an
performance and the supervisor’s coaching behaviors (i.e., guidance, facilitation, inspiration).
Taken together, the research on FO suggests this individual characteristic has the potential
M
to help explain when individuals will seek feedback and whether feedback will be used effectively.
While many individual characteristics have been empirically tested with feedback-specific
d
variables, future research needs to expand on the determinants of FO and how FO impacts desired
te
outcomes of the feedback process, including learning, performance improvement, and motivation.
In addition, the literature on FO suggests it is an important control variable for studies that are
p
Based on the research performed to date, individual factors play an important role in a
person’s decision to seek and to use feedback. The more recent psychology and management
literature on these factors is more theoretically based and the constructs appear to link better and
measure more closely personal attributes that are likely to play a role in the feedback process.
However, the research to date on many of these factors (e.g., feedback orientation and emotional
intelligence) is limited and most of these studies are not performed in a professional context where
this research is likely to have the most relevance and impact. Future research needs to examine
Page 13 of 69
how these individual factors are affected by contextual factors in the professional environment and
whether characteristics like feedback orientation and goal orientation can be shifted over time
t
ip
Prior literature in the auditing context on the impact of the individual on feedback seeking
cr
and use is limited (see Table 1 for a summary of the audit research on feedback). Audit research
shows that a number of personal characteristics, including locus of control, cognitive style, gender,
us
and cultural background, affect judgment and decision making (Bonner, 2008). However, only one
study (Bryant, Murthy, & Wheeler, 2009) has directly tested the relationship between an individual
an
factor and performance feedback, and in turn resulting task performance.
Bryant et al. (2009) examine the effects of cognitive style and feedback type on
M
performance. The study examines sensors (more detail-oriented) versus intuitives (more pattern-
oriented) and whether providing the subject information as to their cognitive style improves their
d
ability to identify with-in cycle and out-of-cycle internal control cues. Cognitive style is shown to
te
have no direct effect on task performance. However, participants who receive outcome feedback in
p
conjunction with cognitive style feedback did perform better at detecting out-of-cycle internal
ce
control information than no feedback or cognitive style feedback. Also, the researchers find an
interesting interaction between cognitive style and feedback. Outcome feedback in combination
Ac
with cognitive style feedback has a negative impact on the performance of intuitives, while this
same combination of feedback types has the opposite impact on the performance of sensors. This
indicates that this combination of types of feedback strengthen the detail-orientation of sensors,
while alternatively causing intuitives to overlook details even more than they are already inclined
to do.
studies provide evidence that demographic factors are important when considering the impact of
Page 14 of 69
feedback on auditors. Miller et al. (2006) examine the effects of auditor experience on both the
auditor’s motivation to improve performance and the supervising auditor’s perception of whether
performance improvement actually occurs after discussion of performance during the workpaper
review process. The findings indicate experience moderates the effect of performance discussions
t
on performance improvement as perceived by the reviewer. Generally, discussion improves less
ip
experienced auditors’ performance, but appears to diminish performance improvement for more
cr
experienced auditors. In addition, while Lambert and Agoglia (2011) were not directly examining
us
personal factors in their study, they find gender to be a significant covariate related to over-
documenting (e.g., including a tickmark indicating testing was completed when in fact it was not).
an
In this study the researchers examined how the timeliness of feedback and the framing of the
comments affect the effort and performance of participants in clearing the comments provided by
M
the reviewer. The study finds that significantly more participants’ over-documented in the delayed
condition than the timely condition, with this finding more prevalent in male participants (41%)
d
These studies further extend what is clearly suggested by the psychology and management
literature. That is, individual factors play a role in an individual’s response to feedback which
p
results in varying behavioral effects. In order to understand when and from whom auditors will
ce
seek feedback and how they will react to feedback they receive it is critical to understand how
individual factors moderate and mediate the relationship between the feedback process and work-
Ac
related outcomes. As the auditing environment is quite unique in both the feedback mechanisms
available to an auditor and the operational environment auditors work in day-to-day it is critical to
understand how these factors interact with characteristics unique to the audit environment.
Page 15 of 69
From the preceding discussion it is apparent that responses of individuals to feedback are
complicated by individual factors, such as feedback orientation and cognitive style, yet there is a
clear lack of audit research in this area. Based on the research cited in this section, in conjunction
with the framework and review of research outside the audit context, the following questions merit
t
further research:
ip
RQ1: How do personal factors, like feedback orientation and goal orientation, affect an
cr
auditor’s likelihood of seeking feedback from supervisors, peers, specialists, etc.? How do
personal factors affect an auditor’s reaction to formal and informal feedback? How does this
reaction to feedback affect the auditor’s learning, motivation and future work performance?
us
What personal factors may mitigate the adverse effects of contextual factors? What
contextual factors may mitigate adverse effects of certain personal factors?
RQ2: How do demographics, like age, job tenure, and culture, affect an auditor’s likelihood
an
of seeking feedback from supervisors, peers, specialists, etc.? How do auditor demographics
affect an auditor’s reaction to formal and informal feedback? How does this reaction to
feedback affect an auditor’s learning, motivation and future work performance? What
demographic factors may mitigate the adverse effects of contextual factors? What
M
contextual factors may mitigate adverse effects of certain demographic factors?
RQ3: Do personal factors of auditor’s shift overtime? If so, what contextual factors (e.g.,
feedback environment, supervisor support) play a role in how these personal factors shift?
d
What effect do these shifts have on an auditor’s seeking and receptivity to feedback? How
does recognition as an “expert” affect one’s likelihood of seeking and using feedback?
te
Beyond the personal factors of the individual, there are also a number of contextual factors
ce
associated with feedback that can lead to varying effects on an individual’s motivation, learning and
performance (Kluger & DeNisi, 1996). These contextual factors, as depicted in Figure 2, include who
Ac
the feedback is coming from (i.e., feedback source), characteristics of the feedback message (e.g.,
sign of feedback, timing, frequency) and the organizational environment in which feedback is given
(i.e., feedback environment). The next few sections highlight key contextual factors and associated
Page 16 of 69
Feedback source is one of the more highly researched elements related to feedback seeking
and use. Specific source factors include source identity (e.g., supervisor, peer, task, self) and source
attributes (e.g., credibility, power, leadership style). Research (Anseel et al., 2013; Ilgen et al., 1979)
suggests that an individual’s perception, seeking, accepting, and using of feedback is influenced by
t
who the feedback comes from. Therefore, much of the research to date focuses on understanding
ip
how the recipients of feedback regard various sources and the influence these sources have on
cr
them.
us
In a professional setting, the feedback source can be an individual, including most typically
a supervisor, coworker, or subordinate; the organization; the task environment (i.e., through
an
technology or subsequent events); or one’s self. Greller and Herold (1975) investigate five potential
sources including the organization, supervisors, coworkers, the task, and self. Respondents indicate
M
that intrinsic sources, like self and task, provide more information than extrinsic sources that
include a supervisor, coworker, or the organization. Herold et al. (1987) expand on this previous
d
study by examining whether individuals differentiate between feedback sources on the basis of the
te
perceived usefulness and reliability of the information they provide. The results show that the
consistency and usefulness of the information provided through feedback are important aspects of
p
the feedback source. In an extension of this study, Andrews and Kacmar (2001) investigate
ce
feedback sources in service based organizations and how these sources relate to certain job
attitudes within the firm environment. Task feedback and supervisor feedback are both significant
Ac
predictors of job satisfaction and role ambiguity. The organization as a source of feedback is a
significant predictor of all five outcome variables examined including job satisfaction, role
ambiguity, role conflict, job involvement, and stress. This finding is unexpected given the
organization provides the least amount of feedback compared to the other sources, but may
indicate the importance of setting and communicating standards from the top-down.
Page 17 of 69
Overall, the findings from the psychology and management literatures on source identity
suggest the most valuable feedback comes from the self, the task or the organization. However, in
settings where job responsibilities and tasks are more complex and involve significant judgment,
like the audit setting, one would expect that supervisors and peers may be a better source of
t
feedback. In the below auditing review section, findings appear consistent with this expectation.
ip
Beyond source identity, prior research also focuses heavily on source attributes to
cr
investigate choices of whom to seek feedback from and which feedback is ultimately used. Both
us
credibility and power of the source arguably affect these choices. Giffin (1967) defines credibility as
the recipient’s belief in the sources’ expertise and their trustworthiness.4 A multitude of studies find
an
that expertise and the quality of knowledge received from the feedback source are key factors in
choosing who to seek feedback from and which feedback to use (Steelman & Rutkowski, 2004;
M
Vancouver & Morrison, 1995). Halperin et al. (1976) provide subjects with personality feedback
from one of three sources who vary in expertise and find that especially under the condition of
d
providing a negative personality interpretation, participants are more likely to accept the
te
information from the expert than from the other sources. Similarly, Steelman and Rutkowski
(2004) find supervisor credibility significantly moderates the relationship between negative
p
feedback and the motivation to use feedback. These findings suggest individuals are more accepting
ce
and motivated to use negative feedback when it comes from a highly credible source than when it
In sum, the more credible the feedback source, the higher the perceived value of the
feedback for improving performance, and thus the more likely individuals are to seek and use
feedback from this source. This finding is important to consider in a professional setting. If the
4Giffin (1967) describes expertise as both the belief that the source has the experience in the task to provide
quality feedback, and the belief that the source has enough information/observations to judge the recipient
accurately. Trustworthiness represents whether or not the recipient believes the feedback source is
providing accurate performance information.
Page 18 of 69
supervisor is not directly observing the employee, or is not believed to have the expertise to
provide knowledge and evaluate them, the feedback that is provided may not be seen as credible.
Therefore, the employee is less likely to ask for feedback or to use the feedback from this source.
While credibility plays an important part in seeking and using feedback, power is also an
t
important factor in the recipient’s decision to use feedback. The expectation is that the higher the
ip
power of the source, the more likely the recipient will attempt to use the feedback.5 Ilgen et al.
cr
(1979) predict that the more the source is seen as able to control valued outcomes, the more likely
us
the recipient is to respond to feedback from that source. Stated succinctly, increased power will
result in increased compliance even in situations where feedback is not accepted. Power in the
an
feedback context is an understudied variable, as is the potential conflict between power and
credibility of the source. Given the potential affect both credibility and power have in a professional
M
setting, this review suggests future research related to these aspects is warranted.
One other more recent areas of study is the effect of leadership style on feedback seeking
d
and use. Levy et al. (2002) find that subordinates who view their supervisors as transformational
te
leaders (as opposed to transactional leaders) have greater intentions of seeking feedback from their
While no studies appear to directly assess leadership style and feedback use, prior studies do find
transformational leadership to have positive effects on leadership trust (Podsakoff, MacKenzie, &
Ac
Bommer, 1996), perceptions of relationship quality (Gregory & Levy, 2011), job satisfaction and
work absenteeism (George & Jones, 1997; Staw, Sutton, & Pelled, 1994) and performance (Howell &
Avolio, 1993). A number of these effects are known to be positively associated with feedback use,
5Power refers specifically to the recipient’s belief that the source has the ability to influence outcomes valued
by the recipient (i.e., better tasks, more responsibility, salary and promotions).
Page 19 of 69
suggesting that transformational leadership is likely to have a direct effect on feedback use as well.
Overall, it is evident from the vast number of studies on feedback source that both source
identity and specific attributes of the source have the potential to influence feedback seeking and
t
use. However, researchers continue to examine how feedback source interacts with other key
ip
feedback factors as well as the role feedback source can play in mediating individuals’ reactions to
cr
feedback. Further studies that assess the source in professional settings are likely to play a valuable
us
role in improving our understanding of the effect of feedback source on an individual’s behavior.
an
The feedback message can vary along a number of dimensions. The most highly researched
aspects are sign and type. However, this review also briefly discusses other factors that may apply
M
to future audit research. In the sections below, the dimensions are summarized and key research
4.2.2.1 Sign
Messages conveyed during the feedback process can indicate a range of performance, from
p
good to bad. In most academic literature, feedback sign, is identified as either positive (i.e., the
ce
individual is performing well) or negative (i.e., the individual is performing poorly). Positive
feedback is generally expected to reinforce good behaviors whereas negative feedback is usually
Ac
presumed to discourage bad behaviors. Research in this area examines both the reaction of
recipients to the feedback and the behaviors of those providing the feedback.
Based on a wide array of research, the effects of feedback sign appear quite complex.
Negative feedback can result in “giving up” or “trying harder” and positive feedback may lead to
“sitting on one’s laurels” or “doubling one’s efforts”(Cianci et al., 2010; Van-Dijk & Kluger, 2004). A
number of studies focus on a control theory perspective and find that failure motivates more than
success (Carver & Scheier, 1981; Podsakoff & Farh, 1989). However, another set of studies focuses
Page 20 of 69
on individual factors (e.g., aspirations and self-efficacy) and find that positive feedback motivates
people to try harder and to raise their goals (Bandura, 1986), whereas negative feedback can be
detrimental (Ilgen & Davis, 2000), resulting in defensiveness, dissatisfaction and denial by feedback
t
To reduce the impact of negative feedback the most common reaction by the recipient is to
ip
reject it (Fedor, Eder, & Buckley, 1989; Ilgen et al., 1979). Fedor et al. (1989) find that negative
cr
feedback is less accepted and perceived as less accurate than positive feedback. However, before
us
the feedback even reaches the intended recipient the uncertainty of reactions to negative feedback
lead managers to avoid, delay and distort their feedback to subordinates (Benedict & Levine, 1988;
an
Fisher, 1979). For example, Larson finds (1986) that supervisors are significantly less likely to
provide performance feedback when their subordinates fail to successfully meet their performance
M
goals than when subordinates meet their goals. This study also reports that some supervisors give
positive feedback even when their subordinate performs poorly. Fisher (1979) also demonstrates
d
that supervisors have the tendency to inflate feedback given to poor performers. This distortion
te
may be even stronger in field settings, where there are longer and closer relationships between the
Due to the complexity of reactions to feedback sign, studies to date primarily focus on
ce
understanding variables that moderate and mediate these reactions. A few studies propose that the
impact of feedback sign on perception and acceptance may be influenced by feedback consistency,
Ac
feedback source, and feedback quality. Stone and Stone (1985) find that when inconsistencies exist
between feedback sources, individuals tend to discount the less favorable information, perceiving it
as less accurate.6 Halperin et al. (1976) find that when feedback is positive, the source makes little
difference to the acceptance of feedback, but when it is negative, the less power the source has, the
less feedback acceptance occurs. Additionally, Podsakoff and Farh (1989) find that subjects who
Page 21 of 69
receive more credible negative feedback set higher goals and perform at higher levels than subjects
who receive less credible negative feedback. However, subjects who receive positive feedback have
similar goal attainment and performance regardless of the credibility of the source.
t
negative feedback. The results indicate that favorable contextual characteristics can mitigate the
ip
negative consequences of unfavorable feedback. In fact, credibility, quality, and delivery of feedback
cr
have a larger impact on satisfaction with feedback and motivation to improve than did unfavorable
us
feedback. The findings imply that employees are most motivated to modify their job performance
when unfavorable feedback is from a credible source, is of high quality, and/or is delivered in a
an
considerate and constructive manner. Therefore, supervisors that pay attention to contextual
factors when providing negative feedback may help ensure the feedback recipient will respond
M
more positively and be more inclined to alter behaviors based on that feedback.
Nadler (1979) investigates feedback in groups and finds that feedback sign at the group
d
level affects behavior differently. In groups, individuals take personal responsibility for positive
te
feedback, but attribute negative feedback to other group members. As a result, individuals shift
attributions of failure from themselves to the group. This may be a particularly useful finding to
p
expand upon in professional settings where employees are often working in teams. This finding
ce
suggests it is important to provide feedback specific to the tasks the individual actually did, rather
A few recent studies examine situational factors that may help to explain why different
individuals respond to the same feedback in divergent ways. Van-Dijk and Kluger (2004) examine
how varying levels of motivation are induced by success or failure. The study finds that when
people are in a promotion focus, positive feedback increases their motivation more than negative
feedback. Alternatively, when people are in a prevention focus, negative feedback increases their
motivation more than positive feedback. The researchers suggest that a feedback system should fit
Page 22 of 69
the employee’s occupation, values, and motives for work, resulting in a need for both reward-
oriented and punishment oriented feedback systems. Cianci et al. (2010) find individuals assigned
learning goals improve more than individuals assigned performance goals after receiving negative
feedback, whereas individuals assigned performance goals appear to perform better following
t
positive feedback. In addition, they find a person’s disposition towards the belief that people can
ip
change or improve mitigates the effect of goal type on performance. That is, an individual with a
cr
performance goal is discouraged to a lesser extent by negative feedback when they believe
us
performance improvement is possible. These studies taken together suggest simple framing of an
individual’s focus or goals can change the manner in which they respond to feedback sign.
an
Despite a significant amount of research related to feedback sign, researchers have only just
begun to examine factors that mitigate and accentuate recipients’ reactions to positive and negative
M
feedback. Providing accurate feedback regardless of sign is critical to performance improvement
and therefore warrants continued research. The persistent reluctance of managers to provide
d
negative feedback indicates that research on methods and practices to successfully incorporate this
te
type of feedback is essential. Professional work environments provide an ideal context to analyze
4.2.2.2 Type
The research on feedback type primarily focuses on multiple cue probabilistic learning
(MCPL) techniques. MCPL researchers investigate the ability of different types of feedback to
Ac
judgment strategies. Three types of feedback are identified in the MCPL literature, including
outcome feedback, which is defined as providing the correct answer or information about the
outcome; task-properties feedback, which is information explaining why the outcome occurred or
how to determine the outcome; and cognitive feedback, or information about the judgment strategy
being used by the subject in relation to the task properties feedback. Research on feedback type
Page 23 of 69
focuses primarily on outcome feedback and task-properties feedback. The literature indicates only
certain types of feedback produce high-quality learning. In addition, educational research related to
feedback also identifies similar findings (see Hattie and Timperly 2007 for a comprehensive
review).
t
Studies find outcome feedback does not generally promote learning because subjects tend
ip
to change their procedures haphazardly based on inferences from the outcomes, or they do not use
cr
the feedback correctly or in its entirety (see Balzer et al. 1989 for a review). However, Kluger and
us
DeNisi (1996) suggest that task attributes (e.g., task complexity and predictability) may moderate
the effect of outcome feedback. Alternatively, task properties feedback usually reduces the amount
an
of ambiguity and has therefore been shown to improve judgment in a wide variety of tasks.
Additionally, task feedback combined with outcome feedback stimulates learning better than
M
outcome feedback alone (Balzer, Doherty, & O'Connor, 1989).
Finally, cognitive feedback aims to provide individuals with insight into their judgment
d
policies. However, the tasks in the psychology literature are relatively simple, and as such, do not
te
demonstrate that cognitive feedback improves performance. Balzer et al. (1989) suggest that in
more complex tasks, wherein individuals are not aware of which cues are important to their
p
judgments, cognitive feedback may be more effective. Psychology research also examines the
ce
combination of task and cognitive feedback, but no findings indicate that the combination is
particularly advantageous in improving performance (Balzer, Sulsky, Hammer, & Sumner, 1992).
Ac
learning where answers and task information are readily available. As tasks become more complex,
or feedback is not specific, the usefulness of this type of feedback diminishes. In the auditing section
below, multiple studies are noted that expand on the research identified in this section, and help to
answer some of the questions regarding task predictability and complexity identified above.
4.2.2.3 Quality
Page 24 of 69
Feedback quality is made up of a number of variables. High-quality feedback is defined as
consistent across time, specific and provides information useful to performance outcomes (London,
2003; Steelman, Levy, & Snell, 2004). Feedback high in quality impacts subsequent performance in
a positive, consistent manner (Kluger & DeNisi, 1996). Feedback quality has emerged as a key
t
construct in determining feedback seeking and feedback use (Steelman & Rutkowski, 2004;
ip
Whitaker & Levy, 2012).
cr
Consistency of feedback over time and across sources is noted as important primarily
us
because inconsistent feedback is likely to increase the probability that the feedback recipient will
attribute only feedback they feel is accurate and disregard all other feedback (D. L. Stone & Stone,
an
1985; E. F. Stone & Stone, 1984). A variety of research investigates the role of consistency of
feedback. Haas and Maehr (1965) show that the greater the number of agents who provide
M
consistent feedback to a person, the greater the change in the person’s self-perceptions and the
more enduring the changes are. Additionally Stone and Stone (1984) find that consistent feedback
d
from two feedback agents has a greater impact on self-perceived task competence than repeated
te
feedback by one agent. Extending this study, Stone and Stone (1985) find that unless the person
receives consistent feedback from feedback agents, the perceived accuracy of the feedback is
p
adversely affected. These studies suggest it is important for organizations to consider how best to
ce
ensure feedback remains consistent when feedback may be coming from a variety of sources.
feedback that is specific allows for the recipient to better understand what they have done and
what they should be doing. It also allows for the recipient to set goals that are specific. Specific goals
are consistently found superior to general goals (Steers & Porter, 1974). In addition, the usefulness
of feedback, evaluated from the recipient’s point of view, is identified as a key factor in whether the
recipient accepts and is willing to seek and respond to feedback (Ilgen et al., 1979; Whitaker &
Levy, 2012).
Page 25 of 69
Steelman and Rutkowski (2004) find that feedback quality significantly moderates the
relationship between unfavorable feedback and motivation to use feedback. Therefore, employees
are motivated to use unfavorable feedback that is perceived to be of high quality to improve their
performance compared to unfavorable feedback that is of low quality. In addition Whitaker and
t
Levy (2012) find that feedback quality is a factor in an individual’s perception of feedback utility
ip
which in turn affects the likelihood that the individual will seek feedback. These findings indicate it
cr
is important to train managers in how to provide quality feedback. It also suggests organizations
us
need to be more aware as to whether the feedback mechanisms they have in place are designed to
provide high quality feedback, and whether the organization is properly encouraging supervisors to
an
take appropriate time to provide quality feedback.
Feedback quality has a number of characteristics, even beyond those identified above.
M
While it may seem obvious that feedback needs to be of high quality to be of value, the question
remains as to what defines quality to an individual. Research that focuses on understanding the
d
aspects of feedback quality that best motivates individuals to use the feedback should be a
te
4.2.2.4 Frequency
The literature generally assumes more frequent feedback enhances individual learning and
ce
task performance (Salmoni, Schmidt, & Walter, 1984). The rationale for this assumption is that
greater frequency translates into greater accuracy in perceptions, enhances satisfaction and
Ac
interest in tasks, and provides feelings of competence which increase intrinsic motivation (Chhokar
& Wallin, 1984; Cook, 1967). However, in some settings greater frequency is found to have no
beneficial effect on performance (Chhokar & Wallin, 1984), and a recent study suggests feedback
frequency exhibits an inverted-U relationship with task performance (Lam, DeRue, Karam, &
Hollenback, 2011).
Page 26 of 69
Bilodeau (1966) and Cook (1967, 1968) find that more feedback on simulated tasks results
in better attitudes, improved performance over time and higher levels of aspiration. Chhokar and
Wallin (1984) compare feedback frequency of one week to two weeks for plant workers and find
that performance was about the same in both time periods. However, they did note that when
t
feedback is removed altogether that performance declines, but when added back, performance
ip
again improves. This highlights the importance of feedback overall despite the apparent lack of
cr
significance in frequency of feedback.
us
More recently, Lam et al. (2011) examine the association of feedback frequency with task
performance. The theoretical development uses source allocation theory, which suggests that
an
feedback frequency has a positive effect up to a certain point. However, once feedback frequency
reaches higher levels, the cognitive demand on individuals to respond and process the information
M
becomes overwhelming. The results indicate that feedback frequency exhibits an inverted-U
relationship with task performance, and this relationship is mediated by task effort.
d
In addition to the potential cognitive demand, other researchers suggest increased feedback
te
frequency may have opposing effects on an individual’s feelings of competence and personal
control. Feelings of competence are expected to increase as individuals gain knowledge through the
p
feedback process (Ilgen et al., 1979), whereas feelings of personal control are expected to decrease
ce
as individuals see feedback as a means of controlling their behavior (Chhokar & Wallin, 1984).
Competence and personal control are both linked to intrinsic motivation, and both must be high in
Ac
order to have intrinsic motivation on the job. This implies that it is important to find an optimal
balance of feedback frequency in order for individuals to feel competent and yet not feel that they
Overall, the research on feedback frequency is sparse, especially research that looks at
frequency in a professional setting. The studies noted above are difficult to relate to an actual
professional environment where formal feedback is received much more infrequently and with
Page 27 of 69
multiple feedback variables simultaneously involved. Future research that considers this variable in
a professional context is necessary, especially when interactions of other feedback variables can be
examined at the same time. In addition, there does not appear to be literature that examines how
the frequency of seeking feedback affects an individual’s motivation, learning, and performance.
t
ip
4.2.2.5 Timing
Timing specifically refers to the interval between the individual’s behavior or completion of
cr
a task and the receipt of feedback about the behavior or task. Ammons' (1956) review concludes
us
that the longer the delay in the receipt of feedback the less effective feedback is on performance.
Bilodeau (1966) later indicates that timing is made up of two time intervals, the feedback delay,
an
which is the time between the behavior and the feedback, and the post-feedback interval, or the
time between the feedback and the next opportunity to use the feedback. Using this idea, Bourne
M
and Bunderson (1963) conclude in their study that only post-feedback interval affects concept
learning. Additionally, if the time period between the behavior and the feedback is not filled with
d
interfering activities, then learning is not affected by time delay. However, this finding is unlikely to
te
generalize to professional practice where delays can be extensive and interfering activities are
likely to occur.
p
More recently, research also reveals that time delays may elicit frustration, which in turn
ce
can cause suboptimal cognitive processing and substandard performance (Fox & Spector, 1999).
Also, Sheldon et al. (2006) find that time delays may cause individuals to view information provided
Ac
by the person responsible for the delay as less important. However, they note that the status of the
person (i.e., source credibility) moderates the negative effects of time delays.
Similar to findings in the feedback sign section previously detailed, it appears that the
feedback source can have a significant moderating effect on timing, which by itself can cause
negative reactions to feedback. Based on these varied findings of the impact of feedback timing,
continued research of this factor seems necessary. Of particular importance is a need for more
Page 28 of 69
research that examines interactions and the moderating effects of other feedback factors with
feedback timing, as well as research that examines how delayed feedback affects subsequent
t
ip
Early literature presents feedback as a process that occurs between a feedback sender and a
cr
feedback recipient (Ilgen et al., 1979; Morrison & Bies, 1991), whereas more recent literature
highlights the influence of the organizational context on feedback seeking and use (Levy, Albright,
us
Cawley, & Williams, 1995; London & Smither, 2002). This organizational context, referred to as the
feedback environment, is thought to play an influential role in determining how a person will seek,
an
process, and use feedback messages (Anseel & Lievens, 2007; London & Smither, 2002). It helps to
shape an individual’s attitude towards feedback and the extent to which the individual relies on
M
feedback to improve performance (Farr & Levy, 2007; Gregory & Levy, 2011).
Researchers (Levy & Williams, 2004; London & Smither, 2002) emphasize the importance
d
of understanding the role that the feedback environment plays in feedback interactions and
te
processes. Herold and Parsons (1985) identify the feedback environment as an employee’s
p
perception of the type of job performance information they have available to them and develop an
ce
initial scale to assess the availability of different types of feedback information in an organization,
but this scale is not validated and is not actively used in research or practice (Ashford, 1993;
Ac
Steelman et al., 2004). More recent research conceptualizes the feedback environment as an
organizational environment that is supportive of feedback interactions and processes (London &
A strong feedback environment is identified as one in which policies and programs for
performance management are in place, continuous learning is encouraged and career development
is important. Steelman et al. (2004) develop and validate the feedback environment scale (FES) to
measure an employee’s perception of the overall supportiveness for feedback in the workplace.
Page 29 of 69
This instrument measures a more comprehensive view of the feedback environment than prior
instruments by taking into account both supervisor and coworker feedback (Steelman et al., 2004;
Whitaker, Dahling, & Levy, 2007).7 In addition to validating the FES, Steelman et al. (2004) find that
employees in a positive feedback environment are more motivated to use feedback, are more
t
satisfied with the feedback, and seek feedback more frequently. In a follow-up study, Steelman and
ip
Rutkowsi (2004) find some of the dimensions of the feedback environment, including source
cr
credibility, feedback quality and feedback delivery, mitigate the unwanted effects of negative
us
feedback.
A few recent studies examine the effects of the feedback environment on work-related
an
outcomes. Specifically, the feedback environment is positively related to organizational citizenship
behavior of employees, but this relationship is mediated by their affective commitment (Norris-
M
Watts & Levy, 2004). Also, employees who perceive a supportive feedback environment increase
feedback seeking, have higher role clarity and higher performance ratings (Whitaker et al., 2007).
d
In addition, a couple of studies (Anseel & Lievens, 2007; Gregory & Levy, 2011) examine
te
associations between the feedback environment and the relationship between a supervisor and a
subordinate, finding subordinates perceptions of the relationship quality fully mediate the
p
relationship between the feedback environment and an employee’s job satisfaction and the
ce
Overall, findings from psychology and management indicate that the feedback environment
is positively associated with several work-related outcomes. As such, researchers need to continue
to gain a better understanding of the mechanisms that support feedback in an organization, and
7 The FES measures an employee’s perception of supervisor and coworker feedback environments in terms of
seven dimensions. These include source credibility, feedback quality, frequency of positive feedback,
frequency of negative feedback, feedback delivery, source availability, and the extent to which feedback-
seeking behavior is encouraged (Steelman et al., 2004).
Page 30 of 69
target areas where further development may be necessary. In addition, researchers should examine
interventions and trainings at both the supervisor and subordinate level that may help to improve
the feedback environment within the organization. Finally, research suggests that there are both
mediating and moderating factors that can play a role on the relationship between the feedback
t
environment and desired work outcomes, as such research needs to continue to examine other
ip
factors that may affect this relationship.
cr
4.2.4 Overall Conclusions regarding Contextual Factors
us
Based on the research performed to date, contextual factors play an important role in a
person’s decision to seek and to use feedback. The more recent psychology and management
an
literature on these factors has become more theoretically based and focuses more on the social
context in which feedback is given (i.e., the feedback environment). However, similar to the
M
research on individual factors, the studies examining these factors in a professional context, where
they have the most relevance, are limited. Future research needs to examine how these contextual
d
Auditing research on the contextual factors of feedback focus primarily on feedback source
ce
and feedback type (see Table 1 for a summary of the audit research on feedback). However, there
are two additional contextual factors identified in this review that are not explicitly addressed in
Ac
prior psychology and management literatures, but are important in the audit setting. These are
feedback method (e.g., electronic, face-to-face) and feedback emphasis (i.e., the performance
characteristics of the source matter in determining who an individual will seek feedback from and
Page 31 of 69
how they will react and use the feedback they receive. In the audit environment, there are a number
assigned coach or mentor, a performance manager) who can have varying personal attributes (e.g.,
t
Belkaoui and Picur (1987) provide one of the few audit studies examining how source
ip
identity affects the auditor’s perception of the reliability of information received. The study finds
cr
that information on job tasks and requirements and appraisal information originate from different
us
sources, which differ in terms of how informative they are. The supervisor is consistently identified
as the most reliable source for both relevant information and appraisal information by study
an
participants. This finding is notably different from psychology studies where self and task are
considered particularly important (Greller & Herold, 1975). This finding suggests that due to the
M
complexities of audit tasks, auditors cannot rely on the task and self to learn and improve, rather
they require feedback from supervisors to gauge their performance and to develop technical
d
Feedback source attributes are commonly examined in the psychology and management
literature, but do not appear to be a focus in the auditing literature despite the clear implications of
p
the effects of source attributes on feedback seeking and use (Anseel et al., 2013; Ilgen et al., 1979).
ce
While expertise is a widely discussed construct in the audit literature, few prior studies have
examined the effect of source expertise on an auditor’s likelihood of seeking feedback or using
Ac
One exception is Schaefer (2013); the study finds that auditors’ concerns about their ego
and image affect who they will seek advice from, but concerns of a potential internal quality review
(IQR) make auditors more likely to seek advice from a knowledgeable source (i.e., the engagement
Page 32 of 69
manager rather than a peer).8 The relationship between feedback seeking and ego and image
concerns is well documented in the psychology literature (Anseel, Lievens, & Levy, 2007; Ashford et
al., 2003; Morrison & Bies, 1991). Schaefer (2013) highlights how a specific auditing contextual
factor (i.e. IQR) mitigates auditors’ impression management attempts. Kadous et al. (2013) also
t
examine sources of advice, finding advice from a stronger social bond advisor is weighted more
ip
heavily regardless of how well justified the advice is. They indicate that non-specialist auditors’
cr
feelings of trust in the advisor may overshadow their ability to objectively assess the quality of the
us
advice. These studies, taken together, suggest that auditors may not always seek feedback from the
most knowledgeable source and may not be able to properly assess the quality of feedback when
an
strong relationships are formed with the source. Audit researchers should continue to investigate
circumstances that both encourage and discourage appropriate seeking and accepting of feedback
M
as this is an important piece of the coaching and quality control process in audit firms.
In a professional context source power is often associated with an individual’s job title, but
d
often it is the individual’s underlying characteristics that give them power (e.g., expertise, status
te
within the firm). Fedor and Ramsay (2007) examine the effects of workpaper preparers’
perceptions of reviewers’ power on their responses to a workpaper review. The study finds that, in
p
general, preparers attempt to improve performance and seek feedback in response to a workpaper
ce
review, and if the review is particularly negative, they also try to manage the reviewer’s
impressions of them. However, preparers’ perceptions of the reviewer’s power differentially affect
Ac
a preparer’s response. Reviewers perceived as having referent power, the ability to make a
subordinate feel valued, has positive effects on preparers’ efforts to improve and to seek feedback
and they are less likely to attempt to manage the reviewer’s impressions of them. A reviewer with
expertise (expert power) positively affects feedback seeking, whereas perceived ability to punish
8This study specifically examines advice seeking, rather than feedback seeking, however the advice source
construct is similar to that of feedback source and is therefore worthwhile to include in this review.
Page 33 of 69
(coercive power) has negative effects on performance improvement efforts and feedback seeking.
In addition, the researchers find that power perceptions of reviewers by preparers in an auditing
context are different than those in other contexts as studied by Fedor et al. (2001).
Another source attribute studied in the auditing context is leadership style. As mentioned
t
above, recent management literature has focused on the transformational leadership construct to
ip
assess leadership style, but prior literature identifies two underlying characteristics of leadership
cr
style, structure and consideration (Fleishman & Peters, 1962) which are the measurements
us
primarily used in the audit literature (Otley & Pierce, 1995; Pierce & Sweeney, 2004; Pratt &
Jiambalvo, 1982). While audit literature has examined leadership style in relation to audit team
an
performance and dysfunctional behaviors (Pierce & Sweeney, 2004; Pratt & Jiambalvo, 1982) it
does not appear that prior audit literature examines the effects of leadership style on feedback
M
seeking and use.
A few auditing studies that do not directly measure leadership style, find certain leader
d
behaviors impact staff auditors’ behaviors. Kida (1984) finds supportive behavior by an audit
te
manager during review meetings relate to seniors’ satisfaction with the meetings and their
manager, but not to performance improvement. Also, Stefaniak and Robertson (2010) find prior
p
supervisors reactions to errors made by an auditor, influence the likelihood the auditor will admit
ce
mistakes in the future. These studies suggest that leader behaviors and their style of management
likely influence whether a staff auditor will seek feedback and be receptive to feedback based on
Ac
Unlike the psychology and management literature, the studies in the audit literature do not
find a consistent positive relationship with leadership style and staff auditor behavior. This may be
due to specific audit environment factors (e.g., the greater number of “leaders” auditors work with
during the year or auditor time/budget pressures playing a more important role) or engagement or
task specific factors (e.g., client-specific circumstances or complexity of the task being performed).
Page 34 of 69
Due to these inconsistencies, it is warranted for auditing researchers to examine how leadership
style of the source and contextual factors of the audit environment may interact to impact feedback
The auditing literature has examined a number of factors related to feedback source, but the
t
breadth and depth is fairly limited overall. Of particular importance is to examine how
ip
characteristics of the feedback source interact with specific auditing contextual factors, including
cr
complexity of the task, time/budget pressures, client characteristics, etc. The auditing context
us
allows for an extension of research on feedback source due to the uniqueness of contextual factors
in the environment.
an
4.2.5.2 Feedback Message
As noted in the review of literature in psychology and management, feedback message
M
encompasses a number of contextual factors related to how and what is conveyed through
performance feedback. The review in this section covers the factors most heavily studied by audit
d
researchers and those that appear to have the most future relevance to auditing studies.
te
One area that audit researchers have examined in some depth relates to the effects of
p
different feedback types on task learning. Similar to studies in psychology, audit researchers focus
ce
heavily on the varying effects of outcome feedback, process feedback, cognitive feedback, and
various combinations of these feedback options (Ashton, 1990; C. E. Earley, 2003; Hirst, Luckett, &
Ac
Unlike the research in psychology, audit research has shown that under certain conditions,
outcome feedback can have an effect on task learning and performance (Ashton, 1990; Bonner &
Walker, 1994; Hirst et al., 1999). Ashton (1990) examines outcome feedback in combination with a
decision aid and finds that when outcome feedback is present with no decision aid, the accuracy of
subjects is greater than those with neither feedback nor a decision aid. However, when a decision
Page 35 of 69
aid is present, outcome feedback has no effect on accuracy. The task used allows for an actual
immediate right or wrong answer, but this is often not possible in auditing practice.9 Therefore, a
number of researchers have since expanded on this study by varying the type of feedback,
combining multiple types of feedback, and examining other task characteristics that may interact
t
with feedback to affect task learning and performance.
ip
Bonner and Walker (1994) find that outcome feedback assists with knowledge acquisition
cr
only when significant instruction precedes the task, while explanatory feedback with any pretask
us
instruction produces knowledge gains. This study suggests that when prior knowledge is provided,
auditors are able to learn from outcome feedback. Earley (2001) expands on this study by
an
investigating explanatory feedback and self-explanation (subjects generate explanations that clarify
the actual outcomes). Both treatments result in higher accuracy than providing no feedback, and
M
the combination results in higher accuracy than either treatment by itself. Together, these findings
A few studies examine factors that may interact with feedback type in the audit
environment. Hirst et al. (1999) varies the level of task predictability and shows that outcome
p
feedback, by itself and in combination with task properties feedback, promotes judgment accuracy
ce
for both high and medium levels of task predictability. As tasks in auditing can vary in complexity,
Leung and Trotman (2005, 2008) extend this prior research by examining the interaction of
Ac
feedback type and task complexity. The combination of task-properties and cognitive feedback is
feedback is more effective in the less complex task, while cognitive feedback is more effective for
the more complex task. Overall, the results suggest the nature of the task moderates the effects of
different types of feedback and feedback that includes only information as to what judgment should
Page 36 of 69
have been made (i.e., outcome feedback) is not enough when auditors are completing complex
tasks. Finally, Bryant et al. (2009) examine the interaction of feedback type and an auditor’s
cognitive style. They find outcome feedback and cognitive style feedback together have a negative
effect on pattern-oriented individuals (i.e., intuitives) performance, but a positive effect on detailed-
t
oriented individuals (i.e., sensors) performance.
ip
Together these studies indicate feedback type has an effect on an auditor’s learning,
cr
performance, and judgment. Studies that only vary feedback type and those that examine it in
us
combination with other factors provide evidence that auditors are affected by the feedback they
receive and this is heavily dependent on the type of task the auditor is performing. As outcome
an
feedback is often not available on a timely basis, research that examines how other types of
feedback may assist in learning and performance are worth continued study. As most of this
M
research focuses heavily on specific auditor tasks it may be beneficial to expand research into other
forms of feedback (i.e., workpaper reviews and engagement reviews) available to auditors.
d
A feedback message variable that is fairly unique to the audit environment is feedback
method (e.g., electronic and face-to-face). This research not only has informed audit practice, but it
p
has expanded the list of feedback factors previously identified and studied in the psychology and
ce
management literatures. The research in this area capitalized on a significant change in the audit
environment from hard copy paper audit files to electronic audit files. With the switch in file types,
Ac
also came the ability to choose to review audit workpapers electronically or to meet with the
A number of studies examine the effects of review method on the workpaper preparers
feelings of accountability, level of effort and effectiveness, and the resulting workpaper quality
(Agoglia et al., 2009; Bamber, Payne, & Ramsay, 2011; Brazel, Agoglia, & Hatfield, 2004; Payne,
Ramsay, & Bamber, 2010). Brazel et al. (2004) find that the method of review affects the preparer’s
Page 37 of 69
effectiveness and efficiency. Specifically, the anticipation of a face-to-face review increases auditors’
effectiveness, decreases their efficiency and makes them feel more accountable than either an
electronic or no-review condition. In an extension of this study, Agoglia et al. (2009) find that
preparers that are reviewed electronically provide their reviewers with lower-quality workpaper
t
documentation than preparers that are reviewed face-to-face. Both studies highlight that the level
ip
of accountability appears to vary depending on the feedback method and this perception of
cr
accountability affects the quality of the workpaper.
us
Another study that specifically examines accountability pressure but uses review and
feedback as manipulations of this pressure is DeZoort et al. (2006). They find auditors under high
an
accountability pressure (i.e., response requires justification and formal feedback will be provided)
provide more conservative judgments and have less judgment variability than auditors with lower
M
levels of pressure (i.e., partner review will be conducted and anonymity). While this study’s
variable manipulations are different, it supports the previous contention that varying the manner in
d
which feedback is expected to be given to audit staff affects their behavior and subsequent
te
judgment.
Bamber et al. (2011) perform a similar study with a different task, examining the effects of
p
review method on auditor performance and accountability. The results show that electronic,
ce
discussion, and interview methods all stimulate a high level of accountability, but an electronic
review elicits significantly greater accountability than the interview method. The findings also show
Ac
that auditors anticipating an interview detect more conceptual errors than auditors anticipating
either an electronic or discussion review. This study’s findings vary from that of Brazel et al. (2004)
and Agoglia et al. (2009) in that electronic review appears to elicit significant accountability
compared to discussion or interview. This suggests task differences may play a role in the response
to various review methods. In addition, it appears that feedback method may actually influence
Page 38 of 69
Not only does the feedback method affect the efficiency, quality and level of accountability
of the preparer, but it is shown to impact an auditor’s motivation to improve performance (Miller et
al., 2006), as well as an auditor’s attention to procedures, which in turn appears to help in the
identification of trends indicative of fraud (Payne et al., 2010). Miller et al. (2006) find
t
incorporating discussion of performance with written review notes enhances preparers’ motivation
ip
to improve performance. Payne et al. (2010) find auditors, who anticipate an interactive review,
cr
focus more on conclusion-oriented audit procedures, which leads to better performance in
us
identifying a trend that may be indicative of fraud.
These studies taken together suggest researchers should continue to examine feedback
an
method, taking into account contextual factors that may potentially exacerbate or improve an
auditor’s response to feedback method and the level of accountability they feel. If feelings of
M
accountability are impacted by the feedback method, it appears worthwhile to examine other
feedback factors that have been shown to mitigate negative effects, like feedback source or
d
feedback quality. It may also be worthwhile to investigate whether these findings which focus
te
primarily on task and workpaper reviews generalize to other feedback mechanisms in the audit
4.2.5.2.3 Sign
ce
context. While prior psychology research suggests both positive and negative feedback are
Ac
necessary for performance improvement, a recent qualitative study (Westermann et al., 2014) in
auditing notes that audit managers are reluctant to provide negative feedback due to concerns that
staff auditors will leave the firm or retaliate by providing poor upward feedback. However, recent
interactions with practitioners also indicate inspection and litigation concerns have made feedback
more compliance based and critical in general. These somewhat contradicting ideas suggest it is
Page 39 of 69
important to examine feedback sign in the auditing context, and yet only a few studies have
examined this variable to date (Cianci & Bierstaker, 2009; Fedor & Ramsay, 2007; Kida, 1984).
In examining criticism, Kida (1984) reveals that seniors view managerial criticism as
positively affecting their job performance as long as the criticism is directed at specific job aspects
t
and not the senior personally. Fedor and Ramsay (2007) examine the effect of source power on
ip
audit staff response to review using the sign of feedback as a control variable. This study finds
cr
auditors who reported higher levels of impression management were significantly more likely to
us
have reported the review as negative feedback. Finally, Cianci and Bierstaker (2009) examine
whether prior poor or exceptional performance, as noted in an annual review, impacts auditors’
an
subsequent ethical decision making. They find auditors who receive positive feedback make more
ethical judgments on both self-focused and public focused ethical tasks compared to those auditors
M
who receive negative feedback. They also find auditors who receive positive feedback when
auditing less important clients make the most ethical judgments on both self-focused and public-
d
focused tasks. These findings suggest auditors are susceptible to pressure from negative feedback
te
and client importance, even when the judgment has public consequences.
conclusions from these studies due to the inconsistencies in the findings. Two of these studies
ce
(Cianci & Bierstaker, 2009; Fedor & Ramsay, 2007) suggest negative feedback may result in
undesirable behaviors, whereas one (Kida, 1984) suggests that when negative feedback is given in
Ac
the appropriate manner it can positively affect auditor behavior. Given that more recent research in
psychology and management suggests certain contextual factors can improve individual’s response
to negative feedback it seems important to further this line of research in the audit setting. While
the above findings are inconsistent they suggest that feedback sign has the potential to impact
4.2.5.2.4 Emphasis
Page 40 of 69
Research in psychology and management has not explicitly identified feedback emphasis as
appraisal and coaching appear to suggest that dimensions emphasized during performance review
and the approach taken by a coach in providing feedback affect individual’s subsequent behaviors
t
(Gregory, Levy, & Jeffers, 2008; Hunt, 1995). Audit researchers find that a number of dimensions
ip
may be highlighted by a supervising auditor during performance feedback and the weighting of
cr
these dimensions can vary significantly depending on preferences of the supervisor (Kida, 1984;
us
Wright, 1980, 1982)
This emphasis on specific dimensions is shown to impact a variety of auditor behaviors. One
an
study finds the emphasis of audit supervisors on specific job dimensions affects the amount of
effort auditors direct towards various aspects of their job (Jiambalvo, 1979). Shankar and Ng
M
(2008) examine two-specific dimensions of performance evaluation, either demonstrating
expertise or building client relationships, and find auditors are less (more) likely to accept the
d
expertise and they receive technical advice to not support (support) the client’s method.
A couple of studies (Pierce & Sweeney, 2004; Sweeney & Pierce, 2004) examine whether the
p
technical ability) affect dysfunctional auditor behaviors. These studies find both target-constrained
Ac
and non-accounting styles result in dysfunctional auditor behavior, but the behavior varies
Finally, Lambert and Agoglia (2011) examine emphasis during the workpaper review
process, where the reviewer stresses either conclusion or documentation during the review. This
study finds emphasis on conclusion-framed review notes leads to higher effort levels than
10 For instance, higher under-reporting of time is significantly associated with a target-constrained style.
Page 41 of 69
documentation-framed review notes. While the emphasis in this case is not directly linked to
performance evaluation, similar to prior research, one would expect that the reviewee believes
focusing on the aspects highlighted in the workpaper review will lead to positive results when the
t
Overall, audit research finds that the dimensions emphasized by a supervisor during
ip
performance feedback affect audit staff’s subsequent behaviors. While a number of factors related
cr
to feedback emphasis have been examined, research on feedback and coaching suggest other
us
factors may be worth examining. For instance, goal emphasis in combination with feedback is
shown to play an important role in feedback acceptance and response (Ilgen & Davis, 2000). In
an
addition, the audit environment has changed quite substantially over the last ten years, suggesting
the dimensions emphasized during performance feedback may have changed in response to new
M
pressures and regulatory requirements.
Similar to studies in psychology and management, both the timing of feedback and the
te
frequency of feedback appear to affect auditor behavior. Both anecdotal evidence and qualitative
research suggest that significant time delays may exist in the performance feedback process
p
(Anderson-Gough et al., 1998; Lambert & Agoglia, 2011). However, only a few studies to date
ce
specifically examine timing delays in the audit setting. Lambert and Agoglia (2011) find that a
timely review can enhance reviewee effort and the combination of a timely review and conclusion-
Ac
framed review notes leads to better performance. In addition, they find delayed reviews are
associated with increased dysfunctional audit behavior (i.e., ghost-ticking). Earley (2003) also
examines timing delay, but this study focuses on the lack of timely outcome feedback, an imbedded
issue in the audit setting where actual answers are not necessarily known until months or years
after an audit report is issued. The study finds that auditors who receive outcome feedback before
generating explanations exhibit a higher level of reasoning and performance than those who do not
Page 42 of 69
receive the feedback prior to generating explanations. Together these studies suggest that, when
available, timely feedback induces greater effort and better performance of staff auditors.
Audit research also suggests there is great diversity in the frequency in which performance
feedback is given (Wright, 1980). However, only one study (Pierce & Sweeney, 2004) to date has
t
examined the effect of feedback frequency on auditor behavior. Pierce and Sweeney (2004) find
ip
that respondents whose performance is evaluated after each assignment report significantly lower
cr
dysfunctional behaviors than respondents who are evaluated less frequently. These findings
us
support the related research in management and psychology and suggest the critical importance of
an
Overall, audit research findings are consistent with prior research in psychology and
suggests the source of feedback may reduce the negative effects of delayed feedback. However, it is
d
not clear whether this finding would carry over to the audit setting. In addition, more recent
te
auditing, it is an empirical question whether the multitude of feedback opportunities available (e.g.,
p
workpaper reviews, engagement reviews, annual reviews, informal feedback) may induce a similar
ce
effect.
Ac
management literatures, but a couple of studies within the auditing context suggest this may be an
important factor to consider. Anderson-Gough (1998) examine overall socialization of new auditors
highlighting a number of feedback related issues, including performance feedback being too general
and not representing the work actually performed. Also, auditor trainees mention that the
dimensions identified in performance reviews are not integrated well with the values and norms of
Page 43 of 69
the auditors. This evidence suggests issues with the feedback environment in audit firms which
have the potential to impact auditor behavior. In following up on this potential concern, Dalton and
firms and whether they are associated with negative job outcomes. In addition, this study examines
t
whether mentoring relationships help to mitigate the adverse effects of these environments. They
ip
find unfavorable supervisory feedback environments are associated with lower levels of
cr
organizational commitment, role clarity, and job satisfaction, but they do find that strong mentoring
us
relationships help to mitigate the effects of these environments.
The limited studies in auditing suggest further examination of the feedback environment is
an
warranted. Future research needs to examine both the effects of supportive feedback
environments, as well as to further examine other factors that may mitigate the adverse effects of
M
unfavorable feedback environments, as it certainly appears these exist in public accounting firms.
From the preceding discussion it is apparent that responses of individuals to feedback are
te
complicated by contextual factors, yet there is a clear lack of audit research in this area. Based on
p
the research cited in this section, in conjunction with the framework and review of research outside
ce
RQ4: How do the attributes of the feedback source (e.g. power, credibility) affect how
auditors seek and respond to performance feedback? How does varying the source of
Ac
RQ5: What type of feedback is most successful when there is uncertainty (i.e., when
decisions involve judgment)? Can outcome feedback in the form of alternative or preferred
judgments in review comments improve future judgments of the preparer? What effect does
outcome feedback have in more complex auditor situations?
RQ6: Are certain review methods (electronic, face-to-face, interactive, etc.) or types
(outcome, task-properties, cognitive, etc.) better suited to certain individuals? What role
Page 44 of 69
does feedback orientation play in auditor response to the feedback method? Does the effect
of review method vary by the type of review (i.e., workpaper review, engagement review)?
RQ7: What individual factors (e.g., feedback orientation, experience) make auditors more
resistant or accepting of negative or critical feedback? What contextual factors (e.g.
feedback environment, feedback emphasis) make auditors more resistant or accepting of
negative or critical feedback?
t
ip
RQ8: Which dimensions do audit staff perceive as the most important dimensions assessed
during performance review? Do these vary by the type of review (e.g., workpaper,
engagement, annual)? Which dimensions do managers and partners believe are the most
cr
important dimensions? Does the firm culture and “tone-at-the-top” reflect the same or
different dimensions? How do the dimensions emphasized during performance review
affect auditor behavior?
us
RQ9: How timely does performance feedback need to be given in order to reduce the
negative effects on auditor behavior? Are there individual or contextual factors (e.g.,
an
feedback orientation, feedback source) that mitigate the negative effects of delayed
feedback on auditor behavior? How does feedback frequency affect auditor behavior? Is
there too much or too little performance feedback in the audit environment? How does a
supervisors’ feedback quality change as the number of reviews increases?
M
RQ10: What is the feedback environment like in the public accounting firms? How does the
feedback environment affect an auditor’s response to performance feedback? Can
improvements in auditor response to feedback be made through refining the feedback
d
environment of the firm? How does the relationship between the audit supervisor and the
te
audit staff affect seeking of feedback and responding (i.e., effort, performance) to feedback?
Do, and if so, how do audit supervisors adjust performance feedback in response to
individual differences of their subordinates?
p
RQ11: How does the audit environment (i.e., documentation requirements and new
ce
standards) and technology (i.e., new workpaper and performance appraisal systems) affect
an auditor’s response to performance feedback?
Ac
5. Conclusion
This paper takes the position that while performance feedback is recognized by auditing
firms as an important component to ensuring audit quality and for developing staff auditors,
behavior and to the behavioral effects of providing feedback. Furthermore, the review of the
psychology and management literatures suggests the effects of feedback on learning, motivation,
and performance can be quite variable depending on features of the feedback recipient, the
Page 45 of 69
feedback source and the contextual factors of the feedback message and environment. The
complexities of the construct indicate further research is needed to understand the interplay of
various feedback factors and the social context in which feedback is given.
As noted in this review, a number of auditing studies address the performance feedback
t
process, but the studies are narrowly focused overall and an abundance of research opportunities
ip
still exist. Studies of performance feedback in auditing primarily focus on the knowledge acquisition
cr
effects of feedback rather than the potential performance and motivational effects. The studies that
us
investigate the behavioral effects of performance feedback focus heavily on feedback type and
feedback method. While these are certainly key variables to consider, audit researchers need to
an
broaden their scope of factors affecting the learning, performance, and motivation of auditors. In
addition, much of the audit research on performance feedback is quite dated. The audit
M
environment, as well as the feedback mechanism and processes, have changed quite substantially in
the last fifteen years (e.g., new technology, new standards, heightened inspection and litigation
d
concerns, new performance appraisal systems), suggesting this may be an area where a renewed
te
focus is warranted.
To stimulate additional research in this area, I propose eleven research questions focused
p
on gaining an understanding of the current feedback mechanisms in the audit environment and the
ce
implications of these feedback mechanisms on auditor behavior and development, and overall audit
quality. Research addressing these questions has the potential to not only extend academic
Ac
literature on feedback, but to inform practitioners and standard setters to improve the
effectiveness of feedback in the audit environment. Given the significance of performance feedback
to quality control and staff development and the present gap in this literature such research is
critical.
should be taken not to replicate findings reported in the psychology and management literatures.
Page 46 of 69
Audit researchers have the opportunity to use a professional setting to extend and contribute to the
further develop theories to explain the results. Successful research will depend on devising strong
qualitative and experimental studies that will capture the individuals involved and the social
t
context of the feedback process in the audit firm.
ip
Acknowledgements
cr
I appreciate the helpful comments of Jean C. Bedard, Jay C. Thibodeau, and accounting research
workshop participants at Bentley University.
us
an
M
d
p te
ce
Ac
Page 47 of 69
References
Agoglia, C. P., Hatfield, R. C., & Brazel, J. F. (2009). The effects of audit review format on review team
judgments. Auditing: A Journal of Practice & Theory, 28(1), 95-111.
American Institute of Certified Public Accountants (AICPA). (2006). Planning and Supervision AU
Section 311. New York, NY: AICPA.
t
Ammons, R. B. (1956). Effects of knowledge of performance: A survey and tentative theoretical
ip
formulation. The Journal of General Psychology, 54(2), 279-299.
Anderson-Gough, F., Grey, C., & Robson, K. (1998). Making up accountants : the organizational and
professional socialization of trainee chartered accountants. Aldershot, Hants, England;
cr
Brookfield, Vt., USA: Ashgate Pub.
Andrews, M. C., & Kacmar, K. M. (2001). Confirmation and extension of the sources of feedback scale
in service-based organizations. Journal of Business Communication, 38, 206-226.
us
Anseel, F., Beatty, A. S., Shen, W., Lievens, F., & Sackett, P. R. (2013). How Are We Doing After 30
Years? A Meta-Analytic Review of the Antecedents and Outcomes of Feedback-Seeking
Behavior. Forthcoming in Journal of Management.
Anseel, F., & Lievens, F. (2007). The long-term impact of the feedback environment on job
an
satisfaction: A field study in a Belgian context. Applied Psychology: An International Review,
56(2), 254-266.
Anseel, F., Lievens, F., & Levy, P. E. (2007). A self-motives perspective on feedback-seeking
behavior: Linking organizational behavior and social psychology research. International
M
Journal of Management Reviews, 9(3), 211-236.
Asare, S. K., Haynes, C. M., & Jenkins, J. G. (2007). The effects of client and preparer risk factors on
workpaper review effectiveness. Behavioral Research in Accounting, 19, 1-18.
Ashford, S. J. (1993). The feedback environment: An exploratory study of cue use. Journal of
d
1990), 148-180.
Balzer, W. K., Doherty, M. E., & O'Connor, R. (1989). Effects of cognitive feedback on performance.
ce
Bamber, E. M., Payne, E. A., & Ramsay, R. J. (2011). The effect of alternative methods of review on
auditors' accountability and performance. University of Kentucky (Working Paper).
Bandura, A. (1986). Social foundations of thought and action : a social cognitive theory. Englewood
Cliffs, N.J.: Prentice-Hall.
Bass, B. M. (1997). Personal selling and transactional/transformational leadership. The Journal of
Personal Selling and Sales Management, 17(3), 19-28.
Belkaoui, A., & Picur, R. D. (1987). Sources of feedback in a CPA firm. Journal of Business Finance &
Accounting, 14(2), 175-186.
Benedict, M. E., & Levine, E. L. (1988). Delay and distortion: Tacit influences on performance
appraisal effectiveness. Journal of Applied Psychology, 73(3), 507-514.
Bilodeau, I. M. (1966). Information feedback. In E. A. Bilodeau (Ed.), Acquisition of Skill (pp. 255-
296). New York: Academic Press.
Page 48 of 69
Bonner, S. E. (2008). Judgment and Decision Making in Accounting. Upper Saddle River, N.J.:
Pearson/Prentice Hall.
Bonner, S. E., & Walker, P. L. (1994). The effects of instruction and experience on the acquisition of
auditing knowledge. The Accounting Review, 69(1), 157-178.
Bourne, L. E., Jr., & Bunderson, C. V. (1963). Effects of delay of information feedback and length of
postfeedback interval on concept identification. Journal of Experimental Psychology, 65, 1-5.
Braddy, P. W., Sturm, R. E., Atwater, L. E., Smither, J. W., & Fleenor, J. W. (2013). Validating the
feedback orientation scale in a leadership development context. Group & Organization
t
Management, 38(6), 690-716.
ip
Brazel, J. F., Agoglia, C. P., & Hatfield, R. C. (2004). Electronic versus face-to-face review: The effects
of alternative forms of review on auditors' performance. The Accounting Review, 79(4), 949-
cr
966.
Brockner, J., & Chen, Y.-R. (1996). The moderating roles of self-esteem and self-construal in reaction
to a threat to the self: Evidence from the People's Republic of China and the United States.
us
Journal of Personality and Social Psychology, 71(3), 603-615.
Bryant, S., Murthy, U., & Wheeler, P. (2009). The effects of cognitive style and feedback type on
performance in an internal control task. Behavioral Research in Accounting, 21(1), 37-58.
Carver, C. S., & Scheier, M. (1981). Attention and self-regulation : a control-theory approach to human
an
behavior. New York: Springer-Verlag.
Chhokar, J. S., & Wallin, J. A. (1984). A field study of the effect of feedback frequency on
performance. Journal of Applied Psychology, 69(3), 524-530.
Cianci, A. M., & Bierstaker, J. L. (2009). The effect of performance feedback and client importance on
M
auditors' self- and public-focused ethical judgments. Managerial Auditing Journal, 24(5),
455-474.
Cianci, A. M., Schaubroeck, J. M., & McGill, G. A. (2010). Achievement goals, feedback, and task
performance. Human Performance, 23(2), 131-154.
d
Cook, D. M. (1967). The effect of frequency of feedback on attitudes and performance. Journal of
Accounting Research, 5, 213-224.
te
environments in public accounting firms. Clemson University and Texas Tech University
(Working Paper).
DeZoort, T., Harrison, P., & Taylor, M. (2006). Accountability and auditors' materiality judgments:
The effects of differential pressure strength on conservatism, variability, and effort.
Ac
Page 49 of 69
Farr, J. R., & Levy, P. E. (2007). Performance appraisal. In L. L. Koppes, P. W. Thayer, A. J. Vinchur &
E. Salas (Eds.), Historical Perspectives in Industrial and Organizational Psychology. Mahwah,
N.J.: Erlbaum.
Fedor, D. B., Davis, W. D., Maslyn, J. M., & Mathieson, K. (2001). Performance improvement efforts in
response to negative feedback: the roles of source power and recipient self-esteem. Journal
of Management, 27(1), 79-97.
Fedor, D. B., Eder, R. W., & Buckley, M. R. (1989). The contributory effects of supervisor intentions
on subordinate feedback responses. Organizational Behavior and Human Decision Processes,
t
44(3), 396-414.
ip
Fedor, D. B., & Ramsay, R. J. (2007). Effects of supervisor power on preparers' responses to audit
review: A field study. Behavioral Research in Accounting, 19, 91-106.
cr
Fisher, C. D. (1979). Transmission of positive and negative feedback to subordinates: A laboratory
investigation. Journal of Applied Psychology, 64(5), 533-540.
Fleishman, E. A., & Peters, D. R. (1962). Interpersonal values, leadership attitudes, and managerial
us
"success". Personnel Psychology, 15(2), 127-143.
Fox, S., & Spector, P. E. (1999). A model of work frustration-aggression. Journal of Organizational
Behavior, 20(6), 915-931.
George, J. M., & Jones, G. R. (1997). Experiencing work: values, attitudes, and moods. Human
an
Relations, 50(4), 393-416.
Gibbins, M., & Trotman, K. T. (2002). Audit review: Managers' interpersonal expectations and
conduct of the review. Contemporary Accounting Research, 19(3), 411-444.
Giffin, K. (1967). The contribution of studies of source credibility to a theory of interpersonal trust
M
in the communication process. Psychological Bulletin, 68(2), 104-120.
Gregory, J. B., Beck, J. W., & Carr, A. E. (2011). Goals, feedback, and self-regulation: Control theory as
a natural framework for executive coaching. Consulting Psychology Journal: Practice and
Research, 63(1), 26-38.
d
Gregory, J. B., & Levy, P. E. (2011). It's not me, it's you: A multilevel examination of variables that
impact employee coaching relationships. Consulting Psychology Journal: Practice and
te
5(2), 86-99.
Gregory, J. B., Levy, P. E., & Jeffers, M. (2008). Development of a model of the feedback process
ce
within executive coaching. Consulting Psychology Journal: Practice and Research, 60(1), 42-
56.
Greller, M. M., & Herold, D. M. (1975). Sources of feedback: A preliminary investigation.
Organizational Behavior and Human Performance, 13(2), 244-256.
Ac
Haas, H. I., & Maehr, M. L. (1965). Two experiments on the concept of self and the reaction of others.
Journal of Personality and Social Psychology, 1(1), 100-105.
Halperin, K., Snyder, C. R., Shenkel, R. J., & Houston, B. K. (1976). Effects of source status and
message favorability on acceptance of personality feedback. Journal of Applied Psychology,
61(7), 85-88.
Harrell, A., & Wright, A. (1990). Empirical evidence on the validity and reliability of behaviorally
anchored rating scales for auditors. Auditing: A Journal of Practice & Theory, 9(3 (Fall
1990)), 134-149.
Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81-
112.
Herold, D. M., & Fedor, D. B. (1998). Individuals' interaction with their feedback environment: The
role of domain specific individual differences. Research in Personnel and Human Resources
Management, 16, 215.
Page 50 of 69
Herold, D. M., Liden, R. C., & Leatherwood, M. L. (1987). Using multiple attributes to assess sources
of performance feedback. The Academy of Management Journal, 30(4), 826-835.
Herold, D. M., & Parsons, C. K. (1985). Assessing the feedback environment in work organizations:
Development of the job feedback survey. Journal of Applied Psychology, 70(2), 290-305.
Herold, D. M., Parsons, C. K., & Rensvold, R. B. (1996). Individual differences in the generation and
processing of performance feedback. Educational and Psychological Measurement, 56(1), 5-
25.
Hirst, M. K., & Luckett, P. F. (1992). The relative effectiveness of different types of feedback in
t
performance evaluation. Behavioral Research in Accounting, 4, 1-22.
ip
Hirst, M. K., Luckett, P. F., & Trotman, K. T. (1999). Effects of feedback and task predictability on
task learning and judgment accuracy. Abacus, 35(3), 286-301.
cr
Howell, J. M., & Avolio, B. J. (1993). Transformational leadership, transactional leadership, locus of
control, and support for innovation: Key predictors of consolidated-business-unit
performance. Journal of Applied Psychology, 78(6), 891-902.
us
Hunt, S. C. (1995). A review and synthesis of research in performance evaluation in public
accounting. Journal of Accounting Literature, 14, 107.
Ilgen, D. R., & Davis, C. (2000). Bearing bad news: Reactions to negative performance feedback.
Journal of Applied Psychology, 49(3), 550-565.
an
Ilgen, D. R., Fisher, C. D., & Taylor, M. S. (1979). Consequences of individual feedback on behavior in
organizations. Journal of Applied Psychology, 64(4), 349-371.
Jiambalvo, J. (1979). Performance evaluation and directed job effort: Model development and
analysis in a CPA firm setting. Journal of Accounting Research, 17(2), 436-455.
M
Kadous, K., Leiby, J., & Peecher, M. E. (2013). How do auditors weight informal contrary advice? The
joint influence of advisor social bond and advice justifiability. The Accounting Review, 88(6),
2061-2087.
Kaplan, S. E., & Reckers, P. M. J. (1985). An examination of auditor performance evaluation. The
d
Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical
review, a meta-analysis, and a preliminary feedback intervention theory. Psychological
ce
31.
Lam, C. F., DeRue, D. S., Karam, E. P., & Hollenback, J. R. (2011). The impact of feedback frequency on
learning and task performance: Challenging the "more is better" assumption. Organizational
Behavior and Human Decision Processes, 116, 217-228.
Lambert, T. A., & Agoglia, C. P. (2011). Closing the loop: Review process factors affecting audit staff
follow-through. Journal of Accounting Research, 49(5), 1275-1306.
Landy, F. J. (2005). Some historical and scientific issues related to research on emotional
intelligence. Journal of Organizational Behavior, 26(4), 411-424.
Larson, J. R. (1986). Supervisors' performance feedback to subordinates: The impact of subordinate
performance valence and outcome dependence. Organizational Behavior and Human
Decision Processes, 37(3), 391-408.
Page 51 of 69
Leung, P. W., & Trotman, K. T. (2005). The effects of feedback type on auditor judgment
performance for configural and non-configural tasks. Accounting, Organizations and Society,
30(6), 537.
Leung, P. W., & Trotman, K. T. (2008). Effect of different types of feedback on the level of auditors'
configural information processing. Accounting & Finance, 48(2), 301-318.
Levy, P. E., Albright, M. D., Cawley, B. D., & Williams, J. R. (1995). Situational and individual
determinants of feedback seeking: A closer look at the process. Organizational Behavior and
Human Decision Processes, 62(1), 23-37.
t
Levy, P. E., Cober, R. T., & Miller, T. (2002). The effect of transformational and transactional
ip
leadership perceptions on feedback-seeking intentions. Journal of Applied Social Psychology,
32(8), 1703-1720.
cr
Levy, P. E., & Williams, J. R. (2004). The social context of performance appraisal: A review and
framework for the future. Journal of Management, 30(6), 881-905.
Linderbaum, B. A., & Levy, P. E. (2010). The development and validation of the feedback orientation
us
scale (FOS). Journal of Management, 36(6), 1372-1405.
London, M. (2003). Job feedback : Giving, seeking, and using feedback for performance improvement
(2nd Edition ed.). Mahwah, N.J.: Lawrence Erlbaum Associates.
London, M., & Smither, J. W. (2002). Feedback orientation, feedback culture, and the longitudinal
an
performance management process. Human Resource Management Review, 12(1), 81-100.
Miller, C. L., Fedor, D. B., & Ramsay, R. J. (2006). Effects of discussion of audit reviews on auditors'
motivation and performance. Behavioral Research in Accounting, 18, 135.
Morrison, E. W., & Bies, R. J. (1991). Impression management in the feedback-seeking process: A
M
literature review and research agenda. The Academy of Management Review, 16(3), 522-541.
Morrison, E. W., Chen, Y.-R., & Salgado, S. R. (2004). Cultural differences in newcomer feedback
seeking: A comparison of the United States and Hong Kong. Applied Psychology, 53(1), 1-22.
Nadler, D. (1979). The effects of feedback on task group behavior: A review of the experimental
d
the feedback environment to work outcomes. Journal of Vocational Behavior, 65(3), 351-
365.
Otley, D. T., & Pierce, B. J. (1995). The control problem in public accounting firms: An empirical
p
study of the impact of leadership style. Accounting, Organizations and Society, 20(5), 405-
420.
ce
Payne, E. A., Ramsay, R. J., & Bamber, E. M. (2010). The effect of alternative types of review on
auditors' procedures and performance. Auditing: A Journal of Practice & Theory, 29(1), 207-
220.
Pierce, B., & Sweeney, B. (2004). Cost-quality conflict in audit firms: an empirical investigation.
Ac
Page 52 of 69
Public Company Accounting and Oversight Board (PCAOB). PCAOB Rulemaking Docket Matter No.
31, Application of the "Failure to Supervise" Provision of the Sarbanes-Oxley Act of 2002 and
Solicitation of Comment on Rulemaking Concepts. Washington, D.C.: PCAOB, 2010b.
Public Company Accounting and Oversight Board (PCAOB). (2010c). Supervision of the Audit
Engagement Auditing Standard No. 10. Washington, DC: PCAOB.
Ramsay, R. J. (1994). Senior/Manager differences in audit workpaper review performance. Journal
of Accounting Research, 32(1), 127-135.
Rich, J. S., Solomon, I., & Trotman, K. T. (1997). The audit review process: A characterization from
t
the persuasion perspective. Accounting, Organizations and Society, 22(5), 481.
ip
Salmoni, A. W., Schmidt, R. A., & Walter, C. B. (1984). Knowledge of results and motor learning: a
review and critical reappraisal. Psychological Bulletin, 95(3), 355-386.
cr
Schaefer, T. J. (2013). The effects of social costs and internal quality reviews on auditor consulation
strategies. Unpublished Dissertation. Darla Moore School of Business, University of South
Carolina.
us
Shankar, P. G., & Ng, T. B.-P. (2008). When does advice influence auditors' decisions? Moderating
effects of performance evaluation focus and client attitude. Paper presented at the 2008
International Symposium on Audit Research, Pasadena.
Sheldon, O. J., Thomas-Hunt, M. C., & Proell, C. A. (2006). When timeliness matters: the effect of
an
status on reactions to perceived time delay within distributed collaboration. Journal of
Applied Psychology, 91(6), 1385-1395.
Staw, B. M., Sutton, R. I., & Pelled, L. H. (1994). Employee positive emotion and favorable outcomes
at the workplace. Organization Science, 5(1), 51.
M
Steelman, L., Levy, P. E., & Snell, A. F. (2004). The feedback environment scale: Construct definition,
measurement, and validation. Educational and Psychological Measurement, 64(1), 165-184.
Steelman, L., & Rutkowski, K. (2004). Moderators of employee reactions to negative feedback.
Journal of Managerial Psychology, 19(1), 6-18.
d
Steers, R. M., & Porter, L. W. (1974). The role of task-goal attributes in employee performance.
Psychological Bulletin, 81(7), 434-452.
te
Stefaniak, C., & Robertson, J. C. (2010). When auditors err: How mistake significance and superiors'
historical reactions influence auditors' likelihood to admit a mistake. International Journal
of Auditing, 14(1), 41-55.
p
Stone, D. L., & Stone, E. F. (1985). The effects of feedback consistency and feedback favorability on
self-perceived task competence and perceived feedback accuracy. Organizational Behavior
ce
Sweeney, B., & Pierce, B. (2004). Management control in audit firms: A qualitative examination.
Accounting, Auditing & Accountability Journal, 17(5), 779-812.
Tan, H.-T., & Jamal, K. (2001). Do auditors objectively evaluate their subordinates' work? The
Accounting Review, 76(1), 99-110.
Tan, H.-T., & Trotman, K. T. (2003). Reviewers' responses to anticipated stylization attempts by
preparers of audit workpapers. The Accounting Review, 78(2), 581-604.
Taylor, M. S., Fisher, C. D., & Ilgen, D. R. (1984). Individuals' reactions to performance feedback in
organizations: A control theory perspective. Research in Personnel and Human Resource
Management, 2, 81-124.
Van-Dijk, D., & Kluger, A. (2004). Feedback sign effect on motivation: Is it moderated by regulatory
focus? Applied Psychology: An International Review, 53(1), 113-135.
Page 53 of 69
Vancouver, J. B., & Morrison, E. W. (1995). Feedback inquiry: The effect of source attributes and
individual differences. Organizational Behavior and Human Decision Processes, 62(3), 276-
285.
VandeWalle, D. (2003). A goal orientation model of feedback-seeking behavior. Human Resource
Management Review, 13(4), 581-604.
VandeWalle, D., & Cummings, L. L. (1997). A test of the influence of goal orientation on the
feedback-seeking process. Journal of Applied Psychology, 82(3), 390-400.
Vera Munoz, S. C., Ho, J. L., & Chow, C. W. (2006). Enhancing knowledge sharing in public accounting
t
firms. Accounting Horizons, 20(2), 133-155.
ip
Westermann, K. D., Bedard, J. C., & Earley, C. E. (2014). Learning the "craft of auditing": A dynamic
view of auditors' on-the-job learning within its social context. Forthcoming in Contemporary
cr
Accounting Research.
Whitaker, B. G., Dahling, J. J., & Levy, P. E. (2007). The development of a feedback environment and
role clarity model of job performance. Journal of Management, 33(4), 570.
us
Whitaker, B. G., & Levy, P. E. (2012). Linking feedback quality and goal orientation to feedback
seeking and job performance. Human Performance, 25(2), 159-178.
Wright, A. (1980). Performance appraisal of staff auditors. The CPA Journal, 50(Nov 1980), 37-43.
Wright, A. (1982). An investigation of the engagement evaluation process for staff auditors. Journal
an
of Accounting Research, 20(1), 227-239.
M
d
p te
ce
Ac
Page 54 of 69
Figure 1
t
ip
Figure 1 – A Dynamic Model of Feedback Behavior
cr
Start Feedback Feedback Feedback End Feedback
us
Trajectory Perspective Behaviors Trajectory
an
Performance Level T1 Individual Resource:
Feedback Seeking
Knowledge T1 Informal
Inquiry
Motivation/Effort T1
M
Monitoring
Organizational Resource:
Formal Feedback Giving
ed
Workpaper Review
Engagement Review
Annual Review
pt
Informal
Coaching
Performance Level T2
ce
Individual Factors
Contextual Factors
Page 55 of 69
Figure 2
t
ip
Figure 2 – Determinants of Feedback Seeking and Use
cr
Individual Factors Contextual Factors
us
an
1) Personal 2) Feedback 3) Environment 4) Message 5) Source/Target
Characteristics Attitudes
M
ed
Decision Decision
to Seek to Use
pt
1) Personal Characteristics Feedback Feedback 3) Source
a) Demographics (age, job a) Identity (supervisor, peer, task,
ce
t
ip
Table 1
cr
Summary of research on performance feedback in auditing
us
investigated method
Agoglia et al. (2009) Feedback Message - Method Study examines audit workpaper Experiment Electronic review preparers provide
review formats: face-to-face versus reviewers with lower-quality
electronic to assess their effects on workpaper documentation than face-
an
audit review team judgments to-face preparers.
through a focus on quality issues Electronic reviewers’ judgments are
within the documentation. affected by their preparer’s less-
informative documentation.
M
Study also examines two mediating Specifically, reviewers’ judgments are
factors: preparer workpaper of lower quality when the workpaper
documentation quality and the preparer anticipates an electronic
extent to which reviewers review as opposed to a face-to-face
ed
appropriately evaluate preparer review.
documentation quality.
Anderson-Gough et al. (1998) Feedback Message - Timing Study examines the socialization of Case Study Provides descriptive information of
Feedback Environment trainees working towards the formal appraisal forms and
pt
qualifying as chartered accountants processes at two audit firms.
at two 'Big 6' (now 'Big 4) firms in Common criticisms noted with the
the United Kingdom. formal appraisal forms include: the
ce
Page 57 of 69
t
ip
Citation Aspects of feedback Purpose Research Key research findings
cr
investigated method
Ashton (1990) Feedback Message - Type Study examines the impact of Experiment When outcome feedback is present
financial incentives, performance with no decision aid the accuracy of
us
feedback, and the requirement to subjects is greater than those with
justify one's decision to others on neither feedback nor a decision aid.
decision making in an auditing When a decision aid is present,
setting. outcome feedback has no effect on
an
accuracy.
Bamber et al. (2011) Feedback Message - Method Study investigates the effects of Experiment Each method elicits high levels of
anticipating one of three methods accountability, but an electronic
of review (electronic, interview or review elicits significantly greater
M
discussion) on preparer accountability than an interview.
accountability and performance. Accountability has both direct and
indirect effects on performance and
documentation.
ed
Anticipation of an interview results in
the detection of more conceptual
errors than anticipation of either an
electronic review or discussion.
pt
Results differ from Brazel et al. (2004),
suggesting the differences in task play
a role on the method of review that
ce
Page 58 of 69
t
ip
Citation Aspects of feedback Purpose Research Key research findings
cr
investigated method
Bonner and Walker (1994) Feedback Message - Type Study examines the effectiveness of Experiment Combinations of instruction and no
various combinations of instruction experience or of instruction and
us
and experience (practice and practice without feedback do not
feedback) in producing knowledge. produce knowledge.
Practice with explanatory feedback
and any form of instruction creates
an
gains in knowledge.
Practice with outcome feedback does
not assist with knowledge acquisition
unless it is preceded by
M
"understanding rules", but not with
"how-to rules".
Brazel et al. (2004) Feedback Message - Method Study examines the effects on Experiment The method of review affects preparer
preparers of using two different effectiveness and efficiency.
ed
methods of review: face-to-face and Anticipation of a face-to-face review
electronic review. produces higher quality judgments,
less reliance on prior year, and more
accountability, but lower task
pt
efficiency, than anticipation of an
electronic review.
Bryant et al. (2009) Feedback Message - Type Study investigates the effects of Experiment Cognitive style has no effect on task
ce
Personal Characteristics cognitive style and feedback type performance; however outcome
on auditors' ability to identify feedback in conjunction with cognitive
internal control cues using internal style feedback results in better
control questionnaires. performance at detecting out-of-cycle
Ac
Page 59 of 69
t
ip
Citation Aspects of feedback Purpose Research Key research findings
cr
investigated method
Cianci and Bierstaker (2009) Feedback Message - Sign Study investigates the effect of Experiment Receiving positive (negative) feedback
performance feedback and client results in more (less) ethical
us
importance on auditors' self- and judgments in a self-focused task and in
public-focused ethical judgments. a public-focused task when auditing a
less (more) important client.
Receiving positive feedback and
an
auditing a less important client results
in more ethical judgments in both
tasks.
Suggests auditors are susceptible to
M
pressure from negative feedback and
client importance, even when the
judgment could have public
consequences.
ed
Dalton and Viator (2014) Feedback Environment Study investigates whether Survey Unfavorable supervisory feedback
unfavorable supervisory feedback environments are associated with
environments are associated with lower levels of job satisfaction,
negative job outcomes in the public organizational commitment, and role
pt
accounting profession and whether clarity.
mentoring relationships can Mentoring support mitigates the
mitigate adverse effects of these negative effects of unfavorable
ce
Page 60 of 69
t
ip
Citation Aspects of feedback Purpose Research Key research findings
cr
investigated method
DeZoort et al. (2006) Feedback Message - Method Study investigates the effects of Experiment Under high pressure (i.e., justification
varying accountability pressure on and feedback) more conservative
us
auditors' materiality judgments. judgments are provided, and less
judgment variability exists than lower
levels of pressure (i.e., review and
anonymity).
an
Accountability strength is also related
to the amount of time spent on the
task, explanation length, and
consideration of qualitative
M
materiality factors.
Use of a planning materiality decision
aid influenced the accountability
effects of the materiality judgment.
ed
These judgments are more
conservative and less variable when
the decision aid was available.
Earley (2001) Feedback Message - Type Study examines novice auditors' Experiment Providing explanatory feedback in
pt
knowledge acquisition by summary form improves performance.
examining whether providing Self-explanation training improves
explanatory feedback and/or self- performance, but it is dependent on an
ce
Earley (2003) Feedback Message - Type Study investigates the effect of Experiment In the absence of outcome feedback,
providing outcome feedback (i.e., lower levels of reasoning are exhibited
the correct answer) prior to or in self-explanations, which then
after self-explaining on the level of adversely affect performance.
reasoning exhibited in self- Ability to reason is not due solely to
explanations, and then the effect of individual differences.
level of reasoning on performance.
Page 61 of 69
t
ip
Citation Aspects of feedback Purpose Research Key research findings
cr
investigated method
Fedor and Ramsay (2007) Feedback Source - Attributes Study investigates the effect of Survey Audit review results in attempts to
Feedback Message - Sign workpaper reviewers' power on improve performance and seek
us
workpaper preparers' attempt to feedback.
improve their performance, When feedback is negative, attempts
manage the reviewers' impressions to manage the reviewer's impressions
of their work, and seek additional are also noted.
an
feedback from their reviewers. Perceptions of a reviewer's power
affect the preparer’s response to the
review. Referent power, reviewers
who make a preparer feel valued, has a
M
positive effect on all three outcomes.
Reviewer expert power positively
affects feedback seeking, whereas
coercive power, the perceived ability
ed
to punish, has negative effects on
feedback seeking and performance
improvement efforts.
Power perceptions are different for
pt
auditors compared to administrative
workers. Staff auditors perceive audit
supervisors to have more expert
ce
Page 62 of 69
t
ip
Citation Aspects of feedback Purpose Research Key research findings
cr
investigated method
Jiambalvo (1979) Feedback Message - Emphasis Study develops and tests a model of Survey It is possible to predict the amount of
how the performance evaluation time CPAs direct toward various
us
process affects CPAs' motivation to aspects of their jobs and their
engage in certain classes of job performance on job dimensions using
behaviors. perceptions of effort and reward
relationships and the intrinsic value of
an
the activities.
Kadous et al. (2013) Feedback Source - Identity Study examines how auditors Experiment When advice comes from a stronger
weight informal advice depending social bond advisor, the advice it
on the social bond and advice weighted relatively heavily and no
M
justification. differentiation is made between better
and worse justified advice.
Non-specialists fail to objectively
assess the quality of advice, and they
ed
optimistically assess specific attributes
of advice coming from stronger social
bond advisors, inaccurately equating
better and worse justified advice.
pt
Specialists put less weight on better
justified advice despite assessing its
quality to be higher when it comes
ce
Page 63 of 69
t
ip
Citation Aspects of feedback Purpose Research Key research findings
cr
investigated method
Kida (1984) Feedback Source - Attributes The study examines the evaluation Survey Seniors emphasize similar dimensions
Feedback Message - Emphasis schemes of audit managers and as managers when arriving at overall
us
Feedback Message - Sign seniors. It also examines the evaluations. However, substantial
interpersonal interactions between disagreement exists at the individual
managers and seniors during rater level. Suggesting individual
meetings on job performance. raters are applying different weighting
an
schemes.
Supportive behavior, invitation to
participate and participation in goal
setting are related to the seniors'
M
satisfaction with the meeting and their
managers, but not to performance
improvement.
Seniors view managerial criticism as
ed
positively affecting their job
performance if the criticism is directed
at specific job aspects and not the
senior personally.
pt
Lambert and Agoglia (2011) Feedback Message - Emphasis Study examines how two Experiment Providing a timely review enhances
Feedback Message - Timing contextual factors, review reviewee effort.
Personal Characteristics timeliness and review note frame, Conclusion-framed review notes lead
ce
Page 64 of 69
t
ip
Citation Aspects of feedback Purpose Research Key research findings
cr
investigated method
Leung and Trotman (2005) Feedback Message - Type Study examines the effect of four Experiment Task properties feedback and
types of feedback (outcome, task combined feedback improves
us
properties, cognitive, combined performance on both tasks.
task properties/cognitive) in Outcome feedback is more effective for
combination with the complexity of the nonconfigural task, while cognitive
the task (configural or non- feedback is more effective for the
an
configural), on the ability of an configural task.
individual to transfer learning to Combined feedback is particularly
subsequent tasks. effective in transferring knowledge
across tasks.
M
The nature of the task moderates the
effects of different types of feedback.
Leung and Trotman (2008) Feedback Message - Type Study investigates the impact of Experiment Task properties feedback, cognitive
four types of feedback (outcome, feedback and the combination all show
ed
task properties, cognitive and increases in configural processing
combined) on increasing the extent compared to the no feedback group.
of configural information The level of configural processing is
processing by auditors. positively associated with
pt
performance.
Miller et al. (2006) Feedback Message - Method Study investigates whether the Survey Incorporating discussion of
Personal Characteristics addition of discussion of performance with written review
ce
Page 65 of 69
t
ip
Citation Aspects of feedback Purpose Research Key research findings
cr
investigated method
Payne et al. (2010) Feedback Message - Method Study examines the effects on Experiment Interactive review leads to a focus on
preparers of anticipating a real- more cognitively demanding,
us
time interactive review to the conclusion-oriented audit procedures,
effects of anticipating receipt of which leads to better performance in
more traditional written review identifying a trend that is indicative of
notes. fraud.
an
Finds no evidence that dysfunctional
behavior strategies operate under the
less structured interactive review to
compromise audit performance.
M
Pierce and Sweeney (2004) Feedback Source - Attributes Study identifies some of the main Survey Dysfunctional behaviors are
Feedback Message - changes that are perceived by significantly related to time pressure
Frequency auditors to have recently occurred and performance evaluation
Feedback Message - Emphasis in their operating environments. (specifically style and frequency of
ed
evaluation).
Study investigates the relationship Perceived tightness of time budgets
between dysfunctional behaviors and their perceived importance to
and environmental variables performance evaluation have
pt
including time pressure (budgets decreased in recent years.
and deadlines) and performance "Effort put into the job" and ability to
evaluation (style and frequency of communicate are reported to be
ce
Page 66 of 69
t
ip
Citation Aspects of feedback Purpose Research Key research findings
cr
investigated method
Schaefer (2013) Feedback Source - Identity Study examines factors that affect Experiment The social costs of seeking advice
when auditors seek advice, to impact the advice strategies that
us
whom auditors go to for advice, auditors use.
and how they present audit issues Auditors' concerns to protect and
to the advisor. defend their egos/images can cause
them to avoid pushing issues up to the
an
manager. However, firm's internal
quality review process mitigates these
behaviors.
Internal quality review mitigates
M
social pressures to encourage proper
advice seeking.
Shankar and Ng (2008) Feedback Message - Emphasis Study examines whether and how Experiment When the client’s attitude is to use the
auditors’ use of advice is jointly most appropriate accounting methods
ed
affected by the performance to enhance financial reporting quality,
evaluation focus of superiors and neither the advice direction nor
preferences of the client. performance evaluation focus
influences auditors’ decisions.
pt
When the client believes that they
should be able to use any accounting
methods as long as they are acceptable
ce
Page 67 of 69
t
ip
Citation Aspects of feedback Purpose Research Key research findings
cr
investigated method
Stefaniak and Robertson Feedback Source - Attributes Study investigates the effects of Experiment Auditors are more likely to admit
(2010) mistake significance and superiors' errors when their superiors have
us
historical reactions to mistake reacted positively, regardless of error
admissions on the likelihood that significance.
staff auditors will admit mistakes. Auditors are less likely to admit
apparently insignificant errors when
an
their superiors have reacted
negatively to prior mistakes.
Sweeney and Pierce (2004) Feedback Source - Attributes Study investigates control system Field Study Style of evaluation moderates the
Feedback Message - Emphasis variables (time pressure, association between time pressure
M
participation, and style of and quality threatening behavior.
evaluation) shown to be related to High levels of time pressure are more
quality threatening behavior in likely associated with high levels of
audit firms. deliberate quality threatening
ed
behavior when a target-constrained
style of performance evaluation is
used. Conversely, high levels of time
pressure are more likely to be
pt
associated with low levels of
deliberate quality threatening
behavior when a profit conscious style
ce
of evaluation is used.
Ac
Page 68 of 69
t
ip
Citation Aspects of feedback Purpose Research Key research findings
cr
investigated method
Wright (1980) Feedback Message - Emphasis Study examines the performance Field Study Study identifies descriptions of strong
Feedback Message - evaluation process for staff and weak performers and the
us
Frequency auditors. perceived importance of performance
criteria.
Specific areas of investigation All firms indicate engagement
include performance criteria, evaluations are the most important
an
reliance on engagement factor considered to appraise staff
evaluations for salary and auditor performance.
promotion decisions, approaches to There is diversity in how frequently a
dealing with appraisal difficulties staff's overall performance is
M
and experimentation with discussed.
alternative evaluation techniques. Nontraditional forms of feedback are
not used (i.e., upward feedback, self-
reviews, peer reviews).
ed
Considerable diversity exists in
content of engagement evaluation
forms.
Widely different philosophies exist on
pt
the role and importance of the
engagement review process.
Wright (1982) Feedback Message - Emphasis Study examines the validity of Experiment Technical ability is the major cue
ce
Page 69 of 69