Professional Documents
Culture Documents
MillerVerbosGoswami2014 PDF
MillerVerbosGoswami2014 PDF
MillerVerbosGoswami2014 PDF
net/publication/263320194
CITATIONS READS
6 515
3 authors, including:
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Ashita Goswami on 23 January 2018.
Employee social
Employee social cognition and cognition
performance evaluation
process reactions
Janice S. Miller 515
Sheldon B. Lubar School of Business, University of Wisconsin-Milwaukee,
Received 21 January 2011
Milwaukee, Wisconsin, USA Revised 22 October 2011
Amy Klemm Verbos 27 April 2012
29 October 2013
Department of Management, Central Michigan University, Accepted 12 December 2013
Mount Pleasant, Michigan, USA, and
Ashita Goswami
Department of Psychology, Central Michigan University,
Mount Pleasant, Michigan, USA
Abstract
Purpose – The paper uses social cognitive theory to explore reactions to performance evaluation
processes as situated cognitions by examining the relationship between key elements of employees’
schemas about an organizational environment, preparation for evaluation, and these reactions.
The paper aims to discuss these issues.
Design/methodology/approach – Survey of 260 employees of eight organizations in a Midwestern
US city.
Findings – Job resource adequacy, communication adequacy, coworker relationships, and preparation
time are significantly and positively associated with employee reactions to performance evaluation
processes. Preparation time moderates the association between organizational context and employee
reactions.
Research limitations/implications – A social cognitive perspective on performance evaluation
broadens the scope of extant research. This study is limited by cross-sectional design but opens the
door to future experimental and longitudinal research.
Practical implications – Performance evaluation processes are situated in an organizational
context. Organizational interventions to improve perceptions of this key process could focus on better
communication and encouraging preparation, especially if job resources are less adequate.
Originality/value – This research contributes to the performance evaluation literature by applying
social cognitive theory to performance evaluation reactions as situated cognitions, calling attention to
the broader organizational context in which these processes occur.
Keywords Quantitative, Situated cognition, Social cognition, Performance evaluation,
Communication adequacy, Job resource adequacy, Social schema
Paper type Research paper
Introduction
Performance evaluation, a social process embedded in an organizational context,
generates situated cognitions including critical employee reactions, “individual-level
attitudinal evaluations of and responses to the performance appraisal process” (Pichler,
2012, p. 710). Employers and employees often regard the performance evaluation
process as a source of dissatisfaction (Antonioni, 1994; Bernardin et al., 1998). Personnel Review
Vol. 43 No. 4, 2014
Low-quality performance appraisal experiences are associated with reduced job pp. 515-535
r Emerald Group Publishing Limited
satisfaction, weaker organizational commitment, and increased intentions to leave 0048-3486
(Brown et al., 2010). Thus, employees’ positive reaction to performance evaluation DOI 10.1108/PR-01-2011-0011
PR remains a desirable component of performance management systems (Boswell and
43,4 Boudreau, 2002; Nathan et al., 1991).
The present study addresses a gap in our understanding of employee responses to
performance evaluation processes as situated cognition, the interplay between what
happens in an organizational environment and a cognitive schema (Elsbach et al.,
2005). According to Ferris et al. (2008), examining the complex backdrop to
516 performance evaluation will enable us to better comprehend performance evaluation
challenges. Job resources, organizational communication, and coworker relationships
may facilitate performance of one’s job, suggesting their potential importance as
environmental variables that may affect an employee’s reactions to performance
evaluation. The time spent preparing for a performance evaluation is a proxy for
reflective cognition about the performance evaluation which may also affect these
reactions. This research expands the theoretical underpinnings of performance
evaluation research. To demonstrate the relevance of social cognitive theory, we
expand past insights from other approaches to performance evaluation.
H1. Job resource adequacy is positively associated with favorable employee reactions
to performance evaluation processes.
Coworker relationships
A great deal of performance evaluation research focusses on the supervisor-subordinate
relationship. Respectful interpersonal treatment is a key relational component of the
evaluation process (Findley et al., 2000). Although this research is informative, there
is growing recognition of the importance of positive workplace relationships more
generally (e.g. Dutton and Ragins, 2007). A climate for positive coworker relationships
is potentially a powerful facet of the social cognitions about an organizational
environment.
Positive relationships with coworkers may generate positive social capital (Baker
and Dutton, 2007) and reciprocity (Gouldner, 1960). Relationships that foster social
support facilitate access to resources (Tsai and Ghoshal, 1998), greater power and
influence (Brass and Burkhardt, 1993), greater input into decision making and problem
solving (Alper et al., 1998), and buffer against job stress and burnout (Cohen and Willis,
1985; Cordes and Dougherty, 1993). Positive relationships are beneficial not only in
stressful situations, but magnify positive affect when things go well (Gable et al., 2004).
Bettenhausen and Fedor (1997) demonstrated that positive coworker relationship
quality affected favorable reactions to peer and upward appraisal. However, their study
did not directly assess reactions to the performance evaluation processes as a whole.
Consequently, we offer the following hypothesis:
Preparation as a moderator
Elsbach et al. (2005) consider situated cognition an interaction of cognition and its
context. Under dual processing theory (Evans, 2008; Evans and Stanovich, 2013), we
posit that preparation may interact with contextual elements of a workplace schema
to influence reactions to performance evaluation processes. Individual employees
cannot control either job resource adequacy or communication adequacy within
an organization, but can choose to prepare for a performance evaluation. Deliberative
Type 2 processing (i.e. preparation time) requires greater cognitive resources, while
Type 1 processing (i.e. no or little preparation) is automatic.
Social cognitive theory suggests that an employee’s social schema will become more
positive as job resource adequacy improves. Under no preparation time, an employee
should have less favorable reactions to performance evaluation processes, more
favorable reactions in a moderate job resource context, and the most favorable
reactions in a high job resource context. We expect employee preparation to interact
with job resource adequacy such that high preparation time in lower resource
environments should produce more favorable reactions to performance evaluation
processes than moderate preparation time, which in turn will be more favorable than
no preparation time. In austere times, an employee might use preparation time to make
a case for why his or her performance should be evaluated more positively for “doing
more with less.” Therefore, when preparation is high in a lower job resource context,
we expect more favorable reactions to performance evaluation processes, consistent
PR with our prediction for the direct relationship in H4, but moderating the direct
43,4 relationship posited in H1. The following hypothesis examines this:
H5. Preparation time moderates the relationship between job resource adequacy
and employee reactions to performance evaluation processes. Under conditions
of high preparation, the relationship between job resource adequacy and
520 employee reactions to performance evaluation is weaker than under conditions
of moderate preparation or no preparation.
Method
Participants
The data were collected in a survey of 313 employees from eight organizations in the
Midwestern USA. Participant demographics are set forth in Table I. All organizations
are service providers in different industries and sectors. The second author contacted
Performance Evaluation
Process Reactions
H4
H5 H6
Preparation Time
H1 H3
H2
Figure 1.
Hypothesized Job Resource Communication Coworker
Adequacy Adequacy Relationship
relationships
Quality
Gender
Employee social
Women 66% cognition
Men 33%
No answer 1%
Age
o21 years old 2%
21-29 25.3%
30-39 36.9%
521
40-49 21.2%
450 years old 13.5%
No answer 1.2%
Exempt status
Exempt 43.8%
Non-exempt 53.5%
No answer 2.7%
Education
High School 12.7%
Associates Degree 33.5%
Bachelors Degree 41.5%
Graduate Degree 11.2%
Tenure
o3 years 38%
4-5 years 20%
6 or more years 40% Table I.
No answer 2% Demographics
Measures
We chose existing measures for this study that used five-point Likert-type scales,
except as noted below. As recommended by Cohen et al. (2003) we centered the
independent variables job resource adequacy, communication adequacy, and coworker
relationships by subtracting the mean from each value. Items for the variables of
interest in this study are listed in Appendix.
Reactions to performance evaluation processes. The scale measuring employee
reactions to performance evaluation processes contains nine items similar to those
used by Dobbins et al. (1990) and Giles and Mossholder (1990).
PR Job resource adequacy. Seven items identified by Peters and O’Connor (1980) as
43,4 situational constraints scale measure job resource adequacy.
Coworker relations. Six items from Bettenhausen and Fedor (1997) measure the
quality of participants’ relations with their coworkers.
Communication adequacy. Four items developed by Day et al. (1998) measure
workplace communication adequacy.
522 Preparation time. The time an employee spends preparing for a feedback interview
is an objective measure of cognitive resources devoted to that portion of the evaluation
process. Less time indicates Type 1 cognitions and more time indicates more reflective
thought. Since cognition cannot be measured directly and we are concerned with the
amount rather than the content of this preparation, employees indicated how much
time they spent preparing for their most recent performance evaluation. Response
categories (coded 0 through 4) were offered in 15-minute increments ranging from no
time to over an hour.
Control variables
Organization. Performance evaluation systems vary across the participating
organizations. Each has its own evaluation format, ratings, purpose, and frequency.
In order to account for any organization-specific variance in performance evaluation
reactions, we use a dummy code control for each organization. An analysis of variance
disclosed no significant differences across organizations with regard to the dependent
variable (F ¼ 1.317, ns).
Total performance evaluations. We control for the number of performance
evaluation events an individual has experienced with the current employer.
Motivating potential score. Consistent research evidence indicates that
characteristics of highly motivating jobs are associated with performance (Fried and
Ferris, 1987) and overall satisfaction (Ambrose and Kulik, 1999). In the event that such
overall satisfaction is related to and/or influences satisfaction with appraisal processes,
we controlled for this construct in the analysis. Based on Hackman and Oldham’s
(1980) research, we entered each participant’s self-reported motivating potential
score (MPS ¼ (Skill Variety þ Task Identity þ Task Significance)/3 Autonomy
Feedback) as an additional control. One item assessed each job characteristic.
For example, task identity was assessed with responses to the following question:
“To what extent does your work involve doing a whole and identifiable piece
of work?”
We considered other control variables such as years with the organization, whether
a respondent participated in peer or upward evaluation, type of organization
(non-profit or business), gender, age, and education level. However, these considerations
were not significantly correlated to the variables of interest in this study.
Results
We performed confirmatory factor analysis to examine construct validity and test for
common method variance. We used a partial disaggregation approach for each variable
with more than five indicators, creating item parcels using the item-to-construct
balance approach (Williams and O’Boyle, 2008). Confirmatory factor analysis indicated
that one item in communication adequacy cross-loaded on coworker relations.
We noted that it dealt with coworkers rather than organizational communication.
In order to keep the constructs distinct, we eliminated the item before proceeding (see
Appendix). To test for model fit, we relied on a chi-square test of the null hypothesis
and two indices recommended by Williams et al. (2002), CFI (values of 0.95 and above) Employee social
and RMSEA (values below 0.05 represent very good fit and 0.08 represent good fit). cognition
In our sample the CFI was 0.998 and the RMSEA was 0.018. Estimates of factor loadings
are set forth in Table II.
Scale reliabilities (where applicable) are shown on the diagonal in Table III.
Cronbach’s a’s were very good: evaluation reactions (0.90), job resource adequacy (0.82),
co-worker relationship quality (0.85), and communication adequacy (0.88). Pearson 523
product-moment correlations in Table III provide initial support for the hypotheses.
Each independent variable is positively and significantly correlated with performance
evaluation reactions ( job resource adequacy at r ¼ 0.45, coworker relations at r ¼ 0.35,
communication adequacy at r ¼ 0.34, po0.001, and preparation time at r ¼ 0.23,
po0.001).
We tested a null model of performance evaluation reactions for the possibility of
employing hierarchical linear modeling (HLM) in our analysis. It was not significant
(w2(6) ¼ 6.67, p ¼ 0.352), meaning that the between organization variance is not
a significant portion of the total variance. The intraclass correlation showed that o1
percent of the total variance in the unconditioned model could be attributed to between
organization differences. Thus, HLM is not warranted (Hox, 2010).
We analyzed the data using hierarchical regression in SPSS because the data
has inadequate statistical power to use structural equation modeling. Hierarchical
regression is an appropriate method to test both direct and interaction hypotheses in a
Estimate
Mean SD 1 2 3 4 5 6 7
Dependent variable
Variables entered Evaluation process reaction
Controls VIF
MPS 0.29*** 0.19*** 0.18** 0.17** 1.19
Total no. evaluations 0.17** 0.13** 0.12* 0.11 1.29
Organization 1 0.03 0.06 0.08 0.07 1.68
Organization 2 0.12 0.21** 0.21** 0.19* 2.41
Organization 3 0.12 0.11* 0.11 0.14* 1.30
Organization 4 0.08 0.13* 0.12 0.14* 1.76
Organization 5 0.06 0.00 0.03 0.05 1.20
Organization 6 0.03 0.43 0.06 0.08 1.36
Organization 7 0.02 0.17 0.04 0.01 1.17
R2 0.15
F 4.72***
Step 1 Organization
Job resource adequacyb 0.24*** 0.24*** 0.45*** 2.74
Communication adequacyb 0.17* 0.14* 0.11** 2.94
Coworker relationship qualityb 0.16** 0.16** 0.17** 1.28
DR2 0.17
DF 20.63***
Step 2 Cognition
Preparation time 0.15** 0.13* 1.16
DR2 0.02
DF 7.11**
Step 3 Interactions
Job resource adq. Prep. time 0.30*** 2.57
Comm. adequacy Prep. time 0.36*** 2.91
DR2 0.05
DF 10.45***
R2 of model 0.15 0.32 0.34 0.39
Table IV.
a b
Results of hierarchical Notes: n ¼ 260. Standardized regression coefficients; Variables centered prior to regression as
regression analysisa recommended by Cohen et al. (2003). * po0.05; ** po0.01; *** po0.001
Regression results support the first three hypotheses. Job resource adequacy, Employee social
communication adequacy, and high-quality coworker relationships are significantly cognition
associated with performance evaluation process reactions (b ¼ 0.24, po0.001, b ¼ 0.17,
po0.05, and b ¼ 0.18, po0.01, respectively). H4 is also supported, employee time
preparing for a performance evaluation is positively associated with evaluation reactions
(b ¼ 0.15, po0.01).
H5 predicts that preparation time moderates the relationship between job resource 525
adequacy and reactions to performance evaluation processes by weakening the
positive relationship, especially when job resource adequacy is lower. Consistent
with H5, when the interaction terms are entered in Step 3, the main effects for job
resource adequacy and preparation time remain significant (b ¼ 0.45, po0.001 and
b ¼ 0.13, po0.05, respectively), and interaction effects of job resource adequacy and
preparation time are significant and negative (b ¼ 0.30, po0.001). In order to
interpret the interaction, we followed the procedure set forth in Cohen et al. (2003)and
plotted the three regression lines of centered job resource adequacy on employee
reactions to performance evaluation processes at three values of preparation time, at
its mean and one standard deviation above and below the mean. Lines with different
slopes provide evidence of an interaction. Figure 2 shows this plot. H5 is partially
supported. Preparation time moderates job resource adequacy, but the explanation is
more complex than hypothesized. Under high preparation, when job resource
adequacy is lowest, reactions to performance evaluation processes are slightly higher
than at average preparation and no preparation. However, as job resource adequacy
increases, high preparation has a lesser slope than medium preparation which has, in
turn, a lesser slope than no preparation. Thus, no preparation in a high resource
environment produces the most favorable reactions to performance evaluation
processes.
Finally, H6 predicts that preparation time moderates the relationship between
communication adequacy and reactions to performance evaluation by magnifying
the positive association with communication adequacy. H6 is supported. When the
interaction terms are entered in Step 3, the main effect for communication adequacy
remains significant, the sign changes from positive to negative (b ¼ 0.11, po0.01),
and the interaction is significant (b ¼ 0.36, po0.001). In order to interpret the
3
Reactions to Per. Eval. Processes
Figure 2.
0 Simple regression lines:
1 2 3 4 5 job resource adequacy
Job Resource Adequacy with preparation
time moderator
High Prep Med Prep No Prep
PR interaction, we plotted the three regression lines of centered job resource adequacy on
43,4 employee reactions to performance evaluation processes at three values of
preparation time, at its mean and one standard deviation above and below the
mean (Cohen et al., 2003). This plot appears in Figure 3. Consistent with H6, under
no preparation, average preparation, and high preparation time, communication
adequacy has a progressively steeper slope, indicating more favorable employee
526 reactions to performance evaluation processes. In other words, preparation time
moderates the association between communication adequacy and employee reactions
to performance evaluation processes such that greater preparation in a high
communication environment produces the most positive employee reactions to
performance evaluation processes.
The hypotheses and results are summarized in Table V. We next discuss the
implications of this study for research and practice.
Discussion
This research explores employee reactions to performance evaluation processes as
situated cognitions. Our approach holds promise for interventions to improve employee
satisfaction with performance evaluation processes. This study provides initial
support for the notion that job resources, organizational communication, and coworker
relationships in organizations are positively associated with situated cognitions about
performance evaluation processes. The time an employee spends preparing for a
performance evaluation interview also emerges as an interesting subject for future
research, as we found both direct associations and interactions with the organizational
context. Using a social cognitive approach in future research may help illuminate
factors that surround and influence reactions to performance evaluation processes
(Bamberger, 2008).
For example, we found support for the role job resources may play in overall
reactions to performance evaluation processes alone and as it interacts with preparation
time (H1 and H5). Specifically, abundant job resources may help employees see an
organization’s performance evaluation processes in a positive light. Inadequate job
resources may be the most cognitively relevant to an employee when a performance
5
Reactions to Perf. Eval.
4
Processes
Figure 3. 0
Simple regression lines: 1 2 3 4 5
communication adequacy Communication Adequacy
with preparation
time moderator
High Prep Med Prep No Prep
Supported or
Employee social
Hypothesis not supported cognition
1. Job resource adequacy is positively associated with favorable employee reactions Supported
to performance evaluation processes
2. Workplace communication adequacy is positively associated with favorable Supported
employee reactions to performance evaluation processes
3. Coworker relationship quality is positively associated with favorable employee Supported
527
reactions to performance evaluation processes
4. Preparation time for an evaluation interview is positively associated with Supported
favorable employee reactions to performance evaluation processes
5. Preparation time moderates the relationship between job resource adequacy and Partially
employee reactions to performance evaluation processes. Under conditions of high supported
preparation, the relationship between job resource adequacy and employee
reactions to performance evaluation is weaker than under conditions of moderate
preparation or no preparation
6. Preparation time moderates the relationship between communication adequacy Supported
and employee reactions to performance evaluation processes. Under conditions of
high preparation time, the positive relationship between communication adequacy
and employee reactions to performance evaluation is more positive than under
conditions of moderate preparation, which in turn is more positive than no Table V.
preparation time Summary of results
Corresponding author
Dr Amy Klemm Verbos can be contacted at: verbo1a@cmich.edu