Effects of Trainee Characteristics On Training Effectiveness-Jacob Weisberg

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 8

International Journal of Selection and Assessment Volume 15 Number 2 June 2007

Effects of Trainee
Characteristics on Training
Effectiveness
Aharon Tziner*, Michal Fisher*, Tami Senior* and
Jacob Weisberg**

*Netanya University College, 16 Kibutz, Galoyot Street, Netanya 42365, Israel. atziner@netanya.ac.il
**Bar-Ilan University, Box 90000, Ramat-Gan, 52900, Israel

Six employee characteristics (conscientiousness, self-efficacy, motivation to learn, learn-


ing goal orientation, performance goal orientation, instrumentality) and one work
environment characteristic (transfer of training climate) were captured for 130 trainees
in a large industrial company in an attempt to predict training effectiveness (training
grade, supervisor evaluation of the application of training). The results strongly support
the predicted links, although not all the predictor variables contributed a statistically
significant share of the explained variance of the training outcomes. Motivation to learn
and learning goal orientation were found to contribute most to predicting training
outcomes. The implications of the results are discussed and the limitations of the study
are noted, along with suggested avenues for future research.

1. Effects of trainee characteristics on researchers are interested in identifying the factors


training effectiveness likely to affect training effectiveness.
Among the factors that have been singled out as

T he constant pressure to maintain superiority in the


marketplace engenders the need to constantly
upgrade employee skills and knowledge and to improve
predictors of training outcomes are both individual
characteristics, such as self-efficacy, goal orientation,
and motivation to learn, and work environment pro-
positive work-related attitudes (Tannenbaum, 1997). perties, such as transfer of training climate (e.g., Gist,
The method most commonly used to attain these goals Stevens, & Bavetta, 1991; Mathieu, Tannenbaum,
is training. In economic terms, training represents a & Salas, 1992; Towler & Dipboye, 2001). Insufficient
major outlay for American companies, with estimates of research, however, has been devoted to investigating
more than $55 billion spent annually for this purpose by the unique and combined effects of these two types
firms with 100 employees or more (Arthur, Bennett, of predictors, particularly in real organizational
Edens, & Bell, 2003). This is thought to be money well settings (Holladay & Quinones, 2003). This study was
spent. Davis and Yi (2004) report, for example, that therefore designed to build on and extend previous
Motorola estimates that every dollar spent on training research by studying the unique and combined effects
generates $30 in productivity gains within 3 years. of six trainee characteristics and one work environment
Given the paramount importance and substantial cost variable on training effectiveness in a large industrial
of training, it is not surprising that both companies and company.

& 2007 The Authors. Journal compilation & 2007 Blackwell Publishing Ltd,
9600 Garsington Road, Oxford, OX4 2DQ, UK and 350 Main St., Malden, MA, 02148, USA
168 Aharon Tziner, Michal Fisher, Tami Senior and Jacob Weisberg

1.1. Training effectiveness master training-program contents (Gist et al., 1991;


Stevens & Gist, 1997). It has consistently proven to be
A recent meta-analysis of training effectiveness reveals
positively linked to training performance (Mathieu &
that two of the most relevant measures of training
Martineau, 1997; Mathieu, Martineau, & Tannenbaum,
success are learning outcomes and post-training job
1993), most probably because it plays a motivational
performance (Arthur et al., 2003). The authors con-
role, affecting the amount of effort applied to task
tend, however, that despite the fact that these measures
performance.
are conceptually related, empirical investigations have
only partially succeeded in producing evidence of this
link (Alliger, Tannenbaum, Bennett, Traver, & Shotland,
1.2.3. Motivation to learn
1997; Colquitt, LePine, & Noe, 2000). It may be that
This term refers to the intention to invest high levels
each of the two criteria captures a different facet of
of consistent effort in a particular training program.
training effectiveness, or that each is affected by differ-
Several studies suggest that acquisition is influenced by
ent factors. For instance, actual job performance may
the motivation to learn (Mathieu & Martineau, 1997;
be more susceptible to organizational factors than
Tziner, Haccoun, & Kadish, 1991), but this contention
training performance, or the post-training environment
has thus far received only limited empirical support,
may not generate appropriate opportunities for the
perhaps because motivation is not easily measurable.
learned material, skills, or competencies to be demon-
strated. In either of these circumstances, empirical
findings of training effectiveness would differ depending
1.2.4. Learning goal orientation
on the measure used. Consequently, this study incorpo-
According to Seijts, Latham, Tasa, and Latham (2004)
rated two effectiveness-of-training measures: (a) train-
and Seijts and Latham (2005), those driven by a learning
ing grade (as a measure of the learning outcome of
goal orientation seek challenging tasks that provide
training) and (b) supervisor evaluation of post-training
them with the opportunity to acquire and master new
performance (as an estimate of actual on-the-job
skills and expand competencies. Hence, they can also
performance following completion of the training pro-
be expected to devote more attention to training
gram). This was merely a precautionary step, as there is
programs that enable them to develop their abilities.
no reason to believe that any conceptual difference
exists between the two measures.
1.2.5. Performance goal orientation
Individuals high on performance goal orientation seek
1.2. Trainee characteristics to demonstrate competence and have a strong desire
The literature suggests that certain trainee character- to impress others. Unlike those high on learning goal
istics, relating either to personality or to motivation, orientation, for whom the learning process itself is the
influence training outcomes to a greater extent than reward, people scoring high on performance goal
others. The following attributes, all of which have been orientation are rewarded by external recognition for
shown to impact training outcomes, were chosen for the attainment of goals. This would lead us to expect
this study. the two goal orientation types to be inversely related to
training effectiveness. Although the results are not
1.2.1. Conscientiousness unequivocal, various studies do seem to indicate that
Individuals high on conscientiousness are more depend- learning goal orientation is associated with higher
able, well-organized, persevering, and motivated to training scores than performance goal orientation
excel on the job. Moreover, they tend to set themselves (VandeWalle, Cron, & Slocum, 2001; Fisher & Ford,
higher standards of performance and to be more 1998). However, research is yet to be conducted on the
committed to them. Conscientiousness has been found link between goal orientation and performance during
to be related to overall performance in a wide range of and after training.
jobs (Barrick & Mount, 1991; Salgado, Viswesvaran, &
Ones, 2001; Zhas & Seibert, 2006), and trainees high on
conscientiousness tend to attain higher training out- 1.2.6. Instrumentality of training
comes than those low on this personality trait (Barrick, This term refers to the individual’s perception that
Stewart, & Piotrowski, 2002; Colquitt & Simmering, completion of training will lead to valued outcomes,
1998). such as a sense of accomplishment, greater chance of
promotion, or monetary rewards. Campbell and Kuncel
1.2.2. Self-efficacy (2001) maintain that there is a reasonable body of
This attribute is defined as the individual’s belief that he/ evidence indicating that the magnitude of training
she can successfully meet training requirements and instrumentality affects trainee achievements.

International Journal of Selection and Assessment & 2007 The Authors


Volume 15 Number 2 June 2007 Journal compilation & 2007 Blackwell Publishing Ltd
Effects of Trainee Characteristics 169

1.3. Work environment characteristic: transfer of supervisor. This information was used as a code to
training climate match each questionnaire with the grade obtained by
the respondent at the end of the course, thereby
Work environment characteristics have also been found
maintaining anonymity for purposes of the study. (No
to influence the effectiveness of the learning process in
two respondents shared the same date of birth and the
training, and the extent to which the capabilities
same supervisor.) The final grade was as an objective
acquired in training are applied in the actual job setting.
numerical score on a scale from 1 to 100 reflecting the
One of the primary environmental factors is transfer
level of mastery of the course contents.
of training climate, defined as the trainee’s perception
About 3 weeks after completion of the program, the
of the degree to which there will be support for
supervisors were asked to assess the degree to which
using on the job what has been acquired in training.
each trainee made use of the skills developed during
Research clearly supports the proposition that a favor-
training. The same code was used to match these evalua-
able transfer climate enhances training attainment
tions with the participants’ final grades and questionnaires.
and subsequent job performance (Tracey, Tannenbaum,
& Kavangh, 1995; Tziner et al., 1991).
Although each of these variables has been studied
individually, no previous comprehensive investigation
3. Instruments
has examined their combined and relative contribution
to training effectiveness in a real setting. This study sought
3.1. Dependent variables
to fill this gap. On the basis of the above definitions and 3.1.1. Training grade
previous findings, it was hypothesized that the trainee The participant’s mark out of 100 on the final training
personality characteristics of conscientiousness and course examination, which assessed the knowledge he
self-efficacy, the motivational characteristics of motiva- had acquired in the program (M ¼ 85.45; SD ¼ 9.75).
tion to learn, learning goal orientation, performance
goal orientation, and instrumentality, and the environ- 3.1.2. Supervisor evaluation of post-training job performance
mental characteristic of transfer of training climate, Ten items designed to obtain the supervisor’s assess-
would all be linked to training scores and to post- ment of the extent to which the employee applied the
training evaluated job performance. All the employee knowledge and skills he acquired during the training
and work environment variables were expected program. The items related to issues such as the degree
to produce positive correlations with the outcome to which the trainee tried to improve his performance,
variables, except for performance goal orientation, to use new work techniques and knowledge, to change
which would yield a negative correlation. existing work procedures, to persuade colleagues and
superiors at work to modify customary work proce-
dures, etc. Scores were marked on a six–point scale
2. Method ranging from 6 (to a large degree) to 1 (to a small degree),
with high scores indicative of greater use of the knowl-
2.1. Participants edge and skills acquired in training, in the assessment
of the supervisor. This measure yielded an internal
Data were collected from 130 male employees of a consistency of a ¼ .88 (M ¼ 4.3; SD ¼.80).
large industrial power company who held a variety of
technical and operational jobs. All of them attended a
two-month in-house training program aimed at main- 3.2. Independent variables
taining and upgrading technical–professional knowl-
edge. Mean age of the participants was 37.48 Conscientiousness was assessed using nine items drawn
(SD ¼ 7.54) and mean tenure with the company was from the first items in this construct in the NEO Five-
10.45 years (SD ¼ 6.35). In terms of education, 46.2% Factors Inventory (Costa & McCrae, 1992). A high
had completed high school, 43.8% had some academic score on this scale reflects a high degree of conscien-
training, and 10% held a university degree. tiousness. In this study, internal consistency was a ¼ .86
(M ¼ 5.14; SD ¼.57).
Self-efficacy was gauged by means of nine items
designed to assess the extent to which the trainee beli-
2.2. Procedure
eved he had the necessary competencies to successfully
A questionnaire designed to measure the trainee and meet the training requirements, for example: ‘I believe I
environmental variables was administered to the parti- am capable of absorbing the material taught in this
cipants about a week after commencement of the program,’ ‘I feel confident I can succeed in this program,’
training program. In addition, they were asked to note ‘I am capable of performing the training assignments.’ A
their full date of birth and the name of their immediate high score indicates a high level of perceived self-

& 2007 The Authors International Journal of Selection and Assessment


Journal compilation & 2007 Blackwell Publishing Ltd Volume 15 Number 2 June 2007
170 Aharon Tziner, Michal Fisher, Tami Senior and Jacob Weisberg

efficacy. The internal consistency of the measure was acquired skills is valued highly,’ and ‘Back at work I
found to be a ¼ .90 (M ¼ 5.06; SD ¼.59). anticipate being assigned tasks which require that I
Motivation to learn was assessed by means of 10 apply the knowledge I acquired in the training program.’
items, such as: ‘I am exerting considerable effort to A high score on this measure is indicative of a work
obtain a high grade in this program,’ ‘I am devoting a environment supportive of the transfer of training. This
considerable amount of time to my training assign- measure yielded an internal consistency of a ¼ .85
ments,’ and ‘I have set high achievement goals for myself (M ¼ 4.62; SD ¼.76).
in this program.’ A high score indicates a strong The final questionnaire measuring the independent
motivation to learn. An internal consistency of a ¼ .93 variables of trainee and work environment character-
(M ¼ 4.48; SD ¼.91) was found for this measure. istics therefore consisted of 57 statements. Participants
Learning goal orientation was measured by means of indicated their response to each statement on a six-
nine items, for example: ‘The opportunity to learn new point scale ranging from 6 (strongly agree) to 1 (strongly
things is important to me,’ ‘I like doing challenging disagree). Each participant was assigned a score for each
work,’ ‘It is important to me to make the most of my of the seven variables equal to his total score on all the
skills.’ A high score indicates a high level of learning goal items relating to that variable.
orientation. The internal consistency of the measure
was found to be a ¼ .83 (M ¼ 5.29; SD ¼.46).
Performance goal orientation was measured by 10 4. Results
items, including: ‘The things I enjoy the most are the
things I do best,’ ‘I enjoy performing tasks which I know I Pearson’s correlations were performed among all the
will do well,’ and ‘I feel smart when I do things without study variables. The results of this analysis appear in
making mistakes.’ A high score is indicative of a high level Table 1.
of performance goal orientation. This measure yielded The correlation coefficients in Table 1 reveal that all
an internal consistency of a ¼ .87 (M ¼ 4.36; SD ¼.78). our hypotheses were confirmed. In addition, a strong
Instrumentality of training was tapped by means of 10 correlation was found between training grade and
items, for example: ‘I feel that successful completion of supervisor evaluation. Studies typically report a corre-
the training program will help me to get higher monetary lation around .45 between training scores and post-
rewards,’ ‘I trust and believe that succeeding in this training job performance ratings, often attributing the
training program will enhance my chances of promotion.’ relatively moderate magnitude of this association to
A high score indicates that the training course has a deficiencies in the training program. Our investigation,
high instrumentality value for the trainee. The internal however, found a correlation of .705 between the two
consistency found here was a ¼ .88 (M ¼ 3.96; SD ¼.87). measures of training effectiveness, perhaps indicating
Transfer of training climate was assessed by means of that a better job was carried out here in attuning the
10 items, such as: ‘I can count on the support I will get training program to actual job requirements.
at work when I try to apply the skills acquired in The trainee’s personality characteristics yielded sig-
training,’ ‘In my work unit, the utilization of newly nificant correlations with both success on the final

Table 1. Descriptive statistics and Pearson’s correlations among study variables (N ¼ 130)
Transfer of Performance Learning
Conscien- Self- training goal goal Motivation Instru- Training
Mean SD tiousness efficacy climate orientation orientation to learn mentality grade

Conscientiousness 5.135 .574


Self-efficacy 5.064 .593 .331**
Transfer of training 4.616 .757 .467** .547**
climate
Performance goal 4.356 .783 .093 (NS) .407** .218**
orientation
Learning goal 5.287 .463 .473** .627** .465** .210**
orientation
Motivation to learn 4.481 .910 .324** .689** .642** .358** .487**
Instrumentality 3.969 .872 .072 (NS) .453** .514** .245** .272** .689**
Training grade 85.45 9.753 .292** .661** .530** .411** .530** .758** .576**
(0–100)
Supervisor 4.320 .799 .395** .509** .503** .330** .539** .609** .433** .705**
evaluation
Note: **po.01. NS, not significant.

International Journal of Selection and Assessment & 2007 The Authors


Volume 15 Number 2 June 2007 Journal compilation & 2007 Blackwell Publishing Ltd
Effects of Trainee Characteristics 171

exam and supervisor’s evaluation of his successful Table 2. Hierarchical regression results for training grade and
application of what he had learned. The higher the supervisor’s evaluation
trainee’s conscientiousness, the higher his final training Model 1: Model 2: super-
grade (r ¼.292, p ¼ .001) and the higher his rating on training grade visor evaluation
the supervisor evaluation (r ¼.395, p ¼ .000). Similarly,
b DR2 b DR2
higher self-efficacy was associated with higher training
grade (r ¼.661, p ¼ .000) and higher supervisor evalua- Block 1
tion (r ¼.509, p ¼ .000). Personality
Four variables were used to examine motivational 2. Self-efficacy .661** .437 .424** .259
1. Conscientiousness .254** .057
features of the trainee: motivation to learn, learning Block 2
goal orientation, performance goal orientation, and Personality
instrumentality. These variables also produced signifi- 2. Self-efficacy .53** .437 .315** .259
cant correlations in the expected directions with the 1. Conscientiousness .174 .057
two measures of training effectiveness. Higher motiva- Organization
3. Transfer of training .241** .041 .249** .038
tion to learn, learning goal orientation, and instrumen- climate
tality were all associated with higher training grades Block 3
(r ¼.758, p ¼ .000; r ¼.530, p ¼ .000; r ¼.576, p ¼ .000, Personality
respectively), as well as with higher supervisor evalua- 1. Conscientiousness .157 (NS)
tion (r ¼.609, p ¼ .000; r ¼.539, p ¼ .000; r ¼.433, 2. Self-efficacy .259** .437 .072 (NS)
Organization
p ¼ .000, respectively). On the other hand, higher 3. Transfer of training .028 (NS) .070 (NS)
performance goal orientation yielded negative correla- climate
tions with training grade (r ¼ .441, p ¼ .000) and Motivation for training
supervisor evaluation (r ¼ .330, p ¼ .000). 6. Motivation to learn .561** .134 .376** .073
To ensure that no multi-colinearity effect existed 5. Learning goal .259** .037
orientation
among these four motivational characteristics, a 4. Performance goal .170* .022
Cronbach’s a test was performed and displayed the orientation
very low a ¼ .308. Moreover, while the correlation 7. Instrumentality
coefficients between the four variables are significant, Note: *po.05, **po.01. NS, not significant.
they are not high, further reconfirming the lack of a
multi-colinearity bias.
Finally, the work environment characteristic of transfer
of training climate was also found to correlate positively Model 2 tested the multivariate effect on supervisor
with the two measures of training effectiveness. The evaluation. Here, both conscientiousness and self-effi-
higher the trainee perceived the transfer of training cacy were significant in the first steps of the regression,
climate, the higher his training grade (r ¼.530, p ¼ .000) but lost their significance when additional variables
and the higher the supervisor evaluation of his on-the-job were entered. In the final step of the regression, self-
application of the training program (r ¼.503, p ¼ .000). efficacy showed no significant direct relationship to
To investigate the unique and combined contributions supervisor evaluation (b ¼ .072; p ¼ .490), but contrib-
of the independent variables on training effectiveness, uted very highly to the explained variance (DR2 ¼ 25.9%
two hierarchical regression models were examined. The out of R2 ¼ 48.5%). Moreover, it had a positive indirect
results of this analysis are presented in Table 2. effect via motivation to learn (b ¼ .740; p ¼ .000). Con-
Model 1 tested the multivariate effect on the trai- scientiousness displayed borderline significance (b ¼ .157;
nee’s final grade, and revealed that the personality p ¼ .054) and contributed the minor proportion to the
characteristic of self-efficacy had a significant direct explained variance (DR2 ¼ out of R2 ¼ 48.5%).
effect on grade (b ¼ .259; p ¼ .001) and contributed With respect to motivation, motivation to learn
most to the total explained variance (DR2 ¼ 43.7% out (b ¼ .376; p ¼ .001), learning goal orientation (b ¼ .259;
of R2 ¼ 61.2%). Surprisingly, conscientiousness was not p ¼ .004), and performance goal orientation (b ¼ .170;
found to have a significant effect on grade. Of the p ¼ .024) all displayed a significant effect on supervisor
motivational variables, only motivation to learn pro- evaluation, contributing to the explained variance
duced a significant effect (b ¼ .561; p ¼ .001), contribut- (DR2 ¼ 7.3%; DR2 ¼ 3.7%; DR2 ¼ 2.2%, respectively, out
ing the minor proportion to the explained variance of R2 ¼ 48.5%). No significant effect was found for
(DR2 ¼ 13.4% out of R2 ¼ 61.2%). The organizational instrumentality. Nor did the environmental character-
characteristic of the transfer of training climate did not istic of the transfer of training climate produce a
show a significant direct effect on grade, although an significant direct effect on supervisor evaluation,
indirect relationship was found via motivation to learn although it had a significant indirect effect via motiva-
(b ¼ .642; p ¼ .000). tion to learn (b ¼ .454; p ¼ .000).

& 2007 The Authors International Journal of Selection and Assessment


Journal compilation & 2007 Blackwell Publishing Ltd Volume 15 Number 2 June 2007
172 Aharon Tziner, Michal Fisher, Tami Senior and Jacob Weisberg

5. Discussion invest greater efforts in the course and therefore are


more successful in acquiring new skills and work meth-
This investigation examined the direct influence of six ods than trainees low on motivation. These employees
employee characteristics (conscientiousness, self-efficacy, may logically be expected to bring their improved work
motivation to learn, learning goal orientation, perfor- competencies back with them to the workplace, allowing
mance goal orientation, instrumentality) and a work them to perform better and thereby achieve higher
environment characteristic (transfer of training climate) supervisor evaluations than trainees low on motivation.
on two training outcomes (training grade, supervisor Goal orientation also produced the expected pattern
evaluation of post-training performance) in a real of results in Model 2 (supervisor evaluation), with a
organizational setting. Having previously been investi- significant positive effect found for learning goal orien-
gated individually, the seven independent variables are tation and a significant negative effect for performance
all assumed to impact on the value of employee training. goal orientation. The effect of learning goal orientation
Our aim here was to discover the relative contribution on performance could be accounted for by the desire of
of these diverse dimensions by examining their unique people high on this trait to master new skills and
and combined effects on training effectiveness. discover better performance strategies that will ulti-
Conscientiousness was found to have a direct effect mately result in better performance attainments. On
on supervisor evaluation, a finding consistent with the the other hand, trainees high on performance goal
claim that conscientious people tend to be organized orientation would focus attention on how to impress
and systematic and to accurately assess the demands of others, that is, on the outcome of performance rather
a task. They therefore have confidence in their abilities, than on its actual level. As supervisor evaluations relate
enabling them to perform better than people low on to the quality of attainments, those who have invested
conscientiousness (Barrick & Mount, 1991; Salgado, efforts in developing the competencies needed to per-
1997). Contrary to expectations, however, no signifi- form better (i.e., learning goal orientation) would be
cant effect for conscientiousness on the final training expected to rate higher than employees driven by the
grade was found, despite the familiar contention that needs of impression management (i.e., performance
conscientious individuals, who display traits such as per- goal orientation), and the two goal orientations should
severance and diligence, invest greater efforts in train- correlate inversely with performance ratings (Seijts &
ing programs and therefore achieve greater success Latham, 2005; Seijts et al., 2004).
(McCrae & Costa, 1987). However important con- Although studies relying on the Expectancy Theory
scientiousness may be, it is possible that in the context (Lawler & Suttle, 1973; Vroom, 1964) have demon-
of training it has less effect on performance than other strated that the perception of the value of training is
personal qualities or than motivation. related to success, this was not borne out this study.
Revealing the opposite pattern, the second person- Instrumentality did not produce a significant effect
ality characteristic, self-efficacy, yielded a significant either on the training grade or on supervisor evaluation
effect on training grade but not on supervisor evalua- of the application of training on the job.
tion. The effect on training grade is consistent with an Nor was a significant direct effect found for transfer
earlier study, which reported that trainees high on self- of training climate on either of the measures of training
efficacy displayed high performance levels that were effectiveness, although previous studies have shown
reflected in the final grade (Maurer & Pierce, 1998). The that employees in organizations with a climate that
fact that this characteristic did not show a direct encourages the application of training invest greater
significant effect on supervisor evaluation is surprising, efforts in applying their newly acquired knowledge and
as it has previously been found to have positive direct skills in the workplace (Ford, Quinones, Sego, & Sorra,
links to work performance (Stajkovic & Luthans, 1998). 1992; Tziner et al., 1991). This study, however, did find
In our study, the effect of self-efficacy on performance an indirect significant effect for this variable, mediated
was mediated by motivation to learn. It is possible that by a motivation to learn, on both training grade and
self-efficacy enhances the motivation to learn, which in supervisor evaluation. This rather surprising result
turn leads the trainee to acquire more knowledge, might be explained by the fact that variables such as
skills, and competencies and to develop superior motivation to learn and goal orientation were not
work strategies. If this is the case, then motivation to included in the investigations that reported a positive
learn would exert a closer impact on performance than effect for transfer of training climate. These variables
on self-efficacy. may very well capture most of the unique significant
Indeed, this study found a significant positive effect contribution of a positive climate. On the other hand, a
for motivation to learn on both training grade and high learning goal orientation and motivation to learn
supervisor evaluation. It is reasonable to assume that might shield trainees from an unfavorable, non-suppor-
trainees with a high motivation to learn (as part of the tive transfer climate, giving them the strength to over-
effect of other personality and situational variables) come the obstacles it places in their path. In both cases,

International Journal of Selection and Assessment & 2007 The Authors


Volume 15 Number 2 June 2007 Journal compilation & 2007 Blackwell Publishing Ltd
Effects of Trainee Characteristics 173

the transfer of training climate would exert its effect (Burke & Baldwin, 1999; Haccoun, 1997). It would
on the two measures of training effectiveness through therefore be wise to obtain a repeated measure of the
the mediation of motivation to learn. application of training after a longer period has elapsed.
In addition to advancing research in the field, the This study focused on seven trainee and work envir-
results of this study may prove useful for improving both onment variables previously found to relate to training
the internal outcomes of training courses (measured by outcomes. Nonetheless, a large number of other vari-
final grade) and their application in the workplace ables have also been reported to affect these outcomes,
(measured by supervisor evaluation). The consistent such as work involvement, organizational commitment,
findings of the investigation highlight the importance of achievement orientation, locus of control, etc. Future
promoting learning goal orientation and motivation to research would thus do well to include additional
learn in order to attain better training outcomes. This predictors and training effectiveness measures to study
lends credence to the results of previous studies that their unique and combined contribution as well.
suffered from a restricted framework, as they were Given the economic implications of employee train-
conducted on students and employed fewer variables ing in terms of its value and cost to the company,
(Colquitt & Simmering, 1998; VandeWalle et al., 2001). It research that serves to promote training effectiveness
is also worth noting that our findings support Arthur et is of the utmost importance. We believe this study
al.’s (2003) contention that the estimated effectiveness of takes us one step closer to that goal by identifying,
training may vary with the outcome measure used. As in a real organizational setting, two factors that appear
proved to be the case in our study, the variables found to have a stronger impact than others on training
uniquely related to one measure of effectiveness are not outcomes.
necessarily the same as those uniquely associated with a
different measure of effectiveness (e.g., conscientious-
ness and goal orientation measures predicted supervisor
evaluation but not training grade). Both Alliger et al. Acknowledgements
(1997) and Arthur, Tubre, Paul, and Edens (2004) would
attribute this finding to the fact that the training-out- The authors are greatly indebted to Gil Sharoni for his
come measures captured distinct facets of the training- help with the data analysis.
effectiveness construct.
Certain limitations of this study should be noted, and
might be addressed in future investigations. First, data References
regarding the outcome variable of application of training
on the job were obtained from a single source – the Alliger, G.M., Tannenbaum, S.I., Bennett, W. Jr., Traver, H. and
trainee’s immediate supervisor. Research has shown Shotland, A. (1997) A Meta-Analysis of Relations among
that such evaluations may be biased in different ways as Training Criteria. Personnel Psychology, 50, 41–358.
a result of a variety of factors associated with the Arthur, W. Jr., Bennett, W. Jr., Edens, P.S. and Bell, S.T. (2003)
supervisors themselves, including personality traits, Effectiveness Training in Organizations: A meta-analysis of
their personal and professional relationship with the design and evaluation features. Journal of Applied Psychology,
employee, power struggles in the organization, con- 88, 234–255.
Arthur, W. Jr., Tubre, T.C., Paul, D.S. and Edens, P.S. (2004)
flicts, differing interests, etc. (Tziner, 2002, pp. 279–
Teaching Effectiveness: The relationship between reaction
307). Consequently, the supervisor evaluation of the
and learning criteria. Education Psychology, 23, 275–285.
extent to which the employee applied his newly Barrick, M.R. and Mount, M.K. (1991) The Big Five Personality
acquired knowledge and skills may not have accurately Dimensions and Job Performance: A meta-analysis. Person-
reflected the true situation in all cases. Future investi- nel Psychology, 44, 1–26.
gations might therefore attempt to include objective Barrick, M.R., Stewart, G.L. and Piotrowski, M. (2002) Per-
measures of the application of training as well. sonality and Job Performance: Test of the mediating effects
Moreover, supervisor evaluations were conducted 3 of motivation among sales representatives. Journal of Applied
weeks after completion of training and were captured Psychology, 87, 243–245.
only once. It is conceivable that for a short period of Burke, L.A. and Baldwin, T.T. (1999) Workforce Training
time immediately following the training course, employ- Transfer: A Study of the effect of relapse prevention
training and transfer climate. Human Resource Management,
ees return to work imbued with the motivation to apply
32, 227–242.
their new skills. Once time has elapsed, however,
Campbell, J.P. and Kuncel, N.R. (2001) Individual and Team
circumstances may change: motivation may decline, the Training. In: Anderson, N., Ones, D.S., Sinangil, H.K. and
material learned in the course may be forgotten, the Viswesvaran, C. (eds), Handbook of Industrial, Work &
transfer of training climate may become less conducive, Organizational Psychology, Vol. 2. London: Sage, pp. 278–312.
and so on. Indeed, the phenomenon of relapse of training Colquitt, J.A., LePine, J.A. and Noe, R.A. (2000) Toward an
has been the subject of a considerable number of studies Integrative Theory of Training Motivation: A meta-analytic

& 2007 The Authors International Journal of Selection and Assessment


Journal compilation & 2007 Blackwell Publishing Ltd Volume 15 Number 2 June 2007
174 Aharon Tziner, Michal Fisher, Tami Senior and Jacob Weisberg

path analysis of 20 years of research. Journal of Applied servers. Journal of Personality and Social Psychology, 52, 81–
Psychology, 85, 678–707. 90.
Colquitt, J.A. and Simmering, M.S. (1998) Conscientiousness, Salgado, J.F. (1997) The Five-Factor Model of Personality and
Goal Orientation, and Motivation to Learn during the Job Performance in the European Community. Journal of
Learning Process: A longitudinal study. Journal of Applied Applied Psychology, 82, 30–43.
Psychology, 83, 654–665. Salgado, J.F., Viswesvaran, C. and Ones, D.S. (2001) Predictors
Costa, P.T. and McCrae, R.R. (1992). Revised, NEO Personality Used for Personnel Selection: An overview of constructs,
Inventory and the NEO Five-Factor Inventory. Psychological methods and techniques. In: Anderson, N., Ones, D.S.,
Assessment Resources, Odessa, FL. Simangil, H.K. and Viswesvaran (eds), Handbook of Industrial,
Davis, F.D. and Yi, M.Y. (2004) Improving Computer Skill Work and Organizational Psychology, 1. Thousand Oaks, CA:
Training: Behavior modeling, symbolic mental rehearsal, and Sage, pp. 165–199.
the role of knowledge systems. Journal of Applied Psychology, Seijts, G.H. and Latham, G.P. (2005) Learning versus Perfor-
89, 509–523. mance Goals: When should each be used? Academy of
Fisher, S.L. and Ford, J.K. (1998) Differential Effects of Learner Management Executive, 19, 124–131.
Effect and Goal Orientation in Two Learning Outcomes. Seijts, G.H., Latham, G.P., Tasa, K. and Latham, B.W. (2004)
Personnel Psychology, 51, 397–420. Goal Setting and Goal Orientation: An integration of two
Ford, J.K., Quinones, M.A., Sego, D.J. and Sorra, J.S. (1992) different yet related literatures. Academy of Management
Factors Affecting the Opportunity to Perform Trained Journal, 47, 227–240.
Tasks on the Job. Personnel Psychology, 45, 511–527. Stajkovic, A.D. and Luthans, F. (1998) Self-Efficacy and Work-
Gist, M.E., Stevens, C.K. and Bavetta, A.G. (1991) Effects of Related Performance: A meta-analysis. Psychological Bulletin,
Self-Efficacy and Post-Training Intervention on the Acquisi- 124, 240–261.
tion and Maintenance of Complex Interpersonal Skills. Stevens, C.K. and Gist, M.E. (1997) Effects of Self-Efficacy and
Personnel Psychology, 44, 837–861. Goal Orientation Training on Negotiation Skill Maintenance:
Haccoun, R.R. (1997) Transfer and Retention: Let’s do both What are the mechanisms? Personnel Psychology, 50,
and avoid dilemmas. Applied Psychology: An International 955–978.
Review, 46, 340–344. Tannenbaum, S.I. (1997) Enhancing Continuous Learning:
Holladay, C.L. and Quinones, M.A. (2003) Practice Variability Diagnostic findings from multiple companies. Human Re-
and Transfer of Training: The role of self-efficacy generality. source Management, 36, 437–452.
Journal of Applied Psychology, 88, 1094–1103. Towler, A.J. and Dipboye, R.L. (2001). Effects of Charismatic
Lawler, E.E. and Suttle, J.L. (1973) Expectancy Theory and Communication Training on Motivation, Behavior, and
Job Behavior. Organizational Behavior and Human Decision Attitudes. Paper presented at the annual meeting of the
Processes, 9, 482–503. Society of Industrial/Organizational Psychological, San-
Mathieu, J.E. and Martineau, J.W. (1997) Individual and Situa- Diego.
tional Influences in Training Motivation. In: Ford, J.K., Tracey, J.B., Tannenbaum, S.I. and Kavangh, J.J. (1995)
Kozlowski, S.W.J., Kraiger, K., Salas, E. and Geachout, M.S. Applying Trained Skills on the Job: The importance of
(eds), Improving Training Effectiveness in Organizations. work environment. Journal of Applied Psychology, 80,
Hillsdale, NJ: Erlbaum, pp. 193–222. 239–252.
Mathieu, J.E., Martineau, J.W. and Tannenbaum, S.I. (1993) Tziner, A. (2002) Human Resource Management and Organiza-
Individual and Situational Influences on the Development of tion Behavior: Selected perspectives. Aldershot, UK: Ashgate.
Self-Efficacy: Implications for training effectiveness. Person- Tziner, A., Haccoun, R. and Kadish, A. (1991) Personal and
nel Psychology, 46, 125–147. Situational Characteristics Influencing the Effectiveness of
Mathieu, J.E., Tannenbaum, S.I. and Salas, E. (1992) Influences Transfer of Training Improvement Strategies. Journal of
of Individual and Situational Characteristics on Measures of Occupational Psychology, 64, 67–177.
Training Effectiveness. Academy of Management Journal, 35, VandeWalle, D., Cron, W. and Slocum, J.W. Jr. (2001) The
828–847. Role of Goal Orientation Following Performance Feedback.
Maurer, T.J. and Pierce, H.R. (1998) A Comparison of Likert Journal of Applied Psychology, 86, 629–640.
Scale and Traditional Measures of Self-Efficacy. Journal of Vroom, V.H. (1964) Motivation and Work. New York: Wiley.
Applied Psychology, 83, 324–329. Zhas, H. and Seibert, S.E. (2006) The Big Five Personality
McCrae, R.R. and Costa, P.T. Jr. (1987) Validation of the Five- Dimensions and Entrepreneurial Status: A meta-analytical
Factor Model of Personality Across Instruments and Ob- review. Journal of Applied Psychology, 91, 259–271.

International Journal of Selection and Assessment & 2007 The Authors


Volume 15 Number 2 June 2007 Journal compilation & 2007 Blackwell Publishing Ltd

You might also like