Professional Documents
Culture Documents
Effects of Trainee Characteristics On Training Effectiveness-Jacob Weisberg
Effects of Trainee Characteristics On Training Effectiveness-Jacob Weisberg
Effects of Trainee Characteristics On Training Effectiveness-Jacob Weisberg
Effects of Trainee
Characteristics on Training
Effectiveness
Aharon Tziner*, Michal Fisher*, Tami Senior* and
Jacob Weisberg**
*Netanya University College, 16 Kibutz, Galoyot Street, Netanya 42365, Israel. atziner@netanya.ac.il
**Bar-Ilan University, Box 90000, Ramat-Gan, 52900, Israel
& 2007 The Authors. Journal compilation & 2007 Blackwell Publishing Ltd,
9600 Garsington Road, Oxford, OX4 2DQ, UK and 350 Main St., Malden, MA, 02148, USA
168 Aharon Tziner, Michal Fisher, Tami Senior and Jacob Weisberg
1.3. Work environment characteristic: transfer of supervisor. This information was used as a code to
training climate match each questionnaire with the grade obtained by
the respondent at the end of the course, thereby
Work environment characteristics have also been found
maintaining anonymity for purposes of the study. (No
to influence the effectiveness of the learning process in
two respondents shared the same date of birth and the
training, and the extent to which the capabilities
same supervisor.) The final grade was as an objective
acquired in training are applied in the actual job setting.
numerical score on a scale from 1 to 100 reflecting the
One of the primary environmental factors is transfer
level of mastery of the course contents.
of training climate, defined as the trainee’s perception
About 3 weeks after completion of the program, the
of the degree to which there will be support for
supervisors were asked to assess the degree to which
using on the job what has been acquired in training.
each trainee made use of the skills developed during
Research clearly supports the proposition that a favor-
training. The same code was used to match these evalua-
able transfer climate enhances training attainment
tions with the participants’ final grades and questionnaires.
and subsequent job performance (Tracey, Tannenbaum,
& Kavangh, 1995; Tziner et al., 1991).
Although each of these variables has been studied
individually, no previous comprehensive investigation
3. Instruments
has examined their combined and relative contribution
to training effectiveness in a real setting. This study sought
3.1. Dependent variables
to fill this gap. On the basis of the above definitions and 3.1.1. Training grade
previous findings, it was hypothesized that the trainee The participant’s mark out of 100 on the final training
personality characteristics of conscientiousness and course examination, which assessed the knowledge he
self-efficacy, the motivational characteristics of motiva- had acquired in the program (M ¼ 85.45; SD ¼ 9.75).
tion to learn, learning goal orientation, performance
goal orientation, and instrumentality, and the environ- 3.1.2. Supervisor evaluation of post-training job performance
mental characteristic of transfer of training climate, Ten items designed to obtain the supervisor’s assess-
would all be linked to training scores and to post- ment of the extent to which the employee applied the
training evaluated job performance. All the employee knowledge and skills he acquired during the training
and work environment variables were expected program. The items related to issues such as the degree
to produce positive correlations with the outcome to which the trainee tried to improve his performance,
variables, except for performance goal orientation, to use new work techniques and knowledge, to change
which would yield a negative correlation. existing work procedures, to persuade colleagues and
superiors at work to modify customary work proce-
dures, etc. Scores were marked on a six–point scale
2. Method ranging from 6 (to a large degree) to 1 (to a small degree),
with high scores indicative of greater use of the knowl-
2.1. Participants edge and skills acquired in training, in the assessment
of the supervisor. This measure yielded an internal
Data were collected from 130 male employees of a consistency of a ¼ .88 (M ¼ 4.3; SD ¼.80).
large industrial power company who held a variety of
technical and operational jobs. All of them attended a
two-month in-house training program aimed at main- 3.2. Independent variables
taining and upgrading technical–professional knowl-
edge. Mean age of the participants was 37.48 Conscientiousness was assessed using nine items drawn
(SD ¼ 7.54) and mean tenure with the company was from the first items in this construct in the NEO Five-
10.45 years (SD ¼ 6.35). In terms of education, 46.2% Factors Inventory (Costa & McCrae, 1992). A high
had completed high school, 43.8% had some academic score on this scale reflects a high degree of conscien-
training, and 10% held a university degree. tiousness. In this study, internal consistency was a ¼ .86
(M ¼ 5.14; SD ¼.57).
Self-efficacy was gauged by means of nine items
designed to assess the extent to which the trainee beli-
2.2. Procedure
eved he had the necessary competencies to successfully
A questionnaire designed to measure the trainee and meet the training requirements, for example: ‘I believe I
environmental variables was administered to the parti- am capable of absorbing the material taught in this
cipants about a week after commencement of the program,’ ‘I feel confident I can succeed in this program,’
training program. In addition, they were asked to note ‘I am capable of performing the training assignments.’ A
their full date of birth and the name of their immediate high score indicates a high level of perceived self-
efficacy. The internal consistency of the measure was acquired skills is valued highly,’ and ‘Back at work I
found to be a ¼ .90 (M ¼ 5.06; SD ¼.59). anticipate being assigned tasks which require that I
Motivation to learn was assessed by means of 10 apply the knowledge I acquired in the training program.’
items, such as: ‘I am exerting considerable effort to A high score on this measure is indicative of a work
obtain a high grade in this program,’ ‘I am devoting a environment supportive of the transfer of training. This
considerable amount of time to my training assign- measure yielded an internal consistency of a ¼ .85
ments,’ and ‘I have set high achievement goals for myself (M ¼ 4.62; SD ¼.76).
in this program.’ A high score indicates a strong The final questionnaire measuring the independent
motivation to learn. An internal consistency of a ¼ .93 variables of trainee and work environment character-
(M ¼ 4.48; SD ¼.91) was found for this measure. istics therefore consisted of 57 statements. Participants
Learning goal orientation was measured by means of indicated their response to each statement on a six-
nine items, for example: ‘The opportunity to learn new point scale ranging from 6 (strongly agree) to 1 (strongly
things is important to me,’ ‘I like doing challenging disagree). Each participant was assigned a score for each
work,’ ‘It is important to me to make the most of my of the seven variables equal to his total score on all the
skills.’ A high score indicates a high level of learning goal items relating to that variable.
orientation. The internal consistency of the measure
was found to be a ¼ .83 (M ¼ 5.29; SD ¼.46).
Performance goal orientation was measured by 10 4. Results
items, including: ‘The things I enjoy the most are the
things I do best,’ ‘I enjoy performing tasks which I know I Pearson’s correlations were performed among all the
will do well,’ and ‘I feel smart when I do things without study variables. The results of this analysis appear in
making mistakes.’ A high score is indicative of a high level Table 1.
of performance goal orientation. This measure yielded The correlation coefficients in Table 1 reveal that all
an internal consistency of a ¼ .87 (M ¼ 4.36; SD ¼.78). our hypotheses were confirmed. In addition, a strong
Instrumentality of training was tapped by means of 10 correlation was found between training grade and
items, for example: ‘I feel that successful completion of supervisor evaluation. Studies typically report a corre-
the training program will help me to get higher monetary lation around .45 between training scores and post-
rewards,’ ‘I trust and believe that succeeding in this training job performance ratings, often attributing the
training program will enhance my chances of promotion.’ relatively moderate magnitude of this association to
A high score indicates that the training course has a deficiencies in the training program. Our investigation,
high instrumentality value for the trainee. The internal however, found a correlation of .705 between the two
consistency found here was a ¼ .88 (M ¼ 3.96; SD ¼.87). measures of training effectiveness, perhaps indicating
Transfer of training climate was assessed by means of that a better job was carried out here in attuning the
10 items, such as: ‘I can count on the support I will get training program to actual job requirements.
at work when I try to apply the skills acquired in The trainee’s personality characteristics yielded sig-
training,’ ‘In my work unit, the utilization of newly nificant correlations with both success on the final
Table 1. Descriptive statistics and Pearson’s correlations among study variables (N ¼ 130)
Transfer of Performance Learning
Conscien- Self- training goal goal Motivation Instru- Training
Mean SD tiousness efficacy climate orientation orientation to learn mentality grade
exam and supervisor’s evaluation of his successful Table 2. Hierarchical regression results for training grade and
application of what he had learned. The higher the supervisor’s evaluation
trainee’s conscientiousness, the higher his final training Model 1: Model 2: super-
grade (r ¼.292, p ¼ .001) and the higher his rating on training grade visor evaluation
the supervisor evaluation (r ¼.395, p ¼ .000). Similarly,
b DR2 b DR2
higher self-efficacy was associated with higher training
grade (r ¼.661, p ¼ .000) and higher supervisor evalua- Block 1
tion (r ¼.509, p ¼ .000). Personality
Four variables were used to examine motivational 2. Self-efficacy .661** .437 .424** .259
1. Conscientiousness .254** .057
features of the trainee: motivation to learn, learning Block 2
goal orientation, performance goal orientation, and Personality
instrumentality. These variables also produced signifi- 2. Self-efficacy .53** .437 .315** .259
cant correlations in the expected directions with the 1. Conscientiousness .174 .057
two measures of training effectiveness. Higher motiva- Organization
3. Transfer of training .241** .041 .249** .038
tion to learn, learning goal orientation, and instrumen- climate
tality were all associated with higher training grades Block 3
(r ¼.758, p ¼ .000; r ¼.530, p ¼ .000; r ¼.576, p ¼ .000, Personality
respectively), as well as with higher supervisor evalua- 1. Conscientiousness .157 (NS)
tion (r ¼.609, p ¼ .000; r ¼.539, p ¼ .000; r ¼.433, 2. Self-efficacy .259** .437 .072 (NS)
Organization
p ¼ .000, respectively). On the other hand, higher 3. Transfer of training .028 (NS) .070 (NS)
performance goal orientation yielded negative correla- climate
tions with training grade (r ¼ .441, p ¼ .000) and Motivation for training
supervisor evaluation (r ¼ .330, p ¼ .000). 6. Motivation to learn .561** .134 .376** .073
To ensure that no multi-colinearity effect existed 5. Learning goal .259** .037
orientation
among these four motivational characteristics, a 4. Performance goal .170* .022
Cronbach’s a test was performed and displayed the orientation
very low a ¼ .308. Moreover, while the correlation 7. Instrumentality
coefficients between the four variables are significant, Note: *po.05, **po.01. NS, not significant.
they are not high, further reconfirming the lack of a
multi-colinearity bias.
Finally, the work environment characteristic of transfer
of training climate was also found to correlate positively Model 2 tested the multivariate effect on supervisor
with the two measures of training effectiveness. The evaluation. Here, both conscientiousness and self-effi-
higher the trainee perceived the transfer of training cacy were significant in the first steps of the regression,
climate, the higher his training grade (r ¼.530, p ¼ .000) but lost their significance when additional variables
and the higher the supervisor evaluation of his on-the-job were entered. In the final step of the regression, self-
application of the training program (r ¼.503, p ¼ .000). efficacy showed no significant direct relationship to
To investigate the unique and combined contributions supervisor evaluation (b ¼ .072; p ¼ .490), but contrib-
of the independent variables on training effectiveness, uted very highly to the explained variance (DR2 ¼ 25.9%
two hierarchical regression models were examined. The out of R2 ¼ 48.5%). Moreover, it had a positive indirect
results of this analysis are presented in Table 2. effect via motivation to learn (b ¼ .740; p ¼ .000). Con-
Model 1 tested the multivariate effect on the trai- scientiousness displayed borderline significance (b ¼ .157;
nee’s final grade, and revealed that the personality p ¼ .054) and contributed the minor proportion to the
characteristic of self-efficacy had a significant direct explained variance (DR2 ¼ out of R2 ¼ 48.5%).
effect on grade (b ¼ .259; p ¼ .001) and contributed With respect to motivation, motivation to learn
most to the total explained variance (DR2 ¼ 43.7% out (b ¼ .376; p ¼ .001), learning goal orientation (b ¼ .259;
of R2 ¼ 61.2%). Surprisingly, conscientiousness was not p ¼ .004), and performance goal orientation (b ¼ .170;
found to have a significant effect on grade. Of the p ¼ .024) all displayed a significant effect on supervisor
motivational variables, only motivation to learn pro- evaluation, contributing to the explained variance
duced a significant effect (b ¼ .561; p ¼ .001), contribut- (DR2 ¼ 7.3%; DR2 ¼ 3.7%; DR2 ¼ 2.2%, respectively, out
ing the minor proportion to the explained variance of R2 ¼ 48.5%). No significant effect was found for
(DR2 ¼ 13.4% out of R2 ¼ 61.2%). The organizational instrumentality. Nor did the environmental character-
characteristic of the transfer of training climate did not istic of the transfer of training climate produce a
show a significant direct effect on grade, although an significant direct effect on supervisor evaluation,
indirect relationship was found via motivation to learn although it had a significant indirect effect via motiva-
(b ¼ .642; p ¼ .000). tion to learn (b ¼ .454; p ¼ .000).
the transfer of training climate would exert its effect (Burke & Baldwin, 1999; Haccoun, 1997). It would
on the two measures of training effectiveness through therefore be wise to obtain a repeated measure of the
the mediation of motivation to learn. application of training after a longer period has elapsed.
In addition to advancing research in the field, the This study focused on seven trainee and work envir-
results of this study may prove useful for improving both onment variables previously found to relate to training
the internal outcomes of training courses (measured by outcomes. Nonetheless, a large number of other vari-
final grade) and their application in the workplace ables have also been reported to affect these outcomes,
(measured by supervisor evaluation). The consistent such as work involvement, organizational commitment,
findings of the investigation highlight the importance of achievement orientation, locus of control, etc. Future
promoting learning goal orientation and motivation to research would thus do well to include additional
learn in order to attain better training outcomes. This predictors and training effectiveness measures to study
lends credence to the results of previous studies that their unique and combined contribution as well.
suffered from a restricted framework, as they were Given the economic implications of employee train-
conducted on students and employed fewer variables ing in terms of its value and cost to the company,
(Colquitt & Simmering, 1998; VandeWalle et al., 2001). It research that serves to promote training effectiveness
is also worth noting that our findings support Arthur et is of the utmost importance. We believe this study
al.’s (2003) contention that the estimated effectiveness of takes us one step closer to that goal by identifying,
training may vary with the outcome measure used. As in a real organizational setting, two factors that appear
proved to be the case in our study, the variables found to have a stronger impact than others on training
uniquely related to one measure of effectiveness are not outcomes.
necessarily the same as those uniquely associated with a
different measure of effectiveness (e.g., conscientious-
ness and goal orientation measures predicted supervisor
evaluation but not training grade). Both Alliger et al. Acknowledgements
(1997) and Arthur, Tubre, Paul, and Edens (2004) would
attribute this finding to the fact that the training-out- The authors are greatly indebted to Gil Sharoni for his
come measures captured distinct facets of the training- help with the data analysis.
effectiveness construct.
Certain limitations of this study should be noted, and
might be addressed in future investigations. First, data References
regarding the outcome variable of application of training
on the job were obtained from a single source – the Alliger, G.M., Tannenbaum, S.I., Bennett, W. Jr., Traver, H. and
trainee’s immediate supervisor. Research has shown Shotland, A. (1997) A Meta-Analysis of Relations among
that such evaluations may be biased in different ways as Training Criteria. Personnel Psychology, 50, 41–358.
a result of a variety of factors associated with the Arthur, W. Jr., Bennett, W. Jr., Edens, P.S. and Bell, S.T. (2003)
supervisors themselves, including personality traits, Effectiveness Training in Organizations: A meta-analysis of
their personal and professional relationship with the design and evaluation features. Journal of Applied Psychology,
employee, power struggles in the organization, con- 88, 234–255.
Arthur, W. Jr., Tubre, T.C., Paul, D.S. and Edens, P.S. (2004)
flicts, differing interests, etc. (Tziner, 2002, pp. 279–
Teaching Effectiveness: The relationship between reaction
307). Consequently, the supervisor evaluation of the
and learning criteria. Education Psychology, 23, 275–285.
extent to which the employee applied his newly Barrick, M.R. and Mount, M.K. (1991) The Big Five Personality
acquired knowledge and skills may not have accurately Dimensions and Job Performance: A meta-analysis. Person-
reflected the true situation in all cases. Future investi- nel Psychology, 44, 1–26.
gations might therefore attempt to include objective Barrick, M.R., Stewart, G.L. and Piotrowski, M. (2002) Per-
measures of the application of training as well. sonality and Job Performance: Test of the mediating effects
Moreover, supervisor evaluations were conducted 3 of motivation among sales representatives. Journal of Applied
weeks after completion of training and were captured Psychology, 87, 243–245.
only once. It is conceivable that for a short period of Burke, L.A. and Baldwin, T.T. (1999) Workforce Training
time immediately following the training course, employ- Transfer: A Study of the effect of relapse prevention
training and transfer climate. Human Resource Management,
ees return to work imbued with the motivation to apply
32, 227–242.
their new skills. Once time has elapsed, however,
Campbell, J.P. and Kuncel, N.R. (2001) Individual and Team
circumstances may change: motivation may decline, the Training. In: Anderson, N., Ones, D.S., Sinangil, H.K. and
material learned in the course may be forgotten, the Viswesvaran, C. (eds), Handbook of Industrial, Work &
transfer of training climate may become less conducive, Organizational Psychology, Vol. 2. London: Sage, pp. 278–312.
and so on. Indeed, the phenomenon of relapse of training Colquitt, J.A., LePine, J.A. and Noe, R.A. (2000) Toward an
has been the subject of a considerable number of studies Integrative Theory of Training Motivation: A meta-analytic
path analysis of 20 years of research. Journal of Applied servers. Journal of Personality and Social Psychology, 52, 81–
Psychology, 85, 678–707. 90.
Colquitt, J.A. and Simmering, M.S. (1998) Conscientiousness, Salgado, J.F. (1997) The Five-Factor Model of Personality and
Goal Orientation, and Motivation to Learn during the Job Performance in the European Community. Journal of
Learning Process: A longitudinal study. Journal of Applied Applied Psychology, 82, 30–43.
Psychology, 83, 654–665. Salgado, J.F., Viswesvaran, C. and Ones, D.S. (2001) Predictors
Costa, P.T. and McCrae, R.R. (1992). Revised, NEO Personality Used for Personnel Selection: An overview of constructs,
Inventory and the NEO Five-Factor Inventory. Psychological methods and techniques. In: Anderson, N., Ones, D.S.,
Assessment Resources, Odessa, FL. Simangil, H.K. and Viswesvaran (eds), Handbook of Industrial,
Davis, F.D. and Yi, M.Y. (2004) Improving Computer Skill Work and Organizational Psychology, 1. Thousand Oaks, CA:
Training: Behavior modeling, symbolic mental rehearsal, and Sage, pp. 165–199.
the role of knowledge systems. Journal of Applied Psychology, Seijts, G.H. and Latham, G.P. (2005) Learning versus Perfor-
89, 509–523. mance Goals: When should each be used? Academy of
Fisher, S.L. and Ford, J.K. (1998) Differential Effects of Learner Management Executive, 19, 124–131.
Effect and Goal Orientation in Two Learning Outcomes. Seijts, G.H., Latham, G.P., Tasa, K. and Latham, B.W. (2004)
Personnel Psychology, 51, 397–420. Goal Setting and Goal Orientation: An integration of two
Ford, J.K., Quinones, M.A., Sego, D.J. and Sorra, J.S. (1992) different yet related literatures. Academy of Management
Factors Affecting the Opportunity to Perform Trained Journal, 47, 227–240.
Tasks on the Job. Personnel Psychology, 45, 511–527. Stajkovic, A.D. and Luthans, F. (1998) Self-Efficacy and Work-
Gist, M.E., Stevens, C.K. and Bavetta, A.G. (1991) Effects of Related Performance: A meta-analysis. Psychological Bulletin,
Self-Efficacy and Post-Training Intervention on the Acquisi- 124, 240–261.
tion and Maintenance of Complex Interpersonal Skills. Stevens, C.K. and Gist, M.E. (1997) Effects of Self-Efficacy and
Personnel Psychology, 44, 837–861. Goal Orientation Training on Negotiation Skill Maintenance:
Haccoun, R.R. (1997) Transfer and Retention: Let’s do both What are the mechanisms? Personnel Psychology, 50,
and avoid dilemmas. Applied Psychology: An International 955–978.
Review, 46, 340–344. Tannenbaum, S.I. (1997) Enhancing Continuous Learning:
Holladay, C.L. and Quinones, M.A. (2003) Practice Variability Diagnostic findings from multiple companies. Human Re-
and Transfer of Training: The role of self-efficacy generality. source Management, 36, 437–452.
Journal of Applied Psychology, 88, 1094–1103. Towler, A.J. and Dipboye, R.L. (2001). Effects of Charismatic
Lawler, E.E. and Suttle, J.L. (1973) Expectancy Theory and Communication Training on Motivation, Behavior, and
Job Behavior. Organizational Behavior and Human Decision Attitudes. Paper presented at the annual meeting of the
Processes, 9, 482–503. Society of Industrial/Organizational Psychological, San-
Mathieu, J.E. and Martineau, J.W. (1997) Individual and Situa- Diego.
tional Influences in Training Motivation. In: Ford, J.K., Tracey, J.B., Tannenbaum, S.I. and Kavangh, J.J. (1995)
Kozlowski, S.W.J., Kraiger, K., Salas, E. and Geachout, M.S. Applying Trained Skills on the Job: The importance of
(eds), Improving Training Effectiveness in Organizations. work environment. Journal of Applied Psychology, 80,
Hillsdale, NJ: Erlbaum, pp. 193–222. 239–252.
Mathieu, J.E., Martineau, J.W. and Tannenbaum, S.I. (1993) Tziner, A. (2002) Human Resource Management and Organiza-
Individual and Situational Influences on the Development of tion Behavior: Selected perspectives. Aldershot, UK: Ashgate.
Self-Efficacy: Implications for training effectiveness. Person- Tziner, A., Haccoun, R. and Kadish, A. (1991) Personal and
nel Psychology, 46, 125–147. Situational Characteristics Influencing the Effectiveness of
Mathieu, J.E., Tannenbaum, S.I. and Salas, E. (1992) Influences Transfer of Training Improvement Strategies. Journal of
of Individual and Situational Characteristics on Measures of Occupational Psychology, 64, 67–177.
Training Effectiveness. Academy of Management Journal, 35, VandeWalle, D., Cron, W. and Slocum, J.W. Jr. (2001) The
828–847. Role of Goal Orientation Following Performance Feedback.
Maurer, T.J. and Pierce, H.R. (1998) A Comparison of Likert Journal of Applied Psychology, 86, 629–640.
Scale and Traditional Measures of Self-Efficacy. Journal of Vroom, V.H. (1964) Motivation and Work. New York: Wiley.
Applied Psychology, 83, 324–329. Zhas, H. and Seibert, S.E. (2006) The Big Five Personality
McCrae, R.R. and Costa, P.T. Jr. (1987) Validation of the Five- Dimensions and Entrepreneurial Status: A meta-analytical
Factor Model of Personality Across Instruments and Ob- review. Journal of Applied Psychology, 91, 259–271.