Learning and Individual Differences: Malte Schwinger, Nantje Otterpohl

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 11

Learning and Individual Differences 53 (2017) 122–132

Contents lists available at ScienceDirect

Learning and Individual Differences

journal homepage: www.elsevier.com/locate/lindif

Which one works best? Considering the relative importance of


motivational regulation strategies
Malte Schwinger a,⁎, Nantje Otterpohl b
a
Department of Psychology, Philipps-University Marburg, Gutenbergstr. 18, D-35032 Marburg, Germany
b
Department of Psychology, University of Giessen, Otto-Behaghel-Str. 10F, 35394 Giessen, Germany

a r t i c l e i n f o a b s t r a c t

Article history: Although previous studies have shown that motivational regulation strategies are generally effective in
Received 14 June 2016 sustaining students' effort and persistence, little is known about which kind of motivational strategy
Received in revised form 4 November 2016 works best in general, and for certain students in particular. In this article, we investigated the relative im-
Accepted 15 December 2016
portance of eight different motivational regulation strategies across three samples (N = 531, N = 613, and
Available online xxxx
N = 301, respectively) of German high school and college students under varying conditions. Relative
Keywords:
weights analyses enabled us to control for multicollinearity and to disentangle the unique proportion of
Motivational regulation variance each motivational strategy explained in students' self-reported effort. Moreover, we examined
Regulation of motivation potential moderating effects of gender, conscientiousness, dispositional interest, and achievement goal
Relative weights analysis orientations. Consistently across the three samples, results revealed mastery self-talk as the most effective
Self-regulated learning strategy, followed by proximal goal setting and performance-approach self-talk. Interest enhancement
strategies and performance-avoidance self-talk did not explain a significant amount of variance in self-
reported effort. There were no substantial moderation effects leading to the conclusion that the established
rank order of motivational regulation strategies might be generally applicable to the majority of students.
We discuss theoretical implications of our findings for future studies in motivation regulation research as
well as practical implications for educational practitioners.
© 2016 Published by Elsevier Inc.

1. Introduction strategy might be the best to choose in general, and/or for certain stu-
dents in particular. Although some authors have focused on this issue
The ability to enhance and uphold one's own motivation represents (e.g., Engelschalk, Steuer, & Dresel, 2015; Wolters, 1998), the available
an essential feature of self-regulated learning (e.g., Sansone & Thoman, empirical evidence is limited in several ways. First, a considerable num-
2005; Schwinger & Stiensmeier-Pelster, 2012). Researchers have there- ber of studies have not examined a broad set of motivational regulation
fore focused on the concept of motivational self-regulation which can be strategies simultaneously, which limits the generalizability of their find-
defined as the more or less conscious control over one's own motivation ings. Second, the statistical procedures used were inadequate for con-
which mostly serves to increase effort and persistence (Wolters, 2003). trolling the multicollinearity among motivational strategies. Third,
A number of studies have shown that students who use certain strate- only a few studies have considered personality differences as possible
gies to regulate their motivation put more effort into learning tasks moderating factors (Sansone, Wiebe, & Morgan, 1999; Schwinger et
when faced with obstacles or difficulties (Leutner, Barthel, & al., 2009).
Schreiber, 2001; Schwinger, Steinmayr, & Spinath, 2009; Wolters & In the present paper, we strive to address these shortcomings
Benzon, 2013). In contrast to the relatively well-established finding and to further our understanding of the relative importance of mo-
that frequently using any kind of motivational regulation strategy tivational regulation strategies. We report the findings from three
often results in higher effort and persistence, we do not know much empirical studies in which students' learning effort has been pre-
about their relative importance, that is, which kind of motivational dicted by eight different motivational regulation strategies. Using
Relative Weights Analysis (Tonidandel & LeBreton, 2011), we exam-
ine the relative importance of each motivational strategy across
⁎ Corresponding author.
the three studies. Moreover, we investigate whether relative strate-
E-mail addresses: malte.schwinger@uni-marburg.de (M. Schwinger), gy importance differs depending on students' gender, conscien-
nantje.otterpohl@psychol.uni-giessen.de (N. Otterpohl). tiousness, dispositional interest, and achievement goal orientations,

http://dx.doi.org/10.1016/j.lindif.2016.12.003
1041-6080/© 2016 Published by Elsevier Inc.
M. Schwinger, N. Otterpohl / Learning and Individual Differences 53 (2017) 122–132 123

which have all been described as important covariates in motivation 1.2. Effectiveness of motivational regulation strategies
regulation contexts.
Studies testing the effectiveness1 of motivational regulation strate-
gies have mostly focused on two outcome variables, namely academic
1.1. Strategies for motivational regulation effort and achievement. Findings from these studies have indicated
that motivational regulation strategies have only weak, if any, direct ef-
Students can use several strategies in order to successfully regulate fects on achievement (Schwinger et al., 2009; Schwinger, Steinmayr, &
their motivation. Wolters (1998, 1999) originally proposed five differ- Spinath, 2012; Wolters, 1998, 1999). However, focusing mainly on di-
ent motivational strategies. More recently, however, Wolters and rect effects of motivational strategies may underestimate the impor-
Benzon (2013) reported on the reliability and validity of an advanced tance of motivational regulation for students' achievement. In a later
version of this instrument assessing six strategies. Schwinger, von review of the motivational regulation literature, Wolters clearly stated
der Laden, and Spinath (2007; see also Schwinger et al., 2009) intro- that “… one immediate goal of students' regulation of motivation is to in-
duced an adapted version of Wolters' original questionnaire in crease their effort, persistence, or choice of activities. This adaptive change
which they distinguished eight different strategies for motivational in motivation ultimately should positively affect outcomes that more direct-
regulation. This taxonomy of strategies forms the basis for the ly reflect students' learning and achievement” (Wolters, 2003, p. 201).
present article. Thus, strategies for motivational regulation first and foremost aim to
Most of the eight motivational strategies can be divided into one of optimize students' learning efforts. Substantive direct effects of motiva-
two categories that each describe the respective psychological mecha- tional strategies on achievement are not to be expected. This assump-
nism through which the strategies are supposed to influence students' tion parallels the discussion on the effectiveness of cognitive learning
task-related motivation. The first group of strategies may be labelled in- strategies, which also varies depending on the respective outcome
terest-enhancement strategies, whereas the second group consists of (e.g., Credè & Kuncel, 2008). In conclusion, supposed positive effects of
rather goal-based strategies. Although there are certainly different motivational regulation strategies on achievement would be mediated
ways of sorting the various motivational strategies, we think this cate- by an increase in task-related effort and persistence. Schwinger et al.
gorization makes it easier to grasp the essentials of each strategy as (2009) yielded empirical support for the mediation effect hypothesis.
well as to see similarities and differences between them. With respect In a sample of eleventh and twelfth grade German high school students,
to the group of interest-enhancement strategies, the first motivational they found six of the eight motivational regulation strategies discussed
strategy is called enhancement of situational interest and it refers to situ- above to be significantly related to students' effort management, but not
ations when students try to modify the task in a way that makes it more to their school grades. Effort management, in turn, was demonstrated to
exciting and interesting for them. For example, younger students who be a significant predictor of students' GPA.
have to copy long text passages at school might use different colors With respect to the question which motivational outcome is most
in order to stay motivated for this rather boring task (Sansone, Weir, important to consider, we agree with Wolters (2003) and Pintrich
Harpster, & Morgan, 1992; Sansone et al., 1999). While this strategy (2004), who have suggested the broad concept of effort to be the rele-
focuses on a short-term increase of enjoyment and persistence, the vant outcome criterion in motivational regulation. Other researchers
strategy enhancement of personal significance describes students' have argued that the motivational outcome should not be restricted to
efforts to identify additional reasons for why engaging in certain effort. Sansone and Thoman (2005), for example, stressed that having
tasks could be meaningful for them. That is, they try to find relations extrinsic reasons to perform a task (e.g., expecting rewards) is not
between the tasks at hand and their own individual interests, enough to maintain motivation when a person's interest in the task
preferences, and goals in life (Leutner et al., 2001). The third strate- has not been regulated as well. If the activity is continued only due to su-
gy possibly labelled as an option for interest-enhancement is called perordinate reasons, the person is presumed to feel stressed and hassled
self-consequating. This strategy is among the most frequently applied because there is no positive phenomenological experience while com-
strategies for motivation regulation. Herein, students promise pleting the task. As a consequence, the person will probably quit the
themselves a reward (e.g., socializing, watching a movie) for task earlier and/or will perform worse compared to a person who has
successfully accomplishing a certain task. experienced a successful regulation of task-related interest. Following
Regarding the group of goal-based strategies, proximal goal setting Sansone and Thoman (2005), we would need to examine phenomeno-
represents a strategy where students split a lengthy task into small logical experiences such as task-related interest as well in our studies.
pieces in order to feel more self-efficacious about the task (Bandura & However, in the three studies reported here, we focused on effort as
Schunk, 1981). A great number of students use proximal goal setting the only outcome variable since we believe that investing a suitable
and self-consequating in combination (cf. Wolters, 2003). Overall amount of time and energy, which describes the core of the effort con-
three goal-based strategies comprise self-talk related to long-term struct, represents the most fundamental form of motivation needed to
goals. Based on the trichotomous model of achievement goals (Elliot, successfully complete a task. While we agree with Sansone and
1999), mastery self-talk refers to remembering and thinking about the Thoman (2005) that experiencing some kind of intrinsic motivation
goal to improve one's competencies and to learn as much as possible. would be both beneficial and satisfying for the learner, we see it as
Performance-approach self-talk means that students recall their goal of just one of many precursors of the finally resulting effort.
being better than their classmates whereas performance-avoidance Regarding the impact of motivational regulation on students' subjec-
self-talk describes self-instructing by thinking about not to be worse tive effort, several studies have reported positive effects. In a study by
than others. While seven of eight motivational strategies can be easily Wolters (1999), high school students' self-reported effort was linked
categorized as rather interest-enhancement vs. goal-based strategy,
this is not that easy for the last strategy which is named environmental 1
In this article, we use the term “effectiveness” twofold. First, we are interested wheth-
control. It refers to any kinds of rearranging the learning environment
er certain strategies for motivational regulation are generally effective in enhancing stu-
in a way that it helps to sustain one's motivation and persistence. For dents' effort. In this regard, a non-significant correlation between a motivational
example, many students state to prefer quiet places for learning strategy and effort would indicate an ineffective strategy. The second use of the term effec-
(Zimmerman & Martinez-Pons, 1986). Whether using environmental tiveness refers to the question of relative importance, that is, whether particular motiva-
control for motivation regulation enhances one's effort through increas- tional regulation strategies appear to be more effective than others. We would like to
point out that we are not able to examine the “efficiency” of motivational strategies in
ing interest and task-related value or through boosting self-efficacy to the studies presented here. This would relate to the question whether using a certain strat-
achieve one's goals may depend on both personal and contextual egy in qualitatively different ways leads to qualitatively different effects. Albeit interesting,
factors. issues of qualitative strategy efficiency are not part of this article.
124 M. Schwinger, N. Otterpohl / Learning and Individual Differences 53 (2017) 122–132

to their use of interest enhancement, mastery and performance self- association to effort, with rs ranging between 0.25 and 0.48. Correla-
talk, self-consequating, and environmental control. Schwinger et al. tions between performance-approach self-talk and effort were similarly
(2009, 2012) found the eight motivational regulation strategies de- high, whereas the two interest enhancement strategies and perfor-
scribed above to be associated with an increase in effort expenditure mance-avoidance self-talk were rather uncorrelated with effort. Unlike
and current learning motivation, which was, in turn, positively associat- the study by Wolters (1999), however, Schwinger and colleagues did
ed with students' performance. In addition to these findings from field not examine the relative effectiveness of all strategies in a multiple
studies, experimental evidence has been reported for several particular regression. They argued against such analyses due to the high
motivational strategies. Hulleman and Harackiewicz (2009) asked stu- multicollinearity among the motivational strategies.
dents to find connections between their own individual interests and
the contents taught in science class (i.e., they encouraged them to use 1.3.2. Using adequate analysis techniques
the strategy enhancement of personal significance). Compared to an un- As stated above, the two common statistical procedures to evaluate
treated control group, these students substantially increased their inter- the importance of a set of motivational regulation strategies are zero-
est in science over time. Jackson and Molloy (1985) provided evidence order correlations and multiple regression estimates. Correlations rep-
that students could solve more math problems when they promised resent the unique contribution of each predictor by itself, whereas re-
themselves rewards (i.e., when they used self-consequating) for being gression coefficients represent the incremental contribution of each
successful in those tasks. Sansone et al. (1992) instructed students predictor when combined with all remaining predictors. Unfortunately,
who had to copy letters by hand to ornament the characters. This proce- both procedures are not suitable for determining the relative impor-
dure, which resembles the strategy enhancement of situational interest, tance of a particular predictor examined together with a range of
led to increased persistence compared to not instructed students. Taken other predictors (Johnson & LeBreton, 2004). Zero-order correlations
together, there is substantial evidence that motivational strategies are are inadequate because a specific motivational strategy may not func-
positively linked to indicators of students' learning motivation, such as tion independently from other ones in the real-world setting. Tradition-
effort and persistence. al multiple regression estimates are also inadequate because when
estimating the effect of a particular predictor, the effects of all other pre-
1.3. Relative importance of motivational regulation strategies dictors need to be held constant. In most cases, however, there is high
multicollinearity among predictors, which leads to biased regression es-
A number of college and high school students have reported having timates. In Wolters' (1999) study, for instance, the strategy of interest
problems in successfully regulating their own learning motivation (e.g., enhancement was positively correlated with effort (r = 0.30), but failed
Pychyl, Lee, Thibodeau, & Blunt, 2000). These problems, in turn, might to predict effort significantly in multiple regression.
increase the risk for maladaptive reactions, such as procrastination or Altogether, both kinds of information (zero-order correlations and
school dropout (Grunschel, Patrzek, & Fries, 2013; Wolters, 2003). In regression estimates) are necessary to determine the relative impor-
order to develop efficient intervention programs that assist those stu- tance of each predictor in a set of predictor variables. A statistical proce-
dents in building up an adaptive motivation regulation profile, it dure that integrates this information and that also (mostly) overcomes
would be helpful to know which one of the motivational regulation the multicollinearity problem is Relative Weights Analysis (Johnson &
strategies works best for which kinds of students. However, the avail- LeBreton, 2004; Tonidandel & LeBreton, 2011). When independent pre-
able empirical evidence on the effectiveness of motivational regulation dictor variables in multiple regression are correlated, relative weights
strategies is limited in several ways. For example, there is a lack of stud- address this problem by using principal components analysis to trans-
ies assessing motivation regulation on a behavioral level and/or consid- form the original independent variables into a set of uncorrelated prin-
ering the quality of strategy use. Altogether, it is difficult to draw valid cipal components that are most highly correlated with the original
conclusions on the relative importance of a particular motivational independent variables (Tonidandel & LeBreton, 2011). These compo-
strategy. Possible reasons for this specific shortcoming include (a) the nents are then submitted to two regression analyses. The first analysis
small number of studies examining a broad set of motivational strate- is a regression that predicts the dependent variable from these uncorre-
gies simultaneously, (b) the use of inadequate statistical procedures, lated principal components. Next, the original independent variables
and (c) the non-consideration of personality characteristics as moderat- are regressed onto the uncorrelated principal components. Finally, rela-
ing factors. tive weights are computed by multiplying squared regression weights
from the first analysis (regression of dependent variables on compo-
1.3.1. Examining a broad set of motivational strategies nents) with squared regression weights from the second analysis (re-
Many prior studies examining motivational regulation focused on a gression of independent variables on components). Each weight can
single strategy, or only a small number of strategies. As described be divided by R2 and multiplied by 100 so that the new weights add
above, Sansone and colleagues (Sansone & Thoman, 2005; Sansone et to 100%, with each weight reflecting the percentage of predictable var-
al., 1992) have centered exclusively on students' tendency to increase iance. Relative weights are unique as a measure of total effect in that
their situational interest. Similarly, the line of research pioneered by they provide rank orderings of individual independent variables' contri-
Zimmerman and Martinez-Pons (1986) has tapped into a number of butions to a multiple regression effect in the presence of all other pre-
different regulatory strategies, but only into one or two (e.g., self- dictors based on a computational method that addresses associations
consequating, environmental structuring) that might arguably be char- between independent variables by creating their uncorrelated “coun-
acterized as forms of motivational regulation. Other researchers tended terparts” (Johnson & LeBreton, 2004). With respect to motivational reg-
to rely on higher-order indicators of motivational regulation (e.g., ulation, we believe that relative weights analysis represents a suitable
McCann & Garcia, 1999; Wolters, 1998). Only a few studies have exam- procedure to disentangle the relative importance of each motivational
ined the respective effects of a larger number of motivational regulation strategy.
strategies. Wolters (1999) reported the highest correlation with effort
for mastery self-talk (r = 0.43) and the lowest for self-consequating 1.3.3. Individual characteristics as moderating factors
(r = 0.25). However, when all strategies were entered simultaneously The process of motivational regulation seems to be affected by con-
as predictors into a multiple regression model, only mastery self-talk textual and individual factors that function as moderator variables by
remained a significant predictor of students' effort. Schwinger and influencing how often and how effectively particular motivational strat-
colleagues (Schwinger et al., 2007, 2009, 2012; Schwinger & egies are used (Pintrich, 2004; Schwinger & Stiensmeier-Pelster, 2012;
Stiensmeier-Pelster, 2012) reported a quite similar correlation pattern Wolters, 2003). Some studies have shown that personality characteris-
across several studies. Mastery self-talk mostly showed the highest tics can moderate the effectiveness of motivational regulation
M. Schwinger, N. Otterpohl / Learning and Individual Differences 53 (2017) 122–132 125

strategies. For instance, Sansone et al. (1999) reported that students. If this were the case, it would strengthen the generalizability
hardiness—defined as the tendency to perceive stressful life events as of our findings and interpretations on the relative importance of moti-
controllable and as challenging opportunities, rather than as threats vational regulation strategies. In addition to the cumulative study de-
(Kobasa, 1979)—moderated the effectiveness of interest-enhancing signs, there is also a stepwise increase in the number of personality
strategies. Moreover, Schwinger et al. (2009) found that students who moderators assessed. Although gender is the only moderator in Study
have higher cognitive abilities use some, but not all, motivational regu- 1, conscientiousness is added in Study 2, and dispositional interest and
lation strategies more effectively compared to students with less cogni- achievement goal orientations are further added in Study 3. This step-
tive abilities. Despite these and other studies, the overall empirical wise increase of moderator variables allows us to both replicate and ex-
evidence on the moderating role of individual characteristics in motiva- tend our findings from study to study.
tional regulation is still scarce. However, we think that the question of
relative strategy importance cannot be examined without considering 2. Study 1
important individual features. In the three studies presented here, we
therefore assessed different aspects of the individual student. In Study 1, we want to take a first look at the relative importance of
Our search for potential moderating features was guided by the as- the eight motivational regulation strategies described in the introduc-
sumption that motivational regulation is most effective when the strat- tion. Based on the literature review, we specify the following hypotheses.
egy chosen matches a learner's basic motivational beliefs and attitudes
(Wolters & Benzon, 2013). Moreover, we sought to assess potential Hypothesis 1. All motivational regulation strategies contribute unique-
moderators for each group of motivational strategies, i.e. for interest- ly to the explanation of variance in students' self-reported effort.
enhancement and for goal-based strategies. Based on the literature re-
Hypothesis 2. Goal-based motivational strategies predict a significant-
view and theoretical considerations, dispositional interest appeared to
ly higher amount of variance in students' self-reported effort than inter-
be the most suitable moderator for the effectiveness of interest-en-
est-enhancement strategies.
hancement strategies while conscientiousness and achievement goal
orientations were supposed to moderate the effectiveness of goal- Hypothesis 3. Relative importance rank order of motivational strate-
based strategies. Due to the suggested matching principle, it is plausible gies will be the same for male and female students.
to assume that highly interested individuals profit more from using in-
terest-enhancing strategies since they may find it easier to think about
and/or rearrange certain components of task value which they had 2.1. Method
probably been aware of yet. Likewise, highly conscientious individuals
may use motivational strategies that refer to goals more effectively be- 2.1.1. Sample and procedure
cause these individuals set themselves ambitious goals, stay committed In May 2010, a total of 531 students (362 female; age: M = 24.19,
to these goals during task completion, and work hard and persistently to SD = 3.87) from several German universities participated in an online
achieve their goals (Klein & Lee, 2006). In a similar and even more spe- survey. At the beginning of the survey, students were informed that par-
cific way, it would be reasonable to suggest that mastery-oriented stu- ticipation in this study was voluntary and that they could decide to
dents would mostly benefit from using mastery self-talk, whereas withdraw from the study at any time without penalty. They were fur-
their classmates pursuing performance-approach goals may rely on per- ther informed that the questions were anonymous, that their data will
formance-approach self-talk as their favorite motivational strategy. be treated confidentially, that personal allocation from these data to
Given that prior research has shown that male and female students specific persons were not possible, and that return of the questionnaire
often differ in their motivation beliefs (e.g., Roeser, Midgley, & Urdan, will be considered their consent to participate. About 35% of participants
1996) and their use of self-regulatory strategies (e.g., Cleary & Chen, were enrolled in science subjects, 50% in humanities, and the remaining
2009), we decided to include gender as a further potential moderator students were dispersed across various other subjects. In all, 55% were
in our analyses. To our knowledge, however, none of these studies in- in the first five semesters of their studies, whereas the remaining were
vestigated in how far gender moderated the effectiveness of self-regula- in higher semesters.
tory strategy use. Thus, we had no specific expectations regarding
moderation effects of gender in our studies. 2.1.2. Measures
The eight motivational regulation strategies were assessed with the
1.4. The present research questionnaire by Schwinger et al. (2007, 2009). Each scale is represent-
ed by three to five items which have all to be rated on a scale ranging
The few available studies that have examined the relative impor- from 1 (strongly disagree) to 5 (strongly agree). Former studies have re-
tance of motivational regulation strategies had several deficits, such as ported good psychometric qualities for this questionnaire (Schwinger et
focusing on a small number of strategies and using inadequate statistical al., 2007, 2009). Sample items for each motivational regulation strategy
techniques. Altogether, we think that our knowledge of the relative im- are displayed in Table 1. The Effort subscale of the German version of the
portance of motivational regulation strategies is limited and needs to be Motivated Strategies for Learning Questionnaire (MSLQ, Pintrich, Smith,
furthered by more sophisticated methodological designs. In the present Garcia, & McKeachie, 1993; Wild & Schiefele, 1994) was used to assess
paper, we therefore seek to examine the relative importance of motiva- students' effort expenditure. The scale contains eight items, for instance,
tional strategies in three different samples and under varying “I work hard to do well in this class even if I don't like what we are
conditions. In Study 1, we use a cross-sectional design where the moti- doing”. All items were answered on a five-point scale ranging from 1
vational strategies as independent variables and effort expenditure as a (rarely) to 5 (very often). We assessed gender as a moderating variable.
dependent variable are assessed concurrently. In Study 2, we use a lon-
gitudinal design which enables us to control for students' initial motiva- 2.1.3. Analysis procedure
tion. In Study 3, we also use a longitudinal design, but additionally chose First, we conducted multiple regression analyses in Mplus 7.4
a more specific level of analysis by examining motivational regulation (Muthén & Muthén, 1998–2015) with the eight motivational regulation
shortly before an important exam. Moreover, while we examine univer- strategies as predictors and the effort subscale as dependent variable.
sity students in the first two studies, we choose 12th grade high-school Next, we conducted relative weight analyses to identify which motiva-
students as participants in Study 3. We expect that results will be similar tional regulation strategy represents the best predictor of effort expen-
for rather global (Studies 1 and 2) vs. specific (Study 3) research designs diture. Relative weight analyses were conducted in R version 2.15.1 (R
and also for university (Studies 1 and 2) vs. high-school (Study 3) Development Core Team, 2012) using the respective R code provided
126 M. Schwinger, N. Otterpohl / Learning and Individual Differences 53 (2017) 122–132

Table 1 Study 1 were cross-sectional, so we cannot be sure about the causal re-
Sample items for motivational regulation strategies. lation between motivational regulation strategy use and effort expendi-
Scales (numbers of items) Sample items ture. In Study 2, we therefore used a longitudinal design with repeated
Enhancement of sit. interest (5) I make learning more pleasant for
measurement of effort expenditure as a dependent variable.2 Moreover,
me by trying to arrange it playfully. we assessed conscientiousness as a further personal trait that might
Enhancement of pers. signif. (3) I look for connections between moderate the relative effectiveness of motivational regulation strate-
the tasks and my life as such. gies. Based on our literature review and the findings from Study 1, we
Self-consequating (4) I promise myself that, after work,
formulated the following hypotheses.
I will do something that I like.
Proximal goal setting (3) I approach work step-by-step in order
Hypothesis 1. All motivational regulation strategies, except for the
to get the feeling that I proceed well.
Mastery self-talk (4) I persuade myself to work intensely strategy enhancement of personal significance, contribute uniquely to
for the sake of learning. the explanation of variance in students' self-reported effort.
Performance-approach self-talk (5) I call my attention to the fact of how
important it is to obtain good grades. Hypothesis 2. Goal-based motivational strategies predict a significant-
Performance–avoidance self-talk (3) I imagine that my classmates make ly higher amount of variance in students' self-reported effort than inter-
fun of my poor performance. est-enhancement strategies.
Environmental control (3) I make sure that distractions occur
as seldom as possible. Hypothesis 3. Relative importance rank order remains stable when
controlling for students' initial motivation.

Hypothesis 4. Relative importance rank order of motivational strate-


gies will be only slightly different for male and female students. Highly
by Tonidandel and LeBreton (2011). This program allowed us to (a)
conscientious students will profit more from using goal-based motiva-
evaluate whether a particular relative weight was significantly different
tional strategies than students with low values in conscientiousness.
from zero, (b) examine whether relative weights were significantly dif-
ferent from each other, and (c) test whether a predictor's relative
weight differed significantly across two groups. This feature was used
for testing possible moderating effects of gender. 3.1. Method

3.1.1. Sample and procedure


2.2. Results
In August 2010, 613 students (487 female; age: M = 23.88, SD =
5.04) from different German universities participated in another online
2.2.1. Descriptive statistics
survey. Prior to the study, they received the same informed consent as
Means, standard deviations, reliabilities, and intercorrelations can be
students in Study 1. The majority of students (60%) were enrolled in
found in Table 2. Reliabilities for all scales were satisfying to good. Akin
psychology, whereas the remaining students were registered in other
to previous studies, the highest means were reported for performance-
subjects (e.g., mathematics, sports, law). All told, 48% of the participants
approach self-talk and self-consequating, whereas enhancement of sit-
were in their first semester, whereas the other students were dispersed
uational interest was the least frequently used strategy by students.
across higher semesters. At the first time of measurement, students
Scale intercorrelations were also in line with prior research. For exam-
responded to the motivational regulation questionnaire and also rated
ple, performance-approach and performance-avoidance self-talk were
their effort expenditure. Four months later, participants received an
highly associated with each other, but both strategies were uncorrelated
email invitation for another online survey in which they were asked to
with the two interest enhancement strategies. All motivational strate-
rate their effort expenditure again and also to report their study perfor-
gies were positively related to students' effort expenditure, albeit to a
mance. A subsample of 386 students participated at the second time of
different degree.
measurement. Dropout was not significantly related to gender nor to
the use of any of the eight motivation regulation strategies and effort ex-
2.2.2. Relative importance of motivational strategies penditure at t1 (ps N 0.05). The relative weights analyses were conduct-
Results from the relative weights analyses are displayed in Table 3. ed with the subsample of 386 participants. Data from this sample have
Altogether, the eight motivational regulation strategies explained 39% been used in a previous publication by Schwinger, Steinmayr, and
of the variance in effort expenditure. About one third of the total vari- Spinath (2012).
ance was explained by the strategy of mastery self-talk (35%), followed
by proximal goal setting (22%), and performance-approach self-talk
(17%). Environmental control accounted for 10% and self-consequating 3.1.2. Measures
for 7% of the variance, whereas performance-avoidance self-talk, en- Motivational regulation strategies and effort expenditure were mea-
hancement of situational interest, and enhancement of personal signif- sured with the same instruments as in Study 1. However, effort expen-
icance explained b 5% each. Only the relative weight for enhancement of diture was measured at both times of measurement. Conscientiousness
personal significance was not significantly different from zero. was measured with the respective subscale from the German version of
the NEO-FFI (Borkenau & Ostendorf, 1993). It includes self-descriptive
2.2.3. Moderating factors statements (e.g., “I keep my belongings neat and clean.”) that partici-
pants respond to using a 1 (strongly disagree) to 5 (strongly agree)
Gender had a moderating effect on two strategies. First, the relative
weight of mastery self-talk was significantly higher for male (46%) Likert-type scale. As in Study 1, we also assessed gender as a potential
moderating variable.
than for female students (28%). By contrast, however, the relative im-
portance of performance-avoidance self-talk was slightly higher for fe-
male (6%) compared to male students (1%).

2
3. Study 2 We are aware that these are still correlational data, so we cannot be certain about the
causality of relationships. Nevertheless, due to the clear theoretical assumption that moti-
vational strategy use is supposed to influence one's effort exertion and due to the longitu-
With the second study, we sought to replicate and extend the find- dinal design and the option to control for prior effort, we deem it appropriate to use these
ings from the first study in several ways. Most important, data from data as a cautious starting point for interpretation of the relationships in question.
M. Schwinger, N. Otterpohl / Learning and Individual Differences 53 (2017) 122–132 127

Table 2
Means, standard deviations, reliabilities, and intercorrelations (Study 1).

α M (SD) (1) (2) (3) (4) (5) (6) (7) (8)

Enhancement of sit. interest (1) 0.83 2.19 (0.86) 1


Enhancement of pers. signif. (2) 0.87 3.01 (1.17) 0.48⁎⁎ 1
Self-consequating (3) 0.90 3.82 (1.07) 0.17⁎⁎ 0.14⁎⁎ 1
Proximal goal setting (4) 0.76 3.31 (1.03) 0.34⁎⁎ 0.27⁎⁎ 0.28⁎⁎ 1
Mastery self-talk (5) 0.75 2.70 (0.91) 0.34⁎⁎ 0.31⁎⁎ 0.22⁎⁎ 0.31⁎⁎ 1
Performance-approach self-talk (6) 0.89 3.48 (1.07) 0.04 0.06 0.27⁎⁎ 0.19⁎⁎ 0.36⁎⁎ 1
Performance–avoidance self-talk (7) 0.78 2.69 (0.95) 0.05 0.04 0.19⁎⁎ 0.08 0.27⁎⁎ 0.66⁎⁎ 1
Environmental control (8) 0.82 3.16 (0.91) 0.33⁎⁎ 0.20⁎⁎ 0.27⁎⁎ 0.44⁎⁎ 0.35⁎⁎ 0.15⁎⁎ 0.15⁎⁎ 1
Effort expenditure (9) 0.94 3.27 (0.79) 0.22⁎⁎ 0.15⁎⁎ 0.28⁎⁎ 0.42⁎⁎ 0.49⁎⁎ 0.34⁎⁎ 0.10⁎ 0.34⁎⁎
⁎ p b 0.05.
⁎⁎ p b 0.01.

3.2. Results scaled variable conscientiousness, the scale was divided by Median-
Split into high vs. low. Conscientiousness appeared to be a significant
3.2.1. Descriptive statistics moderator of the relative importance of proximal goal setting. This par-
All scales showed good reliabilities (see Table 4). The mean use of ticular strategy was more effective for less conscientious (8%) compared
motivational strategies was in a similar rank order as in Study 1, indicat- to highly conscientious students (0.3%).
ing again the most frequent use for the strategies performance-ap-
proach self-talk and self-consequating. Scale intercorrelations
4. Study 3
provided a sound picture of the expected associations among the differ-
ent motivational strategies with, for instance, moderately positive rela-
Unlike Studies 1 and 2, where the items measuring motivational reg-
tionships between mastery self-talk and the two interest enhancement
ulation strategies pointed to students' general strategy use across differ-
strategies. Zero-order correlations between the motivational regulation
ent situations, we sought to choose a more specific level of analysis in
strategies and students' reported effort at t2 were similar to those of
Study 3. Pertinent studies on cognitive regulation strategies have
Study 1. Although different in magnitude, the respective correlations
shown that correlations between strategy use and achievement fluctu-
were positive for all strategies except performance-avoidance self-talk.
ate considerably, depending on the specificity of the survey context
(Butler, 2002; Leopold & Leutner, 2002). As in Study 2, we also con-
3.2.2. Relative importance of motivational strategies trolled for students' initial effort. Regarding potential individual moder-
We followed the same analysis procedure as in Study 1. Effort ex- ators, we focused again on gender and conscientiousness. However,
penditure at t2 was predicted by the eight motivational regulation strat- based on findings by Wolters and Benzon (2013), who stated that stu-
egies and by effort expenditure from t1. Unsurprisingly, relative weights dents' engagement in motivational regulation is a function of their
analyses revealed that, by far, the greatest portion of variance in effort existing motivational beliefs and attitudes, we further added disposi-
expenditure t2 was explained by effort expenditure t1 (69%, see tional interest and achievement goal orientations to our list of potential
Table 5). 31% of the variance could be attributed to the eight motiva- moderators.
tional strategies. Among those, mastery self-talk appeared again as the
Hypothesis 1. In contrast to the remaining strategies, the strategies en-
most powerful predictor (11%), followed by proximal goal setting
hancement of situational interest, enhancement of personal signifi-
(5%), performance-approach self-talk (4%), environmental control
cance, and performance-avoidance self-talk will not contribute
(4%), and self-consequating (3%). The relative weights for enhancement
uniquely to the explanation of variance in students' self-reported effort.
of situational interest, enhancement of personal significance, and per-
formance-avoidance self-talk were not significantly different from Hypothesis 2. Goal-based motivational strategies predict a significant-
zero (b 2%). ly higher amount of variance in students' self-reported effort than inter-
est-enhancement strategies.
3.2.3. Moderating factors
Hypothesis 3. Relative importance rank order remains stable when
Gender did not moderate the relative effectiveness of any motiva-
controlling for students' initial motivation.
tional regulation strategy. To test the moderating effect of the metrically
Hypothesis 4. Relative importance rank order of motivational strate-
Table 3 gies will be the same for male and female students. Highly conscientious
Regression estimates, relative weights and explained criterion variance (%) for all motiva- students will profit more from using goal-based motivational strategies
tional regulation strategies (Study 1). than students with low values in conscientiousness. Highly interested
Motivational strategies students will profit more from using interest-enhancement strategies.
Goal-related self-talk will be most effective if the strategy-specific goal
B (SE) β RW %
matches the general goal orientation of the student (e.g., highly mastery
d
Enhancement of sit. interest 0.01 (0.04) 0.01 0.013 3.36 oriented students will profit most from using mastery self-talk).
Enhancement of pers. signif. −0.05 (0.03) −0.07 0.005 1.17
Self-consequating 0.06 (0.03) 0.09⁎ 0.028c,d 7.30
Proximal goal setting 0.18 (0.03) 0.23⁎⁎ 0.085a,b 21.98
Mastery self-talk 0.30 (0.04) 0.34⁎⁎ 0.135a 34.87 4.1. Method
Performance-approach self-talk 0.22 (0.04) 0.29⁎⁎ 0.068b,c 17.44
Performance–avoidance self-talk −0.19 (0.04) −0.23⁎⁎ 0.015d 3.77
4.1.1. Sample and procedure
Environmental control 0.08 (0.04) 0.09⁎ 0.039c 10.10
Explained variance R2 0.388 0.388 100 In October 2010, N = 301 students (56.5% female; Age: M = 17.55,
SD = 0.69) participated in this study. They were in their twelfth-grade
Notes. Relative weights holding a superscript are significantly different from zero at
p b 0.05. Values with different superscripts are significantly different at p b 0.05.
year from several high schools (German Gymnasium) in two federal
⁎ p b 0.05. German states. Prior to the study, informed consent was obtained
⁎⁎ p b 0.01. from the students as well as from their parents and teachers. The
128 M. Schwinger, N. Otterpohl / Learning and Individual Differences 53 (2017) 122–132

Table 4
Means, standard deviations, reliabilities, and intercorrelations (Study 2).

α M (SD) (1) (2) (3) (4) (5) (6) (7) (8) (9)

Enhancement of sit. interest (1) 0.88 2.57 (0.89) 1


Enhancement of pers. signif. (2) 0.89 3.34 (1.01) 0.54⁎⁎ 1
Self-consequating (3) 0.93 3.51 (1.04) 0.29⁎⁎ 0.15⁎⁎ 1
Proximal goal setting (4) 0.84 3.35 (0.93) 0.43⁎⁎ 0.20⁎⁎ 0.38⁎⁎ 1
Mastery self-talk (5) 0.76 2.97 (0.85) 0.35⁎⁎ 0.33⁎⁎ 0.27⁎⁎ 0.26⁎⁎ 1
Performance-approach self-talk (6) 0.87 3.67 (0.87) 0.00 −0.04 0.27⁎⁎ 0.07 0.37⁎⁎ 1
Performance–avoidance self-talk (7) 0.79 2.29 (0.96) −0.09⁎ −0.12⁎⁎ 0.11⁎⁎ −0.05 0.19⁎⁎ 0.51⁎⁎ 1
Environmental control (8) 0.74 3.22 (0.96) 0.24⁎⁎ 0.19⁎⁎ 0.31⁎⁎ 0.28⁎⁎ 0.28⁎⁎ 0.19⁎⁎ 0.04 1
Effort expenditure t1 (9) 0.83 3.55 (0.70) 0.29⁎⁎ 0.15⁎⁎ 0.27⁎⁎ 0.31⁎⁎ 0.45⁎⁎ 0.34⁎⁎ 0.05 0.28⁎⁎ 1
Effort expenditure t2 (10) 0.83 3.60 (0.70) 0.43⁎⁎ 0.20⁎⁎ 0.31⁎⁎ 0.35⁎⁎ 0.46⁎⁎ 0.31⁎⁎ 0.05 0.31⁎⁎ 0.83⁎⁎
⁎ p b 0.05.
⁎⁎ p b 0.01.

information in the consent forms was similar to the ones in Studies 1 Presumed moderating factors were assessed at the first measure-
and 2. Students had to bring along the consent form signed by their par- ment point. Conscientiousness was assessed with the same instrument
ents at the day of testing. In their final years in Gymnasium, students can as in Study 2. Dispositional interest in the respective subject was mea-
choose two subjects as advanced-level courses, which means that they sured by four self-created items (e.g., “I like mathematics”; “I am inter-
receive more lessons (usually six) per week. Accordingly, the exam ested in mathematics”). Students' goal orientations were assessed by
grades from the advanced-level courses have the greatest impact on means of the German Scales for the Assessment of Learning and Perfor-
the grade of their school exit exam. As a consequence, students in ad- mance Goals (Spinath, Stiensmeier-Pelster, Schöne, & Dickhäuser,
vanced-level courses are likely to be more intrinsically motivated than 2002). This measure assesses mastery and performance-avoidance
students who have not chosen their own subjects. Participants were goals with eight items each, and performance-approach goals with
asked to complete questionnaires referring to their preparation for an seven items in each domain (see Spinath & Steinmayr, 2012, for details).
upcoming exam in one of their advanced-level courses. A total of These scales have proven convincing convergent and discriminate
42.6% of the students had mathematics as an advanced-level course, validities with related constructs (e.g., achievement motivation, self-ef-
26.9% had German, 15.9% had English, and 14.6% had history. ficacy beliefs, and test anxiety), as well as good predictive validity of
Data from this sample have been used in a previous publication by goal orientations for school grades. All items were responded to on a
Schwinger and Stiensmeier-Pelster (2012). rating scale ranging from 1 (strongly disagree) to 5 (strongly agree).

4.2. Results
4.1.2. Measures and procedure
The students responded to items that referred to an upcoming exam 4.2.1. Descriptive statistics
(specific event) in one of their advanced-level courses (specific subject). The inspection of scale means, standard deviations, reliabilities, and
Questionnaires were filled in during regular lessons in the respective intercorrelations yielded a very consistent impression across the three
advanced-level course. About two weeks before the exam (t1), we samples. In Study 3, performance-approach self-talk and self-
assessed students' current effort (i.e., their willingness to learn for the consequating again showed the highest means, Cronbach alphas were
upcoming exam) with three items, such as “My motivation to learn mostly good, the eight motivational strategies were intertwined in a
for the upcoming exam is currently... [1] very low to [5] very high.” The highly similar pattern compared to Studies 1 and 2, and all motivational
teachers had blocked the last lesson before the exam, so in all courses, strategies were positively related to students' current effort at t2 (see
the second measurement point took place in the next to last lesson be- Table 6).
fore the exam (t2). This resulted in comparable conditions for all sub-
jects, with a similar time lag of two to four days before the exam. At 4.2.2. Relative importance of motivational strategies
this second time of measurement, we measured students' subject- and The rank order of the relative weights was highly similar to those in
event-specific use of motivational regulation strategies (i.e., their use Studies 1 and 2, independent of whether initial motivation was included
of motivational strategies in the days before the exam) with the ques- in the regression model or not (see Table 7). Naturally, the highest
tionnaire by Schwinger et al. (2007, 2009). Moreover, we also asked amount of variance in current effort t2 was explained by current effort
the students again to state their current effort for the upcoming exam. t1 with 59%. The remaining 41% of the explained variance could be

Table 5
relative weights and percentage of explained criterion variance (%) for all motivational regulation strategies plus initial motivation (Study 2).

Motivational strategies Motivational strategies + initial motivation

B (SE) β RW % B (SE) β RW %
a
Initial motivation (t1) – – – – – 0.77 (0.04) 0.757 0.484 69.28
Enhancement of sit. interest 0.01 (0.05) 0.01 0.016b 5.14 −0.02 (0.03) −0.024 0.013 1.92
Enhancement of pers. signif. −0.08 (0.04) −0.11 0.005 1.54 −0.02 (0.03) −0.024 0.003 0.48
Self-consequating 0.05 (0.04) 0.07 0.032b 10.03 0.02 (0.02) 0.035 0.026c 3.69
Proximal goal setting 0.11 (0.04) 0.15⁎⁎ 0.050a,b 15.83 0.03 (0.03) 0.038 0.036b,c 5.10
Mastery self-talk 0.28 (0.05) 0.35⁎⁎ 0.120a 37.62 0.07 (0.03) 0.083 0.074b 10.69
Performance-approach self-talk 0.12 (0.05) 0.15⁎⁎ 0.048b 15.01 −0.03 (0.03) −0.033 0.029c 4.24
Performance–avoidance self-talk −0.11 (0.04) −0.15⁎⁎ 0.006 2.04 0.01 (0.03) 0.002 0.001 0.23
Environmental control 0.09 (0.04) 0.13⁎⁎ 0.041b 12.78 0.04 (0.03) 0.060 0.030c 4.36
Explained variance R2 0.318 0.318 100 0.699 0.699 100

Notes. Relative weights holding a superscript are significantly different from zero at p b 0.05. Values with different superscripts are significantly different at p b 0.05.
⁎⁎ p b 0.01.
M. Schwinger, N. Otterpohl / Learning and Individual Differences 53 (2017) 122–132 129

Table 6
Means, standard deviations, reliabilities, and intercorrelations (Study 3).

α M (SD) (1) (2) (3) (4) (5) (6) (7) (8) (9)

Enhancement of sit. interest (1) 0.82 2.37 (0.82) 1


Enhancement of pers. signif. (2) 0.79 2.66 (0.99) 0.56⁎⁎ 1
Self-consequating (3) 0.86 3.40 (0.96) 0.29⁎⁎ 0.20⁎⁎ 1
Proximal goal setting (4) 0.74 2.95 (0.88) 0.39⁎⁎ 0.22⁎⁎ 0.44⁎⁎ 1
Mastery self-talk (5) 0.70 2.86 (0.74) 0.40⁎⁎ 0.36⁎⁎ 0.38⁎⁎ 0.39⁎⁎ 1
Performance-approach self-talk (6) 0.84 3.47 (0.83) 0.08 0.11⁎ 0.33⁎⁎ 0.28⁎⁎ 0.35⁎⁎ 1
Performance–avoidance self-talk (7) 0.71 2.57 (0.79) 0.28⁎⁎ 0.17⁎⁎ 0.16⁎ 0.23⁎⁎ 0.32⁎⁎ 0.51⁎⁎ 1
Environmental control (8) 0.74 3.06 (0.83) 0.32⁎⁎ 0.23⁎⁎ 0.39⁎⁎ 0.46⁎⁎ 0.52⁎⁎ 0.35⁎⁎ 0.22⁎⁎ 1
Current effort t1 (9) 0.78 3.08 (0.97) 0.08 0.09 0.11 0.20⁎⁎ 0.28⁎⁎ 0.23⁎⁎ 0.21⁎⁎ 0.15⁎⁎ 1
Current effort t2 (10) 0.80 3.00 (1.01) 0.17⁎⁎ 0.18⁎⁎ 0.17⁎⁎ 0.29⁎⁎ 0.35⁎⁎ 0.25⁎⁎ 0.18⁎⁎ 0.24⁎⁎ 0.50⁎⁎
⁎ p b 0.05.
⁎⁎ p b 0.01.

attributed mostly to mastery self-talk (13%), followed by proximal goal to clarify which one of a series of different motivational strategies works
setting (9%), and performance-approach self-talk (6%). The relative best for sustaining students' effort and persistence. Moreover, we were
weights of the other motivational regulation strategies were not signif- interested in whether relative importance might be different depending
icantly different from zero. on individual differences between students regarding gender, conscien-
tiousness, dispositional interest, and achievement goal orientations.
4.2.3. Moderating factors
Gender was found to moderate the relative effectiveness of environ- 6.1. Relative importance of motivational regulation strategies
mental control. This particular strategy was more effective for male
(12%) compared to female students (1%). Conscientiousness, disposi- The relative weights procedure used here provided two important
tional interest, and the three achievement goal orientations did not kinds of information, namely (a) whether a relative weight is signifi-
moderate the relative effectiveness of any motivational regulation cantly different from zero and (b) significant differences between rela-
strategy. tive weights. With respect to the first point, it is interesting to note that
the relative weights of enhancement of personal significance and of per-
5. Summary of relative weights results formance-avoidance self-talk (except Study 1) did not differ significant-
ly from zero. That is, these two strategies did not work in the expected
Findings from the relative weights analyses yielded a consistent pat- way because students who used them did not experience a significant
tern across the three studies. Among the eight motivational regulation increase in motivation to learn. At this point, the added value of the rel-
strategies examined here, mastery self-talk explained most of the vari- ative weights approach compared to zero-order correlations or tradi-
ance in motivational outcomes, followed by proximal goal setting and tional multiple regression models becomes apparent because both
performance-approach self-talk. Environmental control and self- motivational strategies had shown significantly positive correlations
consequating were mostly ranked in middle positions, whereas perfor- to the effort measures in all three studies. However, these positive rela-
mance-avoidance self-talk, enhancement of situational interest, and en- tionships disappeared when the unique contribution of each predictor
hancement of personal significance showed very low relative weights in was considered by computing relative weights.
each study. In Studies 2 and 3, this basic pattern of relative strategy im- With respect to the second point, including information on statistical
portance did not change when we controlled for the effects of students' differences between predictors' relative weights led to a more fine-
initial motivation in our analyses. The results across all studies are illus- grained interpretation of the top three ranked motivational regulation
trated in Fig. 1. strategies. Statistical significance of these three strategies' relative
weights were slightly different in the first two studies compared to
6. General discussion the last study. In Studies 1 and 2, the relative weight for mastery self-
talk was significantly different from the weight for performance-ap-
In this article, we sought to further our understanding of the relative proach self-talk, but not from the weight for proximal goal setting.
importance of motivational regulation strategies. Across three empirical The relative weights for proximal goal setting and performance-
studies with German high school and college students, and by using rel- approach self-talk, in turn, were not significantly different. In Study 3,
ative weights analysis as a sophisticated statistical procedure, we aimed relative weights for all three strategies did not differ significantly from

Table 7
Relative weights and percentage of explained criterion variance (%) for all motivational regulation strategies, plus initial motivation (Study 3).

Motivational strategies Motivational strategies + initial motivation

B (SE) β RW % B (SE) β RW %
a
Initial motivation (t1) – – – – – 0.44 (0.05) 0.42 0.189 59.60
Enhancement of sit. interest −0.02 (0.09) −0.02 0.006 3.83 0.02 (0.08) 0.01 0.006 1.98
Enhancement of pers. signif. 0.06 (0.07) 0.05 0.009 4.14 0.05 (0.06) 0.05 0.008 2.82
Self-consequating −0.04 (0.07) −0.04 0.006 3.54 −0.02 (0.06) −0.02 0.005 1.66
Proximal goal setting 0.19 (0.08) 0.17⁎⁎ 0.035a 21.83 0.13 (0.07) 0.12⁎ 0.028a 8.78
Mastery self-talk 0.32 (0.09) 0.24⁎⁎ 0.057a 35.22 0.20 (0.09) 0.15⁎ 0.041a 13.09
Performance-approach Self-talk 0.15 (0.08) 0.13 0.025a 15.83 0.10 (0.08) 0.09 0.019a 6.22
Performance–avoidance self-talk 0.01 (0.08) 0.01 0.008 5.09 −0.04 (0.08) −0.03 0.005 1.89
Environmental control −0.01 (0.08) −0.01 0.014 8.51 0.02 (0.08) 0.01 0.012 3.95
Explained variance R2 0.161 0.161 100 0.316 0.316 100

Notes. Relative weights holding a superscript are significantly different from zero at p b 0.05. Values with different superscripts are significantly different at p b 0.05.
⁎ p b 0.05.
⁎⁎ p b 0.01.
130 M. Schwinger, N. Otterpohl / Learning and Individual Differences 53 (2017) 122–132

consciously activated. Two different settings may be possible in this re-


gard. First, the motivational energy provided is equally powerful in
every stage of recalling, thus of regulating motivation. Second, the mo-
tivation-enhancing effects become smaller over time. Although our de-
sign does not allow for testing these competing ideas, the clearly highest
relative weights for goal-related motivational strategies lead us to sug-
gest that the first assumption might describe the self-regulation realities
of most students more accurately. Nevertheless, this issue needs to be
considered in more detail in further studies.
Taken together, it seems reasonable that goal-based motivational
strategies are effective because goals have a strong power to provide en-
ergy and to direct that energy in the right way. As the case of perfor-
mance-avoidance self-talk has demonstrated, however, an important
prerequisite is to formulate goals in positive, approach-related terms,
in order to become effective tools for motivation regulation. But why
are goal-related strategies more effective than interest-enhancement
strategies? We think there are two possible reasons for this. First,
goal-based vs. interest-based strategies might be used at different levels
of motivational deficits. Schwinger and Stiensmeier-Pelster (2012)
noted that students' motivation may only be temporarily lowered or
Fig. 1. Summary of relative weights results across all studies.
fundamentally affected. Although it is difficult to categorize the eight
motivational regulation strategies examined here into ones better suit-
each other. The next ranked motivational strategies—environmental ed for temporary vs. fundamental motivational problems, it seems rea-
control and self-consequating—had significantly lower relative weights sonable that students try to solve temporal motivational problems by
than did the top three strategies, but only in Studies 1 and 3. remembering an already established goal and by re-focusing on it in-
Despite these small limitations with respect to statistical signifi- stead of searching for a new, fundamental reason to persist in the task.
cance, we think it is reasonable to conclude that mastery self-talk, prox- The second argument for why we think it is plausible that goal-related
imal goal setting, and performance-approach self-talk are particularly strategies are more effective than interest-enhancement strategies
effective strategies for regulating motivation for an average student points to a similar issue. The strategy of enhancement of personal signif-
in a typical learning situation. Environmental control and self- icance aims at building a new motivational basis that is intrinsic and
consequating may also be labelled as effective and useful motivational long-lasting. If this strategy is applied successfully, it should largely in-
strategies. Whether they are really least effective compared to the top fluence students' effort and persistence. As we did not observe such ef-
three strategies cannot be concluded with certainty, so further studies fects, however, we concluded that the strategy does not work in many
are needed to replicate the statistical differences partially found here. cases. A possible explanation for this might be that the task incorporated
What can be concluded with certainty, however, is that performance- in the strategy was too difficult for the students. If they were to have
avoidance self-talk and the two interest enhancement strategies repre- seen a personal significance in the task, they would have probably
sent rather ineffective ways to regulate students' learning motivation. seen it before, and would thus have been intrinsically motivated and
Moreover, it is striking that this rank order of motivational strategies would have had no need for motivational regulation at all. But if a stu-
was found across different samples (high school vs. college), different dent does not see any personal significance in the task, it appears in-
designs (cross-sectional vs. longitudinal), different covariates (control- stead to be a rather tremendous undertaking to create one. This
ling vs. not controlling for initial motivation), and different contexts reasoning is in line with research on academic motivation in general.
(school in general vs. course-specific), so our findings demonstrated Hidi and Harackiewicz (2000), for instance, have pointed out that it
high stability and replicability. It has to be noted, however, that previous may be easier to motivate students who already have external incen-
studies provided empirical evidence for the general effectiveness of dif- tives, or by setting short- and long-term goals, rather than trying to in-
ferent forms of interest enhancement as well (Leutner et al., 2001; crease their intrinsic motivation.
Sansone et al., 1992). Future studies should explore the reasons for
this incompatibility of findings. 6.3. Moderating effects of individual factors

6.2. Effectiveness of goal-based motivational regulation strategies Our search for personality factors that might moderate the relative
importance of motivational strategies was guided by the assumption
How can our results be explained and what are the psychological that motivational regulation is most effective when the strategy chosen
mechanisms behind them? Obviously, students were more effective in matches a learner's basic motivational beliefs and attitudes (Wolters &
regulating their motivation when they relied on strategies that were Benzon, 2013). We supposed, for example, that highly conscientious
based in some way on goals. Numerous studies have shown that mas- students would be relatively more effective at using goal-related moti-
tery and performance-approach goals are adaptive motivational orien- vational strategies because conscientiousness has been found to be as-
tations as they are related to several important educational processes sociated with ambitious goal setting and commitment (Klein & Lee,
and outcomes, such as higher interest (Hulleman, Durik, Schweigert, & 2006). Quite surprising, however, our interaction analyses revealed
Harackiewicz, 2008; Vansteenkiste et al., 2010), greater performance, only single, isolated effects that did not point to substantial moderation
and adaptive attribution patterns after failure. These positive outcomes effects for any of the personality factors considered. This means that the
can be easily explained by the fact that pursuing those kinds of approach established relative importance of motivational strategies did not seem
goals provides both energy and direction for the individual student to be affected by students' gender, conscientiousness, dispositional in-
(Elliot, 1999). In this regard, our findings seem to indicate that recalling terest, or achievement goal orientations. We are not sure how reliable
and remembering of these goals can re-initiate their inherent power these findings are because it is possible that the power to detect interac-
and energy, making it available again in the current learning situation. tion effects was too low in our studies. Cases with pronounced profiles
We do not know whether the amount of motivation elicited by the ap- (i.e., individuals with high values on one dimension and very low values
proach-oriented achievement goals is the same every time the goal is on the other) are often rare in observational studies, which negatively
M. Schwinger, N. Otterpohl / Learning and Individual Differences 53 (2017) 122–132 131

affects their power to detect meaningful interactions (McClelland & points to the fourth limitation of our studies. Although the three sam-
Judd, 1993). Given this statistical caveat, we are cautious in interpreting ples were large enough to identify the overall rank order of motivational
our findings on moderation effects. However, we think that the results strategies, they might have been too small to detect meaningful interac-
clearly suggest to focus on goal-related strategies in trainings on moti- tion effects (McClelland & Judd, 1993). Fifth, we do not know much
vational regulation. Moreover, it does not seem important to take about why some strategies have been found to be more effective than
students' personality profile into account when conducting such train- others. Possible reasons for this may refer to lower metacognitive
ings. We clearly need to be cautious with such interpretations as we knowledge about how to use certain motivational strategies appropri-
measured several variables only in some of our studies and as we relied ately (Thillmann, Gößling, Marschner, Wirth, & Leutner, 2013) or to
on different samples in those studies. This could mean, for instance, that the fact that some strategies have been applied in a qualitative better
achievement goals have a substantial moderating impact for university way than others (Schwinger et al., 2009). Future studies should exam-
students, albeit we found no effects among high-school students in ine these issues in more detail. Despite these limitations, however, rep-
Study 3. In sum, however, there were no convincing hints for modera- licating the relative importance across three samples under varying
tion effects of personality variables in our data, so we think it may be conditions, and by using relative weights analysis as a sophisticated sta-
more promising instead to pay attention to contextual differences, tistical technique, clearly represents important strengths of this study.
such as boring vs. difficult tasks (Schwinger & Stiensmeier-Pelster, Our findings might provide a promising starting point for developing
2012; Wolters, 1998). basic training modules for improving students' motivation regulation
capacities.
6.4. Practical implications
References
Our findings underline the importance of setting and continuously Bandura, A., & Schunk, D. (1981). Cultivating competence, self-efficacy and intrinsic inter-
endorsing achievement-related goals in both school and university con- est through proximal self-motivation. Journal of Personality and Social Psychology, 41,
texts. It may therefore be promising that educational practitioners such 586–598. http://dx.doi.org/10.1037/0022-3514.41.3.586.
Borkenau, P., & Ostendorf, F. (1993). NEO-Fünf-Faktoren Inventar (NEO-FFI) [NEO five-fac-
as teachers and school psychologists encourage their students to set tor inventory]. Göttingen, Germany: Verlag für Psychologie.
goals for their studying as well as to constantly reflect and recall those Butler, D. L. (2002). Qualitative approaches to self-regulated learning: Contributions
goals, especially in times when they feel unmotivated to learn. Results and challenges. Educational Psychologist, 37, 59. http://dx.doi.org/10.1207/
S15326985EP3701_7.
from a recent meta-analysis support the idea that teachers may exert
Cleary, T. J., & Chen, P. P. (2009). Self-regulation, motivation, and math achievement in
significant influence on students' motivation. Lazowski and Hulleman middle school: Variations across grade level and math context. Journal of School
(2016) examined the effects of motivation interventions in education. Psychology, 47, 291–314. http://dx.doi.org/10.1016/j.jsp.2009.04.002.
Credè, M., & Kuncel, N. (2008). Study habits, skills, and attitudes: The third pillar
They found that interventions were generally effective, with an average
supporting collegiate academic performance. Perspectives on Psychological Science, 3,
mean effect size of d = 0.49 (95% confidence interval = [0.43, 0.56]) 425–453. http://dx.doi.org/10.1111/j.1745-6924.2008.00089.x.
and that there were no statistically significant differences in effect size Elliot, A. J. (1999). Approach and avoidance motivation and achievement goals.
due to theoretical framework of the intervention, age of participants (el- Educational Psychologist, 34, 169–189. http://dx.doi.org/10.1207/s15326985ep3403_3.
Engelschalk, T., Steuer, G., & Dresel, M. (2015). Wie spezifisch regulieren Studierende ihre
ementary through postsecondary students), or type of dependent vari- Motivation bei unterschiedlichen Anlässen? [Situation-specific motivation regula-
able (performance, behavior, self-reported motivation). Integrating our tion: How specifically do students regulate their motivation for different situations?
findings reported here and the meta-analytic results provided by ]. Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie, 47, 14–23.
http://dx.doi.org/10.1026/0049-8637/a000120.
Lazowski and Hulleman (2016) may thus justify our claim that teachers Grunschel, C., Patrzek, J., & Fries, S. (2013). Exploring different types of academic delayers:
should instruct their students to adopt certain goals while studying. A latent profile analysis. Learning and Individual Differences, 23, 225–233. http://dx.
However, this recommendation can be further differentiated on the doi.org/10.1016/j.lindif.2012.09.014.
Hidi, S., & Harackiewicz, J. M. (2000). Motivating the academically unmotivated: A critical
basis of evidence on achievement goal structures. Several studies in issue for the 21st century. Review of Educational Research, 70, 151–179. http://dx.doi.
this field have shown—in accordance with our results on goal-related org/10.3102/00346543070002151.
self-talk—that promoting mastery and/or approach goals in the class- Hulleman, C. S., & Harackiewicz, J. M. (2009). Promoting interest and performance in high
school science classes. Science, 326, 1410–1412. http://dx.doi.org/10.1126/science.
room is most adaptive for students' academic adjustment (e.g.,
1177067.
Rolland, 2012; Wolters, 2004). Hulleman, C. S., Durik, A. M., Schweigert, S. A., & Harackiewicz, J. M. (2008). Task values,
achievement goals, and interest: An integrative analysis. Journal of Educational
Psychology, 100, 398–416. http://dx.doi.org/10.1037/0022-0663.100.2.398.
6.5. Limitations and suggestions for further research
Jackson, H., & Molloy, G. (1985). Some effects of feedback alone and four types of self-
consequation on selected measures of problem solving. Perceptual and Motor Skills,
Our findings are limited in several ways. First, we investigated older 61, 1005–1006. http://dx.doi.org/10.2466/pms.1985.61.3.1005.
high school and college students, leaving open the question of whether Johnson, J. W., & LeBreton, J. M. (2004). History and use of relative importance indices in
organizational research. Organizational Research Methods, 7, 238–257. http://dx.doi.
younger students would show the same relative importance rank order. org/10.1177/1094428104266510.
There is an overall lack of studies on secondary school students' self-reg- Klein, H. J., & Lee, S. (2006). The effects of personality on learning: The mediating role
ulation of motivation, which needs to be addressed in future studies. of goal setting. Human Performance, 19, 43–66. http://dx.doi.org/10.1207/
s15327043hup1901_3.
Second, our analyses and interpretations are completely based on self- Kobasa, S. C. (1979). Stressful life events, personality, and health: An inquiry into hardi-
report data. Many authors have criticized these kind of data since they ness. Journal of Personality and Social Psychology, 37, 1–11. http://dx.doi.org/10.
only capture the remembered frequency of strategy use and may thus 1037/0022-3514.37.1.1.
Lazowski, R. A., & Hulleman, C. S. (2016). Motivation interventions in education: A meta-
not reflect a valid measure of students' self-regulated learning (e.g., analytic review. Review of Educational Research, 86, 602–640. http://dx.doi.org/10.
Winne, 2010). It would therefore be an important research endeavor 3102/0034654315617832.
to find out whether our conclusions on the relative importance of moti- Leopold, C., & Leutner, D. (2002). Der Einsatz von Lernstrategien in einer konkreten
Lernsituation [The usage of learning strategies in a concrete learning situation].
vation regulation strategies can be supported in designs using behavior- Zeitschrift für Pädagogik, 45(Beiheft), 240–258.
al, observational, and/or qualitative data. Third, we focused exclusively Leutner, D., Barthel, A., & Schreiber, B. (2001). Studierende können lernen, sich selbst zum
on individual moderators, so we do not know how certain individual Lernen zu motivieren: Ein Trainingsexperiment. [Students can learn to motivate
themselves for learning—A training experiment]. Zeitschrift für Pädagogische
characteristics might interact with varying contextual conditions. It
Psychologie, 15, 155–167. http://dx.doi.org/10.1024//1010-0652.15.34.155.
may be possible, for instance, that highly conscientious students react McCann, E. J., & Garcia, T. (1999). Maintaining motivation and regulating emotion: Mea-
differently to motivational deficits elicited by a difficult task compared suring individual differences in academic volitional strategies. Learning and Individual
to less conscientious individuals. Providing a deeper understanding of Differences, 11, 259–279. http://dx.doi.org/10.1016/S1041-6080(99)80003-X.
McClelland, G. H., & Judd, C. M. (1993). Statistical difficulties of detecting interactions and
these interactions is an important task for future research. However, moderator effects. Psychological Bulletin, 114, 376–390. http://dx.doi.org/10.1037//
such interaction analyses might require very large sample sizes, which 0033-2909.114.2.376.
132 M. Schwinger, N. Otterpohl / Learning and Individual Differences 53 (2017) 122–132

Muthén, L. K., & Muthén, B. O. (1998–2015). Mplus user's guide (7th ed.). Los Angeles, CA: Spinath, B., & Steinmayr, R. (2012). The roles of competence beliefs and goal orientations
Muthén & Muthén. for change in intrinsic motivation. Journal of Educational Psychology, 104, 1135–1148.
Pintrich, P. R. (2004). A conceptual framework for assessing student motivation and self- http://dx.doi.org/10.1037/a0028115.
regulated learning in college students. Educational Psychology Review, 16, 385–407. Spinath, B., Stiensmeier-Pelster, J., Schöne, C., & Dickhäuser, O. (2002). Die Skalen zur
http://dx.doi.org/10.1007/s10648-004-0006-x. Erfassung von Lern-und Leistungsmotivation (SELLMO) [Scales for the Measurement of
Pintrich, P. R., Smith, D., Garcia, T., & McKeachie, W. (1993). Predictive validity and Learning and Achievement Motivation]. Göttingen, Germany: Hogrefe.
reliability of the Motivated Strategies for Learning Questionnaire. Educational Thillmann, H., Gößling, J., Marschner, J., Wirth, J., & Leutner, D. (2013). Metacognitive
and Psychological Measurement, 53, 801–813. http://dx.doi.org/10.1177/ knowledge about and metacognitive regulation of strategy use in self-regulated sci-
0013164493053003024. entific discovery learning: New methods of assessment in computer-based learning
Pychyl, T. A., Lee, J. M., Thibodeau, R., & Blunt, A. (2000). Five days of emotion: An expe- environments. In R. Azevedo, & V. Aleven (Eds.), International handbook of metacogni-
rience sampling study of undergraduate student procrastination. Journal of Social tion and learning technologies (pp. 575–588). New York, NY: Springer.
Behavior and Personality, 15, 239–254. Tonidandel, S., & LeBreton, J. M. (2011). Relative importance analysis: A useful supple-
R Development Core Team (2012). R: A language and environment for statistical computing. ment to regression analysis. Journal of Business and Psychology, 26, 1–9. http://dx.
Vienna, Austria: R Foundation for Statistical Computing. doi.org/10.1007/s10869-010-9204-3.
Roeser, R. W., Midgley, C., & Urdan, T. C. (1996). Perceptions of the school psychological Vansteenkiste, M., Smeets, S., Soenens, B., Lens, W., Matos, L., & Deci, E. L. (2010). Auton-
environment and early adolescents' psychological and behavioral functioning in omous and controlled regulation of performance-approach goals: Their relations to
school: The mediating role of goals and belonging. Journal of Educational Psychology, perfectionism and educational outcomes. Motivation and Emotion, 34, 333–353.
88, 408–422. http://dx.doi.org/10.1037/0022-0663.88.3.408. http://dx.doi.org/10.1007/s11031-010-9188-3.
Rolland, R. G. (2012). Synthesizing the evidence on classroom goal structures in middle Wild, K. P., & Schiefele, U. (1994). Lernstrategien im Studium. Ergebnisse zur
and secondary schools a meta-analysis and narrative review. Review of Educational Faktorenstruktur und Reliabilität eines neuen Fragebogens. Zeitschrift für
Research, 82, 396. http://dx.doi.org/10.3102/0034654312464909. Differentielle und Diagnostische Psychologie, 15, 185–200.
Sansone, C., & Thoman, D. B. (2005). Interest as the missing motivator in self-regulation. Winne, P. H. (2010). Improving measurements of self-regulated learning. Educational
European Psychologist, 10, 175–186. http://dx.doi.org/10.1027/1016-9040.10.3.175. Psychologist, 45, 267–276. http://dx.doi.org/10.1080/00461520.2010.517150.
Sansone, C., Weir, C., Harpster, L., & Morgan, C. (1992). Once a boring task always a boring Wolters, C. A. (1998). Self-regulated learning and college students' regulation of motiva-
task? Interest as a self-regulatory mechanism. Journal of Personality and Social tion. Journal of Educational Psychology, 90, 224–235. http://dx.doi.org/10.1037/0022-
Psychology, 63, 379–390. http://dx.doi.org/10.1037/0022-3514.63.3.379. 0663.90.2.224.
Sansone, C., Wiebe, D. J., & Morgan, C. (1999). Self-regulating interest: The moderating Wolters, C. A. (1999). The relation between high school students' motivational regu-
role of hardiness and conscientiousness. Journal of Personality, 67, 701–733. http:// lation and their use of learning strategies, effort, and classroom performance.
dx.doi.org/10.1111/1467-6494.00070. Learning and Individual Differences, 11, 281–299. http://dx.doi.org/10.1016/
Schwinger, M., & Stiensmeier-Pelster, J. (2012). Effects of motivational regulation on ef- S1041-6080(99)80004-1.
fort and achievement: A mediation model. International Journal of Educational Wolters, C. A. (2003). Regulation of motivation: Evaluating an underemphasized aspect of
Research, 56, 35–47. http://dx.doi.org/10.1016/j.ijer.2012.07.005. self-regulated learning. Educational Psychologist, 38, 189–205. http://dx.doi.org/10.
Schwinger, M., von der Laden, T., & Spinath, B. (2007). Strategien zur Motivationsregulation 1207/S15326985EP3804_1.
und ihre Erfassung [Motivational regulation strategies and their measurement]. Wolters, C. A. (2004). Advancing achievement goal theory: Using goal structures and goal
Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie, 39, 57–69. http:// orientations to predict students' motivation, cognition, and achievement. Journal of
dx.doi.org/10.1026/0049-8637.39.2.57. Educational Psychology, 96, 236–250. http://dx.doi.org/10.1037/0022-0663.96.2.236.
Schwinger, M., Steinmayr, R., & Spinath, B. (2009). How do motivational regulation strat- Wolters, C. A., & Benzon, M. B. (2013). Assessing and predicting college students' use of
egies affect achievement: Mediated by effort management and moderated by intelli- strategies for the self-regulation of motivation. The Journal of Experimental
gence. Learning and Individual Differences, 19, 621–627. http://dx.doi.org/10.1016/j. Education, 81, 199–221. http://dx.doi.org/10.1080/00220973.2012.699901.
lindif.2009.08.006. Zimmerman, B. J., & Martinez-Pons, M. (1986). Development of a structured interview for
Schwinger, M., Steinmayr, R., & Spinath, B. (2012). Not all roads lead to Rome—Comparing assessing student use of self-regulated learning strategies. American Educational
different types of motivational regulation profiles. Learning and Individual Differences, Research Journal, 23, 614–628. http://dx.doi.org/10.3102/00028312023004614.
22, 269–279. http://dx.doi.org/10.1016/j.lindif.2011.12.006.

You might also like