Professional Documents
Culture Documents
Test Anxiety
Test Anxiety
a r t i c l e i n f o a b s t r a c t
Article history: The distinction of different test anxiety reactions (e.g., worry, emotionality) is well established. Recently, ad-
Received 26 August 2010 ditional relevance has been given to school-subject-specific test anxiety factors. The present study explored a
Received in revised form 6 October 2012 further aspect concerning the structure of test anxiety experiences, specifically oral versus written examina-
Accepted 22 December 2012
tion modes. A questionnaire was administered to 682 high school students (grades 9 to 10) in which three
aspects were systematically combined: different test anxiety factors (worry, emotionality), school-subjects
Keywords:
Test anxiety
(mathematics, German), and examination modes (written, oral). Confirmatory factor analyses supported a
School subjects structure with eight school-subject-specific and examination-mode-specific test anxiety factors. Differential
Written examination relationships revealed evidence for convergent and discriminant validity of these eight specific test anxiety
Oral examination factors with two test anxiety initiating conditions (recitation situations, lack of knowledge).
Construct validity © 2012 Elsevier Inc. All rights reserved.
1. Introduction Marsh, 1988; Marsh & Yeung, 1996). Most of these studies display
problems: They assessed general anxiety instead of TA, and/or measured
Test anxiety (TA) is a frequently researched topic (Cizek & Burg, TA with only one item, and/or did not take the multidimensionality of TA
2006) with ample evidence for its multidimensionality (Zeidner, into account. As an exception Sparfeldt et al. (2005) assessed three
1998). Whereas TA was usually assessed without referencing the corre- TA-factors in four school-subjects: worry, emotionality, and TA-tied
sponding content area, recently school-subject-specific assessments impairments of information processing. Model comparisons document-
have been emphasized (e.g., Marsh & Yeung, 1996; Sparfeldt, ed the importance of considering both aspects (TA-factor, school-
Schilling, Rost, Stelzl, & Peipert, 2005). One important differentiation— subject) simultaneously. Differential relationships between school-
focusing on examination modes—has been neglected. Therefore, the subject-specific TA-factors and grades evidenced convergent/
present study investigates school-subject-specific TA-factors in written discriminant validity. The various school-subjects comprise classes
(TA-written) and oral (TA-oral) examinations. of situations requiring partially different competencies; these differ-
Liebert and Morris (1967) distinguished worry (ruminating about ences seem to structure the TA-experience. Moreover, at least some
self-threatening consequences of failure) from emotionality (perceived antecedents and correlates of TA are tied to school-subjects (as compe-
physiological stress reactions). This two-dimensional TA-structure has tence beliefs; e.g., Marsh & Yeung, 1996), others are structured more
repeatedly been shown with correlations of .55≤r≤.76 (cf., Keith, general (e.g., maladaptive coping). Focusing on TA-assessment Zeidner
Hodapp, Schermelleh-Engel, & Moosbrugger, 2003). Nevertheless, worry (1998, p. 122) suggested a combination of—among others—response
and emotionality are phenomenologically distinct, correlate differentially modes (TA-factors) and evaluation situations (examination modes).
with achievement, and display differential growth-patterns depending on Written examinations and oral examinations are widespread examina-
the examination's temporal distance (Hembree, 1988; Seipp & Schwarzer, tion modes, not yet systematically considered in TA-research. Despite
1991). Additional TA-dimensions (e.g., self-preoccupation, interference) different subtypes, oral examinations in schools are usually more adap-
were suggested, not denying the distinction and usefulness of these tive, more communicative, less restricted, and with a stronger reference
two factors (cf. Zeidner, 1998, 2007). to the individual examinee than written examinations (Jäger, 2004).
TA has been usually assessed without referencing a specific From the examinee's perspective, oral examinations are characterized
content. Recently different school-subject-related TA were analyzed by the potential evaluation of an audience (at least one examiner).
simultaneously (e.g., Goetz, Frenzel, Pekrun, Hall, & Lüdtke, 2007; Some studies have investigated different aspects, correlates and
coping modes of TA-oral (e.g., Buchwald & Schwarzer, 2003; Huwe,
Hennig, & Netter, 1998; Krumpholz, 1993), but not considering
⁎ Corresponding author. Tel.: +49 681 30257490; fax: +49 681 30257488.
E-mail addresses: j.sparfeldt@mx.uni-saarland.de (J.R. Sparfeldt),
TA-written and TA-oral. Only Lukesch (1982) combined these two ex-
rost@staff.uni-marburg.de (D.H. Rost). amination modes and three school-subjects systematically, but with
1
Tel.: +49 6421 2821727; fax: +49 6421 2823910. only one item per school-subject-specific and examination-mode-
1041-6080/$ – see front matter © 2012 Elsevier Inc. All rights reserved.
http://dx.doi.org/10.1016/j.lindif.2012.12.010
J.R. Sparfeldt et al. / Learning and Individual Differences 24 (2013) 198–203 199
specific TA-reaction, not considering different TA-factors. Unfortunate- lack of knowledge)? Recitation situations refer particularly to oral ex-
ly, the corresponding intercorrelations were not reported. Czeschlik aminations. We expected higher correlations in recitation situations
(2008) focused on the relative frequencies in fourth-graders with 81% with TA-oral than TA-written factors. Furthermore, recitation situa-
being “not test-anxious”, 5% “anxious in written”, 5% “in oral”, and 9%
tions should correlate higher with emotionality than with worry. Re-
“in written and oral examinations”. In a high school sample, TA-oral
garding the correlation pattern of the lack of knowledge factors and
and TA-written correlated r = .58.
the recitation situations factors with the TA-factors, we expected nu-
Rost and Schermer (1992, 2007) differentiated classes of situations
that initiate TA in many students. Lack of knowledge refers to TA as merically higher correlations if the two factors referred to an identical
“caused by the realization that achievement demands cannot be met” examination-mode and/or school-subject than if one or both of these
(Rost & Schermer, 1989, p. 42), being closely related to academic aspects differed.
self-beliefs as self-concept and self-efficacy, thereby being tied to specific
context areas and potentially to examination modes. Lack of knowledge 2. Method
correlated r=.51 with worry and r=.48 with emotionality (Rost &
Schermer, 2007, p. 92). Recitation situations refer to TA-initiating situa- 2.1. Participants and Sampling
tions with a social focus, specifically the experience of TA as a “conse-
quence when the achievement has to be presented to other people and Participants were German academic-tracked high school ninth
when reactions which pose a threat to self-esteem are anticipated” and tenth graders (Gymnasium: prep school for university) attending
(Rost & Schermer, 1989, p. 43). Recitation situations correlated differen- 29 classes in five schools. Only 0.5% of the parents did not allow their
tially with worry (r=.18) and emotionality (r=.34; Rost & Schermer, child to participate; 14.5% of the students were absent due to reasons
2007, p. 92). The formulations of the corresponding items refer to oral unrelated to the study (e.g., illness). Data from N = 682 participants
presentations/contributions/talks in class. Therefore, particularly oral (mean age: 15.4 years, SD= 0.71; 406 female) were collected in April
examinations with a stronger social component (compared to written 2008 during regular lessons by a trained experimenter.
examinations) represent such TA-initiating situations.
The multidimensionality and the content-specificity of TA are well 2.2. Instruments
documented, yet examination modes have been neglected. Therefore,
studies that analyze systematically school-subject-specific TA-factors Emotionality and worry in written examinations were measured
in oral and written examinations are needed. This study pursues this with a German adaptation (TAI-G; Hodapp, 1991) of the well-
approach: established Test-Anxiety-Inventory (Spielberger, 1980). Each item
was complemented by a specification of the school-subjects “mathe-
(1) Factorial validity. Is it possible to separate the two central and matics” (numerical domain) and “German” (verbal domain; native lan-
sample-selected TA-factors (worry, emotionality) in mathematics guage) that differed in demands on learners, didactics, and testing
and German (native language) related to oral and written examina- methods. The items were arranged in a table form (grid). Each item
tions using confirmatory factor analyses (CFA)? We expected an ade- formed one row and was presented with a placeholder (…) for the
quate model fit with eight different TA-factors resulting from a school-subject specification. Each school-subject formed one column.
The students were expected to fill out the placeholder (…) mentally
systematic combination of two TA-factors, two school-subjects, and
with the school-subject from the corresponding column. Regarding
two examination modes. This model should fit better than more par-
the presentation mode, an experimental study revealed very similar
simonious models. The correlations of the school-subject-specific and psychometric properties of a multidimensional academic self-concept
examination-mode-specific TA-factors are expected to be numerically inventory with the items presented (a) in a grid and (b) in the usual
higher if two of the three dimensions of the corresponding factors are questionnaire presentation mode (Sparfeldt, Schilling, Rost, & Thiel,
identical (e.g., worry in mathematics in written examinations and worry 2006). TA-oral was assessed with identical items presented on a sepa-
in mathematics in oral examinations refer to the identical TA-factor and rate page in an analogue manner. Thereby, each participant answered
the same school-subject, but to different examination modes) than if each item of each TA-factor separately for both school-subjects and
only one of the three dimensions is identical; the correlations should both examination-modes (Table 1). The use of identical item stems
also be numerically higher if one rather than none of these dimensions minimized variance due to different operationalizations.
The items to assess TA-initiating conditions were taken from anoth-
is identical. According to Sparfeldt et al. (2005), the correlations of the
er well-established German TA-inventory (DAI; Rost & Schermer, 2007)
worry-factors should be similar or slightly higher than those of the
and adapted to measure TA-initiating conditions in mathematics and
emotionality-factors. For the other two dimensions (school-subject,
German. They were also presented in a grid. Regarding recitation situa-
examination-mode), no such deduction can be made. tions, the questionnaire contained the eight slightly adapted items of
(2) Criterion-related validity. Are there differential relationships to be the DAI-short form which explicitly formulate different types of oral
found among school-subject-specific and examination-mode-specific presentations and examinations. Regarding lack of knowledge, oral
TA-factors with specific TA-initiating conditions (recitation situations, and written examinations in mathematics and German could refer
Table 1
Instruments used to assess school-subject-specific and examination mode-specific test anxiety in oral and written examinations.
Introductory phrase “In written examinations in the school subject … “In oral examinations in the school subject …
[Mathematics]/[German] …” [Mathematics]/[German] …”
Worry: item examples (item number); source “… I worry about my results”, “… I find myself thinking about the consequences of failing” (7 items)a; TAI-G (Hodapp, 1991)
Emotionality: item examples (item number); source “… I feel uneasy”, “… my muscles are very tight” (8 items); TAI-G (Hodapp, 1991)
Notes. All items were answered on a six-point scale ranging from 1 (not at all true) to 6 (perfectly true). Pilot studies had shown that six-point scales were appropriate.
a
In accordance with the greater heterogeneity of worry (e.g., Hodapp, 1991), preliminary analyses with the ten more general worry items from the TAI-G revealed that three
items showed inconsistent loadings and were therefore dropped.
200 J.R. Sparfeldt et al. / Learning and Individual Differences 24 (2013) 198–203
Table 2
Instruments used to assess initiating conditions of test anxiety.
Notes. All items were answered on a six-point scale ranging from 1 (not at all true) to 6 (perfectly true). Pilot studies had shown that six-point scales were appropriate.
J.R. Sparfeldt et al. / Learning and Individual Differences 24 (2013) 198–203 201
Table 4 Table 6
Latent correlations of the school-subject-specific (mathematics, German) and examination- Latent correlations of the school-subject-specific (mathematics, German) and examination-
mode-specific (oral, written) test anxiety factors (worry [WOR], emotionality [EMO]) of M 1 mode-specific (oral, written) test anxiety factors (worry [WOR], emotionality [EMO]) with
(see Table 3). the initiating conditions of test anxiety (recitation situations, lack of knowledge)
(see Table 5).
Mathematics German
Mathematics German
Oral Written Oral Written
Oral Written Oral Written
WOR EMO WOR EMO WOR EMO WOR EMO
WOR EMO WOR EMO WOR EMO WOR EMO
Mathematics
Oral EMO .59 Recitation situations
Written WOR .72 .39 Mathematics .53 .78 .38 .50 .41 .67 .30 .44
Written EMO .49 .65 .58 German .38 .60 .23 .29 .50 .80 .36 .51
German Lack of knowledge
Oral WOR .81 .40 .52 .28 Mathematics oral .68 .66 .57 .55 .56 .50 .46 .39
Oral EMO .37 .76 .18 .38 .53 Mathematics written .58 .45 .70 .61 .41 .27 .47 .36
Written WOR .61 .22 .74 .30 .73 .31 German oral .53 .47 .38 .32 .67 .61 .55 .49
Written EMO .32 .46 .28 .59 .46 .63 .48 German written .46 .30 .48 .36 .57 .42 .62 .49
Notes. All coefficients are statistically significant (p b .001). Notes. All coefficients are statistically significant (p b .001).
Correlation of the two recitation situations factors (mathematics–German): r = .84.
Correlations of the four lack of knowledge factors: r (German oral–German written)=.88; r
and the coefficients revealed similar to numerically slightly higher (German oral–mathematics written)=.62; r (German oral–mathematics oral)=.83; r
values for oral (.37 ≤ r ≤ .81) over written (.28 ≤ r ≤ .74) examina- (mathematics oral–German written)=.73; r (mathematics oral–mathematics written)=
tions (medium/large effect). .85; r (mathematics written–German written)=.74.
Correlations of the two recitation situations factors (mathematics/German) with the four
lack of knowledge factors: r (German oral)=.57/.67; r (German written)=.38/.46; r
3.2. Correlations with TA initiating conditions (mathematics oral)=.69/.56; r (mathematics written)=.48/.33.
intelligence factors. Similarly, the sample-selected TA-factors and ex- Appendix 3. Factor loadings (standardized regression coefficients)
amination modes should be extended. The genesis of the different of the school-subject-specific (mathematics [MAT], German [GER]),
TA-factors (and, e.g., the interplay with other variables) cannot be an- examination-mode-specific (oral, written) test anxiety factor
swered by cross-sectional studies. Longitudinal and experimental stud- items (worry, emotionality) and of the test anxiety initiating con-
ies are needed. Additionally, a person-centered approach could dition items (recitation situations, lack of knowledge; Table 5)
supplement the realized variable-centered approach.
In our study, a multi-facet structure of the TA-experience was
shown. General TA-measures seem to mask specific, but systematic
and relevant aspects of the experience of TA. As students' TA differs
according to the examination-mode the same holds probably true
Worry Emotionality Lack of Recitation
for educational/psychological interventions: Whereas some strategies knowledge situations
are largely independent of the examination-mode (e.g., content-
Oral Written Oral Written Oral Written
specific knowledge), others should vary. For example, a behavioral
approach in which oral examinations are simulated in advance in MAT/ MAT/ MAT/ MAT/ MAT/ MAT/ MAT/
GER GER GER GER GER GER GER
order to optimize communication skills should be beneficial for oral
examinations, whereas writing skills should be optimized prior to Item 1 .53/.49 .72/.67 .77/.76 .83/.80 .77/.77 .75/.74 .67/.77
Item 2 .46/.45 .53/.47 .79/.79 .80/.72 . 79/.77 .79/.79 .68/.71
written examinations. It would be interesting to connect the pro-
Item 3 .60/.58 .72/.67 .80/.80 .84/.79 .78/.80 .87/.86 .85/.85
posed diagnostic approach more tightly to interventions. But al- Item 4 .57/.54 .71/.66 .81/.79 .80/.73 .84/.85 .80/.77 .77/.78
though TA-interventions were quite effective in general—especially Item 5 .85/.84 .87/.83 .82/.79 .80/.73 .60/.60 .79/.76 .70/.70
those, that combine cognitive or behavioral approaches with skill- Item 6 .78/.73 .83/.76 .88/.84 .86/.83 .72/.71
focused approaches (cf. Ergene, 2003; Hembree, 1988; Zeidner, Item 7 .80/.77 .86/.80 .83/.80 .83/.78 .81/.82
Item 8 .87/.84 .89/.81 .78/.76
1998)—further research is needed to support the suggested differen-
tial treatment outcomes, especially in school-aged students.
Marsh, H. W., Craven, R., & Debus, R. (1999). Separation of competency and affect Johnsen (Eds.), Advances in Test Anxiety Research, Vol. 7. (pp. 114–129). Amsterdam/
components of multiple dimensions of academic self-concept: A developmental Lisse: Swets & Zeitlinger.
perspective. Merrill-Palmer Quarterly, 45, 567–601. Rost, D. H., & Schermer, F. J. (2007). Differentielles Leistungsangst Inventar (DAI) [Differen-
Marsh, H. W., & Yeung, A. S. (1996). The distinctiveness of affect in specific school tial test anxiety inventory] (2nd ed.). Frankfurt a.M., Germany: Harcourt Test Services.
subjects: An application of confirmatory factor analysis with the National Seipp, B., & Schwarzer, C. (1991). Angst und Leistung – Eine Meta-Analyse empirischer
Educational Longitudinal Study of 1988. American Educational Research Journal, 33, Befunde [Anxiety and academic achievement: A meta-analysis of empirical results].
665–689. Zeitschrift für Pädagogische Psychologie, 5, 85–97.
Muthén, B., & Kaplan, D. (1985). A comparison of some methodologies for the factor Sparfeldt, J. R., Schilling, S. R., Rost, D. H., Stelzl, I., & Peipert, D. (2005).
analysis of non-normal Likert variables. British Journal of Mathematical and Statistical Leistungsängstlichkeit: Facetten, Fächer, Fachfacetten? – Zur Trennbarkeit nach
Psychology, 38, 171–189. Angstfacette und Inhaltsbereich [Test anxiety: The relevance of anxiety factors as
Muthén, L. K., & Muthén, B. O. (1998–2007). Mplus user's guide (5th ed.). Los Angeles, well as school subjects]. Zeitschrift für Pädagogische Psychologie, 19, 225–236.
CA: Muthén & Muthén. Sparfeldt, J. R., Schilling, S. R., Rost, D. H., & Thiel, A. (2006). Blocked versus random-
Muthén, L. K., & Muthén, B. O. (2002). How to use a Monte Carlo study to decide on ized format of questionnaires: A confirmatory multiple group analysis. Educational
sample size and determine power. Structural Equation Modeling, 9, 599–620. and Psychological Measurement, 66, 961–974.
Rost, D. H., & Schermer, F. J. (1989). The various factors of test anxiety: A subcomponent Spielberger, C. D. (1980). Test anxiety inventory (preliminary professional manual). Palo
model of test anxiety measurement. In R. Schwarzer, H. M. van der Ploeg, & C. D. Alto, CA: Consulting Psychologists Press.
Spielberger (Eds.), Advances in Test Anxiety Research, Vol. 6. (pp. 37–52). Amsterdam/ Zeidner, M. (1998). Test anxiety: The state of the art. New York: Plenum Press.
Berwyn, PA: Swets & Zeitlinger/Swets North America. Zeidner, M. (2007). Test anxiety in educational contexts: Concepts, findings, and
Rost, D. H., & Schermer, F. J. (1992). “Reaction to tests” (RTT) and “Manifestations future directions. In P. A. Schutz, & R. Pekrun (Eds.), Emotion in education
of test-anxiety” (DAI-MAN): Same or different concepts? In K. A. Hagtvet, & T. Backer (pp. 165–184). Burlington, MA: Elsevier.