Download as pdf or txt
Download as pdf or txt
You are on page 1of 9

Psychology and Aging Copyright 2000 by the American Psychological Association, Inc.

2000, Vol. 15, No. 4, 648-656 0882-7974/00/S5.00 DOT: 10.1037//D8B2-7974.15.4.648

The Effects of Learning a New Algorithm on Asymptotic Accuracy


and Execution Speed in Old Age: A Reanalysis

Paul Verhaeghen Reinhold Kliegl


Syracuse University University of Potsdam

Time-accuracy curves were derived for 16 younger and 19 older persons who participated in a study on
training in the method of loci (Baltes & Kliegl, 1992). The effects of instruction were to immediately and
permanently boost asymptotic performance and initially slow down the rate of approach to the asymptote.
After extensive practice, rate of approach returned to the initial fast level. Age differences were found in
both asymptotic performance and rate of approach. The effects of instruction and practice, however, were
similar in younger and older adults, but older adults needed 1 session of instruction more than younger
adults did before the intervention showed its full effect.

One of the most replicated findings in the field of cognitive (the onset time). From the onset time on, performance rises in a
aging is the age-related decline in recall from episodic memory negatively accelerating curve, that is, the performance curve rises
(for a meta-analytic overview, see Verhaeghen, Marcoen, & Goos- rather steeply from chance level and then gradually becomes less
sens, 1993; Verhaeghen & Salthouse, 1997). It is well known that and less steep, flattening toward a horizontal asymptote. The third
measures assumed to indicate basic speed of processing are im- parameter describing the function is the rate of approach, that is,
portant mediators between age and episodic memory (for an over- the rate at which performance goes from chance level to the
view, see Salthouse, 1996, and Verhaeghen & Salthouse, 1997). asymptote from the onset time on. More formally, the equation
Research leading to this conclusion has mostly used correlational used to fit the data in the studies described above (assuming that
analysis. Recently, however, the influence of basic speed on higher chance level is zero) is
order cognition has also been examined with an experimental
method. In these studies (Kliegl, Krampe, Mayr, & Liebscher, p = c {1 — exp[(a — t)/b]} for t > a: and
1998; Kliegl, Mayr, & Krampe, 1994; Mayr, Kliegl, & Krampe,
1996; Verhaeghen, 1999; Verhaeghen, Kliegl, & Mayr, 1997; p = 0 for I < a; with a a 0; fc > 0 and e £ 1. (1)
Verhaeghen, Vandenbroucke, & Dierckx, 1998), processing time
is indirectly manipulated through the availability of the external In this equation, p stands for performance or accuracy and t for the
resource "presentation time," and accuracy is mapped out as a time available; a is the onset time, b is the rate of approach, and c
function of time. A mathematical function relating time to accu- represents the asymptote. Note that the b parameter as included in
racy (a time-accuracy function) is then fitted to the data, and the this equation is scaled such that higher b values indicate slower
parameters describing this function are used for subsequent rates of approach, or, in other words, curves that are less steep.
analysis. One important advantage of using the time-accuracy methodol-
Researchers studying the relation between presentation or pro- ogy is that it allows for a distinction between dynamic effects (i.e.,
cessing time and cognitive performance in young adults have effects on rate and onset) and asymptotic effects of aging on
demonstrated that this relation is typically nonlinear and well cognitive performance. One obvious consequence of age-related
described by a delayed exponential equation (e.g., Dosher, 1976; slowing might be that aging effects the dynamics only of the curve.
Lohman, 1989; McClelland, 1979; McElree & Griffith, 1995; In this case, older adults would simply need more time for perfor-
Wickelgren, 1977). This equation is governed by three parameters.
mance to rise above chance level; or they might need more time to
Performance remains at chance level until a certain point in time
reach their asymptotic level, which would then be equal to that of
young adults; or both onset time and rate differences would be
present. If only dynamic differences are present, then age differ-
The original research was conducted in the context of the Expertise and ences can be remediated by allowing for more processing time.
Cognitive Aging Project at the Max Planck Institute for Human Develop- Salthouse (1996) called this the limited-time mechanism for cog-
ment and Education, Berlin, Germany, codirected by Reinhold Kliegl and nitive slowing. Aging, however, might also affect the level of
Paul B. Baltes. performance ultimately reachable, or even the quality of the final
Coirespondence concerning this article should be addressed to Paul
outcome. Salthouse (1996), for instance, has argued for a simul-
Verhaeghen, Department of Psychology, 430 Huntington Hall, Syracuse
taneity mechanism of cognitive slowing, that is, one consequence
University, Syracuse, New York 13244-2340; or to Reinhold Kliegl,
Department of Psychology, University of Potsdam, Post Office Box 60 of slowing could be that products of earlier information processing
15 53, D 14415 Potsdam, Germany. Electronic mail may be sent to may be lost by the time that later processing is completed. If earlier
pverhaeg@psych.syr.edu or to kliegl@rz.uni-potsdam.de. products are needed for accurate performance, then such a mech-
LEARNING A NEW ALGORITHM 649

anism might affect the ultimate, asymptotic performance of the carrying capacity per se. Consequently, more conclusive evidence
system. for the existence of age-related differences in speed of encoding
Another advantage of the time-accuracy methodology is that processes and in final accuracy should come from research where
performance of an individual is now captured in three distinct strategy differences between younger and older adults have been
parameters that each can be assigned meaning, depending on the minimized.
task. Take the onset parameter. For episodic memory, it makes A line of research that seems particularly promising for our goal
sense to posit that a word stimulus must be read before it can be in of strategy equalization is the intervention research aimed at elic-
any way remembered and, conversely, that it will stand a minimal iting cognitive and memory plasticity by teaching older adults
chance of being remembered as soon as it has been accessed in the effective cognitive and mnemonic strategies (e.g., Baltes & Labou-
lexicon. Consequently, the onset parameter can be interpreted as vie, 1973, Baltes & Schaie, 1976; Baltes & Willis, 1982; Denney,
the time needed to recognize the word and access the lexicon. For 1979; Kliegl & Baltes, 1987; Labouvie-Vief, 1976). It has been
the rate of approach parameter, Kliegl (1995) offered an explana- demonstrated that the performance of older adults on memory
tion in terms of elaboration rate. The assumption is that partici- tasks can indeed be boosted considerably by simple instruction and
pants studying a list of words generate elaborations (i.e., particular some practice with an efficient mnemonic, such as the method of
associations) for each of the stimuli and that the probability of loci. In a meta-analysis, Verhaeghen, Marcoen, and Goossens
recall is directly proportional to the number of elaborations that (1992) found the effect to be about three quarters of a standard
can be generated (e.g., Craik & Tulving, 1975; James, 1890; deviation. This demonstration of memory plasticity, in turn, im-
Kausler, 1991, p. 351; note that sheer repetition does not neces- plies that older adults are typically applying suboptimal strategies
sarily lead to better recall [e.g., Glenberg, Smith, & Green, 1977], to the kind of memory tasks psychologists subject them to in their
therefore this component of elaboration seems a necessary ingre- laboratories, but so, apparently, are younger adults. In a follow-up
dient of effective encoding for free recall). Elaborations are as- meta-analysis, Verhaeghen and Marcoen (1996) noted that in all
sumed to be sampled out of a finite store of associations. Hence, memory-training studies (with only one exception) in which both
increased processing time will allow for sampling of more elabo- a group of younger and older adults were trained, the effects of
rations and consequently to better recall. Kliegl (1995) assumed training in the older adults were found to be smaller than those in
that after usage, the elaborations are put back into the store. This younger adults. Consequently, younger adults actually benefit
increases the likelihood of sampling elaborations already retrieved more from memory training than older adults. Thus, it seems that
as time increases and will lead to diminishing returns with in- when younger and older adults are performing identical (and
creased processing time, or in other words, to a time-accuracy highly effective) strategies, age differences do not disappear; on
curve flattening to an asymptote. The negative exponential is the contrary, they are exacerbated. This observation still leaves us
compatible with such a stochastic replacement model of learning in the dark as to the locus of the effect: Older adults might be
(Restle & Greeno, 1970). The asymptote is generally taken to disproportionally slower than younger adults when using effective
reflect the maximum strength of activation (McClelland, 1979), or mnemonics (and this could be due to increased onset times, slower
the carrying capacity of the system (van Geert, 1993), under the rates of approach, or both), their level of asymptotic performance
particular circumstances of the task. might increase less after training, or both. Another possibility is
Previous time-accuracy research has demonstrated that in rather that older adults need more practice with the strategy than younger
simple tasks, such as figural scanning, word scanning, figural adults and that true equalization of strategy use will only occur
reasoning, and cued recognition (Kliegl et al., 1994; Mayr et al., after extended practice.
1996), older adults are merely slower in getting performance off In this article, we apply the time-accuracy methodology to a
the measurement floor or in reaching the asymptote than young long-term data set that examined plasticity in episodic memory
adults. This suggests that a simple limited-time slowing mecha- functioning (Baltes & Kliegl, 1992; Kliegl, Smith, & Baltes,
nism is sufficient to explain aging effects in such tasks. However, Kliegl, Smith, & Baltes, 1989, 1990). In this study, a group of 16
for recall, age differences in asymptotic performance have been younger and 19 older adults were trained in the method of loci and
found, as well as age differences in the rate of approach parameter practiced the method during fifteen 1-hr sessions. The method of
(Kliegl et al., 1998; Verhaeghen et al., 1998, Experiment 1). This loci is an imagery-based mnemonic that is particularly suited for
suggests that the elaboration processes slow down with age and serial recall of words. Briefly, in this mnemonic, participants are
that the carrying capacity of the system for episodic memory instructed to associate each of the words to be remembered with a
decreases. particular location (a "locus") in an ordered sequence of locations,
There is, however, a possible confound here, in the sense that using interactive imagery for the association (see, e.g., Bellezza,
strategic processes at encoding and retrieval are possibly important 1987, for more details). At retrieval, the user mentally revisits each
determinants of episodic recall, and people do differ in the strat- location in the correct order and uses the location as a retrieval cue
egies they bring to such tasks (e.g., Verhaeghen & Marcoen, for the image from which the original word is decoded. In this
1996). Behavioral slowing and loss of ultimate accuracy can only study, a series of 30 Berlin landmarks provided the loci. A total
rightfully be traced to mental slowing and to a loss of carrying of 38 pretest, instruction, practice, and assessment sessions were
capacity when the correspondence axiom (Cerella, 1990) holds, administered over a period of 1 year and 4 months. Given the
that is, when we can be certain that young and older adults apply extremely long duration of this program, we assume that the
the same processes (in the same sequence) to a task. If strategy technique will be highly overleamed, and younger and older adults
differences exist, then behavioral slowing and age-related accuracy will be thoroughly equated on strategy use at the end of training
differences might be the result of usage of less-than-optimal and practice. Data are available for one pretest occasion and nine
strategies by older adults and not of mental slowing or loss of posttest occasions. At each of these points during training, serial
650 VERHAEOHEN AND KLIEGL

recall of a list of 30 words was measured at 6 (pretest to sixth not a strategy that most adults spontaneously apply to serial recall
posttest) or 12 (seventh posttest to final posttest) presentation (Verhaeghen & Marcoen, 1994). Consequently, we expect that,
times per word, ranging between 0.84 s and 20.00 s. In previous after posttest, the rate parameter will decrease with continued
articles reporting on results from this study, data were averaged practice, because the process of generating an interactive image
across these presentation times. In this article, we reexamined the will become more efficient. For the transition from pretest to
data from these different presentation times to derive time- posttest, we might expect the rate of approach to go up, because
accuracy functions for each individual at each of the testing this transition entails a change from strategies that are spontane-
occasions. Previous analysis on this data set revealed sizable ously applied to the task and are presumably partially automatized
treatment gain for both young and older adults. The age differences to a new, deliberately controlled way of doing the task. Given that
present at pretest were magnified over the course of training and the method provides an excellent cueing structure for both encod-
practice sessions, especially at the longer presentation times, sug- ing and retrieval, we would expect asymptotic accuracy to go up
gesting asymptotic age differences. considerably after training. If the sequence of locations is well
The first goal, then, of this article is to assess the effects of learned at the first posttest, then we should expect little change in
training and practice in the method of loci on the parameters of the asymptote after the first posttest.
time-accuracy functions. More specifically, we were interested in The second goal of our reanalysis was to examine age differ-
capturing the differences between the effects of instruction versus ences in the parameters and how they change across training
continued practice on dynamic and asymptotic effects on the sessions. On the basis of previous research on adult age differences
time-accuracy function for serial recall. One interesting aspect of in time-accuracy functions for recall from episodic memory
the previous findings, as seen in Figure 2 in Kliegl et al. (1990) and (Kliegl et al., 1998; Verhaeghen et al., 1998), we expect initial age
Figure 1 in Baltes and Kliegl (1992), is that the curves describing differences in rate of approach and asymptotic performance but not
performance as a function of testing occasions are quite smooth, onset time. One question of particular interest concerns potential
rising steeply at first but then gradually flattening toward a hori- age differences in the nature of the transitions and the possibility
zontal asymptote. At first sight, this seems to suggest that the of interactions between age and testing occasions. It is our assump-
transition from an untrained to a trained and then a well-practiced tion that comparison of the final sessions of practice, when the
state is quite undramatic, and it closely follows the general rule of mnemonic is highly overlearned in both age groups, should give us
the power law of practice (Newell & Rosenhloom, 1981). A closer a good estimate of age differences in memory functioning when
investigation of the correlation matrix, however, revealed that the both groups are using an identical highly effective strategy. Al-
correlation between pretest and the first posttest was quite small, though some literature on aging and skill acquisition exists (for
but correlations were high between the different posttest occasions overviews, see Baron & Cerella, 1993, and Salthouse, 1991), our
(Kliegl et al., 1990). This then suggests no smooth transition, but article is the first to investigate age differences at the level of the
indicates that different mechanisms are indeed at play in pretest parameters of an underlying performance model, rather than at the
and posttest, making for a drastic reordering of participants on the level of observed latencies or observed accuracy.
performance continuum. No such dramatic change occurs between
posttest occasions, suggesting that settling into a well-practiced
Method
state is indeed a smooth transition. We hoped to see this qualitative
shift from learning to continued practice reflected in the parame- Detailed information on participants, procedure, and testing materials
ters of the underlying time-accuracy functions. can be found in the original articles describing this study (Baltes & Kliegl,
Given that the method of loci prescribes a specific strategy, the T992; Kliegl et al., 1989, 1990). Here, we briefly reiterate the main points
meaning of the parameters of the time-accuracy function changes concerning the method.
after posttest. As stated above, the onset time reflects the time
needed for minimal recall of the stimulus. When people are ap-
Participants
plying the method of loci correctly, encoding of a word entails
retrieval of the appropriate locus, reading the word, and forming a Participants were 16 young adults, ranging in age between 20 and 30
combined mental image of the locus and the word. Thus, the onset years, and 19 older adults, ranging in age between 66 and 88 years old.
time at and after posttest should not only reflect perceptual pro- All participants scored above average on the Hamburg-Wechsler-
cesses needed for word reading, but also the time needed for Intelligenztest fur Erwachsens test (i.e., German version of the WAIS;
Hardesty & Lauber, 1956; young IQ, M = 118, SD = 6; old 1Q, M = 125,
retrieval of the locus during the encoding phase of the experiment.
SD = S). All were in good self-reported health. Younger and older adults
We remain agnostic as to whether these processes occur in paral-
did not differ significantly on intelligence and self-reported health
lel; we assume, however, that an increase hi the onset parameter
measures.
after training would signify that either the locus retrieval and word
reading processes are executed in a serial fashion, or else that
queuing is occurring somewhere in the parallel stream of process- Design
ing (Liu, 1996). A decrease in onset time over the course of
The entire experimental schedule consisted of thirty-eight 1-hr sessions,
practice can mean at least two things: either retrieval of the locus
distributed over a period of 1 year and 4 months. After initial assessment,
and word reading become increasingly parallel in their execution, two phases can be distinguished: a training phase (Sessions 5 and 6) and a
or the retrieval process is executed in an increasingly faster fash- practice phase (Sessions 7 to 37). The last session was a debriefing session.
ion. The rate-of-approach parameter would still reflect the time Materials. Lists of 30 words were used for the assessment of serial
needed for elaboration, which, in this case, means forming and recall. All words were nouns denoting concrete objects. Words used for the
elaborating on an interactive image. Forming interactive images is assessment lists appeared only once in the experiment.
LEARNING A NEW ALGORITHM 651

Training conditions. In each of the training and practice sessions,


scheduled at approximately two sessions per week, 4 lists of 30 words were
administered. Across all sessions of training and practice, each participant
performed 4,380 trials of interactive imagery, linking a word to a location.
During the training phase (Sessions 5 and 6), the method of loci was
explained. Words were presented at time intervals comfortable to each
individual, that is, without time pressure. During the 15 sessions of practice
(Sessions 8, 9, 11, 12, 14, 15, 21, 22, 23, 28, 29, 30, 33, 34, and 35),
presentation of words was experimenter paced. Different presentation
times between 0.84 s and 20.00 s per word were used (6 different times up
until Session 25, 12 after Session 25; see next paragraph for precise
values). Participants were moved to shorter presentation times when they
passed a criterion (50% or 80%) correct. When performance was below
criterion on two successive occasions, longer presentation times were used
again.

Performance Assessment

Assessment of serial recall occurred in Sessions 3 (pretest), 7 (immediate


posttest), 10,13, 16,17, 25, 26/27. 31/32, and 36/37 (practice). There were
two assessment formats reflective of the change in rates of presentation
times after Session 23. At the first seven occasions, 6 lists of 30 words
were administered with presentation times of 20.00 s, 15.00 s, 10.00 s,
5.00s, 3.00s, and l.OOs. At the final three occasions, assessment extended
over two sessions. In the first of these sessions, four lists were administered
at 20 s, 15 s, 11.84 s, and 8.44 s; in the second occasion, eight lists were
administered with presentation times of 6.33 s, 4.75 s, 3.56 s, 2.67
s, 2.00 s, 1.50 s, 1.14 s, and 0.84 s. We decided to drop the shortest
presentation times from the analysis, because it is unlikely that the method
of loci can be applied at very fast presentation rates. (This is an assumption
<
that seems inherent in research using this mnemonic. Studies using the 0 5 10 15 20 25 30 35 40
method of loci with college-age adults have used presentation times Session
of 5.00 s and longer; Bellezza & Reddy, 1978; Carlson, Kincaid, Lance &
Hodgson, 1976; De Beni & Comoldi, 1985, 1988; Kemp & van der Krogt, Figure /. The three parameters of the time-accuracy functions for
1985; Lee & Edwards, 1981; Roediger, 1980; Ross & Lawrence, 1968. At younger and older adults as a function of training in the method of loci
shorter times, it may become difficult to both retrieve the locus and start (error bars denote standard error of the mean). The first data point
forming an image.) Therefore, only scores based on the five presentation (Session 3) represents pretraining performance; all other data points are
times of 20.00 s, 15.00 s, 10.00 s, 5.00 s, and 3.00 s were used for the postinstruction.
time-accuracy analysis. Starting with assessment 26 and 27, mean scores
for 11.84 s and 8.44 s were used as an approximation for the 10-s score.
Likewise, a score for the 5.00-s rate was based on the mean of scores of sion interaction on the parameters. As explained in the introduc-
the 6.33-s and 4.74-s rate and for the 3.00-s rate on the mean of scores for tory section, we were interested in capturing the differences be-
lists presented at 3.56 s and 2.67 s per word. tween the effects of instruction versus continued practice on
dynamic and asymptotic effects on the time-accuracy function for
Results serial recall. Therefore, two series of ANOVAs were conducted,
one on the contrast between the pretest and immediate posttest, and
For each individual, the three parameters of the time-accuracy
one on the immediate posttest to final test portion of the learning
function for each testing occasion were estimated by fitting Equa-
tion 1 to the data, with proportion recalled as the dependent
variable and presentation time (in seconds) as the independent
Effects of Age and Training-Practice on Onset Time
variable. The 10 time-accuracy functions for each participant (one
for each occasion based on five lists with different presentation For parameter a, the onset time, neither the main effects nor the
times) were fitted simultaneously, using the Statistical Package for interaction effect reached significance (all Fs < 1, indicating that
the Social Sciences nonlinear regression module. The parameter the effects are very small) in the pretest-to-immediate-posttest
estimates of these individual time-accuracy curves were then av- contrast. In the analysis of the nine testing occasions between
eraged over individuals within each age group to yield average immediate posttest and final test, a main effect was found for
estimates for younger and older adults for each of the occasions. testing occasion, F(8,264) = 3.67, MSE = 0.2Q,p< .001, but not
These estimates are depicted in Figure 1. The models fit the data for age, F(l, 33) = 0.58, MSE = 0.59, m. As can be seen in
quite well; the average pseudo—R2 value for the fit of the individ- Figure 1, the onset parameter tended to decrease over testing
ual curves was .83 for the young (SD = 0.07) and .89 for the old occasions. The main effect of testing occasion, however, was
(SD = 0.05). qualified by an Age X Testing Occasion interaction, F(8,
An analysis of variance (ANOVA) was conducted to determine 264) = 2.80, MSE = 0.20, p < .01. (Note that this interaction was
the effects of age, testing occasion, and the Age X Testing Occa- a cross-over Interaction. Hence, no transformation is necessary to
652 VERHAEGHEN AND KLIEGL

account for the effects of general slowing in the onset parameter.) highly reliable, with older participants being much slower to reach
Regression analysis shows that the decrease in onset time over asymptote than young adults.
testing occasions was entirely due to changes within the older
sample. When we regressed the average onset time on testing Effects of Age and Training-Practice on Asymptotic Level
occasion number within each age group, linear regression did not
of Performance
fit the data of the young group (ff 2 = .00; regression coefficient
—.00); for the old group, however, there was a reliable decrease of A problem arose with the analysis of parameter c. Verhaeghen
the onset parameter across testing occasions (J?2 = .58; regression et al. (1997) suggested to analyze the effects of the asymptotic
coefficient = -.02). This implies that retrieving the locus and parameter (c) by investigating the effect of c on time demand
identifying the stimulus took a constant amount of time in younger needed to reach a given level of performance. In other words, not
adults, regardless of the stage in practice. For older adults, these the parameter c itself is being analyzed, but its impact on the time
processes sped up with about 20 rns for each additional 1-hr needed to reach a given criterion level of recall. This criterion level
session of practice. necessarily needs to be smaller than the lowest asymptote reached
by any participant in any session—otherwise the time needed
would be indeterminate for participants with an asymptote lower
Effects of Age and Training—Practice on Rate
than the criterion level. As the lowest level was very low indeed
of Approach
(several people had asymptotes lower than . 1 at one or more of the
In accordance with the principles outlined in Verhaeghen et al. early sessions), the Verhaeghen et al. (1997) technique was not
(1997), analyses on parameter b, which is the rate of approach, applicable to the present data set. Likewise, an alternative tech-
were conducted on log-transformed scores. After logarithmic nique suggested by Verhaeghen et al. (1998; i.e., analyzing the
transformation, testing for an Age X Condition interaction be- asymptote after logit transformation) could not be applied because
comes a test for deviations from a multiplicative model of aging. many participants attained perfect asymptotes in the later sessions,
That is, we tested whether the young over old ratio of rates therefore logit (c) would be indeterminate. Also, no matter how the
remained constant across testing occasions. This model is in ac- data are transformed, this ceiling effect in later sessions makes
cordance with extant models of age-related slowing (e.g., Cerella, conclusions from any type of ANOVA tentative at best.
1990), which state that central processing in older adults is slowed Because none of the more sophisticated approaches could be
by a constant proportion as compared to processing in younger applied, we decided to conduct a standard ANOVA on untrans-
adults. Given our assumption that perceptual factors would impact formed c parameters. For the pretest-to-immediate-posttest con-
the onset time parameter and not the rate parameter, and given that trast, a reliable main effect was found for testing occasion, F(l,
no motor response is executed during the encoding stage of this 33) = 71.25, MSE = 0.08, p < .001, and age, F(l, 33) = 7.06,
memory task, we assume that peripheral input-output processes MSE = 0.06, p < .05, but not for the Age X Testing Occasion
play no role in the rate parameter. Hence, this parameter should interaction, F(l, 33) = 2.16, MSE = 0.08, ns. This signifies that
thus conform to a strictly proportional model. older adults had lower asymptotes than younger adults and that
For the pretest to immediate posttest contrast, only the effect of there was a marked positive effect of training on asymptotic
testing occasion was significant, F(l, 33) = 6.78, MSB = 18.86, accuracy.
p < .05. Neither the age main effect, F(l, 33) < 1, MSE = 13.80, For the posttest-to-final-test portion of the learning curve, only
ns, nor the Age X Testing Occasion interaction, F(l, 33) = 1.39, the age main effect was found to be significant, F(l, 33) = 12.48,
MSE = 18.86, ns, reached significance. Consequently, one effect MSE = 0.18, p < .001. Neither the testing occasion, F(8,
of instruction in the method of loci appeared in the form of 264) < 1, MSE = 0.04, ns, nor the Age X Testing Occasion
slowing. This slowing is equivalent across age groups, and interaction, F(8, 264) = 1.05, MSE = 0.04, ns, reached signifi-
younger and older adults do not differ in the rate of approach
before and immediately after training.
1
One of the reviewers suggested that the Age X Session interaction in
For the posttest to final test sessions, a reliable main effect was
the posttest-to-final-test segment may falsify general slowing theory, be-
found for age, F(l, 33) = 12.79, MSE = 3.52, p < .01. The Age X
cause the age relation of the parameters changes over sessions (see Cerella,
Testing Occasion interaction, F(8, 264) = 4.13, MSE = \M,p<
1990, and Myerson, Hale, Wagstaff, Poon, & Smith, 1990, for theories
.001, was also reliable, but not the testing-occasion main effect, describing older adults' performance as a simple function of performance
F(8, 264) = 1.33, MSE = 1.84, ns. However, as can be seen in of younger adults; and Salthouse, 1996, for a more mediator-oriented
Figure 1, the slowing effect of instruction was not complete in version of this view). We wish to point out, however, that these general
older adults at the first posttest. Rather, older adults continued to slowing perspectives do not contain theoretical statements about the form
slow down in the second posttest session.1 Therefore, we reana- of the change in age differences after instruction in a mnemonic; for
lyzed the data, conducting an ANOVA on the segment of the curve instance, the theory makes no claim about whether older adults should
representing the second posttest to the final posttest. In this anal- learn a technique equally fast or slower than younger adults. This implies
that there is technically no clear general slowing null hypothesis to falsify.
ysis, reliable effects were found for age, F(l, 33) = 35.06,
Contrary to the reviewer, we think our data suggest that correspondence
MSE = 2.19, p < .001, and testing occasion, f(7, 231) = 3.16,
(i.e., the two groups of participants are applying the same processing steps
MSE = 0.75, p < .01, but not for the Age X Testing Occasion
in the same order; Cerella, 1990) might indeed be established, but only
interaction, F(7, 231) = 1.40, MSE = 0.75, ns. Thus, after slowing after the second posttest session, that is, after the older participants have
down at the first and (for older adults) second posttest, elaboration reached the peak of mnemonic-induced slowing. From that point onward,
speed increased again, apparently at the same rate in both age the age difference in rate of processing appears to remain stable, that is, it
groups. The age difference in the posttest to final test segment was conforms to the expectations of general slowing theory.
LEARNING A NEW ALGORITHM 653

portraits are remarkably similar. At first, a sizeable increase occurs


14 in the asymptotic parameter because of instruction in the method
of loci, while at the same time the rate of approach goes up
12 (meaning that the research participants are getting slower at exe-
O cuting encoding operations). When the peak of slowing and of the
10 rise in asymptotic performance is reached, the curve drops almost
Q. vertically, meaning that the asymptote stays constant while the rate
Q. 8 of approach goes down. The lines are almost parallel for the two
age groups, showing a high qualitative resemblance of the effects
6 of instruction and continued practice. At the same time, the dia-
gram also illustrates two important differences between the age
DC 4 groups, namely, first, that the starting point of the curves (i.e., the
Younger Adults point depicting performance at pretest) is different; and second,
2 Older Adults that older adults need one session more to reach their peak of
asymptotic performance. The similarity in shape combined with a
different starting point Leads to the nonconvergence of age differ-
0.0 0.2 0.4 0.6 0.8 1.0 ences in the course of memory training.
Figure 3 depicts the change over testing occasions of the young-
Asymptote old difference in the rate parameter in a Brinley plot. In such a plot
(Brinley, 1965), average data of older adults are depicted as a
Figure 2. Rate of approach as a function of asymptotic performance and
function of average data of young adults. The difference between
training session for younger and older adults. The two points in the
a traditional Brinley plot and Figure 3 is that Figure 3 contains an
left-hand portion of the graph represent performance in Session 3 (pretest);
the arrow indicates the direction of time; successive sessions are connected ordered sequence of points obtained on the same participants. The
with lines. curve describing the change over time of the rate parameter seems
to curl back onto itself. This suggests that, after the initial shock of
applying the new mnemonic, participants return to their initial
cance. However, as can be seen in Figure 1, the immediate effects speed of encoding processes (and thus to the same initial age
of training in the old were not restricted to the first posttest. Rather, difference). This in turn suggests that the speed at which encoding
asymptotic performance continued to rise in the next session. processes are executed may well be a given within the cognitive
Restricting the analysis to the portion of the learning curve from system, that is independent of the algorithm used, at least after a
the second to the final posttest did not substantially alter the results sufficient amount of practice with the algorithm has been provided.
of the ANOVA [age effect, F(l, 33) = 9.87, MSE = 0.18, p < .01; In that sense, the basic speed of processing of the system works as
testing occasion effect, F(7, 231) < 1, MSE = 0.03, ns; Age x a point attractor (e.g., Kelso, 1995), that is, after destabilization,
Testing Occasion interaction, F(7, 231) = 1.06, MSE = 0.18, ns]. the system returns to its initial settings, much as a spring that is
Thus, older adults appear to have lower asymptotic levels of
performance across continued practice with the method of loci
4
r
CO
than younger adults. [There seems to be a trend toward conver-
gence of the two age groups in the asymptote parameters over
sessions. To assess the size of this effect, we calculated the
< 12
percentage of total variance associated with the interaction effect,
using Levin's (1997) Equations 25 and 3, and we found this to be
.06 (i.e., w2 = .00) for the portion of the curve going from posttest 1
I °
to final test portion of the curve and .0002 (i.e., cu2 = .00) for the
portion extending from the second to the final posttest. Hence, this
apparent convergence is associated with an extremely small effect g 6
size (Cohen, 1988, labeled w2 = .01 as a "small" effect)].
a 4 H
Graphical Analysis "o
2
Figures 2 and 3 depict alternative ways of looking at the data a
(0
concerning some of the parameters. Both of these figures reprise rr n J
the data contained in Figure 1, but they represent them in different
ways, emphasizing different aspects of our data. Figure 2 depicts
0 2 4 6 8 10 12 14
two phase portraits, one for each age group. A phase portrait is a
. Rate of Approach (Younger Adults)
graph depicting change in a system over time; the system is
depicted in an n-dimensional space (called state space) and is Figure 3. Phase portrait in young-old space of the change over training
defined by n descriptive variables. Here, we show a two- in the method of loci of the rate-of-approach parameter for the time-
dimensional plot relating the rate of approach parameter to asymp- accuracy functions. The arrow indicates the direction of time; successive
totic performance. As can be seen in the graph, the two phase sessions are connected with lines.
654 VERHAEGHEN AND KLIEGL

stretched and then released will eventually return to its initial due to the fact that no data points were sampled close to the onset
time (minimum presentation time used for estimating the curves
was 3 s). Nevertheless, the pattern is compatible with the hypoth-

Discussion esis that after instruction in the method of loci participants not only
read the word but also retrieved the locus, which they need to
In this study, older and younger adults were trained in the generate the mental image. The decrease of the onset time over the
method of loci, and they received extensive practice with the course of practice, up to the initial pretest level, suggests that over
method over a period of many months. The results were analyzed practice, retrieval of the locus becomes more and more automatic.
at the level of parameters of the time-accuracy function, that is, the For young adults, this transition may have occurred during the
function relating proportion of recall to the time each item has instruction sessions, which were sufficient to establish the skill at
been presented. a very high level. The reader should note that the finding that the
Our first goal was to assess the effects of training and practice onset times for young and older adults do not differ at pretest is
in the method of loci on the parameters of the time-accuracy consistent with all previous time-accuracy research on recall and
function. Training in an effective mnemonic, such as the method of recognition of words from episodic memory (Verhaeghen, 1999;
loci, entails learning a new algorithm for encoding the to-be- Verhaeghen et al., 1998). This result suggests that the lexical
remembered materials. As such, this intervention initially destabi- access process has an identical time course for younger and older
lizes the system. This can be seen in the effects of training on the adults— a result consistent with lexical access time-course esti-
parameters of the function: It slowed the participants down after mates from spread-of-activation studies (for an overview, see
posttest (viz., the rate parameter is larger after training, and for the Duchek & Balota, 1993) and at least some of the data on reading
older adults, the onset time increases as well), while at the same times (Wingfield & Stine-Morrow, 2000).
time asymptotic performance is boosted. After this initial shock, Our finding of a dramatic shift from an untrained to a trained
the main effect of continued practice is to speed up processing state, followed by a gradual relaxation of the system into a more
(viz., the rate of approach goes down, and for the older adults, the efficient way of executing the algorithm is in accordance with the
onset time decreases), while the asymptotic level of performance correlational analysis on the same data set reported in Baltes and
remains relatively stable. Thus, two distinct mechanisms seem to Kliegl (1992). This analysis showed that instruction disrupts the
be at work in instruction and practice, which have their impact on rank order of participants, which then stayed quite consistent
different aspects of time-related performance. The method of loci during continued practice in both age groups. We suspect that the
provides participants with a framework that allows both for effi- maximum capacity of the system may well be a function of both
cient encoding of the individual words and for correct serial order the learner and the task, therefore the transition from the individ-
at recall. This effectively increases the maximum capacity of the ual's preferred strategy at pretest to the imposed strategy at post-
system for serial recall. However, this increase comes at the cost of test may boost performance of certain individuals more than that of
slowing down the encoding processes, as evidenced by an in- others. This is convergent with some evidence gathered by Ver-
creased rate of approach. Maybe the reason for this initial slowing haeghen and Marcoen (1996). In that study, older adults who at
is that the assemblage of the components of a newly learned pretest indicated that they linked words in a list using some
algorithm is typically an effortful process, occurring under delib- associative technique had more trouble with applying the method
erate control (Duncan, 1986; Norman & Shallice, 1986). In the of loci correctly. Likewise, in that study, the ability to recall paired
method of loci, some compilation of various components is indeed associates, as measured with an independent test at pretest, had a
required: retrieving the locus, forming an image of the locus, larger effect on posttest than on pretest performance. Thus, the
forming an image of the word, and combining these in an inter- method of loci might be better suited to certain individuals than to
active fashion. After initial destabilization, the system speeds up others, and this reorders participants. Once the method has been
again. Likely candidates for this speed-up include faster execution learned, however, practice mostly has the effect of honing the
of the compilation process itself, increased automaticity in the component skills, and there is no reason why this should disturb
execution of one or more of the components, maybe allowing for the rank order of participants.
parallel processing, or the acquisition of a library of stock images For the rate-of-approach parameter, significant age differences
(or of stock solutions for finding an interactive image) that can be were found in the practice portion of the learning curve. Conse-
applied at particular loci. Note that this double effect of increased quently, older adults are slower than young adults (at least during
asymptotic performance and first elevated and then decreasing rate the period of extended practice with the mnemonic). This is in
of approach makes for a deceptively smooth learning curve at the accordance with the bulk of the literature on aging and slowing
level of mean performance, in that the abrupt change in asymptotic (e.g., Cerella, 1990; Salthouse, 1991, 1996) and with previous
performance is masked by the abrupt task-related slowing that time-accuracy research that examined age differences in recall
occurs. from episodic memory (Kliegl et al., 1998; Verhaeghen et al.,
An interesting finding is that the onset time increases for older 1998). This result points at the existence of a limited-time mech-
adults (but not for younger adults) immediately after training (i.e., anism (Salthouse, 1996) for encoding of information both when
during the first and second posttest) and then decreases quite individuals apply their usual encoding strategies and when the
steadily (at a rate of about 20 ms per session). Estimates of the method of loci is applied.
onset parameter should be interpreted cautiously, however. For There was an age main effect in asymptotic performance, both
instance, we found that in the last few sessions, onset times were in the pretest-to-posttest contrast and in the practice portion of the
effectively lower for older than for younger adults. This might learning curve. Older adults are ultimately less accurate than
indicate a failure in precision of estimating the parameter, maybe younger adults. Kliegl et al. (1998) and Verhaeghen et al. (1998)
LEARNING A NEW ALGORITHM 655

have previously demonstrated such asymptotic age differences in Bates, P. B., & Labouvie, G. V. (1973). Adult development of intellectual
recall from episodic memory, and the current research extends this performance: Description, explanation, and modification. In C. Eisdorfer
finding to recall when both age groups are equated in their use of & M. P. Lawton (Eds.), The psychology of adult development and aging
a highly efficient strategy. Thus, this is strong evidence for the (pp. 157-219). Washington, DC: American Psychological Association.
Bakes. P. B., & Schaie, K. W. (1976). On the plasticity of intelligence in
robustness of an asymptotic age difference in recall from episodic
adulthood and old age. American Psychologist, 31, 720-725.
memory. This is not an obvious result. It signifies that even when
Bates, P. B., & Willis, S. L. (1982). Plasticity and enhancement of
given an unlimited amount of time, and even after months of
intellectual functioning in old age: Penn State's Adult Development and
practice, older adults do not reach the same level of recall as
Enrichment Project (ADEPT). In F. I. M. Craik & E. E. Trehub (Eds.),
younger adults when applying a mnemonic device that provides an Aging and cognitive processes (pp. 353-389). New York: Plenum.
excellent and consistent cueing device at both encoding and re- Baron, A.. & Cerella, J. (1993). Laboratory tests of the disuse account of
trieval. Stated in Salthouse's (1996) terms, this implies that a cognitive decline. In J. Cerella, W. Hoyer, J. Rybash, & M. Commons
simple limited-time mechanism of slowing is insufficient to ex- (Eds.), Adult information processing: Limits on loss (pp. 175-203). San
plain adult age differences in recall from episodic memory. Of Diego, CA: Academic Press.
course, in the present experiment no special instructions occurred Bellezza, F. S. (1987). Mnemonic devices and memory schemas. In M. A.
after the initial instruction sessions. New practice regimes or McDaniel & M. Pressley (Eds.), Imagery and related mnemonic pro-
cesses: Theories, individual differences, and Lipplications (pp. 34-55).
special coaching directed at increasing asymptotic levels late in the
New York: Springer-Verlag.
experiment may lead to further shifts of the asymptote.
Bellezza, F. S., & Reddy, B. G. (1978). Mnemonic devices and natural
With regard to the change in age differences over training and
memory. Bulletin of the Psychonomic Society, 11, 277-280.
practice, no Age X Testing Occasion interaction was found for
Brinley, J. F. (1965). Cognitive sets, speed and accuracy of performance in
either the rate of approach or the asymptote. Thus, within the limits the elderly. In A. T. Welford & J. E. Birren (Eds.), Behavior, aging and
of the statistical power of this analysis, the effects of instruction the nervous system (pp. 114-149). Springfield, IL: Thomas.
and practice on these parameters were identical for younger and Carlson, R. F., Kincaid, J. P., Lance, S., & Hodgson, T. (1976). Sponta-
older adults. The phase portrait depicted in Figure 2 offers a vivid neous use of mnemonics and grade point average. Journal of Psychol-
description of this similarity: The change over time of the system ogy, 92, 117-122.
described by the rate of approach and the asymptote is indeed Cerella, J. (1990). Aging and information processing rate. In J. E. Birren &
remarkably similar in younger and older adults, as illustrated by K. W. Schaie (Eds,), Handbook of the psychology of aging (3rd. ed., pp.
the parallemess of the traces. This suggests a strong qualitative 201-221). San Diego, CA: Academic Press.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences
resemblance in the processes underlying performance changes as a
(2nd ed.). Hillsdale, NJ: Erlbaum.
function of instruction and practice in younger and older adults.
Craik, F. I. M., & Tulving, E. (1975). Depth of processing and the retention
(But note that older adults reach the peak in the graph only at the
of words in episodic memory. Journal of Experimental Psychology:
second testing occasion, showing that although the system de-
General, 104, 268-294.
scribed by the rate and asymptotic parameters is indeed similar in De Beni, R., & Cornoldi, C. (1985). Effects of the mnemotechnique of loci
older and younger adults, the older system moves slower through in the memorization of concrete words. Acta Psychologica, 60, 11-24.
state space.) De Beni, R., & Comoldi, C. (1988). Does the repeated use of loci create
There is a third, and quite exciting, illustration of the young-old interference? Perceptual and Motor Skills, 67, 415-418.
parallelism. The trace of the rate parameter in Brinley space as Denney, N. W. (1979). Problem solving in later adulthood: Intervention
depicted in Figure 3 reveals that, at least at the group level, the research. In P. B. Baltes & O. G. Brim (Eds.), Life-span development
original age difference acts as an attractor state. In other words, and behavior (Vol. 2, pp. 37-66). New York: Academic Press.
over the course of training and practice, the rate of approach Dosher, B. A. (1976). The retrieval of sentences from memory: A speed-
returns to its original setting (and hence to its original age differ- accuracy study. Cognitive Psychology, 8, 291—310.
Duchek, J. M., & Balota, D. A. (1993). Sparing activation processes in
ence), much as a spring returns to its original shape after contrac-
older adults. In J. Cerella, J. Rybash, W. Hoyer, & M. L. Commons
tion or expansion. This finding suggests that the speed of elabo-
(Eds.), Adult information processing: Limits on loss (pp. 384-422). San
ration of encoding into episodic memory, after a strategy has
Diego, CA: Academic Press.
become automatic, might well be a constant that is intraindividu- Duncan, J. (1986). Consistent and varied training in the theory of automatic
ally stable. and controlled information processing. Cognition, 23, 279-284.
Summarized, it appears that the instruction in the method of loci Glenberg, A. M., Smith, S. M., & Green, C. (1977). Type I rehearsal:
has its primary effect in a lasting increase of the asymptotic level Maintenance and more. Journal of Verbal Learning and Verbal Behav-
of recall and in temporary slowing of elaboration processes. In ior, 16, 339-352.
older adults, we observed the additional effect of increasing the Hardesty, A., & Lauber, H. (1956). Hamburg-Wechster-lntelligenztestfiir
minimum time needed for minimal recall. Older adults were found Erwachsene (HAWIE) [Hamburg Wechsler intelligence test for adults].
to be slower than younger adults and to have a lower level of Bern, Switzerland: Huber.
James, W. D. (1890). Principles of psychology (Vol. 1). New York: Holt.
asymptotic recall. These differences were largely preserved over
Kausler, D. H. (1991). Experimental psychology, cognition, and human
training and practice after an initial warming-up period for older
aging (2nd ed.). New York: Springer-Yerlag.
adults.
Kelso, J. A. S. (1995). Dynamic patterns: The self-organization of brain
and behavior. Cambridge, MA: MIT Press.
References
Kemp, S., & van der Krogt, C. D. (1985). Effect of visibility of the loci on
Bates, P. B., & Kliegl, R. (1992). Further testing of limits of cognitive recall using the method of loci. Bulletin of the Psychonomic Society, 23,
plasticity: Negative age differences in a mnemonic skill are robust. 202-204.
Developmental Psychology. 28, 121-125. Kliegl, R. (1995). From presentation time to processing time: A psycho-
656 VERHAEGHEN AND KLTEGL

physics approach to episodic memory. In W, Schneider & F. E. Weinert automatic control of behavior. In R. J. Davidson, G. E. Schwartz, & D.
(Eds.), Memory performance and competencies: Issues in growth and Shapiro (Eds.), Consciousness and self-regulation: Advances in re-
development (pp. 89-110). Mahwah, NJ: Erlbaum. search and theory (Vol. 4, pp. 1-18). New York: Plenum.
Kliegl, R-, & Baltes, P, B. (1987). Theory-guided analysis of mechanisms Roediger, R L. (1980). The effectiveness of four mnemonics in ordering
of development and aging through testing-the-limits and research on recall. Journal of Experimental Psychology: Human Learning and Mem-
expertise. In C. Schooler & K. W. Schaie (Eds.), Cognitive functioning ory, 6, 558-567.
and social structures over the life course (pp. 95-119). Norwood, NJ: Ross, J., & Lawrence, K. A. (1968). Some observations on memory
Ablex. artifice. Psychonomic Science, 13, 107-108.
Kliegl, R., Krampe, R., Mayr, U,, & Liebscher, T. (1998). Testing the limits Salthouse, T. A. (1991). Theoretical perspectives on cognitive aging.
and multinomial modeling of age differences in proactive Interference: Hillsdale, NJ: Erlbaum.
Evidence for a context encoding deficit. Manuscript submitted for pub- Salthouse, T. A. (1996). The processing-speed theory of adult age differ-
lication. ences in cognition. Psychological Review, 103, 403-428..
Kliegl, R., Mayr, U., & Krampe, R. T. (1994). Time-accuracy functions for van Geert, P. (1993). A dynamic systems model of cognitive growth:
determining process and person differences: An application to cognitive Competition and support under limited resource conditions. In L. B.
aging. Cognitive Psychology, 26, 134-164. Smith & E. Thelen (Eds.), A dynamic systems approach to development-
Kliegl, R., Smith, J., & Baltes, P. B. (1989). Testing-the-limits and the Applications (pp. 265-331). Cambridge, MA: Bradford.
study of adult age differences in cognitive plasticity of a mnemonic skill.
Verhaeghen, P. (1999). The effects of age-related slowing and working
Developmental Psychology, 25, 247-256.
memory on asymptotic recognition performance. Aging, Neuropsychol-
Kliegl, R., Smith, J., & Baltes, P. B. (1990). On the locus and process of
ogy, and Cognition, 6, 201-213.
magnification of age differences during mnemonic training. Develop-
Verhaeghen, P., Kliegl, R., & Mayr, U. (1997). Sequential and coordinative
mental Psychology, 26, 894-904.
complexity in time-accuracy function for mental arithmetic. Psychology
Labouvie-Vief, G. (1976). Toward optimizing cognitive competence in
and Aging, 12, 555-564.
later life. Educational Gerontology, 1, 75-92.
Verhaeghen, P., & Marcoen, A. (1994). Production deficiency hypothesis
Lee, S. -S., & Edwards, P. (1981). Retrieval of abstract nouns as a function
revisited: Adult age differences in strategy use as a function of process-
of mnemonic instructions and reading ability. Journal of Mental Imag-
ing resources. Aging and Cognition, I, 323-338.
ery, 5, 117-126.
Verhaeghen, P., & Marcoen, A. (1996). On the mechanisms of plasticity in
Levin, J. R. (1997). Overcoming feelings of powerlessness in "aging"
young and older adults after instruction in the method of loci: Evidence
researchers: A primer on statistical power in analysis of variance de-
for an amplification model. Psychology and Aging, 11, 164—178.
signs. Psychology and Aging, 12, 84-106.
Verhaeghen, P., Marcoen, A., & Goossens, L. (1992). Improving memory
Liu, Y. (1996). Queueing network modeling of elementary mental pro-
performance in the aged through mnemonic training: A meta-analytic
cesses. Psychological Review, 103, 116-136.
study. Psychology and Aging, 7, 242-251.
Lohman, D. F. (1989). Estimating individual differences in information
Verhaeghen, P., Marcoen, A., & Goossens, L. (1993). Facts and fiction
processing using speed-accuracy models. In R. Kanfer, P. L. Ackerman,
about memory aging: A quantitative integration of research findings.
& R. Cudeck (Eds.), Abilities, motivation, and methodology (pp. 119-
Journal of Gerontology: Psychological Sciences, 48, P157-P171.
163). Hillsdale, NJ: Erlbaum.
Mayr, U., Kliegl, R., & Krampe, R. (1996). Sequential and coordinative Verhaeghen, P., & Salthouse, T. A. (1997). Meta-analyses of age-cognition

processing dynamics in iigural transformation across the life span. relations in adulthood: Estimates of linear and non-linear age effects and

Cognition, 59, 61-90. structural models. Psychological Bulletin, 122, 231-249.


McClelland, J. L. (1979). On the time relations of mental processes: An Verhaeghen, P., Vandenbroucke, A., & Dierckx, V. (1998). Growing
examination of systems of processes in cascade. Psychological Review, slower and less accurate: The effects of age on time-accuracy functions
86, 287-330. for recall from episodic memory. Experimental Aging Research, 24,
McElree, B., & Griffith, T. (1995). Syntactic and thematic processing in 3-19.
sentence comprehension: Evidence for a temporal dissociation. Journal Wickelgren, W. A. (1977). Speed-accuracy tradeoff and information pro-
of Experimental Psychology: teaming, Memory, and Cognition, 27, cessing dynamics. Acta Psychologica, 41, 67-85.
134-157. Wingfield, A., & Stine-Morrow, E. A. L. (2000). Language and speech. In
Myerson, J., Hale, S., Wagstaff, D., Poon, L. W., & Smith, G. A. (1990). F. I. M. Craik & T. A. Salthouse (Eds.), The handbook of aging and
The information-loss model: A mathematical theory of age-related cog- cognition (2nd ed., pp. 359-416). Mahwah, NJ: Erlbaum.
nitive slowing. Psychological Review, 97, 475-487.
Newell, A., & Rosenbloom, P. S. (1981). Mechanisms of skill acquisition
and the law of practice. In J. R. Anderson (Ed.), Cognitive skills and Received July 21, 1998
their acquisition (pp. 1-56). Hillsdale, NJ: Erlbaum. Revision received March 27, 2000
Norman, D. A., & Shallice. T. (1986). Attention to action: Willed and Accepted March 28, 2000 •

You might also like