Semantic Activation in Parkinson's Disease Patients On and Off Levodopa

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 10

cortex 45 (2009) 950–959

available at www.sciencedirect.com

journal homepage: www.elsevier.com/locate/cortex

Special issue: Original article

Semantic activation in Parkinson’s disease patients


on and off levodopa

Anthony J. Angwina,*, Wendy L. Arnotta, David A. Coplanda, Miriam P.L. Hairea,


Bruce E. Murdocha, Peter A. Silburna,b and Helen J. Chenerya
a
Centre for Research in Language Processing and Linguistics, The University of Queensland, Brisbane, Australia
b
School of Medicine, The University of Queensland, Brisbane, Australia

article info abstract

Article history: Research suggests that dopamine may exert a neuromodulatory influence on automatic
Received 14 April 2008 spreading activation within semantic networks. In order to investigate the influence of
Reviewed 1 August 2008 dopamine depletion on semantic activation in Parkinson’s disease (PD), nine patients with
Revised 6 November 2008 PD performed a lexical decision task when on and off levodopa medication. Eleven healthy
Accepted 16 February 2009 controls matched to the PD patients in terms of sex, age and education also participated in
Published online 11 March 2009 the study. Both directly related word pairs (e.g., tiger – stripe) and indirectly related word
pairs (word pairs related via a mediating word, e.g., chalk – black) were used to measure
Keywords: semantic activation across stimulus onset asynchronies (SOAs) of 270 msec, 520 msec and
Dopamine 1020 msec. Analysis of variance statistics revealed that the activation of directly related
Language and indirectly related targets was slower for the PD group relative to the control group.
Parkinson’s disease Within group comparisons revealed further changes to semantic activation in PD patients
Semantic priming off medication, with no activation of directly or indirectly related target words evident in
Spreading activation PD patients off medication. These results further clarify the nature of dopamine’s neuro-
modulatory influence on semantic activation, and suggest that the nature of altered
semantic activation in PD may depend on the magnitude of dopamine depletion.
ª 2009 Elsevier Srl. All rights reserved.

1. Introduction Randolph et al., 1993). While the results of emerging research


have indicated that semantic processing deficits in PD may be
Parkinson’s disease (PD) is characterized by degeneration of related to alterations in dopaminergic transmission (Gross-
the nigrostriatal dopaminergic system (Mink, 1996) and in man et al., 2002; Watters and Patel, 1999, 2002), the precise
addition to movement disorders, subtle language processing nature of dopamine’s influence on semantic processing
deficits are a frequently reported feature of the disease. There currently remains unclear. The objective of the present study
is currently substantial evidence to suggest that even in the was to use online semantic priming tasks to delineate the
absence of overt dementia, many patients with PD exhibit impact of dopamine depletion in PD on semantic activation.
deficits in lexical-semantic processing (Bayles et al., 1993; Semantic priming refers to the faster recognition of a target
Gurd, 1996, 2000; Lewis et al., 1998; Portin et al., 2000; word when it is preceded by a related prime word (tiger – stripe)

* Corresponding author. Centre for Research in Language Processing and Linguistics, Division of Speech Pathology, The University of
Queensland, Brisbane, QLD 4072, Australia.
E-mail address: a.angwin@uq.edu.au (A.J. Angwin).
0010-9452/$ – see front matter ª 2009 Elsevier Srl. All rights reserved.
doi:10.1016/j.cortex.2009.02.012
cortex 45 (2009) 950–959 951

compared to an unrelated word (table - stripe). These semantic may be expected that striatal dopamine depletion in PD will
priming effects have often been attributed to automatic result in a pattern of semantic activation opposite to that
spreading activation (Collins and Loftus, 1975; Neely, 1977; observed in healthy participants on levodopa. Specifically,
Posner and Snyder, 1975). Spreading activation theories are dopamine depletion may be expected to slow the spread of
based on the assumption that concepts form an inter- activation to both direct and indirect semantic relations, such
connected semantic network, with semantically/associatively that direct and indirect priming effects are only evident at
related concepts stored closer together. It is thought that the longer SOAs. Alternatively, dopamine depletion may also be
processing of a prime word induces a temporary spreading of expected to lead to unfocused activation within semantic
activation that lowers the activation thresholds of related networks, such that spreading activation to indirectly related
target words. Thus, by varying the stimulus onset asynchrony concepts will be increased.
(SOA) between presentation of a prime and target, it is possible Some researchers have observed delayed semantic activa-
to measure the temporal window over which activation occurs. tion in patients with PD (Angwin et al., 2005; Arnott et al., 2001),
Spreading activation theories also assume that activation providing support for the influence of dopamine on the speed
dissipates with increasing distance within the semantic of semantic activation. More importantly, research has also
network. Thus, while activation of directly related targets (e.g., demonstrated that such delays do not occur in an all-or-none
tiger – stripe) will typically occur in a semantic priming task, manner, but occur along a continuum. For instance, Grossman
activation may also, to a lesser extent, spread to target words et al. (2002) found a normal pattern of semantic activation in
that are only indirectly related to the prime (e.g., lion – stripe, a subgroup of PD participants with intact sentence compre-
are only related via the mediating word ‘tiger’). Indeed, hension skills, whilst delayed semantic activation was evident
researchers have revealed significant semantic priming effects in a subgroup of participants with poor comprehension skills.
for both direct and indirect semantic relations in healthy adults In contrast, Angwin et al. (2007) found delayed semantic acti-
(Angwin et al., 2004; Arnott et al., 2003; Hill et al., 2002; Weis- vation both in PD patients with good and poor sentence
brod et al., 1999), with some researchers also illustrating faster comprehension skills, but the magnitude of the delay was
lexical decisions to directly related compared to indirectly larger in those patients with poor comprehension skills.
related targets (Hill et al., 2002; Weisbrod et al., 1999). Grossman et al. (2002) has suggested that the magnitude of
Accordingly, manipulating both SOA and relatedness cognitive slowing in PD, which may be manifest as delayed
(direct/indirect) in semantic priming tasks may represent lexical retrieval, could be dependent on the extent of disruption
a comprehensive method of identifying the manner in which to the dopamine dependent frontal–striatal circuitry. Accord-
dopamine depletion in PD influences semantic processing. ingly, Grossman et al. suggested that delays in semantic acti-
Certainly, the potential neuromodulatory influence of dopa- vation may only be evident in PD patients with more
mine on semantic processing is already well recognized. substantial levels of dopamine depletion. This suggestion is
Kischka et al. (1996) measured direct and indirect semantic also consistent with other research that has suggested that the
priming effects in healthy participants who had ingested striatum plays a key role in the modulation of information
either a levodopa or placebo capsule. The results revealed processing speed (Harrington et al., 1998; Poldrack et al., 2001;
reduced indirect semantic priming in the participants who Schubotz et al., 2000).
ingested levodopa, which the researchers suggested was Since the extent of dopamine depletion may differ mark-
consistent with a dopamine-induced focusing of activation edly across individuals with PD, comparisons of semantic
within semantic networks. Similarly, Copland et al. (2003) priming in the same group of PD patients when on versus off
found that the ingestion of levodopa by healthy participants dopaminergic supplementation may provide additional
caused a focusing of activation and a dampening of weaker insight into the influence of dopamine on semantic process-
associations. ing. When on dopaminergic therapy such as levodopa, dopa-
In contrast, in another investigation of semantic priming in mine deficiency in PD should be temporarily replenished (but
healthy participants who ingested levodopa, the results were see Cools et al., 2003), whilst dopamine levels will decline
not consistent with a focusing of activation (Angwin et al., when patients are off levodopa. To date, only a small number
2004). Instead, the results suggested that the onset and decay of studies have investigated semantic priming in PD patients
of activation to both directly and indirectly related targets was both on and off levodopa. Murdoch et al. (2000) and Arnott
occurring more quickly for participants who ingested levo- et al. (2000) observed a negative priming effect (i.e., faster
dopa. These results suggested that dopamine may also be reaction times to unrelated than related target words) in PD
capable of altering the speed of activation and decay within patients with mild to moderate PD when off medication,
semantic networks. Specifically, Angwin et al. (2004) sug- which Arnott et al. (2000) interpreted within the framework of
gested that by increasing the signal-to-noise ratio of infor- the center-surround theory of inhibition (Carr and Dagenbach,
mation processing, dopamine may speed processing of the 1990). This theory postulates that when difficulty retrieving
prime word, leading to a faster onset and decay of semantic semantic information about a prime word is encountered, the
activation rather than a focusing of activation. Such findings activation of semantic concepts closely related to the prime
suggest that a hyperdopaminergic state will result in the may be inhibited in order to prevent them from blocking the
presence of both direct and indirect priming at short SOAs, but retrieval attempt. Accordingly, Arnott et al. suggested that due
the absence of such priming effects at longer SOAs. to weakened activation of the prime and/or increased noise
Based on this semantic priming research, there is within semantic networks in PD patients off levodopa,
mounting evidence to suggest that dopamine may exert concepts semantically related to the prime word become
a neuromodulatory influence on semantic activation. Thus, it inhibited and a negative priming effect is obtained. Angwin
952 cortex 45 (2009) 950–959

et al. (2006) also investigated semantic priming in people with necessary in order to determine whether priming effects
mild to moderate PD, and whilst they failed to observe nega- reflect automatic or controlled processes.
tive priming effects in PD patients off levodopa, they did find The aim of the present research was to measure automatic
that semantic priming was more susceptible to disruption semantic activation across time in PD patients (both on and
when an unrelated word was presented between a related off levodopa medication) and healthy controls using
prime and the target word. Angwin et al. suggested that such a semantic priming task with three SOAs (270 msec, 520 msec
results could also potentially be explained by weakened acti- and 1020 msec) and four prime conditions (directly related,
vation of the prime word, which makes semantic priming indirectly related, neutral and unrelated). Although strategic
more susceptible to disruption. processing is typically observed at longer SOAs, the three
Taken together, therefore, the results of semantic priming SOAs from 270 msec to 1020 msec were chosen in order to
studies in PD have suggested that dopamine depletion can explore the temporal aspects of semantic activation similar to
induce both a slowing of automatic semantic activation as that implemented in previous research (Angwin et al., 2005,
well as weaker or unfocussed activation within semantic 2007). Further, a masked prime word was utilised in order to
networks. Importantly, weaker or unfocussed activation only minimise the potential influence of such strategic processes.
appears to be evident under conditions of medication with- For healthy controls subjects, it was predicted that acti-
drawal in PD, suggesting that the nature of altered semantic vation of directly and indirectly related concepts would be
activation in PD may differ as a function of the magnitude of evident at both the 270 msec and 520 msec SOAs. It was
dopamine depletion. Specifically, whilst dopamine depletion further predicted that no activation would be evident at
may initially lead to slowed activation, semantic activation 1020 msec SOA for the healthy control group, consistent with
may become progressively unfocussed as the magnitude of the decay in automatic semantic activation for healthy adults
dopamine depletion increases. Whilst there is evidence to (Stern et al., 1991). In contrast, it was hypothesized that
suggest that such unfocussed activation may lead to negative dopamine depletion would result in alterations to automatic
priming effects (Arnott et al., 2000; Murdoch et al., 2000), it is semantic activation for the PD group. For the PD group on
still unclear whether unfocussed activation may also lead to medication, it was predicted that the activation of directly and
increased spreading activation to distantly related concepts. indirectly related concepts would not emerge until the
Increased spreading activation in PD would be predicted based 520 msec SOA, and that this activation would persist across
on previous findings of reduced indirect priming effects in the 1020 msec SOA, consistent with suggestions of a delayed
healthy adults on levodopa (Kischka et al., 1996). time course of semantic activation in PD (Angwin et al., 2007;
The present study seeks to provide further insight into the Arnott et al., 2001; Grossman et al., 2002). For PD patients
dopaminergic changes to automatic semantic activation in tested whilst off medication, it was predicted that the
PD, by combining measures of direct and indirect semantic increased magnitude of dopamine depletion would lead to
activation across time with the testing of PD patients both on further disruptions to semantic priming due to an unfocussed
and off levodopa. Attempts to measure automatic semantic or weaker activation of the prime word. Specifically, it was
activation, however, are often confounded by the influence of predicted that testing PD patients off levodopa would result in
conscious or attention-based processes. For instance, pre- either increased activation of indirectly related concepts (as
lexical expectancies and/or post-lexical semantic matching evidenced by an increased magnitude of indirect priming) or
strategies may influence semantic priming effects, particu- that negative priming effects would emerge.
larly under experimental conditions where longer SOAs are
used and/or when a high proportion of nonwords or related
word pairs are used (Neely, 1991; Neely et al., 1989). To facili-
tate automatic semantic activation and to reduce the influ- 2. Method
ence of attentional confounds on semantic priming, the use of
a pattern mask after the prime word will be implemented in 2.1. Participants
the present study. By presenting a prime word only briefly
(e.g., 80 msec) with a pattern mask presented (e.g., a random Nine participants with idiopathic PD (diagnosis confirmed by
series of letters) after the prime, a participant’s awareness of a neurologist using Calne et al.’s (1992) criteria for diagnosing
the prime may be lowered and the impact of conscious or PD) and 11 non-neurologically impaired control participants
attention-based processing on the lexical decision may be comprised the study’s two participant groups. All participants
reduced. Recently, significant semantic priming effects have were right-handed, native speakers of English with no history
been successfully obtained with the use of masking tech- of neurological surgery, drug or alcohol abuse, or dementia,
niques (Deacon et al., 2000; Ruz et al., 2003). The use of and were not taking any anti-depressive or anti-cholinergic
a neutral priming condition will also be implemented in the medications. The PD group had a mean age of 66.89 years
present study. It has been well established that while auto- [Standard deviation (SD) 7.08] and mean education of 13.44
matic semantic priming results in facilitation (defined as years (SD 5.18), whilst the control group had a mean age of
significantly faster RTs to related target words relative to 66.45 years (SD 9.74) and mean education of 11.82 years (SD
neutral target words), strategic or controlled processing can 2.79). Prior to the commencement of testing, the cognitive
result in both facilitation as well as inhibition (defined as status of all participants was assessed using the Dementia
significantly slower RTs to unrelated target words relative to Rating Scale (DRS) (Mattis, 1988). The mean DRS score was
neutral target words) (Neely, 1977). Hence, the inclusion of 140.11 (SD 3.33) for the PD group and 141.36 (SD 2.16) for the
a neutral prime to measure facilitation and inhibition is control group. Mann–Whitney U tests revealed that the mean
cortex 45 (2009) 950–959 953

age, education and DRS score was not significantly different 3) Neutral relation (e.g., blank – pills)
between the two groups. 4) Unrelated (e.g., organ–swamp).
The PD group had a mean disease duration of 3.67 years (SD
2.06, range 1–8) and a mean age at onset of 63.33 years (SD 7.66, The directly related and indirectly related word pairs were
range 45–68). Hoehn and Yahr scores (Hoehn and Yahr, 1967) derived mainly from stimulus materials used by Balota and
were used to classify the disease severity of the PD patients, with Lorch (1986) and DeGroot (1983), which were derived from
a mean score of 2.22 (SD .51). The predominant symptom was association norms. All related stimulus materials held an
tremor for 4 patients and bradykinesia for 1 patient, while the obvious semantic relationship (e.g., tiger – stripes), and did not
remaining 4 patients experienced predominant symptoms of form compound words (e.g., maple – syrup, bus – stop) or
both tremor and bradykinesia. All PD patients were taking levo- reflect associatively related words without semantic related-
dopa (i.e., Madopar/Sinemet) with a mean daily dosage of ness (e.g., cottage – cheese). In addition to these stimulus
423.61 mg (SD 185.03), while two patients were also taking the materials, an additional 3 directly related word pairs and 4
dopamine agonist cabergoline (Cabaser) (range 1–2 mg). Two of indirectly related word pairs were created. To validate these
the PD patients also experienced a predictable ‘wearing off’ effect additional word pairs, 20 undergraduate students (13 females,
associated with their levodopa medication, such that motor 7 males) were asked to produce associates to the direct and
symptoms typically increased approximately 3–4 h after dosage. indirect prime words. The results from this task indicated that
The experimental tasks were administered to all partici- participants produced the target word as an associate to the
pants as a subcomponent of a larger battery of tests. Specifi- direct primes but did not produce the target word as an
cally, during each testing session, all participants performed associate to the indirect primes. The majority of words used
an additional two semantic priming tasks that were unrelated were nouns, however, some verbs and adjectives were also
to the present study and which utilized different stimuli and used. Specifically, of the 48 critical stimuli, 46 of the prime
conditions to those used in the present study. PD participants words were nouns, with 1 adjective and 1 verb also used. The
were tested at their homes in both an on and an off medica- neutral prime word was always the word ‘blank’. Target word
tion state. During the on medication testing sessions, care was stimuli consisted of 37 nouns, with 4 adjectives and 7 verbs
taken to ensure that PD participants were achieving also used. All prime words for the unrelated and nonword
maximum clinical benefit from their medication at the time of targets were matched to the average frequency and syllable
testing. Therefore, testing of the PD group was conducted length of the related word primes.
approximately 45 min after dosage. In order to avoid testing To avoid repetition of target words, different targets were
during a person’s ‘wearing off’ phase, all participants were used for each prime condition. In order to achieve this,
requested to report to the researcher if they felt that their different target words were chosen for the neutral and unre-
medication was wearing off, so that testing could be ceased. In lated conditions, matched to the frequency (Kucera and
addition, the PD group performed the Unified Parkinson’s Francis, 1967) and syllable length of the target words in the
Disease Rating Scale (UPDRS) (Fahn et al., 1987) finger tap related conditions. To validate the use of these different target
subtest at 30 min intervals throughout each testing session. words, mean lexical decision reaction times (RTs) for each
This short test required participants to tap their index finger target word were obtained from the database of the English
and thumb together as rapidly as possible for 5 sec, each hand Lexicon Project (Balota et al., 2002). ANOVA statistics revealed
being assessed separately. A score between 0 (normal no significant main effect of target word type (i.e., direct,
performance) and 4 (barely able to perform task) was then indirect, neutral, unrelated) on RT ( p ¼ .238). Finally, all
calculated. Since the effects of medication ‘wearing off’ are nonword targets were developed by changing one to three
associated with reduced mobility, testing could be ceased if phonemes in an existing English word, which was matched in
a participant’s UPDRS score increased during any one testing frequency and syllable length to the real target words. Twelve
session. During the course of data collection, however, no of the nonwords were preceded by the neutral prime ‘blank’
testing session was ceased. The off medication sessions were and 36 by a standard word prime.
conducted before patients had taken their first morning dose The same stimulus list was used for each SOA, but the
of medication, such that they had been without dopaminergic order of presentation of word pairs was randomised for each
medication for at least 12 h. SOA and participant. The order in which participants per-
formed the experiments (i.e., 270 msec, 520 msec or 1020 msec
2.2. Stimuli SOA) was counterbalanced, and each experiment was
completed during a different testing session held at least two
A stimulus set consisting of 96 prime – target pairs was weeks apart to reduce the influence of repeated exposure to
assembled, with the same stimulus set used for each SOA. the same stimuli. However, repetition of stimuli (i.e., first,
Whilst the prime word was always a real English word, half second or third exposure to the stimuli) was also factored into
the target words were real words and half the target words statistical analyses in order to determine whether this influ-
were pronounceable nonwords. Four different types of prime enced priming or facilitation effects. Testing sessions for PD
preceded the real word targets, with 12 items in each of these patients off levodopa did not commence until at least 4 weeks
prime conditions. Examples of each condition were as follows: after completion of the on levodopa testing sessions. All
stimuli were presented using Superlab experimental software
1) Direct Semantic Relation (e.g., tiger – stripes) (Version 2.0) (Cedrus, 1996), which measured participant’s RTs
2) Indirect Semantic Relation (e.g., chalk – black; via the via a Cedrus RB-420 response pad (accurate to within 1 msec)
mediating word white) and collected all error and RT data automatically. Button 2 on
954 cortex 45 (2009) 950–959

a 4-button response pad was marked with the word ‘Yes’ and blank screen
button 3 was marked with the word ‘No’.

prime
2.3. Procedure

Participants were informed that a word would appear very flower mask
2000 ms
quickly in the centre of the screen, which they may or may not
recognise, followed by a second word. They were asked to blank screen
Prime = 80 ms hsibk
make a lexical decision to the second word as quickly as
possible, by pressing the ‘Yes’ button if it was a real word and
target
pressing the ‘No’ button if it was a nonword. Experimental Backward
stimuli were presented to participants via 3 blocks of 32 trials, Mask = 190 ms
with an opportunity to rest provided to participants following rose
the completion of each block. Participants were also reminded 0 ms, 250 ms
during rest breaks, that they should make lexical decisions to or 750 ms

the target words as quickly as possible. A practice block,


consisting of 12 word pair trials similar to those in the
experiment proper, was given to each participant to allow Fig. 1 – An illustration of the procedure used for a typical
familiarisation with the procedure prior to the commence- trial during the lexical decision task.
ment of testing. The practice set given always featured the
same SOA as the experiment it preceded, and participants
were told that they were free to repeat the practice block until
they felt comfortable with the testing procedure. All testing were conducted on the RT data to compare the control group
was conducted using a portable laptop computer, with the to the PD group on medication, and to compare the PD group
participant seated approximately 50 cm from the computer on and off medication.
monitor.
All stimuli were written in lower case letters of 75 point 3.1. Controls versus PD on medication
Arial font. The sequence of events during both the practice
trials and experimental trials was as follows: (a) a blank screen Individual participant RTs were entered into a mixed linear
was presented for 2000 msec; (b) the prime word was pre- model analysis with subject as a random factor, group (control,
sented in the center of the screen for 80 msec; (c) a backward PD) as a between subjects factor, and SOA (270 msec, 520 msec,
mask consisting of 5 letters (hsibk) was then presented in the 1020 msec) prime (direct, indirect, neutral, unrelated) and
center of the screen for 190 msec; (d) the target word would repetition (first, second or third exposure to stimuli) as within
then be presented either immediately following the mask subject factors. The results revealed significant main effects of
(SOA 1 ¼ 270 msec), or would follow a 250 msec presentation SOA and prime [F(2,2376) ¼ 12.81, p < .001 and F(3,2359) ¼ 8.76,
of a blank screen (SOA 2 ¼ 520 msec) or a 750 msec presenta- p < .001, respectively] and an interaction effect of group  SOA
tion of a blank screen (SOA 3 ¼ 1020 msec). This target word [F(2,2376) ¼ 31.97, p < .001]. Although there was also a signifi-
was presented in the centre of the screen until the participant cant main effect of repetition [F(2,2376) ¼ 20.22, p < .001],
either gave a response, or until 3000 msec had passed with no together with interaction effects of group  repetition, SOA 
response. The following trial then began automatically. repetition, and group  SOA  repetition [F(2,2376) ¼ 7.10, p ¼
Figure 1 illustrates the procedure used for a typical trial. .001; F(4,1687) ¼ 30.00, p < .001; and F(4,1687) ¼ 7.69, p < .001,
respectively], there were no interactions between repetition and
prime, illustrating that repeated exposure to stimuli did not have
3. Results an influence on the magnitude of priming/facilitation effects for
either group.
Only RTs for the critical trials were analysed. All participant While the main and interaction effects are provided for
errors and all RTs less than 200 msec or greater than descriptive purposes, the data provided therein do not test
1500 msec were removed from analyses. Following the explicitly the hypotheses being considered (i.e., whether there
removal of this data, individual and group outliers (defined as was a differential pattern of activation between the two
any RT more than two SDs above or below the mean) were also groups for directly and indirectly related concepts across
excluded from analyses. This process resulted in the exclu- time). Consequently, of particular interest in this experiment
sion of more than 25% of the data for one of the control were the priming/facilitation effects for the direct and indirect
participants, whose data was subsequently excluded from all conditions at each SOA. Overall priming effects were analysed
remaining analyses. With this participant’s data excluded, the separately for each group and SOA, therefore, by way of
removal of errors and all RT outliers resulted in the removal of planned pairwise comparisons between the related prime
10.66% of the remaining data set. Table 1 displays the conditions (direct, indirect) and the unrelated condition.
percentage accuracy for each group and for each prime Pairwise comparisons were also made between related and
condition. Due to the low percentage of errors, no analyses neutral prime conditions for the analysis of direct and indirect
were conducted on the error data. Table 2 displays the mean facilitation effects, and between unrelated and neutral prime
RTs for each group and for each condition. Separate analyses conditions for the analysis of inhibition effects. These
cortex 45 (2009) 950–959 955

Table 1 – Mean accuracy (%) for the control group and the PD group on and off medication as a function of SOA and prime
condition
Group

Prime condition Control SOA PD on SOA PD off SOA

270 520 1020 270 520 1020 270 520 1020

Direct 99.17 100.00 99.17 99.07 96.30 96.30 99.07 100.00 99.07
Indirect 100.00 99.17 100.00 94.44 96.30 98.15 97.22 96.30 98.15
Neutral 99.17 99.17 98.33 98.15 96.30 99.07 99.07 99.07 100.00
Unrelated 100.00 100.00 99.17 100.00 99.07 98.15 99.07 98.15 99.07

comparisons were conducted using additional mixed linear whilst an interaction effect of group  prime was just outside
model analyses. significance [F(3,2221) ¼ 2.35, p ¼ .071]. There was also a signifi-
Analysis of the control group’s data revealed significant cant main effect of repetition [F(2,221) ¼ 9.00, p < .001], together
direct and indirect priming effects at the 270 msec SOA with interaction effects of group  repetition, SOA  repetition,
[t(2407) ¼ 2.38, p ¼ .017; and t(2407) ¼ 2.04, p ¼ .042, respec- and group  SOA  repetition [F(2,2221) ¼ 10.37, p < .001;
tively], together with significant direct and indirect facilitation F(4,2216) ¼ 3.04, p ¼ .017; and F(4,2176) ¼ 5.21, p < .001, respec-
effects at 270 msec SOA [t(2407) ¼ 2.34, p ¼ .019; and tively]. No interactions between repetition and prime were
t(2407) ¼ 2.00, p ¼ .046, respectively]. Similarly, analyses significant.
revealed significant direct and indirect priming effects for the Priming and facilitation effects were then analysed for the
control group at 520 msec SOA [t(2407) ¼ 2.86, p ¼ .004; and PD group off medication by way of separate planned pairwise
t(2407) ¼ 2.08, p ¼ .037, respectively], and significant direct comparisons between the related prime conditions and the
facilitation effects [t(2407) ¼ 2.51, p ¼ .012]. No priming or unrelated or neutral condition at each SOA, using additional
facilitation effects were significant for the control group at mixed linear model analyses. Whilst no significant priming or
1020 msec SOA. facilitation effects were evident, a negative direct priming
In contrast, analysis of the PD on group’s data revealed effect (i.e., RTs to the directly related target words were slower
significant direct and indirect facilitation effects at 520 msec than RTs to unrelated target words) at 520 msec SOA was just
SOA [t(2407) ¼ 2.59, p ¼ .010; and t(2407) ¼ 2.83, p ¼ .005, outside significance [t(2269) ¼ 1.93, p ¼ .054]. Additionally,
respectively] and significant indirect priming and facilitation comparisons between unrelated and neutral conditions
effects at 1020 msec SOA [t(2407) ¼ 2.20, p ¼ .028; and revealed that RTs in the neutral condition were significantly
t(2407) ¼ 2.24, p ¼ .025, respectively]. Comparisons between slower than RTs in the unrelated condition at 520 msec SOA
RTs for the unrelated and neutral prime conditions for the [t(2269) ¼ 2.04, p ¼ .041].
analysis of inhibition effects were not significant for either
group at any SOA.

4. Discussion
3.2. PD on versus off medication
Using measures of both direct and indirect priming across
Individual participant RTs were entered into a mixed linear multiple SOAs, the present study investigated semantic acti-
model analysis with subject as a random factor and medication vation in PD patients on and off levodopa and in healthy
(on, off), SOA, prime and repetition as within subject factors. control participants. It was hypothesised that dopamine
The results revealed significant main effects of group and SOA depletion in PD would modulate spreading activation within
[F(1,2221) ¼ 6.29, p ¼ .012; F(2,2221) ¼ 33.05, p < .001, respectively] semantic networks, altering patterns of activation for directly

Table 2 – Mean RTs in msec for the control group and the PD group on and off medication as a function of SOA and prime
condition
Group

Prime condition Control SOA PD on SOA PD off SOA

270 520 1020 270 520 1020 270 520 1020

Direct 627 (75) 661 (99) 646 (104) 735 (131) 684 (120) 706 (109) 759 (148) 715 (127) 707 (139)
Indirect 631 (81) 670 (90) 638 (102) 743 (128) 685 (132) 700 (120) 752 (133) 705 (127) 705 (131)
Neutral 661 (97) 689 (107) 648 (91) 756 (154) 723 (145) 729 (139) 757 (138) 718 (126) 700 (143)
Unrelated 660 (80) 698 (105) 653 (94) 745 (134) 698 (114) 725 (132) 753 (130) 691 (125) 710 (129)

Note. Standard deviations in brackets.


956 cortex 45 (2009) 950–959

and indirectly related concepts over time. As anticipated, a delayed time course of semantic activation in PD (Angwin
a differential pattern of direct and indirect priming/facilita- et al., 2007; Arnott et al., 2001; Grossman et al., 2002).
tion was observed across time for the PD group on levodopa Given the striatal dopamine depletion evident in PD, these
compared to controls. In particular, semantic activation of results provide direct support for proposals that dopamine
direct and indirect targets emerged later in the PD group. Such exerts a neuromodulatory influence on the speed of semantic
findings may be consistent with suggestions that dopamine activation (Angwin et al., 2004) and that the functioning of the
alters the speed of semantic activation (Angwin et al., 2004; dopamine dependent frontal–striatal–thalamic system influ-
Grossman et al., 2002). Within group comparisons also ences such processes (Grossman et al., 2002). The fact that
revealed an absence of any priming effects in the PD group off delayed semantic activation was evident even in patients
medication, although a negative direct priming effect was tested while on medication is consistent with suggestions that
almost significant. The findings of the present study are dis- cognitive slowing in PD is not ameliorated by dopaminergic
cussed in terms of the potential neuromodulatory influences treatment (Johnson et al., 2004). Further, such changes to the
of dopamine on semantic activation. speed of activation may also contribute to PD patients’ poor
performance on other tests of semantic processing such as
4.1. Semantic activation in controls verbal fluency, which researchers have suggested may be
related to deficits in semantic retrieval (Randolph et al., 1993;
The control group showed direct semantic priming/facilita- Raskin et al., 1992).
tion effects at both the 270 and 520 msec SOAs, with no Recent findings have indicated that delayed semantic
priming/facilitation evident at 1020 msec SOA. It has been activation may only be evident in a subset of PD patients
shown that automatic semantic activation typically decays in (Angwin et al., 2005; Grossman et al., 2002), and that delays to
healthy older adults approximately 1000 msec following semantic activation may be more severe in some PD patients
presentation of the prime word (Stern et al., 1991). Therefore, relative to others (Angwin et al., 2007). Such findings have
this pattern of direct facilitation that only persists until been attributed to the magnitude of endogenous dopamine
520 msec, together with the absence of inhibition effects, is depletion and subsequent disruption to the frontal–striatal–
consistent with the notion of automatic semantic activation thalamic system in PD (Grossman et al., 2002). Hence, the
and suggests that the masked priming paradigm implemented results of the present study indicate that even in mild to
in the present study successfully reduced the influence of moderate PD, the magnitude of frontal–striatal dysfunction
conscious processing on semantic priming. In contrast to the may be sufficient to slow the speed of semantic activation. It
pattern of direct facilitation, indirect priming/facilitation may also be expected that delays to semantic activation will
effects were evident at the 270 msec SOA, but indirect facili- become longer for an individual with PD as the magnitude of
tation effects were absent at both the 520 msec and 1020 msec dopamine depletion increases.
SOAs suggesting that automatic activation of indirectly Research has also demonstrated that the profile of
related concepts had decayed by 520 msec. Although this cognitive dysfunction in PD may be a function of a complex
absence of indirect facilitation at 520 msec SOA was unex- relationship between the side of disease onset and the
pected, it has been suggested that while direct semantic initial motor symptom (Katzen et al., 2006). Accordingly,
priming effects are robust, indirect semantic priming is future studies with a larger number of participants might
sensitive to both the experimental condition (Hill et al., 2002) consider exploring whether variable patterns of direct and
as well as individual differences in language abilities (Moritz indirect activation are evident in different subgroups of PD
et al., 1999). Hence, factors such as the use of a masked patients, and whether these patterns can be linked to
priming paradigm and/or the older age of participants in the disease related variables such as side of onset and initial
present study may have contributed to the finding of no motor symptom.
indirect facilitation at 520 msec SOA. Overall, the pattern of Also worthy of note is that whilst indirect facilitation was
facilitation for the control group appears consistent with only evident for the control group at 270 msec SOA, indirect
automatic semantic activation at each SOA, providing a valid facilitation effects were significant at both the 520 msec and
baseline against which to compare semantic priming in the PD 1020 msec SOAs for the PD group. This result suggests that the
group. activation of indirectly related target words was maintained
for a longer period of time in PD participants relative to
4.2. Semantic activation in PD patients on levodopa healthy controls. The finding of significant indirect facilitation
at 1020 msec SOA in the PD group also highlights the potential
For PD patients on levodopa, it was predicted that the acti- value of investigating semantic activation in neurologically
vation of directly and indirectly related concepts would first impaired populations using both directly and indirectly
emerge at the 520 msec SOA, and that this activation would related stimuli. If measures of only direct priming had been
persist across the 1020 msec SOA. This hypothesis was sup- used, the results would have given the false impression that
ported by the results, with the absence of any priming/facili- semantic activation was only present for the PD group at
tation effects at 270 msec SOA, but significant direct and 520 msec SOA (as evidenced by the significant direct facilita-
indirect facilitation effects at 520 msec SOA and significant tion effect). Instead, the use of indirectly related stimuli in the
indirect facilitation effects at the 1020 msec SOA. These present study revealed further alterations to semantic acti-
results suggest that directly and indirectly related targets vation at the longest SOA. Hence, indirectly related stimuli
were activated more slowly for the PD group relative to the may be a useful and sensitive measure of automatic semantic
control group, and so are in keeping with previous findings of activation, and researchers should consider measuring both
cortex 45 (2009) 950–959 957

direct and indirect semantic priming in future studies within medication withdrawal in PD may be conceptualized as an
this field. The following discussion will now focus upon the increase in background activity within the semantic
pattern of semantic priming observed in PD patients off network, such that activation of the prime word may be
levodopa. obscured by increased activation of other semantic concepts.
As a result, suppression of related nodes may help stabilize
4.3. Semantic activation in PD patients off levodopa activation of the prime word in the presence of increased
background semantic activity, leading to negative priming
Within group comparisons did reveal a different pattern of effects. It should be noted, however, that there was no
priming/facilitation for PD patients off, relative to on, levo- evidence of negative priming effects for the indirect condi-
dopa. While on levodopa, the PD group demonstrated signifi- tion (Table 2), suggesting that inhibition within semantic
cant direct and indirect facilitation at 520 msec SOA, followed networks in PD may be spatially constrained to concepts
by the emergence of indirect facilitation at the longest SOA. In closely related to the prime word.
contrast, no significant priming or facilitation effects were Based on findings of more focused semantic activation in
evident for the PD group off medication at any SOA. healthy adults on levodopa (Kischka et al., 1996), it was also
It should be noted, however, that a negative direct hypothesized that dopamine depletion in PD would lead to an
priming effect almost reached significance at 520 msec SOA, increased spread of activation to indirectly related concepts.
which is in keeping with our hypotheses and with the find- However, there was no evidence of increased indirect priming
ings of previous research measuring semantic priming in PD effects in PD patients on or off levodopa in the present study.
patients off medication at similar SOAs (Arnott et al., 2000; These findings suggest that unfocussed activation during
Murdoch et al., 2000). Also worthy of note is that this nega- dopamine depletion does not lead to increased spreading
tive priming effect is not associated with decreased task activation in semantic networks, but rather leads to a weak-
accuracy (Table 1). Hence, the mechanism responsible for ening of the prime signal and the subsequent emergence of
negative priming effects in PD does not influence the ability negative priming effects.
to make a correct lexical decision, but rather distracts or As discussed earlier, Katzen et al. (2006) have suggested
slows participants’ task performance. As suggested by Arnott that there is an intricate relationship between side of disease
et al. (2000), such results may potentially be interpreted onset and type of motor symptom, which may subsequently
within the context of the centre-surround theory of inhibi- influence the extent of cognitive dysfunction in PD. Similarly,
tion (Carr and Dagenbach, 1990). Carr and Dagenbach (1990) it is possible that the extent of cognitive dysfunction during
proposed that when difficulty retrieving semantic informa- medication withdrawal will also be influenced by such vari-
tion about a prime word is encountered (e.g., during masked ables. Hence, the nature and extent of any alterations to
priming), participants might direct attention towards the semantic activation during medication withdrawal in PD may
meaning of the prime. It was further proposed that this depend on specific symptomatic variables and the subsequent
attention causes an automatic activation of a center- profiles of cognitive deterioration. This issue needs to be
surround mechanism, which acts to dampen semantic investigated in future research by using a larger sample size,
representations closely related to the prime in order to and by comparing the pattern of semantic priming between
prevent them from blocking the retrieval attempt. Applying subgroups of PD participants with different symptomatic
this mechanism to negative priming in PD, Arnott et al. profiles.
(2000) suggested that dopamine depletion during medication Another limitation to our study is that the on and off
withdrawal may result in prime signals becoming obscured medication testing conditions utilised the same stimuli for the
by noise, such that activation of the prime must occur at the experimental task. Hence, it is possible that the repeated
expense of spreading activation. Specifically, to produce exposure to stimuli may have influenced the pattern of
a more salient prime signal, attentional resources must be priming effects obtained in the off medication condition.
directed to the suppression of related nodes whilst unrelated Further research using different stimuli across the on and off
words remain unaffected. This suppression consequently medication conditions should be conducted in order to further
delays RTs to related target words, which take longer to be confirm the emergence of negative priming in PD patients off
retrieved than unrelated words, leading to a negative levodopa.
priming effect.
The notion of weakened prime activation due to
increased noise is consistent with the potential neuro- 5. Conclusions
modulatory influence of dopamine on information process-
ing. Cepeda and Levine (1998) suggested that dopamine is The current study investigated automatic semantic activation
able to increase the signal-to-noise ratio in neural networks in PD patients on and off levodopa and healthy adults.
by integrating relevant information and screening out less Although the results of the present study appeared to support
relevant information. Thus, dopamine depletion in PD will be a neuromodulatory influence of dopamine on semantic acti-
expected to decrease the signal-to-noise ratio of relevant and vation, the results also suggested that the precise nature of
irrelevant signals. Indeed, it has been suggested that reduced this influence varies in PD, depending on the extent of dopa-
dopamine input in schizophrenia results in a smaller mine depletion. Specifically, it is proposed that striatal dopa-
difference in activity between relevant and irrelevant lexical mine depletion in PD initially leads to a slower time course of
nodes in semantic networks (Spitzer et al., 1993). Similarly, semantic activation and decay, but that increased levels of
increased noise within semantic networks during dopamine depletion may lead to unfocussed or weaker
958 cortex 45 (2009) 950–959

activation of prime words and, subsequently, to additional Experimental Psychology: Learning, Memory, and Cognition, 16:
disruptions in semantic activation. One caveat of the present 341–350, 1990.
study that must be considered is that only a small number of Cedrus. Superlab Experimental Laboratory Software. Phoenix, AZ:
Cedrus Corporation, 1996.
PD patients were able to participate in the research whilst off
Cepeda C and Levine MS. Dopamine and N-Methyl-D-Aspartate
levodopa. Therefore, the results of this research need to be receptor interactions in the neostriatum. Developmental
validated using a larger cohort of PD patients. Neuroscience, 20: 1–18, 1998.
Collins AM and Loftus EF. A spreading activation theory of
semantic processing. Psychological Review, 82: 407–428, 1975.
Cools R, Barker RA, Sahakian BJ, and Robbins TW. L-dopa
medication remediates cognitive inflexibility, but increases
Acknowledgements
impulsivity in patients with Parkinson’s disease.
Neuropsychologia, 41: 1431–1441, 2003.
This research was funded in part by an Australian Research Copland DA, Chenery HJ, Murdoch BE, Arnott WL, and Silburn PA.
Council large grants scheme #A00105401. Dopamine enhances semantic salience: semantic priming
evidence from healthy individuals. Brain and Language, 87: 103–
104, 2003.
Deacon D, Hewitt S, Yang C, and Nagata M. Event-related
references potential indices of semantic priming using masked and
unmasked words: evidence that the N400 does not reflect
a post-lexical process. Cognitive Brain Research, 9: 137–146, 2000.
Angwin AJ, Chenery HJ, Copland DA, Arnott WL, Murdoch BE, and Degroot AMB. The range of automatic spreading activation in
Silburn PA. Dopamine and semantic activation: an word priming. Journal of Verbal Learning and Verbal Behaviour,
investigation of masked direct and indirect priming. Journal of 22: 417–436, 1983.
the International Neuropsychological Society, 10: 15–25, 2004. Fahn S and Elton RL. Members of the UPDRS Development
Angwin AJ, Chenery HJ, Copland DA, Murdoch BE, and Silburn PA. Committee. Unified Parkinson’s Disease rating scale. In
Summation of semantic priming and complex sentence Fahn S, Marsden CD, Calne DB, and Lieberman A (Eds), Recent
comprehension in Parkinson’s disease. Cognitive Brain Developments in Parkinson’s Disease. Florham Park, NJ:
Research, 25: 78–89, 2005. Macmillan Health Care Information, 1987: 153–163.
Angwin AJ, Chenery HJ, Copland DA, Murdoch BE, and Silburn PA. Grossman M, Zurif E, Lee C, Prather P, Kalmanson J, Stern MB,
The influence of dopamine on semantic activation in et al. Information processing speed and sentence
Parkinson’s disease: evidence from a multi-priming task. comprehension in Parkinson’s disease. Neuropsychology, 16:
Neuropsychology, 20: 299–306, 2006. 174–181, 2002.
Angwin AJ, Chenery HJ, Copland DA, Murdoch BE, and Silburn PA. Gurd JM. Word search in patients with Parkinson’s disease.
The speed of lexical activation is altered in Parkinson’s Journal of Neurolinguistics, 9: 207–218, 1996.
disease. Journal of Clinical and Experimental Neuropsychology, 29: Gurd JM. Verbal fluency deficits in Parkinson’s disease: individual
73–85, 2007. differences in underlying cognitive mechanisms. Journal of
Arnott WL, Chenery HJ, Copland DA, Murdoch BE, and Silburn PA. Neurolinguistics, 13: 47–55, 2000.
The effect of backward masking on direct and indirect Harrington DL, Haaland KY, and Hermanowicz N. Temporal
semantic priming in patients with Parkinson’s disease and in processing in the basal ganglia. Neuropsychology, 12: 3–12, 1998.
healthy individuals. Brain and Language, 87: 101–102, 2003. Hill H, Strube M, Roesch-Ely D, and Weisbrod M. Automatic vs
Arnott WL, Chenery HJ, Murdoch BE, and Silburn PA. controlled processes in semantic priming – differentiation by
Dopaminergic modulation of semantic memory via centre- event related potentials. International Journal of
surround attentional processing: evidence from Parkinson’s Psychophysiology, 44: 197–218, 2002.
disease. Asia Pacific Journal of Speech, Language and Hearing, 5: Hoehn MM and Yahr MD. Parkinsonism: onset, progression, and
123–128, 2000. mortality. Neurology, 17: 427–442, 1967.
Arnott WL, Chenery HJ, Murdoch BE, and Silburn PA. Semantic Johnson AM, Almeida QJ, Stough C, Thompson JC, Singrayer R,
priming in Parkinson’s disease: evidence for delayed and Jog MS. Visual inspection time in Parkinson’s disease:
spreading activation. Journal of Clinical and Experimental deficits in early stages of cognitive processing.
Neuropsychology, 23: 502–519, 2001. Neuropsychologia, 42: 577–583, 2004.
Balota DA, Cortese MJ, Hutchinson KA, Neely JH, Nelson D, Katzen HL, Levin BE, and Weiner W. Side and type of motor
Simpson GB, et al. The English Lexicon Project: a web-based symptom influence cognition in Parkinson’s disease.
repository of descriptive and behavioral measures for 40,481 Movement Disorders, 21: 1947–1953, 2006.
English words and nonwords, http://elexicon.wustl.edu/; 2002. Kischka U, Kammer TH, Maier S, Weisbrod M, Thimm M, and
Washington University. Spitzer M. Dopaminergic modulation of semantic network
Balota DA and Lorch RF. Depth of automatic spreading activation: activation. Neuropsychologia, 34: 1107–1113, 1996.
mediated priming effects in pronunciation but not in lexical Kucera H and Francis W. Computational Analysis of Present-Day
decision. Journal of Experimental Psychology: Learning, Memory American English. Providence, RI: Brown University Press, 1967.
and Cognition, 12: 336–345, 1986. Lewis FM, Lapointe LL, Murdoch BE, and Chenery HJ. Language
Bayles KA, Trosset MW, Tomoeda CK, Montgomery EB, and impairment in Parkinson’s disease. Aphasiology, 12: 193–206, 1998.
Wilson J. Generative naming in Parkinson’s disease patients. Mattis S. Dementia Rating Scale. Professional Manual. Odessa, FL:
Journal of Clinical and Experimental Neuropsychology, 15: 547–562, Psychological Assessment Resources, Inc, 1988.
1993. Mink JW. The basal ganglia: focused selection and inhibition of
Calne DB, Snow BJ, and Lee C. Criteria for diagnosing Parkinson’s competing motor programs. Progress in Neurobiology, 50: 381–
disease. Annals of Neurology, 32: S125–S127, 1992. 425, 1996.
Carr T and Dagenbach T. Semantic priming and repetition Moritz S, Andresen B, Domin F, Martin T, Probsthein E,
priming from masked words: evidence for a center-surround Kretschmer G, et al. Increased automatic spreading activation
attentional processes in perceptual recognition. Journal of in healthy subjects with elevated scores in a scale assessing
cortex 45 (2009) 950–959 959

schizophrenic language disturbances. Psychological Medicine, Randolph C, Braun AR, Goldberg TE, and Chase TN. Semantic
29: 161–170, 1999. fluency in Alzheimer’s, Parkinson’s, and Huntington’s disease:
Murdoch BE, Arnott WL, Chenery HJ, and Silburn PA. Dopaminergic dissociation of storage and retrieval failures. Neuropsychology,
modulation of semantic activation: evidence from Parkinson’s 7: 82–88, 1993.
disease. Brain and Language, 74: 356–359, 2000. Raskin SA, Sliwinski M, and Borod JC. Clustering strategies on
Neely JH. Semantic priming and retrieval from lexical memory: tasks of verbal fluency in Parkinson’s disease.
roles of inhibitionless spreading activation and limited- Neuropsychologia, 30: 95–99, 1992.
capacity attention. Journal of Experimental Psychology: General, Ruz M, Madrid E, Lupianez J, and Tudela P. High density ERP
106: 226–254, 1977. indices of conscious and unconscious semantic priming.
Neely JH. Semantic priming effects in visual word recognition: A Cognitive Brain Research, 17: 719–731, 2003.
selective review of current findings and theories. In Besner D Schubotz RI, Friederici AD, and von Cramon DY. Time perception
and Humphreys GW (Eds), Basic Processes in Reading: Visual and motor timing: a common cortical and subcortical basis
Word Recognition. Hillsdale, NJ: Lawrence Erlbaum, 1991: revealed by fMRI. Neuroimage, 11: 1–12, 2000.
264–336. Spitzer M, Braun U, Hermle L, and Maier S. Associative semantic
Neely JH, Keefe DE, and Ross KL. Semantic priming in the lexical network dysfunction in thought-disordered schizophrenic
decision task: roles of prospective prime-generated patients: direct evidence from indirect semantic priming.
expectancies and retrospective semantic matching. Journal of Biological Psychiatry, 34: 864–877, 1993.
Experimental Psychology: Learning, Memory and Cognition, 15: Stern C, Prather P, Swinney D, and Zurif E. The time course of
1003–1019, 1989. automatic lexical access and aging. Brain and Language, 40:
Poldrack RA, Temple E, Protopapas A, Nagarajan S, Tallal P, 359–372, 1991.
Merzenich M, et al. Relations between the neural bases of Watters PA and Patel M. A neural network model of semantic
dynamic auditory processing and phonological processing: processing errors in Parkinson’s disease. Neural Processing
evidence from fMRI. Journal of Cognitive Neuroscience, 13: 687– Letters, 9: 189–199, 1999.
697, 2001. Watters PA and Patel M. Competition, inhibition, and semantic
Portin R, Laatu S, Revonsuo A, and Rinne U. Impairment of judgement errors in Parkinson’s disease. Brain and Language,
semantic knowledge in Parkinson’s disease. Archives of 80: 328–339, 2002.
Neurology, 57: 1338–1343, 2000. Weisbrod M, Kiefer M, Winkler S, Maier S, Hill H, Roesch-Ely D,
Posner ML and Snyder CRR. Attention and cognitive control. In et al. Electrophysiological correlates of direct versus indirect
Solso RL (Ed), Information Processing and Cognition: The Loyola semantic priming in normal volunteers. Cognitive Brain
Symposium. Hillsdale, NJ: Erlbaum, 1975: 55–85. Research, 8: 289–298, 1999.

You might also like