Download as pdf or txt
Download as pdf or txt
You are on page 1of 10

Journal of Geriatric Psychiatry and Neurology

http://jgp.sagepub.com/

Montreal Cognitive Assessment (MoCA): Validation study for Frontotemporal Dementia


Sandra Freitas, Mário R. Simões, Lara Alves, Diana Duro and Isabel Santana
J Geriatr Psychiatry Neurol 2012 25: 146 originally published online 1 August 2012
DOI: 10.1177/0891988712455235

The online version of this article can be found at:


http://jgp.sagepub.com/content/25/3/146

Published by:

http://www.sagepublications.com

Additional services and information for Journal of Geriatric Psychiatry and Neurology can be found at:

Email Alerts: http://jgp.sagepub.com/cgi/alerts

Subscriptions: http://jgp.sagepub.com/subscriptions

Reprints: http://www.sagepub.com/journalsReprints.nav

Permissions: http://www.sagepub.com/journalsPermissions.nav

Citations: http://jgp.sagepub.com/content/25/3/146.refs.html

>> Version of Record - Nov 2, 2012

OnlineFirst Version of Record - Aug 1, 2012

What is This?

Downloaded from jgp.sagepub.com at TOBB Ekonomi ve Teknoloji Üniversitesi on May 13, 2014
Journal of Geriatric Psychiatry
and Neurology
Montreal Cognitive Assessment (MoCA): 25(3) 146-154
ª The Author(s) 2012
Reprints and permission:
Validation study for Frontotemporal sagepub.com/journalsPermissions.nav
DOI: 10.1177/0891988712455235
Dementia http://jgpn.sagepub.com

Sandra Freitas, PhD1,2, Mário R. Simões, PhD1,2, Lara Alves, PhD1,


Diana Duro1, and Isabel Santana, PhD, MD3,4

Abstract
The Montreal Cognitive Assessment (MoCA) is a brief instrument developed for the screening of milder forms of cognitive
impairment, having surpassed the well-known limitations of the Mini-Mental State Examination (MMSE). The aim of the present
study was to validate the MoCA as a cognitive screening test for behavioral-variant frontotemporal dementia (bv-FTD) by
examining its psychometric properties and diagnostic accuracy. Three matched subgroups of participants were considered:
bv-FTD (n ¼ 50), Alzheimer disease (n ¼ 50), and a control group of healthy adults (n ¼ 50). Compared with the MMSE, the
MoCA demonstrated consistently superior psychometric properties and discriminant capacity, providing comprehensive
information about the patients’ cognitive profiles. The diagnostic accuracy of MoCA for bv-FTD was extremely high (area under
the curve AUC [MoCA] ¼ 0.934, 95% confidence interval [CI] ¼ 0.866-.974; AUC [MMSE] ¼ 0.772, 95% CI ¼ 0.677-0.850). With
a cutoff below 17 points, the MoCA results for sensitivity, specificity, positive predictive value, negative predictive value, and clas-
sification accuracy were significantly superior to those of the MMSE. The MoCA is a sensitive and accurate instrument for screen-
ing the patients with bv-FTD and represents a better option than the MMSE.

Keywords
geriatric assessment, neuropsychological test, validation studies, cognitive impairment, frontotemporal dementia, Alzheimer
disease

Received November 22, 2011. Received revised March 12, 2012. Accepted June 4, 2012.

Introduction cohort; the studies also estimate a prevalence rate of 9.4 per
100 000 for the people aged 60 to 69 years and a prevalence of
The diagnosis of frontotemporal dementia (FTD) remains a
3.1 per 100 people aged 85 years or more.4,6 Overall, the estimates
challenge wrapped in a nosologic controversy. Since the turn
suggest that FTD is responsible for up to 20% of presenile demen-
of the century, this clinical condition has been recognized and tia cases5,6 figures that overlap with those purposed for vascular
referred to as Pick disease, frontal lobe degeneration of non-
dementia, at least in Western countries.9 The genetic and chromo-
Alzheimer type, and dementia of the frontal type, among other
somal locus related to tau and progranulin proteins,10-12 as well as
terms.1,2 The task force and consensus for new diagnostic cri-
different neuropathological substrates that are now the basis for a
teria have proposed the designation of ‘‘frontotemporal lobar
degeneration’’3; however, the most frequently used term that
currently gathers larger consensus is FTD.
1
Frontotemporal dementia refers to a group of degenerative Faculty of Psychology and Educational Sciences, University of Coimbra,
dementias that are characterized by progressive, bilateral, and Coimbra, Portugal
2
more or less symmetrical pathology in the frontal and anterior Centro de Investigação do Núcleo de Estudos e Intervenção Cognitivo
Comportamental (CINEICC), Coimbra, Portugal
temporal cortex.4-6 With an average onset age of approximately 3
Faculty of Medicine, University of Coimbra, Coimbra, Portugal
50 to 60 years,7 FTD is probably the second most prevalent 4
Neurology Department of the Coimbra University Hospital, Coimbra,
early-onset cause of degenerative dementia, after Alzheimer dis- Portugal
ease (AD) and overcoming Lewy Body dementia which seems to
be more common in late-onset forms.8 The few epidemiological Corresponding Author:
Sandra Freitas, Psychological Assessment Department, Faculty of Psychology and
studies available indicate a wide range of prevalence rates, with Educational Sciences, University of Coimbra, Rua do Colégio Novo, Apartado
estimates of 15 to 22 per 100 000 people aged 45 to 64 years, 6153, 3001-802 Coimbra, Portugal
which is almost half of the prevalence of AD in the same age Email: sandrafreitas0209@gmail.com

Downloaded from jgp.sagepub.com at TOBB Ekonomi ve Teknoloji Üniversitesi on May 13, 2014
Freitas et al 147

pathological classification of FTD,4,13 were initially described in methodological differences across study designs have contrib-
this group of young familial cases. uted to inconsistent findings and difficulties in the early dis-
Although FTD is a heterogeneous entity that produces a gra- tinction between FTD and others dementias using
dual but variable decline in behavioral, cognitive, and neurolo- neuropsychological tools.1,4,24 This lack of distinction is partic-
gical domains,3,4,6 it has been widely accepted the division into ularly relevant for AD, with which there appears to exist
3 main subgroups, all of which contain corresponding topogra- greater misdiagnosis. Moreover, numerical scores on cognitive
phical cerebral involvement. tests have a limited value in differentiating between FTD and
Frontal variant or behavioral variant is frequently referred to AD, while qualitative performances and error types appear to
as frontotemporal dementia (bv-FTD) and is the most common enhance this distinction.1,21-24
subtype. The bv-FTD accounts for approximately half of all The significant increase in prevalence rates, the high herit-
FTD cases.7,14 It is associated with bilateral, and usually sym- ability of FTD with estimates of 20% to 40% of familial cases
metrical, frontal, and anterior temporal dysfunction.3,4 Despite in referral centers,4,25,26 imposing new challenges in terms of
the heterogeneity in its clinical presentation, bv-FTD is charac- genetic diagnosis and familial counseling, and issues related
terized by an insidious onset and a progressive decline that is to pharmacological treatment of degenerative dementias, since
marked by personality and behavioral changes. These changes drugs used to treat cognitive symptoms of AD or Lewy Body
lead to an early decline in social interpersonal conduct, early dementia are not recommended in FTD, all these points high-
impairment of regulation of personal conduct, and early emo- light the importance of an accurate screening during early
tional blunting and loss of insight.3,15 The cognitive deficits stages of these disorders. The Mini-Mental State Examination
that are most characteristic of bv-FTD are the impairment of (MMSE)27 is the most widely used and validated screening
executive function, attention and working memory deficits, instrument for the assessment of cognitive function. However,
poor abstraction, and difficulty shifting mental set with perse- several limitations have been identified in the literature,
verative tendencies, all of which occur without severe amnesia, namely, the low sensitivity to the early stages of AD and the
aphasia, or perceptual dysfunction.3,6 inability to differentiate between the various dementia disor-
Semantic dementia16,17 is also referred to semantic aphasia ders.22,28-31 Regarding FTD, several studies have reported that
and associative agnosia3 or semantic variant of primary progres- the MMSE lacks enough sensitivity to identify cognitive
sive aphasia.18 It is usually correlated with left or bilateral atro- impairments and frequently results in normal test performance,
phy of the middle and inferior temporal neocortex.19 The core which is especially problematic in cases of isolated frontal or
feature of this clinical syndrome is a language disturbance that linguistic deficits that are typical of the early stages.6,21,32-34
is characterized by fluent, effortless, and empty spontaneous This lack of sensitivity results from the low complexity of the
speech, with severe deficits in naming and word comprehension tasks for assessment of memory and language dysfunctions and
and a loss of word meaning for both verbal and nonverbal con- from the lack of tasks for the evaluation of executive
cepts; another core feature is a perceptual disorder that includes function.22,35
prosopagnosia and associative agnosia.3,6 For patients with The Montreal Cognitive Assessment (MoCA)36 is a recent
semantic dementia, some of the following abilities remain rela- international brief cognitive screening instrument that was
tively preserved: repetition, articulatory abilities, ability to read developed to detect milder forms of cognitive impairment, over-
aloud and to write down orthographically regular words that coming limitations of the MMSE. Previous studies have reported
have been dictated, visuospatial skills, working memory, and the usefulness of MoCA in accurately identifying milder forms
autobiographical memory, at least for the recent past.3,6 of cognitive impairment. Compared with the MMSE, the MoCA
Progressive nonfluent aphasia,3 also called nonfluent/ displays a higher sensitivity in detecting patients with MCI and
agrammatic variant of primary progressive aphasia,18 is associ- AD.26,37-42 This improved sensitivity explains the widespread
ated with asymmetric atrophy of the left hemisphere.19 This is a international use of MoCA and its recognition as one of the best
disorder of expressive language that usually occurs without screening tests.43-45 One of the reasons for the good sensitivity of
impairments in other cognitive domains. These patients present the test is that it allows a more comprehensive assessment of the
nonfluent spontaneous speech that is marked by agrammatism, major cognitive domains, comparatively to other screening tests,
phonemic paraphasias, and anomia, with difficulties in reading especially executive functions and short-term memory, but also
and writing. Word comprehension remains relatively well pre- of language abilities and visuospatial processing. Despite the
served and behavioral symptoms are less common among these recognition that the MoCA has received as a screening tool, its
patients than among sufferers of the other 2 types of FTD.3 diagnostic sensitivity cannot be generalized to FTD because
Several studies have examined the neuropsychological def- there are no published studies validating the MoCA for these
icits in patients with FTD.20-24 These studies were designed to patients.
identify a global characterization of FTD, which would be a The general aim of this study is to validate the MoCA as a
valuable contribution to distinguishing FTD from other demen- cognitive screening test for bv-FTD by examining its psycho-
tia diagnoses. However, the clinical heterogeneity of FTD, its metric properties and diagnostic accuracy. Furthermore, we
decline in domains beyond the cognitive, which are not evalu- also investigated the cognitive performances of patients with
ated by neuropsychological tests, the overlap of some cognitive bv-FTD on the MoCA and analyzed how their performances
deficits between FTD and other types of dementia as well as the differed from patients with AD.

Downloaded from jgp.sagepub.com at TOBB Ekonomi ve Teknoloji Üniversitesi on May 13, 2014
148 Journal of Geriatric Psychiatry and Neurology 25(3)

Methods significant comorbidities; high severity dementia (only those


patients with CDR 2 and MMSE 12 points were included
Participants and Procedures in the study); recent pharmacotherapy changes; recent psychia-
The total sample includes 150 participants divided into 3 sub- tric comorbidity (clinically diagnosed within the 6 months prior
groups: (i) a bv-FTD group with 50 patients, (ii) an AD group to the current neuropsychological evaluation); and significant
with 50 patients, and (iii) a healthy group comprising 50 cog- motor, visual or auditory deficits, all of which may influence
nitively healthy adults. neuropsychological assessment.
Study eligibility was restricted to patients with a compre- The healthy group comprised cognitively healthy commu-
hensive clinical observation, a comprehensive neuropsycholo- nity members who resided in the Portuguese continental terri-
gical evaluation with a validated battery for the Portuguese tory. This group was selected from the database of normative
population (Bateria de Lisboa para a Avaliação de Demência study of MoCA for the Portuguese population in order to match
[Battery of Lisbon for the Assessment of Dementia]46), as well each patient on variables that were found to be predictive of the
as a full investigation using biochemical, structural, and func- MoCA performance (educational level and age),66 and addi-
tional imaging (magnetic resonance imaging and single photon tionally on gender. Several demographic and clinical inclusion
emission computed tomography, and/or positron emission criteria were considered in the initial participant selection for
tomography), which are essential to exclude other causes of the normative study of MoCA for the Portuguese population:
no degenerative dementia and to establish the clinical diagno- age 25 years and older; Portuguese as their native language and
sis. Besides the neuropsychological battery, and as standar- schooling in Portugal; absence of significant motor, visual or
dized procedures of the Dementia Clinic of the Neurology auditory deficits, all of which may influence performance on
Department of Coimbra University Hospital, patients were sub- tests; and to ensure that participants were cognitively healthy
mitted to additional tests and scales which are more disease- adults: autonomy in daily living activities; no history of alco-
specific and are already being purposed in new diagnostic holism or substance abuse; absence of neurological or psychia-
criteria.47 Considering that this is an extensive global assess- tric diseases, as well as of chronic unstable systemic disorders
ment, it was not feasible to carry out this same evaluation in with impact in cognition; absence of significant depressive
both clinical groups. complaints and medication with possible impact in cognition
The bv-FTD group included only those patients who dis- (eg, psychotropic or psychoactive drugs). In order to imple-
played the behavioral variant of FTD diagnosis, as established ment and confirm these general criteria, the recruited partici-
by a multidisciplinary team according to international criteria.3 pants were interviewed by a psychologist with a standard
All the individuals who displayed the aphasic syndromes of questionnaire including a complete sociodemographic ques-
FTD or mixed clinical syndromes were excluded from the tionnaire, an inventory of current clinical health status, and past
study. In order to better characterize this group, all patients habits and medical history. In case of older participants, this
with bv-FTD were further evaluated using the following instru- information was always also checked with general practioner,
ments: the Neuropsychiatric Inventory.48 the Frontal Behavior community center directors, and/or an informant, usually an
Inventory,49 the Comprehensive Affect Testing System,50 the individual in cohabitation or a close relative. For further inclu-
Frontal Assessment Battery,51 the MMSE,27 the Trail Making sion in the study, all the participants were required to display
Test,52 Verbal Fluency,46 the Maze-Tracing Task,53 the Digit normal performance on others tools of the assessment battery
Span Test,54 the Digit Symbol Test,54 the Spatial Span Test,55 especially composed for the normative study of MoCA for the
the Token Test,56 the Buschke Selective Reminding Test,57 and Portuguese population.66 From the initial community-based
the Brief Visuospatial Memory Test.58 sample of the 936 volunteers, 194 (20.73%) were excluded
The AD group included only those patients who were diag- after the interview (most frequent reasons were history of neu-
nosed by a multidisciplinary team consensus based on interna- rological or psychiatric disorder and history of alcohol abuse),
tional criteria for probable AD.59,60 This group was recruited to and 92 (9.83%) were excluded because of their performance on
match the patients with bv-FTD by gender, age, education the assessment battery, suggesting the presence of cognitive
level, and severity of cognitive decline, as assessed by the impairment or depressive symptoms according to Portuguese
MMSE. For patients with AD, the besides the comprehensive cutoff points. The final sample of the normative study of
clinical/neuropsychological standard evaluation, patients MoCA for the Portuguese population was composed by 650
underwent the following specific investigation: the MMSE,27 cognitively healthy adults that met all the inclusion criteria
the Alzheimer Disease Assessment Scale,61 the Clinical defined.66
Dementia Rating scale (CDR),62 the Irregular Word Reading Informed consent was obtained from all the participants
Test (TeLPI)63 as an estimate of premorbid intelligence, the after a member of the research team provided them with a full
Subjective Memory Complaints scale,64 and the Geriatric explanation of the research aims and procedures as well as con-
Depression Scale (GDS-30).65 fidentiality requirements. For the patients who were not capa-
For both clinical groups, the multidisciplinary team was ble of providing the informed consent, a legal representative
blind to MoCA scores and to MMSE scores used in this study. fulfilled that requirement on their behalf. The present research
The following patient exclusion criteria were established at the complies with the ethical guidelines on human experimentation
outset of the study: an unstable clinical condition, with stated in the Declaration of Helsinki and was approved by the

Downloaded from jgp.sagepub.com at TOBB Ekonomi ve Teknoloji Üniversitesi on May 13, 2014
Freitas et al 149

Portuguese Foundation for Science and Technology and by the coefficients were used to analyze interrater reliability and con-
Faculty of Psychology and Educational Sciences Scientific vergent validity and to explore the correlations between items,
Committee. cognitive domains, and the total test score.
The diagnostic accuracy of the MoCA and the MMSE for
predicting clinically diagnosed bv-FTD was assessed through
Materials and Neuropsychological Testing the receiver operating characteristics (ROC) curve analysis
In the clinical interview, data were collected through a compre- implemented in MedCalc (version 11.6; MedCalc Software,
hensive sociodemographic questionnaire and an inventory of Mariakerke). The area under the curve (AUC) was calculated,
the patients’ current clinical health status, past habits, and med- which can vary between 0.5 and 1, with a larger AUC signify-
ical history. The diagnosis of bv-FTD requires significant input ing better diagnostic accuracy. The ROC curves were com-
from a close informant; thus, an extensive interview was con- pared according to Hanley and McNeil AUC comparison
ducted with each patient’s caregiver. The informants also con- method.70 For each instrument, the optimal cutoff points that
tributed to the completion of some of the assessment tests listed yielded the highest Youden index were selected, with a higher
above. For the purposes of this study, the neuropsychologist Youden index indicating the maximization of the instrument’s
administered the MMSE27,67 and the MoCA36,68 in a single ses- sensitivity and specificity. To analyze the predictive value of
sion; according to protocol, all participants first received the the tests, for each cutoff point, we calculated the sensitivity (the
MMSE and screening instruments were not counterbalanced probability that participants with cognitive impairment will test
because with the administration of the MMSE in the first place, positive), specificity (the probability that participants without
we increase the time between verbal tasks, thus resulting in a cognitive impairment will test negative), positive predictive
reduced possible influence of the MMSE verbal items on the value (PPV; the probability of disease in participants who test
MoCA verbal tasks. Besides, and given the lower complexity positive), negative predictive value (NPV; the probability of a
of the MMSE tasks, the predicable effects on MoCA would lack of disease in participants who test negative), and classifi-
be less significant. For the interrater reliability analysis, 2 cation accuracy (the probability of correctly classifying partici-
neuropsychologists blindly scored the performance of the pants who either do or do not have cognitive impairment).
patient in a single assessment.
The MMSE is the most widely recognized and used brief Results
screening instrument for detecting cognitive deficits. Both the
MMSE and the MoCA are brief cognitive screening tools that Sample Characterization
are administered in paper-and-pencil format. For both tests, a Table 1 presents the characteristics of the sample, including
score is derived by summing the points from each successfully details of all the subgroups. The following variables were
completed task, for a total range from 0 to 30 points; higher included in the sample characterization: sample size, gender,
scores indicate better cognitive performance. The MoCA was age, educational level, time progression of the disease, family
developed to screen milder forms of cognitive impairment history, MMSE score, and MoCA score.
through the assessment of a wide range of cognitive functions, As presented in Table 1, there are no gender differences
such as short-term memory, executive functions, visuospatial between the 3 groups. Similarly, no statistically significant dif-
abilities, language, attention, concentration, working memory, ferences were found between groups for age (F2,147 ¼ 1.808,
and temporal and spatial orientation.36,69 It comprises a 1-page P ¼ .168) or educational level (F2,147 ¼ 0.013, P ¼ .987). In
test, which requires a short administration time (10-15 minutes). addition, the clinical groups did not differ from each other in
The MoCA is accompanied by a manual that explicitly describes terms of MMSE score (t98 ¼ 1.622, P ¼ .108), which suggests
the instructions for administering the tasks and objectively an equivalence across groups in the severity of cognitive
defines the scoring system. In the current study, the total score decline. Regarding the time of progression disease, no statisti-
of MoCA refers to the raw score without the one correction point cally significant differences were found between the clinical
for education effects that was recommended in the original groups (t98 ¼ 1.295, P ¼ .198). Finally, half of the AD group
study36 because this correction is not used in the Portuguese patients had a family history of dementia in first-degree rela-
population.66 tives, whereas the bv-FTD group and the healthy group did not
differ from each other; approximately 14% of each group pre-
Statistical Analyses sented positive cases in their family history.

Statistical analyses of the data were computed using the Statis-


tical Package for the Social Sciences (SPSS, version 19.0; IBM
Psychometric Properties
SPSS, Chicago, Illinois). Descriptive statistics were used for Internal consistency reliability of the MoCA was estimated
the sample’s characterization. The w2 test, the 2-sample t test, using Cronbach a. In the total sample, we found a Cronbach
the one-way between-groups analysis of variance, and the a of .906 that confirms the overall reliability of the scale when
Tukey HSD and Bonferroni post hoc test were conducted to used to examine Portuguese participants (the respective value
examine group differences. Cronbach alpha was used as an for MMSE was 0.832). A more detailed analysis reveals that
index of internal consistency. The Pearson correlation excluding any single item from the scale does not improve the

Downloaded from jgp.sagepub.com at TOBB Ekonomi ve Teknoloji Üniversitesi on May 13, 2014
150 Journal of Geriatric Psychiatry and Neurology 25(3)

Table 1. Demographic and Clinical Characteristics of the Subgroupsa As expected, a more detailed analysis regarding the sub-
scores from the MoCA cognitive domains revealed that the
bv-FTD AD Healthy
healthy participants performed higher in all cognitive domains
n 50 50 50 than both clinical groups. Comparing the 2 clinical groups, sta-
Gender 25 (50.0) 25 (50.0) 25 (50.0) tistically significant differences in both the short-term Memory
Age 67.96 + 7.69 70.64 + 7.51 70.12 + 7.22 domain and the Attention, Concentration and Working Mem-
Educational level 6.18 + 3.71 6.14 + 3.88 6.26 + 3.83 ory domain were observed, with the patients with AD perform-
Time progression of 3.24 + 2.80 3.94 + 2.60 —
ing worse than the patients with bv-FTD, according to post
disease
Family history 7 (14.0) 25 (50.0) 7 (14.0) hoc tests (AD group: Memory domain [range 0-5] ¼ 0.16
MMSE score 23.86 + 4.76 22.46 + 3.81 27.88 + 1.71 + 0.510; Attention, Concentration, and Working Memory
MoCA score 13.34 + 5.03 11.04 + 4.46 22.50 + 3.44 domain [range 0-6] ¼ 2.42 + 1.655; bv-FTD group: Memory
domain ¼ 0.72 + 1.230; Attention, Concentration and Work-
Abbreviations: bv-FTD, behavioral variant of frontotemporal dementia; AD,
Alzheimer disease; Healthy, healthy adults; MoCA, Montreal Cognitive
ing Memory domain ¼ 3.30 + 1.799). These cognitive
Assessment (maximum score ¼ 30); MMSE, Mini-Mental State Examination domains correspond to the test subscores as described by the
(maximum score ¼ 30). authors36 and corroborated by confirmatory factor analysis in
a
Gender is characterized by the number of females and respective percentage a previous study from our group.69
(%). Time progression of disease is expressed in years. Family history is
characterized by number of positive cases and respective percentage (%). Data
of others variables are presented as mean + standard deviation. Cutoff Points
reliability coefficient value. This reliability coefficient was The ROC curve analyses were computed to evaluate the diag-
also computed for each clinical group: a (bv-FTD) ¼ .847 and nostic accuracy of the MoCA and the MMSE to discriminate the
a (AD) ¼ .835. The interrater reliability was calculated for a patients with bv-FTD from the cognitively healthy adults. Gra-
subsample of 30 patients with bv-FTD and resulted in a high phic representations of the ROC curves are provided in Figure 1.
Pearson correlation of .976. The correlations between the The MoCA discriminant potential for bv-FTD was excel-
MoCA scores and the MMSE scores were also explored. A lent, with an AUC of 0.934 (95% confidence interval
high positive correlation was observed between the scores from [CI] ¼ 0.866-0.974). In contrast, the MMSE showed an accep-
both tools in the total sample (r ¼ .802, P < .001) and in the table discriminant potential, with a corresponding AUC of
bv-FTD group (r ¼ .838, P < .001), which is indicative of con- 0.772 (95% CI ¼ 0.677-0.850). These AUC were significantly
vergent validity. Both the correlations between each item and different from each other (z ¼ 4.472, P < .001), according to the
the cognitive domains, and between each cognitive domain and AUC comparison method of Hanley and McNeil,70 indicating
the overall MoCA score were also analyzed in the bv-FTD that the instruments were different in the accuracy of their
group. All the items showed a significantly higher correlation classifications.
with their respective domains than with any other domain. In Figure 1 illustrates that the ROC curve for the MoCA fully
this group, the Phonemic Fluency task showed a higher corre- included the curve for the MMSE, which is a clear indication
lation with the Executive Function domain than with Language that there is always a cutoff for the MoCA, with higher sensi-
domain. The same result was found for the AD and healthy tivity and specificity, for any cutoff chosen for the MMSE. The
groups. Furthermore, we found a significant (P < .001) optimal cutoff point for maximum accuracy (Youden index)
positive correlation between each cognitive domain and the and the respective values of sensitivity, specificity, PPV, NPV,
total score of the scale, ranging from .349 to .787. These corre- and classification accuracy are described for both instruments
lations are suggestive of construct-related validity. in Table 2.
Furthermore, each domain showed significantly higher
correlations with the MoCA total score than with any other
domain, illustrating the discriminative power of the domains. Discussion
This study was primarily motivated by the lack of studies vali-
dating the MoCA as a brief cognitive screening instrument for
Group Differences patients with bv-FTD and by the need for a sensitive, reliable,
There were statistically significant differences between the and accurate instrument to briefly assess the cognitive impair-
groups in the MoCA total scores (F2,147 ¼ 96.700, P < .001). ments in these patients. In this context, 3 matched subgroups of
According to post hoc tests, these differences occurred between participants (bv-FTD, AD, and healthy groups) were
all group comparisons. Thus, although the clinical groups were investigated to validate the MoCA in patients with bv-FTD,
previously matched for the severity level of their cognitive to establish the MoCA corresponding cutoff point, and to
decline, as assessed by the MMSE (t98 ¼ 1.622, P ¼ .108), the evaluate its diagnostic classification accuracy. Our findings
patients with AD obtained significant lower MoCA scores demonstrate the MoCA adequacy and usefulness for this task
(11.04 + 4.46) than the patients with bv-FTD and indicate that the MoCA is superior to the widely used
(13.34 + 5.03), and both clinical groups obtained lower scores MMSE as a brief cognitive assessment of patients with bv-
than the healthy group (22.50 + 3.44). FTD.

Downloaded from jgp.sagepub.com at TOBB Ekonomi ve Teknoloji Üniversitesi on May 13, 2014
Freitas et al 151

Table 2. Diagnostic Classification Accuracya

Classification
Cutoff Sensitivity Specificity PPV NPV Accuracy

MoCA <17 78 98 98 82 88
MMSE <26 58 88 83 68 73

Abbreviations: MoCA, Montreal Cognitive Assessment (maximum score ¼


30); MMSE, Mini-Mental State Examination (maximum score ¼ 30); AUC, area
under the operating characteristic curve; PPV, positive predictive value; NPV,
negative predictive value.
a
Sensitivity, specificity, PPV, NPV, and classification accuracy values were
expressed in percentage. Cutoff values indicate the minimum score required
for absence of signal.

with bv-FTD. However, these results should be interpreted


cautiously because they contribute to a literature that already
presents several inconsistencies. Various factors have contrib-
uted to the difficulties in distinguishing between FTD and
other dementias at early stages of the disease using neuropsy-
chological tools,1,4,24 including (a) the clinical heterogeneity
of FTD; (b) its decline in other domains beyond the cognitive,
which are not evaluated by neuropsychological tests; (c) the
Figure 1. The ROC curve analysis of the MoCA (dark gray) and overlap in some cognitive deficits between FTD and other
MMSE (medium gray) to detect bv-FTD, with reference line (light gray
types of dementia; (d) the insufficient breadth of representa-
diagonal). Abbreviations: MoCA, Montreal Cognitive Assessment;
MMSE, Mini-Mental State Examination; bv-FTD, frontotemporal tion of the cognitive abilities relevant to cognitive impairment
dementia, behavioral variant; ROC, receiver operating characteristics. associated with the disease in the cognitive assessment tools,
an essential condition for the accurate and comprehensive
cognitive assessment; and (e) and the methodological differ-
The MoCA consistently displayed superior psychometric ences across the study designs (eg, variation in the mean age
properties than the MMSE, which confirm the overall reliabil- of participants and others characteristics, diagnostic criteria,
ity of the scale when used to examine Portuguese participants. and assessment instruments used; the use of the mixed clinical
We consider that the presence of a manual with administration groups that include different FTD subtypes; and different
and scoring rules for the tasks contributed to the excellent stages of the disease’s evolution). Furthermore, the MoCA
interrater reliability of MoCA. The correlation coefficient is a brief cognitive instrument, which by its nature has a
between the total scores of MoCA and MMSE was high, restricted range of tasks to assess each cognitive domain,
suggesting convergent validity. Finally, significant positive which constitutes an additional limitation to the analysis of
correlations were found between each item and its respective differences in cognitive profile between clinical groups
cognitive domain, and all the items were more highly corre- explored in this study.
lated with their own respective domain than with any other The MoCA displayed excellent diagnostic accuracy in dis-
domain. Each cognitive domain was more highly correlated criminating patients with bv-FTD from cognitively healthy old
with the MoCA total score than with any other domain. These adults, and it exhibited an AUC that was significantly higher
correlations support both the MoCA construct-related validity than the AUC of MMSE. The optimal cutoff point for detecting
and the discriminative power of the cognitive domains. bv-FTD that allowed the maximization of the sensitivity and
As expected, the healthy participants obtained higher MoCA specificity was below 17 points. This cutoff point is equivalent
scores than either of the clinical groups. Despite the previous to the optimal cutoff point established in our prior validation
matching according to the severity level, as assessed by the studies of MoCA for patients with AD 71 and for patients with
MMSE, we found statistically significant differences between vascular dementia (Freitas, Simões, Alves, Vicente, and San-
the 2 clinical groups in the MoCA scores, with a lower tana, 2012).72 With this cutoff point, the MoCA showed high
performance displayed by the patients with AD. This finding levels of sensitivity (78%), specificity (98%), PPV (98%), NPV
demonstrates that the MoCA has better discriminant capacity (82%), and classification accuracy (88%); all the values were
than the MMSE. At the level of the MoCA’s cognitive consistent and significantly higher than the respective MMSE
domains, the healthy participants also had significantly higher values. In this sample, the optimal cutoff point of MMSE to
performances than both patient groups in all cognitive detect bv-FTD was below 26 points.
domains. Between clinical groups, statistically significant dif- We propose that the strengths of the current study include
ferences were observed in the MoCA’s Short-term Memory the homogeneity of the sample regarding groups’ size, gender,
and Attention, Concentration and Working Memory domains, age, educational level, and severity level of cognitive decline
with the patients with AD performing worse than the patients (as assessed by the MMSE in the clinical groups) as well as the

Downloaded from jgp.sagepub.com at TOBB Ekonomi ve Teknoloji Üniversitesi on May 13, 2014
152 Journal of Geriatric Psychiatry and Neurology 25(3)

homogeneity in the FTD group (for which only the behavioral and Technology) through of a PhD fellowship (SFRH/BD/38019/
variant was considered). These strengths allowed a clearer 2007) and PIC/IC/83206/2007.
analysis and minimized the influence of these individual and
methodological variables. Additionally, contributions to the References
current study’s methodological rigor included the previous 1. Hutchinson AD, Mathias JL. Neuropsychological deficits in fron-
well-validated clinical diagnosis of groups by a multidisciplin- totemporal dementia and Alzheimer’s disease: a meta-analytic
ary team using standard criteria and based on a full investiga- review. J Neurol Neurosurg Psychiatry. 2007;78(9):917-928.
tion, the presence of a control group composed of cognitively 2. Kertesz A, Blair M, McMonagle P, Munoz DG. The diagnosis and
healthy adults from the community, and the reduced interrater course of frontotemporal dementia. Alzheimer Dis Assoc Disord.
variability due to evaluation of the participants by 1 of 2 expert 2007;21(2):155-163.
neuropsychologists. 3. Neary D, Snowden JS, Gustafson L, et al. Frontotemporal lobar
However, some limitations of current study must be degeneration: a consensus on clinical diagnostic criteria. Neurol-
addressed, mainly, that our analyses included only those ogy. 1998;51(6):1546-1554.
patients with FTD who displayed the behavioral variant. Cau- 4. Seelaar H, Rohrer JD, Pijnenburg YA, Fox NC, van Swieten JC.
tion should be used when generalizing these results to other Clinical, genetic and pathological heterogeneity of frontotem-
FTD syndromes. Besides, the sample of the present study poral dementia: a review. J Neurol Neurosurg Psychiatry. 2011;
showed a low educational level, which is representative of the 82(5):476-486.
demographic profile of our country, where the older strata of 5. Snowden JS, Neary D, Mann DM. Frontotemporal dementia. Br J
the population are characterized by a very low educational Psychiatry. 2002;180:140-143.
level. This feature should be taken into account in generalizing 6. Weder ND, Aziz R, Wilkins K, Tampi RR. Frontotemporal
the results of this study to other samples. It is also important to dementias: a review. Ann Gen Psychiatry. 2007;6:15.
consider that the aim of our study was the evaluation of mild- 7. Seelaar H, Kamphorst W, Rosso SM, et al. Distinct genetic forms
to-moderate levels of severity of dementia. Future studies with of frontotemporal dementia. Neurology. 2008;71(16):1220-1226.
homogeneous samples of other FTD syndromes will be essen- 8. Harvey RJ, Skelton-Robinson M, Rossor MN. The prevalence and
tial to corroborate the ability of MoCA to identify early cogni- causes of dementia in people under the age of 65 years. J Neurol
tive decline associated with bv-FTD. Finally, the current study Neurosurg Psychiatry. 2003;74(9):1206-1209.
is the first to validate the MoCA for screening bv-FTD and to 9. Rossor MN, Fox NC, Mummery CJ, Schott JM, Warren JD. The
examine its diagnostic accuracy with the establishment of cut- diagnosis of young-onset dementia. Lancet Neurol. 2010;9(8):
off points; thus, we cannot compare it with other studies. 793-806.
In conclusion, MoCA was confirmed as a valid, reliable, 10. Cruts M, Gijselinck I, van der Zee J, et al. Null mutations in pro-
sensitive, and accurate instrument for the brief assessment of granulin cause ubiquitin-positive frontotemporal dementia linked
cognitive impairments in patients with bv-FTD. The MoCA to chromosome 17q21. Nature. 2006;442(7105):920-924.
results were systematically superior to the MMSE results for 11. Hutton M, Lendon CL, Rizzu P, et al. Association of missense and
both discriminant validity and diagnostic accuracy. Therefore, 5’-splice-site mutations in tau with the inherited dementia
MoCA is a better cognitive screening instrument for bv-FTD FTDP-17. Nature. 1998;393(6686):702-705.
than the MMSE. 12. Baker M, Mackenzie IR, Pickering-Brown SM, et al. Mutations in
progranulin cause tau-negative frontotemporal dementia linked to
Authors’ Note chromosome 17. Nature. 2006;442(7105):916-919.
This study was done at the Dementia Clinic of the Neurology Depart- 13. Mackenzie IR, Neumann M, Bigio EH, et al. Nomenclature and
ment of Coimbra University Hospital (Coimbra, Portugal) and at the nosology for neuropathologic subtypes of frontotemporal lobar
Faculty of Psychology and Educational Sciences, University of Coim- degeneration: an update. Acta Neuropathol. 2010;119(1):1-4.
bra (Coimbra, Portugal). Our results were partially presented on poster 14. Johnson JK, Diehl J, Mendez MF, et al. Frontotemporal lobar
session at the 21st Meeting of the European Neurological Society, Lis- degeneration: demographic characteristics of 353 patients. Arch
bon, Portugal (Freitas S, Simões MR, Santana I. Validity study of the Neurol. 2005;62(6):925-930.
montreal cognitive assessment in patients with frontotemporal demen- 15. McKhann GM, Albert MS, Grossman M, et al. Clinical and patho-
tia. Poster presented at the 21st Meeting of the European Neurological logical diagnosis of frontotemporal dementia: report of the Work
Society; March, 2011; Lisbon, Portugal.). Group on Frontotemporal Dementia and Pick’s Disease. Arch
Neurol. 2001;58(11):1803-1809.
Declaration of Conflicting Interests 16. Snowden JS, Goulding PJ, Neary D. Semantic dementia: a form of
The author(s) declared no potential conflicts of interest with respect to circumscribed cerebral atrophy. Behav Neurol. 1989;2:167-182.
the research, authorship, and/or publication of this article. 17. Hodges JR, Patterson K, Oxbury S, Funnell E. Semantic demen-
tia. Progressive fluent aphasia with temporal lobe atrophy. Brain.
Funding 1992;115 (pt 6):1783-1806.
The author(s) disclosed receipt of the following financial support for 18. Gorno-Tempini ML, Hillis AE, Weintraub S, et al. Classification
the research, authorship and/or publication of this article: the Funda- of primary progressive aphasia and its variants. Neurology. 2011;
ção para a Ciência e Tecnologia (Portuguese Foundation for Science 76(11):1006-1014.

Downloaded from jgp.sagepub.com at TOBB Ekonomi ve Teknoloji Üniversitesi on May 13, 2014
Freitas et al 153

19. Neary D, Snowden J, Mann D. Frontotemporal dementia. Lancet 36. Nasreddine Z, Phillips NA, Bédirian V, et al. The Montreal Cog-
Neurol. 2005;4(11):771-780. nitive Assessment, MoCA: a brief screening tool for mild cogni-
20. Diehl J, Monsch A U, Aebi C, et al. Frontotemporal dementia, tive impairment. J Am Geriatr Soc. 2005;53(4):695-699.
semantic dementia, and Alzheimer’s disease: the contribution 37. Fujiwara Y, Suzuki H, Yasunaga M, et al. Brief screening toll for
of standard neuropsychological tests to differential diagnosis. mild cognitive impairment in older Japanese: validation of the
J Geriatr Psychiatry Neurol. 2005;18(1):39-44. Japanese version of the Montreal Cognitive Assessment. Geriatr
21. Gregory CA, Orrell M, Sahakian B, Hodges JR. Can frontotem- Gerontol Int. 2010;10(3):225-232.
poral dementia and Alzheimer’s disease be differentiated using 38. Lee J, Lee Dong Woo, Cho SJ, et al. Brief screening for mild cog-
a brief battery of tests?. Int J Geriatr Psychiatry. 1997;12(3): nitive impairment in elderly outpatient clinic: validation of the
375-383. Korean version of the Montreal Cognitive Assessment. J Geriatr
22. Mathuranath PS, Nestor PJ, Berrios GE, Rakowicz W, Hodges JR. Psychiatry Neurol. 2008;21(2):104-110.
A brief cognitive test battery to differentiate Alzheimer’s disease 39. Luis CA, Keegan AP, Mullan M. Cross validation of the Montreal
and frontotemporal dementia. Neurology. 2000;55(11):1613-1620. Cognitive Assessment in community dwelling older adults resid-
23. Perry RJ, Hodges JR. Differentiating frontal and temporal variant ing in the Southastern US. Int J Geriatr Psychiatry. 2009;24(2):
frontotemporal dementia from Alzheimer’s disease. Neurology. 197-201.
2000;54(12):2277-2284. 40. Rahman TT, Gaafary MM. Montreal Cognitive Assessment Ara-
24. Thompson JC, Stopford CL, Snowden JS, Neary D. Qualitative bic version: reliability and validity prevalence of mild cognitive
neuropsychological performance characteristics in frontotem- impairment among elderly attending geriatric clubs in Cairo. Ger-
poral dementia and Alzheimer’s disease. J Neurol Neurosurg iatr Gerontol Int. 2009;9(1):54-61.
Psychiatry. 2005;76(7):920-927. 41. Smith T, Gildeh N, Holmes C. The Montreal Cognitive Assess-
25. De Jesus-Hernandez M, Mackenzie IR, Boeve BF, et al. ment: validity and utility in a memory clinic setting. Can J Psy-
Expanded GGGGCC hexanucleotide repeat in noncoding region chiatry. 2007;52(5):329-332.
of C9ORF72 causes chromosome 9p-linked FTD and ALS. Neu- 42. Zhao S, Guo C, Wang M, et al. A clinical memory battery for
ron. 2011;72(2):245-256. screening for amnestic mild cognitive impairment in an elderly
26. Renton AE, Majounie E, Waite A, et al. A hexanucleotide repeat Chinese population. J Clin Neurosci. 2011;18(6):774-779.
expansion in C9ORF72 is the cause of chromosome 9p21-linked 43. Ismail Z, Rajji TK, Shulman KI. Brief cognitive screening instru-
ALS-FTD. Neuron. 2011;72(2):257-268. ments: an update. Int J Geriatr Psychiatry. 2010;25(2):111-120.
27. Folstein M, Folstein S, McHugh P. Mini-mental State. A practical 44. Lonie JA, Tierney KM, Ebmeier KP. Screening for mild cognitive
method for grading the cognitive state of patients for the clinician. impairment: a systematic review. Int J Geriatr Psychiatry. 2009;
J Psychiatr Res. 1975;12(3):189-198. 24(9):902-915.
28. Freitas S, Santana I, Simões MR. The sensitivity of the MoCA and 45. Jacova C, Kertesz A, Blair M, Fisk JD, Feldman HH. Neuropsy-
MMSE to cognitive decline: a longitudinal study. Alzheimers chological testing and assessment for dementia. Alzheimers
Dement. 2010;6(4):S353-S354 [Abstract]. Dement. 2007;3(4):299-317.
29. Ihl R, Frölich L, Dierks T, Martin EM, Maurer K. Differential 46. Garcia C. A Doença de Alzheimer: Problemas de diagnóstico
validity of psychometric tests in dementia of Alzheimer type. clı´nico [Alzheimer’s disease: Difficulties in clinical diagnosis]
Psychiatry Res. 1992;44(2):93-106. [dissertation]. Lisbon: University of Lisbon; 1984.
30. Tombaugh TN, McIntyre NJ. The Mini-Mental State Examina- 47. Rascovsky Hodges JR, Knopman D, et al. Sensitivity of revised
tion: a comprehensive review. J Am Geriatr Soc. 1992;40(9): diagnostic criteria for the behavioural variant of frontotemporal
922-935. dementia. Brain. 2011;134(pt 9):2456-2477.
31. Wind AW, Schellevis FG, Van Staveren G, Scholten RP, Jonker 48. Cummings JL, Mega M, Gray K, Rosenberg-Thompson S, Carusi
C, Van Eijk JT. Limitations of the Mini-Mental State DA, Gornbein J. The Neuropsychiatric Inventory comprehensive
Examination in diagnosing dementia in general practice. Int assessment of psychopathology in dementia. Neurology. 1994;
J Geriatr Psychiatry. 1997;12(1):101-108. 44(12):2308-2314.
32. Gregory CA, Hodges JR. Dementia of frontal type: use of 49. Kertesz A, Nadkami N, Davidson W, Thomas AW. The Frontal
consensus criteria and prevalence of psychiatric features. Behavioral Inventory in the differential diagnosis of frontotem-
Neuropsychiatr Neuropsychol Behav Neurol 1996;9:145-153. poral dementia. J Int Neuropsychol Soc. 2000;6(4):460-468.
33. Miller BL, Cummings JL, Villanueva-Meyer J, et al. Frontal lobe 50. Schaffer SG, Wisniewski A, Dahdah M, Froming KB. Emotion
degeneration: clinical, neuropsychological, and SPECT charac- Processing: The Comprehensive Affect Testing System. User’s
teristics. Neurology. 1991;41(9):1374-1382. manual. Sanford, FL: Psychology Software Inc; 2006.
34. Hodges JR, Patterson K, Ward R, et al. The differentiation of 51. Dubois B, Slachevsky A, Litvan I, Pillon B., The FAB: A Frontal
semantic dementia and frontal lobe dementia (temporal and frontal Assessment Battery at bedside. Neurology. 2000;55(11):
variants of frontotemporal dementia) from Alzheimer’s disease: a 1621-1626.
comparative neuropsychological study. Neuropsychology. 1999; 52. .Partington JE, Leiter RG Pathway Test. Psychol Serv Center
13(1):31-40. Bull. 1949;1:9-20.
35. Naugle RI, Kawczak K. Limitations of the Mini-Mental State 53. Lezak MD, Howieson DB, Loring DW. Neuropsychological
Examination. Cleve Clin J Med. 1989;56(3):277-281. Assessment. New York, NY: Oxford University Press; 2004.

Downloaded from jgp.sagepub.com at TOBB Ekonomi ve Teknoloji Üniversitesi on May 13, 2014
154 Journal of Geriatric Psychiatry and Neurology 25(3)

54. Wechsler D. Wechsler Adult Intelligence Scale. 3rd ed. Portu- 65. Yesavage JA, Brink TL, Rose TL, et al. Development and valida-
guese version. Lisbon, Portugal: Cegoc-Tea; 2008. tion of a geriatric depression screening scale: a preliminary report.
55. Wechsler D. Wechsler Memory Scale. 3rd ed. Portuguese version. J Psychiatr Res. 1983;17(1):37-49.
Lisbon, Portugal: Cegoc-Tea; 2008. 66. Freitas S, Simões MR, Alves L, Santana I. Montreal Cognitive
56. De Renzi E, Vignolo LA. The Token Test: a sensitive test to Assessment (MoCA): normative study for the Portuguese popula-
detect receptive disturbances in aphasics. Brain. 1962;85: tion. J Clin Exp Neuropsychol. 2011;33(9):989-996.
665-678. 67. Guerreiro M. Contributo da Neuropsicologia Para o Estudo
57. Buschke H. Selective reminding for analysis of memory and Das Demeˆncias [Contribution of Neuropsychology to the study
learning. J Verb Learn Verb Behav. 1973;12:543-550. of dementia] [dissertation]. Lisbon: University of Lisbon;
58. Benedict RH. Brief Visuospatial Memory Test. Revised. Odessa, 1998.
FL: Psychological Assessments Resources Inc; 1997. 68. Simões MR, Freitas S, Santana I, Firmino H, Martins C, Nasred-
59. American Psychiatric Association. Diagnostic and Statistical dine Z, Vilar M. Montreal Cognitive Assessment (MoCA): Versão
Manual of Mental Disorder., 4th ed, text revised. Washington, final portuguesa [Montreal Cognitive Assessment (MoCA): Por-
DC: American Psychiatric Association; 2000. tuguese Final Version]. Coimbra, Serviço de Avaliação Psicoló-
60. McKhann G, Drachman D, Folstein M, Katzman R, Price D, Sta- gica, Faculdade de Psicologia e de Ciências da Educação da
dlan EM. Clinical diagnosis of Alzheimer’s disease: report of the Universidade de Coimbra; 2008.
NINCDS-ADRDA Work Group under the auspices of Depart- 69. Freitas S, Simões MR, Marôco J, Alves L, Santana I.
ment of Health and Human Services Task Force on Alzheimer’s Construct validity of the Montreal Cognitive Assessment
disease. Neurology. 1984;34(7):939-944. (MoCA). J Int Neuropsychol Soc. 2012;18(2):1-9. doi:10.
61. Rosen WG, Mohs RC, Davis KL. A new rating scale for Alzhei- 1017/S1355617711001573.
mer’s disease. Am J Psychiatry. 1984;141(11):1356-1364. 70. Hanley JA, McNeil BJ. A method of comparing the areas under
62. Hughes CP, Berg L, Danziger WL, Coben LA, Martin RL. A new receiver operating characteristic curves. Radiology. 1983;
clinical scale for the staging of dementia. Brit J Psychiatry. 1982; 148(3):839-843.
140:566-572. 71. Freitas S, Simões MR, Alves L, Santana I. Montreal Cognitive
63. Alves L, Simões MR, Martins C. Teste de Leitura de Palavras Assessment (MoCA): validation study for Mild Cognitive Impair-
Irregulares (TeLPI) [Reading Word Irregular Test]. Coimbra, Ser- ment and Alzheimer’s disease. Alzheimer Dis Assoc Disord. 2012.
viço de Avaliação Psicológica da Faculdade de Psicologia e de doi: 10.1097/WAD.0b013e3182420bfe.
Ciências da Educação da Universidade de Coimbra; 2009. 72. Freitas S, Simões M R, Alves L, Vicente M, Santana I.
64. Schmand B, Jonker C, Hooijer C, Lindeboom J. Subjective mem- Montreal Cognitive Assessment (MoCA): Validation study for
ory complaints may announce dementia. Neurology. 1996;46(1): Vascular Dementia. J Int Neuropsychol Soc. 2012; doi:10.
121-125. 1017/S135561771200077X..

Downloaded from jgp.sagepub.com at TOBB Ekonomi ve Teknoloji Üniversitesi on May 13, 2014

You might also like