Joc 01974

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 7

ORIGINAL CONTRIBUTION

Validation of Clinical Classification Schemes


for Predicting Stroke
Results From the National Registry of Atrial Fibrillation
Brian F. Gage, MD, MSc Context Patients who have atrial fibrillation (AF) have an increased risk of stroke,
Amy D. Waterman, PhD but their absolute rate of stroke depends on age and comorbid conditions.
William Shannon, PhD Objective To assess the predictive value of classification schemes that estimate stroke
risk in patients with AF.
Michael Boechler, PhD
Design, Setting, and Patients Two existing classification schemes were com-
Michael W. Rich, MD bined into a new stroke-risk scheme, the CHADS2 index, and all 3 classification schemes
Martha J. Radford, MD were validated. The CHADS2 was formed by assigning 1 point each for the presence
of congestive heart failure, hypertension, age 75 years or older, and diabetes mellitus

T
HE ATRIAL FIBRILLATION (AF) and by assigning 2 points for history of stroke or transient ischemic attack. Data from
population is heterogeneous in peer review organizations representing 7 states were used to assemble a National Reg-
terms of ischemic stroke risk. istry of AF (NRAF) consisting of 1733 Medicare beneficiaries aged 65 to 95 years who
Subpopulations have annual had nonrheumatic AF and were not prescribed warfarin at hospital discharge.
stroke rates that range from less than Main Outcome Measure Hospitalization for ischemic stroke, determined by Medi-
2% to more than 10%.1-5 Because the care claims data.
relative risk reductions from warfarin Results During 2121 patient-years of follow-up, 94 patients were readmitted to the
sodium (62%) and aspirin (22%) hospital for ischemic stroke (stroke rate, 4.4 per 100 patient-years). As indicated by a
therapy are consistent across these sub- c statistic greater than 0.5, the 2 existing classification schemes predicted stroke bet-
populations,2,6-8 the absolute benefit of ter than chance: c of 0.68 (95% confidence interval [CI], 0.65-0.71) for the scheme
antithrombotic therapy depends on the developed by the Atrial Fibrillation Investigators (AFI) and c of 0.74 (95% CI, 0.71-
underlying risk of stroke. Although 0.76) for the Stroke Prevention in Atrial Fibrillation (SPAF) III scheme. However, with
a c statistic of 0.82 (95% CI, 0.80-0.84), the CHADS2 index was the most accurate
there has been agreement that warfa- predictor of stroke. The stroke rate per 100 patient-years without antithrombotic therapy
rin therapy is favored when the risk of increased by a factor of 1.5 (95% CI, 1.3-1.7) for each 1-point increase in the CHADS2
stroke is high and that aspirin is fa- score: 1.9 (95% CI, 1.2-3.0) for a score of 0; 2.8 (95% CI, 2.0-3.8) for 1; 4.0 (95%
vored when the risk of stroke is low,9,10 CI, 3.1-5.1) for 2; 5.9 (95% CI, 4.6-7.3) for 3; 8.5 (95% CI, 6.3-11.1) for 4; 12.5
there has been little agreement about (95% CI, 8.2-17.5) for 5; and 18.2 (95% CI, 10.5-27.4) for 6.
how to predict the risk of stroke.11-13 Conclusion The 2 existing classification schemes and especially a new stroke risk
Thus, an accurate, objective scheme to index, CHADS2, can quantify risk of stroke for patients who have AF and may aid in
estimate the risk of stroke in the AF selection of antithrombotic therapy.
population would allow physicians and JAMA. 2001;285:2864-2870 www.jama.com
patients to choose antithrombotic
therapy more judiciously. tors: hypertension, prior cerebral ische- per 100 patient-years among partici-
The Atrial Fibrillation Investigators mia (either stroke or transient ische- pants randomized to no antithrom-
(AFI) pooled data from several trials to mic attack [TIA]), and diabetes mellitus botic therapy who had at least 1 of the
form a unified stroke classification (DM).2,8 There were 5.9 to 10.4 strokes 3 clinical risk factors.2,8 In contrast to
scheme. Among trial participants who
Author Affiliations: Divisions of General Medical Sci- Haven Hospital, New Haven, Conn (Dr Radford).
did not receive antithrombotic therapy, ences (Drs Gage, Waterman, and Shannon) and Car- Corresponding Author and Reprints: Brian F. Gage,
these researchers found that the risk of diology (Dr Rich), Washington University School of MD, MSc, Division of General Medical Sciences, Wash-
Medicine, St Louis, Mo; Innovative Emergency Man- ington University School of Medicine Campus, Box
stroke increased by a factor of 1.4 per agement Inc, Baton Rouge, La (Dr Boechler); and Cen- 8005, 660 S Euclid Ave, St Louis, MO 63110 (e-mail:
decade of age and by 3 clinical risk fac- ter for Outcomes Research and Evaluation, Yale–New bgage@im.wustl.edu).

2864 JAMA, June 13, 2001—Vol 285, No. 22 (Reprinted) ©2001 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ by Diana Basto on 10/24/2021


CLASSIFICATION SCHEMES FOR STROKE RISK

these high-risk participants, Medicare- because the original schemes were tension, age 75 years or older, and
aged participants without any of these based on trial participants whose aver- DM—and 2 points for a history of
risk factors were at moderate risk of age age was 69 years, their perfor- stroke or TIA. Thus, CHADS2 is an ac-
stroke, averaging 2.7 to 4.3 strokes mance in older and frailer populations ronym for the risk factors and their
per 100 patient-years. Participants is not well characterized.12 Given these scoring. For example, an 82-year-old
younger than age 65 years who had none limitations, we decided to validate the (+1) patient who had hypertension (+1)
of the 3 risk factors were at low risk 2 existing classification schemes and and a prior stroke (+2) would have a
for stroke, averaging 1.0 to 1.8 strokes their variations10,18,19 in an indepen- CHADS2 score of 4.
per 100 patient-years, and if they also dent sample.
lacked 2 equivocal stroke risk factors— Our goal was to find a convenient and State-Specific Cohorts
coronary artery disease and congestive accurate classification scheme to esti- The NRAF data set contained anony-
heart failure (CHF)—they had 0.0 to 1.6 mate stroke risk in a national registry mous patient records gathered by 5 qual-
strokes per 100 patient-years.2,8,14 of Medicare-aged patients who have ity improvement/peer review organiza-
The Stroke Prevention and Atrial Fi- nonrheumatic AF and were not pre- tions (QIO/PROs) that serve 7 states
brillation (SPAF) investigators re- scribed warfarin at the time of hospi- (California, Connecticut, Louisiana,
ported their classification scheme from tal discharge. Maine, Missouri, New Hampshire, and
SPAF participants who were treated with Vermont). These QIO/PROs had as-
aspirin therapy. Based on data from their METHODS sembled state-specific cohorts of pa-
first 2 trials, the SPAF investigators iden- Formation of CHADS2 tients with AF for quality improve-
tified 4 independent risk factors for We amalgamated the 2 classification ment projects under the Health Care
stroke: blood pressure higher than 160 schemes to form a new stroke-risk in- Quality Improvement Initiative of the
mm Hg, prior cerebral ischemia, recent dex, CHADS2. We then assessed the Health Care Financing Administra-
heart failure (ie, active within the past predictive accuracy of the AFI, SPAF, tion.25 Using Medicare Part A claims re-
100 days) or documented by echocar- and CHADS2 schemes using data from cords (MEDPAR), the QIO/PRO ana-
diography, or the combination of 75 a registry of Medicare beneficiaries who lysts used the appropriate International
years or older and being female.15 In had AF. To create the CHADS2 index, Classification of Diseases, Ninth Revi-
SPAF III, participants with hyperten- we included independent risk factors sion, Clinical Modification (ICD-9-CM)
sion lacking these risk factors had an an- that were identified in either the AFI code 427.31 in either a principal or sec-
nual stroke rate of 3.2 to 3.6 per 100 pa- or SPAF schemes: prior cerebral ische- ondary diagnosis to identify Medicare
tient-years of aspirin therapy,3,13 and the mia, history of hypertension, DM, CHF, beneficiaries who may have had AF.
rate was only 1.1 in those who also and age 75 years or older. We in- Through record review, including
lacked hypertension. cluded a history of hypertension, rather electrocardiographic and physician
The promulgation of 2 stroke-risk than having blood pressure higher documentation, QIO/PRO reviewers
classification schemes (AFI and SPAF), than 160 mm Hg, because even well- confirmed the presence of chronic or
each with cautions about how equivo- controlled hypertension is an indepen- recurrent AF during the index hospi-
cal risk factors influenced the risk of dent risk factor for stroke.20 We in- talization: Medicare beneficiaries who
stroke in low-risk participants, com- cluded age 75 years or older rather than had acute AF and beneficiaries who died
plicates the estimation of stroke risk. the combination of age 75 years or older during hospitalization were excluded.
First, the 2 schemes conflict: many pa- plus female sex, because there is an age- During their chart abstractions, QIO/
tients classified as low risk by one related increase in stroke in both PRO reviewers documented stroke risk
scheme are classified as moderate or women and men.2,5,21,22 We included re- factors, other comorbid conditions, and
high risk by the other.11-13,16 Second, the cent CHF exacerbation, rather than any the antithrombotic therapy pre-
classification schemes are sometimes CHF, because the former is similar to scribed at hospital discharge. No addi-
ambiguous. For example, into which the CHF definition used in the SPAF tional charts were abstracted to create
SPAF risk group should one classify a scheme. the NRAF dataset. Abstractors used
patient who initially presented with a To create CHADS2, we assigned 2 standardized abstraction forms and
systolic blood pressure higher than 160 points to a history of prior cerebral is- statewide sampling techniques that had
mm Hg but whose blood pressure is chemia and 1 point for the presence of been adapted by each QIO/PRO par-
controlled on follow-up evaluation? other risk factors because a history of ticipant, but QIO/PRO protocols were
Third, the development of both classi- prior cerebral ischemia increases the sufficiently similiar to allow the state-
fication schemes was data driven, and relative risk (RR) of subsequent stroke wide data sets to be combined. The 2
therefore the schemes could have cap- commensurate to 2 other risk factors QIO/PRO reviewers who calculated the
tured apparent risk factors that repre- combined. 2 , 4 , 5 , 2 3 , 2 4 We calculated inter-rater reliability for the chart ab-
sented idiosyncrasies in the data set CHADS2 by adding 1 point each for any straction found agreement between ab-
rather than true associations.17 Fourth, of the following—recent CHF, hyper- stractors of more than 90%.
©2001 American Medical Association. All rights reserved. (Reprinted) JAMA, June 13, 2001—Vol 285, No. 22 2865

Downloaded From: https://jamanetwork.com/ by Diana Basto on 10/24/2021


CLASSIFICATION SCHEMES FOR STROKE RISK

To obtain outcomes, each QIO/PRO Outcomes Assessment group identified by each classification
linked chart abstractions from the in- The study outcome was hospitaliza- scheme. We calculated the 95% confi-
dex hospitalizations to MEDPAR. The tion for ischemic stroke as deter- dence interval (CI) of these rates us-
QIO/PRO analyst obtained the dates of mined by Medicare claims. To iden- ing the binomial approximation. We
death from a separate source, the de- tify stroke from the MEDPAR data, we quantified the predictive validity of the
nominator file of living Medicare ben- used the following ICD-9-CM codes in classification schemes by using the c sta-
eficiaries. After linking a maximum of the primary position: 434 (occlusion of tistic17 to test the hypothesis that these
3 years of follow-up data and remov- cerebral arteries), 435 (transient cere- classification schemes performed sig-
ing all patient and provider identifi- bral ischemia), and 436 (acute, but ill- nificantly better than chance (indi-
ers, the QIO/PRO analysts sent the defined, cerebrovascular disease). We cated by a c statistic of 0.5).
unidentified records to Washington did not use the ICD-9-CM code of 433 To determine the predictive accu-
University for inclusion into the NRAF (occlusion and stenosis of precerebral racy of the classification schemes, we
data set. The study was approved by the arteries) because that code is used for used the bootstrap analysis to gener-
human subjects committee at Wash- asymptomatic carotid artery disease.26 ate 95% CIs using the percentile
ington University Medical Center and We had a minimum of 365 days of fol- method.30 We calculated the c statistic
by the participating PRO/QIOs. low-up claims for all Medicare benefi- on a random sample of all patients 1000
ciaries, and we censored beneficiaries times and then noted the 2.5% and
Formation of the NRAF Data Set at the time of nonstroke death or at a 97.5% percentiles. We declared the clas-
We used the QIO/PRO records to de- maximum of 1000 days after the in- sification schemes statistically signifi-
velop an NRAF data set of Medicare ben- dex hospitalization. For beneficiaries cantly different if these CIs did not
eficiaries who had documented chronic who experienced multiple strokes, we overlap.
or recurrent nonrheumatic AF. With few excluded events and patient-days of fol-
exceptions, we obtained the potential low-up that occurred after the initial RESULTS
stroke-risk factors from the chart re- stroke. Baseline Characteristics
views. One exception is that we defined of the NRAF Cohort
recent CHF as an index hospitalization Statistical Analyses Compared with participants in the AF
that carried the principal diagnosis of To calculate the stroke rate as a func- trials, the 1733 patients in the NRAF
CHF based on ICD-9-CM codes 398.91, tion of CHADS2, we used an exponen- cohort were more likely to be women
402.01, 402.11, 402.91, 428.x, or 518.4. tial survival model.27 We used the sur- and elderly and more often had stroke
The other exceptions were that 1 PRO/ vival model to measure how the hazard risk factors: history of CHF (56%), CHF
QIO did not document DM in Medi- rate for stroke was affected by each as the reason for the index hospitaliza-
care beneficiaries and 2 did not exclude 1-point increase in CHADS2 and by pre- tion (14%); history of hypertension
the presence of rheumatic heart dis- scription of aspirin. We also used the (56%); DM (23%); and history of ce-
ease. For these missing fields, we im- model to predict the annual rate of rebral ischemia (25%) (TABLE 1). The
puted the relevant history from the ap- stroke as a function of CHADS2 and of mean CHADS2 score was 2.1 for the
propriate ICD-9-CM codes (250.x for DM aspirin use. We confirmed the appro- 1204 members of the NRAF cohort who
and 393.x-398.x for rheumatic heart dis- priateness of using an exponential sur- were not prescribed any antithrom-
ease) and then excluded patients who vival model graphically (by plotting the botic therapy and 2.3 for the 529 mem-
had rheumatic heart disease. negative of the logarithm of the sur- bers who were prescribed aspirin.
From the original NRAF data set of vival curve vs time).28 We performed
3932 Medicare beneficiaries who had our survival analyses in SAS (Version Stroke Rate in the NRAF Cohort
documented AF, we excluded 2199 ben- 6.12; SAS Institute Inc; Cary, NC) us- The 1733 patients were followed up for
eficiaries from the original data set for the ing the LIFEREG and LIFETEST pro- a mean (median) of 1.2 (1.0) years.
following reasons: 229 for mitral steno- cedures.28 We calculated the RR reduc- During the 2121 patient-years of follow-
sis or rheumatic heart disease; 555 for re- tion from aspirin therapy as 1 minus the up, 94 NRAF patients were readmit-
cent surgery or trauma; 81 for transfer relative hazard of prescribing aspirin (as ted for an ischemic event (rate, 4.4 per
to another acute care facility; 65 whose obtained from the exponential model). 100 patient-years), 71 patients were ad-
ages were younger than 65 or older than To determine the predictive validity mitted for a stroke as indicated by ICD-
95 years; and 1269 for being dis- of each of the 3 classification schemes, 9-CM codes 434 or 436, and 23 pa-
charged with a prescription for warfa- we performed additional time-to- tients were admitted for transient
rin. Thus, the study cohort included event analyses. We censored deaths that cerebral ischemia as indicated by ICD-
1733 patients, aged 65 to 95 years, who were not accompanied by a hospital- 9-CM code 435. We refer to all of these
had nonrheumatic AF and who were not ization for stroke and then calculated events as stroke for simplicity and be-
prescribed warfarin therapy at the time the stroke rate based on patient-years cause 8 of the 23 patients had a subse-
of hospital discharge. of follow-up data 2 9 for each risk quent hospitalization with ICD-9-CM
2866 JAMA, June 13, 2001—Vol 285, No. 22 (Reprinted) ©2001 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ by Diana Basto on 10/24/2021


CLASSIFICATION SCHEMES FOR STROKE RISK

code 434 or 436. Of the 94 patients ad-


Table 1. Comparison of National Registry of Atrial Fibrillation (NRAF) Participants and
mitted for a stroke, 25 (27%) died Clinical Trial Participants*
within 30 days of the hospital admis- NRAF† AFI Trials‡ SPAF Trials§
sion. Characteristics (n = 1733) (n = 3432) (n = 2012)
The stroke rate was lowest among the Age, mean, y 81 69 69
120 patients in the NRAF cohort who Congestive heart failure 56 22 21
had a CHADS2 score of 0, a crude stroke Hypertension 56 46 52
rate of 1.2, and an adjusted rate of 1.9 Women 58 34 28
per 100 patient-years without anti- Diabetes 23 15 15
thrombotic therapy (TABLE 2). The Prior stroke or TIA 25 17 8
stroke rate increased by a factor of 1.5 Prescribed aspirin 31 38 100
(95% CI, 1.3-1.7) for each 1-point in- *Data are presented as percentages, unless otherwise indicated. AFI indicates Atrial Fibrillation Investigators; SPAF,
Stroke Prevention in Atrial Fibrillation; TIA, transient ischemic attack.
crease in the CHADS2 score (P,.001). †Data are from patients who were not prescribed warfarin.
‡Data are from patients who were not prescribed warfarin.2,8 Use of aspirin in the AFI trials was approximately 3%
Aspirin was associated with a hazard greater than shown because of participants in a control arm who took aspirin.
rate of 0.80 (95% CI, 0.5-1.3), corre- §Data are from patients who were not prescribed warfarin.3,13,15,18

sponding to a nonsignificant 20% RR


reduction in the rate of stroke (P=.27). Table 2. Risk of Stroke in National Registry of Atrial Fibrillation (NRAF) Participants, Stratified
The AFI and the SPAF classification by CHADS2 Score*
schemes also identified patients at low NRAF Crude NRAF Adjusted
risk for stroke. The 303 patients (17%) CHADS2 No. of Patients No. of Strokes Stroke Rate per Stroke Rate,
Score (n = 1733) (n = 94) 100 Patient-Years (95% CI)†
in the NRAF cohort identified as low
0 120 2 1.2 1.9 (1.2-3.0)
risk according to the SPAF scheme had
1 463 17 2.8 2.8 (2.0-3.8)
1.5 strokes per 100 patient-years of fol-
2 523 23 3.6 4.0 (3.1-5.1)
low-up (TABLE 3), which is similar to
3 337 25 6.4 5.9 (4.6-7.3)
the published rate of thromboembo- 4 220 19 8.0 8.5 (6.3-11.1)
lism for this population, 1.1 per 100 pa- 5 65 6 7.7 12.5 (8.2-17.5)
tient-years of aspirin therapy.3 The 490 6 5 2 44.0 18.2 (10.5-27.4)
cohort members (27%) classified as *CHADS2 score is calculated by adding 1 point for each of the following conditions: recent congestive heart failure,
moderate risk, according to the AFI hypertension, age at least 75 years, or diabetes mellitus and adding 2 points for having had a prior stroke or transient
ischemic attack. CI indicates confidence interval.
scheme, averaged 2.2 strokes per 100 †The adjusted stroke rate is the expected stroke rate per 100 patient-years from the exponential survival model, as-
patient-years of follow-up (Table 3), suming that aspirin was not taken.

which is similar to the published stroke


rate of 2.7 to 4.3 for this population.2,8 Table 3. Two Existing Risk-Classification Schemes and Their Stroke Rates*
When we excluded all cohort mem- NRAF Published
bers aged 75 years or older from the AFI Stroke Rate per Stroke Rate per
100 Patient-Years, 100 Patient-
moderate-risk cohort, the stroke rate Classification Scheme Scheme Definition (95% CI) Years Reference
was 1.1 per 100 patient-years of follow- Stroke Prevention in
up, but only 130 patients (8%) of the Atrial Fibrillation trial†
NRAF population were in this cohort. Low risk None of the following 1.5 (0.5-2.8) 1.1 3
risk factors
Moderate risk Hypertension 3.3 (1.7-5.2) 3.2-3.6 3, 13
Accuracy of the Stroke
High risk Prior ischemia, 5.7 (4.4-7.0) 5.9-7.9 15, 31
Classification Schemes women .75 years,
The AFI scheme had a c statistic of 0.68 recent CHF or LV
#25%, SBP
(95% CI, 0.65-0.71); the SPAF scheme, .160 mm Hg
0.74 (95% CI, 0.71-0.76); and CHADS2 Atrial Fibrillation
0.82 (95% CI, 0.80-0.84). Variations of Investigators‡
Low risk None of the following ... 1.0-1.8 2, 8
the classification schemes did not im- risk factors
prove their predictive accuracy. When Moderate risk Age .65 years 2.2 (1.1-3.5) 2.7-4.3 2, 8
we included all patients aged 75 years High risk Prior ischemia, 5.4 (4.2-6.5) 5.9-10.4 2, 8
or older as high risk in the AFI scheme, hypertension, DM
its corresponding c statistic was 0.49. *NRAF indicates National Registry of Atrial Fibrillation; CI, confidence interval; HTN, hypertension; CHF, congestive
heart failure; LV, left ventricular fractional shortening as measured by echocardiography; SBP, systolic blood pres-
A variation of the SPAF scheme that in- sure; ellipses, not available; and DM, diabetes mellitus.
†The NRAF stroke rates are from cohorts identified by clinical factors alone; LV fractional shortening and SBP were not
cluded patients with DM in the mod- available in the NRAF data set. Published rates are from Stroke Prevention in Atrial Fibrillation participants who took
erate risk group and did not include aspirin,3,13 sometimes in combination with ineffective doses of warfarin.15,31
‡Published rates are from Atrial Fibrillation Investigators participants randomized to no antithrombotic therapy.2,8
CHF as risk factor18 had a c statistic of
©2001 American Medical Association. All rights reserved. (Reprinted) JAMA, June 13, 2001—Vol 285, No. 22 2867

Downloaded From: https://jamanetwork.com/ by Diana Basto on 10/24/2021


CLASSIFICATION SCHEMES FOR STROKE RISK

0.72, not significantly different from the years without warfarin therapy in 66 pa- represented all geographic regions of the
original SPAF scheme. A variation of tients classified as low risk according United States. Because we formulated
CHADS2 that counted 1 point for the to the SPAF definition and observed a CHADS2 based on previous studies,
presence of any CHF had a c statistic stroke rate of 2.4 per 100 patient- rather than on the NRAF data set, our
of 0.82, identical to CHADS2 that in- years without warfarin therapy in 47 pa- study validates CHADS2. In addition, be-
cluded CHF only if it were the princi- tients classified as moderate risk ac- cause we validated CHADS2 in Medi-
pal diagnosis coded on admission. cording to the AFI scheme. Hellemons care beneficiaries who were recently hos-
In post hoc analyses, we found that et al32 found an annual rate of stroke pitalized, rather than in healthier trial
CHADS2 was a more accurate predic- of approximately 2.1 per 100 patient- participants, CHADS2 should be gener-
tor of stroke both in cohort members years of aspirin therapy in an AF trial alizable to frail or elderly patients who
who did (n = 529) and who did not that excluded patients who had a prior have nonrheumatic AF.
(n = 1204) receive aspirin. For ex- stroke or TIA or age greater than 77 The CHADS2 scheme with either
ample, in NRAF cohort members who years. During long-term follow-up of 55 definition of CHF that we tested in
were not prescribed aspirin the c sta- elderly patients with lone AF, Ko- CHADS2—any CHF as identified on
tistics were 0.71 for the AFI scheme, pecky et al1 found a stroke rate of 0.9 chart review and CHF identified as the
0.76 for the SPAF scheme, and 0.84 for per 100 patient-years, despite a low use principal diagnosis by ICD-9-CM code—
CHADS2 scheme. of warfarin. These studies support the had a c statistic of 0.82. We used the later
We also performed post hoc analy- premise that by applying a classifica- definition in CHADS2 because it was
ses to determine whether the greater tion scheme, clinicians can identify AF closer to the definition of CHF that was
predictive accuracy of CHADS2 was due patients who are at low risk for stroke an independent predictor of stroke in
to its greater number of risk strata. We even without warfarin therapy. other studies: CHF that caused symp-
collapsed the 7 CHADS2 strata (Table Because the net benefit of antithrom- toms within the past 100 days was an
2) into 3 strata: low risk (CHADS2 0 or botic therapy correlates with the under- independent predictor of stroke in
1), moderate risk (CHADS2 2 or 3), or lying risk of stroke, CHADS2 may be SPAF,4,15 and moderate or severe left-
high risk (CHADS2 4, 5, or 6) ; CHADS2 helpful in several clinical settings. For ventricular systolic dysfunction on ech-
with 3 strata had a c statistic of 0.78, example, in identifying low-risk pa- ocardiography was an independent pre-
which was 0.04 less than the value ob- tients, a CHADS2 score of 0 defines an dictor of stroke in both SPAF and
tained from the complete CHADS2. We AF population who should be offered the AFI.14,15,23 We did not have access to
also collapsed CHADS2 into 2 strata by option of aspirin therapy. In addition, echocardiographic results, which would
combining scores 0 with 1 and then CHADS2 could aid in decision making have allowed us to assess how they could
scores 2 through 6; CHADS2 with 2 for patients with AF and who are un- have improved the predictive accuracy
strata had a c statistic of 0.71. dergoing surgical or dental procedure of CHADS2 and SPAF.
because perioperative management de- Our study had several important limi-
COMMENT pends on their risk of hemorrhage from tations. First, NRAF cohort members
This study validated 2 existing stroke- the procedure compared with the un- were older and sicker than participants
risk classification schemes and a com- derlying thrombotic risk.33 Also, in pa- in clinical trials (Table 1), and the AFI
bination of these schemes, CHADS2, in tients for whom taking warfarin would and SPAF schemes may have per-
Medicare beneficiaries with nonrheu- be burdensome,34,35 CHADS2 could fa- formed better in a healthier population
matic AF who had been followed up cilitate risk stratification and selection that included patients younger than 65
from 365 to 1000 days after an index of antithrombotic therapy based on a pa- years. Because CHADS2 was based on the
hospitalization. The AFI and SPAF tient-specific risk of stroke.36,37 AFI and SPAF schemes, it too might
schemes successfully identified co- Our study has several strengths. First, have performed better in a younger or
horts with stroke rates of 1.5 to 2.2 per we used chart review, rather than ICD- healthier population. Second, we used a
100 patient-years, whereas CHADS2 9-CM claims, to document the pres- single chart review to assess most of the
identified a low-risk cohort with an ad- ence of AF and to identify the stroke risk stroke risk factors and had no way of cap-
justed stroke rate of 1.5 per 100 patient- factors. These chart reviews also identi- turing new risk factors if they devel-
years without antithrombotic therapy. fied patients who were discharged from oped. Third, we studied patients who had
Overall, CHADS2 had greater predic- the hospital and received aspirin, en- been hospitalized and who were not pre-
tive accuracy than did either AFI or abling adjustment for the prescription of scribed warfarin from our analyses. Fu-
SPAF schemes. aspirin in our calculations of the ture analyses are needed to evaluate
Other studies support our finding CHADS2-specific stroke rates. Because of CHADS2 and the other classification
that Medicare-aged patients with AF at the number of strokes (94), we were able schemes in other populations. Fourth, we
low risk for stroke can be identified pro- to calculate stroke rates with precision used Medicare claims to ascertain ische-
spectively. Feinberg et al19 observed a (Table 2). The NRAF cohort included mic events and have no way to verify
stroke rate of 1.7 per 100 patient- Medicare beneficiaries from 7 states that these events. Because Medicare claims
2868 JAMA, June 13, 2001—Vol 285, No. 22 (Reprinted) ©2001 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ by Diana Basto on 10/24/2021


CLASSIFICATION SCHEMES FOR STROKE RISK

cannot be expected to capture all strokes, R01-HS10133 from the Agency for Healthcare Re- tithrombotic therapy to prevent stroke in patients with
search and Quality (AHRQ). The authors are grateful atrial fibrillation: a meta-analysis. Ann Intern Med.
our estimates of the CHADS2-specific to the Health Care Financing Administration (HCFA) 1999;131:492-501.
stroke rates may be biased downward. of the Department of Health and Human Services and 7. The European Atrial Fibrillation Trial Study Group.
to the 5 peer review organizations who provided the Secondary prevention in non-rheumatic atrial fibril-
Comparison of stroke rates that we ob- deidentified data that made this research possible. The lation after transient ischaemic attack or minor stroke.
served with published rates (Table 3) chart abstractions were performed as part of the Health Lancet. 1993;342:1255-1262.
Care Quality Improvement Initiative that was initi- 8. Laupacis A, Boysen G, Connolly S, et al. The effi-
suggests that this ascertainment bias is ated and sponsored by HCFA under HCFA contracts cacy of aspirin in patients with atrial fibrillation: analy-
modest. In contrast, the CHADS2-specific 500-99-CA02 and Utilization and Quality Control Peer sis of pooled data from 3 randomized trials. Arch In-
stroke rates may significantly underes- Review Organization for the state of California, Cali- tern Med. 1997;157:1237-1240.
fornia Medical Review Inc provided data on 549 Medi- 9. Gage BF, Cardinalli AB, Albers GW, Owens DK.
timate the stroke rate in patients who care beneficiaries from the period of 1993-1998; un- Cost-effectiveness of warfarin and aspirin for prophy-
have high-risk conditions that we did not der HCFA contract 500-96-P549, Utilization and laxis of stroke in patients with nonvalvular atrial fi-
Quality Control Peer Review Organization for the state brillation. JAMA. 1995;274:1839-1845.
consider, such as mitral stenosis, car- of Connecticut, Qualidiqm provided data on 1598 Con- 10. Laupacis A, Albers G, Dalen J, Dunn MI, Jacob-
diac thrombus, mechanical heart valve, necticut Medicare beneficiaries from the period of son AK, Singer DE. Antithrombotic therapy in atrial
1994-1997; under HCFA contract 500-99-LA02, Uti- fibrillation. Chest. 1998;114:579S-589S.
recent anterior myocardial infarction, or lization and Quality Control Peer Review Organiza- 11. Go AS, Hylek EM, Phillips KA, et al. Implications
high-grade carotid artery stenosis. Like- tion for the state of Louisiana, Louisiana Health Care of stroke risk criteria on the anticoagulation decision
wise, CHADS2 may underestimate stroke Review Inc provided data on 531 Medicare benefi- in nonvalvular atrial fibrillation: the anticoagulation and
ciaries from the period of 1996-1998; under HCFA con- risk factors in the Atrial Fibrillation (ATRIA) study. Cir-
risk in patients with hypertension that tract 500-96-P612, Use and Quality Control Peer Re- culation. 2000;102:11-13.
exceeds 160 mm Hg5,15 or in patients with view Organization for the State of Missouri, Missouri 12. Hart RG. Warfarin in atrial fibrillation: under-
Patient Care Review Foundation provided data on 597 used in the elderly, often inappropriately used in the
a prior stroke or TIA that occurred in the Medicare beneficiaries from the period of 1993- young [editorial]. Heart. 1999;82:539-540.
previous 3 months.7,38 1996; and under HCFA contracts 500-99-ME01, 500- 13. Pearce LA, Hart RG, Halperin JL. Assessment of
99-NH01, and 500-99-VT01, Utilization and Quality three schemes for stratifying stroke risk in patients with
Although the 20% risk reduction for Control Peer Review Organization for the states of nonvalvular atrial fibrillation. Am J Med. 2000;109:
aspirin effectiveness in preventing stroke Maine, New Hampshire, and Vermont, Northeast 45-51.
was not statistically significant in this Health Care Quality Foundation provided data on 657 14. Atrial Fibrillation Investigators. Echocardio-
Medicare beneficiaries from the period of 1996- graphic predictors of stroke in patients with atrial fi-
study, it does have clinical significance 1998. brillation: a prospective study of 1066 patients from
when combined with other research. Disclaimer: The content of this publication does not 3 clinical trials. Arch Intern Med. 1998;158:1316-
necessarily reflect the views or policies of the Depart- 1320.
Our finding is consistent with a recent ment of Health and Human Services, nor does men- 15. Stroke Prevention in Atrial Fibrillation Investiga-
meta-analysis that estimated a 22% risk tion of commercial products or organizations imply en-
tors. Risk factors for thromboembolism during aspi-
dorsement of them by the US government. The authors
reduction for aspirin therapy6 but dif- assume full responsibility for the accuracy and com-
rin therapy in patients with atrial fibrillation: The Stroke
Prevention in Atrial Fibrillation study. J Stroke Cere-
fers from a subgroup analysis that found pleteness of the ideas presented. The conclusions pre-
brovasc Dis. 1995;5:147-157.
sented herein are solely those of the authors and do
no effectiveness of aspirin in AF popu- not represent those of the 5 peer review organiza-
16. Sudlow M, Thomson R, Thwaites B, Rodgers H,
lations aged 75 years or older.8 Thus, al- Kenny RA. Prevalence of atrial fibrillation and eligi-
tions, AHRQ, or HCFA. Ideas and contributions to
bility for anticoagulants in the community. Lancet.
though our nonrandomized study could the authors engaging with the issues presented are
1998;352:1167-1171.
welcome.
not determine the effectiveness of aspi- 17. Harrell FE Jr, Lee KL, Mark DB. Multivariable prog-
Acknowledgment: We thank David Nilasena, Robert
nostic models: issues in developing models, evaluat-
rin, our results suggest that aspirin A. Felberg, Lyn Dupré Oppenheimer, the Missouri Pa-
tient Care Review Foundation, and the Writer’s Group ing assumptions and adequacy, and measuring and
therapy should be prescribed for el- of the Division of General Medical Sciences at Wash- reducing errors. Stat Med. 1996;15:361-387.
18. Hart RG, Pearce LA, McBride R, Rothbart RM, As-
derly patients with AF who are not suit- ington University for their thoughtful review of a prior
inger RW, for The Stroke Prevention in Atrial Fibril-
version of the manuscript. We are indebted to Jill
able candidates for warfarin. Duncan for her statistical assistance. lation (SPAF) Investigators. Factors associated with is-
In summary CHADS2 is an easy-to- chemic stroke during aspirin therapy in atrial fibrillation:
analysis of 2012 participants in the SPAF I-III clinical
use classification scheme that esti- trials. Stroke. 1999;30:1223-1229.
REFERENCES
mates the risk of stroke in elderly pa- 19. Feinberg WM, Kronmal RA, Newman AB, et al.
1. Kopecky SL, Gersh BJ, McGoon MD, et al. Lone Stroke risk in an elderly population with atrial fibril-
tients with AF. Physicians and patients atrial fibrillation in elderly persons: a marker for car- lation. J Gen Intern Med. 1999;14:56-59.
could use CHADS2 to make decisions diovascular risk. Arch Intern Med. 1999;159:1118- 20. D’Agostino RB, Wolf PA, Belanger AJ, Kannel WB.
1122. Stroke risk profile: adjustment for antihypertensive
about antithrombotic therapy based on medication: the Framingham Study. Stroke. 1994;25:
2. Atrial Fibrillation Investigators. Risk factors for stroke
patient-specific risk of stroke. and efficacy of antithrombotic therapy in atrial fibril- 40-43.
lation. Arch Intern Med. 1994;154:1449-1157. 21. Flegel KM, Hanley J. Risk factors for stroke and
Author Contributions: Study concept and design: Gage, 3. Stroke Prevention Atrial Fibrillation III Writing Com- other embolic events in patients with non-rheumatic
Rich, Radford. mittee. Patients with nonvalvular atrial fibrillation at atrial fibrillation. Stroke. 1989;20:1000-1004.
Acquisition of data: Gage, Waterman, Boechler, low risk of stroke during treatment with aspirin: Stroke 22. Yuan Z, Bowlin S, Einstadter D, Cebul R, Conners
Radford. Prevention in Atrial Fibrillation III Study. JAMA. 1998; A, Rimm A. Atrial fibrillation as a risk factor for stroke:
Analysis and interpretation of data: Gage, Water- 279:1273-1277. a retrospective cohort study of hospitalized Medicare
man, Shannon, Rich, Radford. 4. Stroke Prevention in Atrial Fibrillation Investiga- beneficiaries. Am J Public Health. 1998;88:395-400.
Drafting of the manuscript: Gage, Waterman. tors. Predictors of thromboembolism in atrial fibrilla- 23. Stroke Prevention in Atrial Fibrillation Investiga-
Critical revision of the manuscript for important in- tion, I: clinical features of patients at risk. Ann Intern tors. Predictors of thromboembolism in atrial fibrilla-
tellectual content: Gage, Waterman, Shannon, Med. 1992;116:1-5. tion, II: Echocardiographic features of patients at risk.
Boechler, Rich, Radford. 5. van Latum JC, Koudstaal PJ, Venables GS, van Gijn Ann Intern Med. 1992;116:6-12.
Statistical expertise: Gage, Shannon, Boechler. J, Kappelle LJ, Algra A, for the European Atrial Fibril- 24. Moulton AW, Singer DE, Hass JS. Risk factors for
Obtained funding: Gage, Waterman, Radford. lation Trial (EAFT) Study Group. Predictors of major stroke in patients with nonrheumatic atrial fibrillation:
Administrative, technical, or material support: Wa- vascular events in patients with a transient ischemic a case-control study. Am J Med. 1991;91:156-161.
terman, Boechler attack or minor ischemic stroke and with nonrheu- 25. Jencks SF, Wilensky GR. The Health Care Quality
Study supervision: Rich, Radford. matic atrial fibrillation. Stroke. 1995;26:801-806. Improvement Initiative: a new approach to quality as-
Funding/Support: This project was supported by grant 6. Hart RG, Benavente O, McBride R, Pearce LA. An- surance in Medicare. JAMA. 1992;268:900-903.

©2001 American Medical Association. All rights reserved. (Reprinted) JAMA, June 13, 2001—Vol 285, No. 22 2869

Downloaded From: https://jamanetwork.com/ by Diana Basto on 10/24/2021


CLASSIFICATION SCHEMES FOR STROKE RISK

26. Benesch C, Witter DMJ, Wilder AL, Duncan PW, tors. Adjusted-dose warfarin versus low-intensity, fixed- 35. Howitt A, Armstrong D. Implementing evidence
Samsa GP, Matchar DB. Inaccuracy of the Interna- dose warfarin plus aspirin for high-risk patients with atrial based medicine in general practice: audit and quali-
tional Classification of Diseases (ICD-9-CM) in iden- fibrillation: Stroke Prevention in Atrial Fibrillation III ran- tative study of antithrombotic treatment for atrial fi-
tifying the diagnosis of ischemic cerebrovascular dis- domised clinical trial. Lancet. 1996;348:633-638. brillation. BMJ. 1999;318:1324-1327.
ease. Neurology. 1997;49:660-664. 32. Hellemons BS, Langenberg M, Lodder J, et al. Pri- 36. Gage BF, Cardinalli AB, Owens DK. Cost-
27. Lee E. Statistical Methods for Survival Data Analy- mary prevention of arterial thromboembolism in non- effectiveness of preference-based antithrombotic
sis. 2nd ed. New York, NY: John Wiley & Sons; 1992. rheumatic atrial fibrillation in primary care: ran- therapy for patients with nonvalvular atrial fibrilla-
28. Allison PD. Survival Analysis Using the SAS Sys- domised controlled trial comparing two intensities of tion. Stroke. 1998;29:1083-1091.
tem: A Practical Guide. Cary, NC: SAS Institute Inc; 1995. coumarin with aspirin. BMJ. 1999;319:958-964. 37. Man-Son-Hing M, Laupacis A, O’Connor AM, et
29. Rothman KJ, Greenland S. Modern Epidemiol- 33. Kearon C, Hirsh J. Management of anticoagula- al. A patient decision aid regarding antithrombotic
ogy. 2nd ed. Philadelphia, Pa: Lippincott-Raven Pub- tion before and after elective surgery. N Engl J Med. therapy for stroke prevention in atrial fibrillation: a
lishers; 1998. 1997;336:1506-1511. randomized controlled trial. JAMA. 1999;282:737-
30. Mooney CZ, Duval RD. Bootstrapping: A Non- 34. Gage BF, Cardinalli AB, Owens DK. The effect of 743.
parametric Approach to Statistical Inference. New- stroke and stroke prophylaxis with aspirin or warfarin 38. Foulkes MA, Sacco RL, Mohr JP, Hier DB, Price
bury Park, Calif: Sage Publications Inc; 1993. on quality of life. Arch Intern Med. 1996;156:1829- TR, Wolf PA. Parametric modeling of stroke recur-
31. Stroke Prevention in Atrial Fibrillation Investiga- 1836. rence. Neuroepidemiology. 1994;13:19-27.

An active field of science is like an immense anthill;


the individual almost vanishes into the mass of minds
tumbling over each other, carrying information from
place to place, passing it around at the speed of light.
—Lewis Thomas (1913-1994)

2870 JAMA, June 13, 2001—Vol 285, No. 22 (Reprinted) ©2001 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ by Diana Basto on 10/24/2021

You might also like