Professional Documents
Culture Documents
Comparing The Pneumonia Severity Index With CURB-65 in Patients Admitted With Community Acquired Pneumonia
Comparing The Pneumonia Severity Index With CURB-65 in Patients Admitted With Community Acquired Pneumonia
ORIGINAL ARTICLE
From the 1Department of Infectious Diseases, Austin Health, Heidelberg, 2Department of Medicine, University of Melbourne,
and 3Department of Epidemiology and Preventative Medicine, Monash University, Australia
Abstract
Pneumonia severity assessment systems such as the pneumonia severity index (PSI) and CURB-65 were designed to direct
appropriate site of care based on 30-d mortality. Increasingly they are being used to guide empirical antibiotic therapy and
also possibly to detect patients who will require admission to the intensive care unit (ICU). We retrospectively reviewed the
records of all patients admitted to our institution with confirmed community acquired pneumonia (CAP) for the 12 months
from January 2002. 408 episodes were studied with an overall 30-d mortality of 15.4% and ICU admission of 10.5%. PSI
For personal use only.
classes IV/V were significantly better than CURB-65 score]3 for predicting patients who died within 30 d (94% vs 62%;
pB0.001), and those that needed ICU (86% vs 61%; p0.01). In addition, for the patients identified as ‘low risk’ by PSI
(classes I/II), there was only 1 death and 1 admission to an ICU compared to 8 deaths and 7 ICU admissions with CURB-
65 scores of 01. Although easier to use, CURB-65 is neither sensitive nor specific for predicting mortality in CAP patients.
Neither rule was sufficiently accurate for predicting need for an ICU, even when patients with ‘not for resuscitation’ orders
were excluded.
Correspondence: P. Charles, Department of Infectious Diseases, Austin Health, PO Box 5555, Heidelberg VIC 3084, Australia. Tel: 613 9496 6676.
Fax: 613 9496 6677. E-mail: patrick.charles@austin.org.au
patients, but may underestimate illness severity in hypoxia could be obtained if pulse oximetry results
young, otherwise healthy patients, due to the heavy were 590%. Patients were excluded if they had
weighting it accords to age and comorbidities. On the human immunodeficiency virus infection, tubercu-
other hand, CURB-65 may better identify patients at losis, aspiration pneumonitis or admission to any
the severe end of the spectrum, because it evolved hospital within the preceding 14 d.
from prediction rules originally designed to identify Primary outcome measures were 30-d mortality
patients with severe CAP [2,7,14]. However, the and need for admission to the intensive care unit
CURB-65 rule itself, like the PSI, was derived from (ICU). Mortality was assessed both by a review of
a study of features associated with 30-d mortality [7]. medical records and, if necessary, direct phone
Neither rule is ideal for predicting the need for ICU contact with patients. We also recorded need for
admission [1517]. mechanical ventilation or inotropic support, patient
The PSI was adopted by the Australian Thera- length of in-hospital stay and whether patients had a
peutic Guidelines in 2003 with recommendations on ‘not for resuscitation’ (NFR) recorded within 24 h of
hospitalization and empirical antibiotic therapy admission. The PSI and CURB-65 scores were
based on disease severity [4]. It has not, however, calculated as previously described [3,7].
Scand J Infect Dis Downloaded from informahealthcare.com by RMIT University on 09/24/13
been widely validated in Australia. Therefore, we Statistical analysis was undertaken using Stata
undertook a study to evaluate the performance of the software (Stata 8.2 for Windows; Stata Corporation,
PSI and CURB-65 at our 840-bed, university College Station, Texas, USA). Data were analysed
affiliated hospital, with particular emphasis on using the x2 test and Fisher’s exact test where
assessing their accuracy in predicting 30-d mortality, appropriate. p-values of less than 0.05 were consid-
and need for intensive care unit (ICU) admission. ered statistically significant.
Study population
admitted to our hospital with a discharge diagnosis
of CAP during a 12-month period from January 1299 patient episodes were initially assessed as
2002. Definitions of CAP, as well as inclusion and having the Emergency Department (ED) diagnosis
exclusion criteria for the study were identical to of CAP. However, 891 of these episodes were
those used in the large multi-centre PORT study of excluded, most commonly because of a normal chest
CAP [3], except that where the PORT study X-ray or because of admission to a hospital within
recorded the first results available to emergency the preceding 14 d. Reasons for exclusion are shown
clinicians, we recorded the most abnormal results in Figure 1.
identified in the Emergency Department (since these The study comprised 408 episodes of CAP in 390
were considered more practically relevant to clinical patients who fulfilled the criteria for a diagnosis of
decision-making about disease management). Thus, CAP. The characteristics of these patients are shown
inclusion criteria included: patient age 18 y or more, in Table I. Mean patient age was 72 y, with a median
admission for at least 24 h, principal discharge of 76 y. 56.2% were male and 9.3% of patients were
diagnosis of pneumonia according to the Interna- nursing home residents. A NFR was documented in
tional Classification of Diseases, 10th Edition, 17.9% (73/408) of admissions, suggesting that these
Australian Modification (ICD-10AM codes: J10- patients had either a low pre-admission life expec-
J18), chest radiograph performed within 24 h of tancy or had other clinical features that argued
admission and haematology and serum biochemistry against aggressive medical intervention.
assessment within 24 h of admission [3].
Medical records were reviewed to confirm the
Assessment of severity criteria for 30-d mortality
diagnosis of CAP, which was defined as 1 or more
symptoms suggestive of CAP (cough, sputum pro- Overall 30-d mortality was 15.4% (63/408). The
duction and fever) [1], plus chest radiograph evi- accuracy of the PSI and CURB-65 for predicting
dence of pneumonia confirmed by a radiologist. We mortality in this population is shown in Tables II and
recorded results of temperature, pulse rate, respira- III. Results using the PSI were very similar in this
tory rate, oxygen saturation, arterial blood gas population to those reported by Fine et al. [3]. One
analyses (if performed), and the number of lobes exception was PSI class III, in which mortality was
involved on chest X-ray. Mental status was assumed 4.6% in our cohort compared to 0.9%, although
to be normal unless stated otherwise, and missing absolute patient numbers in this class were small (see
results for glucose or arterial pH were assumed to be Table II). In comparison, mortality predictions using
normal. If blood gases were not taken, PSI points for CURB-65 identified similar rates for all scores other
Severity assessment rules for CAP 295
50 excluded
Admitted for < 24 h (n = 1)
Chart missing (n = 1)
than 1, in which there was a mortality of 8.5% in our CURB-65 score cut-off to 2 or more points im-
cohort, which was significantly higher (pB0.01) proved sensitivity to 87.3% (55/63), but with speci-
than the 1.7% in the study by Lim et al. [7]. Overall, ficity falling from 66.4% to 32.5%. Area under the
PSI classes IV and V predicted 93.7% (59/63) of receiver operating characteristic (ROC) curve was
deaths compared to 61.9% (39/63) for CURB-65 equivalent for PSI and CURB-65 (0.72 vs 0.69).
scores of 3 or more (pB0.001). Reducing the There was only 1 death for patients in the ‘low risk’
296 M. R. Ananda-Rajah et al.
Table I. Baseline characteristics. PSI classes (I and II combined) compared to 8 in
those with CURB-65 scores of 0 or 1 (p0.03).
Characteristic na %a 19 patients died after discharge from their initial
Total CAP episodes 480
CAP admission; 73.7% (14/19) of these died as a
Number of patients 390 result of a terminal event unrelated to CAP, but
Age: instead related to their chronic underlying comor-
Mean9SD 72 y916 bidities.
Median 76 y Of the 44/63 patients who died in hospital, 56.8%
Range 18100 y
Male 229 56.1
(25/44) had an NFR order, of whom 84.0% (21/25)
Accommodation: died within 7 d of admission. Overall, 30-d mortality
Nursing home residence 38 9.3 among patients with a NFR was 45.9% (34/74). As
Private residence 320 78.4 expected, when NFR patients were excluded from
Patient comorbidities: the analysis, the predictive accuracy for 30-d mor-
Congestive cardiac failure 105 25.7 tality of both the PSI and CURB-65 decreased for
Cerebrovascular disease 56 13.7 patients in higher risk classes: 30-d mortality for PSI
Malignancy 61 15.0
Scand J Infect Dis Downloaded from informahealthcare.com by RMIT University on 09/24/13
30-d mortality
Severity score No. episodes All patients n (%) Patients without NFRb n (%) Published results,% [Refs 3,7] ICU admissiona n (%)
PSI
Class I/II 49 1 (2.0) 0/46 0.10.6 1 (2.0)
Class III 65 3 (4.6) 2/60 (3.3) 0.9 5 (7.7)
Class IV 181 23 (12.7) 13/150 (8.7) 9.3 23 (12.7)
Class V 113 36 (31.9) 14/76 (18.4) 27.0 14 (12.4)
CURB-65
0 points 26 0 0/26 0.6 0
1 point 94 8 (8.5) 4/81 (4.9) 1.7 7 (7.4)
2 points 133 16 (12.0) 11/112 (9.8) 9.0 10 (7.5)
3 points 107 20 (18.7) 11/88 (12.5) 20.7 20 (18.7)
45 pointsc 48 19 (39.6) 3/26 (11.5) 35.1 6 (12.5)
Scand J Infect Dis Downloaded from informahealthcare.com by RMIT University on 09/24/13
nancies resulted in higher sensitivity for PSI classes with CURB-65 scores 01. This is of concern as
IV/V at 85.0% versus 62.5% for CURB-65 group patients with CURB-65 scores 01, like those in PSI
3 (34/40 vs 25/40; pB0.05). Again, specificity was classes I/II, are regarded as potentially suitable for
significantly better for CURB-65 (p B0.001). home-based treatment [3,7]. Area under ROC curve
For personal use only.
Pneumonia scoring rule Sensitivity% (95% CI) Specificity% (95% CI) PPV% (95% CI) NPV% (95% CI)
Abbreviations: CI: confidence interval; PPV: positive predictive value; NPV: negative predictive value.
298 M. R. Ananda-Rajah et al.
Table IV. Accuracy for predicting need for ICU, with and without NFRa patients.
Pneumonia scoring rule Sensitivity% (95% CI) Specificity% (95% CI) PPV% (95% CI) NPV% (95% CI)
Abbreviations: CI: confidence interval; PPV: positive predictive value; NPV: negative predictive value.
a
Not for resuscitation order within 24 h of admission.
b
n408.
c
n335.
CAP, contributing to the low positive predictive Several other studies have compared these pneu-
values for this outcome. monia severity scoring rules. A large US study of
Since admission to an ICU can be an imprecise inpatients and ambulatory patients found that the
surrogate marker of severe CAP (given differing PSI was slightly better at identifying low risk (PSI
criteria for ICU admission between hospitals), the classes IIII) patients than CURB (age criterion
For personal use only.
need for ventilatory and/or inotropic support was omitted) or CURB-65 [22]. A study comparing
assessed among these patients. 86.0% of patients CURB-65, CRB-65 (urea result omitted) and the
who were admitted to an ICU required such PSI found that they were all similar in terms of their
support, suggesting that most had severe CAP. area under the receiver operator curve graph for
Both PSI and CURB-65 correlated moderately predicting 30-d mortality. However, the authors
with this outcome, but similar to results for 30-d neglected to mention that CURB-65 scores ]3
mortality, CURB-65 misidentified 7 patients with only predicted 67% of deaths compared to 94% for
severe CAP as being ‘low risk’. PSI classes IV/V (pB0.001) [17]. CURB-65 was
The demographic characteristics of the cohort in also poor for predicting the need for mechanical
this study may have affected the performance of ventilation with a sensitivity of only 39%, and this
CURB-65, since the included patients were older study was further limited by the small number of
(mean age 72 y) and more sick (30-d mortality, patients who required an ICU (only 4.3%) [17]. An
15.6%; ICU admission, 10.5%) than those originally Australian study of CURB, CURB-65, the modified
described by Lim et al. (mean age, 64 y; 30-d British Thoracic Study (mBTS) rule, the modified
mortality, 9%; ICU admission, 5%) [7]. Also, unlike American Thoracic Society criteria, and the PSI
Lim et al., this study included residents from care found that PSI classes IV and V and CURB were
facilities for the aged and those with active malig- equivalent and performed better than CURB-65 for
nancies, although results for CURB-65 only im- 30-d mortality and ICU admission, but that the
proved marginally when we excluded these patients. rarely used mBTS rule was superior [16]. However,
Others have also questioned the usefulness of similar to Capelastegui et al. [17], conclusions were
CURB-65 in the elderly, because it does not assess based on a small number (6.6%) of ICU admissions
the impact of many comorbid illnesses on mortality compared to 1015% generally reported in the
[1820]. In addition, a minimally elevated urea, a literature [13]. A Swedish study compared these
key element of CURB-65 which was present in 57% tools in patients with bacteraemic pneumococcal
of all patients in this cohort, may not be a good infections and showed improved sensitivities for PSI
discriminator in the elderly as it is subject to multiple classes IV/V compared to CURB-65 scores ]3 for
confounders [18,19,21]. Diastolic blood pressure of predicting both 30-d mortality and need for ICU
60 mmHg or less was also a poor discriminator, [23]. A recent study from Hong Kong also demon-
being present in 42% of our patient population and strated better results for PSI for both predicting
thus contributing to the poor positive predictive deaths and need for ICU for classes IV/V compared
value of CURB-65. to CURB-65 scores ]3, as well as a lower risk of
Severity assessment rules for CAP 299
these in PSI classes I/II compared to CURB-65 [3] Fine MJ, Auble TE, Yealy DM, Hanusa BH, Weissfeld LA,
Singer DE, et al. A prediction rule to identify low-risk
scores 0 or 1 [24]. Despite these findings, the
patients with community acquired pneumonia. N Engl J
authors of 3 of these studies that showed better Med 1997;336:24350.
/ /
results for the PSI all concluded that CURB-65 was [4] Antibiotic Writing Group. Therapeutic Guidelines: Antibio-
the preferred tool because of its simplicity tic. 12th edn. North Melbourne: Therapeutic Guidelines
[17,23,24]. The common theme in these papers is Limited; 2003.
that areas under ROC curve results are similar, due [5] Hedlund J, Stralin K, Ortqvist A, Holmberg H. Swedish
guidelines for the management of community acquired
to better specificity and poorer sensitivity for CURB- pneumonia in immunocompetent adults. Scand J Infect
65. However, such ROC calculations weight sensi- Dis 2005;37:791805.
/ /
tivity and specificity equally, whereas for the identi- [6] Schouten JA, Prins JM, Bonten MJ, Degener J, Janknegt RE,
fication of severe CAP, higher sensitivity is preferable Hollander JM, et al. Revised SWAB guidelines for antimi-
because it is more important that such patients are crobial therapy of community acquired pneumonia. Neth J
Med 2005;63:32335.
detected.
/ /
[7] Lim WS, van der Eerden MM, Laing R, Boersma WG,
Our study has some limitations. In particular, the Karalus N, Town GI, et al. Defining community acquired
retrospective design meant that variables such as pneumonia severity on presentation to hospital: an interna-
Scand J Infect Dis Downloaded from informahealthcare.com by RMIT University on 09/24/13
confusion might have been under-reported in the tional derivation and validation study. Thorax 2003;58: / /
available. However, by using stringent case defini- [9] Mandell LA, Bartlett JG, Dowell SF, File TMJ, Musher
tions based on principal discharge diagnoses as well DM, Whitney C. Update of practice guidelines for the
management of community acquired pneumonia in immu-
as review of medical records and chest radiograph nocompetent adults. Clin Infect Dis 2003;37:140533./ /
reports, the likelihood that the studied patients did [10] Mandell LA, Marrie TJ, Grossman RF, Chow AW, Hyland
For personal use only.
have CAP was increased. This method is more RH. Canadian guidelines for the initial management of
robust than relying on ED diagnoses, since previous community acquired pneumonia: an evidence-based update
studies have shown that the discrepancy between ED by the Canadian Infectious Diseases Society and the
Canadian Thoracic Society. The Canadian Community-
clinicians’ interpretation of the chest radiograph and Acquired Pneumonia Working Group. Clin Infect Dis
radiologist opinion is high, with 2050% not con- 2000;31:383421.
/ /
firmed as consistent with pneumonia, despite clin- [11] British Thoracic Society. BTS guidelines for the manage-
icians’ interpretation as such [2527]. ment of community acquired pneumonia in adults: 2004
In a predominantly elderly population such as update. In: British Thoracic Society; 2004. Available from
URL: http://www.britthoracic.org.uk/iqs/sid.063199406661
these, CURB-65 did not safely identify low risk
39715803055/bts_guidelines_pneumonia_html
patients and was inferior to the PSI for predicting [12] Woodhead M, Blasi F, Ewig S, Huchon G, Leven M,
severe illness and short-term mortality. PSI classes Ortqvist A, et al. Guidelines for the management of adult
IV/V better correlated with ICU admission than lower respiratory tract infections. Eur Respir J 2005;26: / /
a result, we are undertaking a large prospective study [14] Research Committee of the British Thoracic Society and the
with 1 of its aims being to develop a more useful and Public Health Laboratory Service. Community acquired
pneumonia in adults in British hospitals in 19821983: a
accurate tool for this purpose. survey of aetiology, mortality, prognostic factors and out-
come. The British Thoracic Society and the Public Health
Laboratory Service. Q J Med 1987;62:195220.
[15] Angus DC, Marrie TJ, Obrosky DS, Clermont G, Dremsi-
References zov TT, Coley C, et al. Severe community acquired
[1] Fine MJ, Hough LJ, Medsger AR, Li YH, Ricci EM, Singer pneumonia: use of intensive care services and evaluation of
DE, et al. The hospital admission decision for patients with American and British Thoracic Society Diagnostic criteria.
community acquired pneumonia. Results from the pneumo- Am J Respir Crit Care Med 2002;166:71723.
/ /
nia Patient Outcomes Research Team cohort study. Arch [16] Buising KL, Thursky KA, Black JF, Macgregor L, Street A,
Intern Med 1997;157:3644.
/ /
Kennedy M, et al. Reconsidering what is meant by severe
[2] Neill AM, Martin IR, Weir R, Anderson R, Chereshsky A, pneumonia: a prospective comparison of severity scores for
Epton MJ, et al. Community acquired pneumonia: aetiology community acquired pneumonia. Thorax 2006;61:41924. / /
and usefulness of severity criteria on admission. Thorax [17] Capelastegui A, Espana PP, Quintana JM, Areitio I, Gor-
1996;51:10106.
/ / ordo I, Egurrola M, et al. Validation of a predictive rule for
300 M. R. Ananda-Rajah et al.
the management of community acquired pneumonia. Eur prediction rules for prognosis in community acquired
Respir J 2006;27:1517.
/ /
pneumonia. Am J Med 2005;118:38492.
/ /
[18] Kamath AV, Myint PK, Vowler SL, Harrison BD. Is it time [23] Spindler C, Ortqvist A. Prognostic score systems and
to rethink the urea criterion in CURB-65? Eur Respir J 2006;
/
community acquired bacteraemic pneumococcal pneumo-
27:13212.
/
nia. Eur Respir J 2006;28:81623.
/ /
[19] Myint PK, Kamath AV, Vowler SL, Maisey DN, Harrison [24] Man SY, Lee N, Ip M, Antonio GE, Chau SS, Mak P, et al.
BD. Severity assessment criteria recommended by the British Prospective comparison of 3 predictive rules for assessing
Thoracic Society (BTS) for community acquired pneumonia severity of community acquired pneumonia in Hong Kong.
(CAP) and older patients. Should SOAR (systolic blood Thorax 2007;62:34853.
/ /
pressure, oxygenation, age and respiratory rate) criteria be [25] Campbell SG, Murray DD, Hawass A, Urquhart D,
Ackroyd-Stolarz S, Maxwell D. Agreement between emer-
used in older people? A compilation study of 2 prospective
gency physician diagnosis and radiologist reports in patients
cohorts. Age Ageing 2006;35:28691.
discharged from an emergency department with community
/ /