Professional Documents
Culture Documents
The Pediatric Early Warning System Score: A Severity of Illness Score To Predict Urgent Medical Need in Hospitalized Children
The Pediatric Early Warning System Score: A Severity of Illness Score To Predict Urgent Medical Need in Hospitalized Children
Clinical Research—Pediatric
Keywords: Abstract
Early detection;
Purpose: We developed and performed the initial retrospective validation of a pediatric severity of
Prevention;
illness score. The score is to preemptively identify hospitalized children who are likely to require
Code blue;
resuscitation to treat cardiopulmonary arrest.
Severity of illness
Materials and Methods: The Pediatric Early Warning System (PEWS) score was developed using expert
opinion. The score generated contained 20 items, 16 of which were able to be retrospectively abstracted.
Validation used a case-control study design in a Canadian university–affiliated pediatric hospital. Eligible
patients were younger than 18 years, were admitted to a hospital ward, and had no level-of-care
restrictions. Case patients had a code blue called to obtain immediate assistance for treatment of impending
or actual cardiopulmonary arrest. Control patients had no code blue event and were not urgently admitted
to the intensive care unit within 48 hours of study. A total of 128 controls and 87 cases were compared.
Results: The PEWS score area under the receiver operating characteristic curve was 0.90. The sensitivity
was 78% and the specificity was 95% at a score of 5.
Conclusions: Application of the score may have identified more than 3 quarters of code blue calls in our
hospital with at least an hour’s warning. After further refinement and validation, the PEWS score has great
potential to increase the efficiency of care delivery and to improve the outcomes of care provided to
hospitalized children.
D 2006 Elsevier Inc. All rights reserved.
B
This work was supported by internal funding from the Department of Critical Care Medicine and the Research Institute at the Hospital for Sick Children,
Toronto, Ontario, Canada. The investigators functioned independent of these funding sources, and have no conflict of interest to declare with respect to this
publication. Drs C Parshuram and J Hutchison have received peer-reviewed funding from the Heart and Stroke Foundation of Canada to support ongoing
research in the prevention and treatment of pediatric cardiopulmonary arrest. This funding was in part related to the work described in the submitted manuscript.
BB
H Duncan contributed to the concept, design, interpretation, and manuscript revisions. J Hutchison contributed to the design, interpretation,
and manuscript revisions. CS Parshuram contributed to the concept, design, interpretation, and drafting of the manuscript and assisted with its revisions. All
authors approved the final submitted manuscript.
* Corresponding author. Department of Critical Care Medicine, Research Institute, Hospital for Sick Children, Department of Pediatrics, University of
Toronto, Toronto, Ontario, Canada M5G 1X8.
E-mail address: christopher.parshuram@sickkids.ca (C.S. Parshuram).
0883-9441/$ – see front matter D 2006 Elsevier Inc. All rights reserved.
doi:10.1016/j.jcrc.2006.06.007
272 H. Duncan et al.
1. Introduction
Up to 3% of children admitted to hospital wards require
immediate medical assistance for treatment of actual or
impending cardiopulmonary arrest [1,2]. These children
have increased morbidity and mortality associated with
cardiopulmonary arrest [3,4]. Currently, this catastrophic
clinical deterioration is treated by bcode blueQ teams called
to provide immediate resuscitation.
In adults, preemptive management may prevent cardio-
pulmonary arrest and improve mortality [5]. The provision
of critical care boutreachQ services to deliver preemptive
care is recommended in Britain [6]. However, the provision
of preemptive care relies on the timely identification of
patients at risk and referral to the responding medical
emergency team. The incomplete identification of patients
may have contributed to the negative findings of the MERIT
study, a cluster randomized trial of medical emergency Fig. 1 The PEWS concept. Trajectories of illness in 3
teams in 23 Australian hospitals [7]. hospitalized children. Child A is admitted to hospital, underwent
Two approaches to the timely identification of patients at initial stabilization, and has an uneventful hospital course before
risk may be used. First is the use of calling criteria, where discharge. Child B and Child C continue to deteriorate once
patients meeting one or more specific btriggeringQ criteria admitted to hospital. Child B is identified by the PEWS score,
receives preemptive therapy, and improves. The clinical deteriora-
are referred. Alternatively, b early warningQ scores may be
tion in child C was not recognized and culminated in a
used. These severity of illness scores combine clinical cardiopulmonary arrest.
parameters into a single score. Patients with scores greater
than a threshold are identified and referred.
Early warning scores compliment clinical decision sion, postoperative); and staffing-related items (eg, nurse-
making and can identify trends independent of practitioner patient ratio). We excluded staffing-related items from the
experience or clinical workload. Our systematic review score, as staffing variables are planned as part of the graded
found no scores for use in children and found one partially responses to Pediatric Early Warning System (PEWS) score
validated adult score [8]. We decided to develop a simple within the pediatric early warning system.
bedside score to preemptively identify children who require One focus group met again to reduce the dynamic items
resuscitation to treat actual or impending cardiopulmonary to those that were thought to be feasibly measured and
arrest (Fig. 1). documented as part of routine care. A modified Delphi
method was used [9]. Items required a 75% majority to be
either excluded or included, or were included after 3 rounds
2. Methods of inconclusive voting. The focus group then categorized
selected items into age-based and age-independent catego-
A score to identify children with increasing severity of ries, and assigned weights. The investigators reviewed
illness was developed using expert opinion synthesized by the static items. Items with unclear definitions and those
a modified Delphi method [9]. The performance of the that would be cumbersome to use in a bedside score
score was evaluated with a frequency-matched case-control were excluded.
design. Hospitalized children without code blue or urgent
intensive care unit (ICU) admission were compared with the 2.2. Clinical data
sicker children for whom a code blue was called. Eligible children were admitted to a hospital ward at the
2.1. Score development Hospital for Sick Children, were younger than 18 years at
hospital admission, and had no prespecified care limitations.
Items were generated by 2 focus groups of experienced Case patients were defined as children who had code blue
acute care nurses, facilitated by one of the investigators calls made as part of their care. In our hospital, a code blue
(CP). Items were divided into 3 domains: patient-related is called for children who are assessed to require additional
physiologic measurements, patient-related demographic, and immediate medical assistance for the treatment of actual
and care-related factors. These were reclassified into or impending cardiopulmonary arrest. Case patients were
different domains: dynamic, where measurements were retrospectively identified from the resuscitation committee
anticipated to change frequently (eg, heart rate, blood database for the 28-month period ending March 2003.
pressure, respiratory rate); static, where measurements Control patients were defined as children who had no
change infrequently (days-months, eg, previous ICU admis- code blue event and were not admitted to the pediatric
The pediatric early warning system score 273
Patient complexity
Comorbiditiesa
No. of medications
requiring routine ward-based care and sicker children who in mortality and reduced ICU admission [5,11]; however, a
subsequently had an immediate need for medical interven- recent cluster randomized trial showed that the introduction
tion. At a threshold score of 5, the sensitivity and specificity of medical emergency teams in adult hospitals did not
were 78% and 95%, respectively. The PEWS score reduce rates of cardiac arrest, unplanned ICU admission, or
identifies patients with at least a 1-hour warning before unexpected death in bmedical emergency teamsQ vs control
the code blue event. This should be sufficient time to initiate hospitals. Only 30% of patients at risk were identified to the
ward-based management and to arrange transfer to higher medical emergency team [7]. Other studies have shown that
acuity patient-care area as required. early intervention in populations of critically ill adults
improves survival [12] and late admission to ICU is
4.1. Strengths and weaknesses associated with increased mortality and nonoptimal care
[13]. If these observations are valid in children then the
This is the most detailed development of any early
application of the PEWS score to identify children with
warning score. The score was developed for nurses to use at
evolving critical illness has significant potential to decrease
the bedside and was based on the knowledge of experienced
hospitalization-associated mortality and morbidity.
acute care nurses, with minor modifications by the
physician-developers. It incorporates adjustments for age- 4.3. Implications of findings
related physiologic differences and for more constant
background risk factors. In this validation study, we We found that code blue events are infrequent. This is
calculated PEWS scores by using an electronic PEWS- fortunate, but poses challenges to the development of
scoring algorithm, rather than the frontline nurses who are screening mechanisms to identify children who are at risk
anticipated to calculate the score in real time. for this event. Application of the PEWS score would have
The largest component (dynamic items) of this expert- identified 58 (78%) of the children who were resuscitated by
derived score was validated in an independent data set the code blue team. With intervention after identification,
(Table 3), and alone has an area under the ROC curve of these children may have avoided the morbidity associated
0.83. However, the clinical data were used to assess and with urgent resuscitation [14], may have had less disease-
remove 5 static items from the score; thus, the validation of associated organ dysfunction, and consequently avoided or
the PEWS score is not completely independent of the had a shortened ICU admission. Conversely, 22% of case
development data set. In addition, the contribution of 4 patients would not have been identified, and 5% (1763
dynamic items could not be assessed because of incomplete children during the study period) of the hospitalized
or inconsistent documentation in the medical record. population would have been bfalselyQ identified as needing
However, despite the absence of these items, the score review (Table 6).
performs well. The ability of the dynamic items to There may be advantages to reviewing children with high
discriminate between case and control patients is good. PEWS scores. These children are likely to be the sickest pa-
Discrimination is improved with the addition of the static tients on the hospital wards. The immediate medical attention
items, although 12 children who went on to have a code of the code blue team may not be required; nevertheless,
blue event were above threshold on the basis of these review by early-response personnel may be beneficial.
background factors alone. The PEWS score identifies patients at risk at least 1 hour
Three potential issues remain. First, the impact of biased before imminent cardiopulmonary arrest. Earlier and graded
measurement endorsement, second the use of extreme interventions in response to rising PEWS scores may offer
groups, and third the use of the bmost availableQ medical opportunity to reduce ICU admissions. These interventions
record to select control patients. These factors may have may include altered monitoring, higher nurse-patient ratios,
inflated the differences between groups, and artificially more frequent physician review, in addition to response-
enhanced score performance. Finally, the bscoreQ was team notification, and or ICU admission. In turn, this may
developed to be used in all bpediatricQ ages; as such, it promote efficient use of available resources.
could be argued that 5 scores were developed and tested in Although the PEWS score has great potential in this initial
5 samples. Fortunately, the score performs well, both overall assessment, issues with the application of the PEWS score as
and within each subgroup. a routine bedside tool should be addressed before its wide-
spread use; specifically the usability and score-associated
4.2. Relationship to other studies workload. The investigators believe that independent pro-
spective validation and refinement is required before allo-
This is the first pediatric early warning score. We found, cating resources to the application of PEWS at the bedside.
as in adults, that clinical deterioration in patients with
evolving critical illness is detectable well before immediate
resuscitation is initiated [10]. In adult hospitals the 5. Conclusions
application of unvalidated bcalling criteriaQ in combination
with medical emergency response teams has been associated A severity of illness score for hospitalized children was
with reductions in hospital cardiac arrests, a 50% reduction developed by using nursing-expert focus groups. The PEWS
278 H. Duncan et al.
score can discriminate between children who had a code sions: the effect of a medical emergency team. Med J Aust 2000;
blue event and those who did not. At a threshold score of 5, 173:236 - 40.
[12] Rivers E, Nguyen B, Havstad S, Ressler J, Muzzin A, Knoblich B,
the sensitivity and specificity were 78% and 95%, respec- et al. Early goal directed therapy in the treatment of severe sepsis
tively. Prospective evaluation and refinement are required and septic shock. N Engl J Med 2001;345:1368 - 77.
before the score can be used routinely to detect children at [13] McQuillan P, Pilkington S, Allan A, Taylor B, Short A, Morgan G,
risk for this uncommon but highly significant event. Despite et al. Confidential inquiry into quality of care before admission to
these reservations, the PEWS score has significant potential intensive care. BMJ 1998;316:1853 - 8.
[14] Kozer E, Seto W, Verjee Z, Parshuram C, Khattak S, Koren G, et al.
to identify children who will benefit from preemptive Prospective observational study on the incidence of medication errors
therapy and to thus improve the delivery and outcome of during simulated resuscitation in a paediatric emergency department.
hospital-based care. BMJ 2004;329:1321.
Acknowledgments