Professional Documents
Culture Documents
Schlapbach Et Al 2024 PCCM
Schlapbach Et Al 2024 PCCM
F
open access article distributed under
ollowing the 1992 and 2001 consensus statement of the American College the Creative Commons Attribution
of Chest Physicians, pediatric sepsis was defined through expert opinion License 4.0 (CCBY), which permits
in 2005 by the International Pediatric Sepsis Consensus Conference unrestricted use, distribution, and re-
(IPSCC) as infection in presence of at least two out of four criteria of systemic production in any medium, provided
inflammatory response syndrome (SIRS) (1, 2). Severe sepsis was defined as the original work is properly cited.
sepsis with organ dysfunction, with more weight given to cardiovascular and DOI: 10.1097/PCC.0000000000003388
organ dysfunction, it is currently unclear which to 2015 population-based multicenter prospective co-
Downloaded from http://journals.lww.com/pccmjournal by g2VIwjYxOCX6FLwXicpYKviWdeAnAKjYgMiXuEyGMjTmn
of the four available organ dysfunction crite- hort study, with clearly defined, gold standard phe-
ria in children—2005 International Pediatric
notype of blood culture-proven sepsis (2), to test the
Sepsis Consensus Conference (IPSCC) cri-
teria, Pediatric Logistic Organ Dysfunction-2 predictive performance of existing scoring systems to
(PELOD-2), pediatric Sequential Organ Failure identify children at higher mortality risk.
Assessment (pSOFA), and Pediatric Organ
Dysfunction Information Update Mandate
(PODIUM)—perform best for children with
MATERIALS AND METHODS
sepsis. Study Design
• While adult sepsis criteria are based on the We have carried out a nonprespecified secondary
SOFA score, pediatric sepsis remains defined
analysis of data collected by the Swiss Pediatric Sepsis
by IPSCC criteria, which were crafted in 2005.
Study, 2011–2015 (17). This prospective, observa-
• In view of the planned revision of pediatric tional multicenter cohort study investigated blood
sepsis criteria, there is a need for robust eval- culture-proven sepsis, as defined by IPSCC defini-
uation of organ dysfunction score performance
tions (2), in children in Switzerland. All ten major
in children with confirmed sepsis.
children’s hospitals in the country participated in the
study. These sites accounted for 78% of all pediatric
respiratory dysfunction (3). These pediatric “Sepsis-2” hospital admissions and 98% of all PICU admissions
definitions remain the only ones available for this age with an International Classification of Diseases, 10th
group, yet they have not been adequately validated (3). Revision code for pathogen-specific sepsis in children
The recent Sepsis-3 consensus definition dem- in Switzerland (17). The current analysis was approved
onstrated that infected adult patients with organ by the ethics committees of all participating centers
dysfunction, as measured by the Sequential Organ (Cantonal Ethics Committee Bern, approval number
Failure Assessment (SOFA) score, had higher mor- KEK-029/11, approval date February 20, 2018, study
tality than those without organ dysfunction, imply- title “Swiss Pediatric Sepsis Study—Impact of innate
ing higher utility of the SOFA score compared with immunity on susceptibility to sepsis in neonates and
SIRS for mortality prediction (4). The 2020 pedi- children”) and the study was conducted in accordance
atric Surviving Sepsis Campaign accordingly used with the ethical principles described in the Declaration
the terms “sepsis-associated organ dysfunction” and of Helsinki. We followed the Strengthening the
“septic shock” to delineate sepsis, rather than “severe Reporting of Observational Studies in Epidemiology
sepsis” (5). Given the limitations of the IPSCC, crite- reporting guideline (18).
ria for pediatric sepsis are currently being revised, and
a global survey among pediatricians identified that
Cohort Characteristics
the concept of sepsis-associated organ dysfunction is
widely accepted to distinguish sepsis from infection In 2011–2015, infants and children presenting with
(6–8). Yet, controversy surrounds the optimal opera- blood culture-proven bacterial or fungal sepsis, as de-
tionalization of organ dysfunction scoring in children fined by IPSCC definitions (2), were eligible if they
with infection (9). Most previous cohorts on pediatric were recruited to the Swiss Pediatric Sepsis Study with
sepsis included either children with suspected infec- an age between older than 7 days and younger than 17
tions, lacking comprehensive microbiological diag- years at sepsis onset and if patient files to verify organ
nostics, or children with microbiological results that dysfunction were available. We excluded preterm neo-
may represent either colonization, co-infection, or nates born younger than 37 weeks and neonates with
primary viral infection (10–14). Furthermore, most early-onset sepsis at younger than 7 days of life.
after blood culture sampling (19). Data on demo- outcome using area under the curve (AUC) of re-
graphics, perinatal and other risk factors, comorbidi- ceiver operating characteristic curves (25). To adjust
ties, infection site, severity, and outcome were entered the AUCs for age, sex, and presence of chronic med-
prospectively into an online database. For the cur- ical conditions, we fitted logistic mixed-effects models
rent analysis, we post hoc categorized comorbidities with a random intercept for each hospital, using the
according to the pediatric complex chronic conditions linear predictor of the fixed effects for further anal-
classification system version 2 (20). ysis by receiver operating characteristic curves and
corresponding AUCs. We estimated 95% CIs using
Organ Dysfunction Scores DeLong’s method (26). We assessed the calibration
of adjusted models with the Hosmer-Lemeshow C*-
In the original study (17), investigators prospectively
statistic (27) and Cox’s calibration regression (28), and
categorized every patient as having sepsis, severe
the overall fit of the models with Brier score (29). We
sepsis, or septic shock, according to IPSCC criteria
then examined the contribution of individual organs
(2). For this curated dataset, we additionally collected
for the prediction of the primary and secondary out-
the variables required to define, post hoc, individual
come for the IPSCC, PELOD-2, pSOFA, and PODIUM
organ dysfunctions according to IPSCC (2), Pediatric
scores, respectively. For this analysis, we used condi-
Logistic Organ Dysfunction-2 (PELOD-2) (21), pe-
tional random forest analyses that are unbiased in the
diatric SOFA (pSOFA) (22), and Pediatric Organ
presence of variables with different number of levels
Dysfunction Information Update Mandate (PODIUM)
(30). The relevance of the individual organs within a
(23) (Supplementary Methods, http://links.lww.com/
score for the prediction of the outcome was judged by
PCC/C434). For every parameter, the worst value doc-
the permutation importance (31). We additionally ana-
umented within the same calendar day during which
lyzed the IPSCC and the binarized PELOD-2, pSOFA,
the blood culture was obtained was collected. If a labo-
and PODIUM scores with logic regression models
ratory parameter had not been performed (such as lac-
that find the optimal combination of organs via cross-
tate or arterial blood gas), it was assumed to be normal,
validation of logic trees. We did sensitivity analyses
which is aligned with contemporary scoring method-
using only the first sepsis episode in every patient, to
ology (21). For PELOD-2, pSOFA, and PODIUM, in
account for the fact that a patient could experience
addition to using the full scores, we constructed a bi-
more than one sepsis episode. Further details on the
nary (yes/no) variable for the presence of each indi-
statistical analyses are presented in the Supplementary
vidual organ dysfunction, defined as yes if the score
Methods (http://links.lww.com/PCC/C434). All analy-
summary of all variables contributing to a given organ
ses were conducted with R Version 4.1.2 (32).
were greater than 0. Accordingly, we constructed
five (PELOD-2), six (IPSCC and pSOFA), and eight
(PODIUM) individual organ dysfunctions as binary RESULTS
variables. Cohort Description
1, http://links.lww.com/PCC/C434). In 442 of 877 epi- than or equal to 3 days increased incrementally with
sodes (50.4%), patients were previously healthy, and higher score values (Fig. S4, http://links.lww.com/
227 of 877 episodes (25.9%) were classified as hospital- PCC/C434), as well as with higher number of organs
acquired. The median length of stay in hospital was 14 affected (Fig. S5, http://links.lww.com/PCC/C434).
days (IQR, 8–28 d). In 289 of 877 episodes (33.0%),
l1J2vbyYFSXPO/rQ4Nzd9gPrxqlGg41/N8fsD8UYDucnGDNMKXawehKhSleK8cJzNyDRY6JKMjC5dRp+Prw on 04/04/2024
Figure 1. Upset demonstrating adjudication of presence of an organ dysfunction affected by each of the four organ dysfunction scores.
Upset (43) displaying intersections of the four organ dysfunction scores (sets). The lower shows a matrix layout for all intersections,
with dark circles indicating a sets is part of the intersection (i.e., presence of an organ dysfunction as defined by each of the four
organ dysfunction scores). The upper shows the size of intersections. IPSCC = International Pediatric Sepsis Consensus Conference,
PELOD-2 = Pediatric Logistic Organ Dysfunction-2, PODIUM = Pediatric Organ Dysfunction Information Update Mandate, pSOFA =
pediatric Sequential Organ Failure Assessment.
In adjusted analyses, the discrimination of the sec- and PODIUM for the primary outcome using condi-
ondary outcome by the organ dysfunction scores ranged tional random forest analyses. Cardiovascular, respi-
between AUC 0.73 (0.70–0.77) for PELOD-2 and AUC ratory, and neurologic dysfunction were consistently
0.76 (0.73–0.80) for pSOFA (eTable 4 and Fig. S7B, the most relevant organ dysfunctions across all four
http://links.lww.com/PCC/C434). Model calibration organ dysfunction scores, while hepatic dysfunction
and discrimination were comparable for PELOD-2, was relevant in IPSCC and PODIUM but not pSOFA
pSOFA, and PODIUM in their binarized form (eTable 4 (Fig. 4). These results were confirmed in logic regres-
and Fig. S8B, http://links.lww.com/PCC/C434). Results sion for IPSCC and binarized PELOD-2, while res-
were confirmed in sensitivity analyses (eTables 5 and 6, piratory, neurologic, and hepatic dysfunction were
http://links.lww.com/PCC/C434). most relevant for the binarized pSOFA. We could
not derive a discriminative model from the binarized
PODIUM using logic regression. Results were con-
Contribution of Individual Organ Dysfunctions
firmed in sensitivity analyses (Fig. S9, http://links.
to Mortality
lww.com/PCC/C434).
We then assessed importance of individual organ dys- We then simplified IPSCC, PELOD-2, pSOFA,
functions as defined by IPSCC, PELOD-2, pSOFA, and PODIUM by only considering information on
Figure 2. Proportions of patients meeting the primary outcome (30-d mortality) in relation to score value, according to the four organ
dysfunction scores used. Proportion of episodes with the primary outcome for International Pediatric Sepsis Consensus Conference
(IPSCC), Pediatric Logistic Organ Dysfunction-2 (PELOD-2), pediatric Sequential Organ Failure Assessment (pSOFA), and Pediatric
Organ Dysfunction Information Update Mandate (PODIUM). The x-axes denote the number of organs affected (IPSCC) or the total
score of each of the four organ dysfunction scores. Numbers above bars indicate number with the primary outcome/total number.
cardiovascular, respiratory, and neurologic dysfunc- confirms an association between organ dysfunction
tion (eTable 7, http://links.lww.com/PCC/C434). In and 30-day mortality. When comparing four pedi-
adjusted analyses, model calibration and discrimina- atric scores for organ dysfunction, discrimination of
tion were comparable to their full score equivalents the primary and secondary outcome did not substan-
(eTables 8 and 9 and Figs. S10 and S11, http://links. tially differ, however, we observed major differences in
lww.com/PCC/C434). Results were confirmed in sen- terms of classification as to whether organ dysfunction
sitivity analyses (eTables 7, 10, and 11, http://links. was present, and as to which organ was dysfunctional.
lww.com/PCC/C434). Cardiovascular, respiratory, and neurologic dysfunc-
tion emerged as the most relevant organs contributing
to a higher risk of mortality.
DISCUSSION
The relevance of organ dysfunction to identify chil-
This secondary analysis of a curated dataset from 2011 dren with higher disease severity is biologically evident
to 2015 population-based multicenter prospective and has been confirmed in multiple studies primarily
cohort study of children with blood culture-proven in intensive care settings. Yet, direct comparisons of
sepsis recruited across ED, ward, and PICU settings different approaches to adjudicate organ dysfunction,
Figure 3. Area under the receiver operating characteristics curve analyses to predict the primary outcome (30-d mortality) for each
of the four organ dysfunction scores used. Unadjusted (A), and analyses adjusted for age, sex, and presence of comorbidities, with
a random effect per study site (B) are shown. IPSCC = International Pediatric Sepsis Consensus Conference, PELOD-2 = Pediatric
Logistic Organ Dysfunction-2, PODIUM = Pediatric Organ Dysfunction Information Update Mandate, pSOFA = pediatric Sequential
Organ Failure Assessment.
TABLE 1.
Measures of Calibration and Discrimination of Adjusted Models to Predict the Primary Outcome (30-d Mortality) in
Children With Sepsis
Schlapbach et al
International
Pediatric Sepsis
Model Consensus
Assessment Conference PELOD-2 pSOFA PODIUM PELOD-2 pSOFA PODIUM
e124 www.pccmjournal.org
Area under the 0.87 (0.82–0.92) 0.83 (0.76–0.89) 0.85 (0.78–0.92) 0.85 (0.78–0.91) 0.81 (0.74–0.88) 0.82 (0.74–0.89) 0.84
curve (95% (0.77–0.90)
CI)
Hosmer-Lemeshow C*
X2 (8) 10.28 10.98 4.37 20.69 24.18 6.80 19.31
p 0.25 0.20 0.82 0.008 0.002 0.56 0.013
Cox’s calibration regression
Intercept 0.00 (–0.01 to 0.02) 0.01 (–0.01 to 0.02) 0.00 (–0.01 to 0.01) 0.00 (–0.02 to 0.02) 0.00 (–0.02 to 0.02) 0.00 (–0.01 to 0.00 (–0.01 to
(95% CI) 0.02) 0.02)
Slope (95% 0.99 (0.84–1.14) 0.86 (0.67–1.04) 0.97 (0.88–1.06) 0.98 (0.72–1.24) 0.99 (0.67–1.30) 0.96 (0.78–1.13) 0.94 (0.71–1.17)
CI)
X2 (1) 63.49 43.93 60.72 61.13 47.74 42.12 52.36
p < 0.001 < 0.001 < 0.001 < 0.001 < 0.001 < 0.001 < 0.001
Brier score 0.03 0.03 0.03 0.03 0.03 0.03 0.03
PELOD-2 = Pediatric Logistic Organ Dysfunction-2, PODIUM = Pediatric Organ Dysfunction Information Update Mandate, pSOFA = pediatric Sequential Organ Failure
Assessment.
Figure 4. Importance of individual organ dysfunctions for the prediction of the primary outcome (30-d mortality) for each of the four
organ dysfunction scores used. Permutation importance of individual organ dysfunctions from conditional random forest analyses of
2005 International Pediatric Sepsis Consensus Conference (A), Pediatric Logistic Organ Dysfunction-2 (B), pediatric Sequential Organ
Failure Assessment (C), and Pediatric Organ Dysfunction Information Update Mandate (D). A higher value indicates higher importance
compared with the other score items. Irrelevant covariates display permutation importance close to 0 or negative values.
adults with PELOD-2 based age-specific cutoffs and neurologic dysfunction were the most relevant organ
has been subsequently validated in additional studies dysfunctions in respect to prediction of the primary
(14, 22). Finally, the recent PODIUM criteria represent outcome across all four organ dysfunction scores.
the product of extensive systematic literature reviews Our observation is supported by a post hoc analysis
and expert opinion, incorporating some age-specific of a large randomized fluid trial on children with in-
cutoffs derived from other studies (such as creatinine) fection (38), and by a secondary analysis of an in-
(9, 23). Importantly, the use of these scores, except for ternational pediatric sepsis point prevalence study
IPSCC, has been largely confined to PICU settings, and (39). Interestingly, when we limited organ dysfunc-
validation, where available, was almost exclusively per- tion scores to these three organ dysfunctions, the
formed in PICU cohorts (15, 34). To date, the majority performance in unadjusted and adjusted analyses
of ED and ward-based studies investigating identifica- were surprisingly similar in comparison to the re-
tion of sicker children have focused on Early Warning spective full organ dysfunction score. Importantly,
Tools, which commonly use vital signs but only rarely cardiovascular, respiratory, and neurologic dysfunc-
provide measures of organ dysfunction (35, 36). tions are readily measurable during clinical exami-
Similar to the adult quick SOFA score (37), nation, which facilitates their assessment in ED and
we found that cardiovascular, respiratory, and in smaller hospitals without dedicated PICU or in
less resourced healthcare settings (6). However, our Our findings suggest that derived, simplified organ
findings do not preclude that the presence of other dysfunction criteria may yield comparable perfor-
organ dysfunction, such as renal failure, in partic- mance, facilitating application toward less resourced
ular, in higher acuity PICU cohorts, may contribute and nonintensive care settings.
additionally to worse prognosis for short- and long-
l1J2vbyYFSXPO/rQ4Nzd9gPrxqlGg41/N8fsD8UYDucnGDNMKXawehKhSleK8cJzNyDRY6JKMjC5dRp+Prw on 04/04/2024
ACKNOWLEDGMENTS
In contrast to previous epidemiological studies
on organ dysfunction in pediatric sepsis, the present We thank the participating patients and their fami-
study was based on data from a population-based lies. We thank the study nurses at each study site, and
multicenter prospective cohort designed to investigate SwissPedNet, the Swiss Research Network of Clinical
blood culture-proven sepsis, with all patients meet- Pediatric Hubs, for their help in running the study. We
ing IPSCC sepsis criteria. The study captured both also wish to acknowledge Torsten Hothorn for his val-
community- and hospital-acquired sepsis and is repre- uable statistical input. Members of Study Group Swiss
sentative of a broad range of comorbidities and clinical Pediatric Sepsis Study include (in alphabetical order):
settings in a high-income country (11–13). Sample size Christoph Aebi, Philipp K. A. Agyeman, Walter Bär,
in subgroups was small, however, precluding separate Christoph Berger, Sara Bernhard-Stirnemann, Eric
analysis of PICU and ED populations. In addition, the Giannoni, Paul Hasters, Ulrich Heininger, Christian
focus on blood culture-proven sepsis allowed studying R. Kahlert, Gabriel Konetzny, Antonio Leone,
a clearly defined infectious disease phenotype of high Giancarlo Natalucci, Anita Niederer-Loher, Klara M.
relevance. Posfay-Barbe, Christa Relly, Thomas Riedel, Luregn J.
A number of limitations need to be considered. Schlapbach, and Martin Stocker.
First, we excluded premature babies and those with
early-onset sepsis, given the intrinsic difficulties in 1 Department of Intensive Care and Neonatology, and
applying organ dysfunction criteria to this age group Children`s Research Center, University Children`s Hospital
(41). Additionally, patients after allogeneic bone mar- Zurich, Zurich, Switzerland.
row transplants were not included. Second, we did not 2 Child Health Research Centre, University of Queensland,
Brisbane, QLD, Australia.
develop or validate specific thresholds but used pub-
3 Division of Infectious Diseases, and Children’s Research Center,
lished organ dysfunction criteria. Third, not all crite- University Children’s Hospital Zurich, Zurich, Switzerland.
ria included in the full PODIUM score were available, 4 Department of Pediatrics, Inselspital, Bern University
which may have decreased its performance. Fourth, Hospital, University of Bern, Bern, Switzerland.
we did not consider deaths occurring greater than 5 Clinic of Neonatology, Department Mother-Woman-Child,
30 days, nor functional or quality of health outcomes Lausanne University Hospital and University of Lausanne,
Lausanne, Switzerland.
(42). Fifth, the study only included children with blood
6 Pediatric Infectious Diseases Unit, Department of Woman,
culture-proven sepsis and our findings may not gen-
Child and Adolescent, Children’s Hospital of Geneva,
eralize to sepsis caused by viral infections or culture- University Hospitals of Geneva and Faculty of Medicine,
negative sepsis. Finally, our findings date back to a Geneva, Switzerland.
cohort recruited in 2011–2015 and may not be gen- 7 Children’s Hospital Lucerne, Lucerne, Switzerland.
eralizable to other healthcare settings, in particular, to 8 Infectious Diseases and Vaccinology, University Children’s
low- or middle-income countries. Hospital Basel, Basel, Switzerland.
9 Children’s Hospital Aarau, Aarau, Switzerland.
CONCLUSIONS 10 Children’s Hospital of Eastern Switzerland, St. Gallen,
Switzerland.
In conclusion, while the performance of different 11 Department of Neonatology, University Hospital Zurich,
organ dysfunction scores was similar to predict 30-day Zurich, Switzerland.
mortality, the substantial discrepancies in terms of 12 Department of Pediatrics, Cantonal Hospital Graubuenden,
Chur, Switzerland.
organ dysfunction adjudication implies a lack of com-
Supplemental digital content is available for this article. Direct
parability and provides a strong rationale for future
URL citations appear in the printed text and are provided in the
tailoring of these scores toward a single score informed HTML and PDF versions of this article on the journal’s website
by the analysis of large international databases (6, 16). (http://journals.lww.com/pccmjournal).
Dr. Heininger received funding from Global Pertussis Initiative 5. Weiss SL, Peters MJ, Alhazzani W, et al: Surviving sepsis cam-
and the Central and Eastern Europe Pertussis Awareness Group, paign international guidelines for the management of septic
Infectopharm, Merck, Moderna, Pfizer, Roche, Sanofi, and Sanofi shock and sepsis-associated organ dysfunction in children.
Pasteur; he disclosed that he is on the Data Monitoring Committee, Pediatr Crit Care Med 2020; 21:e52–e106
the phase II study of adjuvanted pandemic influenza vaccine, the 6. Morin L, Hall M, de Souza D, et al; Pediatric Sepsis Definition
Data Monitoring Committee Norovirus Bivalent Virus-like par- Taskforce: The current and future state of pediatric sepsis
l1J2vbyYFSXPO/rQ4Nzd9gPrxqlGg41/N8fsD8UYDucnGDNMKXawehKhSleK8cJzNyDRY6JKMjC5dRp+Prw on 04/04/2024
ticle Vaccine Program, the Meta Data Safety Monitoring Board definitions: An international survey. Pediatrics 2022;
Downloaded from http://journals.lww.com/pccmjournal by g2VIwjYxOCX6FLwXicpYKviWdeAnAKjYgMiXuEyGMjTmn
18. von Elm E, Altman DG, Egger M, et al; STROBE Initiative: and regression trees, bagging, and random forests. Psychol
The Strengthening the Reporting of Observational Studies in Methods 2009; 14:323–348
Epidemiology (STROBE) statement: Guidelines for reporting 32. R Core Team: R: A Language and Environment for Statistical
observational studies. Ann Intern Med 2007; 147:573–577 Computing. Vienna, Austria, R Foundation for Statistical
19. Raith EP, Udy AA, Bailey M, et al; Australian and New Zealand Computing, 2021. Available at: https://www.R-project.org.
Intensive Care Society (ANZICS) Centre for Outcomes and Accessed December 1, 2023
l1J2vbyYFSXPO/rQ4Nzd9gPrxqlGg41/N8fsD8UYDucnGDNMKXawehKhSleK8cJzNyDRY6JKMjC5dRp+Prw on 04/04/2024
Resource Evaluation (CORE): Prognostic accuracy of the 33. Schlapbach LJ, Javouhey E, Jansen NJG: Paediatric
Downloaded from http://journals.lww.com/pccmjournal by g2VIwjYxOCX6FLwXicpYKviWdeAnAKjYgMiXuEyGMjTmn
SOFA score, SIRS criteria, and qSOFA score for in-hospital sepsis: Old wine in new bottles? Intensive Care Med 2017;
mortality among adults with suspected infection admitted to 43:1686–1689
the intensive care unit. JAMA 2017; 317:290–300 34. Weiss SL, Carcillo JA, Leclerc F, et al; Pediatric Organ
20. Feudtner C, Feinstein JA, Zhong W, et al: Pediatric complex Dysfunction Information Update Mandate (PODIUM)
chronic conditions classification system version 2: Updated Collaborative: Refining the pediatric multiple organ dysfunc-
for ICD-10 and complex medical technology dependence and tion syndrome. Pediatrics 2022; 149(Suppl_1):S13–S22
transplantation. BMC Pediatr 2014; 14:199 35. Lambert V, Matthews A, MacDonell R, et al: Paediatric early
21. Leteurtre S, Duhamel A, Salleron J, et al; Groupe Francophone warning systems for detecting and responding to clinical de-
de Réanimation et d’Urgences Pédiatriques (GFRUP): terioration in children: A systematic review. BMJ Open 2017;
PELOD-2: An update of the pediatric logistic organ dysfunc- 7:e014497
tion score. Crit Care Med 2013; 41:1761–1773 36. Romaine ST, Potter J, Khanijau A, et al: Accuracy of a modified
22. Matics TJ, Sanchez-Pinto LN: Adaptation and validation of a qSOFA score for predicting critical care admission in febrile
pediatric sequential organ failure assessment score and eval- children. Pediatrics 2020; 146:e20200782
uation of the Sepsis-3 definitions in critically ill children. JAMA 37. Seymour CW, Liu VX, Iwashyna TJ, et al: Assessment of clinical
Pediatr 2017; 171:e172352 criteria for sepsis: For the third international consensus defi-
23. Bembea MM, Agus M, Akcan-Arikan A, et al: Pediatric Organ nitions for sepsis and septic shock (Sepsis-3). JAMA 2016;
Dysfunction Information Update Mandate (PODIUM) con- 315:762–774
temporary organ dysfunction criteria: Executive summary.
38. Levin M, Cunnington AJ, Wilson C, et al: Effects of saline or
Pediatrics 2022; 149(1 Suppl 1):S1–S12
albumin fluid bolus in resuscitation: Evidence from re-analysis
24. Krippendorff K: Content Analysis: An Introduction to Its of the FEAST trial. Lancet Respir Med 2019; 7:581–593
Methodology. Second Edition. Thousand Oaks, CA, Sage, 2004
39. Lin JC, Spinella PC, Fitzgerald JC, et al; Sepsis Prevalence,
25. Hanley JA, McNeil BJ: The meaning and use of the area under Outcomes, and Therapy Study Investigators: New or progres-
a receiver operating characteristic (ROC) curve. Radiology sive multiple organ dysfunction syndrome in pediatric severe
1982; 143:29–36 sepsis: A sepsis phenotype with higher morbidity and mortality.
26. DeLong ER, DeLong DM, Clarke-Pearson DL: Comparing the Pediatr Crit Care Med 2017; 18:8–16
areas under two or more correlated receiver operating charac- 40. Weiss SL, Balamuth F, Thurm CW, et al: Major adverse kidney
teristic curves: A nonparametric approach. Biometrics 1988; events in pediatric sepsis. Clin J Am Soc Nephrol 2019;
44:837–845 14:664–672
27. Hosmer DW, Lemesbow S: Goodness of fit tests for the mul- 41. Molloy EJ, Wynn JL, Bliss J, et al; on behalf of the Infection,
tiple logistic regression model. Commun Stat - Theory Methods Inflammation, Immunology and Immunisation (I4) section of
1980; 9:1043–1069 the ESPR: Neonatal sepsis: Need for consensus definition,
28. Cox DR: Two further applications of a model for binary regres- collaboration and core outcomes. Pediatr Res 2020; 88:2–4
sion. Biometrika 1958; 45:562–565 42. Zimmerman JJ, Banks R, Berg RA, et al; Life After Pediatric
29. Brier GW: Verification of forecasts expressed in terms of prob- Sepsis Evaluation (LAPSE) Investigators: Critical illness fac-
ability. Mon Weather Rev 1950; 78:1–3 tors associated with long-term mortality and health-related
30. Hothorn T, Hornik K, Zeileis A: Unbiased recursive partition- quality of life morbidity following community-acquired pediatric
ing: A conditional inference framework. J Comput Graph Stat septic shock. Crit Care Med 2020; 48:319–328
2006; 15:651–674 43. Lex A, Gehlenborg N, Strobelt H, et al: UpSet: Visualization
31. Strobl C, Malley J, Tutz G: An introduction to recursive partition- of intersecting sets. IEEE Trans Vis Comput Graph 2014;
ing: Rationale, application, and characteristics of classification 20:1983–1992