Skip to main content

Validation of the pediatric refractory septic shock definition: post hoc analysis of a controlled trial

Abstract

Background

The European Society of Pediatric and Neonatal Intensive Care (ESPNIC) developed and validated a definition of pediatric refractory septic shock (RSS), based on two septic shock scores (SSS). Both bedside SSS (bSSS) and computed SSS (cSSS) were found to be strongly associated with mortality. We aimed at assessing the accuracy of the RSS definition on a prospective cohort from India.

Methods

Post hoc analysis of a cohort issued from a double-blind randomized trial that compared first-line vasoactive drugs in children with septic shock. Sequential bSSS and cSSS from 60 children (single-center study, 53% mortality) were analyzed. The prognostic value of the ESPNIC RSS definition was tested for 28-day all-cause mortality.

Results

In this septic shock cohort, RSS was diagnosed in 35 patients (58.3%) during the first 24 h. Death occurred in 30 RSS patients (85.7% mortality) and in 2 non-RSS patients (8% mortality), OR = 60.9 [95% CI: 10.5–676.2], p < 0.001 with a median delay from sepsis onset of 3 days [1.0–6.7]. Among patients diagnosed with RSS, the mortality was not significantly different according to vasopressors randomization. Diagnosis of RSS with bSSS and cSSS had a high discrimination for death with an area under the receiver operating curve of 0.916 [95% CI: 0.843–0.990] and 0.925 [95% CI: 0.845–1.000], respectively. High prognostic accuracy of the bSSS was found in the first hours following intensive care admission. The best interval of prognostication occurs after the 12th hour following treatment initiation (AUC 0.973 [95% CI: 0.925–1.000]).

Conclusions

The ESPNIC refractory septic shock definition accurately identifies, within the first 6 h of septic shock management, children with lethal outcome.

Background

Septic shock, defined as fluid-refractory sepsis with organ dysfunction encompasses various clinical and pathophysiological entities. The Surviving Sepsis Campaign [1] and the American College of Critical Care Medicine guidelines for Hemodynamic Support in Neonates and Children [2] issued guidelines for patients with sepsis including the subset of patients who are unresponsive to vasopressors and labeled as having refractory septic shock (RSS). RSS is described as a circulatory failure due to septic cardiomyopathy [3, 4] with or without vasoplegia [5]. Survival observed following short-term circulatory support with newer vasoactive agents or extra-corporeal life support (ECLS) is an indicator that RSS is potentially reversible [6]. To maximize the impact of these rescue therapies, a robust tool for early detection of RSS was required. The European Society of Pediatric and Neonatal Intensive Care (ESPNIC) defined RSS as the association of high blood lactate with high vasopressor doses and/or myocardial dysfunction [7]. This definition based on two septic shock scores (SSS) showed excellent discriminative power and suggested that both bedside (bSSS) and computed (cSSS) septic shock scores are powerful and potentially useful tools to categorize severity and compare patients in future interventional randomized multicenter studies on septic shock in children. Nevertheless, this RSS definition was established on retrospective data from European and Australian centers and a prospective validation is mandatory as part of the validation process [8]. Furthermore, it may not have been representative of the regional diversity of critically ill children case mix. There is substantial data outlining the differences in sepsis incidence and etiology between regions, with increased incidence of immunodepressed patients (e.g., oncology, solid organ transplantation) in high-income countries in contrast to low- and middle-income countries [9, 10]. In addition, variability in sepsis management may occur and potentially impact sepsis outcome [10]. In order to overcome these limitations, we evaluated the validity of the ESPNIC RSS definition and SSS scores in a post hoc analysis of a double-blind randomized trial aimed at comparing first-line vasoactive drugs in children with septic shock in India [8].

Material and methods

Patients

All patients (n = 60) included in the double-blind randomized trial at the Advanced Paediatrics Center, Post Graduate Institute of Medical Education and Research, Chandigarh, India, were included in the post hoc analysis. The study protocol has been previously described [8]. In summary, this was a monocentric randomized controlled trial on septic shock children comparing dopamine to epinephrine as first-line vasoactive agents. Patients aged between 3 months and 12 years were enrolled if they had fluid-refractory septic shock and admitted in pediatric intensive care unit between July 2013 and December 2014. The study was registered (CTRI/2014/02/004393) and a local institutional review board approved the use of the database for this study and waived the need for informed consent.

Data

Patients baseline characteristics including gender, age, Pediatric Risk of Mortality (PRISM) III and Pediatric Logistic Organ Dysfunction (PELOD) score, blood lactate, central venous oxygen saturation (ScvO2), vasoactive-inotropic score (VIS) as well as the occurrence of severe acute respiratory distress syndrome (ARDS) defined according to Berlin definition [11] and use of renal replacement therapy were analyzed. There was no missing data, as analyzed items were part of the main outcome measurements from the original study [8]. Both bSSS and cSSS were calculated every 6 h for the first 24 h. The bSSS is a 0 to 5 points score with 1 point for a lactate value above 8 mmol/L or increased > 1 mmol/L after 6 h of management, 1 point for a VIS > 200 and 3 points for the presence of a severe cardiomyopathy defined by a cardiac index < 2.2L/min.m2 or a left ventricle ejection fraction < 25%. The cSSS is calculated with: cSSS = 1.1blood lactate value + 1.001VIS + 18 (in the presence of a severe cardiomyopathy). The impact of the interventional group (dopamine or epinephrine) was considered in the analysis. Primary outcome was 28 days all-cause mortality.

Statistical analysis

Continuous variables were tested for normality with Kolmogorov–Smirnov test and compared with Student’s t test or Mann–Whitney test, as appropriate. Non-continuous variables were tested with Chi-squared test or Fisher’s exact test, as appropriate. Data were described as frequencies and percentages, means and standard deviations or median and interquartile range (IQR), as appropriate. Multivariable Cox’s regression with backward-stepwise method was performed having as outcome 28 days all-cause mortality. Covariates inserted in the models were PRISM III and computed SSS. We measured the discrimination of each score using the area under the receiver operating characteristic curve (AUROC) and expressed values with its 95% confidence interval (CI). The best thresholds for these scores were obtained with the calculation of sensitivity, specificity, positive and negative predictive values and the Youden’s index (Y = sensitivity + specificity − 1). The DeLong test was used to compare the AUROC of both scores. Survival of RSS patients according to both scores have been evaluated by Kaplan–Meier curves and these latter have been tested using log-rank test. A p value of less than 0.05 was considered statistically significant. Statistical analyses were performed with SPSS 19.0.0 (SPSS, Chicago, IL) software.

Results

Of the 210 patients diagnosed with sepsis and screened, 61 children were eligible for enrollment. One parent refused consent, 29 children were randomized to epinephrine group and 31 to dopamine group. All the enrolled subjects completed the study, and were followed up to 28 days. Patients in the epinephrine group achieved earlier resolution of fluid-refractory hypotensive shock in children as compared to dopamine. The baseline characteristics are presented in Table 1. A RSS was diagnosed in 35 patients (58.3%) with a bSSS ≥ 2 or a cSSS ≥ 3.5. Mortality in the RSS patients (n = 30/35, 85.7% mortality) was higher than in non-RSS patients (n = 2/25, 8% mortality), OR = 60.9 [95% CI: 10.5–676.2], p < 0.001. The survival curves of the patients diagnosed with RSS are presented in Fig. 1a and b. There was no significant difference in discrimination of mortality between bSSS and cSSS with, respectively, an AUROC of 0.916 [95% CI: 0.843–0.990] and 0.925 [95% CI: 0.845–1.000] (Fig. 2). The best binary performance for bSSS was ≥ 2 for bSSS (Youden’s index = 0.76) and > 20,5 for cSSS (Youden’s index = 0.78). A bSSS ≥ 2 was associated with an in-hospital mortality of 50% [positive LR: 5.25, 95% CI = 2.4–11.7], a sensitivity of 93.7% [95% CI: 79.2–99.2] and a specificity of 82.1% [95% CI: 63.1–93.9]. A cSSS > 20.5 was associated with an in-hospital mortality of 93.1% [positive LR: 22.7, 95% CI: 3.3–157], a sensitivity of 81.2% [95% CI: 63.6–92.8] and a specificity of 96.4% [95% CI: 81.7–99.9]. The measure of bSSS between the 12th and 24th hour following septic shock diagnosis was the most discriminative for in-hospital mortality with an AUROC of 0.973 [95% CI: 0.924–1.000], compared to 0 to 6th hours 0.876 [95% CI: 0.780–0.972], p = 0.011 (Fig. 3).

Table 1 Baseline characteristics
Fig. 1
figure1

a Survival curve of refractory septic shock patients diagnosed with a bedside septic shock score ≥ 2. b Survival curve of refractory septic shock patients diagnosed with a computed septic shock score ≥ 3.5

Fig. 2
figure2

Receiver operating curve (ROC) and area under the ROC for mortality of bedside Septic Shock Score (bSSS) calculated in the first 24 h of admission for septic shock

Fig. 3
figure3

Receiver operating curve (ROC) and area under the ROC for mortality of bedside Septic Shock Score (bSSS) calculated in the first 24 h following admission for septic shock

We did not find any effect of the group of interventions on the computed score (epinephrine group cSSS = 3.22 [95% IC: 2.32–21.53] and dopamine group cSSS = 20.68 [95% CI: 2.41–21.47], p = 0.242) or the bedside score (epinephrine group bSSS = 1 [95% CI: 0–4] and dopamine group bSSS = 4 [95% CI: 0–4], p = 0.281). Among patients diagnosed with RSS (bSSS > 2 or cSSS > 3.5), the mortality was not significantly different according to randomization to epinephrine (N = 13/14 death, 92.9% mortality) or dopamine (n = 17/21, 81% mortality), RR = 1.15 [95% CI: 0.89–1.48], p = 0.627. We compared the association of the SSS and PRISM III to mortality using a backward logistic regression and found an independent association with PRISM III (exp(B) = 1.77, 95% CI: [1.11–2.81], p = 0.015) and cSSS (exp(B) = 1.495, 95% CI: [1.07–2.08], p = 0.018). The bSSS was not tested as it was not developed as a linear score, but a quick tool to assess patients at the bedside.

Discussion

This study showed that the bedside and computed septic shock scores discriminated the most severe cases in a prospective cohort from India and confirmed the accuracy of these scores. Patients diagnosed in RSS had a very high mortality. While the presence of a severe myocardial dysfunction is not mandatory for the diagnosis of RSS, it was present in all patients in this study. This point reinforces the importance of septic cardiomyopathy in the pathophysiology of RSS. El Nawawy et al. demonstrated in a small monocentric cohort the added value of myocardial and hemodynamic evaluation with echocardiography and confirmed the high incidence of myocardial dysfunction in pediatric septic shock [12, 13]. The vasoactive-inotropic score used in the SSS is validated in pediatric sepsis as a marker of severity. Interestingly, MacIntosh et al. found a similar pattern of evolution of the VIS with a best correlation with morbidity after the 12th hour of care [14]. Meanwhile, the addition of blood lactate and myocardial dysfunction in the SSS may explain the excellent discrimination power as early as within the first 6 h of management. Blood lactate with a cut-off value of 4 mmol/L was associated with mortality in a large cohort of pediatric sepsis patients [15]. Despite having a higher lactate cut-off value of 8 mmol/L, the bSSS does not seem to have lower sensitivity than the cSSS. In this study, both bSSS and cSSS identified the same number of RSS patients with similar outcome. The high lactate cut-off value in the bSSS effectively selects patients at the highest risk of mortality and with catecholamine-refractory shock. Interestingly, bSSS ≥ 2 cut-off confirmed the one set in the original study [7]. However, cSSS best cut-off is higher in this cohort than in the original. This is due to a strong impact of myocardial dysfunction (+ 18 points) and its elevated incidence in the present cohort where all patients in RSS had myocardial failure. The stronger association of myocardial dysfunction and mortality seen in this study emphasize the heterogeneity in the case mix and management, and further support the use of bSSS that shows to encompass accurately the whole spectrum of RSS.

Our previous study’s main limitation was the uncertainty about the simultaneity of the measure of lactate, VIS and/or the presence of cardiomyopathy. The present study focused on the first 24 h of management, all the measures were associated with discrimination for mortality. Nevertheless, the scores were best predictive of mortality after the first 12th hour of management. This may be explained by the need for the vasopressors to be progressively increased until the VIS cut-off is reached, or the patient deteriorates with the occurrence of septic cardiomyopathy. Timing is essential in RSS diagnosis. An early diagnosis of RSS in the first 24 h associated with a 60% [7] to 85.7% (present study) estimated mortality should be a strong indicator of need for adjunct therapies.

A recent study found that refractory shock is the first cause of mortality in pediatric septic shock patients [16]. This fact emphasizes the need for a definition of RSS, thus, its validation in this study. Despite being a less frequent cause of death, multiple-organ dysfunction syndrome (MODS) can be diagnosed or assessed with several scores such as PELOD 2 and PIM 2. While PIM 2 may only be measured at admission, PELOD 2 can be measured sequentially [17]. However, in our study PELOD was not calculated sequentially. The PRSIM III score, designed to estimate mortality, was found to be independently associated with mortality. Although formerly not evaluating organ failure, PRSIM III score is calculated using many clinical and biochemical criterion surrogated of organ failures. In the RSS definition process, individual organ failures were not retained by pediatric critical care experts preferring quantifiable cardio-circulatory criterion [7]. Our study confirms the importance of cardio-circulatory failure in sepsis severity and prognostication and although not being specifically investigated, a potential hierarchical importance over individual organ failure may be suggested.

The first limitation of this study is that it was a post hoc analysis of a single-center randomized trial. The use of inotrope or vasopressor in the original study was protocolized, which may have affected the increase in the inotropes or vasopressors, hence the VIS and the predictive performances of the SSS in the first hour of management. Nevertheless, the randomization drug was not associated with increase mortality in the multivariable analysis. Secondly, all patients diagnosed with RSS had a severe cardiomyopathy diagnosed with cardiac ultrasound, which is a sufficient criterion for the diagnosis of RSS. Indeed, cardiac ultrasound is questionable due to the subjectivity of the exam and the risk of error for the diagnosis of cardiac failure due to the presence of hypovolemia. Yet, this risk for over-diagnosis of RSS appears unlikely when considering the good performance of the scores and the high mortality in the RSS group. Thirdly, most scores used or currently discussed in the question of sepsis and septic shock diagnosis were unavailable in our cohort, hence we could not compare their performance with the SSS.

This study’s strengths are the homogeneous and well-characterized cohort of patients with septic shock with timely measured SSS. It is to our knowledge the first prospective study to evaluate sequentially during the first 24 h the prognosis performances of these scores in pediatric septic shock patients. This study provides clear evidence that RSS is a specific entity responsible for most deaths in pediatric septic shock.

Conclusion

This post hoc prospective single-center study validates septic shock scores used to diagnose refractory septic shock, showing excellent discriminatory power for mortality in the first hours of management. Future studies should explore the application of this definition in a multicentric prospective cohort of patients and investigate the benefits obtained from adjunct therapies dedicated to the patients with the highest risk of death.

Availability of data and materials

All materials are available upon request to Pr. Sunit Singhi at sunitcsinghi@gmail.com.

Abbreviations

ESPNIC:

European Society of Pediatric and Neonatal Intensive Care

RSS:

Refractory septic shock

b-/c-SSS:

Bedside/computed Septic Shock Score

ECLS:

Extra-corporeal life support

PRISM:

Pediatric Risk of Mortality

MODS:

Multiple-organ dysfunction syndrome

PELOD:

Pediatric Logistic Organ Dysfunction

PIM:

Pediatric Index of Mortality

VIS:

Vaso-Inotropic Score

LR:

Likelihood ratio

CI:

Confidence interval

References

  1. 1.

    Dellinger RP, Levy MM, Rhodes A, Annane D, Gerlach H, Opal SM, et al. Surviving sepsis campaign: international guidelines for management of severe sepsis and septic shock: 2012. Crit Care Med. 2013;39:580–637.

    Article  Google Scholar 

  2. 2.

    Davis AL, Carcillo JA, Aneja RK, Deymann AJ, Lin JC, Nguyen TC, et al. The American College of Critical Care Medicine Clinical Practice Parameters for Hemodynamic Support of Pediatric and Neonatal Septic Shock: executive summary. Crit Care Med. 2017;18(9):884–90.

    Article  Google Scholar 

  3. 3.

    Parker MM, Shelhamer JH, Bacharach SL, Green MV, Natanson C, Frederick TM, et al. Profound but reversible myocardial depression in patients with septic shock. Ann Intern Med. 1984;100(4):483–90.

    CAS  Article  Google Scholar 

  4. 4.

    Pathan N, Hemingway CA, Alizadeh AA, Stephens AC, Boldrick JC, Oragui EE, et al. Role of interleukin 6 in myocardial dysfunction of meningococcal septic shock. Lancet. 2004;363(9404):203–9.

    CAS  Article  Google Scholar 

  5. 5.

    Deep A, Goonasekera CDA, Wang Y, Brierley J. Evolution of haemodynamics and outcome of fluid-refractory septic shock in children. Intensive Care Med. 2013;39(9):1602–9.

    Article  Google Scholar 

  6. 6.

    MacLaren G, Butt W, Best D, Donath S. Central extracorporeal membrane oxygenation for refractory pediatric septic shock. Pediatr Crit Care Med. 2011;12(2):133–6.

    Google Scholar 

  7. 7.

    Morin L, Ray S, Wilson C, Remy S, Benissa MR, Jansen NJG, et al. Refractory septic shock in children: a European Society of Paediatric and Neonatal Intensive Care definition. Intensive Care Med. 2016;42(12):1948–57.

    Article  Google Scholar 

  8. 8.

    Ramaswamy KN, Singhi S, Jayashree M, Bansal A, Nallasamy K. Double-blind randomized clinical trial comparing dopamine and epinephrine in pediatric fluid-refractory hypotensive septic shock. Pediatr Crit Care Med. 2016;17(11):e502–12.

    Article  Google Scholar 

  9. 9.

    Schlapbach LJ, Straney L, Alexander J, MacLaren G, Festa M, Schibler A, et al. Mortality related to invasive infections, sepsis, and septic shock in critically ill children in Australia and New Zealand, 2002–13: a multicentre retrospective cohort study. Lancet Infect Dis. 2015;15(1):46–54.

    Article  Google Scholar 

  10. 10.

    Schultz MJ, Dunser MW, Dondorp AM, Adhikari NK, Iyer S, Kwizera A, et al. Current challenges in the management of sepsis in ICUs in resource-poor settings and suggestions for the future. Intensive Care Med. 2017;43(5):612–24.

    Article  Google Scholar 

  11. 11.

    De Luca D, Piastra M, Chidini G, Tissieres P, Calderini E, Essouri S, et al. The use of the Berlin definition for acute respiratory distress syndrome during infancy and early childhood: multicenter evaluation and expert consensus. Intensive Care Med. 2013;39(12):2083–91.

    Article  Google Scholar 

  12. 12.

    El-Nawawy AA, Abdelmohsen AM, Hassouna HM. Role of echocardiography in reducing shock reversal time in pediatric septic shock: a randomized controlled trial. J Pediatr (Rio J). 2018;94(1):31–9.

    Article  Google Scholar 

  13. 13.

    Raj S, Killinger JS, Gonzalez JA, Lopez L. Myocardial dysfunction in pediatric septic shock. J Pediatr. 2014;164(1):72-77.e2.

    Article  Google Scholar 

  14. 14.

    McIntosh AM, Tong S, Deakyne SJ, Davidson JA, Scott HF. Validation of the Vasoactive-Inotropic Score in Pediatric Sepsis*. Pediatr Crit Care Med. 2017;18(8):750.

    Article  Google Scholar 

  15. 15.

    Scott HF, Brou L, Deakyne SJ, Kempe A, Fairclough DL, Bajaj L. Association between early lactate levels and 30-day mortality in Clinically Suspected Sepsis in Children. JAMA Pediatr. 2017;171(3):249–55.

    Article  Google Scholar 

  16. 16.

    Weiss SL, Balamuth F, Hensley J, Fitzgerald JC, Bush J, Nadkarni VM, et al. The epidemiology of hospital death following pediatric severe sepsis: when, why, and how children with sepsis die. Pediatr Crit Care Med J Soc Crit Care Med World Fed Pediatr Intensive Crit Care Soc. 2017;18(9):823–30.

    Google Scholar 

  17. 17.

    Slater A, Shann F, Pearson G, Paediatric Index of Mortality (PIM) Study Group. PIM2: a revised version of the Paediatric Index of Mortality. Intensive Care Med. 2003;29(2):278–85.

    Article  Google Scholar 

Download references

Funding

None.

Author information

Affiliations

Authors

Contributions

Study conception and design: LM, PT, KR, SS. Acquisition, analysis, or interpretation of data: LM, PT, KR. Statistical analysis: KR, LM. Drafting and revision of the work: all authors. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Pierre Tissieres.

Ethics declarations

Ethics approval and consent to participate

The study was registered (CTRI/2014/02/004393) and local IRB approved the use of the database for this study and waived the need for informed consent.

Consent for publication

All authors agreed for publication of this study.

Competing interests

Pr. Tissieres reports research grants from Merieux Foundation and Chiesi Inc, outside the submitted work, and consulting fee for Baxter, Bristol Myers Squibb, bioMerieux, Faron, Chiesi. All other authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Morin, L., Ramaswamy, K.N., Jayashree, M. et al. Validation of the pediatric refractory septic shock definition: post hoc analysis of a controlled trial. Ann. Intensive Care 11, 32 (2021). https://doi.org/10.1186/s13613-021-00822-8

Download citation

Keywords

  • Sepsis
  • Refractory shock
  • Cardiac dysfunction
  • Score