Residual rates of mortality in patients with severe sepsis: a fatality or a new challenge?
Annals of Intensive Care volume 3, Article number: 27 (2013)
Phase III clinical trials on severe sepsis and septic shock published during the past decade have failed to reveal the superiority of any therapeutic intervention on mortality compared with evolving standards of care, with the exception of the Early-Goal Directed Therapy reported in 2001. This viewpoint paper presents an analysis of these studies in order to understand what lessons can be learned and proposes perspectives for future study designs. A total of 102 studies were selected among clinical trials published in the field of severe sepsis and septic shock from 2001 to 2013, based on the assessment of a therapeutic intervention and mortality as an outcome. Studies were further selected according to randomized, controlled trial (RCT) quality criteria and analysed according to reported data. Most (n = 61) were excluded because they did not comply with RCT quality criteria or did not report inclusion criteria or patient severity (n = 22). The 19 remaining studies were categorized into three groups depending on whether the intervention assessed led to better, worse, or equivalent outcomes. It appears that the mortality rate in the control arm, ranging from 17% to 61%, impacted the results, with a benefit reported in the studies with the highest rates. Both heterogeneous studied populations and uncontrolled diversity of care among participating centres probably contributed to discrepancies between studies assessing the same intervention. The new challenge to enhance the probability of decreasing mortality rates should include a more appropriate definition of sepsis based on more specific criteria involving biomarker use and accurate patient phenotypes.
PROWESS-SHOCK, the most recently published trial that assessed the efficacy of activated protein C in septic shock failed to show any benefit on mortality despite an apparently appropriate design . This disappointing failure, the last among many in the field of severe sepsis trials, prompted our group of intensivists particularly involved in sepsis research to look at the past decade of trials from 2001, the publication year of two positive sepsis clinical trials: the Early Goal guided therapy from Rivers and colleagues  and the PROWESS study , both published in the New England Journal of Medicine. In order to understand what lessons can be learned from the past, we focused on the heterogeneity of data, patient management protocols, and study populations. The interpretation is not based on a systematic review of the literature but reflects a viewpoint in the light of what we considered as the most relevant studies for the reasons explained below. Finally, this viewpoint provides the opportunity to suggest perspectives for future study designs.
Many randomized, controlled trials (RCTs), aiming to show an improvement of survival in patients with severe sepsis and septic shock, were performed since the initial PROWESS study and the seminal Early-Goal Directed Therapy study, both published in 2001 [2, 3], in parallel with the release and widespread dissemination of the Surviving Sepsis Campaign guidelines .
Studies that address the effect of various strategies on sepsis- or septic shock-induced mortality were selected among PubMed indexed publications from 2001 to 2013. The initial search strategy was based on “sepsis” or “septic shock” as main topics and/or title words. Studies were then qualified if they assessed at least one therapeutic intervention on mortality as an outcome. Trials that did not clearly report inclusion and exclusion criteria were excluded, as were those that did not comply with standard RCT quality criteria (e.g., appropriate research questions, randomization, blinding when relevant and inclusion/exclusion process)  or were not published in peer-reviewed journals [1–3, 6–21]. Among 102 trials that assessed therapeutic interventions on mortality in sepsis published since 2001, only 19 were retained for further analysis (Figure 1).
The selected studies were divided into three categories regarding the impact of the studied intervention compared with the control arm: better; no difference; or worse (Table 1). Only 4 of 19 trials reported that the studied treatment successfully improved primary outcomes (mainly mortality) of patients with severe sepsis or septic shock [2, 3, 6, 7]. In fact, most of these high-quality RCTs (15/19) found either an absence of statistical difference between the intervention and control groups (7/19) or a worse impact on at least one primary or secondary outcome (8/19) (Table 1). Hence, mortality was increased with the use of hydroxyethylstarches (HES)  or by L-NAME administration . The increase in poor outcomes more often concerned serious adverse events: HES increased the incidence of renal failure [17, 21], low-dose steroids were associated with a higher rate of new infections , intensive insulin therapy was reported to increase the risk of hypoglycaemia [17, 20], and dopamine infusion was shown to favour arrhythmia .
It is noteworthy that two [3, 7] of the four positive studies were stopped early at an interim analysis, which may impact indirect comparison between studies assessing the same intervention. For instance, the PROWESS study, that has been stopped prematurely, showed a reduction of mortality at day 28, but not at 3 months . In contrast, a study on antithrombin III showed a trend towards a reduction in 90-day mortality in the high-risk SAPS II stratum, which was not observed at 28 days .
Population and management heterogeneity
When comparing the selected studies, one of the most striking observations is that overall 28-day mortality rates in control groups are very heterogeneous, ranging from 17% [10, 11] to 61% , despite similar definitions of severe sepsis and septic shock and very closed inclusion and exclusion criteria. Interestingly, three of the four positive trials are among the oldest studies and also are those with the highest mortality rates in the control group (49-61%). Conversely, negative trials included more recent trials with lower mortality rates in the control arm (17-39%) [2, 3, 6]. This observation was confirmed by the latest published phase III study known as the ACCESS randomized trial , which failed to show any benefit with the infusion of eritoran (a lipid A antagonist) on 28- or 90-day mortality, with a mortality rate in the control arm in the low range (26.9%). Another argument supporting this hypothesis is the comparison between the PROWESS  and PROWESS SHOCK  studies published 10 years apart. The authors of the PROWESS SHOCK study themselves concluded that they cannot explain the inconsistency between their findings and the reduction of mortality at 28 days that was observed in the PROWESS study. The difference in 28-day mortality rates between the two control populations was consistent (24.2% vs. 30.8%, respectively), and may reveal different severity status between the two populations/periods, and therefore explain the discrepancy in terms of benefit. Interestingly, such a difference was close to that observed between intervention and control groups in the “positive” PROWESS study.
Changes in standards of care over time, essentially based on new recommendations and guidelines for the management of sepsis, have led to a dramatic decrease in mortality rate of severe sepsis and septic shock during the past decade . This fact directly impacts sepsis study designs through the necessary requirement of larger populations to adequately tailor the power of trials with mortality as a primary outcome. For instance, a 10% decrease in absolute mortality rate from a control mortality rate of 30% will require a sample size of approximately 7,000 patients (Tables 2 and 3) that has not yet been attained in critical care trials focused on sepsis.
Additionally, virtually no information is available in these studies concerning early mortality (within the first 3 days) related to sepsis-induced refractory shock or death due to withdrawal of care in the context of persisting organ dysfunctions . Such information might be important to analyse the direct effect of the tested drug and to understand the causes of death in ICU.
Another observation is that despite similar definitions of sepsis, these high-quality studies enrolled patients following varying delays from the onset of septic shock and organ failure, ranging from less than 2 h  to 72 h . The time window ranged from “as soon as possible” to 24 h in the successful studies, whereas it ranged from 12 h to 72 h for the studies with adverse effects of therapy. Interestingly, trials that succeeded to improve outcomes were characterized by an early randomization/enrolment (within the first 24 hours) allowing early interventions. The most striking example is the Early Goal Directed Therapy trial, in which patients were enrolled within 2 hours following their arrival at the emergency department . This may be a crucial point when testing drugs that aim to control the inflammatory cascade in the absence of immunomonitoring. Different delays from onset to inclusion may partially explain the different results found by two trials assessing the effects of low-dose steroids [6, 18]. Indeed, patients were enrolled within 8 h in the study of Annane and colleagues reporting an improvement in the intervention arm , whereas enrolment was allowed within the first 72 h in the study of Sprung and colleagues reporting a potential deleterious impact of similar doses of steroids .
The analysis of patients’ characteristics reveals that most of the trials included heterogeneous populations. Inclusion criteria were essentially based on the 1992 ACCP consensus criteria without any further characterization of sepsis, and study groups widely varied in terms of aetiology of infection, severity of illness, organ failures, organ support, standard of care, and levels of healthcare systems. Furthermore, comorbidities, which have been shown to be major prognostic factors, were not or poorly reported in most of these studies . Strikingly, stratification of patients according to severity scores (APACHE II score, SAPS…) did not prevent such bias. In a meta-analysis assessing recombinant human activated protein C and including the PROWESS and ADDRESS studies, the heterogeneity of the results (efficacy in the PROWESS study, failure in the ADDRESS study) was observed even when considering patients with APACHE II score ≥ 25 . In this respect, extending the risk-related variables from the systemic inflammatory response or the organ dysfunction to a global personalized approach, such as proposed in the PIRO concept , might eventually contribute to a better selection of the “good patients to include”.
Overall, the analysis of the selected studies combined with the authors’ experience in the field of sepsis management supports the idea that both population heterogeneity and uncontrolled diversity of care among participating centres probably contributed to discrepancies between studies assessing the same intervention. This interpretation is consistent with the survey on the type of fluids used for fluid challenge in European ICUs , a study on catecholamine use , or the assessment of the adherence to Surviving Sepsis Campaign recommendations .
Finally, it is noteworthy that among the few studies reporting improved outcomes, all excepted one were academic and recruited either in a single centre  or in a small number of centres inside a single country [6, 7]. In order to decrease the length of the trials and to favour international development of their product, pharmaceutical companies conducted large international trials, despite well-known differences in ICU bed availability and life expectancy (both indirect health system indicators) around the world. These observations support the need for improving homogeneity of populations enrolled in future trials.
Although the knowledge of sepsis pathophysiology continues to dramatically progress, clinical trials in this field still suffer from major weaknesses mainly due to heterogeneity. Addressing the major causes of heterogeneity remains therefore a major issue.
What lessons have we learned from previous studies and what could be proposed to improve research in sepsis? First, “standardized” open-source clinical reporting forms should be conceived for severe sepsis/septic shock studies and should be accessible for all future studies. In an era characterized by the promises of “big-data”, this would allow massive comprehensive data aggregation into data warehouses, which could be publically available through clear usage licenses.
Second, if mortality is to remain a primary endpoint, trials should be able to recruit only patients with high mortality risks. However, the use of severity scores and classical definitions of severe sepsis/septic shock have all clearly failed to this end. Therefore, an alternative stratification of patients into high mortality risk groups by referring to the dynamic rather than the static use of existing parameters, i.e., persistence and/or worsening signs of hypoperfusion after adequate infection source control, goal-directed fluid therapy, and vasopressor infusion could be recommended. The search for panels of biomarkers associated with high mortality also could improve the selection of patients to be included into future studies. Likewise and maybe more realistically, patient phenotypes not to be included in trials because of good prognosis or absence of ongoing infection should be identified (for instance, by excluding patients with normal values of procalcitonin).
Finally, another potential cause for the heterogeneity observed in many studies seldom raised may be intercentre variability. Indeed, in many recent studies, although enrolment criteria were overall similar, the inclusion rates varied widely from centre to centre. Centres that enrol too few patients during a sustained period of time are most likely exposed to “study pitfalls”, leading to potential bias and should not be maintained in the study.
Based on our analysis highlighting the heterogeneity of data reported during the past decade in the field of severe sepsis and septic shock, the challenge is to set up new approaches, which should generate more appropriate definitions of sepsis to be used in appropriate study designs resulting in higher probabilities of showing an impact on mortality. A recent viewpoint paper  stated that the definition of severe sepsis vs. sepsis often is confusing and that some criteria, such as the degree of organ dysfunction, should be taken into account in the definition. One key message is that it is more appropriate to refer to various and specific sepsis instead of sepsis in general. This nuance should be taken into account in the definition and selection of patients to be enrolled.
The authors submitted this article on behalf of the French Opinion Group in Sepsis (FrOGS).
Ranieri VM, Thompson BT, Barie PS, Dhainaut JF, Douglas IS, Finfer S, Gårdlund B, Marshall JC, Rhodes A, Artigas A, Payen D, Tenhunen J, Al-Khalidi HR, Thompson V, Janes J, Macias WL, Vangerow B, Williams MD, PROWESS-SHOCK Study Group: Drotrecogin alfa (activated) in adults with septic shock. N Engl J Med 2012, 366: 2055–2064. 10.1056/NEJMoa1202290
Rivers E, Nguyen B, Havstad S, Ressler J, Muzzin A, Knoblich B, Peterson E, Tomlanovich M, Early Goal-Directed Therapy Collaborative Group: Early goal-directed therapy in the treatment of severe sepsis and septic shock. N Engl J Med 2001, 345: 1368–1377. 10.1056/NEJMoa010307
Bernard GR, Vincent JL, Laterre PF, Recombinant human protein C Worldwide Evaluation in Severe Sepsis (PROWESS) study group: Efficacy and safety of recombinant human activated protein C for severe sepsis. N Engl J Med 2001,344(10):699–709. 10.1056/NEJM200103083441001
Surviving sepsis campaign http://www.survivingsepsis.org/Pages/default.aspx
US National Institute of Health http://enhancing-peer-review.nih.gov/
Annane D, Sébille V, Charpentier C, Bollaert PE, François B, Korach JM, Capellier G, Cohen Y, Azoulay E, Troché G, Chaumet-Riffaud P, Bellissant E: Effect of treatment with low doses of hydrocortisone and fludrocortisone on mortality in patients with septic shock. JAMA 2002, 288: 862–871. 10.1001/jama.288.7.862
Cruz DN, Antonelli M, Fumagalli R, Foltran F, Brienza N, Donati A, Malcangi V, Petrini F, Volta G, Bobbio Pallavicini FM, Rottoli F, Giunta F, Ronco C: Early use of polymyxin B hemoperfusion in abdominal septic shock: the EUPHAS randomized controlled trial. JAMA 2009, 301: 2445–2452. 10.1001/jama.2009.856
Warren BL, Eid A, Singer P, Pillay SS, Carl P, Novak I, Chalupa P, Atherstone A, Pénzes I, Kübler A, Knaub S, Keinecke HO, Heinrichs H, Schindel F, Juers M, Bone RC, Opal SM, KyberSept Trial Study Group: Caring for the critically ill patient. High-dose antithrombin III in severe sepsis: a randomized controlled trial. JAMA 2001, 286: 1869–1878. 10.1001/jama.286.15.1869
Reinhart K, Meier-Hellmann A, Beale R, Forst H, Boehm D, Willatts S, Rothe KF, Adolph M, Hoffmann JE, Boehme M, Bredle DL, EASy-Study Group: Open randomized phase II trial of an extracorporeal endotoxin adsorber in suspected Gram-negative sepsis. Crit Care Med 2004, 32: 1662–1668. 10.1097/01.CCM.0000132902.54925.B5
Hentrich M, Fehnle K, Ostermann H, Kienast J, Cornely O, Salat C, Ubelacker R, Buchheidt D, Behre G, Hiddemann W, Schiel X: IgMA-enriched immunoglobulin in neutropenic patients with sepsis syndrome and septic shock: a randomized, controlled, multiple-center trial. Crit Care Med 2006, 34: 1319–1325. 10.1097/01.CCM.0000215452.84291.C6
Abraham E, Laterre PF, Garg R, Levy H, Talwar D, Trzaskoma BL, François B, Guy JS, Brückmann M, Rea-Neto A, Rossaint R, Perrotin D, Sablotzki A, Arkins N, Utterback BG, Macias WL, Administration of Drotrecogin Alfa (Activated) in Early Stage Severe Sepsis (ADDRESS) Study Group: Drotrecogin alfa (activated) for adults with severe sepsis and a low risk of death. N Engl J Med 2005, 353: 1332–1341. 10.1056/NEJMoa050935
Annane D, Vignon P, Renault A, Bollaert PE, Charpentier C, Martin C, Troché G, Ricard JD, Nitenberg G, Papazian L, Azoulay E, Bellissant E, CATS Study Group: Norepinephrine plus dobutamine versus epinephrine alone for management of septic shock: a randomised trial. Lancet 2007, 370: 676–684. 10.1016/S0140-6736(07)61344-0
Stephens DP, Thomas JH, Higgins A, Bailey M, Anstey NM, Currie BJ, Cheng AC: Randomized, double-blind, placebo-controlled trial of granulocyte colony-stimulating factor in patients with septic shock. Crit Care Med 2008, 36: 448–454. 10.1097/01.CCM.0B013E318161E480
Russell JA, Walley KR, Singer J, Gordon AC, Hébert PC, Cooper DJ, Holmes CL, Mehta S, Granton JT, Storms MM, Cook DJ, Presneill JJ, Ayers D: VASST Investigators: Vasopressin versus norepinephrine infusion in patients with septic shock. N Engl J Med 2008, 358: 877–887. 10.1056/NEJMoa067373
Opal SM, Laterre PF, Francois B, LaRosa SP, Angus DC, Mira JP, Wittebole X, Dugernier T, Perrotin D, Tidswell M, Jauregui L, Krell K, Pachl J, Takahashi T, Peckelsen C, Cordasco E, Chang CS, Oeyen S, Aikawa N, Maruyama T, Schein R, Kalil AC, Van Nuffelen M, Lynn M, Rossignol DP, Gogate J, Roberts MB, Wheeler JL, Vincent JL, ACCESS Study Group: Effect of eritoran, an antagonist of MD2-TLR4, on mortality in patients with severe sepsis: the ACCESS randomized trial. JAMA 2013, 309: 1154–1162. 10.1001/jama.2013.2194
López A, Lorente JA, Steingrub J, Bakker J, McLuckie A, Willatts S, Brockway M, Anzueto A, Holzapfel L, Breen D, Silverman MS, Takala J, Donaldson J, Arneson C, Grove G, Grossman S, Grover R: Multiple-center, randomized, placebo-controlled, double-blind study of the nitric oxide synthase inhibitor 546C88: effect on survival in patients with septic shock. Crit Care Med 2004, 32: 21–30. 10.1097/01.CCM.0000105581.01815.C6
Brunkhorst FM, Engel C, Bloos F, Meier-Hellmann A, Ragaller M, Weiler N, Moerer O, Gruendling M, Oppert M, Grond S, Olthoff D, Jaschinski U, John S, Rossaint R, Welte T, Schaefer M, Kern P, Kuhnt E, Kiehntopf M, Hartog C, Natanson C, Loeffler M, Reinhart K, German Competence Network Sepsis (SepNet): Intensive insulin therapy and pentastarch resuscitation in severe sepsis. N Engl J Med 2008, 358: 125–139. 10.1056/NEJMoa070716
Sprung CL, Annane D, Keh D, Moreno R, Singer M, Freivogel K, Weiss YG, Benbenishty J, Kalenka A, Forst H, Laterre PF, Reinhart K, Cuthbertson BH, Payen D, Briegel J, CORTICUS Study Group: Hydrocortisone therapy for patients with septic shock. N Engl J Med 2008, 358: 111–124. 10.1056/NEJMoa071366
Patel GP, Grahe JS, Sperry M, Singla S, Elpern E, Lateef O, Balk RA: Efficacy and safety of dopamine versus norepinephrine in the management of septic shock. Shock (Augusta, Ga.) 2010, 33: 375–380. 10.1097/SHK.0b013e3181c6ba6f
Annane D, Cariou A, Maxime V, Azoulay E, D'honneur G, Timsit JF, Cohen Y, Wolf M, Fartoukh M, Adrie C, Santré C, Bollaert PE, Mathonet A, Amathieu R, Tabah A, Clec'h C, Mayaux J, Lejeune J, Chevret S, COIITSS Study Investigators: Corticosteroid treatment and intensive insulin therapy for septic shock in adults. JAMA 2010, 303: 341–348.
Perner A, Haase N, Guttormsen AB, Tenhunen J, Klemenzson G, Åneman A, Madsen KR, Møller MH, Elkjær JM, Poulsen LM, Bendtsen A, Winding R, Steensen M, Berezowicz P, Søe-Jensen P, Bestle M, Strand K, Wiis J, White JO, Thornberg KJ, Quist L, Nielsen J, Andersen LH, Holst LB, Thormar K, Kjældgaard AL, Fabritius ML, Mondrup F, Pott FC, Møller TP, 6S Trial Group; Scandinavian Critical Care Trials Group: Hydroxyethyl starch 130/0.42 versus Ringer's acetate in severe sepsis. N Engl J Med 2012, 367: 124–134. 10.1056/NEJMoa1204242
Levy MM, Artigas A, Phillips GS, Rhodes A, Beale R, Osborn T, Vincent JL, Townsend S, Lemeshow S, Dellinger RP: Outcomes of the Surviving Sepsis Campaign in intensive care units in the USA and Europe: a prospective cohort study. Lancet Infect Dis 2012, 12: 919–924. 10.1016/S1473-3099(12)70239-6
Singer M, De Santis V, Vitale D, Jeffcoate W: Multiorgan failure is an adaptive, endocrine-mediated, metabolic response to overwhelming systemic inflammation. Lancet 2004, 364: 545–548. 10.1016/S0140-6736(04)16815-3
Barnett K, Mercer SW, Norbury M, Watt G, Wyke S, Guthrie B: Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. Lancet 2012,380(9836):37–43. 10.1016/S0140-6736(12)60240-2
Wiedermann CJ, Kaneider NC: A meta-analysis of controlled trials of recombinant human activated protein C therapy in patients with sepsis. BMC Emergency Med 2005, 5: 1–4. 10.1186/1471-227X-5-1
Rubulotta F, Marshall JC, Ramsay G, Nelson D, Levy M, Williams M: Predisposition, insult/infection, response, and organ dysfunction: A new model for staging severe sepsis. Crit Care Med 2009, 37: 1329–1335. 10.1097/CCM.0b013e31819d5db1
Schortgen F, Deye N, Brochard L, CRYCO Study Group: Preferred plasma volume expanders for critically ill patients: results of an international survey. Intensive Care Med 2004, 30: 2222–2229. 10.1007/s00134-004-2415-1
Sakr Y, Reinhart K, Vincent JL, Sprung CL, Moreno R, Ranieri VM, De Backer D, Payen D: Does dopamine administration in shock influence outcome? Results of the Sepsis Occurrence in Acutely Ill Patients (SOAP) Study. Crit Care Med 2006, 34: 589–597. 10.1097/01.CCM.0000201896.45809.E3
Finfer S: The Surviving Sepsis Campaign: robust evaluation and high-quality primary research is still needed. Crit Care Med 2010, 38: 683–684. 10.1097/CCM.0b013e3181cc5302
Vincent JL, Opal SM, Marshall JC, Tracey KJ: Sepsis definitions - Authors' reply. Lancet 2013, 381: 774–775. 10.1016/S0140-6736(12)61815-7
This review article was supported by LFB Biomédicaments.
PA has received consultancy fees and honoraria from LFB Biomédicaments. YEC has received honoraria from LFB Biomédicaments. JD has received consultancy fees from LFB Biomédicaments. EK has received consultancy fees from LFB Biomédicaments, and honoraria from LFB, Gilead, and MSD for lectures. ML has received consultancy fees from LFB Biomédicaments and honoraria from Fresenius Kabi and Novartis for lectures. BL has received consultancy fees from LFB Biomédicaments and honoraria from Pulsion and Baxter for lectures. JPM has received fees from LFB Biomédicaments, EISAI and Eli Lilly for lecture, grants or advisory boards.
All of the coauthors made substantial contributions to collection, analysis, and interpretation of data, were involved in drafting the manuscript and revising it critically for important intellectual content, and have given final approval of the version to be published.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Asfar, P., Claessens, YE., Duranteau, J. et al. Residual rates of mortality in patients with severe sepsis: a fatality or a new challenge?. Ann. Intensive Care 3, 27 (2013). https://doi.org/10.1186/2110-5820-3-27