Skip to main content
Annals of Intensive Care
Download PDF

Efficacy and safety of IL-6 inhibitors in patients with COVID-19 pneumonia: a systematic review and meta-analysis of multicentre, randomized trials

Annals of Intensive Care volume 11, Article number: 152 (2021) Cite this article

Abstract

Purpose

COVID-19 is characterized by dysregulated immune response, respiratory failure and a relevant mortality rate among hospitalized patients. Interleukin-6 (IL-6) is involved in COVID-19-associated cytokine storm, and several trials investigated whether its inhibition could improve patients’ outcome. We performed a meta-analysis of randomized trials (RCT) to test this hypothesis.

Materials and methods

Two independent investigators searched PubMed, Scopus, ClnicalTrials.gov and medRxiv up to September 1st, 2021. Inclusion criteria were: administration of tocilizumab or sarilumab; COVID-19 adult patients with pneumonia; and being a RCT. Primary outcome was mortality at the longest follow-up. Secondary outcomes included intubation rate and incidence of adverse events. Two independent investigators extracted data from eligible trials.

Results

Of the 763 studies assessed, 15 RCTs were included (9,320 patients), all were multicentre, and the majority open-label vs standard treatment. IL-6 inhibitors were associated with reduced all-cause mortality at the longest follow-up (1315/5,380 [24.4%] in the IL-6 inhibitors group versus 1080/3,814 [28.3%] in the control group, RR = 0.90; 95% CI 0.84 to 0.96; p for effect = 0.003, I2 = 0%, with 13 studies included), with reduction in 28/30-day mortality and intubation rates, and with no increase in adverse events and secondary infections.

Conclusion

IL-6 inhibitors reduced longest follow-up mortality and intubation in COVID-19 patients. Findings need to be confirmed in high-quality RCTs.

Introduction

In December 2019 a novel coronavirus outbreak due to Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) emerged in China [1] This virus was linked to a new emerging respiratory disease named Coronavirus disease 2019 (COVID-19) associated with significant mortality and morbidity which spread worldwide over the months and was declared a pandemic by the World Health Organization in March 2020 [2]. From the very beginning, patients affected by severe COVID-19 were found to have an uncontrolled inflammatory response resembling that observed in patients with cytokine-release syndrome [3]. Among several cytokines, serum levels of interleukin-6 (IL-6) were associated with severity of the clinical manifestations and poor outcome of COVID-19 patients [4, 5]. Consequently, given the absence of SARS-CoV-2-specific therapies, the monoclonal antibody tocilizumab, which specifically targets the IL-6 receptor and is currently approved for the treatment of rheumatoid arthritis and giant cell arteritis [6, 7], and the monoclonal antibody sarilumab, which also targets the IL-6 receptor and is approved for the treatment of rheumatoid arthritis [8], were evaluated for the moderate–severe group of patients [9]. As a consequence, several retrospective studies evaluated the role of tocilizumab in severe COVID-19 patients over the last months, with contradictory results [10,11,12]. Thanks to an unpreceded effort, randomized-controlled trials (RCTs) were rapidly set up and carried out in several countries to properly investigate the role of tocilizumab in COVID-19.

Given the urgent need for effective treatments for COVID-19 and the social and economic costs associated with the pandemic, we perform a systemic review of all published RCTs to answer to the unsolved question: should we use IL-6 inhibitors to treat our COVID-19 patients?

Materials and methods

The present systematic review and meta-analysis of RCTs was performed in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines and following Cochrane Collaboration recommendations [13,14,15,16,17]. The review was registered on International Prospective Register of Systematic Reviews (PROSPERO) under registration no. CRD42021230944 on January 18th 2021.

Search strategy and study selection

Randomized controlled trials comparing tocilizumab or sarilumab versus any comparator (placebo, standard treatment, or active comparator) were included in this study. The following PICOS criteria were followed: population—patients with COVID-19 pneumonia; interventions—tocilizumab, sarilumab; comparison intervention—placebo; standard treatment; any active comparator; outcome—longest follow-up mortality, secondary outcomes as described below; study design—randomized-controlled trials. No exclusion by publication date or language was enforced.

In detail, we included studies with all the following criteria: administration of tocilizumab or sarilumab; in adult patients with COVID-19 pneumonia; and randomized-controlled trials. Exclusion criteria were (at least one of the following): overlapping population; non-randomized trials; setting other than COVID-19 pneumonia; paediatric studies; non-human studies; lack of data for outcomes of interest; studies directly comparing tocilizumab against steroids [18]; and studies published as abstract only.

We searched PubMed, Scopus, ClinicalTrials.gov and medRxiv databases. Search was performed independently by two trained investigators for suitable articles, and last updated on September 1st, 2021. We applied backward snowballing to retrieve additional manuscripts. Eligibility assessment was first performed by two independent investigators at title/abstract level. Subsequently, the final selection of included articles was based on the complete manuscripts and performed by two independent investigators, with disagreements solved by consensus. The search strategies are available in the Additional file 1.

Data extraction

Details on baseline characteristics (setting, methodological details, number of patients in ICU, number of patients on invasive mechanical ventilation, number of patients receiving steroids), procedural (study drug dose, timing and mode of administration, blinding) and outcome data were independently collected by two investigators. Divergences were resolved by consensus. Data were extracted following the intention-to-treat principle whenever possible.

Corresponding authors of individual studies were contacted by email to obtain further data.

Outcomes

The primary outcome was mortality at the longest follow-up available. Secondary outcomes were: 28/30-day mortality, need for intubation, clinical worsening, number of patients with at least one serious adverse event, number of patients with at least one secondary infection. Outcomes were defined according to individual studies author’s definition, and definitions are provided in the Additional file 1.

Statistical analysis

For dichotomous outcomes, we calculated individual and pooled risk ratio (RR) with 95% confidence intervals (CI). For continuous variables, mean difference (MD) or standardized mean difference (SMD) with corresponding 95% CI were calculated. If necessary, continues variables were converted into mean and standard deviation following the methodology described by Wan et al. [19].

Heterogeneity analysis was performed with Cochran Q statistic and quantified with I2. Heterogeneity with an I2 > 25% was considered significant. We employed the fixed effect model or the random-effects model in case of low or high statistical heterogeneity, respectively.

Publication bias for primary endpoint was assessed by visual inspection of funnel plot if the number of retrieved studies was greater than 10 [20].

Risk of bias was assessed according to a modified version of the Risk-of-Bias 2 tool of the Cochrane Collaboration [17, 21]. Two trained investigators evaluated each item and provided an overall judgement of low risk, high risk, some concerns or unclear risk of bias. Trials with published results that did not underwent peer-review [22], single-centre trials [23, 24], and open-label trials [25], were considered to have at least “some concerns” of bias.

We planned the following pre-specified subgroup analyses: patients in ICU, patients on mechanical ventilation, studies with a high prevalence (> 50% of patients) of concomitant steroid therapy. However, we found only one study enrolling patients in the ICU, and no studies enrolling only patients on invasive mechanical ventilation. Therefore, the subgroup analysis on studies enrolling ICU patients was not performed. For the invasive mechanical ventilation subgroup analysis, we analysed studies including also patients on mechanical ventilation at baseline. In addition, we performed an unplanned subgroup analysis of patients who received versus those who did not receive steroids in addition to IL-6 inhibitors.

The following sensitivity analyses were performed: low risk of bias trials only; sequential removal of each individual trial and re-analysis of the remaining dataset; change of analysis methods; change of summary statistics, and analysis excluding patients receiving sarilumab.

For pooled outcome analyses, a p-value less than 0.05 was considered significant. Analysis was performed using RevMan 5.4. software (Review Manager, The Nordic Cochrane Centre, The Cochrane Collaboration, Copenhagen, Denmark).

Trial sequential analysis (TSA) was performed [26, 27]. We performed a fixed-effects TSA with the intent of maintaining an overall 5% risk of type I error and a 20% risk of type II error, at a power of 80%. We assumed a relative risk reduction of 15% and derived the control event proportion from the dataset. The resulting required information size was further diversity (D2)-adjusted. In the case of D2 = 0, we performed a sensitivity analysis assuming a D2 = 25%. The TSA Viewer software was used to perform TSA (TSA Viewer [Computer program], version 0.9.5.5 Beta, Copenhagen Trial Unit, Centre for Clinical Intervention Research, Rigshospitalet, 2016).

Results

A total of 763 references were examined at a title/abstract level. After initial screening, a total of 22 studies were retrieved as complete articles. After exclusion of three non-randomized trials [28,29,30], three study protocols [31,32,33], and one study comparing tocilizumab against dexamethasone [34], a total of 15 studies randomizing 9320 patients were included in the analysis (Fig. 1) [35,36,37,38,39,40,41,42,43,44,45,46,47,48,49].

Fig. 1
figure 1

Flow diagram for study inclusions

Full size image

Characteristics of included trials

Characteristics of included trials are reported in Table 1 and Additional file 1: Table S2. All studies were multicentre. Three studies have not yet undergone peer-review as of September 15th 2021 and are available as pre-print only [42, 44, 47]. One study was performed on ICU patients alone [48], and eight studies also included patients under invasive mechanical ventilation at baseline [34, 40, 41, 43, 45,46,47,48] (Table 2). Concomitant use of steroids was highly variable across studies, ranging from 10.6 to 91.1% of enrolled patients (Table 2). Seven studies specifically enrolled patients with documented hyperinflammation [35, 36, 39, 42,43,44, 49], including two studies enrolling patients with documented elevated IL-6 [39, 42], and one study enrolling patients with elevated C-reactive protein (CRP) [43] (Table 1).

Table 1 Characteristics of included studies
Full size table
Table 2 Treatment characteristics of included trials
Full size table

Five studies compared IL-6 inhibitors with placebo [36, 38, 40, 45, 47], nine studies with standard treatment, [35, 37, 41,42,43,44, 46, 48, 49] and one study against favipiravir [42].

Overall, risk of bias analysis showed that three of included trials were at low risk of bias [36, 38, 40], while the remaining had at least some concerns of bias, mainly due to lack of blinding or lack of peer-review (Additional file 1).

All-cause mortality

Overall, we found that IL-6 inhibitors administration was associated with a significant reduction in all-cause longest follow-up mortality (1315/5380 [24.4%] in the IL-6 inhibitors group versus 1080/3814 [28.3%] in the control group, RR = 0.90; 95% CI 0.84 to 0.96; p for effect = 0.003, I2 = 0%, with 13 studies included; NNT = 26) (Fig. 2).

Fig. 2
figure 2

Forest plot for longest follow-up mortality

Full size image

Changes of the summary statistics from RR to odds ratio or risk difference did not result in a change in significance of study findings. Similarly, changing from fixed- to random-effects model did not alter significance of the results (RR for random-effects model = 0.89; 95% CI = 0.83 to 0.96; p-value = 0.002).

Sequential removal of each trial showed that statistical significance is lost when removing the RECOVERY study (RR without RECOVERY = 0.91; 95% CI 0.81 to 1.02; p-value = 0.09; I2 = 0%) [43].

Analyses including the three low risk of bias studies only, suggested the lack of benefit of IL-6 inhibitors (longest follow-up mortality was 96/705 [13.6%] in the IL-6 inhibitors group versus 47/453 [10.3%] in the control group, RR = 1.01; 95% CI 0.74 to 1.40; p-value = 0.93; I2 = 0%, with three trials included).

Analysis excluding patients receiving sarilumab confirmed magnitude and direction of the results (851/3,547 [24.0%] in the tocilizumab group versus 955/3325 [28.7%] in the control group, RR = 0.88; 95% CI 0.81 to 0.95; p for effect = 0.001, I2 = 0%, with 11 studies included) (Additional file 1).

Interleukin-6 inhibitors reduced mortality significantly compared to controls according to TSA (TSA-adjusted 95% CI = 0.81 to 0.99; required information size = 3,361). In particular, TSA showed that the cumulative Z curve crossed boundaries for benefit, suggesting that information size has been reached (Fig. 3). Trial sequential analysis results were confirmed at sensitivity analysis assuming a D2 = 25% (Additional file 1).

Fig. 3
figure 3

Trial sequential analysis for primary outcome

Full size image

Visual inspection of funnel plot did not suggest presence of publication bias (Additional file 1).

Secondary outcomes

Results of secondary outcome analyses are presented in the Additional file 1. A total of 11 trials reported 28/30-day mortality data with a significant improvement in survival in the IL-6 inhibitors group (1193/4,967 [24%] in the IL-6 inhibitors group versus 924/3399 [27.1%] in the control group, RR = 0.92; 95% CI 0.85 to 0.99; p = 0.03, I2 = 0%).

In addition, we found that use of IL-6 inhibitors was associated with a significant reduction in need for intubation (171/1933 [8.8%] versus 180/1649 [10.9%]; RR = 0.73; 95% CI = 0.60 to 0.88; p = 0.001; I2 = 0%; 9 trials included) and clinical worsening (517/3,019 [17.1%] versus 891/2777 [32.0%]; RR = 0.68; 95% CI = 0.52 to 0.91; p = 0.009; I2 = 82%; 10 trials included) (Fig. 4).

Fig. 4
figure 4

Forest plot for clinical worsening

Full size image

We observed no significant difference in occurrence rate of serious adverse events (983/5166 [19%] versus 354/3604 [9.8%]; RR = 1.00; 95% CI = 0.90 to 1.10; p = 0.99; I2 = 1%; 13 trials included), and occurrence rate of secondary infections (177/1593 [11.1%] versus 130/1259 [10.3%]; RR = 0.78; 95% CI = 0.60 to 1.01; p = 0.06; I2 = 11%; 11 trials included).

When analysing low risk of bias studies only, the need for intubation was reduced in the IL-6 inhibitors group (82/593 [13.8%] versus 57/299 [19.1%]; RR = 0.72; 95% CI = 0.53 to 0.96; p = 0.03; I2 = 0%; 3 trials included), as well as clinical worsening (113/593 [19.1%] versus 76/299 [25.4%]; RR = 0.74; 95% CI = 0.55 to 1.00; p = 0.05; I2 = 25%, 3 trials included) (Additional file 1). For all other outcomes, we observed no significant differences.

Subgroup analyses

Results of subgroup analyses of studies enrolling vs not enrolling patients on invasive mechanical ventilation at baseline are presented in the Additional file 1. We found a significant subgroup interaction when analysing the effect of IL-6 inhibitors on the rate of secondary infections, with studies not enrolling patients on invasive mechanical ventilation showing benefit as compared with studies also enrolling patients on invasive mechanical ventilation (p for interaction = 0.04) (Additional file 1).

Three trials reported longest follow-up and 28/30-day mortality data stratified by steroids use [40, 43, 47]. In this analysis, we found a significant subgroup interaction, with improved survival in patients receiving steroids together with IL-6 inhibitors (p for interaction = 0.004) (Additional file 1). In the other subgroup analyses by concomitant use of steroids, we found no significant subgroup interactions (Additional file 1).

Discussion

Key findings

In this meta-analysis of multicentre RCTs, we found that IL-6 inhibitors administration in patients with COVID-19 pneumonia is associated with a significant reduction in longest follow-up mortality. Furthermore, it is associated with reduction in 28/30-day mortality, need for intubation, and clinical worsening. The beneficial effect on the need for intubation and clinical worsening was confirmed also when analysing studies with a low risk of bias. Results on mortality are largely driven by the RECOVERY trial. [43].

Relationship with previous studies

Several meta-analyses and systematic review on this topic have been recently published [18, 50,51,52,53,54,55,56,57,58,59,60]. However, most of these meta-analyses did not include the most recently published trials such as the RECOVERY trial [43].

The largest meta-analysis published so far by the World Health Organization (WHO) Rapid Evidence Appraisal for COVID-19 Therapies (REACT) Working Group included a total 27 randomized studies, 18 of which were not published at time of the meta-analysis publication. They found that IL-6 inhibition was associated with improved 28-day survival and reduction in the composite endpoint of need for invasive mechanical ventilation, extracorporeal membrane oxygenation, or death. Our study also found a reduction in 28/30-day mortality, together with a reduction in need for invasive mechanical ventilation and in a composite endpoint of clinical worsening. Compared with the WHO REACT meta-analysis, our study focused on a different primary endpoint (longest follow-up mortality) and on studies with published results (even if not peer-reviewed). Furthermore, due to different search strategy, inclusion criteria and last update, we included four trials not included in the WHO REACT meta-analysis [35, 39, 42, 44]. There are also some methodological difference in the statistical analysis. For example, we used a Mantel–Haenszel weighted risk ratio versus an inverse variance-weighted odds ratio. However, analysis of our data using a similar approach did not lead to change in magnitude and direction of results. We also analysed risk of bias using somewhat more restrictive criteria for unpublished, open-label and single-centre trials, and therefore our risk of bias analysis results in a lower proportion of low risk of bias studies [22,23,24,25]. Finally, we also performed a TSA. Overall, despite these methodological differences, we believe that our work is complementary to the WHO REACT study and that it confirms the potential beneficial effect of IL-6 inhibitors in patients with COVID-19 also found by the WHO REACT colleagues. In particular, our study suggest that IL-6 inhibitors benefit may extend beyond 28/30 days, and our TSA showed that the required information size was reached, suggesting firm evidence on beneficial effect of IL-6 inhibitors.

Significance of study findings and what this study adds to our knowledge

Our meta-analysis provides some evidence that tocilizumab administration may be beneficial in patients with COVID-19 pneumonia, by reducing the risk of death and the risk of intubation without increasing risk of secondary infections and adverse events.

Most of the studies enrolled patients about 10 days after symptoms onset, with a moderate–severe disease. Only one RCT was specifically performed in ICU patients [48], and several studies excluded patients requiring mechanical ventilation at baseline. Therefore, we are unable to comment on efficacy and safety of IL-6 inhibitors in critically ill patients and particularly on those receiving mechanical ventilation, which may have the highest risk of secondary infections [61,62,63].

Nevertheless, the REMAP-CAP study (the only study entirely performed in an ICU setting) is one of the two studies showing a significant improvement in patients survival without higher rate of severe infections [48]. However, less than 30% of patients enrolled in the REMAP-CAP were receiving invasive mechanical ventilation at baseline.

Another interesting finding of our systematic review is that approximately half of included studies did not screen patients on the basis of baseline elevated inflammatory markers [37, 38, 40, 41, 48], including the REMAP-CAP trial [48]. However, the RECOVERY trial enrolled patients with elevated baseline C-reactive protein, somehow supporting the rationale of administering tocilizumab to patients with documented inflammation [43]. Moreover, in accordance with the results of the RECOVERY trial and WHO REACT meta-analysis [18], we also observed that the concomitant use of steroids and IL-6 inhibitors was associated with a significant reduction in clinical worsening.

In addition, we also explored the risk of development of secondary infections as well as serious adverse events and found no differences between patients receiving IL-6 inhibitors and controls, suggesting safety of this therapy.

Notably, only five trials were double-blinded [36, 38, 40, 45, 47] and only three were judged to carry a low risk of bias [36, 38, 40]. All others RCTs were open-label. Therefore, we believe that the overall treatment effect of IL-6 inhibitors may be overestimated, as it has been showed that blinded trials generally have a 40% higher NNT when compared to unblinded trials [25]. Nevertheless, we do acknowledge that the ongoing pandemic and the pressure on most healthcare systems prompted the need to test therapies in a short timeframe, thereby not allowing in most cases to organize double-blind placebo-controlled trials.

Notably, the reduction in need for invasive mechanical ventilation as well as in clinical worsening were confirmed also when analysing double-blind, low risk of bias studies.

Collectively, results of our meta-analysis suggest that administration of IL-6 inhibitors may be beneficial in patients in a relatively early stage of the disease not undergoing invasive mechanical ventilation and treated together with systemic steroids. Although further high-quality evidence is required, use of IL-6 inhibitors may be justified in a context of pandemic and high pressure on healthcare systems and intensive care units [64, 65].

Strengths and limitations of the study

Our meta-analysis includes only multicentre RCTs, thereby with highest internal and external validity, and therefore carry the highest level of evidence [23, 24, 66, 67]. Furthermore, we explored both safety and efficacy outcomes, and investigated possible subgroup interactions including concomitant use of steroids.

However, our results are limited by the overall high risk of bias of available studies and heterogeneity among inclusion criteria and concomitant treatments. We also included trials that have not yet undergone peer-review. Nevertheless, this has been a common practice in the ongoing COVID-19 pandemic [18].

We were unable to obtain additional data from investigators, and therefore we could not perform detailed analysis on interaction between corticosteroids and IL-6 inhibitors.

Statistical significance is lost when removing the RECOVERY trial [43] from analysis. However, beneficial effect of IL-6 inhibitors on clinically relevant secondary outcomes is confirmed in several sensitivity analyses, including low risk of bias trials.

The COVID-19 pandemic is still ongoing and several treatments are under investigation. We cannot comment on possible interaction between other promising treatment strategies such as anti-virals or monoclonal antibodies and IL-6 inhibitors.

Future studies and prospects

Our study highlighted current gaps of knowledge in IL-6 inhibitors use among patients with COVID-19. In particular, there is still insufficient evidence on efficacy and safety of IL-6 inhibitors among patients with critical disease requiring invasive mechanical ventilation. Furthermore, despite several mRCTs have been published, the quality of evidence remains low since several published trials lacked blinding [25].

Future studies should be designed as double-blinded and placebo-controlled in order to provide the greatest level of scientific rigour. Our study can provide baseline information to calculate sample size for such a future trial.

Furthermore, future studies should assess the possible interactions between available treatments for COVID-19, especially the combination of both systemic steroids and tocilizumab in specific subgroup of patients with a more pronounced inflammatory phenotype.

Conclusions

Interleukin-6 inhibitors may reduce mortality and need for intubation in patients with COVID-19 pneumonia, when administered within 10 days since symptoms onset, especially if used concomitantly with steroids. In particular, the reduction in need for intubation and in a composite endpoint of clinical worsening was confirmed also in low risk of bias studies. However, most of published RCTs lacked blinding and significance of mortality results is lost when only low-risk of bias studies are analysed.

Availability of data and materials

All data generated or analysed during this study are included in this published article and its supplementary information files.

References

  1. Zhu N, Zhang D, Wang W, et al. A novel coronavirus from patients with pneumonia in China, 2019. N Engl J Med. 2020;382(8):727–33. https://doi.org/10.1056/nejmoa2001017.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Guan W, Ni Z, Hu Y, et al. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med. 2020;382(18):1708–20. https://doi.org/10.1056/nejmoa2002032.

    Article  CAS  PubMed  Google Scholar 

  3. Mehta P, McAuley DF, Brown M, Sanchez E, Tattersall RS, Manson JJ. COVID-19: consider cytokine storm syndromes and immunosuppression. Lancet. 2020;395(10229):1033–4. https://doi.org/10.1016/S0140-6736(20)30628-0.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. Yonas E, Alwi I, Pranata R, et al. Elevated interleukin levels are associated with higher severity and mortality in COVID 19—a systematic review, meta-analysis, and meta-regression. Diabetes Metab Syndr Clin Res Rev. 2020;14(6):2219–30. https://doi.org/10.1016/j.dsx.2020.11.011.

    Article  Google Scholar 

  5. Li J, Rong L, Cui R, et al. Dynamic changes in serum IL-6, IL-8, and IL-10 predict the outcome of ICU patients with severe COVID-19. Ann Palliat Med. 2021;10(2):62–62. https://doi.org/10.21037/apm-20-2134.

    Article  Google Scholar 

  6. Smolen JS, Beaulieu A, Rubbert-Roth A, et al. Effect of interleukin-6 receptor inhibition with tocilizumab in patients with rheumatoid arthritis (OPTION study): a double-blind, placebo-controlled, randomised trial. Lancet. 2008;371(9617):987–97. https://doi.org/10.1016/S0140-6736(08)60453-5.

    Article  CAS  PubMed  Google Scholar 

  7. Stone JH, Tuckwell K, Dimonaco S, et al. Trial of tocilizumab in giant-cell arteritis. N Engl J Med. 2017;377(4):317–28. https://doi.org/10.1056/nejmoa1613849.

    Article  CAS  PubMed  Google Scholar 

  8. Genovese MC, Fleischmann R, Kivitz AJ, et al. Sarilumab plus methotrexate in patients with active rheumatoid arthritis and inadequate response to methotrexate: results of a phase III study. Arthritis Rheumatol. 2015;67(6):1424–37. https://doi.org/10.1002/art.39093.

    Article  CAS  PubMed  Google Scholar 

  9. Campochiaro C, Dagna L. The conundrum of interleukin-6 blockade in COVID-19. Lancet Rheumatol. 2020;2(10):e579–80. https://doi.org/10.1016/S2665-9913(20)30287-3.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Campochiaro C, Della-Torre E, Cavalli G, et al. Efficacy and safety of tocilizumab in severe COVID-19 patients: a single-centre retrospective cohort study. Eur J Intern Med. 2020;76:43–9. https://doi.org/10.1016/j.ejim.2020.05.021.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  11. Della-Torre E, Campochiaro C, Cavalli G, et al. Interleukin-6 blockade with sarilumab in severe COVID-19 pneumonia with systemic hyperinflammation: an open-label cohort study. Ann Rheum Dis. 2020;79(10):1277–85. https://doi.org/10.1136/annrheumdis-2020-218122.

    Article  CAS  PubMed  Google Scholar 

  12. Monti G, Campochiaro C, Zangrillo A, et al. Immunosuppressive strategies in invasively ventilated ARDS COVID-19 patients. Minerva Anestesiol. 2021;87(8):891–902. https://doi.org/10.23736/S0375-9393.21.15339-8.

    Article  PubMed  Google Scholar 

  13. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339(7716):332–6. https://doi.org/10.1136/bmj.b2535.

    Article  Google Scholar 

  14. Liberati A, Altman DG, Tetzlaff J, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Ann Intern Med. 2009;151(4):W65–94. https://doi.org/10.7326/0003-4819-151-4-200908180-00136.

    Article  PubMed  Google Scholar 

  15. Greco T, Zangrillo A, Biondi-Zoccai G, Landoni G. Meta-analysis: pitfalls and hints. Hear Lung Vessel. 2013;5(4):219–25.

    CAS  Google Scholar 

  16. Biondi-Zoccai G, Lotrionte M, Landoni G, Modena MG. The rough guide to systematic reviews and meta-analyses. HSR Proc Intensive Care Cardiovasc Anesth. 2011;3(3):161–73.

    CAS  PubMed  PubMed Central  Google Scholar 

  17. Higgins J, Thomas J, Chandler J, et al., eds. Cochrane Handbook for Systematic Reviews of Interventions. 2nd ed. Chichester (UK): John Wiley & Sons; 2019. https://training.cochrane.org/cochrane-handbook-systematic-reviews-interventions. Accessed 7 Jan 2021.

  18. Domingo P, Mur I, Mateo GM, et al. Association between administration of IL-6 antagonists and mortality among patients hospitalized for COVID-19. JAMA. 2021;326(6):499–518. https://doi.org/10.1001/jama.2021.11330.

    Article  CAS  PubMed  Google Scholar 

  19. Wan X, Wang W, Liu J, Tong T. Estimating the sample mean and standard deviation from the sample size, median, range and/or interquartile range. BMC Med Res Methodol. 2014;14(1):135. https://doi.org/10.1186/1471-2288-14-135.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Sterne JAC, Sutton AJ, Ioannidis JPA, et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ. 2011;343(7818): d4002. https://doi.org/10.1136/bmj.d4002.

    Article  PubMed  Google Scholar 

  21. Sterne JAC, Savović J, Page MJ, et al. RoB 2: A revised tool for assessing risk of bias in randomised trials. BMJ. 2019;366: l4898. https://doi.org/10.1136/bmj.l4898.

    Article  PubMed  Google Scholar 

  22. Ravinetto R, Caillet C, Zaman MH, et al. Preprints in times of COVID19: the time is ripe for agreeing on terminology and good practices. BMC Med Ethics. 2021;22(1):106. https://doi.org/10.1186/s12910-021-00667-7.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Landoni G, Pieri M, Young PJ, Bellomo R. Why do multicenter randomized controlled trials not confirm the positive findings of single center randomized controlled trials in acute care? Minerva Anestesiol. 2019;85(2):194–200. https://doi.org/10.23736/S0375-9393.18.13070-7.

    Article  PubMed  Google Scholar 

  24. Bellomo R, Warrillow SJ, Reade MC. Why we should be wary of single-center trials. Crit Care Med. 2009;37(12):3114–9. https://doi.org/10.1097/CCM.0b013e3181bc7bd5.

    Article  PubMed  Google Scholar 

  25. Baiardo Redaelli M, Belletti A, Monti G, et al. The impact of non-blinding in critical care medicine trials. J Crit Care. 2018;48:414–7. https://doi.org/10.1016/j.jcrc.2018.09.031.

    Article  CAS  PubMed  Google Scholar 

  26. Brok J, Thorlund K, Gluud C, Wetterslev J. Trial sequential analysis reveals insufficient information size and potentially false positive results in many meta-analyses. J Clin Epidemiol. 2008;61(8):763–9. https://doi.org/10.1016/j.jclinepi.2007.10.007.

    Article  PubMed  Google Scholar 

  27. Wetterslev J, Thorlund K, Brok J, Gluud C. Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis. J Clin Epidemiol. 2008;61(1):64–75. https://doi.org/10.1016/j.jclinepi.2007.03.013.

    Article  PubMed  Google Scholar 

  28. Somers EC, Eschenauer GA, Troost JP, et al. Tocilizumab for treatment of mechanically ventilated patients with COVID-19. medRxiv. 2020. https://doi.org/10.1101/2020.05.29.20117358.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Gupta S, Wang W, Hayek SS, et al. Association between early treatment with tocilizumab and mortality among critically Ill patients with COVID-19. JAMA Intern Med. 2021;181(1):41–51. https://doi.org/10.1001/jamainternmed.2020.6252.

    Article  CAS  PubMed  Google Scholar 

  30. Strohbehn GW, Heiss BL, Rouhani SJ, et al. COVIDOSE: Low-dose tocilizumab in the treatment of Covid-19. medRxiv. 2020. https://doi.org/10.1101/2020.07.20.20157503.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Garcia-Vicuña R, Abad-Santos F, González-Alvaro I, Ramos-Lima F, Sanz JS. Subcutaneous Sarilumab in hospitalised patients with moderate-severe COVID-19 infection compared to the standard of care (SARCOVID): a structured summary of a study protocol for a randomised controlled trial. Trials. 2020;21(1):772. https://doi.org/10.1186/s13063-020-04588-5.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  32. León López R, Fernández SC, Limia Pérez L, et al. Efficacy and safety of early treatment with sarilumab in hospitalised adults with COVID-19 presenting cytokine release syndrome (SARICOR STUDY): protocol of a phase II, open-label, randomised, multicentre, controlled clinical trial. BMJ Open. 2020;10(11): e039951. https://doi.org/10.1136/bmjopen-2020-039951.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Maes B, Bosteels C, De Leeuw E, et al. Treatment of severely ill COVID-19 patients with anti-interleukin drugs (COV-AID): a structured summary of a study protocol for a randomised controlled trial. Trials. 2020;21(1):468. https://doi.org/10.1186/s13063-020-04453-5.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  34. Rashad A, Mousa S, Nafady-Hego H, Nafady A, Elgendy H. Short term survival of critically ill COVID-19 Egyptian patients on assisted ventilation treated by either dexamethasone or tocilizumab. Sci Rep. 2021;11(1):8816. https://doi.org/10.1038/s41598-021-88086-x.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  35. Salvarani C, Dolci G, Massari M, et al. Effect of tocilizumab vs standard care on clinical worsening in patients hospitalized with COVID-19 pneumonia: a randomized clinical trial. JAMA Intern Med. 2021;181(1):24–31. https://doi.org/10.1001/jamainternmed.2020.6615.

    Article  CAS  PubMed  Google Scholar 

  36. Stone JH, Frigault MJ, Serling-Boyd NJ, et al. Efficacy of tocilizumab in patients hospitalized with Covid-19. N Engl J Med. 2020;383(24):2333–44. https://doi.org/10.1056/nejmoa2028836.

    Article  CAS  PubMed  Google Scholar 

  37. Hermine O, Mariette X, Tharaux PL, Resche-Rigon M, porcher R, ravaud p. effect of tocilizumab vs usual care in adults hospitalized with COVID-19 and moderate or severe pneumonia: a randomized clinical trial. JAMA Intern Med. 2021;181(1):32–40. https://doi.org/10.1001/jamainternmed.2020.6820.

    Article  CAS  PubMed  Google Scholar 

  38. Salama C, Han J, Yau L, et al. Tocilizumab in patients hospitalized with Covid-19 pneumonia. N Engl J Med. 2020;384(1):20–30. https://doi.org/10.1056/nejmoa2030340.

    Article  CAS  PubMed  Google Scholar 

  39. Zhao H, Zhu Q, Zhang C, et al. Tocilizumab combined with favipiravir in the treatment of COVID-19: a multicenter trial in a small sample size. Biomed Pharmacother. 2021;133: 110825. https://doi.org/10.1016/j.biopha.2020.110825.

    Article  CAS  PubMed  Google Scholar 

  40. Rosas IO, Bräu N, Waters M, et al. Tocilizumab in hospitalized patients with severe Covid-19 pneumonia. N Engl J Med. 2021;384(16):1503–26. https://doi.org/10.1056/NEJMoa2028700.

    Article  CAS  PubMed  Google Scholar 

  41. Veiga VC, Prats JAGG, Farias DLC, et al. Effect of tocilizumab on clinical outcomes at 15 days in patients with severe or critical coronavirus disease 2019: randomised controlled trial. BMJ. 2021;372: n84. https://doi.org/10.1136/bmj.n84.

    Article  PubMed  Google Scholar 

  42. Wang D, Fu B, Peng Z, et al. Tocilizumab ameliorates the hypoxia in COVID-19 moderate patients with bilateral pulmonary lesions: a randomized, controlled, open-label, Multicenter Trial. SSRN Electron J. 2020. https://doi.org/10.2139/ssrn.3667681.

    Article  Google Scholar 

  43. RECOVERY Collaborative Group. Tocilizumab in patients admitted to hospital with COVID-19 (RECOVERY): a randomised, controlled, open-label, platform trial. Lancet. 2021;397(10285):1637–45. https://doi.org/10.1016/S0140-6736(21)00676-0.

    Article  Google Scholar 

  44. Talaschian M, Akhtari M, Mahmoudi M, et al. Tocilizumab failed to reduce mortality in severe COVID-19 patients: results from a randomized controlled clinical trial. Res Sq. 2021. https://doi.org/10.21203/RS.3.RS-463921/V1.

    Article  Google Scholar 

  45. Lescure F-X, Honda H, Fowler RA, et al. Sarilumab in patients admitted to hospital with severe or critical COVID-19: a randomised, double-blind, placebo-controlled, phase 3 trial. Lancet Respir Med. 2021;9(5):522–32. https://doi.org/10.1016/S2213-2600(21)00099-0.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  46. Soin AS, Kumar K, Choudhary NS, et al. Tocilizumab plus standard care versus standard care in patients in India with moderate to severe COVID-19-associated cytokine release syndrome (COVINTOC): an open-label, multicentre, randomised, controlled, phase 3 trial. Lancet Respir Med. 2021;9(5):511–21. https://doi.org/10.1016/S2213-2600(21)00081-3.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  47. Sivapalasingam S, Lederer DJ, Bhore R, et al. A randomized placebo-controlled trial of sarilumab in hospitalized patients with Covid-19. MedRxiv. 2021. https://doi.org/10.1101/2021.05.13.21256973.

    Article  Google Scholar 

  48. Gordon AC, Mouncey PR, Al-Beidh F, et al. Interleukin-6 receptor antagonists in critically Ill patients with Covid-19. N Engl J Med. 2021;384(16):1491–502. https://doi.org/10.1056/NEJMoa2100433.

    Article  PubMed  Google Scholar 

  49. Rutgers A, Westerweel PE, van der Holt B, et al. Timely administration of tocilizumab improves survival of hospitalized COVID-19 patients. SSRN Electron J. 2021. https://doi.org/10.2139/SSRN.3834311.

    Article  Google Scholar 

  50. Hariyanto TI, Hardyson W, Kurniawan A. Efficacy and safety of tocilizumab for coronavirus disease 2019 (Covid-19) patients: a systematic review and meta-analysis. Drug Res. 2021;71(5):265–74. https://doi.org/10.1055/a-1336-2371.

    Article  CAS  Google Scholar 

  51. Tleyjeh IM, Kashour Z, Damlaj M, et al. Efficacy and safety of tocilizumab in COVID-19 patients: a living systematic review and meta-analysis. Clin Microbiol Infect. 2021;27(2):215–27. https://doi.org/10.1016/j.cmi.2020.10.036.

    Article  CAS  PubMed  Google Scholar 

  52. Khan FA, Stewart I, Fabbri L, et al. Systematic review and meta-analysis of anakinra, sarilumab, siltuximab and tocilizumab for COVID-19. Thorax. 2021;76(9):907–19. https://doi.org/10.1136/thoraxjnl-2020-215266.

    Article  PubMed  Google Scholar 

  53. Berardicurti O, Ruscitti P, Ursini F, et al. Mortality in tocilizumab-treated patients with COVID-19: a systematic review and meta-analysis. Clin Exp Rheumatol. 2020;38(6):1247–54.

    PubMed  Google Scholar 

  54. Kim MS, An MH, Kim WJ, Hwang TH. Comparative efficacy and safety of pharmacological interventions for the treatment of COVID-19: a systematic review and network meta-analysis. PLoS Med. 2020;17(12): e1003501. https://doi.org/10.1371/journal.pmed.1003501.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  55. Sarfraz A, Sarfraz Z, Sarfraz M, Aftab H, Pervaiz Z. Tocilizumab and COVID-19: a meta-analysis of 2120 patients with severe disease and implications for clinical trial methodologies. Turkish J Med Sci. 2021;51(3):890–7. https://doi.org/10.3906/sag-2010-131.

    Article  CAS  Google Scholar 

  56. Aziz M, Haghbin H, Abu Sitta E, et al. Efficacy of tocilizumab in COVID-19: a systematic review and meta-analysis. J Med Virol. 2021;93(3):1620–30. https://doi.org/10.1002/jmv.26509.

    Article  CAS  PubMed  Google Scholar 

  57. Malgie J, Schoones JW, Pijls BG. Decreased mortality in Coronavirus Disease 2019 patients treated with tocilizumab: a rapid systematic review and meta-analysis of observational studies. Clin Infect Dis. 2021;72(11):e742–9. https://doi.org/10.1093/cid/ciaa1445.

    Article  CAS  PubMed  Google Scholar 

  58. Kotak S, Khatri M, Malik M, et al. Use of tocilizumab in COVID-19: a systematic review and meta-analysis of current evidence. Cureus. 2020;12(10): e10869. https://doi.org/10.7759/cureus.10869.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Kow CS, Hasan SS. The effect of tocilizumab on mortality in hospitalized patients with COVID-19: a meta-analysis of randomized controlled trials. Eur J Clin Pharmacol. 2021;77(8):1089–94. https://doi.org/10.1007/s00228-021-03087-z.

    Article  CAS  PubMed  Google Scholar 

  60. Snow TAC, Saleem N, Ambler G, Nastouli E, Singer M, Arulkumaran N. Tocilizumab in COVID-19: a meta-analysis, trial sequential analysis, and meta-regression of randomized-controlled trials. Intensive Care Med. 2021;47(6):641–52. https://doi.org/10.1007/s00134-021-06416-z.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  61. Giacobbe DR, Battaglini D, Ball L, et al. Bloodstream infections in critically ill patients with COVID-19. Eur J Clin Invest. 2020;50(10): e13319. https://doi.org/10.1111/eci.13319.

    Article  CAS  PubMed  Google Scholar 

  62. Buetti N, Ruckly S, de Montmollin E, et al. COVID-19 increased the risk of ICU-acquired bloodstream infections: a case–cohort study from the multicentric OUTCOMEREA network. Intensive Care Med. 2021;47(2):180–7. https://doi.org/10.1007/s00134-021-06346-w.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  63. Ripa M, Galli L, Poli A, et al. Secondary infections in patients hospitalized with COVID-19: incidence and predictive factors. Clin Microbiol Infect. 2021;27(3):451–7. https://doi.org/10.1016/j.cmi.2020.10.021.

    Article  CAS  PubMed  Google Scholar 

  64. Zangrillo A, Beretta L, Silvani P, et al. Fast reshaping of intensive care unit facilities in a large metropolitan hospital in Milan, Italy: facing the COVID-19 pandemic emergency. Crit Care Resusc. 2020;22(2):91–4.

    PubMed  Google Scholar 

  65. Monti G, Cremona G, Zangrillo A, et al. Home ventilators for invasive ventilation of patients with COVID-19. Crit Care Resusc. 2020;22(3):266–70.

    PubMed  Google Scholar 

  66. Biondi-Zoccai GGL, Agostoni P, Abbate A. Parallel hierarchy of scientific studies in cardiovascular medicine. Ital Hear J. 2003;4(11):819–20.

    Google Scholar 

  67. Biondi-Zoccai G, Landoni G, Modena MG. A journey into clinical evidence: from case reports to mixed treatment comparisons. HSR Proc Intensive Care Cardiovasc Anesth. 2011;3(2):93–6.

    CAS  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We thank Rosalba Lembo, MSc (Department of Anaesthesia and Intensive Care, IRCCS San Raffaele Scientific Institute) for her valuable help with statistical analysis.

Funding

None.

Author information

Authors and Affiliations

  1. Department of Anesthesia and Intensive Care, IRCCS San Raffaele Scientific Institute, Milan, Italy

    Alessandro Belletti, Marilena Marmiere, Giovanni Landoni & Alberto Zangrillo

  2. Unit of Immunology, Rheumatology, Allergy and Rare Diseases, IRCCS San Raffaele Scientific Institute, Milan, Italy

    Corrado Campochiaro & Lorenzo Dagna

  3. I.M. Sechenov First Moscow State Medical University (Sechenov University), Moscow, Russia

    Valery Likhvantsev & Andrey Yavorovskiy

  4. Federal Research and Clinical Center of Resuscitation and Rehabilitation, Moscow, Russia

    Valery Likhvantsev

  5. School of Medicine, Vita-Salute San Raffaele University, Milan, Italy

    Lorenzo Dagna, Giovanni Landoni & Alberto Zangrillo

  6. Department of Cardiopneumology, Instituto Do Coração, Universidade de São Paulo, Av. Dr. Enéas de Carvalho Aguiar 44, São Paulo, 05403-900, Brazil

    Ludhmila Abrahão Hajjar

Authors
  1. Alessandro Belletti
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Corrado Campochiaro
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Marilena Marmiere
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Valery Likhvantsev
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Andrey Yavorovskiy
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Lorenzo Dagna
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Giovanni Landoni
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Alberto Zangrillo
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Ludhmila Abrahão Hajjar
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

AB: conception of the work, data collection, data analysis, data interpretation, manuscript draft, approval. CC: conception of the work, data collection, data interpretation, manuscript draft, approval. MM: data collection, revision, approval. VL: data collection, data analysis, revision, approval. AY: data analysis, revision, approval. LD: data analysis, data interpretation, revision, approval. GL: conception of the work, data interpretation, revision, approval. AZ, LAH: conception of the work, data analysis, data interpretation, revision, approval. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Ludhmila Abrahão Hajjar.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Supplementary Appendix including details on search strategies, supplementary tables S1–S2, and supplementary figures S1–S25.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Belletti, A., Campochiaro, C., Marmiere, M. et al. Efficacy and safety of IL-6 inhibitors in patients with COVID-19 pneumonia: a systematic review and meta-analysis of multicentre, randomized trials. Ann. Intensive Care 11, 152 (2021). https://doi.org/10.1186/s13613-021-00941-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13613-021-00941-2

Keywords