Skip to main content

Accuracy of ventilator-associated events for the diagnosis of ventilator-associated lower respiratory tract infections

Abstract

Background

The aim of this study was to investigate the concordance between ventilator-associated events (VAE) and ventilator-associated lower respiratory tract infections (VA-LRTI), and their impact on outcome.

Methods

This retrospective study was performed in five 10-bed ICUs of a teaching hospital, during a 2-year period. Ventilator-associated lower respiratory tract infections (VA-LRTI), including ventilator-associated tracheobronchitis (VAT) and ventilator-associated pneumonia (VAP) were prospectively diagnosed. The agreement between VAE, VAT and VAP was assessed by k statistics.

Results

A total of 1059 patients (15,029 ventilator-days) were included. 268 VAP (17.8 per 1000 ventilator-days), 127 VAT (8.5 per 1000 ventilator-days) and 262 VAE (17.4 per 1000 ventilator-days) were diagnosed. There was no agreement between VAT and VAE, and the agreement was poor between VAP and VAE (k = 0.12, 95% CI 0.03–0.20). VAE and VA-LRTI were associated with significantly longer duration of mechanical ventilation, ICU and hospital length of stay. VAP, VAT and VAE were not significantly associated with mortality in multivariate analysis.

Conclusions

The agreement was poor between VAE and VAP. No agreement was found between VAE and VAT. VAE episodes were significantly associated with longer duration of mechanical ventilation and length of stay, but not with ICU mortality.

Background

In spite of increased use of non-invasive mechanical ventilation, and high-flow nasal oxygen in the intensive care unit (ICU), invasive mechanical ventilation is still used in a large proportion of critically ill patients [1]. Ventilator-associated lower respiratory tract infections (VA-LRTI), including ventilator-associated pneumonia (VAP), and ventilator-associated tracheobronchitis (VAT) are the most common complications in patients receiving mechanical ventilation. These infections are associated with increased duration of mechanical ventilation, length of hospital stay, and cost [2, 3].

The diagnosis of these infections is based on chest X-ray, which is not specific in detecting new infiltrates in critically ill patients. Therefore, the CDC recommended using a new definition for ventilator-associated events (VAE), including infectious and other conditions. This definition includes only objective criteria and is perfectly reproducible [4]. However, recent studies and meta-analysis reported poor agreement between VAE, including ventilator-associated conditions (VAC), infection-related ventilator-associated complications (IVAC), or probable VAP (pVAP) [5,6,7]. Few studies evaluated the agreement between VAE and VA-LRTI, including VAP and VAT. Although VAP and VAT are both associated with increased duration of mechanical ventilation and length of ICU stay, only VAP is associated with increased mortality rates [8]. Thus, it is probably important to distinguish VAP from VAT. In addition, the recent ATS/IDSA guidelines on VAP recommended not treating VAT patients with antimicrobial, based on the low quality of the available evidence [9]. Therefore, we conducted this retrospective analysis of prospectively collected data to determine the agreement between VAE and VA-LRTI, including VAP and VAT. We also aimed to determine the impact of VAE on outcomes, including duration of mechanical ventilation, length of ICU and hospital stay, and mortality.

Patients and methods

Study design

This study was conducted in five 10-bed ICUs in Lille University Hospital, during a 2-year period (from January 1st, 2016 through December 31st, 2017). The IRB of the Lille University Hospital approved the study and waived informed consent. In accordance with the French law, and because of the retrospective observational design, written informed consent was not required. All patients hospitalized in one of the 5 ICUs and receiving invasive mechanical ventilation for at least 5 days were eligible for this study. Patients who received mechanical ventilation for < 5 days, and those who received mechanical ventilation for > 24 h before ICU admission were excluded.

Definitions

VA-LRTI included VAP and VAT. VAP was defined as pneumonia diagnosed after 48 h of intubation and mechanical ventilation. The diagnostic criteria for VAP included a new infiltrate on chest X-ray associated with at least two of the following: body temperature ≥ 38.5 °C or < 36 °C; leukocyte count ≥ 10 × 109/L or < 1.5 × 109/L; and purulent tracheal aspirate or sputum. In addition, a microbiological confirmation was required for all patients (positive endotracheal aspirate culture ≥ 105 colony-forming units (cfu)/mL or positive bronchoalveolar lavage culture ≥ 104 cfu/mL) [9]. VAT was defined using the same criteria as for VAP, except the presence of new or progressive pulmonary infiltrate. VAE were diagnosed according to CDC definition (Additional file 1: Figure S1). VAE diagnosis was considered concordant with that of VAT or VAP, when these infections occurred within 2 days before or after the alteration of PEEP or FiO2 (Additional file 1: Figure S2).

VAP prevention and treatment

A VAP prevention strategy was routinely used during the study period. The ventilator circuit was not changed routinely. Sedation and weaning were based on a written protocol. A minimal positive end expiratory pressure of 5 cm H2O was used in all patients. Oral cavity was cleaned with chlorhexidine thrice daily. Cuff pressure was measured and adjusted (25 cm H2O) by nurses thrice a day. Tracheal suctioning was routinely performed by nurses, using an open tracheal suction system. Patients remained in semi-recumbent position, and received enteral nutrition based on a written protocol.

Antibiotic treatment for patients with suspected VAP was based on ATS/IDSA guidelines [9]. Antibiotic treatment for other infections was based on written local guidelines adapted from international and national guidelines. Stress ulcer prophylaxis was not routinely used. Selective digestive decontamination was not used.

Data collection

Data related to VAP and VAT episodes were prospectively collected. Data regarding mechanical ventilation (PEEP and FiO2) were automatically imported every hour in the patient management software ICIP® (Philips Healthcare). Data from 2-h time slots were then retrospectively examined to determine the episodes of VAE. Other data such as body temperature, leukocytosis, antibiotic use, patient characteristics, aetiology of VAE episodes, duration of mechanical ventilation and hospitalization, and mortality were collected retrospectively from patients’ computerized medical records.

Statistical analysis

The incidence rate and Cohen’s kappa coefficients were calculated on all episodes of VAE, VAP and VAT. The concordance between the diagnosis for VAC, IVAC, pVAP and that of VAP and VAT was determined by Cohen’s kappa statistic [10].

Only first episodes were taken to examine patients’ characteristics according to the occurrence of VAE, VAP and VAT. Qualitative variables were expressed in percentage. Because of non-normal distribution, quantitative variables were expressed in median, 25th and 75th percentiles. Chi squared test, or Fisher’s exact test; and Mann–Whitney U test, or Kruskal–Wallis test, were used to compare the qualitative and quantitative variables, respectively. The difference was considered significant when p < 0.05. When a significant difference existed between patients with VAP, VAT, and those with no VA-LRTI, comparisons between different groups were performed: VAP vs VAT, VAP vs no VA-LRTI and VAT vs no VA-LRTI.

Multivariate analyses, using forward multiple logistic regression models, were performed to determine the impact of VA-LRTI and VAE on mortality, adjusting for age, SAPS II and immunosuppression.

Results

Out of the 1896 patients who received invasive mechanical ventilation, 837 (44%) were excluded (Fig. 1). Overall 1059 patients were included and received 15,029 days of invasive mechanical ventilation.

Fig. 1
figure 1

Flowchart. Data are number of patients. p, probable; IVAC, infectious ventilator-associated condition; VAC, ventilator-associated condition; VAP, ventilator-associated pneumonia; VAT, ventilator-associated tracheobronchitis

Incidence of VAE and VA-LRTI

A total of 262 episodes of VAC (17.4 for 1000 ventilator-days), 268 VAP (17.8 for 1000 ventilator-days) and 127 VAT (8.5 for 1000 ventilator-days) were diagnosed and used for concordance analysis.

At least one episode of VAC, IVAC, and pVAP was diagnosed in 227 (21.4%), 123 (11.6%), and 62 (5.9%) patients, respectively. At least one episode of VAT or VAP were diagnosed in 99 (9.3%) and 215 (20.3%) patients, respectively. Among patients with VAT, 12 (9.4%) patients developed a subsequent VAP.

Correlation between VAE and VA-LRTI

A total of 6 VAT and 71 VAP were correlated with VAC (Fig. 2). Concordance (kappa statistic) between VAC and VAP, IVAC and VAP, pVAP and VAP were 0.03 (95% CI 0–0.11), 0.15 (95% CI 0.07–0.23), and 0.27 (95 CI 0.18–0.35), respectively (Table 1). Because of the small number of patients with VAE and VAT (n = 6), kappa statistic could not be calculated.

Fig. 2
figure 2

Consistency between VAE and VA–LRTI diagnoses. Data are number of VAE, VAP, or VAT. All episodes of VAE, VAP or VAT were taken into account. p, probable; IVAC, infectious ventilator-associated condition; VAC, ventilator-associated condition; VAE, ventilator-associated events; VAP, ventilator-associated pneumonia; VAT, ventilator-associated tracheobronchitis

Table 1 Correlation between ventilator-associated events and ventilator-associated lower respiratory tract infections

Clinical significance of VAE

The most common causes for VAE were VAP (n = 79, 30%), and atelectasis (n = 53, 20%). 2.6% of VAE were possibly related to VAT, and no aetiology was found for (63, 24%) episodes (Fig. 3).

Fig. 3
figure 3

Clinical causes for VAE. APO, acute pulmonary oedema; ARDS, acute respiratory distress syndrome; VAP, ventilator-associated pneumonia; VAT, ventilator-associated tracheobronchitis

Patient characteristics based on VA-LRTI

Characteristics of patients who presented VAT, VAP, or no VA-LRTI are presented in Table 2. A significant difference was found between the three groups regarding male gender, age, neurologic failure at ICU admission, and immunosuppression. Median duration of mechanical ventilation before VAT, and VAP occurrence was 9 (5, 13), and 7 (4, 13) days, respectively.

Table 2 Patient characteristics at ICU admission, based on the presence of ventilator-associated lower respiratory tract infections

Patient characteristics based on VAE

The characteristics of patients with VAC, IVAC, or pVAP, and those without these conditions are presented in Table 3. In VAC patients, as compared with those with no VAC, male gender, SOFA at ICU admission, and BMI > 30 were significantly higher. In IVAC patients, as compared with those with no IVAC, SOFA score at ICU admission, and BMI > 30 were significantly higher. In pVAP patients, as compared with those with no pVAP, age, medical category, and Charlson comorbidity index were significantly lower. Median duration of mechanical ventilation before VAC, and iVAC, and pVAP occurrence was 5 (3, 9), 5 (3, 9), and 5 (4, 10) days, respectively.

Table 3 Patient characteristics at ICU admission, based on the presence of ventilator-associated events

Outcomes based on VA-LRTI

ICU mortality, duration of mechanical ventilation and length of stay were significantly different between patients with VAP, VAT, or no VA-LRTI (Table 4). In patients with VAP, as compared with those with no VA-LRTI, duration of mechanical ventilation, and length of stay were significantly higher. In patients with VAP, as compared with those with VAT, ICU mortality was significantly higher. In patients with VAT, as compared with those with no VA-LRTI, duration of mechanical ventilation and length of stay were higher, and ICU mortality was significantly lower. In multivariate analysis, the occurrence of VA-LRTI was not associated with mortality (Table 6).

Table 4 Outcomes of study patients based on the presence of ventilator-associated lower respiratory tract infections

Outcomes based on VAE

Although duration of mechanical ventilation and length of stay were significantly higher in patients with VAC, IVAC, or pVAC, as compared with those without these conditions, no significant difference in mortality was found between these different groups (Table 5). In multivariate analysis, the occurrence of VAE, or of VA-LRTI was not associated with mortality (Table 6).

Table 5 Outcomes of study patients based on the presence of ventilator-associated events
Table 6 Risk factor for ICU mortality by multivariate analysis

Discussion

Our results suggest that VAE are moderately correlated to VAP, and not correlated to VAT. VAE and VA-LRTI are all associated with increased duration of mechanical ventilation and length of hospital and ICU stay. VA-LRTI and VAE were not independently associated with mortality.

The strengths of our study include the large number of included patients (n = 1059) and ventilator days (n = 15,029), and the prospective evaluation of all VA-LRTI, including VAT. Previous studies reported similar findings regarding the correlation between VAE and VAP [6, 11, 12]. However, few studies prospectively evaluated the incidence of VAT in patients with VAE [11, 13]. Among the 262 diagnosed episodes of VAE, only 6 (2%) were possibly related to VAT. Thus, the correlation between VAE, and VAT could not be calculated. In a retrospective analysis of prospectively collected data, Bouadma et al. [11] identified aetiologies of each episode and found only 1% of VAC caused by tracheobronchitis.

Worsening of ventilatory parameters is not a mandatory criterion for VA-LRTI definition, and only the Clinical Pulmonary Infection Score (CPIS) includes the alteration of the PaO2/FiO2. Our study and previous studies [5, 11] reported that an important percentage of VAE episodes were possibly related to VAP, and not to VAT. This clearly suggests that using alteration of oxygenation, i.e. PaO2/FiO2, could be helpful in differentiating VAP from VAT. Differentiating these two infections could be a difficult task, as the accuracy of chest X-ray in diagnosing new infiltrates is low [14,15,16]. However, it is still important to differentiate them, as antibiotic treatment is not recommended for VAT and inappropriate use of antimicrobials is a risk factor for subsequent emergence of multidrug-resistant bacteria [17, 18]. Previous large observational studies and two small randomized controlled trials suggested beneficial effects of systemic and inhaled antibiotics. However, several limitations preclude definite conclusions on the interest of antimicrobials in patients with VAT, and further large multicentre randomized controlled trials are required.

The incidence of VAE in our study is in line with previous findings. However, the incidence of VAP (21%) is somehow higher than that reported by recent studies [19]. This could be explained by the fact that only patients receiving mechanical ventilation for > 4 days were included in our study.

VAE, and VA-LRTI were associated with significantly longer duration of mechanical ventilation and hospital and ICU stay. However, VAE and VA-LRTI were not independently associated with mortality. In contrast, two previous studies reported that VAE were associated with significantly higher mortality rates [11, 12].

VAE diagnosis algorithm is based on objective criteria and easy to use in routine in mechanically ventilated patients. However, the clinical relevance of VAE is not clear. First, our study and previous ones clearly showed that applying a VAE algorithm surveillance is not accurate in detecting VA-LRTI. Second, the impact of a ventilator bundle on VAE incidence is unknown. Few studies have focused on the preventability of VAE, but it seems that bundles applied for VAP prevention are not completely effective for VAE prevention [20,21,22]. Our results show that many VAE were non-infectious events as atelectasis, pleural effusion or acute pulmonary embolism. This might explain why ventilator bundles are not effective in preventing VAE, and should not be used to assess the quality of care in mechanically ventilated patients.

VAE algorithm failed in identifying most of VAT and 73% of VAP episodes and should not be used to start an empirical treatment of VA-LRTI. Furthermore, the retrospective nature of VAE does not allow its use at bedside. In fact, to meet IVAC criteria, patients must have 2 days of stable oxygenation parameter and 2 days of worsening ventilatory settings after which a new antibiotic must be prescribed for at least 4 days.

Our study has some limitations. First, it was performed in a single center, and its results may not be generalized to all ICU patients. Second, it was retrospective. However, all VA-LRTI were prospectively identified. Third, no data were collected on duration of antibiotic treatment before VA-LRTI, and VAE, neither on appropriateness of antibiotic treatment in patients with VA-LRTI. Fourth, the definition of VAT and VAP was based on chest X-ray that was interpreted by physicians in charge and no blind interpretation was performed. The prolonged duration of mechanical ventilation reported in patients with VA-LRTI, or VAE, as compared to those with no infection, or no VAE could not be attributed to these events as no adjustment was performed.

Conclusion

VAE and VA-LRTI are common in mechanically ventilated critically ill patients, and have a significant impact on duration of mechanical ventilation and length of stay. VAE are moderately correlated to VAP, and not correlated to VAT. Our results suggest that VAE should not be used as a marker of quality of care or to start empirical antibiotic treatment.

Availability of data and materials

All data are provided in the manuscript.

Abbreviations

CI:

confidence interval

CPIS:

clinical pulmonary infection score

OR:

odds ratio

RGV:

residual gastric volume

VAP:

ventilator-associated pneumonia

VAT:

ventilator-associated tracheobronchitis

References

  1. Nosocomial infection surveillance in intensive care units. REA-Raisin network, France—Results 2017. https://www.santepubliquefrance.fr/docs/surveillance-des-infections-nosocomiales-en-reanimation-adulte-reseau-rea-raisin-france-resultats-2017. Accessed 22 Apr 2019.

  2. Safdar N, Dezfulian C, Collard H, Saint S. Clinical and economic consequences of ventilator-associated pneumonia: a systematic review. Crit Care Med. 2005;33(10):2184–93.

    Article  PubMed  Google Scholar 

  3. Martin-Loeches I, Povoa P, Rodríguez A, Curcio D, Suarez D, Mira J-P, et al. Incidence and prognosis of ventilator-associated tracheobronchitis (TAVeM): a multicentre, prospective, observational study. Lancet Respir Med. 2015;3(11):859–68.

    Article  PubMed  Google Scholar 

  4. Nuckchady D, Heckman MG, Diehl NN, Creech T, Carey D, Domnick R, et al. Assessment of an automated surveillance system for detection of initial ventilator-associated events. Am J Infect Control. 2015;43(10):1119–21.

    Article  PubMed  Google Scholar 

  5. Fan Y, Gao F, Wu Y, Zhang J, Zhu M, Xiong L. Does ventilator-associated event surveillance detect ventilator-associated pneumonia in intensive care units? A systematic review and meta-analysis. Crit Care. 2016;20(1):338.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Klein Klouwenberg PMC, van Mourik MSM, Ong DSY, Horn J, Schultz MJ, Cremer OL, et al. Electronic implementation of a novel surveillance paradigm for ventilator-associated events. Feasibility and validation. Am J Respir Crit Care Med. 2014;189(8):947–55.

    Article  PubMed  Google Scholar 

  7. Nair GB, Niederman MS. Ventilator-associated pneumonia: present understanding and ongoing debates. Intensive Care Med. 2015;41(1):34–48.

    Article  PubMed  Google Scholar 

  8. Melsen WG, Rovers MM, Groenwold RH, Bergmans DC, Camus C, Bauer TT, et al. Attributable mortality of ventilator-associated pneumonia: a meta-analysis of individual patient data from randomised prevention studies. Lancet Infect Dis. 2013;13(8):665–71.

    Article  PubMed  Google Scholar 

  9. Kalil AC, Metersky ML, Klompas M, Muscedere J, Sweeney DA, Palmer LB, et al. Management of Adults with hospital-acquired and ventilator-associated pneumonia: 2016 Clinical Practice Guidelines by the Infectious Diseases Society of America and the American Thoracic Society. Clin Infect Dis. 2016;63(5):e61–111.

    Article  PubMed  PubMed Central  Google Scholar 

  10. McHugh ML. Interrater reliability: the kappa statistic. Biochem Med. 2012;22(3):276–82.

    Article  Google Scholar 

  11. Bouadma L, Sonneville R, Garrouste-Orgeas M, Darmon M, Souweine B, Voiriot G, et al. Ventilator-associated events: prevalence, outcome, and relationship with ventilator-associated pneumonia. Crit Care Med. 2015;43(9):1798–806.

    Article  PubMed  Google Scholar 

  12. Muscedere J, Sinuff T, Heyland DK, Dodek PM, Keenan SP, Wood G, et al. The clinical impact and preventability of ventilator-associated conditions in critically ill patients who are mechanically ventilated. Chest. 2013;144(5):1453–60.

    Article  PubMed  Google Scholar 

  13. the EU-VAE Study Investigators Group, Ramírez-Estrada S, Lagunes L, Peña-López Y, Vahedian-Azimi A, Nseir S, et al. Assessing predictive accuracy for outcomes of ventilator-associated events in an international cohort: the EUVAE study. Intensive Care Med. 2018;44(8):1212–20.

    Article  Google Scholar 

  14. Butler KL. The chest radiograph in critically ill surgical patients is inaccurate in predicting ventilator-associated pneumonia. Am Surg. 1999;40:805–9.

    Google Scholar 

  15. Hayden GE, Wrenn KW. Chest radiograph vs. computed tomography scan in the evaluation for pneumonia. J Emerg Med. 2009;36(3):266–70.

    Article  PubMed  Google Scholar 

  16. Self WH, Courtney DM, McNaughton CD, Wunderink RG, Kline JA. High discordance of chest X-ray and computed tomography for detection of pulmonary opacities in ED patients: implications for diagnosing pneumonia. Am J Emerg Med. 2013;31(2):401–5.

    Article  PubMed  Google Scholar 

  17. Vincent J-L. International study of the prevalence and outcomes of infection in intensive care units. JAMA. 2009;302(21):2323.

    Article  CAS  PubMed  Google Scholar 

  18. Barbier F, Lisboa T, Nseir S. Understanding why resistant bacteria are associated with higher mortality in ICU patients. Intensive Care Med. 2016;42(12):2066–9.

    Article  PubMed  Google Scholar 

  19. Koulenti D, Tsigou E, Rello J. Nosocomial pneumonia in 27 ICUs in Europe: perspectives from the EU-VAP/CAP study. Eur J Clin Microbiol Infect Dis. 2017;36(11):1999–2006.

    Article  CAS  PubMed  Google Scholar 

  20. Kallet RH. Ventilator bundles in transition: from prevention of ventilator-associated pneumonia to prevention of ventilator-associated events. Respir Care. 2019;64(8):994–1006.

    Article  PubMed  Google Scholar 

  21. Klompas M, Anderson D, Trick W, Babcock H, Kerlin MP, Li L, et al. The preventability of ventilator-associated events. The CDC Prevention Epicenters Wake Up and Breathe Collaborative. Am J Respir Crit Care Med. 2015;191(3):292–301.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Cocoros NM, Klompas M. Ventilator-associated events and their prevention. Infect Dis Clin North Am. 2016;30(4):887–908.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

None.

Funding

None.

Author information

Authors and Affiliations

Authors

Contributions

SN, and AR designed the study. OP, and SN performed statistical analyses. All authors collected the data, contributed in interpretation of the results, drafted and approved the submitted manuscript. SN had full access to the data and takes the responsibility for the integrity of the data and the accuracy of the data analysis. OP and SL contributed equally to this study. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Saad Nseir.

Ethics declarations

Ethics approval and consent to participate

The IRB of the Lille University Hospital approved the study and waived informed consent. In accordance with the French law, and because of the retrospective observational design, written informed consent was not required.

Consent for publication

Not applicable.

Competing interests

SN: MSD (advisory board and lecture); Pfizer, Gilead, Bio Rad, and Biomérieux (lecture). AR: Maatpharma (advisory board); Pfizer (lecture). Other authors: none.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

 Online supplementary material.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pouly, O., Lecailtel, S., Six, S. et al. Accuracy of ventilator-associated events for the diagnosis of ventilator-associated lower respiratory tract infections. Ann. Intensive Care 10, 6 (2020). https://doi.org/10.1186/s13613-020-0624-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13613-020-0624-6

Keywords