Skip to main content

The 2014 updated version of the Confusion Assessment Method for the Intensive Care Unit compared to the 5th version of the Diagnostic and Statistical Manual of Mental Disorders and other current methods used by intensivists

Abstract

Background

One third of patients admitted to an intensive care unit (ICU) will develop delirium. However, delirium is under-recognized by bedside clinicians without the use of delirium screening tools, such as the Intensive Care Delirium Screening Checklist (ICDSC) or the Confusion Assessment Method for the ICU (CAM-ICU). The CAM-ICU was updated in 2014 to improve its use by clinicians throughout the world. It has never been validated compared to the new reference standard, the Diagnostic and Statistical Manual of Mental Disorders 5th version (DSM-5).

Methods

We made a prospective psychometric study in a 16-bed medical–surgical ICU of a French academic hospital, to measure the diagnostic performance of the 2014 updated CAM-ICU compared to the DSM-5 as the reference standard. We included consecutive adult patients with a Richmond Agitation Sedation Scale (RASS) ≥ −3, without preexisting cognitive disorders, psychosis or cerebral injury. Delirium was independently assessed by neuropsychological experts using an operationalized approach to DSM-5, by investigators using the CAM-ICU and the ICDSC, by bedside clinicians and by ICU patients. The sensitivity, specificity, positive and negative predictive values were calculated considering neuropsychologist DSM-5 assessments as the reference standard (primary endpoint). CAM-ICU inter-observer agreement, as well as that between delirium diagnosis methods and the reference standard, was summarized using κ coefficients, which were subsequently compared using the Z-test.

Results

Delirium was diagnosed by experts in 38% of the 108 patients included for analysis. The CAM-ICU had a sensitivity of 83%, a specificity of 100%, a positive predictive value of 100% and a negative predictive value of 91%. Compared to the reference standard, the CAM-ICU had a significantly (p < 0.05) higher agreement (κ = 0.86 ± 0.05) than the physicians,’ residents’ and nurses’ diagnoses (κ = 0.65 ± 0.09; 0.63 ± 0.09; 0.61 ± 0.09, respectively), as well as the patient’s own impression of feeling delirious (κ = 0.02 ± 0.11). Differences between the ICDSC (κ = 0.69 ± 0.07) and CAM-ICU were not significant (p = 0.054). The CAM-ICU demonstrated a high reliability for inter-observer agreement (κ = 0.87 ± 0.06).

Conclusions

The 2014 updated version of the CAM-ICU is valid according to DSM-5 criteria and reliable regarding inter-observer agreement in a research setting. Delirium remains under-recognized by bedside clinicians.

Background

Nearly one third of patients admitted to an intensive care unit (ICU) will develop delirium [1], which is subsequently associated with sedation–analgesia management issues [2,3,4], an increased duration of mechanical ventilation, length of stay in the ICU and hospital, risk of death, as well as of having long-term neurocognitive dysfunction [1, 5]. Guidelines recommend the routine use of validated clinical tools for the early recognition and treatment of delirium by medical and nursing ICU teams, even if they are not expert neuropsychologists [6].

Among the delirium diagnosis tools that can be used by ICU clinicians in routine practice, the Confusion Assessment Method for the ICU (CAM-ICU) [7, 8] and the Intensive Care Delirium Screening Checklist (ICDSC) [9] have been extensively studied for more than 15 years, demonstrating good psychometric properties in a research setting [6]. In 2014, the CAM-ICU and its training manual were updated to avoid any misinterpretation by users (Table 1). Also, the original version of the CAM-ICU [7, 8] was validated against the American Psychiatric Association’s fourth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV). Differences between the 4th and the new 5th versions (DSM-5) regarding delirium assessment are still under debate [10, 11].

Table 1 Principal changes made in the 2014 updated version of the CAM-ICU training manual

The primary objective of this study was to measure the ability of the 2014 updated version of the CAM-ICU to diagnose delirium according to the most updated neuropsychological reference standard, i.e., the DSM-5 method. Secondary objectives were (1) to measure inter-observer agreement for the CAM-ICU, and (2) within the context of a comprehensive investigation of delirium assessment in a real-life intensive care setting, to compare the diagnostic accuracy of the CAM-ICU to the ICDSC and to physician, resident and nurse recognition of delirium, as well as to common orientation questions and to the patient’s own impression of feeling delirious.

Methods

Ethics and consent

The protocol was approved by an independent ethics committee [Comité de Protection des Personnes (CPP) Sud Méditerranée.IV (N°ID-RCB: 2015-A01084-45; Protocol version 1: 06/23/2015)] and was conducted in accordance with the Declaration of Helsinki (clinicaltrials.gov: NCT02760446). Written consent was required from the patient or the legally authorized representative or a proxy/surrogate decision maker (patient’s next of kin) who gave consent on the patient’s behalf, followed by the patient’s consent as soon they could communicate.

Population

The study took place in the 16-bed medical–surgical ICU of the University of Montpellier Saint Eloi Hospital, an academic tertiary-care hospital, from November 2015 to April 2016. All consecutive French-speaking patients ≥ 18-year old were eligible for enrollment if they had a Richmond Agitation Sedation Scale (RASS) ≥ −3 [12,13,14]. Exclusion criteria were preexisting cognitive disorder/psychosis (baseline cognitive status is often unknown early in the ICU stay, precluding accurate evaluation of change in mental status, a key feature of delirium), visual/hearing loss without helpers, pregnancy (according to French law), patients under tutelage, withdrawal of consent or change in clinical status that would preclude a complete cognitive testing.

Study conduct

All consecutive patients admitted to our ICU were screened by the ICU research team every morning including weekends, until they reached the inclusion criteria during a period of 5 months (November 2015–March 2016). After having obtained consent and enrolling the patient, the ICU research team contacted one of two neuropsychological experts participating in the study to independently perform a neuropsychological assessment of delirium. Figure 1 summarizes the timing of delirium assessments by the neuropsychological experts and the ICU research team.

Fig. 1
figure 1

Study design. The order of assessments by the research team was determined to check both the patient’s eligibility and the presence of some CAM-ICU and ICDSC features (i.e., fluctuating course of mental status assessed by RASS ratings). ICDSC was assessed after CAM-ICU because ICDSC included some CAM-ICU features (i.e., inattention). RASS Richmond Agitation Sedation Scale, CAM-ICU Confusion Assessment Method for the Intensive Care Unit, ICDSC Intensive Care Delirium Screening Checklist, DSM-5 5th version of the Diagnostic and Statistical Manual of Mental Disorders

Data collection

Delirium

Delirium was assessed once, the same day, in five ways that occurred as close together as possible in time, but strictly independent of each other. Separate clinical research forms were used to assure independence between observers.

1. ICU delirium tools: CAM-ICU and ICDSC

The ICU research team used the French versions of the 2014 updated CAM-ICU training manual and the ICDSC [9, 15]. The CAM-ICU was assessed by two independent investigators to estimate inter-observer agreement.

2. Expert neuropsychological assessment of delirium (the reference standard)

The neuropsychological experts were members of the speech and language therapy team, usually in charge of neuropsychological testing in the neurology/neurosurgery/neuro-ICU departments of the Neurosciences University Hospital of Montpellier. A standardized method for diagnosing delirium was used based on the DSM-5 [16] using the Montreal Cognitive Assessment (MOCA) [17], Dubois’ 5-word test [18], Language Screening Test (LAST) [19], with helpers for intubated ICU patients (see Additional file 1: Supplemental Digital Content).

3. Bedside–clinician assessment of delirium

When immediately available, the patient’s bedside ICU team (i.e., the patient’s nurse, resident and attending physician) were contacted by the ICU research team to get their personal feeling about the presence or absence of delirium.

4. The 3 simple orientation/memory questions for the assessment of delirium

The ICU research team also assessed delirium by asking three simple questions commonly used to assess delirium at our institution: Where are you? What day is it today? Who is the president? (because long-term memory is frequently altered in delirium) [20]. The number of incorrect and absent response(s) was recorded.

5. The patient’s own feeling

At the end of testing, the patients were asked by the ICU research team if they had the impression they were confused.

Demographic and medical data

Age, gender, comorbidities and the reason for ICU admission were recorded. The Simplified Acute Physiological Score II (SAPS-II) score [21] and the Sequential Organ Failure Assessment (SOFA) score [22] were calculated within 24 h after ICU admission and upon enrollment. In case enrollment occurred before 24 h, the SAPS-II score took into account the worst value available during the 24 h preceding enrollment. Therapeutics such as sedation, mechanical ventilation and the use of vasopressors were collected upon enrollment.

Data presentation and statistical analysis

Psychometric properties of the CAM-ICU

Validity (primary endpoint)

The performance of the CAM-ICU for diagnosing delirium was assessed by measuring the sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) according to standardized definitions [23, 24]. Expert assessments were used as the reference standard.

Reliability

The kappa coefficient was calculated between the two ICU research investigators. Kappa coefficients above 0.80, 0.60 and 0.40 are considered as measuring ‘near perfect,’ ‘strong’ and ‘moderate’ levels of agreement [25], respectively.

The diagnostic performance of other methods commonly used to assess delirium (ICSDC, bedside clinician assessments, 3-question test), as well as patients’ impressions)

The sensitivity, specificity, PPV and NPV were also calculated using the expert assessments as the reference standard. To compare all five methods for diagnosing delirium, kappa coefficients were calculated between the expert assessments and the other methods. Kappa coefficient comparisons between methods were made using the Z-test [26]. A p value of < 0.05 was considered statistically significant.

Power analysis

The study sample size was determined in relation to the primary endpoint. For expected values [8] of sensitivity and specificity at 85 and 75%, respectively, a desired level of precision set at 10% and the prevalence of delirium set at 50%, the number of patient inclusions required for achieving appropriate power would be 95. Taking into account possible post-enrollment exclusions, 115 patients needed to be enrolled in the study. The prevalence of delirium ranged from 30 to 90% in the literature [1]. Thus, we set the prevalence of delirium at 50% which is conservative regarding the number of patients needed to be analyzed, in order to maximize the power.

Data presentation

Quantitative data are shown as medians and 25th–75th percentiles. Data were analyzed using SAS version 9.2 (SAS Institute, Cary, NC).

Results

A total of 108 patients were included for analysis among the 115 patients enrolled in the study. A Standards for Reporting of Diagnostic Accuracy (STARD) diagram for patient enrollment is shown in Additional file 1: Supplemental Digital Content. Table 2 summarizes patient demographic and medical characteristics. Delirium was diagnosed by the neuropsychological experts for 41 of the 108 patients (38%).

Table 2 Demographic and medical characteristics of the 108 patients included for analysis

Validation of the 2014 updated CAM-ICU

A positive CAM-ICU was found for 34 (31%) patients. Compared to expert assessments, there were 7 misclassified CAM-ICU ratings among the 108 ratings, of which there were 7 false negatives and no false positives. Compared to expert assessments, the CAM-ICU had a sensitivity of 83% [95% confidence interval 71–94], a specificity of 100% [100–100], a PPV of 100% [100–100] and a NPV of 91% [84–97].

To measure the inter-observer reliability of the CAM-ICU, 98 patients were assessed by a second investigator. For the ten remaining patients, a second assessment was impossible because of changes in vigilance status or clinical condition. The kappa coefficient for inter-observer reliability was 0.87 (SD ± 0.06) demonstrating strong agreement. There were no significant differences between the 5 ICU investigators and the 2 neuropsychological experts (kappa coefficients ranging from 0.82 ± 0.1 to 0.88 ± 0.2). First and second CAM-ICU investigators obtained similar agreement with experts’ assessments (kappa coefficients = 0.86 ± 0.1 and 0.85 ± 0.1, respectively).

Diagnostic performance of commonly used methods for assessing delirium

Table 3 presents the statistical measurement of performance regarding delirium recognition via the CAM-ICU, and the ICDSC, by nurses, residents and physicians, as well as via three simple questions. The CAM-ICU demonstrated good performance, while the 3 simple questions demonstrated poor performance. The 3 simple questions demonstrated the highest sensitivity for a false or absent response, but with the lowest specificity and PPV. The ICDSC and clinicians’ diagnosis demonstrated similar performances.

Table 3 Patients’ clinical diagnosis and simple orientation questions

Figure 2 shows the graphic representation of kappa coefficients for each of the methods used to assess delirium. The kappa coefficient measured the agreement between each of the methods and the assessment by the neuropsychological experts using DSM-5 criteria (reference standard). There was a significant difference between the level of agreement found for the CAM-ICU (kappa 0.86 ± 0.05) and that found for other methods (p < 0.047), except the ICDSC (0.69 ± 0.07, p = 0.054, Z-test). Detailed data regarding CAM-ICU/ICDSC procedures are provided in Additional file 1: Supplemental Digital Content.

Fig. 2
figure 2

Agreement between different delirium assessment methods and the neurological experts’ reference rating using the DSM-5 criteria. This figure shows the graphic representation of kappa coefficients and their standard deviations for each of the methods used to assess delirium. The kappa coefficient measured the agreement between each of the methods and the assessment by the neuropsychologist experts using DSM-5 criteria (reference standard). For simple questions, we did not decide a priori how to analyze the answers. Because some patients answered some questions but did not answer other ones, we decided a posteriori to analyze these data following two approaches: including all patients and including only the patients able to answer all the questions. Several thresholds were tested, i.e., delirium was defined in all patients if they gave at least 1 or 2 false or no response(s), or, among the patients who were able to answer all simple questions, if the patients gave at least 1 or 2 false response(s). There was a significant difference (p < 0.047) between the CAM-ICU and each of the other methods, except the ICDSC (p = 0.054). There were significant differences between “all methods from CAM-ICU to ≥ 1 false response to simple questions” and “patient’s own impression of feeling delirious,” as well as between “all methods from CAM-ICU to nurse diagnosis” and “≥ 2 false responses to simple questions” or “patient’s own impression of feeling delirious.” *: Significant difference (p < 0.05); CAM-ICU Confusion Assessment Method for the Intensive Care Unit, ICDSC Intensive Care Delirium Screening Checklist

The 3 simple questions and the patient’s own impression had the lowest agreements with experts and demonstrated significant differences with other methods.

Patient’s own impression of feeling delirious

Among the 108 patients, 77 (71%) were able to answer the question as to whether they felt delirious or not (all had a RASS level ≥ −1). Among these patients, 27 (35%) answered that they were. The patient’s sensitivity for recognizing delirium compared to expert assessments was 38%, with a specificity of 66%, a PPV of 22% and a NPV of 80%.

Discussion

The main finding of this study is that the 2014 updated version of the CAM-ICU was valid compared to the DSM-5 reference standard, with strong inter-observer agreement. CAM-ICU and ICDSC agreed with experts’ opinion without significant difference. The CAM-ICU had superior performance for diagnosing delirium compared to the bedside–clinicians’ opinion, as well as compared to simple questions that are commonly used to assess delirium. Patient impressions of feeling delirious are not accurate, with a false-positive rate at 78%.

Delirium is multifactorial and frequent in critically ill ICU patients [6, 27,28,29,30,31,32,33,34,35]. It is diagnosed in 10–90% of ICU patients, depending on the diagnosis tool, the timing of assessment (during or after interrupting sedation), as well as the frequency of assessment (one-point assessment for validation studies or throughout the ICU stay) [6, 36]. A recent review of 42 studies estimated the prevalence of delirium at 5280 (31.8%) out of 16,595 critically ill patients [1]. The prevalence of delirium in the present study is close to this result: 38% according to neuropsychological assessment and 31% according to the CAM-ICU. Although frequent, delirium is under-recognized by both physicians and nurses [37]. Compared to the CAM-ICU, clinician sensitivity for diagnosing delirium is about 30% [38, 39]. The recognition of delirium by physicians and nurses in the present study was better, with a sensitivity of nearly 70%, suggesting that there might have been an increase in clinician awareness regarding delirium in the ICU over the past decade [40]. However, with PPVs under 80% and NPVs under 90% in the present study, clinicians should still use an ICU delirium tool to improve their diagnostic performance, according to current guidelines [6]. In the present study, agreement with expert diagnosis was not significantly different between the CAM-ICU and the ICDSC. In previous studies, the pooled sensitivity and specificity were 76 and 96%, respectively, for the CAM-ICU, and 80 and 75% for the ICDSC [41]. Sensitivity and specificity were slightly higher for both tools in the present study. This could be due to the study setting where a research team with experience in conducting research in the area of sedation–analgesia was available to conduct this psychometric study. Indeed, performance measurements for ICU delirium tools are higher in research settings than in real life [41]. However, the original study validating the CAM-ICU reported higher sensitivity and specificity than in the present study, with a sensitivity ranging from 93 to 100% and a specificity ranging from 98 to 100% [8]. This could be due to differences in the studied populations. In the original study [8], patients had a median Glasgow score of 7 at enrollment, while in the present study, 80% of patients had a RASS level ≥ 0, suggesting they were more alert. It has been reported that the CAM-ICU could have a lower sensitivity in alert patients, possibly because of better cognitive function [42, 43]. Because delirium prevalence and recognition may depend on the level of consciousness, some authors recommend stratifying delirium assessments for sedation score using a cutoff of RASS − 2 [44]. In the present study also, when taking into account only the 99 patients who had a RASS level of > −2 for a sensitivity analysis, the delirium prevalence was lower than in the overall population (32% instead of 38% according to the experts, 25% instead of 31%, according to the CAM-ICU). The CAM-ICU had a slightly lower sensitivity (78%, instead of 83%), while conserving the same specificity, positive and negative predictive values. Similar findings were obtained when excluding from the analysis the 12 patients who were sedated (8 of them having a RASS level of > −2).

Our study has several limitations. For example, all the methods for diagnosing delirium were assessed within a short time. This may have tired patients and decreased their cognitive functions. The research team planned the assessments within the space of an hour to increase the chance of measuring delirium at the same time for a given patient (Fig. 1). The agreement between the neuropsychological expert and the CAM-ICU was not significantly different whether the expert performed the assessment before or after the research team (kappa coefficient 0.86 ± 0.1 vs 0.85 ± 0.1, respectively). Secondly, except ICDSC, many other validated delirium tools [42] were not performed in order to make the duration of assessment feasible. In the same way, the ICDSC could have demonstrated higher sensitivity and specificity if it had been performed in more alert patients, and by the patient’s clinicians rather than by the research team. To perform the ICDSC, the research team took into account all nursing/medical charts (Fig. 1) but performed only “punctual” cognitive evaluations instead of evaluations over a nursing shift. The ICDSC was not performed by the patient’s clinicians to avoid any bias regarding their raw opinion about the presence or the absence of delirium. In other words, clinicians did not use a validated delirium tool which is to take into account for the interpretation of the data. The primary goal of the present study was to validate the 2014 updated version of the CAM-ICU. Measuring the psychometric properties of the ICDSC was only informative because it is a second recommended tool for assessing delirium and therefore frequently used throughout the world [6]. Moreover, the present study demonstrated no significant difference between the ICDSC and CAM-ICU regarding the agreement between the ICU research team and the neuropsychological experts (Fig. 2). However, this study was not calibrated to measure this difference. A longer period of evaluation could have resulted in a higher sensitivity for ICDS. Similarly, repeated measurements of delirium on a longer period of time could have lead to a higher sensitivity. Regarding the expert’s assessment, DSM-5 interpretations and use as a reference standard for delirium are a source of debate and thus may vary according to assessor [10, 11]. Finally, all the causes of delirium were not investigated because this was out of the scope of this psychometric study. Sepsis was present in 44% of patients at admission, and 11% of patients received sedatives at enrollment. Thus, a few intubated patients were included, due to a strategy of “early-sedation-interruption.” This study should be further performed in different settings/ICU populations.

Study strengths include the reference standard method used by experts to diagnose delirium, which was provided for the first time in detail to facilitate study reproducibility (see Additional file 1: Supplemental Digital Content). Aside from the expert assessment, a pragmatic approach for diagnosing delirium was also evaluated in order to reflect real-life situations in intensive care. This included nurse, resident and physician diagnoses, as well as commonly used simple orientation/memory questions. These questions are not appropriate for diagnosing delirium. This might be due to patient disorientation, which can be related to environment (absence of windows). The recommendation to use a validated delirium tool is reinforced by the fact that the ICU team is used to conducting clinical research and quality improvement projects in the area of agitation, sedation and analgesia [45,46,47]. Even in such an “a priori” favorable setting for the early recognition of delirium, bedside–clinicians still need to use a validated tool during their routine practice, repeatedly during the day and throughout the ICU stay. This is paramount for treating the factors associated with delirium [6, 27,28,29,30,31,32,33,34,35] as soon as possible, especially when taking into account the negative outcomes associated with delirium [5, 6]. A comprehensive approach [48] integrating delirium management with analgesia, sedation, mechanical ventilation, mobility/exercise and family engagement/empowerment has shown a positive impact on increasing ventilatory-free days [49, 50], decreasing delirium incidence [49,50,51] and improving hospital mortality [51].

Finally, the study investigated the patient’s ability to recognize delirium. Though delusional memories are frequent in ICU survivors, they have not been investigated during hospitalization in the ICU setting [52,53,54]. Recent studies found no significant association between delirium in the ICU and mental disorders in survivors [55,56,57]. However, memories of being delirious in the ICU are associated with anxiety [56]. The link between delirium recollection, feelings of being delirious while in the ICU (which is possibly theoretically wrong or too abstract for some patients) and long-term psychological outcomes thus requires further exploration.

Conclusions

The 2014 updated version of the CAM-ICU is a valid tool for delirium diagnosis in a research setting in critically ill patients according to the DSM-5 criteria used by neuropsychological experts. It demonstrated important inter-observer reliability, and better performance for diagnosing delirium in ICU patients than physicians, residents and nurses, despite increased awareness regarding delirium in the ICU for many years. Future studies should investigate the discrepancies between validated methods to diagnose delirium (DSM-5, CAM-ICU, ICDSC) and the ICU team. Moreover, the patient’s own ability to report delirium might be inaccurate. Ethics committees should pay attention to delirium assessment when checking for patient’s ability to consent to participate in ICU studies [58]. This suggests also that delusional memories reported by survivors should be investigated in regard to a valid assessment of delirium during the ICU stay. In the ICU, patients should be asked about feeling delirious, comforted if they are not, but be taken care of regarding what could make them feel so.

Abbreviations

CAM-ICU:

Confusion Assessment Method for the Intensive Care Unit

DSM-5:

5th version of the Diagnostic and Statistical Manual of Mental Disorders

ICDSC:

Intensive Care Delirium Screening Checklist

ICU:

Intensive care unit

NPV:

negative predictive value

PPV:

positive predictive value

RASS:

Richmond Agitation Sedation Scale

SAPS II:

Simplified Acute Physiological Score II score

SOFA:

Sequential Organ Failure Assessment

References

  1. Salluh JI, Wang H, Schneider EB, Nagaraja N, Yenokyan G, Damluji A, et al. Outcome of delirium in critically ill patients: systematic review and meta-analysis. BMJ. 2015;350:h2538.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Chanques G, Tarri T, Ride A, Prades A, De Jong A, Carr J, et al. Analgesia nociception index for the assessment of pain in critically ill patients: a diagnostic accuracy study. Br J Anaesth. 2017;119:812–20.

    Article  CAS  PubMed  Google Scholar 

  3. Chanques G, Payen JF, Mercier G, de Lattre S, Viel E, Jung B, et al. Assessing pain in non-intubated critically ill patients unable to self report: an adaptation of the Behavioral Pain Scale. Intensive Care Med. 2009;35:2060–7.

    Article  PubMed  Google Scholar 

  4. Wang PP, Huang E, Feng X, Bray CA, Perreault MM, Rico P, et al. Opioid-associated iatrogenic withdrawal in critically ill adult patients: a multicenter prospective observational study. Ann Intensive Care. 2017;7:88.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Pandharipande PP, Girard TD, Jackson JC, Morandi A, Thompson JL, Pun BT, et al. Long-term cognitive impairment after critical illness. N Engl J Med. 2013;369:1306–16.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Barr J, Fraser GL, Puntillo K, Ely EW, Gelinas C, Dasta JF, et al. Clinical practice guidelines for the management of pain, agitation, and delirium in adult patients in the intensive care unit. Crit Care Med. 2013;41:278–80.

    Article  Google Scholar 

  7. Ely EW, Margolin R, Francis J, May L, Truman B, Dittus R, et al. Evaluation of delirium in critically ill patients: validation of the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU). Crit Care Med. 2001;29:1370–9.

    Article  CAS  PubMed  Google Scholar 

  8. Ely EW, Inouye SK, Bernard GR, Gordon S, Francis J, May L, et al. Delirium in mechanically ventilated patients: validity and reliability of the confusion assessment method for the intensive care unit (CAM-ICU). JAMA. 2001;286:2703–10.

    Article  CAS  PubMed  Google Scholar 

  9. Bergeron N, Dubois MJ, Dumont M, Dial S, Skrobik Y. Intensive Care Delirium Screening Checklist: evaluation of a new screening tool. Intensive Care Med. 2001;27:859–64.

    Article  CAS  PubMed  Google Scholar 

  10. Adamis D, Rooney S, Meagher D, Mulligan O, McCarthy G. A comparison of delirium diagnosis in elderly medical inpatients using the CAM, DRS-R98, DSM-IV and DSM-5 criteria. Int Psychogeriatr. 2015;27:883–9.

    Article  PubMed  Google Scholar 

  11. Meagher DJ, Morandi A, Inouye SK, Ely W, Adamis D, Maclullich AJ, et al. Concordance between DSM-IV and DSM-5 criteria for delirium diagnosis in a pooled database of 768 prospectively evaluated patients using the delirium rating scale-revised-98. BMC Med. 2014;12:164.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Sessler CN, Gosnell MS, Grap MJ, Brophy GM, O’Neal PV, Keane KA, et al. The Richmond Agitation–Sedation Scale: validity and reliability in adult intensive care unit patients. Am J Respir Crit Care Med. 2002;166:1338–44.

    Article  PubMed  Google Scholar 

  13. Ely EW, Truman B, Shintani A, Thomason JW, Wheeler AP, Gordon S, et al. Monitoring sedation status over time in ICU patients: reliability and validity of the Richmond Agitation–Sedation Scale (RASS). JAMA. 2003;289:2983–91.

    Article  PubMed  Google Scholar 

  14. Chanques G, Jaber S, Barbotte E, Verdier R, Henriette K, Lefrant J, et al. Validation of the French translated Richmond vigilance-agitation scale. Ann Fr Anesth Reanim. 2006;25:696–701.

    Article  CAS  PubMed  Google Scholar 

  15. Chanques G, Garnier O, Carr J, Conseil M, de Jong A, Rowan CM, et al. The CAM-ICU has now a French “official” version. The translation process of the 2014 updated Complete Training Manual of the Confusion Assessment Method for the Intensive Care Unit in French (CAM-ICU.fr). Anaesth Crit Care. Pain Med. 2017;36:297–300.

    Google Scholar 

  16. American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders. 5th edition. Arlington, VA; 2013.

  17. Nasreddine ZS, Phillips NA, Bedirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53:695–9.

    Article  PubMed  Google Scholar 

  18. Dubois B, Touchon J, Portet F, Ousset PJ, Vellas B, Michel B. “The 5 words”: a simple and sensitive test for the diagnosis of Alzheimer’s disease. Presse Med. 2002;31:1696–9.

    CAS  PubMed  Google Scholar 

  19. Flamand-Roze C, Falissard B, Roze E, Maintigneux L, Beziz J, Chacon A, et al. Validation of a new language screening tool for patients with acute stroke: the Language Screening Test (LAST). Stroke. 2011;42:1224–9.

    Article  PubMed  Google Scholar 

  20. Meagher D, Adamis D, Trzepacz P, Leonard M. Features of subsyndromal and persistent delirium. Br J Psychiatry. 2012;200:37–44.

    Article  PubMed  Google Scholar 

  21. Legall J-R, Lemeshow S, Saulnier F. New Simplified Acute Physiology Score (SAPS II) based on a European/North American Multicenter Study. JAMA. 1993;270:2957–63.

    Article  CAS  Google Scholar 

  22. Vincent J, de Mendonça A, Cantraine F, Moreno R, Takala J, Suter P, et al. Use of the SOFA score to assess the incidence of organ dysfunction/failure in intensive care units: results of a multicenter, prospective study. Working group on “sepsis-related problems” of the European Society of Intensive Care Medicine. Crit Care Med. 1998;26:1793–800.

    Article  CAS  PubMed  Google Scholar 

  23. Altman DG, Bland JM. Diagnostic tests 2: predictive values. BMJ. 1994;309:102.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  24. Altman DG, Bland JM. Diagnostic tests. 1: sensitivity and specificity. BMJ. 1994;308:1552.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  25. Landis J, Koch G. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.

    Article  CAS  PubMed  Google Scholar 

  26. Altman DG, editor. Practical statistics for medical research. London: Chapman and Hall; 1991.

    Google Scholar 

  27. Page VJ, Davis D, Zhao XB, Norton S, Casarin A, Brown T, et al. Statin use and risk of delirium in the critically ill. Am J Respir Crit Care Med. 2014;189:666–73.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  28. Van Rompaey B, Elseviers MM, Van Drom W, Fromont V, Jorens PG. The effect of earplugs during the night on the onset of delirium and sleep perception: a randomized controlled trial in intensive care patients. Crit Care. 2012;16:R73.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Kamdar BB, Niessen T, Colantuoni E, King LM, Neufeld KJ, Bienvenu OJ, et al. Delirium transitions in the medical ICU: exploring the role of sleep quality and other factors. Crit Care Med. 2015;43:135–41.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Serafim RB, Dutra MF, Saddy F, Tura B, de Castro JE, Villarinho LC, et al. Delirium in postoperative nonventilated intensive care patients: risk factors and outcomes. Ann Intensive Care. 2012;2:51.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Rafat C, Flamant M, Gaudry S, Vidal-Petiot E, Ricard JD, Dreyfuss D. Hyponatremia in the intensive care unit: How to avoid a Zugzwang situation? Ann Intensive Care. 2015;5:39.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Delaney LJ, Van Haren F, Lopez V. Sleeping on a problem: the impact of sleep disturbance on intensive care patients—a clinical review. Ann Intensive Care. 2015;5:3.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Dittrich T, Tschudin-Sutter S, Widmer AF, Ruegg S, Marsch S, Sutter R. Risk factors for new-onset delirium in patients with bloodstream infections: independent and quantitative effect of catheters and drainages—a four-year cohort study. Ann Intensive Care. 2016;6:104.

    Article  PubMed  PubMed Central  Google Scholar 

  34. van Ewijk CE, Jacobs GE, Girbes ARJ. Unsuspected serotonin toxicity in the ICU. Ann Intensive Care. 2016;6:85.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Neuville M, El-Helali N, Magalhaes E, Radjou A, Smonig R, Soubirou JF, et al. Systematic overdosing of oxa- and cloxacillin in severe infections treated in ICU: risk factors and side effects. Ann Intensive Care. 2017;7:34.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Patel SB, Poston JT, Pohlman A, Hall JB, Kress JP. Rapidly reversible, sedation-related delirium versus persistent delirium in the intensive care unit. Am J Respir Crit Care Med. 2014;189:658–65.

    Article  PubMed  Google Scholar 

  37. SRLF Trial Group. Sedation in French intensive care units: a survey of clinical practice. Ann Intensive Care. 2013;3:24.

    Article  Google Scholar 

  38. Spronk PE, Riekerk B, Hofhuis J, Rommes JH. Occurrence of delirium is severely underestimated in the ICU during daily care. Intensive Care Med. 2009;35:1276–80.

    Article  PubMed  PubMed Central  Google Scholar 

  39. van Eijk MM, van Marum RJ, Klijn IA, de Wit N, Kesecioglu J, Slooter AJ. Comparison of delirium assessment tools in a mixed intensive care unit. Crit Care Med. 2009;37:1881–5.

    Article  PubMed  Google Scholar 

  40. Patel RP, Gambrell M, Speroff T, Scott TA, Pun BT, Okahashi J, et al. Delirium and sedation in the intensive care unit: survey of behaviors and attitudes of 1384 healthcare professionals. Crit Care Med. 2009;37:825–32.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Neto AS, Nassar AP Jr, Cardoso SO, Manetta JA, Pereira VG, Esposito DC, et al. Delirium screening in critically ill patients: a systematic review and meta-analysis. Crit Care Med. 2012;40:1946–51.

    Article  PubMed  Google Scholar 

  42. Luetz A, Heymann A, Radtke FM, Chenitir C, Neuhaus U, Nachtigall I, et al. Different assessment tools for intensive care unit delirium: which score to use? Crit Care Med. 2010;38:409–18.

    Article  PubMed  Google Scholar 

  43. Mitasova A, Kostalova M, Bednarik J, Michalcakova R, Kasparek T, Balabanova P, et al. Poststroke delirium incidence and outcomes: validation of the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU). Crit Care Med. 2012;40:484–90.

    Article  PubMed  Google Scholar 

  44. Haenggi M, Blum S, Brechbuehl R, Brunello A, Jakob SM, Takala J. Effect of sedation level on the prevalence of delirium when assessed with CAM-ICU and ICDSC. Intensive Care Med. 2013;39:2171–9.

    Article  CAS  PubMed  Google Scholar 

  45. Chanques G, Jaber S, Barbotte E, Violet S, Sebbane M, Perrigault P, et al. Impact of systematic evaluation of pain and agitation in an intensive care unit. Crit Care Med. 2006;34:1691–9.

    Article  PubMed  Google Scholar 

  46. de Jong A, Molinari N, de Lattre S, Gniadek C, Carr J, Conseil M, et al. Decreasing severe pain and serious adverse events while moving intensive care unit patients: a prospective interventional study (the NURSE-DO project). Crit Care. 2013;17:R74.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Dodek P, Chanques G, Brown G, Norena M, Grubisic M, Wong H, et al. Role of organisational structure in implementation of sedation protocols: a comparison of Canadian and French ICUs. BMJ Qual Saf. 2012;21:715–21.

    Article  PubMed  Google Scholar 

  48. Ely EW. The ABCDEF bundle: science and philosophy of how ICU liberation serves patients and families. Crit Care Med. 2017;45:321–30.

    Article  PubMed  Google Scholar 

  49. Balas MC, Vasilevskis EE, Olsen KM, Schmid KK, Shostrom V, Cohen MZ, et al. Effectiveness and safety of the awakening and breathing coordination, delirium monitoring/management, and early exercise/mobility bundle. Crit Care Med. 2014;42:1024–36.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Chanques G, Conseil M, Roger C, Constantin JM, Prades A, Carr J, et al. Immediate interruption of sedation compared with usual sedation care in critically ill postoperative patients (SOS-Ventilation): a randomised, parallel-group clinical trial. Lancet Respir Med. 2017;5:795–805.

    Article  PubMed  Google Scholar 

  51. Barnes-Daly MA, Phillips G, Ely EW. Improving hospital survival and reducing brain dysfunction at seven California community hospitals: implementing PAD guidelines via the ABCDEF bundle in 6,064 patients. Crit Care Med. 2017;45:171–8.

    Article  PubMed  Google Scholar 

  52. Jones C, Bäckman C, Capuzzo M, Flaatten H, Rylander C, Griffiths RD. Precipitants of post-traumatic stress disorder following intensive care: a hypothesis generating study of diversity in care. Intensive Care Med. 2007;33:978–85.

    Article  CAS  PubMed  Google Scholar 

  53. Jones C, Griffiths RD, Humphris G, Skirrow PM. Memory, delusions, and the development of acute posttraumatic stress disorder-related symptoms after intensive care. Crit Care Med. 2001;29:573–80.

    Article  CAS  PubMed  Google Scholar 

  54. Parker AM, Sricharoenchai T, Raparla S, Schneck KW, Bienvenu OJ, Needham DM. Posttraumatic stress disorder in critical illness survivors: a metaanalysis. Crit Care Med. 2015;43:1121–9.

    Article  PubMed  Google Scholar 

  55. Wolters AE, Peelen LM, Welling MC, Kok L, de Lange DW, Cremer OL, et al. Long-term mental health problems after delirium in the ICU. Crit Care Med. 2016;44:1808–13.

    Article  PubMed  Google Scholar 

  56. Svenningsen H, Egerod I, Christensen D, Tonnesen EK, Frydenberg M, Videbech P. Symptoms of posttraumatic stress after intensive care delirium. Biomed Res Int. 2015;2015:876947.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Jackson JC, Pandharipande PP, Girard TD, Brummel NE, Thompson JL, Hughes CG, et al. Depression, post-traumatic stress disorder, and functional disability in survivors of critical illness in the BRAIN-ICU study: a longitudinal cohort study. Lancet Respir Med. 2014;2:369–79.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Fan E, Shahid S, Kondreddi VP, Bienvenu OJ, Mendez-Tellez PA, Pronovost PJ, et al. Informed consent in the critically ill: a two-step approach incorporating delirium screening. Crit Care Med. 2008;36:94–9.

    Article  PubMed  Google Scholar 

Download references

Authors’ contributions

GC, EWE, CMR, SMG and SJ contributed to study concept and design; OG, FP, AE and AP contributed to data acquisition; GC, EWE, SMG and SJ contributed to data analysis and interpretation; GC, ADJ and NM contributed to statistical methods and statistical data analysis; GC, EWE and JC contributed to manuscript preparation and drafting; CMR, ADJ, SMG and SJ contributed to manuscript critique and review. All authors read and approved the final manuscript.

Acknowledgements

We would like to thank all patients who participated in the study and the families who gave their consent for participation, as well as the clinical and research staff. We also thank Dr. Carey M. Suehs for her help with English corrections.

Competing interests

In contexts unrelated to the present work, Pr Jaber has consulted for and received honorarium from the following companies: Dräger, Hamilton, Maquet and Fisher Paykel. No other conflicts of interest related to this article exist for the other authors.

Availability of data and materials

The datasets supporting the conclusion of this article are available from the corresponding author on reasonable request.

Consent for publication

All patients or surrogates gave a written consent to participate in the study allowing for data analysis and publication.

Ethics approval and consent to participate

The protocol was approved by an independent ethics committee [Comité de Protection des Personnes (CPP) Sud Méditerranée.IV (N°ID-RCB: 2015-A01084-45; Protocol version 1: 06/23/2015)] and was conducted in accordance with the Declaration of Helsinki (clinicaltrials.gov: NCT02760446). Written consent was required from the patient or the legally authorized representative or a proxy/surrogate decision maker (patient’s next of kin) who gave consent on the patient’s behalf, followed by the patient’s consent as soon they could communicate.

Funding

Support for this study was provided solely via institutional and/or departmental sources (Montpellier University Hospitals; 34000, France).

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Gérald Chanques.

Additional file

Additional file 1: Figure S1.

Standards for Reporting of Diagnostic Accuracy (STARD) diagram. Figure S2. Procedure data regarding the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU). Table S1. Procedure data regarding the Intensive Care Delirium Screening Checklist (ICDSC). Protocol. Standardized neuropsychological assessment of delirium, adapted for critically ill patients. Helpers for intubated patients, used by neuropsychological experts.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chanques, G., Ely, E.W., Garnier, O. et al. The 2014 updated version of the Confusion Assessment Method for the Intensive Care Unit compared to the 5th version of the Diagnostic and Statistical Manual of Mental Disorders and other current methods used by intensivists. Ann. Intensive Care 8, 33 (2018). https://doi.org/10.1186/s13613-018-0377-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13613-018-0377-7

Keywords