Evaluation of emotional excitation during standardized endotracheal intubation in simulated conditions
Annals of Intensive Care volume 8, Article number: 117 (2018)
To assess how stressful conditions in endotracheal intubation could induct emotional excitation in a population of acute care physicians.
Materials and methods
Two situations were randomly tested: one in standard and easy intubation conditions the other under difficult conditions presumed to induce stress (monitoring alarms, manikin lying on the floor, difficult intubation). Emotional excitation was assessed using several physiological (cardiac patterns, electrodermal activity and eye-tracking) and psycho-cognitive patterns. Auto-evaluations of video recordings and mental workload were performed immediately after simulation.
Significant physiological parameter modifications were observed under the stressful intubation conditions (SDNN 35 ± 15 vs. 42 ± 21; p = 0.035—AVNN 514 ± 94 vs. 548 ± 110; p < 0.0001). Emotional excitation was demonstrated to lead a higher mental workload (NASA-TLX = 39 ± 18 vs. 63 ± 15; p = 0.001), frustration and effort dimensions being its determinant components (p < 0.01). Video recording auto-evaluations depicted significant emotional excitation occurrence under the difficult conditions, with few differences according to the operator’s experience.
This study highlights the fact that a stress condition during ETI on a simulation model leads to an important emotional excitation as compared to the neutral condition.
Endotracheal intubation (ETI) is a standard procedure for the airway management. In emergency medicine (EM), anesthesiology and critical care, it is a challenging procedure associated with severe life-threatening complications, including cardiac arrest. These complications vary according to the operator expertise and depend on several factors, notably in prehospital EM, i.e., unstable medical conditions, environmental requirements, unknown patient medical history  and emotional excitation.
Technical skills training has traditionally been modeled on an apprenticeship system, where trainees operated under direct supervision from their seniors. Over recent years, this system has evolved, taking into account security concepts developed in the aerospace sector with simulation and healthcare guidelines from national authorities [2, 3]. Simulation is increasingly used in this setting, and different learning programs exist between juniors and seniors .
Emotional excitation that is frequently and improperly called “stress” can be considered as a psychological status that may affect physicians’ performance . While a certain degree of emotional excitation may improve task performance (positive impact), it can also become a threat when the perceived demand outweighs individual resources (negative impact, i.e., “stress”).
We made the hypothesis that stress conditions to IOT would induce a high level of emotional excitation as compared to neutral conditions and that the experience could lead to a lower level of stress.
The main objective of this study was to assess how stressful conditions in ETI could induct emotional excitation in a population of acute care physicians. A second objective was to assess how emotional excitation varied among seniors and juniors.
Materials and methods
This prospective, crossover, randomized study was conducted in situ by the CESIM Santé—LATIM INSERM UMR 1101 research unit at Brest University Hospital (France) between April and May 2016.
A block randomization was used to determine the scenario’s order.
The study was approved by our local ethics committee, and participants were asked to complete a demographic questionnaire and to sign informed consent.
The study was conducted with acute care medicine juniors and seniors. Seniors had to be at least one-year experienced, but juniors could have no prior or a few experience in endotracheal intubation on real patients.
Intubation was performed using an endotracheal tube with 7.0 mm of internal diameters (Mallinckrodt, Dublin, Ireland). The direct laryngoscopy was performed using a Macintosh blade (Size 4). Participants could use a flexible mandrel if needed.
The success of the intubation was secondarily confirmed by an experienced practitioner by a visual control and a lungs’ auscultation.
Two scenarios of drug overdose were designed and tested before prior to the study, to ensure reproducibility and realistic environmental conditions.
ETI was performed using standard devices of our hospital. All subjects, juniors included, were familiar with these devices. We used an ALS Kelly manikin (Laerdal, Stavanger, Norway) and two standardized recordings of the patient’s monitoring system simulator evolution (LLEAP, Laerdal, Stavanger, Norway):
Neutral condition The manikin was lying supine on a stretcher that could be adjusted by participants. Vital signs were considered stable [heart rate (HR) = 90 bpm, blood pressure = 120/80 mmHg, oxygen saturation (SpO2) = 98%, normal sinus rhythm]. Endotracheal intubation was to be free of any difficult intubation-associated factors. No evolution of the scenario was to occur during the intubation procedure.
Stress condition The manikin was lying supine on the floor, in a corner of the room, with reduced available space. Patient’s clinical condition was to deteriorate gradually within 2 min: from tachycardia, to atrial fibrillation and ventricular tachycardia; hypoxemia was present at the beginning of the scenario, despite adequate preoxygenation, and was to deteriorate (SpO2 decrease from 92 to 70%). The tongue of the manikin was blown up to Cormack class IV. Deterioration of physiological parameters was to trigger the monitor’s range alarms after a 15-s period, and the alarm volume was set to be very loud.
Physicians handled the scenarios consecutively, in a randomized and crossover design. Participants were informed that ETI was the main purpose of the study and that global care was not required. Preoxygenation and rapid sequence induction were considered already carried out. ECG and pulse oximetry monitor, and all necessary devices were placed beside the manikin, and if required, operators could ask for a gum elastic bougie.
A limit of two unsuccessful attempts and/or a maximum duration of 5 min were considered to define ETI failure.
Emotional excitation assessment
Emotional excitation was assessed using various physiological and psycho-cognitive parameters:
Heart rate variability (HRV). HRV offers a noninvasive indicator of autonomic nervous system activity  and was recorded using a two-lead electrocardiogram attached to the upper chest. The signal was sampled at 1000 Hz using a Biopac® MP36R system and analyzed using AcqKnowledge software (Biopac Systems Inc, Santa Barbara, CA, USA). All data were visually checked for quality control. Time-domain and frequency-domain analyses of beat-to-beat RR intervals were performed according to the following parameters :
Heart rate (HR), the average of RR intervals.
Maximum heart rate (maxHR).
Standard deviation of RR intervals (SDNN). SDNN reflects all the cyclic components responsible for variability in the period of recording and therefore represents total variability.
Average of all RR intervals (AVNN).
LF/HF ratio, ratio of low (LF) to high (HF) frequency power. HF is the power spectral density of series of the RR intervals between 0.15 and 0.40 Hz due to parasympathetic activity, and LF is the power spectral density for intervals between 0.04 and 0.15 Hz due to sympathetic activity. LF/HF ratio. LF/HF ratio was proposed as an index of sympathetic to parasympathetic balance of heart rate fluctuation .
Electrodermal activity (EDA). EDA can also be used to examine implicit emotional responses that may occur with or without conscious awareness (i.e., threat, anticipation) . An Embrace wristband (Empatica, Cambridge, MA, USA) was used to monitor EDA via skin conductance level (SCL). SCL is a tonic level of electrical skin conductivity in EDA activity  and is presumed to reflect sympathic nervous system activity.
Eye-tracking. Eye-tracking is a technique that provides an objective, quantifiable and measurable link between an individual and his immediate environment . SMI eye-tracking glasses (SensoMotoric Instruments GmbH, Teltow, Germany) recorded saccades, blinking and eye fixations using iView ETG 2.2 and BeGaze 3.5.101 software (SensoMotoric Instruments GmbH, Teltow, Germany) to record and export data into video and text formats. SMI glasses were adjusted and calibrated individually, before each simulation. Calibration was carried out by aligning the focus circle as displayed on the output screen of the eye tracking notebook with the actual fixation focus of the participant. Data were subsequently analyzed using a proprietary software. Blinks and fixations were recorded in the central vision. Periods with excessive noise, usually due to movement, were eliminated from analysis. Blinks and fixations were expected higher in a stress condition.
Psycho-cognitive evaluations were performed using three different methods after each scenario:
Likert-type scale. Each practitioner evaluated stress level using a Likert-type scale, from 1—none—to 10—very important stress
Mental workload. Mental workload estimation was assessed using the National Aeronautics and Space Administration Task Load Index (NASA-TLX) [12, 13]. This questionnaire is regularly used to evaluate different medical and surgical procedures and to assess human–machine interface (HMI).
Self-assessment stress evaluation. It was carried out immediately after each scenario, while viewing back-recorded video sequences. The participant was asked to quantify his stress level from 0 to 100 using a haptic 3D wheel navigator (3Dconnexion Space Navigator) and a proprietary software (Autoconfrontation V1.0.4, BCom, Brest, France).
Statistical analysis and data entry were performed using SPSS 23.0 software (IBM Corporation, Armonk, NY, USA). Continuous quantitative data are presented as means ± STD. Non-normally distributed data are presented using median and extreme values, categorical variables by a percentage. Statistical analysis was performed using the Wilcoxon test in between groups and the two scenarios for the same population. P-values equal or below 0.05 were considered significant.
Twenty-six acute care physicians were recruited (16 seniors, 10 juniors). Their general characteristics are depicted in Table 1. Physiological patterns are shown in Table 2 and Fig. 1, and psycho-cognitive and subjective assessments are shown in Table 3 and Fig. 2.
Emotional excitation between scenarios
Physiological patterns as HR, maxHR, SDNN and AVNN differed statistically between neutral and stress condition (Table 2, Fig. 1). SCL did not differ between scenarios. The number of blinks and eye fixations was statistically higher in stress condition.
Task load index significantly differed, and subjective assessment of stress felt during scenarios was statistically higher during stress condition.
Emotional excitation in each group
HR, maxHR and AVNN differed statistically between neutral and stress conditions for seniors (Table 2). We did not observe a difference in HRV patterns between neutral and stress condition for juniors, except with SDNN.
SCL did not differ between scenarios for seniors and juniors, and the number of eye fixations was statistically higher in stress condition for seniors.
In the TLX assessment, temporal workload and effort dimensions were higher during stress condition for juniors, while performance and frustration dimensions likewise differed for seniors as compared to neutral condition.
In neutral condition, 96% of the participants succeed to perform intubation after the first attempt and 100% after the second attempt. In stress condition, 15.5% succeed after the first attempt, 61.5% after the second attempt, and 23% failed to perform intubation.
This study highlights the fact that a stress condition during ETI on a simulation model leads to an important emotional excitation as compared to the neutral condition. While emotional excitation yet occurred for all participants, unlike studies performed in surgery , the data collected in this study suggest that in such conditions, experience has a limited impact on emotional excitation.
Acute care medicine can be considered as a complex system where emotional excitation is one element, interacting with other components such as task performance, such interactions being responsible for human errors . Medical simulation is a powerful tool to assess the different features of emotional excitation and to measure interactions between practitioners and tasks. Our study design depicts a comprehensive approach of emotional excitation, where each physiological and psycho-cognitive data enable to explore specific responses to stress.
HR reflects emotional excitation among practitioners . HR is higher during the first few minutes of the simulation [15,16,17] and subsequently decreases, possibly due to the practitioner’s getting used to the simulation exercise. It is worthwhile to note that most of the practitioners had high HR, even exceeding 80% of their theoretical maximal value. In our study, HR was significantly higher during stress condition than neutral condition which is consistent with the literature . Heart rate variability (HRV) is a physiological phenomenon, which is a suitable assessment of the autonomous nervous system controlling the heart functions, thus exploring another aspect of HR in emotional excitation.
Considering that cardiovascular activity is directly influenced by the autonomic nervous system, LF/HF ratio has been proposed as an index of sympathetic to parasympathetic balance of heart rate fluctuation. HF is driven by respiration and appears to be an indicator of the parasympathetic activity, while LF is derived from both parasympathetic and sympathetic activity. HRV was also explored through AVNN and SDNN measurements, which are presumed to be less dependent from emotional excitation. Our data therefore suggest a disturbed autonomic nervous system function during simulation . Such a phenomenon has been associated with mental stress  and suggested to indicate inability to respond to physiological variability . Senior HRV tends to be higher than junior ones, which may raise the hypothesis that experience is responsible for a more tranquil behavior, as also observed in other studies [18, 19, 21]. During HRV frequency analysis, low HR values were responsible for a higher LF/HF ratio, the persistence of this indicator within scenarios indicating sympathetic system activation, even in a neutral situation . Short-lasting exposure to psychosocial stressors has been described to indicate parasympathetic withdrawal and increased sympathetic activity .
Emotional excitation induces an increase in the sweat gland activity and therefore a modification of the electrical properties of the skin (EDA), which can be assessed by SCL . However, SCL values did not differ in between scenarios within our study. Wachtel et al. reported that in the event of stress, some participants were slower to respond to peripheral stimuli ; it could therefore be considered that the delay in between the scenarios was too short in our study. While 10–25% of our participants were estimated as non-responders in terms of EDA , some participants may have cardiovascular abnormalities, which may lead to EDA rhythmic artefacts . Finally, it is not possible to obtain high-quality EDA measurements from some individuals, especially in simulation conditions with movement artefacts .
Another way to assess stress is eye-tracking techniques, which provides an objective, quantifiable and measurable link between an individual and his immediate environment . Because links between the focus of vision and the focus of cognition have been established , eye-tracking may provide useful information for studying situational awareness . As expected, eye fixation and number of blinks were higher in stress conditions, suggesting an enhanced encoding of the environment  in order to improve performance. However, juniors had more eye fixation in neutral conditions than experienced practitioners, and they did not experience more fixation during stress condition. As compared to juniors, seniors had more eye fixations in stress conditions. Herten et al. showed that emotional excitation leads to a memory enhancement and to promote attentional narrowing toward relevant stimuli at the expense of irrelevant data, associated with more eye fixation . Schulz et al. have demonstrated that juniors were spending more time looking at the patients’ monitoring devices than experts . They suggested than experienced practitioners might be able to maintain sufficient situation awareness without spending more time in monitoring tasks and could actively direct their attention toward manual and relevant tasks . Our results suggested stress condition was not associated with a memory enhancement for juniors, probably due to their inexperience. In normal condition, we suspect than eye fixation was linked with an inappropriate attentional narrowing on irrelevant data. By contrast, because of emotional excitation, seniors were able to better optimize their memory to improve their performance than juniors, resulting with more eye fixation in stress condition. Attentional narrowing in a stressful situation may be related to a greater fixation [31, 32], thus being a predictor of memory performance . While stress seems to prepare the organism for accurate attentional processing of relevant stimuli, eye-tracking technology has the potential to transform the way clinical simulation is evaluated, thereby helping to improve patient safety . Its standardized use may lead to the development of training protocols to improve students’ education.
According to our participants, the stress condition generated more emotional excitation and more mental workload than neutral condition. Task load index, assessed by NASA-TLX, is a psycho-cognitive scale measuring difficulty to perform a task . In the NASA-TLX measurement, TLX is influenced by two types of dimension: (1) dimensions depending on human–machine interface (mental, physical and temporal workload) and (2) dimensions depending on the task and on the environment of the task (effort, performance and frustration). Within our study, the importance of each dimension differed in between groups. For seniors, the difference mainly concerned the performance and frustration, while for juniors there was a trend toward physical workload increase. These results could be explained by the fact that experience diverts the focus of participants when they are subjected to emotional excitation. Juniors are concerned by procedure itself, while seniors are concerned by success, which can generate frustration.
Our study suffers from limitations. First, while this was an exploratory study, no power calculation was performed to assess sample size and a post hoc analysis may consider that the observed power was insufficient to allow conclusion on the secondary objectives of the study. Moreover, while practitioners were recruited at their workplace, individual stress factors independent from our study could have been exerted on participants. Second, heart rate variations might be influenced by physiological demand that could differ between scenarios. However, this does not seem to be a major problem for results analysis while: (1) HRV variations are not strictly correlated with heart rate values; (2) physiological demand during the difficult intubation scenario was calibrated to be as lower as possible for the physicians. Furthermore, other recorded parameters (that cannot be correlated with physiological demand) were consistent with an increased emotional excitation in between the two different scenarios: (1) eye-tracking assessment of blinking and eye fixation; (2) psycho-cognitive scoring using Likert scales and NASA-TLX. Third, the motion sensor clusters distributed among the practitioners were a key factor limiting their freedom of movement; the participant was alone to perform the task, while in clinical routine he will be provided some help and use several other difficult intubation equipment. Finally, the choice and interpretation of our sensors results could also be discussed. Concerning eye-tracking, Lotfus et al. concluded that attention and eye fixation could be dissociated . Beside these limitations, our study has some strengths. To the best of our knowledge, this study provides various aspects of emotional excitation, including physiological measurement (HR, eye-tracking and SCL), psycho-cognitive evaluation and subjective stress assessment. Thus, our model is the first to allow a global and comprehensive model assessing emotional excitation due to stressful conditions in acute care medicine procedure.
In conclusion, an isolated analysis of intubation during a simulation is an important source of stress for seniors and juniors when it is presented as a difficult intubation according to prehospital criteria. According to the Yerkes–Dodson law, subjects may need some part of stress to improve performance, while a too high level of stress may decrease performance . Our study depicts significant physiological and psycho-behavioral changes between ETI conditions. Medical simulation taking into account emotional excitation sensors may enable an enhancement of practitioners’ performance while improving teaching.
average of RR intervals
human machine interface
heart rate variability
maximum heart rate
skin conductance level
standard deviation of HRV
task load index
Combes X, Wang HE, Kupas DF, Paris PM, Bates RR, Costantino JP, Yealy DM. Multivariate predictors of failed prehospital endotracheal intubation. Acad Emerg Med. 2003;10:717–24.
Health French Authority. Assessment and improvement of practices. Health simulation’s good practice; 2012.
Neale G, Woloshynowych M, Vincent C. Exploring the causes of adverse events in NHS hospital practice. J R Soc Med. 2001;94:322–30.
Bond WF, Deitrick LM, Arnold DC. Using simulation to instruct emergency medicine residents in cognitive forcing strategies. Acad Med. 2004;79:438–46.
Daglius Dias R, Scalabrini Neto A. Stress levels during emergency care: a comparison between reality and simulated scenarios. J Crit Care. 2016;33:8–13.
Berntson GG, Bigger JT Jr, van der Molen MW. Heart rate variability: origins, methods, and interpretive caveats. Psychophysiology. 1997;34:623–48.
Guidelines heart rate variability standards of measurement, physiological interpretation, and clinical use task force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. Eur Heart J. 1996;17:354–81.
Pagani M, Lombardi F, Guzzetti S, Rimoldi O, Furlan RA, Pizzinelli P, et al. Power spectral analysis of heart rate and arterial pressure variabilities as a marker of sympatho-vagal interaction in man and conscious dog. Circ Res. 1986;59:178–93.
Braithwaite JJ, Watson DG, Jones R, Rowe M. A guide for analysing electrodermal activity (EDA) and skin conductance responses (SCRs) for psychological experiments. Psychophysiology. 2015;49:1017–34.
Boucsein W, Fowles DC, Grimnes S, Ben Shakhar G, Roth WT, Dawson ME, Filion DL. Publication recommendations for electrodermal measurements. Psychophysiology. 2012;49:1017–34.
Mele ML, Federici S. Gaze and eye-tracking solutions for psychological research. Cogn Process. 2012;13:261–5.
NASA Task Load Index (TLX) V 1.0 users manual, Human Systems Information Analysis Center; 1988.
Hart SG, Staveland LE. Development of NASA-TLX (task load index): results of experimental and theoretical research. Hum Ment Workload. 1988;52:139–83.
Wetzel CM, Black SA, Hanna GB, Athanasiou T, Kneebone RL, Nestel D, Wolfe JH, Woloshynowych M. The effects of stress and coping on surgical performance during simulations. Ann Surg. 2010;25(1):171–6.
Kohn LT, Corrigan JM, Donaldson MS, editors. Institute of Medicine (US) Committee on Quality of Health Care in America. To err is human: building a safer health system. Washington, DC: National Academies Press (US); 2000.
Arora S, Sevdalis N, Nestel D, Woloshynowych M, Darzi A, Kneebone R. The impact of stress on surgical performance: a systematic review of the literature. Surgery. 2010;147:318–30.
Mills B, Carter O, Rudd C, Claxton L, O’Brien R. An experimental investigation into the extent social evaluation anxiety impairs performance in simulation-based learning environments amongst final-year undergraduate nursing students. Nurse Educ Today. 2016;45:9–15.
Rieger A, Stoll R, Kreuzfeld S, Behrens K, Weippert M. Heart rate and heart rate variability as indirect markers of surgeons’ intraoperative stress. Int Arch Occup Environ Health. 2014;87:165–74.
Horsten M, Ericson M, Perski A, Wamala SP, Schenck-Gustafsson K, Orth-Gomér K. Psychosocial factors and heart rate variability in healthy women. Psychosom Med. 1999;61:49–57.
Myrtek M, Weber D, Brugner G, Muller W. Occupational stress and strain of female students:results of physiological, behavioural, and psychological monitoring. Biol Psychol. 1996;42:379–91.
Brosschot JF, Van Dijk E, Thayer JF. Daily worry is related to low heart rate variability during waking and the subsequent nocturnal sleep period. Int J Phychophysiol. 2007;63:39–47.
Clays E, De Bacquer D, Crasset V, et al. The perception of work stressors is related to reduced parasympathetic activity. Int Arch Occup Environ Health. 2011;84:185–91.
Delaney JPA, Brodie DA. Effects of short-term psychological stress on the time and frequency domains of heart-rate variability. Percept Mot Skills. 2000;91:515–24.
Naveteur J, Buisine S, Gruzelier JH. The influence of anxiety on electrodermal responses to distractors. Int J Psychophysiol. 2005;56:261–9.
Wachtel PL. Anxiety, attention and coping with threat. J Abnorm Psychol. 1968;73:137–43.
Figner B, Murphy RO. Using skin conductance in judgment and decision making research. In: Schulte-Mecklenbeck M, Kuehberger A, Ranyard R, editors. A handbook of process tracing methods for decision research. New York: Psychology Press; 2011.
Just MA, Carpenter PA. Eye fixations and cognitive processes. Cogn Psychol. 1976;8:441–80.
Williams B, Quested A, Cooper S. Can eye-tracking technology improve situational awareness in paramedic clinical education? OAEM. 2013;5:23–8.
Herten N, Otto T, Wolf OT. The role of eye fixation in memory enhanced under stress—an eye tracking study. Neurobiol Learn Mem. 2017;140:134–44.
Schulz CM, Schneider E, Schneider G. Visual attention of anaesthetists during simulated critical incidents. Br J Anaesth. 2011;106:807–13.
Chajut ED, Algom D. Selective attention improves under stress: implications for theories of social cognition. J Per Soc Psychol. 2003;85:231–48.
Christianson SA, Loftus EF, Hoffman H, Loftus GR. Eye fixations and memory for emotional events. J Exp Psychol Learn Mem Cogn. 1991;17:693–701.
Loftus GR. Eye fixations and recognition memory for pictures. Cogn Psychol. 1972;3:525–51.
Posner MI. Orienting of attention. Q J Exp Psychol A. 1980;32:3–25.
Yerkes R, Dodson J. The relation of strength of stimulus to rapidity of habit-formation. J Comp Neurol Psychol. 1908;18:459–82.
CT and ELH conceived the study. CT, NM, ELH and NP acquired data. ELH and NM provided statistical expertise. CT, NM and ELH wrote the manuscript. All authors read and approved the final manuscript.
The authors would like to acknowledge all the physicians who agreed to participate in this study. The authors wish to thank Jeffrey Arsham, an American medical translator, for reviewing and editing our original English language manuscript.
ELH is a consultant for Smiths Medical, General Electrics; he is the co-founder of Oxynov Inc., a Canadian R&D company dedicated to automation of respiratory care processes. NM received honoraria from Weinmann medical and Airliquide healthcare for lectures. CT and NP do not declare any conflict of interest.
Ethics approval and consent to participate
No funding was received for this study.
The following work was presented to the American Thoracic Society 2017 congress: Stress Evaluation During Endotracheal Intubation on a Simulation Model, May 22, 2017, Washington, DC, USA.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Marjanovic, N.S., Teiten, C., Pallamin, N. et al. Evaluation of emotional excitation during standardized endotracheal intubation in simulated conditions. Ann. Intensive Care 8, 117 (2018). https://doi.org/10.1186/s13613-018-0460-0