Accuracy and limitations of continuous glucose monitoring using spectroscopy in critically ill patients
© van Hooijdonk et al.; licensee Springer. 2014
Received: 7 November 2013
Accepted: 25 February 2014
Published: 6 March 2014
OptiScanner devices, continuous glucose monitoring devices that perform automated blood draws via a central venous catheter and create plasma through centrifugation, measure plasma glucose levels through mid-infrared spectroscopy at the bedside. The objective of this study was to determine accuracy and practicality of the devices in critically ill patients attempting glycemic control.
The plasma glucose level was measured by the devices and in comparative plasma samples using Yellow Springs Instrument (YSI) plasma analyzers. After adding several previously unrecognized interferences in the interference library, we reanalyzed the mid-infrared signals and compared the resulting plasma glucose level with the reference value. Results are presented in Clarke error grids, glucose prediction errors and Bland-Altman plots and expressed as correlation coefficients.
We analyzed 463 comparative samples from 71 patients (median 6 (4 to 9) samples per patient). After calibrating the system, a Clarke error grid showed 100% of the values in zones A or B. The glucose predictor error demonstrated that 86% of the glucose values < 75 mg/dL were within ± 15 mg/dL of the YSI results and 95% ≥ 75 mg/dL were within 20% of the comparative YSI results. Bland-Altman plot showed a bias of −0.6 with limit of agreement of −24.6 to 23.3. The Pearson correlation coefficient was 0.93 and R2 was 0.87. In one third of the patients the devices had to be disconnected prematurely (that is before planned disconnection) because of repeated occlusion alarms suggesting blood draw errors.
The devices needed calibration for several previously unrecognized interferences. Thereafter, accuracy of the device to measure plasma glucose levels in ‘our cohort’ of critically ill patients improved, but external validation is highly recommended. The automated blood draw system of the devices needs further improvement to make this device of value for clinical use (trial registration (Netherlands Trial Register): NTR2864).
KeywordsGlucose Spectroscopy Point-of-care Monitoring ICU
Critically ill patients often receive insulin infusion [1, 2], although concerns with the risk of hypoglycemia and failure to show a positive impact on patient outcome has altered the frequency of use. Intense monitoring of the blood glucose level is a prerequisite for efficient and safe insulin infusion [1, 2]. At present, ICU nurses monitor the blood glucose level through intermittent manually obtained blood samples for glucose measurements in central laboratories or at the bedside using different types of point-of-care analyzers .
Today’s blood glucose monitoring suffers from a variety of error sources that can put ICU patients at risk for insulin titration inaccuracies . Moreover, intermittent glucose monitoring lacks sufficient trending, while immediate feedback and predictability of the effects of insulin could have the potential to improve titration of insulin in ICU patients . Also, ICU nurses usually take > 2 mL of blood with every blood draw and the time consumed is estimated to be as high as five minutes with each draw and subsequent measurement , which makes intense monitoring impractical if not impossible. Automated continuous glucose monitoring (CGM) could overcome several of these problems.
OptiScanner devices (OptiScan Biomedical Corporation, Hayward, CA, USA), devices that perform automated blood draws via central venous catheters and create plasma through automatic centrifugation, measure the plasma glucose level every 15 minutes through mid-infrared spectroscopy at the bedside . In a pre-clinical animal study, this device accurately measured the glucose level along hypoglycemic, euglycemic and hyperglycemic ranges . Similar results came from a study with diabetic volunteers , and a study of frozen and stored plasma samples from critically ill patients . We hypothesized that the devices provide accurate glucose level measurements in ICU patients. In this study we tested the accuracy of the devices in a cohort of critically ill patients treated according to a glucose control guideline targeting blood glucose levels between 90 and 144 mg/dL (ICU-A in ).
Study design and informed consent
This was an investigator-initiated observational study testing the accuracy of the devices in critically ill patients. OptiScan Biomedical Corporation sponsored part of the study, identified interferences and updated the interference library. The company had no influence on study design, the final analysis and the writing of this manuscript. The Institutional Review Board of the Academic Medical Center (AMC), Amsterdam, the Netherlands, approved the study protocol. Patients or next of kin had to provide written informed consent before the start of any procedure of the study. Analysis of paired data followed the analysis plan as published at [http://www.trialregister.nl/] (NTR2864).
The study was performed in a 32-bed mixed medical-surgical ICU in a university hospital (AMC), a closed format department with patients under the direct care of an ICU team. The nurse to patient ratio is 1:2. All beds are equipped with a patient data management system (MetaVision®, iMDsoft, Tel Aviv, Israel) in which all clinical and laboratory data are stored.
Patients were eligible for inclusion if they were aged ≥ 18 years, had an expected ICU length of stay of > three days at time of enrollment and an Acute Physiology and Chronic Health Evaluation (APACHE) II  score ≥ 10, had an existing arterial line, and had an existing central venous catheter (CVC) with a free lumen available. Both patients who received insulin infusion and patients who did not receive insulin infusion could be included in the study. Patients were excluded if they had received any investigational product or if they had received treatment with an investigational device within the previous 30 days or were pregnant. For practical reasons, patients in isolation for colonization with multi-resistant bacteria were excluded from participation.
ICU nurses performed glucose control with insulin, following a local guideline targeting at blood glucose levels between 90 and 144 mg/dL (ICU-A in ). The local guideline for glucose control advised starting continuous infusion of insulin when the blood glucose level > 144 mg/dL. Insulin was exclusively given by continuous intravenous infusion with only a bolus of insulin given when the blood glucose level exceeded > 360 mg/dL. Subcutaneous insulin is never used. Insulin infusion adjustments were made using sliding scales . Insulin infusion was stopped and boluses of dextrose were given when the blood glucose level declined < 61 mg/dL. According to the local guideline for glucose control, glucose levels were to be measured at least every four hours, but for the study the study protocol dictated that comparative glucose levels were to be measured every two hours. Glucose levels used for insulin adjustment were measured in arterial blood samples using RapidLab 1265 blood gas analyzers (Siemens Healthcare Diagnostics, The Hague, the Netherlands), located in the ICU.
The device withdraws approximately 2.6 mL of blood every 15 minutes. From this, a sample of approximately 0.1 mL is extracted, heparinized, converted to plasma and analyzed by a mid-infrared spectrometer. For this, after each draw, the device centrifuges the sample, and a measurement is conducted on the plasma component using spectral analysis. This spectroscopy technique is based on the characteristic absorption of vibrational nodes of different molecules, including glucose. Mid-infrared spectroscopy can be used because the glucose spectral peaks are in the mid-infrared region . After measurement, the device automatically flushes the sample to sealed waste containers, cleaning the micro-cuvette in the process. The remaining approximate 2.5 mL of blood is returned back to the patient with a small amount of saline (less than 2.0 mL). There is no heparin in the blood that is returned to the patient. The devices have an onboard interference library which includes drugs and endogenous substances that is used to subtract out interferences.
One device was connected to the proximal port of an existing CVC for up to 24 hours in the first 65 patients, and for up to 72 hours in the last 10 patients. Every 15 minutes, the device withdrew blood and measured the plasma glucose level. These results were not visible for ICU nurses and staff, but were downloaded to a computer after disconnection of the device. Comparative arterial blood draws were taken every two hours, at the same time as the device was drawing venous blood, starting from approximately 8 am until 10 pm. Comparative glucose levels in plasma were measured immediately with the YSI 2300 STAT Plus (Yellow Springs Instrument, Yellow Springs, OH, USA) and with the RapidLab 1265 blood gas analyzers (Siemens Healthcare Diagnostics, The Hague, the Netherlands). The results of the blood gas analyzers were available for the nurses for insulin titration.
Dealing with new interfering substances
An interfering substance was suspected if we found significant discrepancies between paired fixed-wavelength mid-infrared glucose measurements and YSI readings. OptiScan Biomedical Corporation then analyzed the source documentation to identify what substances could have affected the spectra. Pure spectra of the identified interferences were then isolated and subsequently proven to interfere in separate laboratory experimentation by OptiScan Biomedical Corporation. If subsequently verified, the interference was added to the interference library. First, the updated interference library was tested in the already collected spectroscopies. Thereafter, the interference library was updated to the onboard database and used in subsequent patients.
The onboard interference library was updated twice during the study, that is after inclusion and analysis of patient 28 and patient 63, and once after inclusion of the last patient. We thus had accrued three different interference libraries during the study, and one new interference library at the end of the study. After adding all validated interferences in the interference library, the mid-infrared spectroscopies were reanalyzed by OptiScan Biomedical Corporation, calculating a new glucose value for every collected spectroscopy.
We report data as means (± SD) or medians (IQR) where appropriate. In order to be considered for the statistical analysis, each patient needed to have at least two consecutive and successfully analyzed blood draws.
Clarke error grid (CEG) analyses were used to show the percentage of paired values falling within predefined zones. The CEG is divided in ten zones: in the two zones A the device results are < 20% of the YSI results, which is seen as clinical acceptable, or the results are < 70 mg/dL; in the two zones B the device results deviate > 20% from the YSI result, but deviations are seen as clinically acceptable because they are considered only to cause benign insulin titration errors; in the zones C to E the deviations become increasingly unacceptable; in zones D potentially dangerous hypoglycemia or hyperglycemia are left undetected, and in zones E device results lead to opposite treatment decisions, that is the device suggests hypoglycemia while the YSI shows hyperglycemia, or vice versa.
For each pair of device and YSI results, the glucose prediction error was defined as (device result – YSI result). The percentage of paired data points with glucose prediction errors are presented according to the current International Standards Organization standard (ISO15197), with the percentage of data points specified that fall within ± 15 mg/dL of the YSI results for YSI glucose level of < 75 mg/dL, and within ± 20% of the YSI results for YSI glucose level ≥ 75 mg/dL. The higher the percentages, the better accuracy for YSI results < 75 mg/dL, or ≥ 75 mg/dL.
Bland-Altman plot with bias (mean difference between the device and YSI measurements) and limits of agreement (bias ± 1.96 x standard deviation of the bias) were used to show agreement between the device and YSI measurements . The limit of agreement shows the band in which 95% of the device results deviate from the mean difference between the YSI and device results. The smaller the bias and limit of agreement, the better agreement between the YSI and device results .
The results of the device were regressed on the results of the YSI using unweighted least squares. The linearity between the device and the YSI over the study measurement range were assessed by the Pearson correlation coefficient and coefficient of determination, R2.
To assess if the occurrence of occlusion alarms was related to the insertion site of the CVC, patients were divided into groups based on the location of their CVC (jugular, femoral or subclavian). The Chi-square test was used to compare the different locations with and without alarms. A P- value < 0.05 was considered statistically significant.
Analyses were performed using IBM SPSS Statistics 20 (IBM, Armonk, New York, United States). R (version: 2.15.1; R Foundation for Statistical Computing, Vienna, Austria) was used for CEG, glucose prediction error, Bland-Altman plot and linearity tests.
Age (years), median (IQR)
65 (55 to 73)
Male gender, number (%)
Admission diagnosis, number (%)
APACHE II scores, median (IQR)_
21 (16 to 26)
SAPS II, median (IQR)
43 (36 to 54)
ICU LOS (days), median (IQR)
10 (5 to 20)
Hospital LOS (days), median (IQR)
20 (12 to 34)
ICU mortality, number (%)
Hospital mortality, number (%)
Central venous catheter insertion site, number (%)
Type of central venous catheter, number (%)
Measures of blood glucose control
Number of measurements
Blood glucose level - mg/dL (median (IQR))
130.3 (113.0 to 147.3)
Blood glucose level - mg/dL (mean ± SD)
134.3 ± 35.0
Number of measurements per patient (median, IQR)
6 (4 to 9)
Severe hypoglycemia < 40 mg/dL - measurements, number (%)
Severe hypoglycemia < 40 mg/dL - patients, number (%)
Mild hypoglycemia < 75 mg/dL - measurements, number (%)
Mild hypoglycemia < 75 mg/dL - patients, number (%)
Mild hyperglycemia > 150 mg/dL - measurements, number (%)
Mild hyperglycemia > 150 mg/dL - patients, number (%)
Severe hyperglycemia > 180 mg/dL - measurements, number (%)
Severe hyperglycemia > 180 mg/dL - patients, number (%)
Accuracy of devices in critically ill patients
With the recalculated values we analyzed all paired samples (Figure 3). The correlation coefficient was 0.93 and R2 was 0.87. The accuracy of the results of the final 12 patients was consistent with the reanalysis by OptiScan Biomedical Corporation of the overall study population.
We found the following interferences; 6% hydroxyethyl starch (Venofundin®, B Braun, Melsungen, Germany); 20% human albumin (Albuman®, Sanquin, Amsterdam, the Netherlands, immunoglobulin G (Nanogam®, Sanquin, Amsterdam, the Netherlands), propofol (Propofol-®Lipuro, B Braun, Melsungen, Germany), cephalosporin (including cefotaxim and ceftazidim), lactate (infusion fluid containing lactate used for continuous veno-venous hemofiltration), mannitol and infusion of phosphate (Figure 1).
Practicality of the devices in critically ill patients
Number (%) of
Number (%) of
Per insertion site
Per type of central venous catheter
Alarms leading to disconnection
Per insertion site
Per type of central venous catheter
In 18 out of 101 (18%) cartridges an error occurred, mandating replacement of the cartridge. Twelve cartridge failures occurred prior to connecting the device to the patient, that is during the systems initial self-diagnostic check of the system. After connection, in four cases there was a problem with the fluidics system within the cartridge; in one case blood could not be drawn and in one case there was a problem with loading heparin into the cartridge. A system error, mandating a reset of the system, occurred three times. In all cases this happened before connection of the device to the patient. We could not further determine what actually happened, because the logging capabilities failed to analyze this error.
The present study shows that the device, after calibration for previously unrecognized interferences, had a better accuracy for measuring plasma glucose levels in critically ill patients. However, in a significant number of patients the devices had to be disconnected prematurely because of occlusion alarms, which could not easily be overcome by flushing the system.
The results of the present investigation confirm findings from previous studies with the same devices. One study of otherwise healthy diabetic patients showed 99% of data in zones A or B of the CEG analysis . Another study testing ex vivo point accuracy of the same devices using frozen plasma samples from a series of ICU patients found a correlation coefficient of 0.94 . While the device was designed for critically ill patients it had not yet been tested in vivo, and specifically, in critically ill patients at the ICU bedside. The present study expands the experience with the devices and shows that the devices could perform accurate glucose level measurements.
The accuracy of the device improved after adding interferences to the interference library. Indeed, after adding the interferences as identified in this study cohort, all paired samples were in zones A and B.
The total percentage of paired data values outside the glucose prediction error of the device is around 6%, less accurate than most of the blood gas analyzers . Several different continuous glucose monitoring devices are being developed, using dissimilar sampling techniques and sensors . The reports on accuracy of other continuous glucose monitoring devices show comparable accuracies, with 95 to 100% of the paired measurements in zone A and B of the CEG [12, 13, 15–18].
Even though numerous interferences were already identified in previous studies [7–9], several new ones were identified. We were not surprised to find interferences, although we did not expect to find such commonly used substances as interferences. This is probably explained by the fact that the devices were previously only ex vivo tested in an ICU patient cohort. Furthermore, this cohort was in another continent, where other medications and infusion fluids are used . The finding of commonly used medications as interferences shows the importance of external validation in different continents and countries, and maybe even hospitals. Therefore, caution is needed with the implementation of devices.
Additionally, we encountered cartridge errors, and system errors which occurred before connection of the device to the patient. We had to disconnect the device frequently because of occlusion alarms, suggesting that the device could not draw a blood sample. Sometimes occlusion alarms could be easily overcome by flushing the connection system. If not, manipulation of the CVC was needed to facilitate blood draws. We are uncertain whether these problems may persist in daily clinical practice.
Notably, results from two patients with simultaneous glucose infusion via another port of the CVC were excluded in the analysis. While simultaneous glucose infusion via the same infusion system that is used for measuring glucose levels should be avoided, the finding clearly shows the risk of erroneous readings.
Any device that uses a CVC has the potential to increase the risk of catheter-associated blood stream infections, especially when blood is retracted repeatedly through the CVC. In addition, the latter could also cause clotting in the lumen. We explicitly looked for these clinically important complications but did not find them in this cohort of patients. It should be noted, though, that this study is too small to draw firm conclusions regarding the risk of blood stream infections or clotting. Also, we did not find a difference in occurrence of occlusion alarms between insertion site or type of catheters. In some cases of occlusion, alarms were solved by manipulation of the CVC. It should be noted, though, that the need for manipulation of the CVC could be a shortcoming of the device. Second, it should be noted that nurses were allowed to disconnect the device at any moment an occlusion alarm occurred in the absence of the investigators. However, it is unknown what happens if repeated occlusion alarms occur and are resolved, that is whether this promotes clotting of the lumen. This needs to be investigated in future studies.
One limitation of the study is that we only collected paired glucose measurements during working hours, which could have prevented us from finding additional interferences (for example, medications that are only infused during the night). Furthermore, this was a single-center study. Also, it is possible that additional interferences could be found when the devices are used in other patient populations.
In addition, the number of paired glucose measurements per patient was small. An additional limitation of the study is that most data points were in a narrow glucose range - we only had 8 of the 484 paired measurements < 75 mg/dL and 42 of the 484 paired measurements > 180 mg/dL. We did not have the opportunity to assess the ability of the device to detect severe hypoglycemia (that is, < 40 mg/dL) as it did not occur during conduct of the study. Here, the low incidence of hypoglycemia suggests that the nurses were experts in insulin titration. Indeed, the nurses had experience with the insulin infusion guideline for many years. In addition, the blood glucose target in the local guideline is higher compared to that in the original Leuven studies, which could also have affected the incidence of severe hypoglycemia. Furthermore, because nurses were aware that the devices monitored the blood glucose level in their patients frequently, it could be that they titrated insulin more precisely. Finally, the nurses had access to all blood glucose levels, thus also the extra ones taken for the study. As such, nurses could also better prevent severe hypoglycemia.
The blood glucose measuring devices we used needed calibration for several previously unrecognized interferences. Thereafter, accuracy of the device for measuring plasma glucose levels in ‘our cohort’ of critically ill patients improved, but external validation is highly recommended. Also, the automated blood draw system of these devices needs further improvement to make them of value for clinical use.
Academic Medical Center
Acute Physiology and Chronic Health Evaluation
Clarke error grid
continuous glucose monitoring
central venous catheter
length of stay
Simplified Acute Physiology Score
Yellow Springs Instrument.
- Jacobi J, Bircher N, Krinsley J, Agus M, Braithwaite SS, Deutschman C, Freire AX, Geehan D, Kohl B, Nasraway SA, Rigby M, Sands K, Schallom L, Taylor B, Umpierrez G, Mazuski J, Schunemann H: Guidelines for the use of an insulin infusion for the management of hyperglycemia in critically ill patients. Crit Care Med 2012, 40: 3251–3276. 10.1097/CCM.0b013e3182653269View ArticlePubMedGoogle Scholar
- Schultz MJ, Harmsen RE, Spronk PE: Clinical review: strict or loose glycemic control in critically ill patients - implementing best available evidence from randomized controlled trials. Crit Care 2010, 14: 223. 10.1186/cc8966PubMed CentralView ArticlePubMedGoogle Scholar
- Finfer S, Wernerman J, Preiser JC, Cass T, Desaive T, Hovorka R, Joseph JI, Kosiborod M, Krinsley J, Mackenzie I, Mesotten D, Schultz MJ, Scott MG, Slingerland R, Van den Berghe G, Van Herpe T: Clinical review: consensus recommendations on measurement of blood glucose and reporting glycemic control in critically ill adults. Crit Care 2013, 17: 229. 10.1186/cc12537PubMed CentralView ArticlePubMedGoogle Scholar
- Dungan K, Chapman J, Braithwaite SS, Buse J: Glucose measurement: confounding issues in setting targets for inpatient management. Diabetes Care 2007, 30: 403–409. 10.2337/dc06-1679View ArticlePubMedGoogle Scholar
- Miller M, Skladany MJ, Ludwig CR, Guthermann JS: Convergence of continuous glucose monitoring and in-hospital tight glycemic control: closing the gap between caregivers and industry. J Diabetes Sci Technol 2007, 1: 903–906. 10.1177/193229680700100616PubMed CentralView ArticlePubMedGoogle Scholar
- Aragon D: Evaluation of nursing work effort and perceptions about blood glucose testing in tight glycemic control. Am J Crit Care 2006, 15: 370–377.PubMedGoogle Scholar
- Magarian P, Sterling B: Plasma-generating glucose monitor accuracy demonstrated in an animal model. J Diabetes Sci Technol 2009, 3: 1411–1418. 10.1177/193229680900300622PubMed CentralView ArticlePubMedGoogle Scholar
- Jax T, Heise T, Nosek L, Gable J, Lim G, Calentine C: Automated near-continuous glucose monitoring measured in plasma using mid-infrared spectroscopy. J Diabetes Sci Technol 2011, 5: 345–352. 10.1177/193229681100500222PubMed CentralView ArticlePubMedGoogle Scholar
- Krinsley J, Bochicchio K, Calentine C, Bochicchio G: Glucose measurement of intensive care unit patient plasma samples using a fixed-wavelength mid-infrared spectroscopy system. J Diabetes Sci Technol 2012, 6: 294–301. 10.1177/193229681200600212PubMed CentralView ArticlePubMedGoogle Scholar
- Eslami S, de Keizer NF, Dongelmans DA, de Jonge E, Schultz MJ, Abu-Hanna A: Effects of two different levels of computerized decision support on blood glucose regulation in critically ill patients. Int J Med Inform 2012, 81: 53–60. 10.1016/j.ijmedinf.2011.10.004View ArticlePubMedGoogle Scholar
- Knaus WA, Draper EA, Wagner DP, Zimmerman JE: APACHE II: a severity of disease classification system. Crit Care Med 1985, 13: 818–829. 10.1097/00003246-198510000-00009View ArticlePubMedGoogle Scholar
- Mulavisala K, Gopal P, Crane B, Mackenzie A: Preliminary ICU experience of a novel intravascular blood glucose sensor. Crit Care 2012, 16: P175. Abstract 10.1186/cc10782PubMed CentralView ArticleGoogle Scholar
- Schierenbeck F, Owall A, Franco-Cereceda A, Liska J: Evaluation of a continuous blood glucose monitoring system using a central venous catheter with an integrated microdialysis function. Diabetes Technol Ther 2013, 15: 26–31. 10.1089/dia.2012.0169View ArticlePubMedGoogle Scholar
- Inoue S, Egi M, Kotani J, Morita K: Accuracy of blood-glucose measurements using glucose meters and arterial blood gas analyzers in critically ill adult patients: systematic review. Crit Care 2013, 17: R48. 10.1186/cc12567PubMed CentralView ArticlePubMedGoogle Scholar
- Bird S, Macken L, Flower O, Bass F, Hammond N, Webb S, Kennedy N, Baker A, Yarad E, Chau C, Librande M, Strasma P, Finfer S: Continuous arterial and venous glucose monitoring by quenched chemical fluorescence in ICU patients after cardiac surgery. Crit Care 2013, 17: P461. Abstrac 10.1186/cc12399PubMed CentralView ArticleGoogle Scholar
- Nasraway SA, Ehsan A, Melanson AM, Menzie W, Trieu MQ, Berlin J, Hurley J, Krystyniak K, Segal S: Accuracy of a novel non-invasive transdermal continuous glucose monitor in critically ill patients. Crit Care Med 2012, 40: S305. Abstract 10.1097/CCM.0b013e318232646bView ArticleGoogle Scholar
- De Block C, Manuel YKB, Van Gaal L, Rogiers P: Intensive insulin therapy in the intensive care unit: assessment by continuous glucose monitoring. Diab Care 2006, 29: 1750–1756. 10.2337/dc05-2353View ArticleGoogle Scholar
- Goldberg PA, Siegel MD, Russell RR, Sherwin RS, Halickman JI, Cooper DA, Dziura JD, Inzucchi SE: Experience with the continuous glucose monitoring system in a medical intensive care unit. Diab Technol Ther 2004, 6: 339–347. 10.1089/152091504774198034View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.