Pulse oximetry, racial bias and statistical bias
Annals of Intensive Care volume 12, Article number: 2 (2022)
On November 21, 2021, the British Health Minister, Sajid Javid, published an article in the Sunday Times pointing out that pulse oximeters tend to be inaccurate in patients with dark skin pigmentation . The Minister remarked that “technologies are created and developed by people, and so bias, however inadvertent, can be an issue here too.” The article attracted immediate and widespread attention, being covered by newspapers and television channels around the world. Mr. Javid expanded on his concerns during interviews with Andrew Maar on the BBC and Trevor Phillips on Sky News.
A few years after the introduction of pulse oximetry in the 1980s, we noticed that oximeters were less reliable in Black patients. In a 1990 article focusing on oxygenation in mechanically ventilated patients, we reported that pulse oximetry was almost 2½ times less accurate in Black patients .
Given that pulse oximetry operates by shining a light through the skin at two wavelengths—660 nm (red) and 940 nm (infrared)—and measuring the difference in light absorbance at the two wavelengths to estimate arterial oxygen saturation , we surmised that inaccuracy in Black patients is related to skin pigmentation. Supporting evidence is the increase in the difference in light absorbance between red and infrared wavelengths with use of black nail varnish, causing pulse oximeters to register falsely low saturations .
Estimates of oxygen saturation by pulse oximetry differ from true oxygen saturation in an arterial blood sample (the reference standard). The magnitude of the difference between non-invasive estimates and reference-standard measurements (in a group of patients) is quantified as mean and standard deviation, which statisticians dub “bias and precision.” In White patients, the mean and standard deviation of the difference between non-invasive estimates of oxygen saturation and the reference standard are each around 2%, whereas they both exceed 3% in Black patients . In our study, a pulse oximeter target of 92% ensured a safe arterial oxygen tension (PaO2) greater than 60 mmHg in 91.7% of White patients, but in only 50% of our Black patients .
In the first rigorous description of happy hypoxia in COVID-19, a situation where patients experience life-threateningly low oxygen saturations without provoking dyspnoea, we discussed several contributors to the phenomenon including the greater unreliability of pulse oximetry in Black patients . Managing patients with unreliable measurements of oxygenation is hazardous, partly because dangerously low saturations are missed, but also because low saturations are exaggerated and lead to unnecessary intubation . A major contributor to patient mortality in COVID-19 is inappropriate intubation , and it is possible that unreliable measurements of the oxygen saturations have contributed to increased mortality reported in Black patients .
In our 1990 article, we deduced that pulse oximetry was less reliable in Black patients because calibration data were drawn largely from White subjects . The algorithms employed within software of pulse oximeters are trade secrets and not open to scrutiny . We recommended that manufacturers collect data in Black patients to develop better calibration algorithms. In the 31 years since we made this recommendation, we are not aware of any manufacturer attempting to incorporate adjusted algorithms into pulse oximeters. The inaccuracy of pulse oximetry in Black patients is one further example of how medical information generated in (and for) White people contributes to inferior clinical outcome in patients of colour .
Hopefully, the attention generated by Mr. Javid’s highlighting of a significant problem with pulse oximetry will rouse manufacturers into action. Mr. Javid is working with his US counterpart, Xavier Becerra, to introduce new international medical standards. In the meantime, it would help if authors reverted to the more mundane (and precise) terminology of mean and standard deviation and refrained from use of the dodgy terms “bias and precision”, which gives rise to the notion that inanimate objects are capable of racial prejudice.
Availability of data and materials
Sajid Javid orders racial bias review after Covid deaths. The sunday times. November 21, 2021. https://www.thetimes.co.uk/article/sajid-javid-orders-racial-bias-review-after-covid-deaths-wxtsbsxdc. Accessed 22 Nov 2021.
Jubran A, Tobin MJ. Reliability of pulse oximetry in titrating supplemental oxygen therapy in ventilator-dependent patients. Chest. 1990;97(6):1420–5.
Jubran A. Pulse oximetry. In: Tobin MJ, editor. Principles and practice of intensive care monitoring. New York: McGraw-Hill, Inc; 1998. p. 261–87.
Coté CJ, Goldstein EA, Fuchsman WH, Hoaglin DC. The effect of nail polish on pulse oximetry. Anesth Analg. 1988;67(7):683–6.
Tobin MJ, Laghi F, Jubran A. Why COVID-19 silent hypoxemia is baffling to physicians. Am J Respir Crit Care Med. 2020;202(3):356–60.
Tobin MJ, Laghi F, Jubran A. Caution about early intubation and mechanical ventilation in COVID-19. Ann Intensive Care. 2020;10(1):78.
Doidge JC, Gould DW, Ferrando-Vivas P, Mouncey PR, Thomas K, Shankar-Hari M, Harrison DA, Rowan KM. Trends in intensive care for patients with COVID-19 in England, Wales, and Northern Ireland. Am J Respir Crit Care Med. 2021;203(5):565–74.
Price-Haywood EG, Burton J, Fort D, Seoane L. Hospitalization and mortality among black patients and white patients with Covid-19. N Engl J Med. 2020;382(26):2534–43.
Vyas DA, Eisenstein LG, Jones DS. Hidden in plain sight—reconsidering the use of race correction in clinical algorithms. N Engl J Med. 2020;383(9):874–82.
National Institute of Nursing Research (RO1- NR016055).
Ethics approval and consent to participate
Consent for publication
MJT receives royalties for two books on critical care published by McGraw-Hill, Inc., New York.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Tobin, M.J., Jubran, A. Pulse oximetry, racial bias and statistical bias. Ann. Intensive Care 12, 2 (2022). https://doi.org/10.1186/s13613-021-00974-7