Skip to main content

Pulse oximetry, racial bias and statistical bias

A Letter to the Editor to this article was published on 22 February 2022

A Letter to the Editor to this article was published on 22 February 2022

On November 21, 2021, the British Health Minister, Sajid Javid, published an article in the Sunday Times pointing out that pulse oximeters tend to be inaccurate in patients with dark skin pigmentation [1]. The Minister remarked that “technologies are created and developed by people, and so bias, however inadvertent, can be an issue here too.” The article attracted immediate and widespread attention, being covered by newspapers and television channels around the world. Mr. Javid expanded on his concerns during interviews with Andrew Maar on the BBC and Trevor Phillips on Sky News.

A few years after the introduction of pulse oximetry in the 1980s, we noticed that oximeters were less reliable in Black patients. In a 1990 article focusing on oxygenation in mechanically ventilated patients, we reported that pulse oximetry was almost 2½ times less accurate in Black patients [2].

Given that pulse oximetry operates by shining a light through the skin at two wavelengths—660 nm (red) and 940 nm (infrared)—and measuring the difference in light absorbance at the two wavelengths to estimate arterial oxygen saturation [3], we surmised that inaccuracy in Black patients is related to skin pigmentation. Supporting evidence is the increase in the difference in light absorbance between red and infrared wavelengths with use of black nail varnish, causing pulse oximeters to register falsely low saturations [4].

Estimates of oxygen saturation by pulse oximetry differ from true oxygen saturation in an arterial blood sample (the reference standard). The magnitude of the difference between non-invasive estimates and reference-standard measurements (in a group of patients) is quantified as mean and standard deviation, which statisticians dub “bias and precision.” In White patients, the mean and standard deviation of the difference between non-invasive estimates of oxygen saturation and the reference standard are each around 2%, whereas they both exceed 3% in Black patients [2]. In our study, a pulse oximeter target of 92% ensured a safe arterial oxygen tension (PaO2) greater than 60 mmHg in 91.7% of White patients, but in only 50% of our Black patients [2].

In the first rigorous description of happy hypoxia in COVID-19, a situation where patients experience life-threateningly low oxygen saturations without provoking dyspnoea, we discussed several contributors to the phenomenon including the greater unreliability of pulse oximetry in Black patients [5]. Managing patients with unreliable measurements of oxygenation is hazardous, partly because dangerously low saturations are missed, but also because low saturations are exaggerated and lead to unnecessary intubation [6]. A major contributor to patient mortality in COVID-19 is inappropriate intubation [7], and it is possible that unreliable measurements of the oxygen saturations have contributed to increased mortality reported in Black patients [8].

In our 1990 article, we deduced that pulse oximetry was less reliable in Black patients because calibration data were drawn largely from White subjects [2]. The algorithms employed within software of pulse oximeters are trade secrets and not open to scrutiny [3]. We recommended that manufacturers collect data in Black patients to develop better calibration algorithms. In the 31 years since we made this recommendation, we are not aware of any manufacturer attempting to incorporate adjusted algorithms into pulse oximeters. The inaccuracy of pulse oximetry in Black patients is one further example of how medical information generated in (and for) White people contributes to inferior clinical outcome in patients of colour [9].

Hopefully, the attention generated by Mr. Javid’s highlighting of a significant problem with pulse oximetry will rouse manufacturers into action. Mr. Javid is working with his US counterpart, Xavier Becerra, to introduce new international medical standards. In the meantime, it would help if authors reverted to the more mundane (and precise) terminology of mean and standard deviation and refrained from use of the dodgy terms “bias and precision”, which gives rise to the notion that inanimate objects are capable of racial prejudice.

Availability of data and materials

Not applicable.

References

  1. Sajid Javid orders racial bias review after Covid deaths. The sunday times. November 21, 2021. https://www.thetimes.co.uk/article/sajid-javid-orders-racial-bias-review-after-covid-deaths-wxtsbsxdc. Accessed 22 Nov 2021.

  2. Jubran A, Tobin MJ. Reliability of pulse oximetry in titrating supplemental oxygen therapy in ventilator-dependent patients. Chest. 1990;97(6):1420–5.

    Article  CAS  PubMed  Google Scholar 

  3. Jubran A. Pulse oximetry. In: Tobin MJ, editor. Principles and practice of intensive care monitoring. New York: McGraw-Hill, Inc; 1998. p. 261–87.

    Google Scholar 

  4. Coté CJ, Goldstein EA, Fuchsman WH, Hoaglin DC. The effect of nail polish on pulse oximetry. Anesth Analg. 1988;67(7):683–6.

    PubMed  Google Scholar 

  5. Tobin MJ, Laghi F, Jubran A. Why COVID-19 silent hypoxemia is baffling to physicians. Am J Respir Crit Care Med. 2020;202(3):356–60.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Tobin MJ, Laghi F, Jubran A. Caution about early intubation and mechanical ventilation in COVID-19. Ann Intensive Care. 2020;10(1):78.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Doidge JC, Gould DW, Ferrando-Vivas P, Mouncey PR, Thomas K, Shankar-Hari M, Harrison DA, Rowan KM. Trends in intensive care for patients with COVID-19 in England, Wales, and Northern Ireland. Am J Respir Crit Care Med. 2021;203(5):565–74.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  8. Price-Haywood EG, Burton J, Fort D, Seoane L. Hospitalization and mortality among black patients and white patients with Covid-19. N Engl J Med. 2020;382(26):2534–43.

    Article  CAS  PubMed  Google Scholar 

  9. Vyas DA, Eisenstein LG, Jones DS. Hidden in plain sight—reconsidering the use of race correction in clinical algorithms. N Engl J Med. 2020;383(9):874–82.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

National Institute of Nursing Research (RO1- NR016055).

Author information

Authors and Affiliations

Authors

Contributions

All authors contributed equally to the drafting of the manuscript and provided critical revision for important intellectual content. Both authors have read and approved the final manuscript.

Corresponding author

Correspondence to Martin J. Tobin.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

MJT receives royalties for two books on critical care published by McGraw-Hill, Inc., New York.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Tobin, M.J., Jubran, A. Pulse oximetry, racial bias and statistical bias. Ann. Intensive Care 12, 2 (2022). https://doi.org/10.1186/s13613-021-00974-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13613-021-00974-7