Display options
Share it on

Open Forum Infect Dis. 2020 Jun 25;7(6):ofaa213. doi: 10.1093/ofid/ofaa213. eCollection 2020 Jun.

Impact of Risk Adjustment Using Clinical vs Administrative Data on Hospital Sepsis Mortality Comparisons.

Open forum infectious diseases

Chanu Rhee, Zhonghe Li, Rui Wang, Yue Song, Sameer S Kadri, Edward J Septimus, Huai-Chun Chen, David Fram, Robert Jin, Russell Poland, Kenneth Sands, Michael Klompas

Affiliations

  1. Department of Population Medicine, Harvard Medical School/Harvard Pilgrim Health Care Institute, Boston, Massachusetts, USA.
  2. Division of Infectious Diseases, Brigham and Women's Hospital, Boston, Massachusetts, USA.
  3. Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, USA.
  4. Critical Care Medicine Department, Clinical Center, National Institutes of Health, Bethesda, Massachusetts, USA.
  5. Texas A&M Health Science Center College of Medicine, Houston, Texas, USA.
  6. Commonwealth Informatics, Waltham, Massachusetts, USA.
  7. Clinical Services Group, HCA Healthcare, Nashville, Tennessee, USA.

PMID: 32617377 PMCID: PMC7320830 DOI: 10.1093/ofid/ofaa213

Abstract

BACKGROUND: A reliable risk-adjusted sepsis outcome measure could complement current national process metrics by identifying outlier hospitals and catalyzing additional improvements in care. However, it is unclear whether integrating clinical data into risk adjustment models identifies similar high- and low-performing hospitals compared with administrative data alone, which are simpler to acquire and analyze.

METHODS: We ranked 200 US hospitals by their Centers for Disease Control and Prevention Adult Sepsis Event (ASE) mortality rates and assessed how rankings changed after applying (1) an administrative risk adjustment model incorporating demographics, comorbidities, and codes for severe illness and (2) an integrated clinical and administrative model replacing severity-of-illness codes with laboratory results, vasopressors, and mechanical ventilation. We assessed agreement between hospitals' risk-adjusted ASE mortality rates when ranked into quartiles using weighted kappa statistics (к).

RESULTS: The cohort included 4 009 631 hospitalizations, of which 245 808 met ASE criteria. Risk-adjustment had a large effect on rankings: 22/50 hospitals (44%) in the worst quartile using crude mortality rates shifted into better quartiles after administrative risk adjustment, and a further 21/50 (42%) of hospitals in the worst quartile using administrative risk adjustment shifted to better quartiles after incorporating clinical data. Conversely, 14/50 (28%) hospitals in the best quartile using administrative risk adjustment shifted to worse quartiles with clinical data. Overall agreement between hospital quartile rankings when risk-adjusted using administrative vs clinical data was moderate (к = 0.55).

CONCLUSIONS: Incorporating clinical data into risk adjustment substantially changes rankings of hospitals' sepsis mortality rates compared with using administrative data alone. Comprehensive risk adjustment using both administrative and clinical data is necessary before comparing hospitals by sepsis mortality rates.

© The Author(s) 2020. Published by Oxford University Press on behalf of Infectious Diseases Society of America.

Keywords: Adult Sepsis Event; hospital comparisons; outcome measure; risk adjustment; sepsis

References

  1. Infect Control Hosp Epidemiol. 2019 Feb;40(2):208-210 - PubMed
  2. Crit Care Med. 2016 Feb;44(2):319-27 - PubMed
  3. JAMA Netw Open. 2019 Feb 1;2(2):e187571 - PubMed
  4. Crit Care Explor. 2019 Oct 14;1(10):e0049 - PubMed
  5. Ann Intern Med. 2016 Oct 4;165(7):517-518 - PubMed
  6. Med Care. 2014 Jun;52(6):e39-43 - PubMed
  7. N Engl J Med. 2017 Jun 8;376(23):2235-2244 - PubMed
  8. Am J Emerg Med. 2015 May;33(5):713-8 - PubMed
  9. Crit Care Med. 2018 Aug;46(8):1247-1254 - PubMed
  10. JAMA. 2017 Oct 3;318(13):1241-1249 - PubMed
  11. Clin Infect Dis. 2020 Jan 09;: - PubMed
  12. Clin Infect Dis. 2020 May 06;: - PubMed
  13. Anesth Analg. 2018 May;126(5):1763-1768 - PubMed
  14. JAMA. 2014 Jul 2;312(1):90-2 - PubMed
  15. J Hosp Med. 2013 May;8(5):243-7 - PubMed
  16. Crit Care Med. 2019 Mar;47(3):307-314 - PubMed
  17. Crit Care Med. 2019 Apr;47(4):493-500 - PubMed
  18. Crit Care Med. 2001 Jul;29(7):1303-10 - PubMed
  19. JAMA. 2016 Feb 23;315(8):801-10 - PubMed
  20. JAMA Intern Med. 2019 Dec 20;: - PubMed
  21. Crit Care. 2016 Apr 06;20:89 - PubMed
  22. BMC Health Serv Res. 2018 May 4;18(1):328 - PubMed
  23. BMC Health Serv Res. 2019 Apr 11;19(1):221 - PubMed
  24. Crit Care Med. 2019 Aug;47(8):1026-1032 - PubMed
  25. Stat Methods Med Res. 2000 Oct;9(5):475-96 - PubMed
  26. Crit Care Med. 2013 Apr;41(4):945-53 - PubMed
  27. Am J Med Qual. 2015 Jul-Aug;30(4):328-36 - PubMed
  28. Curr Opin Crit Care. 2007 Dec;13(6):725-31 - PubMed

Publication Types