Display options
Share it on

BMJ Qual Saf. 2021 Oct 05; doi: 10.1136/bmjqs-2021-013493. Epub 2021 Oct 05.

Should electronic differential diagnosis support be used early or late in the diagnostic process? A multicentre experimental study of Isabel.

BMJ quality & safety

Matt Sibbald, Sandra Monteiro, Jonathan Sherbino, Andrew LoGiudice, Charles Friedman, Geoffrey Norman

Affiliations

  1. Department of Medicine, McMaster University, Hamilton, Ontario, Canada [email protected].
  2. Department of Health Evidence and Impact, McMaster University, Hamilton, Ontario, Canada.
  3. Department of Medicine, McMaster University, Hamilton, Ontario, Canada.
  4. McMaster University, Hamilton, Ontario, Canada.
  5. University of Michigan, Ann Arbor, Michigan, USA.

PMID: 34611040 DOI: 10.1136/bmjqs-2021-013493

Abstract

BACKGROUND: Diagnostic errors unfortunately remain common. Electronic differential diagnostic support (EDS) systems may help, but it is unclear when and how they ought to be integrated into the diagnostic process.

OBJECTIVE: To explore how much EDS improves diagnostic accuracy, and whether EDS should be used early or late in the diagnostic process.

SETTING: 6 Canadian medical schools. A volunteer sample of 67 medical students, 62 residents in internal medicine or emergency medicine, and 61 practising internists or emergency medicine physicians were recruited in May through June 2020.

INTERVENTION: Participants were randomised to make use of EDS either early (after the chief complaint) or late (after the complete history and physical is available) in the diagnostic process while solving each of 16 written cases. For each case, we measured the number of diagnoses proposed in the differential diagnosis and how often the correct diagnosis was present within the differential.

RESULTS: EDS increased the number of diagnostic hypotheses by 2.32 (95% CI 2.10 to 2.49) when used early in the process and 0.89 (95% CI 0.69 to 1.10) when used late in the process (both p<0.001). Both early and late use of EDS increased the likelihood of the correct diagnosis being present in the differential (7% and 8%, respectively, both p<0.001). Whereas early use increased the number of diagnostic hypotheses (most notably for students and residents), late use increased the likelihood of the correct diagnosis being present in the differential regardless of one's experience level.

CONCLUSIONS AND RELEVANCE: EDS increased the number of diagnostic hypotheses and the likelihood of the correct diagnosis appearing in the differential, and these effects persisted irrespective of whether EDS was used early or late in the diagnostic process.

© Author(s) (or their employer(s)) 2021. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

Keywords: clinical; computerised; decision making; decision support; diagnostic errors; medical education

Conflict of interest statement

Competing interests: None declared.

Publication Types