Display options
Share it on

Can Med Educ J. 2015 Dec 11;6(2):e71-7. eCollection 2015.

Internal Medicine residents use heuristics to estimate disease probability.

Canadian medical education journal

Sen Han Phang, Pietro Ravani, Jeffrey Schaefer, Bruce Wright, Kevin McLaughlin

Affiliations

  1. Department of Medicine, University of Calgary, Calgary, Alberta.
  2. Office of Undergraduate Medical Education, University of Calgary, Calgary, Alberta.
  3. Department of Medicine, University of Calgary, Calgary, Alberta; Office of Undergraduate Medical Education, University of Calgary, Calgary, Alberta.

PMID: 27004080 PMCID: PMC4795085

Abstract

BACKGROUND: Training in Bayesian reasoning may have limited impact on accuracy of probability estimates. In this study, our goal was to explore whether residents previously exposed to Bayesian reasoning use heuristics rather than Bayesian reasoning to estimate disease probabilities. We predicted that if residents use heuristics then post-test probability estimates would be increased by non-discriminating clinical features or a high anchor for a target condition.

METHOD: We randomized 55 Internal Medicine residents to different versions of four clinical vignettes and asked them to estimate probabilities of target conditions. We manipulated the clinical data for each vignette to be consistent with either 1) using a representative heuristic, by adding non-discriminating prototypical clinical features of the target condition, or 2) using anchoring with adjustment heuristic, by providing a high or low anchor for the target condition.

RESULTS: When presented with additional non-discriminating data the odds of diagnosing the target condition were increased (odds ratio (OR) 2.83, 95% confidence interval [1.30, 6.15], p = 0.009). Similarly, the odds of diagnosing the target condition were increased when a high anchor preceded the vignette (OR 2.04, [1.09, 3.81], p = 0.025).

CONCLUSIONS: Our findings suggest that despite previous exposure to the use of Bayesian reasoning, residents use heuristics, such as the representative heuristic and anchoring with adjustment, to estimate probabilities. Potential reasons for attribute substitution include the relative cognitive ease of heuristics vs. Bayesian reasoning or perhaps residents in their clinical practice use gist traces rather than precise probability estimates when diagnosing.

References

  1. J Gen Intern Med. 2004 May;19(5 Pt 1):427-32 - PubMed
  2. Annu Rev Psychol. 2011;62:451-82 - PubMed
  3. JAMA. 2001 Sep 19;286(11):1317-24 - PubMed
  4. Med Educ. 2003 Aug;37(8):695-703 - PubMed
  5. N Engl J Med. 2013 Jun 27;368(26):2445-8 - PubMed
  6. Med Educ. 2008 May;42(5):468-75 - PubMed
  7. BMJ. 2009 Sep 22;339:b3490 - PubMed
  8. J Hosp Med. 2006 Mar;1(2):81-7 - PubMed
  9. Clin Endocrinol (Oxf). 1994 Apr;40(4):479-84 - PubMed
  10. Psychol Bull. 2008 Mar;134(2):207-22 - PubMed
  11. J Clin Endocrinol Metab. 2002 Feb;87(2):489-99 - PubMed
  12. BMJ. 2002 Mar 23;324(7339):729-32 - PubMed
  13. Med Educ. 2008 May;42(5):496-502 - PubMed
  14. Psychol Rev. 1956 Mar;63(2):81-97 - PubMed
  15. Acad Med. 2011 May;86(5):618-27 - PubMed
  16. Acad Med. 2010 Jul;85(7):1125-9 - PubMed
  17. Science. 1974 Sep 27;185(4157):1124-31 - PubMed
  18. Med Educ. 2007 Dec;41(12):1152-8 - PubMed
  19. J Exp Psychol Learn Mem Cogn. 1985 Jul;11(3):501-18 - PubMed
  20. Adv Health Sci Educ Theory Pract. 2014 Aug;19(3):457-64 - PubMed
  21. Arch Intern Med. 2000 Jun 12;160(11):1683-9 - PubMed
  22. Adv Health Sci Educ Theory Pract. 2014 Aug;19(3):393-402 - PubMed
  23. Annu Rev Psychol. 2002;53:1-25 - PubMed
  24. Acad Med. 2009 Aug;84(8):1022-8 - PubMed
  25. Acad Med. 2003 Aug;78(8):775-80 - PubMed
  26. Ann Intern Med. 1999 Jun 15;130(12):1005-13 - PubMed
  27. Science. 1990 Jan 19;247(4940):301-6 - PubMed
  28. Jt Comm J Qual Patient Saf. 2005 Feb;31(2):106-13 - PubMed
  29. BMJ. 2005 May 7;330(7499):1080-3 - PubMed
  30. Ann Intern Med. 2001 Jul 17;135(2):98-107 - PubMed
  31. J Exp Psychol Appl. 2006 Sep;12(3):179-95 - PubMed
  32. Med Educ. 1987 Nov;21(6):471-6 - PubMed

Publication Types