Can Med Educ J. 2015 Dec 11;6(2):e71-7. eCollection 2015.
Internal Medicine residents use heuristics to estimate disease probability.
Canadian medical education journal
Sen Han Phang, Pietro Ravani, Jeffrey Schaefer, Bruce Wright, Kevin McLaughlin
Affiliations
Affiliations
- Department of Medicine, University of Calgary, Calgary, Alberta.
- Office of Undergraduate Medical Education, University of Calgary, Calgary, Alberta.
- Department of Medicine, University of Calgary, Calgary, Alberta; Office of Undergraduate Medical Education, University of Calgary, Calgary, Alberta.
PMID: 27004080
PMCID: PMC4795085
Abstract
BACKGROUND: Training in Bayesian reasoning may have limited impact on accuracy of probability estimates. In this study, our goal was to explore whether residents previously exposed to Bayesian reasoning use heuristics rather than Bayesian reasoning to estimate disease probabilities. We predicted that if residents use heuristics then post-test probability estimates would be increased by non-discriminating clinical features or a high anchor for a target condition.
METHOD: We randomized 55 Internal Medicine residents to different versions of four clinical vignettes and asked them to estimate probabilities of target conditions. We manipulated the clinical data for each vignette to be consistent with either 1) using a representative heuristic, by adding non-discriminating prototypical clinical features of the target condition, or 2) using anchoring with adjustment heuristic, by providing a high or low anchor for the target condition.
RESULTS: When presented with additional non-discriminating data the odds of diagnosing the target condition were increased (odds ratio (OR) 2.83, 95% confidence interval [1.30, 6.15], p = 0.009). Similarly, the odds of diagnosing the target condition were increased when a high anchor preceded the vignette (OR 2.04, [1.09, 3.81], p = 0.025).
CONCLUSIONS: Our findings suggest that despite previous exposure to the use of Bayesian reasoning, residents use heuristics, such as the representative heuristic and anchoring with adjustment, to estimate probabilities. Potential reasons for attribute substitution include the relative cognitive ease of heuristics vs. Bayesian reasoning or perhaps residents in their clinical practice use gist traces rather than precise probability estimates when diagnosing.
References
- J Gen Intern Med. 2004 May;19(5 Pt 1):427-32 - PubMed
- Annu Rev Psychol. 2011;62:451-82 - PubMed
- JAMA. 2001 Sep 19;286(11):1317-24 - PubMed
- Med Educ. 2003 Aug;37(8):695-703 - PubMed
- N Engl J Med. 2013 Jun 27;368(26):2445-8 - PubMed
- Med Educ. 2008 May;42(5):468-75 - PubMed
- BMJ. 2009 Sep 22;339:b3490 - PubMed
- J Hosp Med. 2006 Mar;1(2):81-7 - PubMed
- Clin Endocrinol (Oxf). 1994 Apr;40(4):479-84 - PubMed
- Psychol Bull. 2008 Mar;134(2):207-22 - PubMed
- J Clin Endocrinol Metab. 2002 Feb;87(2):489-99 - PubMed
- BMJ. 2002 Mar 23;324(7339):729-32 - PubMed
- Med Educ. 2008 May;42(5):496-502 - PubMed
- Psychol Rev. 1956 Mar;63(2):81-97 - PubMed
- Acad Med. 2011 May;86(5):618-27 - PubMed
- Acad Med. 2010 Jul;85(7):1125-9 - PubMed
- Science. 1974 Sep 27;185(4157):1124-31 - PubMed
- Med Educ. 2007 Dec;41(12):1152-8 - PubMed
- J Exp Psychol Learn Mem Cogn. 1985 Jul;11(3):501-18 - PubMed
- Adv Health Sci Educ Theory Pract. 2014 Aug;19(3):457-64 - PubMed
- Arch Intern Med. 2000 Jun 12;160(11):1683-9 - PubMed
- Adv Health Sci Educ Theory Pract. 2014 Aug;19(3):393-402 - PubMed
- Annu Rev Psychol. 2002;53:1-25 - PubMed
- Acad Med. 2009 Aug;84(8):1022-8 - PubMed
- Acad Med. 2003 Aug;78(8):775-80 - PubMed
- Ann Intern Med. 1999 Jun 15;130(12):1005-13 - PubMed
- Science. 1990 Jan 19;247(4940):301-6 - PubMed
- Jt Comm J Qual Patient Saf. 2005 Feb;31(2):106-13 - PubMed
- BMJ. 2005 May 7;330(7499):1080-3 - PubMed
- Ann Intern Med. 2001 Jul 17;135(2):98-107 - PubMed
- J Exp Psychol Appl. 2006 Sep;12(3):179-95 - PubMed
- Med Educ. 1987 Nov;21(6):471-6 - PubMed
Publication Types