Display options
Cite
Rothberg B, Feinstein RE, Guiton G. Validation of the colorado psychiatry evidence-based medicine test. J Grad Med Educ. 2013;5(3):412-6doi: 10.4300/JGME-D-12-00193.1.
Rothberg, B., Feinstein, R. E., & Guiton, G. (2013). Validation of the colorado psychiatry evidence-based medicine test. Journal of graduate medical education, 5(3), 412-6. https://doi.org/10.4300/JGME-D-12-00193.1
Rothberg, Brian, et al. "Validation of the colorado psychiatry evidence-based medicine test." Journal of graduate medical education vol. 5,3 (2013): 412-6. doi: https://doi.org/10.4300/JGME-D-12-00193.1
Rothberg B, Feinstein RE, Guiton G. Validation of the colorado psychiatry evidence-based medicine test. J Grad Med Educ. 2013 Sep;5(3):412-6. doi: 10.4300/JGME-D-12-00193.1. PMID: 24404304; PMCID: PMC3771170.
Copy Download .nbib Format: NLM
Share it on

J Grad Med Educ. 2013 Sep;5(3):412-6. doi: 10.4300/JGME-D-12-00193.1.

Validation of the colorado psychiatry evidence-based medicine test.

Journal of graduate medical education

Brian Rothberg, Robert E Feinstein, Gretchen Guiton

PMID: 24404304 PMCID: PMC3771170 DOI: 10.4300/JGME-D-12-00193.1

Abstract

BACKGROUND: Evidence-based medicine (EBM) has become an important part of residency education, yet many EBM curricula lack a valid and standardized tool to identify learners' prior knowledge and assess progress.

OBJECTIVE: We developed an EBM examination in psychiatry to measure our effectiveness in teaching comprehensive EBM to residents.

METHODS: We developed a psychiatry EBM test using the validated EBM Fresno Test of Competence for family medicine. The test consists of case scenarios with open-ended questions. We also developed a scoring rubric and obtained reliability with multiple raters. Fifty-seven residents provided test data after completing 3, 6, 25, or 31 EBM sessions. The number of sessions for each resident was based on their length of training in our program.

RESULTS: The examination had strong interrater reliability, internal reliability, and item discrimination. Many residents showed significant improvement on their examination scores when data were compared from tests taken before and after a sequence of teaching sessions. Also, a threshold for the level of expert on the examination was established using test data from 5 EBM teacher-experts.

CONCLUSIONS: We successfully developed a valid and reliable EBM examination for use with psychiatry residents to measure essential EBM skills as part of a larger project to encourage EBM practice for residents in routine patient care. The test provides information on residents' knowledge in EBM from entry level concepts through expert performance. It can be used to place incoming residents in appropriate levels of an EBM curriculum and to monitor the effectiveness of EBM instruction.

References

  1. JAMA. 2006 Sep 6;296(9):1116-27 - PubMed
  2. BMJ. 2004 Oct 30;329(7473):1017 - PubMed
  3. Acad Med. 2010 Nov;85(11):1794-9 - PubMed
  4. Acad Psychiatry. 2008 Nov-Dec;32(6):525-30 - PubMed
  5. J R Soc Med. 1995 Nov;88(11):620-4 - PubMed
  6. JAMA. 2003 Sep 3;290(9):1190-6 - PubMed
  7. Acad Med. 2009 Mar;84(3):301-9 - PubMed
  8. BMJ. 2003 Feb 8;326(7384):319-21 - PubMed

Publication Types