Display options
Share it on

Int J Med Educ. 2016 Jan 11;7:11-8. doi: 10.5116/ijme.5682.6dfd.

A pilot study of orthopaedic resident self-assessment using a milestones' survey just prior to milestones implementation.

International journal of medical education

Kendall E Bradley, Kathryn M Andolsek

Affiliations

  1. Orthopaedic Surgery Residency Training Program, Duke University Hospital, Box 3648 DUMC, Durham, NC 27710, USA.
  2. Community and Family Medicine, Duke University School of Medicine, Box 3648 DUMC, 201 Trent Drive, Durham, NC 27710, USA.

PMID: 26752012 PMCID: PMC4715902 DOI: 10.5116/ijme.5682.6dfd

Abstract

OBJECTIVE: To pilot test if Orthopaedic Surgery residents could self-assess their performance using newly created milestones, as defined by the Accreditation Council on Graduate Medical Education.

METHODS: In June 2012, an email was sent to Program Directors and administrative coordinators of the 154 accredited Orthopaedic Surgery Programs, asking them to send their residents a link to an online survey. The survey was adapted from the Orthopaedic Surgery Milestone Project. Completed surveys were aggregated in an anonymous, confidential database. SAS 9.3 was used to perform the analyses.

RESULTS: Responses from 71 residents were analyzed. First and second year residents indicated through self-assessment that they had substantially achieved Level 1 and Level 2 milestones. Third year residents reported they had substantially achieved 30/41, and fourth year residents, all Level 3 milestones. Fifth year, graduating residents, reported they had substantially achieved 17 Level 4 milestones, and were extremely close on another 15. No milestone was rated at Level 5, the maximum possible. Earlier in training, Patient Care and Medical Knowledge milestones were rated lower than the milestones reflecting the other four competencies of Practice Based Learning and Improvement, Systems Based Practice, Professionalism, and Interpersonal Communication. The gap was closed by the fourth year.

CONCLUSIONS: Residents were able to successfully self-assess using the 41 Orthopaedic Surgery milestones. Respondents' rate improved proficiency over time. Graduating residents report they have substantially, or close to substantially, achieved all Level 4 milestones. Milestone self-assessment may be a useful tool as one component of a program's overall performance assessment strategy.

Keywords: competency based education; graduate medical education; milestones; postgraduate medical education; self-assessment

References

  1. J Bone Joint Surg Am. 2005 May;87(5):1031-7 - PubMed
  2. Front Psychol. 2013 Nov 21;4:668 - PubMed
  3. J Grad Med Educ. 2013 Mar;5(1):98-106 - PubMed
  4. JAMA. 2013 Dec 4;310(21):2328-46 - PubMed
  5. J Grad Med Educ. 2010 Sep;2(3):410-8 - PubMed
  6. Orthopedics. 2009 Mar;32(3):171 - PubMed
  7. J Grad Med Educ. 2012 Dec;4(4):417-24 - PubMed
  8. AMA J Ethics. 2015 Jun;17(6):515-20 - PubMed
  9. J Grad Med Educ. 2009 Dec;1(2):278-86 - PubMed
  10. Acad Med. 2012 Apr;87(4):419-27 - PubMed
  11. Can J Surg. 2012 Aug;55(4):S153-7 - PubMed
  12. J Grad Med Educ. 2015 Jun;7(2):220-4 - PubMed
  13. JAMA. 2006 Sep 6;296(9):1094-102 - PubMed
  14. Acad Med. 2013 Apr;88(4):449-53 - PubMed
  15. BMC Med Educ. 2013;13:24 - PubMed
  16. Acad Emerg Med. 2014 Jun;21(6):694-8 - PubMed
  17. J Grad Med Educ. 2015 Jun;7(2):162-5 - PubMed
  18. J Grad Med Educ. 2010 Sep;2(3):435-41 - PubMed
  19. J Emerg Med. 2014 Oct;47(4):432-40 - PubMed
  20. Acad Psychiatry. 2014 Jun;38(3):294-302 - PubMed
  21. Patient Educ Couns. 2011 Jul;84(1):3-9 - PubMed
  22. J Grad Med Educ. 2013 Mar;5(1):130-7 - PubMed
  23. J Grad Med Educ. 2009 Sep;1(1):5-20 - PubMed
  24. Acad Med. 2015 May;90(5):609-14 - PubMed
  25. Acad Med. 2005 Oct;80(10 Suppl):S46-54 - PubMed
  26. Am J Surg. 2008 Jan;195(1):1-4 - PubMed
  27. Med Teach. 2012;34(4):279-84 - PubMed
  28. Am J Surg. 2013 May;205(5):557-62; discussion 562 - PubMed
  29. Med Educ Online. 2014;19:25746 - PubMed
  30. J Grad Med Educ. 2015 Dec;7(4):658-62 - PubMed
  31. J Palliat Med. 2014 Apr;17(4):453-62 - PubMed
  32. Acad Med. 2015 Nov;90(11 Suppl):S36-42 - PubMed
  33. J Surg Educ. 2015 Jul-Aug;72(4):618-24 - PubMed
  34. J Bone Joint Surg Am. 2014 Dec 3;96(23):e195 - PubMed
  35. Acad Med. 1991 Dec;66(12):762-9 - PubMed
  36. Adv Health Sci Educ Theory Pract. 2002;7(1):63-80 - PubMed
  37. Med Teach. 2008;30(2):124-45 - PubMed
  38. Am J Obstet Gynecol. 2005 Nov;193(5):1817-22 - PubMed
  39. J Bone Joint Surg Am. 2010 Jan;92(1):245-9 - PubMed
  40. Plast Reconstr Surg. 2015 Jul;136(1):181-7 - PubMed
  41. Acad Emerg Med. 2013 Jul;20(7):736-9 - PubMed
  42. Acad Emerg Med. 2014 Aug;21(8):905-11 - PubMed
  43. Acad Med. 2000 Jul;75(7):737-41 - PubMed
  44. Acad Med. 2015 Aug;90(8):1084-92 - PubMed
  45. N Engl J Med. 2012 Mar 15;366(11):1051-6 - PubMed

MeSH terms

Publication Types

Grant support