Display options
Share it on

Acad Med. 2021 Jul 01;96(7):S42-S49. doi: 10.1097/ACM.0000000000004095.

Learner Levels of Supervision Across the Continuum of Pediatrics Training.

Academic medicine : journal of the Association of American Medical Colleges

Alan Schwartz, Emily Borman-Shoap, Carol Carraccio, Bruce Herman, Patricia M Hobday, Paritosh Kaul, Michele Long, Meghan O'Connor, Richard Mink, Daniel J Schumacher, David A Turner, Daniel C West

Affiliations

  1. A. Schwartz is Michael Reese Endowed Professor of Medical Education and research professor, pediatrics, University of Illinois College of Medicine, Chicago, Illinois, and network director, Association of Pediatric Program Directors (APPD) Longitudinal Educational Assessment Research Network (LEARN), McLean, Virginia; ORCID: http://orcid.org/0000-0003-3809-6637.
  2. E. Borman-Shoap is associate professor, residency program director, and vice chair of education, Department of Pediatrics, University of Minnesota, Minneapolis, Minnesota; ORCID: https://orcid.org/0000-0001-7514-7793.
  3. C. Carraccio was vice president for competency-based medical education, American Board of Pediatrics, Chapel Hill, North Carolina, at the time the work was completed; ORCID: https://orcid.org/0000-0001-5473-8914.
  4. B. Herman is professor and vice chair of education, Department of Pediatrics, University of Utah, Salt Lake City, Utah.
  5. P.M. Hobday is assistant professor and director, Education in Pediatrics Across the Continuum (EPAC), Department of Pediatrics, University of Minnesota, Minneapolis, Minnesota.
  6. P. Kaul is professor and associate director, EPAC, Department of Pediatrics, University of Colorado, School of Medicine, Denver, Colorado; ORCID: https://orcid.org/0000-0003-4155-7406.
  7. M. Long is professor and director, EPAC, Department of Pediatrics, University of California, San Francisco, San Francisco, California; ORCID: https://orcid.org/0000-0002-8399-5589.
  8. M. O'Connor is assistant professor and director, EPAC, Department of Pediatrics, University of Utah, Salt Lake City, Utah; ORCID: https://orcid.org/0000-0002-5403-923X.
  9. R. Mink is professor of pediatrics, David Geffen School of Medicine at the University of California, Los Angeles (UCLA), Los Angeles, California, pediatric critical care fellowship program director, Harbor-UCLA Medical Center, Torrance, California, and director, APPD Subspecialty Pediatrics Investigator Network, McLean, Virginia; ORCID: http://orcid.org/0000-0002-7998-4713.
  10. D.J. Schumacher is associate professor, Department of Pediatrics, Cincinnati Children's Hospital Medical Center/University of Cincinnati College of Medicine, Cincinnati, Ohio; ORCID: https://orcid.org/0000-0001-5507-8452.
  11. D.A. Turner was associate professor, Division of Pediatric Critical Care, Department of Pediatrics, and associate director, Graduate Medical Education, Duke University Hospital and Health System, Durham, North Carolina, at the time the work was completed.
  12. D.C. West is professor and senior director of medical education, Department of Pediatrics, Children's Hospital of Philadelphia and The Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania; ORCID: https://orcid.org/0000-0002-0909-4213.

PMID: 34183601 DOI: 10.1097/ACM.0000000000004095

Abstract

PURPOSE: To describe trajectories in level of supervision ratings for linked entrustable professional activities (EPAs) among pediatric learners in medical school, residency, fellowship.

METHOD: The authors performed secondary analyses of 3 linked datasets of level of supervision ratings for the Core EPAs for Entering Residency, the General Pediatrics EPAs, and the Subspecialty Pediatrics EPAs. After identifying 9 activities in common across training stages and aligning the level of entrustment-supervision scales across the datasets, piecewise ordinal and linear mixed effects models were fitted to characterize trajectories of supervision ratings.

RESULTS: Within each training period, learners were rated as needing less supervision over time in each activity. When transitioning from medical school to residency or during the first year of residency, learners were rated as needing greater supervision in activities related to patient management, teamwork, emergent care, and public health/QI than in earlier periods. When transitioning from residency to fellowship, learners were always rated as needing greater supervision than they had been accorded at the end of residency and sometimes even more than they had been accorded at the start of residency.

CONCLUSIONS: Although development over training is often imagined as continuous and monotonically increasing competence, this study provides empirical evidence supporting the idea that entrustment is a set of discrete decisions. The relaxation of supervision in training is not a linear process. Even with a seamless curriculum, supervision is tightly bound to the training setting. Several explanations for these findings are discussed.

Copyright © 2021 by the Association of American Medical Colleges.

References

  1. Association of American Medical Colleges. Core entrustable professional activities for entering residency. https://www.aamc.org/what-we-do/mission-areas/medical-education/cbme/core-epas. Accessed December 26, 2020. - PubMed
  2. The American Board of Pediatrics. Entrustable Professional Activities for General Pediatrics. Chapel Hill, NC: The American Board of Pediatrics; 2013. - PubMed
  3. The American Board of Pediatrics. Entrustable Professional Activities for Subspecialties. https://www.abp.org/subspecialty-epas. Accessed December 26, 2020. - PubMed
  4. Carraccio C, Englander R, Gilhooly J, et al. Building a framework of entrustable professional activities, supported by competencies and milestones, to bridge the educational continuum. Acad Med. 2017; 92:324–330. - PubMed
  5. Schwartz A, Balmer DF, Borman-Shoap E, et al. Shared mental models among clinical competency committees in the context of time-variable, competency-based advancement to residency. Acad Med. 2020; 95:S95–S102. - PubMed
  6. Caverzagie KJ, Cooney TG, Hemmer PA, Berkowitz L. The development of entrustable professional activities for internal medicine residency training: A report from the Education Redesign Committee of the Alliance for Academic Internal Medicine. Acad Med. 2015; 90:479–484. - PubMed
  7. Albright JB, Meier AH, Ruangvoravat L, VanderMeer TJ. Association between entrustable professional activities and milestones evaluations: Real-time assessments correlate with semiannual reviews. J Surg Educ. 2020; 77:e220–e228. - PubMed
  8. Murray KE, Lane JL, Carraccio C, et al.; Education in Pediatrics Across the Continuum (EPAC) Study Group. Crossing the gap: Using competency-based assessment to determine whether learners are ready for the undergraduate-to-graduate transition. Acad Med. 2019; 94:338–345. - PubMed
  9. Andrews JS, Bale JF Jr, Soep JB, et al.; EPAC Study Group. Education in Pediatrics Across the Continuum (EPAC): First steps toward realizing the dream of competency-based education. Acad Med. 2018; 93:414–420. - PubMed
  10. Schumacher DJ, West DC, Schwartz A, et al.; Association of Pediatric Program Directors Longitudinal Educational Assessment Research Network General Pediatrics Entrustable Professional Activities Study Group. Longitudinal assessment of resident performance using entrustable professional activities. JAMA Netw Open. 2020; 3:e1919316. - PubMed
  11. Mink R, Schwartz A, Carraccio C, et al.; Steering Committee of the Subspecialty Pediatrics Investigator Network. Creating the subspecialty pediatrics investigator network. J Pediatr. 2018; 192:3–4.e2. - PubMed
  12. Schwartz A, Young R, Hicks PJ; Appd Learn. Medical education practice-based research networks: Facilitating collaborative research. Med Teach. 2016; 38:64–74. - PubMed
  13. Powell DE, Carraccio C, Aschenbrener CA. Pediatrics redesign project: A pilot implementing competency-based education across the continuum. Acad Med. 2011; 86:e13. - PubMed
  14. Schumacher DJ, Schwartz A, Zenel JA Jr, et al.; Association of Pediatric Program Directors (APPD) Longitudinal Educational Assessment Research Network (LEARN) General Pediatrics Entrustable Professional Activities Study Group. Narrative performance level assignments at initial entrustment and graduation: Integrating EPAs and milestones to improve learner assessment. Acad Med. 2020; 95:1736–1744. - PubMed
  15. ten Cate O, Schwartz A, Chen HC. Assessing trainees and making entrustment decisions: On the nature and use of entrustment-supervision scales. Acad Med. 2020; 95:1662–1669. - PubMed
  16. Chen HC, van den Broek WE, ten Cate O. The case for use of entrustable professional activities in undergraduate medical education. Acad Med. 2015; 90:431–436. - PubMed
  17. The American Board of Pediatrics. Entrustable Professional Activities: Supervision Scales for General Pediatrics. Chapel Hill, NC: The American Board of Pediatrics; 2013. - PubMed
  18. The American Board of Pediatrics. Entrustable Professional Activities: Supervision Scales for Common EPAs. Chapel Hill, NC: The American Board of Pediatrics; 2013. - PubMed
  19. Wood S. Generalized Additive Models: An Introduction with R. 2nd ed. Boca Raton, FL: CRC Press; 2017:496. - PubMed
  20. Morgan HK, Mejicano GC, Skochelak S, et al. A responsible educational handover: Improving communication to improve learning. Acad Med. 2020; 95:194–199. - PubMed
  21. Edgar L, Hamstra SJ, Hogan S, et al. Milestones National Report 2020. Chicago, IL: Accreditation Council for Graduate Medical Education; 2020. - PubMed

MeSH terms

Publication Types