Display options
Share it on

AEM Educ Train. 2019 Oct 31;4(2):147-153. doi: 10.1002/aet2.10395. eCollection 2020 Apr.

An Event-based Approach to Measurement: Facilitating Observational Measurement in Highly Variable Clinical Settings.

AEM education and training

Rosemarie Fernandez, Elizabeth D Rosenman, Sarah Brolliar, Anne K Chipman, Colleen Kalynych, Marie C Vrablik, Joseph R Keebler, Elizabeth H Lazzara

Affiliations

  1. Department of Emergency Medicine and the Center for Experiential Learning and Simulation, College of Medicine University of Florida Gainesville FL.
  2. Department of Emergency Medicine University of Washington Seattle WA.
  3. Department of Emergency Medicine, Office of Educational Affairs University of Florida College of Medicine-Jacksonville Jacksonville FL.
  4. Department of Human Factors and Behavioral Neurobiology, College of Arts and Sciences Embry-Riddle Aeronautical University Daytona Beach FL.

PMID: 32313861 PMCID: PMC7163198 DOI: 10.1002/aet2.10395

Abstract

BACKGROUND: Translational research in medical education requires the ability to rigorously measure learner performance in actual clinical settings; however, current measurement systems cannot accommodate the variability inherent in many patient care  environments. This is especially problematic in emergency medicine, where patients represent a wide spectrum of severity for a single clinical presentation. Our objective is to describe and implement EBAM, an event-based approach to measurement that can be applied to actual emergency medicine clinical events.

METHODS: We used a four-step event-based approach to create an emergency department trauma resuscitation patient care measure. We applied the measure to a database of 360 actual trauma resuscitations recorded in a Level I trauma center using trained raters. A subset (

RESULTS: The methodology created a metric containing both universal items that are applied to all trauma resuscitation events and conditional items that only apply in certain situations. For clinical trauma events, injury severity scores ranged from 1 to 75 with a mean (±SD) of 21 (±15) and included both blunt (254/360; 74%) and penetrating (86/360; 25%) traumatic injuries, demonstrating the diverse nature of the clinical encounters. The mean (±SD) Cohen's kappa for patient care items was 0.7 (±0.3).

CONCLUSION: We present an event-based approach to performance assessment that may address a major gap in translational education research. Our work centered on assessment of patient care behaviors during trauma resuscitation. More work is needed to evaluate this approach across a diverse array of clinical events.

© 2019 by the Society for Academic Emergency Medicine.

References

  1. Am J Med. 2006 Feb;119(2):166.e7-16 - PubMed
  2. BMJ Qual Saf. 2013 May;22(5):436-48 - PubMed
  3. Med Teach. 2005 May;27(3):200-6 - PubMed
  4. BMJ. 1992 Jun 6;304(6840):1491-4 - PubMed
  5. Simul Healthc. 2011 Aug;6 Suppl:S42-7 - PubMed
  6. Sci Transl Med. 2010 Feb 17;2(19):19cm8 - PubMed
  7. Med Educ. 2001 Apr;35(4):331-6 - PubMed
  8. Crit Care Med. 2013 Nov;41(11):2551-62 - PubMed
  9. Med Educ. 2014 Apr;48(4):375-85 - PubMed
  10. Acad Med. 2004 Jan;79(1):16-22 - PubMed
  11. Aust N Z J Surg. 1999 Mar;69(3):183-6 - PubMed
  12. Biometrics. 1977 Mar;33(1):159-74 - PubMed
  13. Ann Intern Med. 2003 Mar 18;138(6):476-81 - PubMed
  14. J Am Coll Surg. 2014 Mar;218(3):459-66 - PubMed
  15. Med Educ. 2005 Sep;39(9):880-9 - PubMed
  16. J Trauma. 2002 Jun;52(6):1078-85; discussion 1085-6 - PubMed
  17. J Trauma. 1995 Jan;38(1):79-82 - PubMed
  18. Med Educ. 2016 May;50(5):585-6 - PubMed
  19. J Trauma. 2009 Dec;67(6):1412-20 - PubMed

Publication Types