Display options
Share it on

Australas Med J. 2013 May 30;6(5):301-7. doi: 10.4066/AMJ.2013.1651. Print 2013.

Automated classification of limb fractures from free-text radiology reports using a clinician-informed gazetteer methodology.

The Australasian medical journal

Amol Wagholikar, Guido Zuccon, Anthony Nguyen, Kevin Chu, Shane Martin, Kim Lai, Jaimi Greenslade

Affiliations

  1. The Australian e-Health Research Centre, Brisbane, CSIRO.

PMID: 23745152 PMCID: PMC3674422 DOI: 10.4066/AMJ.2013.1651

Abstract

BACKGROUND: Timely diagnosis and reporting of patient symptoms in hospital emergency departments (ED) is a critical component of health services delivery. However, due to dispersed information resources and a vast amount of manual processing of unstructured information, accurate point-of-care diagnosis is often difficult.

AIMS: The aim of this research is to report initial experimental evaluation of a clinician-informed automated method for the issue of initial misdiagnoses associated with delayed receipt of unstructured radiology reports.

METHOD: A method was developed that resembles clinical reasoning for identifying limb abnormalities. The method consists of a gazetteer of keywords related to radiological findings; the method classifies an X-ray report as abnormal if it contains evidence contained in the gazetteer. A set of 99 narrative reports of radiological findings was sourced from a tertiary hospital. Reports were manually assessed by two clinicians and discrepancies were validated by a third expert ED clinician; the final manual classification generated by the expert ED clinician was used as ground truth to empirically evaluate the approach.

RESULTS: The automated method that attempts to individuate limb abnormalities by searching for keywords expressed by clinicians achieved an F-measure of 0.80 and an accuracy of 0.80.

CONCLUSION: While the automated clinician-driven method achieved promising performances, a number of avenues for improvement were identified using advanced natural language processing (NLP) and machine learning techniques.

Keywords: Limb fractures; classification; emergency department; machine learning; radiology reports; rule-based method

References

  1. Eur J Emerg Med. 1997 Dec;4(4):213-6 - PubMed
  2. Artif Intell Med. 1997 May;10(1):5-24 - PubMed
  3. J Biomed Inform. 2013 Aug;46(4):734-43 - PubMed
  4. AJR Am J Roentgenol. 2005 Feb;184(2):687-90 - PubMed
  5. J Am Med Inform Assoc. 2010 Jul-Aug;17(4):440-5 - PubMed
  6. Clin Pediatr (Phila). 2011 Mar;50(3):183-6 - PubMed
  7. AMIA Jt Summits Transl Sci Proc. 2013 Mar 18;2013:300-4 - PubMed
  8. J Am Med Inform Assoc. 2006 Nov-Dec;13(6):696-8 - PubMed
  9. J Digit Imaging. 1998 Aug;11(3 Suppl 1):18-20 - PubMed
  10. Emerg Med (Fremantle). 2001 Jun;13(2):194-7 - PubMed
  11. J Digit Imaging. 2012 Feb;25(1):30-6 - PubMed
  12. Arch Emerg Med. 1991 Dec;8(4):266-70 - PubMed

Publication Types