Display options
Share it on

NPJ Digit Med. 2019 Apr 10;2:25. doi: 10.1038/s41746-019-0099-8. eCollection 2019.

Deep learning versus human graders for classifying diabetic retinopathy severity in a nationwide screening program.

NPJ digital medicine

Paisan Raumviboonsuk, Jonathan Krause, Peranut Chotcomwongse, Rory Sayres, Rajiv Raman, Kasumi Widner, Bilson J L Campana, Sonia Phene, Kornwipa Hemarat, Mongkol Tadarati, Sukhum Silpa-Archa, Jirawut Limwattanayingyong, Chetan Rao, Oscar Kuruvilla, Jesse Jung, Jeffrey Tan, Surapong Orprayoon, Chawawat Kangwanwongpaisan, Ramase Sukumalpaiboon, Chainarong Luengchaichawang, Jitumporn Fuangkaew, Pipat Kongsap, Lamyong Chualinpha, Sarawuth Saree, Srirut Kawinpanitan, Korntip Mitvongsa, Siriporn Lawanasakol, Chaiyasit Thepchatri, Lalita Wongpichedchai, Greg S Corrado, Lily Peng, Dale R Webster

Affiliations

  1. 1Department of Ophthalmology, Rajavithi Hospital, Bangkok, Thailand.
  2. 2Google AI, Google, Mountain View, CA USA.
  3. 3Shri Bhagwan Mahavir Vitreoretinal Services, Sankara Nethralaya, Chennai, Tamil Nadu India.
  4. 4Department of Ophthalmology, Vajira Hospital, Bangkok, Thailand.
  5. Eye and Laser Center, Charlotte, NC USA.
  6. 6East Bay Retina Consultants, Oakland, CA; Department of Ophthalmology, University of California San Francisco, San Francisco, CA USA.
  7. 7Retina-Vitreous Associates Medical Group, Department of Ophthalmology, University of Southern California, Los Angeles, CA USA.
  8. Department of Ophthalmology, Lamphun Hospital, Lamphun, Thailand.
  9. Department of Ophthalmology, Somdejphrajaotaksin Maharaj Hospital, Tak, Thailand.
  10. Department of Ophthalmology, Sawanpracharak Hospital, Nakhon Sawan, Thailand.
  11. Department of Ophthalmology, Nakhon Nayok Hospital, Nakhon Nayok, Thailand.
  12. Department of Ophthalmology, Photharam Hospital, Ratchaburi, Thailand.
  13. 13Department of Ophthalmology, Prapokklao Hospital, Chanthaburi, Thailand.
  14. Department of Ophthalmology, Mahasarakham Hospital, Mahasarakham, Thailand.
  15. Department of Ophthalmology, Nongbualamphu Hospital, Nongbualamphu, Thailand.
  16. Department of Ophthalmology, Pakchongnana Hospital, Nakhon Ratchasima, Thailand.
  17. Department of Ophthalmology, Mukdahan Hospital, Mukdahan, Thailand.
  18. Department of Ophthalmology, Suratthani Hospital, Suratthani, Thailand.
  19. Department of Ophthalmology, Sungaikolok Hospital, Narathiwat, Thailand.
  20. 20Bangkok Metropolitan Administration Public Health Center 7, Bangkok, Thailand.

PMID: 31304372 PMCID: PMC6550283 DOI: 10.1038/s41746-019-0099-8

Abstract

Deep learning algorithms have been used to detect diabetic retinopathy (DR) with specialist-level accuracy. This study aims to validate one such algorithm on a large-scale clinical population, and compare the algorithm performance with that of human graders. A total of 25,326 gradable retinal images of patients with diabetes from the community-based, nationwide screening program of DR in Thailand were analyzed for DR severity and referable diabetic macular edema (DME). Grades adjudicated by a panel of international retinal specialists served as the reference standard. Relative to human graders, for detecting referable DR (moderate NPDR or worse), the deep learning algorithm had significantly higher sensitivity (0.97 vs. 0.74,

Keywords: Developing world; Diabetes complications

Conflict of interest statement

Competing interestsJ.K., R.S., K.W., B.J.L.C., G.S.C., L.P., S.P. and D.R.W. are Google employees and receive salary and stock as a part of the standard compensation package. O.K., J.J. and J.T. are c

References

  1. Ophthalmology. 2000 Jan;107(1):19-24 - PubMed
  2. BMJ. 2001 Jul 7;323(7303):4-5 - PubMed
  3. Diabetes Care. 2003 Jun;26(6):1831-5 - PubMed
  4. Am J Ophthalmol. 2005 Apr;139(4):597-604 - PubMed
  5. J Med Assoc Thai. 2008 May;91(5):716-22 - PubMed
  6. Cochrane Database Syst Rev. 2011 Jul 06;(7):CD008081 - PubMed
  7. Telemed J E Health. 2011 Dec;17(10):814-37 - PubMed
  8. S Afr Med J. 2014 Sep 03;104(10):700-4 - PubMed
  9. PLoS One. 2014 Dec 11;9(12):e114245 - PubMed
  10. J Rehabil Res Dev. 2015;52(2):193-200 - PubMed
  11. JAMA Ophthalmol. 2016 Feb;134(2):222-8 - PubMed
  12. Ophthalmology. 2016 Dec;123(12):2571-2580 - PubMed
  13. JAMA. 2016 Dec 13;316(22):2402-2410 - PubMed
  14. Curr Diab Rep. 2017 Sep 5;17(10):96 - PubMed
  15. JAMA. 2017 Dec 12;318(22):2211-2223 - PubMed
  16. Ophthalmology. 2018 Aug;125(8):1264-1272 - PubMed
  17. Ophthalmology. 2018 Oct;125(10):1608-1622 - PubMed
  18. BMJ Glob Health. 2018 Aug 16;3(4):e000766 - PubMed

Publication Types