June 2023
Volume 64, Issue 8
Open Access
ARVO Annual Meeting Abstract  |   June 2023
Deep learning-based detection of advanced AMD on retinal OCT from the UK Biobank dataset on behalf of the PINNACLE Consortium
Author Affiliations & Notes
  • Oliver Leingang
    Department of Ophthalmology, Medizinische Universitat Wien, Wien, Wien, Austria
  • Hrvoje Bogunovic
    Department of Ophthalmology, Medizinische Universitat Wien, Wien, Wien, Austria
  • Gregor Sebastian Reiter
    Department of Ophthalmology, Medizinische Universitat Wien, Wien, Wien, Austria
  • Arunava Chakravarty
    Department of Ophthalmology, Medizinische Universitat Wien, Wien, Wien, Austria
  • Martin Joseph Menten
    Institute for AI and Informatics in Medicine, Technische Universitat Munchen, Munchen, Bayern, Germany
  • Robert Holland
    Institute for AI and Informatics in Medicine, Technische Universitat Munchen, Munchen, Bayern, Germany
  • Lars G Fritsche
    University of Michigan, Ann Arbor, Michigan, United States
  • Hendrik P Scholl
    Institute of Molecular and Clinical Ophthalmology Basel, Basel, Basel-Stadt, Switzerland
  • Daniel Rueckert
    Institute for AI and Informatics in Medicine, Technische Universitat Munchen, Munchen, Bayern, Germany
  • Sobha Sivaprasad
    Moorfields Eye Hospital NHS Foundation Trust, London, London, United Kingdom
  • Andrew J Lotery
    University of Southampton, Southampton, Hampshire, United Kingdom
  • Ursula Schmidt-Erfurth
    Department of Ophthalmology, Medizinische Universitat Wien, Wien, Wien, Austria
  • Footnotes
    Commercial Relationships   Oliver Leingang None; Hrvoje Bogunovic Heidelberg Engineering, Code F (Financial Support), Apellis, Code F (Financial Support), RetInSight, Code F (Financial Support), Bayer, Code R (Recipient), Apellis, Code R (Recipient); Gregor Reiter None; Arunava Chakravarty None; Martin Menten None; Robert Holland None; Lars G Fritsche None; Hendrik Scholl None; Daniel Rueckert None; Sobha Sivaprasad None; Andrew Lotery None; Ursula Schmidt-Erfurth Apellis, Code C (Consultant/Contractor), Genentech, Code F (Financial Support), Kodiak, Code F (Financial Support), Novartis, Code F (Financial Support), Apellis, Code F (Financial Support), RetInsight, Code P (Patent)
  • Footnotes
    Support  Wellcome Trust Collaborative Award,“ Deciphering AMD by deep phenotyping and machine learning”( PINNACLE), Ref.210572/Z/18/Z.
Investigative Ophthalmology & Visual Science June 2023, Vol.64, 544. doi:
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Oliver Leingang, Hrvoje Bogunovic, Gregor Sebastian Reiter, Arunava Chakravarty, Martin Joseph Menten, Robert Holland, Lars G Fritsche, Hendrik P Scholl, Daniel Rueckert, Sobha Sivaprasad, Andrew J Lotery, Ursula Schmidt-Erfurth; Deep learning-based detection of advanced AMD on retinal OCT from the UK Biobank dataset on behalf of the PINNACLE Consortium. Invest. Ophthalmol. Vis. Sci. 2023;64(8):544.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Purpose : To demonstrate the capability and limitations of artificial intelligence (AI) in automatically detecting late-stage age-related macular degeneration (AMD) in large non-disease-specific optical coherence tomography (OCT) volume data set from UK Biobank under population and image domain shift.

Methods : We applied a deep neural network, trained on a subset of independent real-world data from the retrospective part of the PINNACLE project (PIN), to the UK Biobank data set (UKBB). PIN consisted of 3,765 Topcon-2000 OCTs of 1,849 eyes with either AMD or a healthy retina. In contrast, UKBB consisted of 175,869 lower quality Topcon-1000 OCTs from 85,709 patients with a variety of diseases, where the majority is expected to be healthy, representative of population screening. The 3D volume classifier is composed of two convolutional neural networks, connected sequentially, and was trained to detect the presence of complete RPE, and outer retinal atrophy (cRORA) and/or macular neovascularization (MNV) on the 3D volume. Classification uncertainty estimates were generated with Monte-Carlo drop-out at inference time. After removing ungradable OCTs with a robustness filter, we classified 93,648 OCT out of 54,000 patients on UKBB. Uncertain predictions were removed to compensate for the scanner model domain shift. All remaining positive predictions for MNV and cRORA, 502 OCTs from 460 patients from UKBB, were graded by a retinal specialist. Furthermore, a hold-out test set of 96 OCTs from PIN was graded by a retinal specialist.

Results : Our AMD detection network achieved a positive predictive value (PPV) of 0.94 and 0.89 for MNV and cRORA on the test set of PIN, respectively. On the external UKBB, the classifier achieved a low PPV for the presence of active MNV (0.11) and a high PPV for cRORA (0.98). Reformulating the classification target to the presence of retinal fluid (nAMD, RVO, CSCR, DME...) the model achieved a PPV of 0.93 for retinal fluid, and 0.95 for fluid-and/or-atrophy vs no-fluid-and-no-atrophy on the UKBB.

Conclusions : Our results reflect the strengths and caveats of population-biased training of machine learning models. Although trained to detect MNV and cRORA secondary to AMD, the classifier was able to detect fluid and atrophy when exposed to a screening population beyond AMD eyes.

This abstract was presented at the 2023 ARVO Annual Meeting, held in New Orleans, LA, April 23-27, 2023.

 

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×