July 2019
Volume 60, Issue 9
Free
ARVO Annual Meeting Abstract  |   July 2019
Linking Function and Structure: Prediction of Retinal Sensitivity in AMD from OCT using Deep Learning
Author Affiliations & Notes
  • Philipp Seeböck
    Department of Ophthalmology, Medical University of Vienna, Vienna, Vienna, Austria
  • Wolf-Dieter Vogl
    Department of Ophthalmology, Medical University of Vienna, Vienna, Vienna, Austria
  • Sebastian M Waldstein
    Department of Ophthalmology, Medical University of Vienna, Vienna, Vienna, Austria
  • Magdalena Baratsits
    Department of Ophthalmology, Medical University of Vienna, Vienna, Vienna, Austria
  • José Ignacio Orlando
    Department of Ophthalmology, Medical University of Vienna, Vienna, Vienna, Austria
  • Thomas Alten
    Department of Ophthalmology, Medical University of Vienna, Vienna, Vienna, Austria
  • Hrvoje Bogunovic
    Department of Ophthalmology, Medical University of Vienna, Vienna, Vienna, Austria
  • Mustafa Arikan
    Department of Ophthalmology, Medical University of Vienna, Vienna, Vienna, Austria
  • Georgios Mylonas
    Department of Ophthalmology, Medical University of Vienna, Vienna, Vienna, Austria
  • Ursula Schmidt-Erfurth
    Department of Ophthalmology, Medical University of Vienna, Vienna, Vienna, Austria
  • Footnotes
    Commercial Relationships   Philipp Seeböck, None; Wolf-Dieter Vogl, None; Sebastian Waldstein, Bayer (F), Genentech (F), Novartis (C); Magdalena Baratsits, None; José Orlando, None; Thomas Alten, None; Hrvoje Bogunovic, None; Mustafa Arikan, None; Georgios Mylonas, None; Ursula Schmidt-Erfurth, Böhringer Ingelheim (C), Genentech (C), Novartis (C), Roche (C)
  • Footnotes
    Support  Christian Doppler Research Association, the Austrian Federal Ministry for Digital and Economic Affairs and the National Foundation for Research, Technology and Development. We thank the NVIDIA for GPU donation.
Investigative Ophthalmology & Visual Science July 2019, Vol.60, 1534. doi:
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Philipp Seeböck, Wolf-Dieter Vogl, Sebastian M Waldstein, Magdalena Baratsits, José Ignacio Orlando, Thomas Alten, Hrvoje Bogunovic, Mustafa Arikan, Georgios Mylonas, Ursula Schmidt-Erfurth; Linking Function and Structure: Prediction of Retinal Sensitivity in AMD from OCT using Deep Learning. Invest. Ophthalmol. Vis. Sci. 2019;60(9):1534.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Purpose : Microperimetry examines retinal sensitivity at specific retinal locations and is the most comprehensive test of visual function at the macular level. However, it is also time consuming and has limitations in reproducibility. To establish reliable morphologic surrogate endpoints for visual function testing, we developed and evaluated a deep learning model to predict retinal sensitivity maps (function) from OCT volumes (structure). The consolidated use of microperimetry and deep learning offers the opportunity to detect novel biomarker candidates for retinal function, to evaluate to which extent retinal function can be explained by structure shown in OCT, and to investigate which features of the retina affect its sensitivity.

Methods : As a representative dataset, we used 463 pairs of SD-OCT volume scans (512x128x1024 voxels, Cirrus, Zeiss) and corresponding microperimetry examinations (Nidek MP1), obtained in 174 patients with a healthy retina, early or intermediate AMD, CNV or GA. First, registration of each OCT-microperimetry pair was performed. Then, a deep learning model was trained to predict an en-face 2D retinal sensitivity map for a 3D OCT volume, in which a retinal sensitivity value is assigned to each A-scan location.

Results : We compare three different models, using A-scans (DL-1), B-scans (DL-2) or 3D patches (DL-3) as input for prediction. We achieved an overall Mean Absolute Error (MAE) for point-wise sensitivity (PWS) of 3.07 dB (DL-1), 2.87 dB (DL-2) and 2.67 dB (DL-3) on the test set. To investigate which parts of the OCT were important for retinal sensitivity prediction, explanatory techniques to understand the model decisions can be applied.

Conclusions : We propose a deep learning methodology to predict retinal sensitivity from OCT volumes. Using a model based on three-dimensional input improves the prediction performance, indicating the importance of context information. Subsequent qualitative evaluation using saliency maps enable an in in-depth evaluation. The results of this study are a promising step in exploring the linkage between image-based information and function, in particular in the context of novel biomarker candidate detection.

This abstract was presented at the 2019 ARVO Annual Meeting, held in Vancouver, Canada, April 28 - May 2, 2019.

 

Overview of the presented approach that predicts function from morphology.

Overview of the presented approach that predicts function from morphology.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×