June 2022
Volume 63, Issue 7
Open Access
ARVO Annual Meeting Abstract  |   June 2022
Predicting 2-year and 5-year Late AMD Progression using Deep Learning with Longitudinal Fundus Images
Author Affiliations & Notes
  • Junghwan Lee
    Biomedical Informatics, Columbia University, New York, New York, United States
    Population Health Sciences, Weill Cornell Medicine, New York, New York, United States
  • Tingyi Wanyan
    Intelligent System Engineering, Indiana University, Bloomington, Indiana, United States
  • Qingyu Chen
    National Center for Biotechnology Information, Bethesda, Maryland, United States
  • Tiarnan D L Keenan
    National Eye Institute, Bethesda, Maryland, United States
  • Emily Y Chew
    National Eye Institute, Bethesda, Maryland, United States
  • Zhiyong Lu
    National Center for Biotechnology Information, Bethesda, Maryland, United States
  • Fei Wang
    Population Health Sciences, Weill Cornell Medicine, New York, New York, United States
  • Yifan Peng
    Population Health Sciences, Weill Cornell Medicine, New York, New York, United States
  • Footnotes
    Commercial Relationships   Junghwan Lee None; Tingyi Wanyan None; Qingyu Chen None; Tiarnan Keenan None; Emily Chew None; Zhiyong Lu None; Fei Wang None; Yifan Peng None
  • Footnotes
    Support  NO1-EY-5-0007; HHS-N-260-2005-00007-C; intramural program from NLM/NIH and NEI/NIH; 4R00LM013001;
Investigative Ophthalmology & Visual Science June 2022, Vol.63, 3003 – F0273. doi:
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Junghwan Lee, Tingyi Wanyan, Qingyu Chen, Tiarnan D L Keenan, Emily Y Chew, Zhiyong Lu, Fei Wang, Yifan Peng; Predicting 2-year and 5-year Late AMD Progression using Deep Learning with Longitudinal Fundus Images. Invest. Ophthalmol. Vis. Sci. 2022;63(7):3003 – F0273.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Purpose : Accurately predicting a patient’s risk of progressing to late age-related macular degeneration (AMD) is difficult but crucial for personalized medicine. While current risk prediction models are useful, none utilizes a longitudinal series of images in patients’ history to estimate the risk of late AMD in a given time interval. In this work, we seek to evaluate how deep neural networks capture the sequential patterns of longitudinal fundus images and improve the prediction of 2-year and 5-year risks of progression to late AMD.

Methods : We developed a hybrid architecture that consists of a Convolutional Neural Network and a Recurrent Neural Network, popularly known as CNN-RNN (Fig 1). Specifically, we used a ResNet to extract features from the images and applied an LSTM layer on top for the prediction. Two training strategies were used: (1) we used the ResNet trained on a late AMD detection task as a fixed feature extractor, and (2) we fine-tuned the weights of ResNet together with the LSTM in an end-to-end manner. We also compared our model with a ResNet which predicts AMD progression using a single image.

Results : We trained and evaluated the models using longitudinal fundus images from the Age-Related Eye Disease Study (AREDS). The AREDS dataset includes 4,315 participants, a large majority of whom had annual visits over 10 years. The dataset was split into train/validation sets with a 0.7:0.3 ratio. We evaluated models using the area under the receiver operating characteristic curve (AUC). Table 1 shows that the CNN-RNN model outperforms the baseline on 2-year (0.926 vs. 0.892) and 5-year (0.904 vs. 0.829) predictions. In the meantime, our model’s performance increases with up to 5 visits, but drops with more visits in patient history. This might be due to the data imbalance and sparsity issues. We also observed that the end-to-end training did not show significant improvement.

Conclusions : We presented a CNN-RNN model for predicting late AMD progression for each patient in this study. Our experiments show that our model can capture dynamic sequential patterns and outperforms baselines. This study sheds light on the potential of deep learning to facilitate and support clinical decision-making on an individual basis.

This abstract was presented at the 2022 ARVO Annual Meeting, held in Denver, CO, May 1-4, 2022, and virtually.

 

Figure 1. The archietecture of (A) CNN-RNN and (B) ResNet model.

Figure 1. The archietecture of (A) CNN-RNN and (B) ResNet model.

 

Table 1. AUC on predicting 2-year and 5-year late AMD progression on longitudinal fundus images.

Table 1. AUC on predicting 2-year and 5-year late AMD progression on longitudinal fundus images.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×