Investigative Ophthalmology & Visual Science Cover Image for Volume 61, Issue 7
June 2020
Volume 61, Issue 7
Free
ARVO Annual Meeting Abstract  |   June 2020
Automated Grading of Diabetic Retinopathy by Simulating Human’s Attention with Deep Learning in Fundus Image
Author Affiliations & Notes
  • Yanyun Jiang
    School of Information Science and Engineering, Shandong Normal University, Jinan, Shandong, China
  • Xiaodan Sui
    School of Information Science and Engineering, Shandong Normal University, Jinan, Shandong, China
  • Weikuan Jia
    School of Information Science and Engineering, Shandong Normal University, Jinan, Shandong, China
  • Jian Lian
    School of Information Science and Engineering, Shandong Normal University, Jinan, Shandong, China
  • Wanzhen Jiao
    Ophthalmology, Shandong Provincial Hospital Affiliated to Shandong University, Jinan, Shandong, China
  • Yuanjie Zheng
    School of Information Science and Engineering, Shandong Normal University, Jinan, Shandong, China
  • Footnotes
    Commercial Relationships   Yanyun Jiang, None; Xiaodan Sui, None; Weikuan Jia, None; Jian Lian, None; Wanzhen Jiao, None; Yuanjie Zheng, None
  • Footnotes
    Support  Supported by the National Natural Science Foundation of China (No. 61572300; No. 81871508; No. 61773246);Taishan Scholar Program of Shandong Province of China (No. TSHW201502038); Major Program of Shandong Province Natural Science Foundation (No. ZR2018ZB0419).
Investigative Ophthalmology & Visual Science June 2020, Vol.61, 2034. doi:
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Yanyun Jiang, Xiaodan Sui, Weikuan Jia, Jian Lian, Wanzhen Jiao, Yuanjie Zheng; Automated Grading of Diabetic Retinopathy by Simulating Human’s Attention with Deep Learning in Fundus Image. Invest. Ophthalmol. Vis. Sci. 2020;61(7):2034.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Purpose : Diabetic retinopathy (DR) is an eye disease that is retinal microvascular damage due to diabetes mellitus. DR can lead to severe vision loss for patients. In this study, we propose an attention model using the deep convolutional neural network (DCNN) for the prediction of the critical regions of DR, which could predict attention maps for subsequent grading.

Methods : Figure 1 displays the DCNN structure. Inspired by Gradient-weighted Class Activation Mapping (Grad-CAM), we design a visual explanation of DCNN, which could highlight the important regions for classification model via guided backpropagation. In the premise of the image attention maps, an end-to-end regression model was used to learn attention maps. The performance of grading DR was improved by creating attention weight using a trained attention model, as well as “re-weight” the original image.

Results : We utilize 35126 images from Kaggle DR Detection Dataset to train the DCNN model. To measure if the attention maps help ophthalmologist screening for DR, we verify our method on the IDRiD dataset. We utilize 35126 images from Kaggle DR Detection Dataset to train the DCNN model. To measure if the attention maps help ophthalmologist screening for DR, we verify our method on the IDRiD dataset. Quadratic weighted kappa (QWK) for DR grading of 0.75 and 0.79 for without attention maps and with attention maps, respectively.

Conclusions : The attention map obtained by the classification model is a region that is meaningful for DR grading, which is consistent with our hypothesis that attention maps highlight the diseased area. The proposed attention model learns to generate reliable attention regions for clinical interpretation without known grading scales.

This is a 2020 ARVO Annual Meeting abstract.

 

Figure 1. The flowchart shows our proposed method which consists of a CNN classification module and an attention module.

Figure 1. The flowchart shows our proposed method which consists of a CNN classification module and an attention module.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×