June 2023
Volume 64, Issue 8
Open Access
ARVO Annual Meeting Abstract  |   June 2023
A Coarse-to-fine Model for Fundus Image Segmentation via Variational Auto-Encoder
Author Affiliations & Notes
  • feiyan zhang
    Information Science and Computer, Shandong Normal University, Jinan, Shandong, China
  • Yuanjie Zheng
    Information Science and Computer, Shandong Normal University, Jinan, Shandong, China
  • Jie Wu
    Information Science and Computer, Shandong Normal University, Jinan, Shandong, China
  • Zeyuan Chen
    Information Science and Computer, Shandong Normal University, Jinan, Shandong, China
  • Footnotes
    Commercial Relationships   feiyan zhang None; Yuanjie Zheng None; Jie Wu None; Zeyuan Chen None
  • Footnotes
    Support  The National Natural Science Foundation. of China (81871508, 61773246), Major Program of Shandong Province Natural Science Foundation (ZR2018ZB0419), the China Postdoctoral Science Foundation (No. 2021M691982), Taishan Scholar Program of Shandong Province of China (TSHW201502038)
Investigative Ophthalmology & Visual Science June 2023, Vol.64, 347. doi:
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      feiyan zhang, Yuanjie Zheng, Jie Wu, Zeyuan Chen; A Coarse-to-fine Model for Fundus Image Segmentation via Variational Auto-Encoder. Invest. Ophthalmol. Vis. Sci. 2023;64(8):347.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Purpose : The optic cup-to-disc ratio is an important indicator for the evaluation of glaucoma as a disease, and the cup-to-disc ratio is one of the fundus examinations that has positive implications for the diagnosis of fundus images and optic neuropathy. The deep learning model shows excellent performance in optic cup-to-disc segmentation, but it relies heavily on a single label. In the medical field, an image is usually labeled by multiple experts. However, traditional label fusion strategies tend to overfit the model and ignore the information expressed among multiple experts. To address these problems, this study develops an objective and quantifiable coarse-to-fine model to improve optic cup and optic disc segmentation by Probabilistic variational auto-encoder and soft attention mechanism.

Methods : We employ the ORIGA dataset which contains 650 fundus images with six expert annotations. The model we constructed is shown in Figure 1, it includes the following three components: (1) The backbone network is Unet, and the feature of the last layer of the decoder is used as the coarse segmentation features F1. (2) Meanwhile, the original input images and labels are fed into the prior and posterior networks of the probabilistic variational self-encoder, respectively. The prior and posterior features are connected with Unet's last layer feature F1 to obtain the coarse segmentation results. (3) To obtain the refined segmentation results, a soft attention mechanism is used to focus on the uncertainty map between features and labels, thus fusing the consistent and disparity information and enabling the model to obtain a more accurate representation.

Results : We select the sensitivity (SE), specificity (SP), accuracy (AC), AUC, and dice coefficient (Dice) to evaluate the performance of the proposed model. Extensive comparison experiments have verified that our model is superior to the state-of-the-art models. The Dice of this method in the optic cup and optic disc segmentation is 96.78% and 86.89% respectively.

Conclusions : Our multi-label coarse-to-fine deep learning framework provides an automated tool for accurate segmentation of the optic cup and optic disc from fundus images. It helps to learn annotation information among multiple experts, improving not only the accuracy but also the generalization ability of the model.

This abstract was presented at the 2023 ARVO Annual Meeting, held in New Orleans, LA, April 23-27, 2023.

 

An overview of the proposed model for fundus image segmentation via variational auto-encoder.

An overview of the proposed model for fundus image segmentation via variational auto-encoder.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×