July 2019
Volume 60, Issue 9
Open Access
ARVO Annual Meeting Abstract  |   July 2019
Inter-grader and Intra-grader Reliabilities of Graders and an Automated Algorithm for Cup-Disc Ratio Grading in Fundus Photographs
Author Affiliations & Notes
  • Weihan Tong
    Ophthalmology, National University Hospital Singapore, Singapore, Singapore
  • Maryanne Romero
    Ophthalmology, National University Hospital Singapore, Singapore, Singapore
  • Vivien Lim
    Ophthalmology, National University Hospital Singapore, Singapore, Singapore
  • Seng Chee Loon
    Ophthalmology, National University Hospital Singapore, Singapore, Singapore
  • Shuang Yu
    Commonwealth Scientific and Industrial Research Organisation, Australia, Victoria, Australia
  • Di Xiao
    Commonwealth Scientific and Industrial Research Organisation, Australia, Victoria, Australia
  • Yogesan Kanagasingam
    Commonwealth Scientific and Industrial Research Organisation, Australia, Victoria, Australia
  • Victor T C Koh
    Ophthalmology, National University Hospital Singapore, Singapore, Singapore
  • Footnotes
    Commercial Relationships   Weihan Tong, None; Maryanne Romero, None; Vivien Lim, None; Seng Chee Loon, None; Shuang Yu, None; Di Xiao, None; Yogesan Kanagasingam, None; Victor Koh, None
  • Footnotes
    Support  None
Investigative Ophthalmology & Visual Science July 2019, Vol.60, 5592. doi:
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Weihan Tong, Maryanne Romero, Vivien Lim, Seng Chee Loon, Shuang Yu, Di Xiao, Yogesan Kanagasingam, Victor T C Koh; Inter-grader and Intra-grader Reliabilities of Graders and an Automated Algorithm for Cup-Disc Ratio Grading in Fundus Photographs. Invest. Ophthalmol. Vis. Sci. 2019;60(9):5592.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Purpose : To investigate the inter-grader and intra-grader reliabilities of graders and an automated algorithm, for cup-disc ratio (CDR) grading using fundus photographs.

Methods : 200 fundus photographs were selected from a database of 3000 photographs taken from patients screened in an eye clinic of a tertiary referral centre. Graders involved include glaucoma specialists(n=2), general ophthalmologists(n=2), optometrists(n=2), family physicians(n=2) and an Automated Algorithm(AA). In total, 2 rounds of CDR grading were held for each grader on 2 different dates, with the photographs presented in random order. CDR values were graded as 0.1-0.9, or as pale disc or ungradable. The grading results of the senior glaucoma specialist were used as the reference benchmark for comparison.

Results : Statistical analysis results show varying levels of both inter-grader and intra-grader reliabilities among all graders, with no obvious correlation between their level of reliability and their experiences in grading CDR. Intra-Class Coefficient(ICC) values for inter-grader reliabilities range from 0.37 to 0.74, while ICC for intra-grader reliabilities range from 0.47 to 0.87. Receiver Operating Characteristic(ROC) curves were used to assess the capability of the AA in CDR grading. Area under curve(AUC) value of the AA was 0.829(66.3% sensitivity, 89.2% specificity), being very similar to the AUC 0.823 of the junior glaucoma specialist(94.4% sensitivity, 72.1% specificity).

Conclusions : The AUC values suggest that the Automated Algorithm has the potential to have better performance over human graders in CDR grading of fundus photographs. This may have potential applications as a screening tool for large numbers of people in the community, to pick up asymptomatic glaucoma suspect patients early.

This abstract was presented at the 2019 ARVO Annual Meeting, held in Vancouver, Canada, April 28 - May 2, 2019.

 

Inter-grader Reliabilities in CDR grading

Inter-grader Reliabilities in CDR grading

 

Receiver Operating Characteristic Curves of Automated Algorithm and Junior Glaucoma Specialist

Receiver Operating Characteristic Curves of Automated Algorithm and Junior Glaucoma Specialist

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×