Utilization of automated deep learning approach toward detection of ocular toxoplasmosis using fundus photographs

Abstract

Purpose : Ocular Toxoplasmosis is often a clinical challenge that may require an expert opinion. A correct and timely diagnosis of active disease is the key to preventing significant vision loss from the disease. In this study, we aim to develop a deep learning algorithm without coding for the differentiation of Ocular Toxoplasmosis fundus images from a normal fundus image.

Methods : Patients with a confirmed diagnosis of Ocular Toxoplasmosis who had fundus photos available for the diseased eye/s were included in the study. Patients were excluded if they had other concomitant ocular diseases, had ungradable imaging data, or if the diagnosis was uncertain. The Ocular Toxoplasmosis fundus photos were obtained from uveitis centers in Argentina, Turkey, and USA. The healthy fundus photos were obtained from publicly available databases. The fundus photos included in the study were a combination of standard fundus photos and ultrawide field fundus photos. A deep learning model using the automated machine learning (AutoML) vision platform from Google LLC (Menlo Park, CA) was trained using 441 Ocular Toxoplasmosis and 103 normal images followed by validation using 54 Ocular Toxoplasmosis and 12 normal images. The model was then tested using 57 Ocular Toxoplasmosis and 15 normal images. The area under the precision-recall curve (AUPRC) was plotted and sensitivity, specificity, positive predictive value (PPV), and accuracy (AC) were calculated.

Results : A total of 552 Ocular Toxoplasmosis patient images were compared to 130 healthy images. AUPRC for the dataset was found to be 0.99 (Figure 1A). The sensitivity, specificity, PPV, and AC of the model were 96.5%, 100%, 100%, and 97%. Figure 1B also shows the confusion matrix of the model.

Conclusions : Clinician-derived automated machine learning model developed without coding was able to differentiate Ocular Toxoplasmosis from normal images. This model has the potential to be developed further to aid physicians in the diagnosis of Ocular Toxoplasmosis. Additionally, AutoML can enable clinician-derived discovery of disease biomarkers.

This abstract was presented at the 2023 ARVO Annual Meeting, held in New Orleans, LA, April 23-27, 2023.

 

Figure 1. (A) Area under the precision-recall curve of the automated machine learning model. (B) Confusion matrix of the automated machine learning model.