June 2021
Volume 62, Issue 8
Open Access
ARVO Annual Meeting Abstract  |   June 2021
Evaluation of Federated Learning for OCT B-scan classification
Author Affiliations & Notes
  • Robin Hirt
    prenode GmbH, Karlsruhe, Germany
  • Christian Kungel
    Carl Zeiss AG, Munich, Baden-Württemberg, Germany
  • Caroline Dieterich
    prenode GmbH, Karlsruhe, Germany
  • Gary C Lee
    Carl Zeiss Meditec Inc, Dublin, California, United States
  • Dominik Fischer
    prenode GmbH, Karlsruhe, Germany
  • Niranchana Manivannan
    Carl Zeiss Meditec Inc, Dublin, California, United States
  • Aditya Nair
    Carl Zeiss Meditec Inc, Dublin, California, United States
  • Hugang Ren
    Carl Zeiss Meditec Inc, Dublin, California, United States
  • Sophia Yu
    Carl Zeiss Meditec Inc, Dublin, California, United States
  • Alexander Urich
    Carl Zeiss AG, Munich, Baden-Württemberg, Germany
  • Footnotes
    Commercial Relationships   Robin Hirt, prenode GmbH (E); Christian Kungel, Carl Zeiss AG (E); Caroline Dieterich, prenode GmbH (E); Gary Lee, Carl Zeiss Meditec, Inc (E); Dominik Fischer, prenode GmbH (E); Niranchana Manivannan, Carl Zeiss Meditec, Inc (E); Aditya Nair, Carl Zeiss Meditec, Inc (E); Hugang Ren, Carl Zeiss Meditec, Inc (E); Sophia Yu, Carl Zeiss Meditec, Inc (E); Alexander Urich, Carl Zeiss AG (E)
  • Footnotes
    Support  None
Investigative Ophthalmology & Visual Science June 2021, Vol.62, 2103. doi:
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Robin Hirt, Christian Kungel, Caroline Dieterich, Gary C Lee, Dominik Fischer, Niranchana Manivannan, Aditya Nair, Hugang Ren, Sophia Yu, Alexander Urich; Evaluation of Federated Learning for OCT B-scan classification. Invest. Ophthalmol. Vis. Sci. 2021;62(8):2103.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Purpose : Building robust deep learning-based models requires large quantities of diverse training data. Due to medical data privacy regulations, it is often infeasible to collect sensitive patient data in a centralized data lake.
Federated Learning (FL) sidesteps this difficulty by only sharing intermediate model training updates among them. In this study, we will show the effectiveness of FL in comparison to models trained on isolated and centralized data.

Methods : 76,544 OCT B-scans from 598 macular cubes acquired from 598 subjects using CIRRUSTM HD-OCT 5000 (ZEISS, Dublin, CA) were used as the training and test sets (478/120 split at cube level). 40% of B-scans were graded as “abnormal” by at least 1 of 2 retinal specialists.
A real-world scenario was simulated by splitting the training set into 3 originating regions for US (Region A), Europe (Region B), and Asia (Region C). For validation, the global test set consisted of 15,338 B-scans (38% “abnormal”) from the 120 cubes.
A ResNet50 was used to perform binary classification at the B-scan level. To evaluate the FL approach with meaningful baselines, we additionally trained isolated models on the regional data sets and one global model on the complete data set which share the same ANN settings and 50 epochs. All models have been tested on a global test set.
For applying FL, the decentralized ML framework mlx (prenode, Germany, Karlsruhe) was used (see Fig. 1). Each model was trained for one epoch per region locally before centralizing their updated model weights (Δw) for aggregation. This cycled for 100 iterations.

Results : In Table 1, we show the performance (ACC, AUC, and 95% CI in %) of locally best models (selected by best validation score on the global test set) using local training data alone as well as after federated learning.
For Region B and C, a 7.1% relative improvement in accuracy can be observed when the federated model is applied.

Conclusions : Given our experimental results, we can see that FL in a simulated real-world scenario can both ensure a higher level of security and trust between data owners as well as increase the generalizability of the model across regions.
In addition, we observe no difference in the performance of a federated model in comparison to a model that has directly been trained on centralized data. Thus, we show the potential of FL replacing a conventional centralization of data to preserve confidentiality whilst developing robust models.

This is a 2021 ARVO Annual Meeting abstract.

 

 

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×