Investigative Ophthalmology & Visual Science Cover Image for Volume 65, Issue 7
June 2024
Volume 65, Issue 7
Open Access
ARVO Annual Meeting Abstract  |   June 2024
Using generative AI to investigate medical imagery models and datasets
Author Affiliations & Notes
  • Yun Liu
    Google Inc., Mountain View, California, United States
  • Footnotes
    Commercial Relationships   Yun Liu Google, Code E (Employment)
  • Footnotes
    Support  Research was conducted at Google
Investigative Ophthalmology & Visual Science June 2024, Vol.65, 3875. doi:
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Yun Liu; Using generative AI to investigate medical imagery models and datasets. Invest. Ophthalmol. Vis. Sci. 2024;65(7):3875.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Presentation Description : Artificial intelligence models have shown promise in performing many medical imaging tasks. However, our ability to explain what signals these models have learned is severely lacking. Explanations are needed in order to increase the trust of doctors in AI-based models, especially in domains where AI prediction capabilities surpass those of humans. Moreover, such explanations could enable novel scientific discovery by uncovering signals in the data that aren’t yet known to experts. We present an approach for generating hypotheses by leveraging a generative model (StylEx, based on StyleGAN) to produce visual attributes associated with a prediction, followed by interdisciplinary expert review. We demonstrate results on retinal fundus photographs and external eye photographs, showing examples of both possibly novel attributes as well as confounders learned by the model. In contrast to some previous approaches that combine all associated changes into a single visual attribute, our approach has the strength of being able to separate different visual attributes for independent investigation. We hope that our approach can help others check their models for any confounders, and potentially learn previously unknown associations.

This abstract was presented at the 2024 ARVO Annual Meeting, held in Seattle, WA, May 5-9, 2024.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×