June 2023
Volume 64, Issue 8
Open Access
ARVO Annual Meeting Abstract  |   June 2023
Can ChatGPT™, an "intelligent" chatbot, be used to educate our glaucoma patients?
Author Affiliations & Notes
  • David A Lee
    The University of Texas Health Science Center at Houston John P and Katherine G McGovern Medical School, Houston, Texas, United States
  • Gloria Wu
    University of California San Francisco School of Medicine, San Francisco, California, United States
  • Katherine Tien
    Johns Hopkins University Zanvyl Krieger School of Arts and Sciences, Baltimore, Maryland, United States
  • Rohan Madhok
    Tulane University School of Science and Engineering, New Orleans, Louisiana, United States
  • Vrinda Inani
    University of California San Francisco School of Medicine, San Francisco, California, United States
  • Eddie Zhang
    University of California San Francisco School of Medicine, San Francisco, California, United States
  • Jae Yong Lee
    Washington University in St Louis, St Louis, Missouri, United States
  • Weichen Zhao
    University of California Davis, Davis, California, United States
  • Alaap Rag
    University of Rochester School of Arts and Sciences, Rochester, New York, United States
  • Footnotes
    Commercial Relationships   David Lee None; Gloria Wu None; Katherine Tien None; Rohan Madhok None; Vrinda Inani None; Eddie Zhang None; Jae Yong Lee None; Weichen Zhao None; Alaap Rag None
  • Footnotes
    Support  None
Investigative Ophthalmology & Visual Science June 2023, Vol.64, 379. doi:
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      David A Lee, Gloria Wu, Katherine Tien, Rohan Madhok, Vrinda Inani, Eddie Zhang, Jae Yong Lee, Weichen Zhao, Alaap Rag; Can ChatGPT™, an "intelligent" chatbot, be used to educate our glaucoma patients?. Invest. Ophthalmol. Vis. Sci. 2023;64(8):379.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Purpose : 54% of the U.S. population reads below 6th grade. ChatGPT™ (OpenAI, San Francisco) uses a new artificial intelligence (AI) model trained to generate real-time comprehensive and conversational responses. Can ChatGPT™ AI be used to educate our glaucoma patients?

Methods : We asked ChatGPT™ 10 questions formulated by a glaucoma specialist (DAL), directed at glaucoma patient education. The same questions were then asked with a command input “Tell me like I am in 5th grade.” The Flesch Kincaid Grade Level Score, part of the standard U.S. Military Flesch Reading Ease formula, was used to evaluate the American grade level needed to comprehend ChatGPT™ output.

Questions:
1. Which is the better treatment for narrow angles at risk for angle closure glaucoma or angle closure glaucoma: laser iridotomy or cataract extraction?
2. Which glaucoma treatments work better, medications or surgery?
3. Why do people go blind from glaucoma?
4. What is glaucoma?
5. Explain glaucoma.
6. What is the trabecular meshwork?
7. What is open angle glaucoma?
8. What is closed angle glaucoma?
9. What is the most common treatment for glaucoma?
10. What is the most common eye drop to treat glaucoma?

Results : ChatGPT™ Flesch Kincaid average: 18.5 U.S. grade levels
ChatGPT™ Flesch Kincaid average*: 12.7 U.S. grade levels
P-value = 0.182

Q4 (264 words) and 5 (205 words) had different outputs in the “5th grade” version, compared to the adult version (309 words).

*Questions with the phrase “Tell me like I am in 5th grade.”

Conclusions : The answers generated by ChatGPT™ AI are excellent for ophthalmologists and patients with high school education and beyond. Comprehension may be difficult for the general lay public with glaucoma. However, this is an exciting new area for patient education.

This abstract was presented at the 2023 ARVO Annual Meeting, held in New Orleans, LA, April 23-27, 2023.

 

Figure 1. Flesch Kincaid Grade Level Data

Figure 1. Flesch Kincaid Grade Level Data

 

Figure 2. Flesch Kincaid Two-Sample T-Test

Figure 2. Flesch Kincaid Two-Sample T-Test

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×