June 2020
Volume 61, Issue 7
Free
ARVO Annual Meeting Abstract  |   June 2020
Predicting Late Patients in Pediatric Ophthalmology Outpatient Clinic Using Machine Learning
Author Affiliations & Notes
  • Wei-Chun Lin
    Medical Informatics & Clinical Epidemiology, Oregon Health & Science University, Portland, Oregon, United States
  • Jimmy N/A Chen
    School of Medicine, Oregon Health & Science University, Portland, Oregon, United States
  • Michelle Hribar
    Medical Informatics & Clinical Epidemiology, Oregon Health & Science University, Portland, Oregon, United States
    Ophthalmology, Oregon Health & Science University, Portland, Oregon, United States
  • Michael F. Chiang
    Ophthalmology, Oregon Health & Science University, Portland, Oregon, United States
    Medical Informatics & Clinical Epidemiology, Oregon Health & Science University, Portland, Oregon, United States
  • Footnotes
    Commercial Relationships   Wei-Chun Lin, None; Jimmy Chen, None; Michelle Hribar, None; Michael Chiang, Inteleretina (Honolulu, HI) (I), Novartis (Basel, Switzerland) (C)
  • Footnotes
    Support  Supported by grants T15LM007088, R01EY19474, R00LM12238, and P30EY10572 from the National Institutes of Health (Bethesda, MD), and by unrestricted departmental funding from Research to Prevent Blindness (New York, NY).
Investigative Ophthalmology & Visual Science June 2020, Vol.61, 4293. doi:
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Wei-Chun Lin, Jimmy N/A Chen, Michelle Hribar, Michael F. Chiang; Predicting Late Patients in Pediatric Ophthalmology Outpatient Clinic Using Machine Learning. Invest. Ophthalmol. Vis. Sci. 2020;61(7):4293.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Purpose : As healthcare shifts towards value-based care, there has been an increased focus on providing efficient and cost-effective clinical services. An important barrier for clinic efficiency is a patient’s late arrival. Predicting which patients will be late can allow clinic schedulers to adjust and optimize the schedule to minimize the disruption of patient lateness. However, effectively predicting late patients is a challenging task due to a variety of factors that are associated with late arrival for appointments. The purpose of this study was to develop machine learning models to predict late patients in pediatric ophthalmology clinics at Oregon Health & Science University (OHSU) Casey Eye Institute.

Methods : The study data was collected from office visits from 2012 to 2018 at OHSU. Time-stamp and office visit data were extracted from the enterprise-wide clinical warehouse and used to calculate time-related variables. Patients who checked in more than 10 minutes after their scheduled appointment time were considered late. Models using random forest, gradient boosting machine (GBM), support vector machine (SVM), and logistic regression were developed to predict whether the patient would arrive late. We used 10-fold cross-validation to reduce over-fitting. Area under the curve-receiver operating characteristic (AUC-ROC) curve scores were used to evaluate the accuracy of the prediction models. We also ranked the importance of predictors based on the decrease in mean impurity in the GBM and random forest models.

Results : Figure 1 shows the ROC curves and AUC-ROC scores of four machine learning models for distinguishing late patients. The GBM had the best accuracy (AUC=0.654), sensitivity (66%), and specificity (64%). The random forest model had the second-best performance (AUC=0.652) followed by the logistic regression model (AUC=0.643) and SVM (AUC=0.639). The top three important predictors identified in the GBM model were clinic volume, patients arrived late in the previous visit, and previous exam length.

Conclusions : Machine learning model with secondary use of EHR data can be used to predict late patients with reasonable success. More work is needed to refine the models to improve accuracy. Late arrival prediction has implications for improving clinical scheduling efficiency and patient satisfaction.

This is a 2020 ARVO Annual Meeting abstract.

 

Figure 1: Late patient ROC curves of random forest, GBM, SVM, and logistic regression models.

Figure 1: Late patient ROC curves of random forest, GBM, SVM, and logistic regression models.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×