Abstract
Purpose :
Beginning January 26, 2022, the United States Medical Licensing Exam (USMLE) Step 1 changed from a numerical score to Pass/Fail (P/F). The purpose of this study was to determine the perspective of ophthalmology program directors regarding this change in evaluating applicants.
Methods :
After IRB approval, a survey was sent out to program directors of all 125 ophthalmology programs accredited by the Accreditation Council for Graduate Medical Education (ACGME). Survey questions asked for program demographics, the utility of USMLE Step 1 and 2 Clinical Knowledge (CK) scores in assessing applicants, and the importance of sixteen different applicant metrics before and after Step 1 becomes P/F. The metrics examined were: letters of recommendation; clerkship grades; class ranking; Alpha Omega Alpha (AOA) Membership; Gold Humanism Honor Society Membership; Dean’s Letter; involvement and leadership; personal statement; number of abstracts, presentations, and publications; mean number of research experiences in the specialty; Step 2 CK score; volunteering; preclinical grades; away rotation in the specialty; the applicant having another graduate degree; and graduation from a top 40 NIH funded program. Data were analyzed using non-overlapping 95% confidence intervals.
Results :
The survey was completed by 50 (40%) program directors. Sixty-eight percent of respondents stated that a student’s medical school ranking would be considered more after USMLE Step 1 scores become P/F, and 60% stated that medical schools should share clerkship National Board of Medical Examiners (NBME) shelf exam scores with residency programs. Program directors’ ranking of various applicant metrics did not change significantly following the transition to P/F Step 1. Letters of recommendation was considered the most crucial factor of applicant metrics, and graduation from a top 40 NIH funded program was considered the least important.
Conclusions :
Our data suggest that program directors do not plan to change their residency selection process following the transition to P/F Step 1. Though Step 2 CK will be the only remaining objective measure of an applicant, it did not appear to increase in importance. However, program directors would like to receive other objective measures as part of the application, such as NBME shelf exam scores and class ranking.
This abstract was presented at the 2023 ARVO Annual Meeting, held in New Orleans, LA, April 23-27, 2023.