We evaluated initial reader pair agreement, before arbitration on VMA presence or absence, and on VMA width, FTMH, and ERM. Of 100 randomly selected scans, during initial grading, reader agreement was 77% for scans with final grading as “VMA absent” (n = 22) and 80% for scans with final grading as “VMA present” (n = 78), respectively. During initial grading, the primary reader pair agreed on 78%, 91%, and 75% of scans independently evaluated in parallel for the parameters “broad versus focal width of vitreous adhesion,” “FTMH,” and “ERM,” respectively. Accordingly, arbitration was not performed for these parameters on the corresponding scans. In the remaining scans, the initial reader pairs disagreed with one another, and arbitration was required on 22%, 9%, and 25% of scans for the parameters “broad versus focal width of vitreous adhesion,” “FTMH,” and “ERM,” respectively.
Reading Center team percent grading agreement was 97% for presence of VMA, 92% for broad versus focal width of vitreous adhesion, 95% for presence of FTMH, and 82% for presence of ERM. Reading Center team grading reproducibility was high for VMA, broad versus focal width of vitreous adhesion, FTMH, and ERM. Reading Center team qualitative grading reproducibility is shown in
Table 1.
For repeated Reading Center measurements of minimum FTMH width, the intraclass correlation was 0.89 (95% CI 0.85–0.93). For this measurement, the mean paired difference between grading team measurements was 34.4 μm (95% limits of agreement −149.5–218.2 μm,
P = 0.643,
Table 2).
During repeat grading, the primary reader pair agreed on 63%, 92%, and 77% of scans evaluated independently in parallel for the parameters “broad versus focal width of vitreous adhesion,” “FTMH,” and “ERM,” respectively. Accordingly, arbitration was not performed for these parameters on the corresponding scans. In the remaining scans during repeat grading, the initial reader pairs disagreed with each other, and arbitration was required on 37%, 8%, and 23% of scans for the parameters “broad versus focal width of vitreous adhesion,” “FTMH,” and “ERM,” respectively.