April 2012
Volume 53, Issue 4
Free
Glaucoma  |   April 2012
Classification Algorithms Enhance the Discrimination of Glaucoma from Normal Eyes Using High-Definition Optical Coherence Tomography
Author Affiliations & Notes
  • Mani Baskaran
    From the 1Singapore National Eye Center and Singapore Eye Research Institute, Singapore; the 2University of Melbourne, Melbourne, Australia; the 3Department of Statistics and Applied Probability, National University of Singapore, Singapore; Johns Hopkins University, Baltimore, Maryland; and the Yong Loo Lin School of Medicine, National University of Singapore, Singapore.
  • Ee-Lin Ong
    From the 1Singapore National Eye Center and Singapore Eye Research Institute, Singapore; the 2University of Melbourne, Melbourne, Australia; the 3Department of Statistics and Applied Probability, National University of Singapore, Singapore; Johns Hopkins University, Baltimore, Maryland; and the Yong Loo Lin School of Medicine, National University of Singapore, Singapore.
  • Jia-Liang Li
    From the 1Singapore National Eye Center and Singapore Eye Research Institute, Singapore; the 2University of Melbourne, Melbourne, Australia; the 3Department of Statistics and Applied Probability, National University of Singapore, Singapore; Johns Hopkins University, Baltimore, Maryland; and the Yong Loo Lin School of Medicine, National University of Singapore, Singapore.
  • Carol Y. Cheung
    From the 1Singapore National Eye Center and Singapore Eye Research Institute, Singapore; the 2University of Melbourne, Melbourne, Australia; the 3Department of Statistics and Applied Probability, National University of Singapore, Singapore; Johns Hopkins University, Baltimore, Maryland; and the Yong Loo Lin School of Medicine, National University of Singapore, Singapore.
  • David Chen
    From the 1Singapore National Eye Center and Singapore Eye Research Institute, Singapore; the 2University of Melbourne, Melbourne, Australia; the 3Department of Statistics and Applied Probability, National University of Singapore, Singapore; Johns Hopkins University, Baltimore, Maryland; and the Yong Loo Lin School of Medicine, National University of Singapore, Singapore.
  • Shamira A. Perera
    From the 1Singapore National Eye Center and Singapore Eye Research Institute, Singapore; the 2University of Melbourne, Melbourne, Australia; the 3Department of Statistics and Applied Probability, National University of Singapore, Singapore; Johns Hopkins University, Baltimore, Maryland; and the Yong Loo Lin School of Medicine, National University of Singapore, Singapore.
  • Ching Lin Ho
    From the 1Singapore National Eye Center and Singapore Eye Research Institute, Singapore; the 2University of Melbourne, Melbourne, Australia; the 3Department of Statistics and Applied Probability, National University of Singapore, Singapore; Johns Hopkins University, Baltimore, Maryland; and the Yong Loo Lin School of Medicine, National University of Singapore, Singapore.
  • Ying-Feng Zheng
    From the 1Singapore National Eye Center and Singapore Eye Research Institute, Singapore; the 2University of Melbourne, Melbourne, Australia; the 3Department of Statistics and Applied Probability, National University of Singapore, Singapore; Johns Hopkins University, Baltimore, Maryland; and the Yong Loo Lin School of Medicine, National University of Singapore, Singapore.
  • Tin Aung
    From the 1Singapore National Eye Center and Singapore Eye Research Institute, Singapore; the 2University of Melbourne, Melbourne, Australia; the 3Department of Statistics and Applied Probability, National University of Singapore, Singapore; Johns Hopkins University, Baltimore, Maryland; and the Yong Loo Lin School of Medicine, National University of Singapore, Singapore.
  • Corresponding author: Tin Aung, Singapore National Eye Centre, 11 Third Hospital Avenue, Singapore 168751; [email protected]
Investigative Ophthalmology & Visual Science April 2012, Vol.53, 2314-2320. doi:https://doi.org/10.1167/iovs.11-8035
  • Views
  • PDF
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Mani Baskaran, Ee-Lin Ong, Jia-Liang Li, Carol Y. Cheung, David Chen, Shamira A. Perera, Ching Lin Ho, Ying-Feng Zheng, Tin Aung; Classification Algorithms Enhance the Discrimination of Glaucoma from Normal Eyes Using High-Definition Optical Coherence Tomography. Invest. Ophthalmol. Vis. Sci. 2012;53(4):2314-2320. https://doi.org/10.1167/iovs.11-8035.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Purpose: Toevaluate the diagnostic performance of classification algorithms based on Linear Discriminant Analysis (LDA) and Classification And Regression Tree (CART) methods, compared with optic nerve head (ONH) and retinal nerve fiber layer (RNFL) parameters measured by high-definition optical coherence tomography (Cirrus HD-OCT) for discriminating glaucoma subjects.

Methods: Consecutive glaucoma subjects (Training data = 184; Validation data = 102) were recruited from an eye center and normal subjects (n = 508) from an ongoing Singaporean Chinese population-based study. ONH and RNFL parameters were measured using a 200 × 200 scan protocol. LDA and CART were computed and areas under the receiver operating characteristic curve (AUC) compared.

Results: Average RNFL thickness (AUC 0.92, 95% confidence interval [CI] 0.91, 0.93), inferior RNFL thickness (AUC 0.92, 95% CI 0.91, 0.93), vertical cup–disc ratio (AUC 0.91, 95% CI 0.90, 0.92) and rim area/disc area ratio (AUC 0.90, 95% CI 0.86, 0.93) discriminated glaucoma better than other parameters (P ≤ 0.033). LDA (AUC 0.96, 95% CI 0.95, 0.96) and CART (0.98, 95% CI 0.98, 0.99) outperformed all parameters for diagnostic accuracy (P ≤ 0.005). Misclassification rates in LDA (8%) and CART (5.6%) were found to be low. The AUC of LDA for the validation data was 0.98 (0.95, 0.99) and CART was 0.99 (0.99, 0.994). CART discriminated mild glaucoma from normal better than LDA (AUC 0.94 vs. 0.99, P < 0.0001).

Conclusions: Classification algorithms based on LDA and CART can be used in HD-OCT analysis for glaucoma discrimination. The CART method was found to be superior to individual ONH and RNFL parameters for early glaucoma discrimination.

Introduction
Assessment of the retinal nerve fiber layer (RNFL) by optical coherence tomography (OCT) is widely used in the management of glaucoma patients. High-definition optical coherence tomography (HD-OCT) has recently been introduced, 14 and has advantages of increased resolution, accuracy, and repeatability of RNFL measurement over time-domain OCT. 5,6 The ability of time-domain OCT to discriminate glaucomatous discs from normals using optic nerve head (ONH) parameters has been found to be variable, and is affected by optic disc size, ethnicity, 713 stage of disease, 14 and artifacts in imaging. 9 Recently, Mwanza et al. 15 evaluated the diagnostic performance of HD-OCT (Cirrus software version 5.0, Carl Zeiss Meditec, Dublin, CA), which included both ONH and RNFL analysis. They reported that individual ONH and RNFL parameters showed similar diagnostic ability (area under the receiver operator characteristic [ROC] curves [AUCs] ranging from 0.89 to 0.96) in discriminating glaucomatous from normal eyes. 
Classifiers use algorithms and statistical methods that allow “learning” to use multiple variables in decision-making. Researchers have utilized methods such as Linear Discriminant Analysis (LDA), 16 Artificial Neural Networks (ANN), 17 and Classification And Regression Tree (CART) 17 to enhance the performance of Heidelberg Retinal Tomography (HRT) and time-domain OCT for glaucoma detection, which were found to have consistently better performances with such algorithms compared with individual ONH and RNFL parameters for glaucoma prediction. 
The purpose of this study was to evaluate the diagnostic performance of individual ONH and RNFL parameters derived from Cirrus HD-OCT for discriminating glaucomatous from normal eyes, and to compare these with classification algorithms using LDA and CART methods. 
Methods
This was a diagnostic study of consecutive glaucoma subjects who underwent Cirrus HD-OCT (Version 4.5.1.1, Carl Zeiss Meditec Inc.) at a Singapore eye hospital between August and September 2010. Normal subjects were consecutively recruited from an ongoing Singapore Chinese population-based study during this period. The study had the approval of the institutional review board of the hospital and the study adhered to the tenets of the Declaration of Helsinki. Written informed consent was obtained from all subjects. 
Glaucoma subjects were those identified with glaucomatous optic neuropathy (having typical rim notching or thinning, retinal nerve fiber layer defects or disc hemorrhage, and/or disc asymmetry between eyes) with corresponding visual field changes on reliable threshold visual field examination (SITA Standard central 24-2 algorithm, Humphrey; Carl Zeiss Meditec Inc.). The latter was defined as glaucoma hemifield test (GHT) results outside normal limits, and with three or more nonedge contiguous points (except the horizontal nasal meridian) depressed to P < 5%. Reliable visual fields were defined as fixation losses less than 20% and false positive and false negative errors less than 33%. Glaucoma subjects were further classified as mild (mean deviation [MD] ≥ −6 decibels [dB]), moderate (−6 dB ≥ MD ≥ −12 dB) and severe (< −12 dB) according to visual field MD Clinical data such as intraocular pressure (IOP) measured by Goldmann applanation tonometry, gonioscopy, type of glaucoma, vertical cup-to-disk ratio (CDR), and central corneal thickness (CCT) values were obtained from the charts. Subjects with high myopia (≤ −6 DS), unreliable visual fields, poor image quality for Cirrus HD-OCT scans (defined as signal strength <6, or image acquisition artifacts such as discontinuity, or blink artifacts seen as breaks in the OCT scans), 15 as well as those with retinal diseases such as moderate to severe diabetic retinopathy and age-related macular degeneration were excluded. Optic disc abnormalities due to other causes such as myelinated nerve fibers, anterior ischemic optic neuropathy, grossly tilted discs, or optic disc drusen were also excluded. Type of glaucoma was further classified as primary open angle glaucoma (with IOP > 21 mm Hg), normal tension glaucoma (with IOP never recorded above 21 mm Hg), primary angle closure glaucoma (with established angle closure signs such as previous laser peripheral iridotomy or peripheral anterior synechiae), and secondary glaucoma (based on signs of pseudoexfoliation or pigment dispersion) apart from the above definition of glaucoma. 
The control group of normal subjects were recruited from an ongoing population-based study of ethnic Chinese aged 40–80+ years, the Singapore Chinese Eye Study (SCES). 18 Normal subjects had IOP < 21 mm Hg with open angles, healthy optic discs on stereobiomicroscopic disc examination and normal visual fields (defined as MD and pattern standard deviation [PSD] within 95% confidence limits, and GHT within normal limits), no previous ocular surgery, and with no family history of glaucoma. The inclusion and exclusion criteria for visual field tests and Cirrus HD-OCT scans followed protocols similar to those in the glaucoma group and consecutive normal subjects were included for analysis in this study. Two age, sex, ethnicity, and severity-matched glaucoma data sets were collected separately, one for training the classification-based algorithms and one for validation. 
Cirrus HD-OCT Imaging
ONH and RNFL parameters were measured with the optic disc cube 200 × 200 scan protocol using Cirrus HD-OCT (software version 5.0.0). The method of scan acquisition adhered to standard protocol described in the manufacturer's manual. In brief, the subjects were scanned after dilation with 1% tropicamide solution. After positioning the subject, the line scan was focused onto the optic nerve head by adjusting for the refractive error using the mouse alignment. The Z-offset and polarization optimization were performed using mouse-alignment protocols. The laser scanned a 6 × 6 mm cube centered on ONH acquiring the data required. Care was taken to obtain good signal strength for the scans and the best image stored. The RNFL parameters were measured from a circle with diameter 3.46 mm, which is centered on the optic disc. The output from the version 5.0.0 included average RNFL thickness, RNFL thickness for the four quadrants (superior, inferior, temporal, and nasal), and individual clock hour thicknesses (clock hours 1−12). The clock hours 11 for the right eye and 1 for the left eye were grouped as superotemporal thickness (clock hour 11/1) and 7 for the right eye and 5 for the left eye were grouped as inferotemporal thickness (clock hour 7/5) for analysis. Similar grouping was done for all clock hour RNFL thickness data to represent nasal and temporal clock hours for the purpose of analysis. The symmetry readout was another parameter included as a measure of RNFL symmetry between the two eyes of each subject in the analysis. The ONH parameters selected for analysis included rim area, disc area, vertical CDR, and average CDR. The ratio of rim area/disc area was manually computed for all subjects and included in the analysis as a measure adjusting for variation in disc area. Signal strength was included to evaluate the quality of the image acquired. 
Statistical Analysis
If both eyes were eligible, one eye was randomly selected for analysis in the study. Statistical analysis was performed using R software (version 2.4.0, provided in the public domain by R Foundation for Statistical Computing, Vienna, Austria; available at http://www.r-project.org/) and a commercial software package (PASW version 18.0; SPSS Inc., Chicago, IL). Categorical variables between groups were compared using a chi-square test for proportions and numeric variables were compared using Student's t-test for independent samples. One-way ANOVA with Bonferroni correction was performed to compare variables between various glaucoma diagnoses. The areas under the ROC curves (AUCs) for individual ONH and RNFL parameters were computed on their ability to discriminate glaucomatous from normal eyes. 
Linear Discriminant Analysis (LDA) and Classification And Regression Tree (CART) methods were used for automated classification of glaucoma using all the ONH and RNFL parameters tested. The LDA assumes a Gaussian distribution and defines linear discrimination boundaries between the categories, where it maximizes the variance between classes while minimizing the variance within classes, giving the best fit Linear Discriminant Function (LDF). 19 The CART method is a decision tree learning technique that produces either classification or regression trees. The CART makes no assumption on the distribution of the data and applies a set of rules to split each node of a tree, decide when a tree is complete, assign each terminal node a class outcome, and select the “right-sized tree.” It leads to the best classification based on a minimum set of variables. The CART method has inherent training and testing methods for the given sample. 20 For LDA and CART, we had conducted 10-fold cross-validation to examine the out-sample performance of these classifiers. Specifically, we split the whole data into 10 subsets at random and formed separate training samples and test samples. We then evaluated the accuracy of the test samples by using the classification rule constructed from the training samples. Finally, we took the sample average of the AUC values from the test samples. The cross-validated AUC provides a reasonable estimate for the classification accuracy for future analysis. 
For comparing the AUC values, we considered the bootstrap resampling method. Specifically, we took random samples with replacement from the original data and formed bootstrap samples. The AUC values for various parameters based on the bootstrap samples were computed and used in the bootstrap tests. Similar methods were used for the validation data set. 
Comparison of independent ROC curves was performed between individual parameters and algorithm-derived functions. Misclassification rates were reported as the proportion of total number of false positives and false negatives among the total number of eyes used. 
Results
Out of the 196 glaucoma subjects selected for the training data set, 12 subjects were excluded for the following reasons: missing visual field data (1 eye), image artifacts (6 eyes), and high myopia (5 eyes), leaving 184 glaucoma subjects (93.9%) in the final analysis. Of 104 eyes selected for the validation data set, 2 eyes were excluded due to high myopia. 
The majority of the subjects in the glaucoma group of the training data were Chinese (157/184, 85.3%). Comparing the glaucoma subjects with normal controls, those with glaucoma were older, had thinner CCT, larger vertical CDR, and a smaller MD and greater PSD (P < 0.0001, Table 1). The baseline clinical parameters of the validation data were comparable for age, sex, ethnicity, vertical CDR, and visual field indices (P > 0.05, Table 1). 
Table 1.
 
Comparison of Demographic and Clinical Characteristics between Normal and Glaucoma Subjects
Table 1.
 
Comparison of Demographic and Clinical Characteristics between Normal and Glaucoma Subjects
Parameter Normal (n = 508)*, Mean (SD) Glaucoma (training) (n = 184), Mean (SD) Glaucoma (validation) (n = 102), Mean (SD) P Value†
Age (years) 52.7 (6.2) 65 (11.6) 67.5 (11.1) 0.0001
Sex (Male:Female) 275:232 106:79 62:40 0.49
Ethnicity (Chinese:Malay:Indian:Others) 508:0:0:0 157:14:9:4 90:6:3:3 0.0001
Laterality of Eye (Right Eye:Left Eye) 249:259 100:84 48:54 0.19
Central Corneal Thickness (CCT) (μm) 556 (33.4) 528.3 (33.1) 530.3 (35.5) 0.0001
Vertical cup-disc ratio (Clinical) 0.39 (0.11) 0.78 (0.14) 0.77 (0.14) 0.0001
Mean Deviation (dB) −0.7 (1.2) −8.1 (13.67) −9.04 (7.33) 0.0001
Pattern Standard Deviation (dB) 1.59 (0.38) 6.95 (10.43) 6.29 (4.22) 0.0001
The majority of the glaucoma subjects were diagnosed to have primary open angle glaucoma (POAG, 126, 68.5%) followed by primary angle closure glaucoma (PACG, 48, 26.1%) and secondary glaucoma (10, 5.4%). POAG included 56 normal tension glaucoma (NTG) subjects. NTG subjects did not differ in terms of disc area or symmetry, whereas they had higher average RNFL thickness, larger vertical CDR, and a higher MD compared with POAG (P < 0.0001, one-way ANOVA with Bonferroni correction). Based on visual field MD, there were 108 subjects with mild glaucoma, 58 with moderate glaucoma, and 18 with severe glaucoma. The signal strength of scans in the normal group was higher than that of the glaucoma group. All the parameters including average RNFL thickness, rim area, vertical CDR, and cup volume were significantly different between normal and glaucomatous eyes (Table 2). Disc area was found to be significantly larger in glaucomatous eyes (1.97 vs. 2.12 mm2; P < 0.0001) compared with controls. 
Table 2.
 
Comparison of Optic Nerve Head and Retinal Nerve Fiber Layer Parameters between Normal and Glaucoma Subjects
Table 2.
 
Comparison of Optic Nerve Head and Retinal Nerve Fiber Layer Parameters between Normal and Glaucoma Subjects
Parameter Normal (n = 508), Mean (SD) Glaucoma (n = 184), Mean (SD) P Value
Signal strength 8.6 (0.99) 6.02 (1.23) <0.0001
Average RNFL thickness (μm) 97.99 (9.1) 73.98 (15.05) <0.0001
Superior RNFL thickness (μm) 123.39 (16.02) 88.78 (23.08) <0.0001
Inferior RNFL thickness (μm) 127.37 (15.98) 83.77 (26.25) <0.0001
Symmetry 0.72 (0.34) 0.49 (0.35) <0.0001
Rim area (mm2) 1.3 (0.23) 0.84 (0.35) <0.0001
Disc area (mm2) 1.97 (0.37) 2.12 (0.45) <0.0001
Vertical cup–disc ratio 0.49 (0.12) 0.73 (0.12) <0.0001
Average cup–disc ratio 0.55 (0.12) 0.75 (0.12) <0.0001
Cup volume (mm3) 0.17 (0.13) 0.49 (0.34) <0.0001
Rim area/disc area ratio 0.68 (0.13) 0.17 (0.01) <0.0001
Table 3 shows the comparison of AUCs for various ONH and RNFL parameters in discriminating glaucoma from normal, whereas Table 4 shows the comparison between mild and moderate glaucomas. Average RNFL thickness (AUC0.92), inferior RNFL thickness (0.92), vertical CDR (0.91), and rim area/disc area ratio (0.90) showed excellent AUCs compared with other parameters (P < 0.0001). Disc area showed poor discrimination between normal and glaucomatous eyes. Superotemporal (clock hour 1) thickness (AUC 0.62) and inferotemporal (clock hour 5) thickness (AUC 0.81) were not found to be robust parameters for discrimination. All the parameters performed less well (AUC < 0.90) for mild glaucoma discrimination, whereas almost all except disc area performed excellently (AUC > 0.90) for moderate glaucomas. Similar results were obtained for discrimination of mild versus moderate glaucomas except for inferior RNFL thickness and vertical CDR, which showed AUC > 0.90. We had not included the diagnostic performance for severe glaucomas separately due to small sample size. Figure 1 depicts the comparison of AUC among the ONH and RNFL parameters in discriminating glaucomatous eyes from normal eyes, suggesting that both performed equally well in our study. 
Table 3.
 
Area under the Curve for Spectral-Domain Optical Coherence Tomography (OCT) Parameters (Optic Disc and RNFL Thickness), Linear Discriminant Function and CART in Detecting Glaucoma (n = 184)
Table 3.
 
Area under the Curve for Spectral-Domain Optical Coherence Tomography (OCT) Parameters (Optic Disc and RNFL Thickness), Linear Discriminant Function and CART in Detecting Glaucoma (n = 184)
Parameter AUC for Glaucoma Diagnosis (95% CI) Clock Hour RNFL Thickness AUC for Glaucoma Diagnosis (95% CI)
Average RNFL thickness (μm) 0.92 (0.91, 0.93)1a Clock hour 1* 0.62 (0.60, 0.64)
Superior RNFL thickness (μm) 0.89 (0.88, 0.90) Clock hour 2 0.77 (0.76, 0.78)
Inferior RNFL thickness (μm) 0.92 (0.91, 0.93)1a Clock hour 3 0.86 (0.85, 0.87)
Symmetry 0.76 (0.72, 0.79) Clock hour 4 0.79 (0.78, 0.80)
Rim area (mm2) 0.88 (0.87, 0.89) Clock hour 5 0.81 (0.80, 0.82)
Disc area (mm2) 0.60 (0.58, 0.62) Clock hour 6 0.70 (0.68, 0.72)
Vertical cup–disc ratio 0.91 (0.90, 0.92)1b Clock hour 7 0.52 (0.50, 0.54)
Average cup–disc ratio 0.89 (0.88, 0.90) Clock hour 8 0.61 (0.59, 0.63)
Cup volume (mm3) 0.84 (0.80, 0.88) Clock hour 9 0.83 (0.82, 0.84)
Rim area/disc area ratio 0.90 (0.86, 0.93)1b Clock hour 10 0.88 (0.87, 0.89)
LDF† 0.955 (0.947, 0.963)2 Clock hour 11 0.87 (0.86, 0.88)
CART† 0.982 (0.975, 0.991)2 Clock hour 12 0.70 (0.68, 0.72)
Table 4.
 
Comparison of Area under the Receiver Operating Characteristic Curve for Mild and Moderate Types of Glaucoma
Table 4.
 
Comparison of Area under the Receiver Operating Characteristic Curve for Mild and Moderate Types of Glaucoma
Parameter AUC for Normal vs. Mild Glaucoma Diagnosis (95% CI), (n = 108) AUC for Normals vs. Moderate Glaucoma Diagnosis (95% CI), (n = 58) AUC for Mild vs. Moderate Glaucoma Diagnosis (95% CI)
Average RNFL thickness (μm) 0.89 (0.88, 0.90) 0.94 (0.92, 0.96) 0.89 (0.88, 0.90)
Superior RNFL thickness (μm) 0.87 (0.85, 0.89) 0.91 (0.89, 0.93) 0.86 (0.84, 0.87)
Inferior RNFL thickness (μm) 0.88 (0.86, 0.90) 0.96 (0.95, 0.97) 0.92 (0.91, 0.93)
Rim area (mm2) 0.85 (0.83, 0.87) 0.91 (0.90, 0.92) 0.87 (0.86, 0.88)
Disc area (mm2) 0.61 (0.58, 0.64) 0.61 (0.59, 0.63) 0.59 (0.57, 0.62)
Vertical cup–disc ratio 0.89 (0.87, 0.92) 0.95 (0.93, 0.97) 0.91 (0.89, 0.92)
Average cup–disc ratio 0.87 (0.85, 0.89) 0.92 (0.90, 0.94) 0.87 (0.86, 0.88)
Rim area/disc area ratio 0.88 (0.86, 0.89) 0.93 (0.91, 0.95) 0.88 (0.86, 0.89)
LDF 0.94 (0.93, 0.95) 0.98 (0.97, 0.99)
CART 0.99 (0.98, 0.99) 0.99 (0.98, 1.00)
Figure 1.
 
Area under the receiver operating characteristic curves (AUC) for selected OCT parameters are depicted here for comparison: average RNFL thickness (AUC 0.92), inferior RNFL thickness (AUC 0.92), rim area (AUC 0.88), and vertical cup–disc ratio (AUC 0.91), showing that the RNFL and ONH parameters perform equally for discrimination of glaucoma.
Figure 1.
 
Area under the receiver operating characteristic curves (AUC) for selected OCT parameters are depicted here for comparison: average RNFL thickness (AUC 0.92), inferior RNFL thickness (AUC 0.92), rim area (AUC 0.88), and vertical cup–disc ratio (AUC 0.91), showing that the RNFL and ONH parameters perform equally for discrimination of glaucoma.
The equation derived from LDA is provided here:    
When this equation was used to derive the LDF, it showed an AUC of 0.96 (95% CI, 0.95, 0.96) for diagnosing glaucoma and had a misclassification rate of 8% (54/692). The LDF misclassified 47 subjects as having mild glaucoma (Normal, 7; other stages of glaucoma, 40), 6 as having moderate glaucoma (other stages of glaucoma, 6), and 1 as having severe glaucoma (other stage of glaucoma, 1). The CART analysis showed an AUC of 0.98 (95% CI, 0.98, 0.99) and a misclassification rate of 5.6% (39/692). The CART was the best method among all the parameters (and LDF) for discrimination of normal versus overall glaucoma diagnosis (P < 0.0001; Table 3, Fig. 2). Figure 3 shows the flow chart depicting the CART used for discrimination of normal versus overall glaucoma diagnosis. The CART method used inferior RNFL thickness, vertical CDR, average RNFL thickness, superior RNFL thickness, disc area, cup volume, symmetry, and nasal RNFL thickness for the classification. The CART method was also uniformly excellent in performance for both mild and moderate forms of glaucoma discrimination, compared with the diagnostic accuracy of the individual ONH and RNFL parameters (P < 0.007; Table 4). The CART misclassified 35 subjects as having mild glaucoma (Normal, 15; other stages of glaucoma, 20), 3 as having moderate glaucoma (other stages of glaucoma, 3), and 1 as having severe glaucoma (other stage of glaucoma, 1). The LDF performed less well in the discrimination of normal versus mild glaucoma compared with CART (P < 0.0001, Table 4). 
Figure 2.
 
AUCs for selected parameters are depicted here for comparison: average RNFL thickness (AUC 0.92), rim/disc area ratio (AUC 0.90), Linear Discriminant Analysis (LDA, AUC 0.96), and Classification And Regression Tree method (CART, AUC 0.98), showing LDA and CART performing better than individual parameters.
Figure 2.
 
AUCs for selected parameters are depicted here for comparison: average RNFL thickness (AUC 0.92), rim/disc area ratio (AUC 0.90), Linear Discriminant Analysis (LDA, AUC 0.96), and Classification And Regression Tree method (CART, AUC 0.98), showing LDA and CART performing better than individual parameters.
Figure 3.
 
Flow chart depicting the CART cutoff values used for discrimination between normal and glaucomatous eyes.
Figure 3.
 
Flow chart depicting the CART cutoff values used for discrimination between normal and glaucomatous eyes.
The AUC of LDA for the validation data set was 0.98 (0.95, 0.99) and CART was 0.99 (0.99, 0.994). 
Discussion
To the best of our knowledge, this is the first study highlighting the superiority of classification algorithms derived from LDA and CART analysis methods for discriminating glaucomatous from normal eyes with Cirrus HD-OCT, using both ONH and RNFL parameters. The CART method also consistently performed better for mild and moderate glaucomas, compared with LDF and the individual OCT parameters. 
We demonstrated that the diagnostic performance of ONH and RNFL parameters measured by HD-OCT in discriminating glaucoma from normals was comparable, and is in agreement with an earlier publication by Mwanza et al. 15 The latter demonstrated slightly higher but insignificant difference in AUCs for ONH parameters, such as vertical rim thickness (0.96) and rim area (0.96) compared with inferior RNFL thickness, RNFL thickness at 7 clock hour position, and average RNFL thickness (0.95), among 73 glaucoma and 146 age-matched normal subjects. We demonstrated slightly lower AUCs for both ONH and RNFL parameters in our study. Our study did not have strict age matching between groups and the distribution of disease severity was different from their study (Mild: 58.7% vs. 42.5%; Moderate: 31.5% vs. 19.1%; Severe: 9.8% vs. 38.4%). The high AUC levels seen with superotemporal and inferotemporal clock hour RNFL thicknesses were also not demonstrated, which might be attributed to the lower prevalence of focal glaucomatous defects in our cohort. 
Previous studies have shown that optic disc size and glaucoma severity influence the diagnostic performance of OCT. It has been reported that the optic disc size in Asian eyes is larger than that in white Americans. 21,22 Similarly, the disc area (1.93 vs. 1.83 mm2) was larger for normal subjects in our study compared with normal subjects in the article by Mwanza et al., 15 whereas the rim area was similar (1.3 vs. 1.27 mm2). Rao et al. 23 found that optic disc size did not influence any of the scanning protocols in spectral-domain OCT (RTVue; Optovue, Inc., Fremont, CA) but the sensitivity of the rim area increased and the specificity decreased with larger optic discs. They also noted that disease severity affected AUCs for various parameters. Similarly, Leite and colleagues 24 observed that subjects with severe visual field loss, represented by lower visual field index, had better AUC for RNFL parameters in detecting glaucoma. We had a greater number of patients with mild glaucoma in our study sample compared with that in the article by Mwanza et al. 15 Thus, differences in optic disc topography due to ethnic differences as well as varying disease severity may have influenced the differences in diagnostic performance of individual parameters in our study. We also found a larger disc area in glaucomatous eyes compared with normals (1.97 vs. 2.12 mm2, P < 0.0001). Xiao et al. 25 noted similar findings in 52 consecutive unilateral glaucomatous eyes compared with the normal fellow eyes in a clinic-based Chinese population. 
Few studies have evaluated ONH parameters measured by spectral domain/high-definition OCT compared with RNFL parameters for the diagnosis of glaucoma. 3,4,14,15 Classification algorithms 11,16,17,26,27 have used both these parameters in the diagnosis of glaucoma, using OCT and HRT with a view to improve diagnostic accuracy. Medeiros et al. 11 reported better diagnostic performance for LDA compared with inferior RNFL thickness, which had the best AUC in isolated parameter analysis (0.97 vs. 0.91; P = 0.012). Pablo et al. 16 used only ONH parameters and included disc area and horizontal rim width in their LDA, which performed slightly better than vertical rim area (AUC 0.92 vs. 0.9, P > 0.05). Naithani et al. 17 reported the performance of both LDF and CART derived from time-domain OCT parameters to be similar (0.98) and found them to do better than Heidelberg retina tomography–derived discriminant functions. Manassakorn et al. 27 found that in a group of 65 patients with glaucoma, the CART method used inferior RNFL thickness and vertical CDR and achieved the best misclassification rate of 6.2%. In our study, we found that vertical CDR, average RNFL thickness, and inferior RNFL thickness had the best AUC and the classifying algorithms performed better than the isolated parameters in diagnosis of glaucoma. 
Our study has several limitations. There were age, CCT, and ethnic group differences between normal and glaucoma subjects. However, when subanalysis of Chinese glaucoma subjects alone was performed, we found no difference in the AUCs for the various parameters tested (data not shown). The clinical diagnosis of glaucoma was based on optic disc findings and this might be one of the reasons for the higher AUCs observed. However, this need not affect our aim of comparison between methods used in our study. The severity of glaucoma was based on arbitrary nonlinear divisions of the Humphrey visual field data. There were relatively few subjects with severe glaucoma, limiting our ability to compare AUCs for this group. Most studies have found higher AUCs for discriminating severe glaucoma from normals using isolated OCT parameters. 14,15,23,24  
In conclusion, we have used the Cirrus HD-OCT to evaluate classification algorithms against individual RNFL and ONH parameters for glaucoma detection. We found that the LDA and CART methods performed better than any single parameter, although CART performed better than all other parameters for mild or early glaucoma discrimination. The inclusion of such classifiers may enhance the diagnostic performance of HD-OCT for glaucoma discrimination. 
References
Leung CK, Lam S, Weinreb RN, . Retinal nerve fiber layer imaging with spectral-domain optical coherence tomography: analysis of the retinal nerve fiber layer map for glaucoma detection. Ophthalmology . 2010;117 (9):1684–1691. [PubMed]
Leung CK Ye C Weinreb RN . Retinal nerve fiber layer imaging with spectral-domain optical coherence tomography a study on diagnostic agreement with Heidelberg Retinal Tomograph. Ophthalmology . 2010;117 (2):267–274. [CrossRef] [PubMed]
Mansoori T Viswanath K Balakrishna N . Correlation between peripapillary retinal nerve fiber layer thickness and optic nerve head parameters using spectral domain optical coherence tomography. J Glaucoma . 2010;19 (9):604–608. [CrossRef] [PubMed]
Chen TC . Spectral domain optical coherence tomography in glaucoma: qualitative and quantitative analysis of the optic nerve head and retinal nerve fiber layer (an AOS thesis). Trans Am Ophthalmol Soc . 2009;107:254–281. [PubMed]
Leung CK Cheung CY Weinreb RN . Retinal nerve fiber layer imaging with spectral-domain optical coherence tomography: a variability and diagnostic performance study. Ophthalmology . 2009;116 (7):1257–1263. [CrossRef] [PubMed]
Hong S Kim CY Lee WS Seong GJ . Reproducibility of peripapillary retinal nerve fiber layer thickness with spectral domain Cirrus high-definition optical coherence tomography in normal eyes. Jpn J Ophthalmol . 2010;54 (1):43–47. [CrossRef] [PubMed]
Marsh BC Cantor LB WuDunn D . Optic nerve head (ONH) topographic analysis by stratus OCT in normal subjects: correlation to disc size, age, and ethnicity. J Glaucoma . 2010;19 (5):310–318. [PubMed]
Vessani RM Moritz R Batis L Zagui RB Bernardoni S Susanna R . Comparison of quantitative imaging devices and subjective optic nerve head assessment by general ophthalmologists to differentiate normal from glaucomatous eyes. J Glaucoma . 2009;18 (3):253–261. [CrossRef] [PubMed]
Ortega Jde L, Kakati B, Girkin CA. Artifacts on the optic nerve head analysis of the optical coherence tomography in glaucomatous and nonglaucomatous eyes. J Glaucoma . 2009;18 (3):186–191. [PubMed]
Min KH Seong GJ Hong YJ Kim CY . Optic nerve head topographic measurements and retinal nerve fiber layer thickness in physiologic large cups. Korean J Ophthalmol . 2005;19 (3):189–194. [CrossRef] [PubMed]
Medeiros FA Zangwill LM Bowd C Vessani RM Susanna RJr Weinreb RN . Evaluation of retinal nerve fiber layer, optic nerve head, and macular thickness measurements for glaucoma detection using optical coherence tomography. Am J Ophthalmol . 2005;139 (1):44–55. [CrossRef] [PubMed]
Schuman JS Wollstein G Farra T . Comparison of optic nerve head measurements obtained by optical coherence tomography and confocal scanning laser ophthalmoscopy. Am J Ophthalmol . 2003;135 (4):504–512. Erratum in: Am J Ophthalmol. 2003 Aug;136(2):following 403. [CrossRef] [PubMed]
Yüksel N Altintas O Ozkan B Karadag S Caglar Y . Discriminating ability of optical coherence tomography data in staging glaucomatous damage. Can J Ophthalmol . 2009;44 (3):297–307. [CrossRef] [PubMed]
Li S Wang X Li S Wu G Wang N . Evaluation of optic nerve head and retinal nerve fiber layer in early and advanced glaucoma using frequency-domain optical coherence tomography. Graefes Arch Clin Exp Ophthalmol . 2010;248 (3):429–434. [CrossRef] [PubMed]
Mwanza JC Oakley JD Budenz DL Anderson DR . Cirrus optical coherence tomography normative database study group. Ability of Cirrus SD-OCT optic nerve head parameters to discriminate normal from glaucomatous eyes. Ophthalmology . 2010;118 (2):241–248. [PubMed]
Pablo LE Ferreras A Pajarín AB Fogagnolo P . Diagnostic ability of a linear discriminant function for optic nerve head parameters measured with optical coherence tomography for perimetric glaucoma. Eye . 2010;24 (6):1051–1057. [CrossRef] [PubMed]
Naithani P Sihota R Sony P . Evaluation of optical coherence tomography and Heidelberg retinal tomography parameters in detecting early and moderate glaucoma. Invest Ophthalmol Vis Sci . 2007;48 (7):3138–3145. [CrossRef] [PubMed]
Lavanya R Jeganathan VS Zheng Y . Methodology of the Singapore Indian Chinese Cohort (SICC) eye study: quantifying ethnic variations in the epidemiology of eye diseases in Asians. Ophthalmic Epidemiol . 2009;16 (6):325–336. [CrossRef] [PubMed]
Anderson TW . An Introduction to Multivariate Statistical Analysis . Hoboken, NJ: John Wiley & Sons, Inc.; 2003:207–250.
Hastie T Tibshirani R Friedman J . The Elements of Statistical Learning: Data Mining, Inference, and Prediction. 2nd ed. New York: Springer; 2009:257–298.
Seider MI Lee RY Wang D Pekmezci M Porco TC Lin SC . Optic disk size variability between African, Asian, white, Hispanic, and Filipino Americans using Heidelberg retinal tomography. J Glaucoma . 2009;18 (8):595–600. [CrossRef] [PubMed]
Mansour AM . Racial variation of optic disc size. Ophthalmic Res . 1991;23 (2):67–72. [CrossRef] [PubMed]
Rao HL Leite MT Weinreb RN . Effect of disease severity and optic disc size on diagnostic accuracy of RTVue spectral domain Optical Coherence Tomograph in glaucoma. Invest Ophthalmol Vis Sci . 2011;52 (3):1290–1296. [CrossRef] [PubMed]
Leite MT Zangwill LM Weinreb RN . Effect of disease severity on the performance of Cirrus spectral-domain OCT for glaucoma diagnosis. Invest Ophthalmol Vis Sci . 2010;51 (8):4104–4109. [CrossRef] [PubMed]
Xiao GG Wu LL . Optic disc analysis with Heidelberg Retina Tomography III in glaucoma with unilateral visual field defects. Jpn J Ophthalmol . 2010;54 (4);305–309. [CrossRef] [PubMed]
Leung CK Chan WM Hui YL . Analysis of retinal nerve fiber layer and optic nerve head in glaucoma with different reference plane offsets, using optical coherence tomography. Invest Ophthalmol Vis Sci . 2005;46 (3):891–899. [CrossRef] [PubMed]
Manassakorn A Nouri-Mahdavi K Caprioly J . Comparison of retinal nerve fiber layer thickness and optic disc algorithms with optical coherence tomography to detect glaucoma. Am J Ophthalmol . 2006;141:105–115. [CrossRef] [PubMed]
Footnotes
 Supported in part by the National Medical Research Council and the National Research Foundation, Singapore.
Footnotes
 Disclosure: M. Baskaran, None; E.-L. Ong, None; J.-L. Li, None; C.Y. Cheung, None; D. Chen, None; S.A. Perera, None; C.L. Ho, None; Y.-F. Zheng, None; T. Aung, Carl Zeiss Meditec (R)
Figure 1.
 
Area under the receiver operating characteristic curves (AUC) for selected OCT parameters are depicted here for comparison: average RNFL thickness (AUC 0.92), inferior RNFL thickness (AUC 0.92), rim area (AUC 0.88), and vertical cup–disc ratio (AUC 0.91), showing that the RNFL and ONH parameters perform equally for discrimination of glaucoma.
Figure 1.
 
Area under the receiver operating characteristic curves (AUC) for selected OCT parameters are depicted here for comparison: average RNFL thickness (AUC 0.92), inferior RNFL thickness (AUC 0.92), rim area (AUC 0.88), and vertical cup–disc ratio (AUC 0.91), showing that the RNFL and ONH parameters perform equally for discrimination of glaucoma.
Figure 2.
 
AUCs for selected parameters are depicted here for comparison: average RNFL thickness (AUC 0.92), rim/disc area ratio (AUC 0.90), Linear Discriminant Analysis (LDA, AUC 0.96), and Classification And Regression Tree method (CART, AUC 0.98), showing LDA and CART performing better than individual parameters.
Figure 2.
 
AUCs for selected parameters are depicted here for comparison: average RNFL thickness (AUC 0.92), rim/disc area ratio (AUC 0.90), Linear Discriminant Analysis (LDA, AUC 0.96), and Classification And Regression Tree method (CART, AUC 0.98), showing LDA and CART performing better than individual parameters.
Figure 3.
 
Flow chart depicting the CART cutoff values used for discrimination between normal and glaucomatous eyes.
Figure 3.
 
Flow chart depicting the CART cutoff values used for discrimination between normal and glaucomatous eyes.
Table 1.
 
Comparison of Demographic and Clinical Characteristics between Normal and Glaucoma Subjects
Table 1.
 
Comparison of Demographic and Clinical Characteristics between Normal and Glaucoma Subjects
Parameter Normal (n = 508)*, Mean (SD) Glaucoma (training) (n = 184), Mean (SD) Glaucoma (validation) (n = 102), Mean (SD) P Value†
Age (years) 52.7 (6.2) 65 (11.6) 67.5 (11.1) 0.0001
Sex (Male:Female) 275:232 106:79 62:40 0.49
Ethnicity (Chinese:Malay:Indian:Others) 508:0:0:0 157:14:9:4 90:6:3:3 0.0001
Laterality of Eye (Right Eye:Left Eye) 249:259 100:84 48:54 0.19
Central Corneal Thickness (CCT) (μm) 556 (33.4) 528.3 (33.1) 530.3 (35.5) 0.0001
Vertical cup-disc ratio (Clinical) 0.39 (0.11) 0.78 (0.14) 0.77 (0.14) 0.0001
Mean Deviation (dB) −0.7 (1.2) −8.1 (13.67) −9.04 (7.33) 0.0001
Pattern Standard Deviation (dB) 1.59 (0.38) 6.95 (10.43) 6.29 (4.22) 0.0001
Table 2.
 
Comparison of Optic Nerve Head and Retinal Nerve Fiber Layer Parameters between Normal and Glaucoma Subjects
Table 2.
 
Comparison of Optic Nerve Head and Retinal Nerve Fiber Layer Parameters between Normal and Glaucoma Subjects
Parameter Normal (n = 508), Mean (SD) Glaucoma (n = 184), Mean (SD) P Value
Signal strength 8.6 (0.99) 6.02 (1.23) <0.0001
Average RNFL thickness (μm) 97.99 (9.1) 73.98 (15.05) <0.0001
Superior RNFL thickness (μm) 123.39 (16.02) 88.78 (23.08) <0.0001
Inferior RNFL thickness (μm) 127.37 (15.98) 83.77 (26.25) <0.0001
Symmetry 0.72 (0.34) 0.49 (0.35) <0.0001
Rim area (mm2) 1.3 (0.23) 0.84 (0.35) <0.0001
Disc area (mm2) 1.97 (0.37) 2.12 (0.45) <0.0001
Vertical cup–disc ratio 0.49 (0.12) 0.73 (0.12) <0.0001
Average cup–disc ratio 0.55 (0.12) 0.75 (0.12) <0.0001
Cup volume (mm3) 0.17 (0.13) 0.49 (0.34) <0.0001
Rim area/disc area ratio 0.68 (0.13) 0.17 (0.01) <0.0001
Table 3.
 
Area under the Curve for Spectral-Domain Optical Coherence Tomography (OCT) Parameters (Optic Disc and RNFL Thickness), Linear Discriminant Function and CART in Detecting Glaucoma (n = 184)
Table 3.
 
Area under the Curve for Spectral-Domain Optical Coherence Tomography (OCT) Parameters (Optic Disc and RNFL Thickness), Linear Discriminant Function and CART in Detecting Glaucoma (n = 184)
Parameter AUC for Glaucoma Diagnosis (95% CI) Clock Hour RNFL Thickness AUC for Glaucoma Diagnosis (95% CI)
Average RNFL thickness (μm) 0.92 (0.91, 0.93)1a Clock hour 1* 0.62 (0.60, 0.64)
Superior RNFL thickness (μm) 0.89 (0.88, 0.90) Clock hour 2 0.77 (0.76, 0.78)
Inferior RNFL thickness (μm) 0.92 (0.91, 0.93)1a Clock hour 3 0.86 (0.85, 0.87)
Symmetry 0.76 (0.72, 0.79) Clock hour 4 0.79 (0.78, 0.80)
Rim area (mm2) 0.88 (0.87, 0.89) Clock hour 5 0.81 (0.80, 0.82)
Disc area (mm2) 0.60 (0.58, 0.62) Clock hour 6 0.70 (0.68, 0.72)
Vertical cup–disc ratio 0.91 (0.90, 0.92)1b Clock hour 7 0.52 (0.50, 0.54)
Average cup–disc ratio 0.89 (0.88, 0.90) Clock hour 8 0.61 (0.59, 0.63)
Cup volume (mm3) 0.84 (0.80, 0.88) Clock hour 9 0.83 (0.82, 0.84)
Rim area/disc area ratio 0.90 (0.86, 0.93)1b Clock hour 10 0.88 (0.87, 0.89)
LDF† 0.955 (0.947, 0.963)2 Clock hour 11 0.87 (0.86, 0.88)
CART† 0.982 (0.975, 0.991)2 Clock hour 12 0.70 (0.68, 0.72)
Table 4.
 
Comparison of Area under the Receiver Operating Characteristic Curve for Mild and Moderate Types of Glaucoma
Table 4.
 
Comparison of Area under the Receiver Operating Characteristic Curve for Mild and Moderate Types of Glaucoma
Parameter AUC for Normal vs. Mild Glaucoma Diagnosis (95% CI), (n = 108) AUC for Normals vs. Moderate Glaucoma Diagnosis (95% CI), (n = 58) AUC for Mild vs. Moderate Glaucoma Diagnosis (95% CI)
Average RNFL thickness (μm) 0.89 (0.88, 0.90) 0.94 (0.92, 0.96) 0.89 (0.88, 0.90)
Superior RNFL thickness (μm) 0.87 (0.85, 0.89) 0.91 (0.89, 0.93) 0.86 (0.84, 0.87)
Inferior RNFL thickness (μm) 0.88 (0.86, 0.90) 0.96 (0.95, 0.97) 0.92 (0.91, 0.93)
Rim area (mm2) 0.85 (0.83, 0.87) 0.91 (0.90, 0.92) 0.87 (0.86, 0.88)
Disc area (mm2) 0.61 (0.58, 0.64) 0.61 (0.59, 0.63) 0.59 (0.57, 0.62)
Vertical cup–disc ratio 0.89 (0.87, 0.92) 0.95 (0.93, 0.97) 0.91 (0.89, 0.92)
Average cup–disc ratio 0.87 (0.85, 0.89) 0.92 (0.90, 0.94) 0.87 (0.86, 0.88)
Rim area/disc area ratio 0.88 (0.86, 0.89) 0.93 (0.91, 0.95) 0.88 (0.86, 0.89)
LDF 0.94 (0.93, 0.95) 0.98 (0.97, 0.99)
CART 0.99 (0.98, 0.99) 0.99 (0.98, 1.00)
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×