April 2011
Volume 52, Issue 5
Free
Retina  |   April 2011
Automatic Characterization of Classic Choroidal Neovascularization by Using AdaBoost for Supervised Learning
Author Affiliations & Notes
  • Chia-Ling Tsai
    From the Computer Science Department, Iona College, New Rochelle, New York;
  • Yi-Lun Yang
    the ComputerScience and Information Engineering Department, National Chung Cheng University, Chiayi, Taiwan;
  • Shih-Jen Chen
    the Department of Ophthalmology, Taipei Veterans General Hospital, Taipei, Taiwan; and
    the School of Medicine, National Yang Ming University, Taipei, Taiwan.
  • Kai-Shung Lin
    the ComputerScience and Information Engineering Department, National Chung Cheng University, Chiayi, Taiwan;
  • Chih-Hao Chan
    the ComputerScience and Information Engineering Department, National Chung Cheng University, Chiayi, Taiwan;
  • Wei-Yang Lin
    the ComputerScience and Information Engineering Department, National Chung Cheng University, Chiayi, Taiwan;
  • Corresponding author: Shih-Jen Chen, Department of Ophthalmology, Taipei Veterans General Hospital, 112, Taipei, Taiwan 65506; [email protected]
Investigative Ophthalmology & Visual Science April 2011, Vol.52, 2767-2774. doi:https://doi.org/10.1167/iovs.10-6048
  • Views
  • PDF
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Chia-Ling Tsai, Yi-Lun Yang, Shih-Jen Chen, Kai-Shung Lin, Chih-Hao Chan, Wei-Yang Lin; Automatic Characterization of Classic Choroidal Neovascularization by Using AdaBoost for Supervised Learning. Invest. Ophthalmol. Vis. Sci. 2011;52(5):2767-2774. https://doi.org/10.1167/iovs.10-6048.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Purpose.: To provide a computer-aided visualization tool for accurate diagnosis and quantification of choroidal neovascularization (CNV) on the basis of fluorescence leakage characteristics.

Methods.: All image frames of a fluorescein angiography (FA) sequence are first aligned and mapped to a global space. To automatically determine the severity of each pixel in the global space and hence the extent of CNV, the system matches the intensity variation of each set of spatially corresponding pixels across the sequence with the targeted leakage pattern, learned from a sampled population graded by a retina specialist. The learning strategy, known as the AdaBoost algorithm, has 12 classifiers for 12 features that summarize the variation in fluorescence intensity over time. Given a new sequence, the severity map image is generated using the contribution scores of the 12 classifiers. Initialized with points of low and high severity, regions of CNV are delineated using the random walk algorithm.

Results.: A dataset of 33 FA sequences of classic CNV showed the average accuracy of CNV delineation to be 83.26%. In addition, the 30- to 60-second interval provided the most reliable information for differentiating CNV from the background. Using eight sequences of multiple visits of four patients for evaluation of the postphotodynamic therapy (PDT), the statistics derived from the segmented regions correlate closely with the clinical observed changes.

Conclusions.: The clinician can easily visualize the temporal characteristics of CNV fluorescence leakage using the severity map, which is a two-dimensional summary of a complete FA sequence. The computer-aided tool allows objective evaluation and computation of statistical data from the automatic delineation for surgical assessment.

In many developed countries, age-related macular degeneration (AMD) with the devastating complication of choroidal neovascularization (CNV) is the major cause of severe, irreversible vision loss. 1 The vascular nature of the CNV with hemorrhage, subretinal fluid, and retinal edema were best appreciated with the clinical diagnostic tools of fluorescein angiography (FA), indocyanine green angiography (ICGA), and optical coherent tomography (OCT). Although recent studies had shown the efficacy of OCT-guided anti-VEGF treatment in maintaining visual gain, 2 FA remains the standard tool for determining the components and size of CNV, which provide important secondary outcomes for interpretation of trial data and for exploration of the prognostic significance of baseline and follow-up fundus characteristics. 3,4  
Using FA, components of CNV (such as exudate, pigmentation, and fibrosis) can be easily identified based on the type and extent of leakage shown as areas of hyperfluorescence. Analysis and interpretation of retinal angiography are largely performed manually by skilled observers, and analysis is usually performed on single angiographic frames with graded categorical methods (e.g., MPS circles)—without the quantitative knowledge of the rates of area and intensity changes, associated with the severity of leakage from abnormal vasculature. The process is also subjective with considerable observer variability, 5,6 laborious, error-prone, and inaccurate for image comparison. With the need to quantitatively analyze large volumes of angiographic data for clinical studies, digital image processing methodologies are used for more efficient and accurate processing of fundus images. 7,8  
Computerized analyses often need localization (segmentation) of CNV as the prerequisite for quantification and comparison. In this article, we propose an algorithmic approach to automatically determining the severity and hence the extent of CNV by exploiting the typical temporal leakage characteristics of FA, learned from a sampled population graded by a retina specialist. According to the Macular Photocoagulation Study Group, 9 components of CNV exhibit distinct temporal leakage patterns. For classic CNV, distinct areas of hyperfluorescence (leakage) become noticeable within 30 seconds and expand and intensify toward the end of the angiogram. For occult CNV, the leakage is detected as indistinct areas of hyperfluorescence which can appear either early or late and intensify over time. The leakage characteristics of both types of CNV are confirmed again by Berger 10 using computerized, spatiotemporal image analysis. By learning the typical leakage pattern of a certain CNV type, our system can map the intensity variation of a set of spatially corresponding pixels of the same physical point across the sequence to the targeted leakage pattern for computation of severity—the closer the match to the targeted pattern, the more severely affected is the corresponding physical point. 
The objective of our proposed system is twofold (1) to automatically generate a CNV severity map using the dynamic aspects of the complete angiogram, and (2) to automatically segment the area(s) of CNV using the severity map. Both the severity map and the segmentation result can serve as references to reduce grader variability. 
Materials and Methods
The image database consists of 33 single-visit FA sequences for CNV examination and 8 multiple-visit sequences of four patients (2 from each patient) for post-photodynamic therapy (PDT) evaluation. All sequences are categorized as classic CNV and contain multiple images in each of the early, mid, and late phases. The sequences are provided by the Taipei Veterans General Hospital, Taipei, Taiwan. All the patients who had FA or PDT had signed a consent form to be enrolled for the treatment and image study. 
The FA sequences were obtained by using a standard procedure. 11 In brief, color and red-free photographs were taken for both eyes before dye injection after pupil dilatation. The early phase consists of five to six images taken in the first 10 to 12 seconds after the dye starts to appear in the lesion eye and then three to four images in the first minute. The midphase consists of five to six images taken every minute in 2 to 5 minutes. The late phase includes images in the 8 to 10 minutes. The digital camera used in this study was a 50° digital fundus camera (TRC-50IA; Canon, Tokyo, Japan). The original resolution of the images is 2048 × 1360. Images were downsized to 512 × 340 in this study to reduce computation. 
To compute the temporal fluorescence behavior of spatially corresponding areas across the FA sequence, we have to first align the image frames to compensate for the saccadic eye motions or large eye movement for a wide field of view. The alignment technique we adopt is the edge-driven dual-bootstrap iterative closest point algorithm 12 with a quadratic transformation. The algorithm is fully automated and is geared toward alignment of images with substantial, nonlinear intensity changes, which are characteristics of FA images. The AdaBoost classifier 13 is trained by using sequences with spatially aligned frames for recognition of typical leakage characteristics of classic CNV. The outcome of classification for an unseen FA sequence is a color map reflecting the lesion severity, termed the severity map. Small samples of highly affected and nonaffected (background) points are automatically identified by using the severity map to initialize segmentation of CNV which can be valuable for clinical applications such as quantification of PDT effect. In the remaining part of the section, we will focus the discussion on generation of the severity map and segmentation of the CNV lesions. 
Generation of Severity Map
The main idea behind AdaBoost classification, introduced in 1995 by Freund and Schapire, 13 is to classify an instance based on an effective combination of a set of rough and weak classification rules. For a set of spatially corresponding pixels across the sequence, we describe the intensity variation of the fluorescence leakage using n features, where n ≤ 12, and build weak binary classifiers, {C 1, …, Cn }, one for each feature, to decide whether a pixel belongs to CNV or not. Combining the n classification results, the set of pixels is assigned a likelihood ratio of fitting the temporal profile of a CNV fluorescence leakage. 
As shown in Figure 1, characteristics of temporal fluorescence profile associated with classic CNV (plots in red) include fast increase in the fluorescence intensity in the early phase and very modest decrease in brightness for the remaining sequence. To fully describe the profile, we divide the sequence into five time intervals, as shown in Figure 1b: at 0 to 30, 30 to 60, 60 to 150, 150 to 300, and after 300 seconds. For each interval, the averages of the image gray-scale intensity in the range of [0, 255], where 0 is black and 255 is white, and the gray-scale intensity change (change in the intensity value per second) are computed. Both the intensity of each image pixel and the intensity change of corresponding pixels in two consecutive images are normalized to [0, 1] by subtracting the minimum value and dividing the difference by the range of the values, which is the difference between the maximum and the minimum values of the entire sequence. In addition to the features from individual intervals, linear least-squares regression is performed to provide the intercept (the initial intensity value) and slope (intensity change per second) of the straight line approximated using the time–intensity data points with the least-squares error, shown in Figure 1c. In summary, a 12-tuple feature vector is associated with a set of spatially corresponding pixels:   where sw and iw are the average intensity change and average intensity value, respectively, in interval w, and a and b are the slope and intercept, respectively, from linear regression. 
Figure 1.
 
Twelve features for classification. (a) Samples are chosen from the CNV lesion (red dots), the background or non-CNV tissues (blue dots), and the region just outside the CNV (green dots). (b) The temporal fluorescence profile of each sample point is divided into five intervals: 0 to 30, 30 to 60, 60 to 150, and 150 to 300, and after 300 seconds. Each interval provides two features: the average intensity value and the average intensity change. The red plots are drawn from CNV pixels, the blue plots from the background tissues, and the green plots from the background close to the CNV. (c) Each plot is also approximated using least-squares linear regression to find the straight line with the least-squares error to provide two more features: the intercept and the slope. Dotted lines: the typical linear regression lines of the three regions.
Figure 1.
 
Twelve features for classification. (a) Samples are chosen from the CNV lesion (red dots), the background or non-CNV tissues (blue dots), and the region just outside the CNV (green dots). (b) The temporal fluorescence profile of each sample point is divided into five intervals: 0 to 30, 30 to 60, 60 to 150, and 150 to 300, and after 300 seconds. Each interval provides two features: the average intensity value and the average intensity change. The red plots are drawn from CNV pixels, the blue plots from the background tissues, and the green plots from the background close to the CNV. (c) Each plot is also approximated using least-squares linear regression to find the straight line with the least-squares error to provide two more features: the intercept and the slope. Dotted lines: the typical linear regression lines of the three regions.
To train the classifier, a retina specialist manually segmented regions of CNV as the groundtruth for all 33 single-visit FA sequences. The training feature set X contains feature vectors of all points in the foreground (CNV) regions, and regularly spaced points from the background regions from all training sequences. The foreground and background point sets are of similar cardinalities. 
The AdaBoost classifier builds the weak classifiers sequentially, one in each round. The adaptive ability of AdaBoost comes from the fact that misclassified instances of the current weak classifier have stronger influence on subsequent classifiers. In each round, a distribution of weights over X is updated. The weights of those correctly classified instances are decreased, and the weights of those incorrectly classified instances are increased, so that the subsequent classifiers focus more on those misclassified instances. The details on AdaBoost training are included in the Appendix for interested readers. 
At the completion of AdaBoost training, each weak classifier Cj for feature j is associated with a 3-tuple vector (τ j , α j , β j ), where τ j is the optimal threshold for feature j, and α j and β j are the parameters for hj , which determines the contribution score from Cj :   where xk,j is the jth feature of the feature vector xk
The result of AdaBoost classification of the feature vector xk is the normalized sum of the contribution scores from all the weak classifiers considered:   F(k) is in the range of [0, 1] and is the indication of the degree of CNV severity, because it can be treated as the probability that the set of spatially corresponding pixels with feature vector xk matches the fluorescence leakage pattern of a CNV lesion. The severity map is displayed in color, as shown in Figure 2b. The red area indicates high severity of CNV, and the blue area indicates normal tissue. 
Figure 2.
 
The severity map and CNV delineation generated by the proposed computer-aided diagnosis system. (a) The region of CNV lesion, colored in yellow by the retina specialist. (b) The CNV severity map using AdaBoost classification displayed with a color map. (c) Automatic segmentation of the CNV lesion using the random walk algorithm, initialized by using seed points of very high and very low severity as the foreground (CNV) and background points, respectively. The accuracy of this sequence is 89.09% with 1.32% of oversegmentation and 15.37% of undersegmentation.
Figure 2.
 
The severity map and CNV delineation generated by the proposed computer-aided diagnosis system. (a) The region of CNV lesion, colored in yellow by the retina specialist. (b) The CNV severity map using AdaBoost classification displayed with a color map. (c) Automatic segmentation of the CNV lesion using the random walk algorithm, initialized by using seed points of very high and very low severity as the foreground (CNV) and background points, respectively. The accuracy of this sequence is 89.09% with 1.32% of oversegmentation and 15.37% of undersegmentation.
Segmentation of CNV Lesions
The severity map alone is valuable to the physician because the temporal characteristics of the leakage pattern are summarized across the sequence. To further quantify the progression of a disease, it is often necessary to perform delineation of the CNV lesions to compare measurements, such as the area and the leakage speed. 
We performed delineation on the image with the best boundary definition, using the random walks algorithm proposed by Grady. 14 The algorithm performs K-way image segmentation given a small number of predefined seed points with region labels. For our application, K is 2: one label for the foreground and one for the background. The algorithm was initially designed to be an interactive algorithm which demands samples of foreground and background points provided by the user. To avoid intersubject variability, our system automatically identifies the sample points using the severity map. The points with F(k) greater than 0.9 are the foreground points and the points with F(k) lower than 0.1 are the background points. The image for delineation can be chosen manually or automatically picked by the system. In our present study, the image is chosen automatically and is the one with the maximum intensity difference between foreground and the background sample points. 
For each unlabeled pixel, the random walks algorithm analytically determines a K-tuple vector, with each element storing the probability that a random walk starting at this pixel will first reach one of the corresponding prelabeled seed locations. The solution to the problem can be obtained by solving the circuit theory problem that corresponds to a combinatorial analog of the Dirichlet problem. 15 To begin with, the algorithm assigns a unit potential to foreground seed points and 0 to background seed points. The electrical potentials established at each unseeded node are equivalent to the probabilities generated by the random walker. The segmentation is achieved by assigning each pixel to the label with the greatest probability, and the CNV is the region with the foreground label. Figure 2c shows the result of random walks segmentation using the severity map in Figure 2b for initialization. 
Results
The performance of the system is analyzed with 33 single-visit FA sequences using the leave-one-out cross-validation strategy. Each sequence is tested with the AdaBoost classifier trained using the other 32 sequences. The number of weak classifiers involved is eight. It is hard to directly assess the correctness of the severity map, since the groundtruth cannot be easily generated. Instead, based on the understating that an accurate severity map leads to good segmentation, we measure the performance of the complete system in terms of over- and undersegmentation of CNV, comparing it against the manual segmentation, serving as the ground truth. Let Rg and Ra be the results of manual and automatic segmentation of image I, respectively. Each pixel is classified as one of the following: TP = RgRa, FP = Ra − (RgRa), TN = I − (RgRa), and FN = Rg (RgRa), where TP stands for true positive (CNV region correctly labeled); FP for false positive (background region incorrectly labeled); TN for true negative (background correctly labeled); and FN for false negative (CNV region incorrectly labeled). Over- and undersegmentations are measured respectively as:    OS is the fraction of the segmented CNV area which is the normal tissue, whereas US is the fraction of manually segmented CNV (ground truth) mistaken as the normal tissue by our system. The 2-D space defined by OS and US is a unit square S, where the ideal segmentation result is the point of origin in S, and the Euclidean norm of the 2-D space offers a measure of closeness to an ideal segmentation result. The accuracy of the system is defined as   The result is in the range of [0, 1]. Table 1 shows the experimental results of all 33 sequences. The average accuracy is 83.26%. Figures 3a and 3b are the result of a sequence with an accuracy of 94.37%, which comes from 1.42% of oversegmentation and 7.83% of undersegmentation. There are four sequences with the accuracy below 70%, three of which were severely undersegmented and one of which was oversegmented. For the cases of undersegmentation, there is usually an early hypofluorescent ring along the border that is shown to be a fibrin deposit and is defined as part of classic CNV16 by the retina specialist. As shown in Figure 3c, our system does not recognize the early hypofluorescent ring around the CNV, resulting in a lower accuracy of 66.81%, with no oversegmentation and 46.94% undersegmentation. This sequence was the one with the lowest accuracy in our validation set. The impact of the fibrin deposit was particularly profound on cases with small CNV lesions. 
Table 1.
 
Experimental Results on Delineation of Regions of CNV Using 33 FA Sequences of Classic CNV
Table 1.
 
Experimental Results on Delineation of Regions of CNV Using 33 FA Sequences of Classic CNV
TP (Pixels) FP (Pixels) FN (Pixels) Over-segmentation (%) Under-segmentation (%) Accuracy (%)
Case 01 2098 28 381 1.32 15.37 89.09
Case 02 3289 14 1140 0.42 25.74 81.80
Case 03 1880 297 87 13.64 4.42 89.86
Case 04 198 5 96 2.46 32.65 76.85
Case 05 1564 84 203 5.10 11.49 91.11
Case 06 312 33 19 9.57 5.74 92.11
Case 07 3840 312 323 7.51 7.76 92.36
Case 08 4774 1479 58 23.65 1.20 83.25
Case 09 191 0 169 0.00 46.94 66.81
Case 10 825 96 48 10.42 5.50 91.67
Case 11 474 26 0 5.20 0.00 96.32
Case 12 403 3 313 0.74 43.72 69.08
Case 13 689 16 389 2.27 36.09 74.43
Case 14 358 94 86 20.80 19.37 79.90
Case 15 1518 29 450 1.87 22.87 83.78
Case 16 357 1 30 0.28 7.75 94.51
Case 17 9134 132 776 1.42 7.83 94.37
Case 18 834 288 175 25.67 17.34 78.09
Case 19 1489 29 877 1.91 37.07 73.76
Case 20 2956 938 706 24.09 19.28 78.18
Case 21 322 9 124 2.72 27.80 80.25
Case 22 211 19 42 8.26 16.60 86.89
Case 23 2236 40 499 1.76 18.24 87.04
Case 24 647 216 48 25.03 6.91 81.64
Case 25 4774 58 34 1.20 0.71 99.01
Case 26 949 47 721 4.72 43.17 69.29
Case 27 353 82 7 18.85 1.94 86.60
Case 28 10725 743 2255 6.48 17.37 86.89
Case 29 4687 1064 1900 18.50 28.84 75.77
Case 30 407 0 63 0.00 13.40 90.52
Case 31 181 134 10 42.54 5.24 69.69
Case 32 932 0 520 0.00 35.81 74.68
Case 33 885 100 268 10.15 23.24 82.06
Average 83.26
Std Dev 8.69
Figure 3.
 
Examples of segmentation results. Top row: a case with 94.37% accuracy, resulting from 1.42% oversegmentation and 7.83% undersegmentation. Bottom row: one of the four sequences with accuracy below 70%. In this case, the accuracy is 66.81%, with no oversegmentation and 46.94% undersegmentation due to the presence of fibrin deposit, which was labeled as part of the CNV lesion by the retina specialist but was classified as the background by our system. (a, c) The automatically segmented regions are outlined in red and the ground truth in blue. (b, d) The corresponding severity maps.
Figure 3.
 
Examples of segmentation results. Top row: a case with 94.37% accuracy, resulting from 1.42% oversegmentation and 7.83% undersegmentation. Bottom row: one of the four sequences with accuracy below 70%. In this case, the accuracy is 66.81%, with no oversegmentation and 46.94% undersegmentation due to the presence of fibrin deposit, which was labeled as part of the CNV lesion by the retina specialist but was classified as the background by our system. (a, c) The automatically segmented regions are outlined in red and the ground truth in blue. (b, d) The corresponding severity maps.
Robustness of Classification Features
We also performed the analysis on the distinguishing power of the 12 classification features based on the order they were picked by the AdaBoost. A feature with high distinguishing power is unique for CNV and has low variability. For such a feature, it is easy to locate the proper threshold for the weak classifier, leading to lower error comparing to classifiers for features with high variability. The higher the distinguishing power of a feature, the earlier the associated weak classifier is chosen by the AdaBoost. 
In the leave-one-out validation process for the 33 sequences, we also recorded the order that the classifiers were chosen by the AdaBoost. The top four features in order are {i 2, s 2, i 3, i 5} with i 2, the strongest feature, and the bottom four features in order are {s 1, b, i 1, s 5} with s 5, the weakest feature. The order matches the expected temporal fluorescein fluorescence profile of CNV, as observed in Figure 1:
  •  
    The intensity value and intensity change for CNV differ substantially from the background in the 30- to 60-second interval.
  •  
    The fluorescence intensifies at about the same speed for most tissues and pathologies in the 0- to 30-second interval.
  •  
    The fluorescence intensities in general are much better indicators than changes in intensity.
It is not a surprise that better classification result can be obtained without the contributions from the last few weak classifiers since more noise than information is added to the AdaBoost classifier if the last few weak classifiers are considered. To validate our speculation, we performed the experiments using only six FA sequences that contain at least two images in each time interval. The best result is obtained using seven classifiers. Using too few or too many classifiers, where n < 6 or n > 10, the severity map is not good enough to properly initialize the segmentation process, which results in failed segmentation. Since not all sequences contain enough images in each time interval, we used eight weak classifiers to accommodate missing features in our present study.
Application in PDT Evaluation
It is confirmed in multiple studies that CNV quantification can be useful for the support of clinical trials and assessment of visual function after surgery. 7,17 We demonstrated the potential of our system in evaluation of the PDT effect by using the data from four patients, each having one sequence before treatment and one taken 1 month after treatment. All four pretreatment sequences are in our validation set of 33 sequences. To quantify the efficacy of a treatment with the aid of our system, for both pre- and posttreatment sequences, we derived two measurements of the delineated CNV areas before the surgery: average leakage speed and average severity value from the severity map. The leakage speed is a in the feature vector, which is the slope of the least-squares linear regression line. Reduction rates are computed from the pre- and posttreatment measurements and serve as indicators of treatment efficacy. The numbers are shown in Table 2. The measurements derived from the segmented regions correlate closely with the clinical observed changes. The patient with persistent CNV has much lower reduction rates comparing to patients without CNV after surgery. In both cases with complete CNV regression, the reduction rates for the leakage speed and severity value were comparable in the range of 80% to 95%. For the patient with fibrosis after treatment, the leakage speed reduced more than the severity value, which is the opposite for the patient with persistent but smaller CNV after treatment. The severity value decreased much more than the leakage speed. 
Table 2.
 
Quantification of PDT Efficacy
Table 2.
 
Quantification of PDT Efficacy
Average Leakage Speed (Intensity/sec) Average Severity (%) Average Leakage Speed/Severity Reduction Rates (%) Post-PDT Diagnosis
Case 30
    Pre-PDT 10.88 0.89 82.2/67.4 Fibrosis present
    Post-PDT 1.94 0.29
Case 32
    Pre-PDT 5.17 0.75 29.2/56.0 Persistent CNV
    Post-PDT 3.66 0.33
Case 33
    Pre-PDT 13.50 0.77 81.6/87.0 CNV eradicated
    Post-PDT 2.48 0.10
Case 18
    Pre-PDT 17.33 0.93 94.0/90.3 CNV eradicated
    Post-PDT 1.04 0.09
Discussion
In this article, we presented a system that generates a severity map and segments regions of classic CNV based on a learned temporal fluorescence profile using AdaBoost supervised learning. Different from many existing methods in the literature, our algorithm includes all image frames during both training and testing phases to maximize the amount of temporal information available for accurate labeling of regions that belong to CNV. Phillips et al. 18 manually register one early and one late angiographic frames for detection and quantification of leakage using thresholding on the rate of change in fluorescence over time. Since they limit the analysis to only two image frames, considerable temporal information is lost. Berger and Yoken 17 applied the same technique for CNV segmentation on two semiautomatically registered image frames for study of changes in CNV area and integrated lesion intensity measurements among visits. Brankin et al. 19 applied a similar segmentation technique for delineation of CNV, but the operation was performed on only one angiographic image frame without any support of temporal information. The same research group later proposed a system for segmenting hyperfluorescent regions with the combination of manual initialization and automatic refinement using also one image frame. 20 As expected, the system is not able to distinguish well between CNV components and other hyperfluorescent regions that do not represent CNV due to lack of temporal information in fluorescence changes. 
The severity map can be viewed as a 2-D summary of a 3-D FA sequence where the third dimension is the time. Instead of composing the temporal characteristics of the sequence in the mind with much of the quantitative information lost, the clinician can easily visualize the temporal characteristics using the severity map to perform a subjective evaluation. As shown in Figure 2, the severity map allows the physician to easily reach the conclusion that the hyperfluorescent area within the CNV does not have a uniform temporal profile indicating that part of the CNV is in evolution to fibrosis, but the hyperfluorescent area superior to the CNV may require observation for possible recurrent CNV in this case. This surveillance can be particularly useful for less experienced clinicians since the system can learn the temporal profile of the chosen type of CNV using sequences examined by more experienced clinicians. In terms of PDT treatment, the severity map can assist the physician in deciding if retreatment is necessary—if the severity map indicates areas of CNV having leakage characteristics similar to those of fibrosis, it may represent very early regression of CNV, and the surgeon may opt to observe even if the size of the CNV is about the same. Also, differences in reduction rates in the average leakage speed and severity value of the treated CNV may help the clinician decide whether retreatment is needed. Because of the small number of PDT cases in this study, we do not yet know whether the reduction rate of the leakage speed or the severity value is a better indicator for retreatment or observation of CNV. Future large-scale studies with longer follow-up and a combined analysis of OCT may advance the understanding and prediction of nonresponders or nonsustainers after loading doses of anti-VEGF. 
The segmentation algorithm achieved 83.26% accuracy with the major disagreement with the ground truth coming from regions with fibrin deposit, which appears as hypofluorescent ring along the border of the CNV 16 and exhibits very different temporal profile from the typical hyperfluorescence pattern of a CNV. This issue seems to be more prominent in cases with smaller CNV lesions. In addition, sequences without multiple images (at least two) in each of the five defined time intervals tend to have lower accuracies due to missing or inaccurate features. 
Our system is trained to recognize areas that are hyperfluorescent in both early and late phases in FA for AMD patients. Pathology with decreasing fluorescence in the late phase, such as pigment atrophy, is easily detected by our system as the background. Both pooling in serous pigment epithelial detachment (PED) and staining of fibrotic CNV exhibit fluorescence characteristics very similar to those of leaking CNV and are likely to be highlighted by our system with the current training set. In future studies, we will include cases of polypoidal choroidal vasculopathy or retinal angiomatous proliferation of which serous PED is a common accompanied sign. Staining of fibrotic and leaking CNV differs only in the change in the area of hyperfluorescence in the late phase. To explore the difference in future studies, we will take into consideration the temporal intensity variation of the neighborhood of each point. This approach will also improve the accuracy in cases with fibrin deposits. 
Because of the complex nature of CNV, the feasibility of the proposed system is demonstrated only by using sequences of classic CNV, which have distinct areas of hyperfluorescence. Given the promising results of the present study, the work will soon expand to cover other components and types of CNV by incorporating proper training data that capture the temporal variation. We are also interested in studying the correlation between the visual functions and the measurements derived from our system for evaluation of a treatment. Such findings are important in the development of surgical methods and pharmaceutical products. 
Footnotes
 Supported in part by Grant NSC96-2221-E-194-056 from the National Science Council, Taiwan.
Footnotes
 Disclosure: C.-L.Tsai, None; Y.-L. Yang, None; S.-J. Chen, None; K.-S. Lin, None; C.-H. Chan, None; W.-Y. Lin, None
References
Bressler NM Bressler SB Fine SL . Age-related macular degeneration. Surv Ophthalmol. 1988;32:375–413. [CrossRef] [PubMed]
Lalwani GA Rosenfeld PJ Fung AE . A variable-dosing regimen with intravitreal ranibizumab for neovascular age-related macular degeneration: year 2 of the PrONTO Study. Am J Ophthalmol. 2009;148:43–58. [CrossRef] [PubMed]
Doris N Hart P Chakravarthy U . Relation between macular morphology and visual function in patients with choroidal neovascularisation of age related macular degeneration. Br J Ophthalmol. 2001;85:184–188. [CrossRef] [PubMed]
Hogg R Curry E Muldrew A . Identification of lesion components that influence visual function in age related macular degeneration. Br J Ophthalmol. 2003;87:609–614. [CrossRef] [PubMed]
Jaakkola A Tommila P Laatikainen L Immonen I . Grading choroidal neovascular membrane regression after strontium plaque radiotherapy: masked subjective evaluation vs. planimetry. Eur J Ophthalmol. 2001;11:269–276. [PubMed]
Kaiser RS Berger JW Williams GA . Variability in fluorescein angiography interpretation for photodynamic therapy in age-related macular degeneration. Retina. 2002;22:683–690. [CrossRef] [PubMed]
Chakravarthy U Walsh AC Muldrew A Updike PG Barbour T Sadda SR . Quantitative fluorescein angiographic analysis of choroidal neovascular membranes: validation and correlation with visual function. Invest Ophthalmol Vis Sci. 2007;48:349–354. [CrossRef] [PubMed]
Shah SM Tatlipinar S Quinlan E . Dynamic and quantitative analysis of choroidal neovascularization by fluorescein angiography. Invest Ophthalmol Vis Sci. 2006;47:5460–5468. [CrossRef] [PubMed]
Macular Photocoagulation Study Group. Subfoveal neovascular lesions in age-related macular degeneration: guidelines for evaluation and treatment in the Macular Photocoagulation Study. Arch Ophthalmol. 1991;109:1242–1257. [CrossRef] [PubMed]
Berger JW . Quantitative, spatio-temporal image analysis of fundus features in age-related macular degeneration. SPIE Ophthalmic Technol. 1998;48–53.
Johnson RN Schatz H Mcdonald RH Ai E . Fluorescein angiography: basic principles and interpretation. In: Ryan S ed. Retina. Mosby; 2001.
Tsai C-L Li C-Y Yang G Lin K-S . The edge-driven dual-bootstrap iterative closest point algorithm for registration of multimodal fluorescein angiogram sequence. IEEE Trans Med Imaging. 2010;29:636–649. [CrossRef] [PubMed]
Freund Y Schapire RE . A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci. 1997;55:119–139. [CrossRef]
Grady L . Random walks for image segmentation. IEEE Trans Pattern Anal Mach Intell. 2006;28:1768–1783. [CrossRef] [PubMed]
Courant R Hilbert D . Methods of Mathematical Physics. John Wiley and Sons; 1989.
Lopez PF Lambert HM Grossniklaus HE Sternberg P . Well-defined subfoveal choroidal neovascular membranes in age-related macular degeneration. Ophthalmology. 1993;100:415–422. [CrossRef] [PubMed]
Berger JW Yoken J . Computer-assisted quantitation of choroidal neovascularization for clinical trials. Invest Ophthalmol Vis Sci. 2000;41:2286–2295. [PubMed]
Phillips RP Ross PG Tyska M Sharp PF Forrester JV . Detection and quantification of hyperfluorescent leakage by computer analysis of fundus fluorescein angiograms. Graefes Arch Clin Exp Ophthalmol. 1991;229:329–335. [CrossRef] [PubMed]
Brankin E McCullagh P Black N Patton W Muldrew A . The optimization of thresholding techniques for the identification of choroidal neovascular membranes in exudative age-related macular degeneration. Presented at the 19th IEEE Symposium on Computer-Based Medical Systems, Salt Lake City, Utah, June 22–23, 2006. Washington, DC: IEEE; 2006;430–435.
Brankin E McCullagh P Patton W Muldrew A Black N . Identification of choroidal neovascularisation on fluorescein angiograms using gradient vector flow active contours. Presented at the International Machine Vision and Image Processing Conference, Portrush, Ireland, September 3–5, 2008. Washington, DC: IEEE; 2008;165–169.
Appendix
The AdaBoost algorithm takes as an input a training set (x 1, y 1), …, (xm , ym ), where x 1 belongs to X and yk ∈ {−1, +1}, with +1 indicating foreground and −1 background. Dt (k) is the weight assignment to vector xk on round t, and hj (k) is the contribution score for vector xk made by Cj . Initially, all weights are equal and set to 1/m
Given: (x 1, y 1), …,(xm , ym ), where xk X, yk ∈ (−1, +1) 
Initialize: D 1(k) = 1/m
For t = 1, …, n perform the following:
  1.  
    Train the remaining weak classifiers in Γ using Dt .
  2.  
    Pick the classifier Cj with the lowest error and remove it from Γ.
  3.  
    Compute the contribution scores hj .
  4.  
    Compute Dt +1 by updating Dt with hj .
  5.  
    Normalize Dt +1 to make it a valid probability distribution.
To train the classifier Cj with Dt, several threshold values spanning the range of feature j are tested, each giving rise to four values:      where τ is the threshold value and xk,j is the jth feature of xk. The threshold value with the lowest error,W+ + W+, is chosen to be the optimal threshold value τj for classifier Cj. The contribution scores hj from classifier Cj on round t is:   where   and   If Cj outperforms all the other weak classifiers, the weight distribution of Dt is updated with hj to obtain Dt+1 for the next round of training: Dt + 1(k) = Dt(k)ehj(k)yk. A training sample is assigned a heavier weight if it is misclassified by the chosen weak classifier in round t, and the weight of a correctly classified training sample is decreased. Dt+1 is normalized by the sum of its element to make it a distribution. 
At the completion of AdaBoost training, each weak classifier Cj is associated with a 3-tuple vector (τ j , α j , β j ), where τ j is the optimal threshold and, α j and β j are the parameters for hj
Figure 1.
 
Twelve features for classification. (a) Samples are chosen from the CNV lesion (red dots), the background or non-CNV tissues (blue dots), and the region just outside the CNV (green dots). (b) The temporal fluorescence profile of each sample point is divided into five intervals: 0 to 30, 30 to 60, 60 to 150, and 150 to 300, and after 300 seconds. Each interval provides two features: the average intensity value and the average intensity change. The red plots are drawn from CNV pixels, the blue plots from the background tissues, and the green plots from the background close to the CNV. (c) Each plot is also approximated using least-squares linear regression to find the straight line with the least-squares error to provide two more features: the intercept and the slope. Dotted lines: the typical linear regression lines of the three regions.
Figure 1.
 
Twelve features for classification. (a) Samples are chosen from the CNV lesion (red dots), the background or non-CNV tissues (blue dots), and the region just outside the CNV (green dots). (b) The temporal fluorescence profile of each sample point is divided into five intervals: 0 to 30, 30 to 60, 60 to 150, and 150 to 300, and after 300 seconds. Each interval provides two features: the average intensity value and the average intensity change. The red plots are drawn from CNV pixels, the blue plots from the background tissues, and the green plots from the background close to the CNV. (c) Each plot is also approximated using least-squares linear regression to find the straight line with the least-squares error to provide two more features: the intercept and the slope. Dotted lines: the typical linear regression lines of the three regions.
Figure 2.
 
The severity map and CNV delineation generated by the proposed computer-aided diagnosis system. (a) The region of CNV lesion, colored in yellow by the retina specialist. (b) The CNV severity map using AdaBoost classification displayed with a color map. (c) Automatic segmentation of the CNV lesion using the random walk algorithm, initialized by using seed points of very high and very low severity as the foreground (CNV) and background points, respectively. The accuracy of this sequence is 89.09% with 1.32% of oversegmentation and 15.37% of undersegmentation.
Figure 2.
 
The severity map and CNV delineation generated by the proposed computer-aided diagnosis system. (a) The region of CNV lesion, colored in yellow by the retina specialist. (b) The CNV severity map using AdaBoost classification displayed with a color map. (c) Automatic segmentation of the CNV lesion using the random walk algorithm, initialized by using seed points of very high and very low severity as the foreground (CNV) and background points, respectively. The accuracy of this sequence is 89.09% with 1.32% of oversegmentation and 15.37% of undersegmentation.
Figure 3.
 
Examples of segmentation results. Top row: a case with 94.37% accuracy, resulting from 1.42% oversegmentation and 7.83% undersegmentation. Bottom row: one of the four sequences with accuracy below 70%. In this case, the accuracy is 66.81%, with no oversegmentation and 46.94% undersegmentation due to the presence of fibrin deposit, which was labeled as part of the CNV lesion by the retina specialist but was classified as the background by our system. (a, c) The automatically segmented regions are outlined in red and the ground truth in blue. (b, d) The corresponding severity maps.
Figure 3.
 
Examples of segmentation results. Top row: a case with 94.37% accuracy, resulting from 1.42% oversegmentation and 7.83% undersegmentation. Bottom row: one of the four sequences with accuracy below 70%. In this case, the accuracy is 66.81%, with no oversegmentation and 46.94% undersegmentation due to the presence of fibrin deposit, which was labeled as part of the CNV lesion by the retina specialist but was classified as the background by our system. (a, c) The automatically segmented regions are outlined in red and the ground truth in blue. (b, d) The corresponding severity maps.
Table 1.
 
Experimental Results on Delineation of Regions of CNV Using 33 FA Sequences of Classic CNV
Table 1.
 
Experimental Results on Delineation of Regions of CNV Using 33 FA Sequences of Classic CNV
TP (Pixels) FP (Pixels) FN (Pixels) Over-segmentation (%) Under-segmentation (%) Accuracy (%)
Case 01 2098 28 381 1.32 15.37 89.09
Case 02 3289 14 1140 0.42 25.74 81.80
Case 03 1880 297 87 13.64 4.42 89.86
Case 04 198 5 96 2.46 32.65 76.85
Case 05 1564 84 203 5.10 11.49 91.11
Case 06 312 33 19 9.57 5.74 92.11
Case 07 3840 312 323 7.51 7.76 92.36
Case 08 4774 1479 58 23.65 1.20 83.25
Case 09 191 0 169 0.00 46.94 66.81
Case 10 825 96 48 10.42 5.50 91.67
Case 11 474 26 0 5.20 0.00 96.32
Case 12 403 3 313 0.74 43.72 69.08
Case 13 689 16 389 2.27 36.09 74.43
Case 14 358 94 86 20.80 19.37 79.90
Case 15 1518 29 450 1.87 22.87 83.78
Case 16 357 1 30 0.28 7.75 94.51
Case 17 9134 132 776 1.42 7.83 94.37
Case 18 834 288 175 25.67 17.34 78.09
Case 19 1489 29 877 1.91 37.07 73.76
Case 20 2956 938 706 24.09 19.28 78.18
Case 21 322 9 124 2.72 27.80 80.25
Case 22 211 19 42 8.26 16.60 86.89
Case 23 2236 40 499 1.76 18.24 87.04
Case 24 647 216 48 25.03 6.91 81.64
Case 25 4774 58 34 1.20 0.71 99.01
Case 26 949 47 721 4.72 43.17 69.29
Case 27 353 82 7 18.85 1.94 86.60
Case 28 10725 743 2255 6.48 17.37 86.89
Case 29 4687 1064 1900 18.50 28.84 75.77
Case 30 407 0 63 0.00 13.40 90.52
Case 31 181 134 10 42.54 5.24 69.69
Case 32 932 0 520 0.00 35.81 74.68
Case 33 885 100 268 10.15 23.24 82.06
Average 83.26
Std Dev 8.69
Table 2.
 
Quantification of PDT Efficacy
Table 2.
 
Quantification of PDT Efficacy
Average Leakage Speed (Intensity/sec) Average Severity (%) Average Leakage Speed/Severity Reduction Rates (%) Post-PDT Diagnosis
Case 30
    Pre-PDT 10.88 0.89 82.2/67.4 Fibrosis present
    Post-PDT 1.94 0.29
Case 32
    Pre-PDT 5.17 0.75 29.2/56.0 Persistent CNV
    Post-PDT 3.66 0.33
Case 33
    Pre-PDT 13.50 0.77 81.6/87.0 CNV eradicated
    Post-PDT 2.48 0.10
Case 18
    Pre-PDT 17.33 0.93 94.0/90.3 CNV eradicated
    Post-PDT 1.04 0.09
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×