Abstract
Purpose.:
To compare subfoveal choroidal thickness (SCT) measurements of three different commercially available spectral-domain optical coherence tomography instruments with healthy eyes of Japanese.
Methods.:
A prospective, cross-sectional study was performed at a single institution. SCT of the right eye of 43 normal subjects was measured using three different SD-OCTs: Heidelberg Spectralis-OCT (Spectralis), Cirrus HD-OCT (Cirrus), and Topcon 3D OCT-1000 Mark II (Topcon). Two separate measurements were performed for the same eye with a maximum by a single examiner. SCT was defined as the distance from the posterior edge of the retinal pigment epithelium to the choroid/sclera junction. After manual segmentation, measurements were made using calipers equipped on each machine by masked raters. Intraclass, interrater, and intermachine agreements were assessed.
Results.:
Forty-three subjects (mean age, 30.5 years) were enrolled. Of 43 eyes, the SCT of 39 eyes (90.7%) could be measured using each machine. Intraclass correlation coefficients (95% confidence intervals) were 0.976 (0.954–9.987), 0.958 (0.919–0.978), and 0.939 (0.895–0.971) with Spectralis, Cirrus, and Topcon, respectively. Interrater correlation coefficients (95% confident interval) were 0.944 (0.893 to 0.971), 0.956 (0.831 to 0.983), and 0.924 (0.825 to 0.964) with Spectralis, Cirrus, and Topcon, respectively. The average SCT was 272.6, 272.8, and 269.2 μm with Spectralis, Cirrus, and Topcon, respectively. The intermachine correlation coefficient was significantly high among the machines (P < 0.001, Spearman), 0.97 (Spectralis–Cirrus), 0.96 (Cirrus–Topcon), and 0.98 (Topcon–Cirrus). Bland–Altman plot analysis showed no typical trend among the machines.
Conclusions.:
SCT measurements obtained with three different SD-OCTs were highly correlated and could be used interchangeably. (http://upload.umin.ac.jp number, UMIN000005287.)
The accumulating evidence shows that the choroid plays an important role in the pathogenesis of various retinal diseases. For example, a choroidal abnormality is often noted in age-related macular degeneration examined with indocyanine green angiography.
1,2 In diabetic retinopathy, choroidal pathology is sometimes associated with retinal changes, which are found in histology or angiography,
3,4 although a qualitative and quantitative evaluation of choroidal morphology has not been easy to obtain in a clinical setting.
Optical coherence tomography (OCT) has become an essential tool not only for diagnosing various retinal diseases, but also for determining their effective treatment. Above all, paradigms have changed rapidly since the emergence of a new generation of Fourier domain (FD) and spectral domain (SD)-OCT. These OCT machines perform scans much faster, allowing systematic raster scanning associated with a higher resolution, thus providing more extensive morphologic details. Spaide et al.
5 recently reported adequate examination and measurement of choroidal thickness in normal and pathologic states with enhanced depth imaging (EDI)-OCT, which has brought great progress to the field of retinochoroidal pathophysiology. Indeed, many reports on choroidal pathology were published subsequently using this EDI-OCT and examination of the choroid with OCT is becoming a standard method for evaluating ocular diseases.
6 –16 At the same time, the technique of averaging images contributed the reduction of speckle noises, which improved the continuity of retinal structures. Cirrus HD-OCT and Topcon OCT have this image averaging.
Currently, it is recognized that the algorithms of commercially available machines differ and the results of each machine for retinal thickness evaluation are not interchangeable.
17 –22 Many commercially available SD-OCT machines are applicable for choroidal examinations. To our knowledge, however, there are few studies comparing choroidal thickness measurements taken with different commercially available SD-OCT machines in a standardized and prospective way,
23 and it is necessary to know the characteristics of each machine, including interexamination and interdevice reproducibility.
The aim of this study was to take choroidal thickness measurements of normal eyes with three frequently used SD-OCT machines—Heidelberg Spectralis-OCT, Cirrus HD-OCT, Topcon 3D OCT-1000 Mark II—and compare the results.
This is a cross-sectional prospective observational study. Originally, the number of enrollment eyes was projected to be 40 from March 15 to April 30, 2011. Primary outcome measured was the difference in choroidal thickness examined with three different OCT machines: Heidelberg Spectralis-OCT (Spectralis; Heidelberg Engineering, Heidelberg, Germany), Cirrus HD-OCT (Cirrus; Carl Zeiss Meditec Inc., Dublin, CA), and 3D OCT-1000 Mark II (Topcon; Topcon Corp., Tokyo, Japan).
Volunteers with no known eye disease were used to evaluate the ability to image and measure the thickness of the choroid. Only the right eye of each volunteer was examined. Eligibility criteria were as follows: 18 years of age or older and 40 years of age or younger, eyes considered normal that were examined by funduscopy and OCT. Exclusion criteria included eyes with known ocular diseases such as glaucoma, and diabetic retinopathy; subjects with known systemic diseases such as hypertension and diabetes; subjects with highly myopic eyes of −6.0 D or more spherical equivalent; subjects with a history of intraocular surgery or injection; and eyes in which the ocular fundus could not be observed due to media opacities. No eye was excluded due to poor OCT image quality because of poor fixation.
Spectralis.
Cirrus.
Topcon.
During the study period, 50 volunteers, all Japanese, were screened for this project, but 7 eyes were excluded because of high myopia. As a result, 43 eyes were studied and 39 of these eyes gave clear choroidal images. Age ranged from 19 to 40 years (mean ± SD: 30.5 ± 7.8 years). Twenty subjects were females. Refractive errors were −3.1 ± 1.8D (mean ± SD). The subfoveal choroidal thickness measured with Spectralis was 273.90 ± 66.15 μm at the first examination and 271.31 ± 61.21 μm at the second examination. The choroidal thickness measured with Cirrus was 276.59 ± 69.82 μm at the first examination and 269.08 ± 61.97 μm at the second examination. The choroidal thickness measured with Topcon was 269.05 ± 63.54 μm at the first examination and 260.75 ± 61.67 μm at the second examination. At the first examination, choroidal thickness could be measured in 39/43 eyes (90.7%), with each of Spectralis, Cirrus, or Topcon. Eyes for which choroidal thickness could not be measured were common in the second examination (Cases 6, 34, 35, and 42). In these eyes, neither the first nor the second examination showed sufficiently clear imaging for choroidal thickness evaluation, whereas clear imaging was obtained in both the first and the second examinations in the other 39 eyes.
In this study, we compared three different commercially available SD-OCT machines—Spectralis, Cirrus, and Topcon—in a head-to-head study of normal subjects to measure subfoveal choroidal thickness in a prospective manner. Two separate examinations showed good reproducibility with each machine.
There are many reports showing head-to-head comparisons of different SD-OCT for normal subjects, but they focus on retinal nerve fiber layer thickness or retinal thickness.
17 –22 To the best of our knowledge, this is the only report on a head-to-head analysis of different commercially available machines regarding choroidal thickness measurements; in their report, they studied three machines, which are different from the present machines.
23 Since the first report of EDI-OCT, OCT imaging of the choroid has attracted the interest of clinicians and studies of the choroid using EDI-OCT are increasing in number.
5 Because of the current commercial availability of various SD-OCT machines and the more frequent use of these machines in ongoing and planned longitudinal studies of choroid, we believe this report is of value to shed light on the usefulness and limitations that might exist when using data obtained by various SD-OCT machines.
We found that all three SD-OCTs have a very high correlation to each other for subfoveal and parafoveal choroidal thickness measurements. Pearson correlation coefficients were exceptionally high for average choroidal thickness and did not differ among machines. Of note, in previous studies of intermachine comparisons of retinal nerve fiber layer thickness or retinal thickness, the data from each machine were neither completely compatible nor interchangeable.
17 –22 There were consistent differences in retinal thickness measurements among machines. It was hypothesized that the segmentation of outer retina differed among machines, which led to the intermachine difference; that is, the inner retinal border was not different, but the outer border was different (e.g., the outer border of the retina was set at the RPE for Cirrus, whereas it was set at the photoreceptor outer segment tip for Topcon).
17,22 Thus, it is easy to understand that the macular thickness of a normal eye was approximately 20 to 40 μm larger with Cirrus than that with Topcon.
17,22
On the other hand, recently, Heussen et al.
27 reported that manual correction of the outer retinal boundary to a standardized reference location could yield similar retinal thickness measurements across Cirrus, Spectralis, and Topcon 3D OCT-2000. Our present result is in accord with their results, although they measured retinal thickness, not choroidal thickness. Indeed, we drew the boundaries of the choroid manually in this study, resulting in each machine being identical. The results of the present study and Heussen's report strongly support the hypothesis that the fixed bias among machines when measuring with SD-OCT is attributable mainly to the segmentation algorithm.
Of importance is that the Bland–Altman plots show maximum differences of up to 50 μm and a fair number of points >20 μm between the machines. The 95% limits of agreement indicate a spread of >30 μm between the Cirrus and both other machines. We could not figure out the exact reason for this result. Compared with the retinal configuration on SD-OCT, the border of choroid/sclera was not clear on SD-OCT. In addition, the choroidal measurement was performed in a strictly masked fashion in this study. These factors might have something to do with this result. It is possible that an 80-μm range of difference seems high. However, the range was almost the same as that reported by Branchini and colleagues.
23 In their manuscript, the range of difference between Cirrus and Spectralis was +12.81% to −13.33% and the range was 26.14%. The average choroidal thickness of their result was 345 μm. As a result, the range was approximately 89 μm, which is equal to that of the present study. This similarity would support the credibility of these two studies. Additionally, we could not find any specific factor to cause the difference between machines. Therefore, the subtle change of choroidal thickness on SD-OCT might not be meaningful for clinical trials.
Among the 43 examined eyes, choroidal thickness measurements could not be done successfully in 4 eyes, which were common to the three machines. Thus, the machines were not the factor; rather, it was the individual eyes. The images of these eyes showed a clear retinal configuration and inner border of the choroid, but an obscure choroid boundary. The subfoveal choroidal thicknesses of these eyes were all >500 μm, although the exact thickness was not measurable. Thus, eyes with a thick choroid, probably with deep pigmentation as well, might not be suitable for choroidal imaging with the present machines. For these eyes, a high-penetration OCT machine with a longer wavelength would be necessary.
13,28 Furthermore, the present results do not mean that the three machines have an equal sensitivity. Rather, these four exceptional cases might have been included coincidently in this study. To compare the sensitivity of the three machines correctly, intermachine comparison should be done on many more cases by more graders. In the previous report, subfoveal choroidal thickness could be measured in all subjects: 18 White, 5 Asians, 3 Hispanics, and 2 African Americans.
23 We cannot figure out why the measurability was so different. This might be a characteristic of Asian populations with moderate pigmentation and thick choroid. It should be noted that the present subjects were all Japanese; thus, the results might differ from subjects of other ethnic populations.
Retinal thickness is one of the major treatment criteria for age-related macular degeneration or diabetic macular edema. Therefore, it is particularly important to know the characteristics of each OCT machine in a clinical setting. At present, choroidal thickness is not yet used as a major criterion to determine treatment. Rather, it is used for investigating the pathology of diseases. However, according to increasing information on the choroid from studies using OCT, it will be a treatment criterion for ocular diseases in the very near future. For example, the choroidal thickness of Vogt–Koyanagi–Harada disease is reduced after successful steroid treatment; thus, it would be expected to be an indicator for performing or not performing steroid treatment.
11 Choroidal thickness is influenced by intraocular pressure and it might become a criterion for glaucoma treatment, although the results are still controversial.
10,24 Because SD-OCT is noninvasive to examinees, it might be used for evaluating systemic conditions as well. One may argue that manual segmentation is time-consuming and troublesome in a clinical setting. However, because choroidal thickness was measured easily with a caliper equipped on each machine, the present method using manual segmentation is practical even in clinical practice.
For a clinical setting, the quality of images and the ease of obtaining clear images would be important factors in choosing a machine. Although there was some tendency, we could not conclude which machine is superior because of lack of objective method to quantitate these factors. This issue should be studied in the near future.
Strengths of the study include its prospective design, which recruited a number of healthy subjects with a wide range of choroidal thicknesses. Scans of each eye were performed within a limited time, which minimized the possibility of choroidal thickness change caused by diurnal variations, fluctuations of intraocular pressure, and circulating catecholamines.
24,25 Limitations of this study are that scans were acquired from young healthy subjects with no ocular pathology and did not reflect those of patients seen in a routine outpatient setting. For instance, the clarity of images of patients could be hindered by an ocular pathology such as significant media opacity or masking of choroidal reflectance by intraocular tissue. These issues, especially the age interval, should be remembered in interpreting the present results. Second, there are always concerns about manual segmentation approaches, which might cause an uncontrollable bias among examiners. We performed interrater comparison in this study, which was found to be sufficiently high. However, the raters of the present study were well trained. If the agreement ratio of many different raters is proven to be high on each device, the present results should be more generalized and the present machines could be used interchangeably with confidence. Third, we evaluated the specific scanning protocol of only three SD-OCT machines commonly used now. It is uncertain whether our observations can be generalized for other SD-OCT machines or other scanning protocols. Besides, the present results can apply to the choroidal thickness of the subfoveal or parafoveal areas. We do not have any evidence of the choroidal thickness of other areas. This should also be kept in mind when interpreting the present data.
In conclusion, the subfoveal choroidal thickness measurements obtained with Spectralis, Cirrus, and Topcon would be almost identical and interchangeable. Because it is an easy, reproducible, and noninvasive examination, it can be used more often in a clinical setting. The data could provide a better understanding of ocular diseases, which will further increase the value of this examination.
Supported in part by a grant from the Research Committee on Chorioretinal Degeneration and Optic Atrophy, Ministry of Health, Labor, and Welfare, Tokyo, Japan.
Disclosure:
To. Yamashita, None;
Ta. Yamashita, None;
M. Shirasawa, None;
N. Arimura, None;
H. Terasaki, None;
T. Sakamoto, None