January 2012
Volume 53, Issue 1
Free
Clinical and Epidemiologic Research  |   January 2012
Diagnostic Characteristics of Tests for Ocular Chlamydia after Mass Azithromycin Distributions
Author Affiliations & Notes
  • Jeremy D. Keenan
    From the F. I. Proctor Foundation,
    the Departments of Ophthalmology,
  • Craig W. See
    From the F. I. Proctor Foundation,
  • Jeanne Moncada
    Laboratory Medicine, and
  • Berhan Ayele
    The Carter Center, Addis Ababa, Ethiopia; and
  • Teshome Gebre
    The Carter Center, Addis Ababa, Ethiopia; and
  • Nicole E. Stoller
    From the F. I. Proctor Foundation,
  • Charles E. McCulloch
    Epidemiology and Biostatistics, and
  • Travis C. Porco
    From the F. I. Proctor Foundation,
    the Departments of Ophthalmology,
    Epidemiology and Biostatistics, and
  • Bruce D. Gaynor
    From the F. I. Proctor Foundation,
    the Departments of Ophthalmology,
  • Paul M. Emerson
    The Carter Center, Atlanta, Georgia.
  • Julius Schachter
    Laboratory Medicine, and
  • Thomas M. Lietman
    From the F. I. Proctor Foundation,
    the Departments of Ophthalmology,
    Epidemiology and Biostatistics, and
    the Institute for Global Health, University of California, San Francisco, San Francisco, California;
  • Corresponding author: Jeremy D. Keenan, F. I. Proctor Foundation, 513 Parnassus Avenue, Med Sci S309, Box 0412, University of California, San Francisco, San Francisco, CA 94143-0412; [email protected]
Investigative Ophthalmology & Visual Science January 2012, Vol.53, 235-240. doi:https://doi.org/10.1167/iovs.11-8493
  • Views
  • PDF
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Jeremy D. Keenan, Craig W. See, Jeanne Moncada, Berhan Ayele, Teshome Gebre, Nicole E. Stoller, Charles E. McCulloch, Travis C. Porco, Bruce D. Gaynor, Paul M. Emerson, Julius Schachter, Thomas M. Lietman; Diagnostic Characteristics of Tests for Ocular Chlamydia after Mass Azithromycin Distributions. Invest. Ophthalmol. Vis. Sci. 2012;53(1):235-240. https://doi.org/10.1167/iovs.11-8493.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Purpose.: Although trachoma control programs frequently use the World Health Organization (WHO) simplified grading system for trachoma to monitor the clinical response after repeated mass azithromycin treatments, the programmatic relevance of this evaluation after multiple rounds of antibiotic treatments is unclear.

Methods.: Three rounds of annual mass azithromycin were distributed to 12 villages in Ethiopia. Twelve months after the third treatment, children were assessed for follicular trachomatous inflammation (TF) and intense trachomatous inflammation (TI) using the WHO simplified grading system and for ocular chlamydial infection using DNA-based and RNA-based tests. Test characteristics for predicting chlamydial infection were computed assuming a chlamydial RNA-based gold standard. As a secondary analysis, test characteristics were also assessed using a latent class analysis.

Results.: The prevalence of RNA evidence of ocular chlamydia was 7.1% (95% confidence interval [CI], 2.7–17.4). A DNA-based test and TF had sensitivities of 61.0% (95% CI, 47.1–73.3) and 65.9% (95% CI, 41.6–83.9), specificities of 100% (95% CI, 99.3–100) and 67.5% (95% CI, 61.0–73.5), and positive predictive values of 100% (95% CI, 86.3–100) and 13.4% (95% CI, 5.5–29.3) compared with an RNA-based gold standard. The latent class analysis confirmed that the RNA-based test was a reasonable choice for a gold standard, with a sensitivity of 100% (95% CI, 67.1–100) and specificity of 99.6% (95% CI, 98.1–100).

Conclusions.: Basing treatment decisions after mass azithromycin distributions on the WHO simplified grading system will maximize the treatment of infected persons compared with a DNA-based test but will also result in more uninfected persons being treated. The RNA-based test was considerably more sensitive, and almost equivalently specific, compared with a DNA-based test. (ClinicalTrials.gov number, NCT00322972.)

Trachoma is a blinding disease caused by ocular infection with Chlamydia trachomatis. 1 Ocular chlamydial infection manifests clinically as conjunctival inflammation, characterized by conjunctival hyperemia and germinal lymphoid follicles on the upper tarsal conjunctiva. Repeated or persistent episodes of infection are associated with conjunctival scarring, which in turn may lead to entropion, trichiasis, and blindness. 2 4  
Trachoma-endemic districts are treated with mass administration of azithromycin to the entire population, regardless of each person's disease status. Given the central role of antibiotic therapy for trachoma, an ideal test for trachoma would assess chlamydial infection to provide information about the usefulness of future antibiotic treatments. The most widely used test for monitoring trachoma is conjunctival examination using the World Health Organization (WHO) simplified grading system. 5 In this system, a grade of follicular trachomatous inflammation (TF) indicates the presence of five or more follicles at least 0.5 mm in diameter in the upper tarsal conjunctiva. A grade of intense trachomatous inflammation (TI) indicates obscuration of more than half the deep tarsal blood vessels. Both TF and TI are used to assess the burden of trachoma in a community. 
Laboratory tests for chlamydial infection are used primarily for trachoma research. 6 Most commonly used is a nucleic acid amplification test (NAAT) that targets the cryptic DNA plasmid of chlamydia (Amplicor; Roche Diagnostics, Indianapolis, IN). A second-generation rRNA-based NAAT with an additional target capture step has been well characterized in the sexually transmitted disease literature. In a duplex format that detects both Chlamydia trachomatis and Neisseria gonorrhoeae, this rRNA-based test (Aptima Combo 2; Gen-Probe, San Diego, CA) has been shown to be among the most sensitive and specific of the NAATs for the detection of chlamydia. 7 15 A version of this test that detects only chlamydia (Aptima CT) has proven to be an even more sensitive indicator of chlamydial infection. 8,11,16 NAATs targeting chlamydial rRNA are not widely used by trachoma control programs or researchers, though several trachoma studies have reported results of conjunctival swabs using Aptima CT. 17 19 Because of its superior sensitivity, the RNA test is a logical gold standard test against which to compare other tests for their ability to predict ocular chlamydia. 
The WHO recommends treating trachoma-endemic communities with annual mass azithromycin treatment, followed by reassessment after at least 3 years of treatment using the simplified grading system. 20,21 However, the results of clinical examination are often discordant with results from laboratory tests for chlamydia, especially after mass azithromycin treatments. 22 This finding may reflect differences in the kinetics of infection versus inflammation (i.e., there is an incubation period before inflammatory clinical signs develop and a period of persistent clinical signs after infection has cleared). 6,23 Because the simplified grading system is used to determine whether mass antibiotic treatments should continue, its ability to predict chlamydial infection is important. We compared the diagnostic test performance (defined as the ability to correctly identify the presence of chlamydia) of the WHO simplified grading system with that of a DNA-based chlamydial test after three rounds of mass azithromycin using an RNA-based chlamydial test as a gold standard. 
Methods
Study Design
In a cluster-randomized clinical trial for trachoma conducted in the Goncha Siso Enese woreda of Ethiopia from 2006 to 2009, 72 contiguous subkebeles (government administrative units) were randomly assigned to 1 of 6 treatment arms. 24 27 In one of the treatment arms, 12 subkebeles were randomly assigned to receive annual mass azithromycin treatments of the entire community. At the 36-month visit (1 year after the third mass treatment), conjunctival examination and swabbing for chlamydia testing were performed on a random sample of children from each subkebele. 28,29  
Intervention
An enumerative census and mass azithromycin distribution were performed in all 12 subkebeles at months 0, 12, and 24 of the study. At each distribution, a single dose of directly observed azithromycin (1 g for adults, 20 mg/kg approximated with height-based dosing for children) 30 was offered to all persons in the subkebele aged 1 year and older. Infants younger than 1 year, pregnant women, and anyone allergic to macrolides were given two tubes of tetracycline ophthalmic ointment to be used twice daily for 6 weeks. 
Monitoring
Each of the 12 subkebeles consisted of approximately four smaller administrative units known as state teams (interquartile range, 3.5–5 state teams per subkebele), which we refer to as villages for the purposes of this report. We randomly selected one sentinel village from each subkebele for monitoring. At the 36-month study visit, conjunctival examination and swabbing were performed on 50 randomly selected children aged 0 to 9 years from each sentinel village. Trained, experienced examiners assessed the upper right tarsal conjunctiva for TF and TI according to the WHO simplified grading system. 5 Then a dacron swab was passed firmly three times over the upper right tarsal conjunctiva, rotating 120° between each pass. Finally, a swab for chlamydial RNA was collected in a similar fashion, using swabs and transport media from a swab collection kit (Aptima CT [ACT] Unisex Swab Specimen Collection Kit; Gen-Probe, Inc.). RNA swabs were always collected after DNA swabs. We collected five negative field control swabs per sentinel village for each laboratory test by passing the swab within 1 inch of, but not touching, the tarsal conjunctiva. Examiners used a new pair of gloves for each study participant. 
We trained all examiners in trachoma grading and conjunctival swabbing at the beginning of each study visit. To grade the clinical signs of trachoma for this study, examiners were required to reach sufficient agreement (Cohen's kappa ≥0.6) with a consensus grade from three experienced trachoma graders (BA, BDG, TML) regarding the presence of clinically active trachoma (TF, TI, or both) on a set of 50 conjunctival photographs. The kappa coefficient for clinically active trachoma for clinically active trachoma for the eight graders in this study ranged from 0.66 to 0.88; the mean kappa coefficient, inverse probability weighted based on the number of children examined, was 0.87 (95% confidence interval [CI], 0.75–0.99) for TF and 0.73 (95% CI, 0.69–0.77) for TI. 
Sample Processing
The dacron swabs were stored at 4°C in the field and at −20°C within 6 hours and then were shipped at 4°C to San Francisco, where they were stored at −80°C until processing. The dacron swabs were processed using an assay (Amplicor PCR assay; Roche Diagnostics) to detect Chlamydia trachomatis DNA within the cryptic plasmid. This assay was performed on pools of five swabs, and individual swabs from any pools with positive results were tested further. RNA swabs were stored and transported to San Francisco at room temperature. Nucleic acid amplification of C. trachomatis 16s rRNA using the Aptima CT assay was also performed on pools of five swabs, and individual swabs from any pools with positive results were tested further. 
Discrepancies
Any samples with discrepant NAAT results were retested with the RNA-based ACT assay. Discrepant samples were also tested with the Aptima Combo 2 assay (Gen-Probe, Inc.), a different NAAT that targets the 23S chlamydial rRNA. A random sample of nine swabs that tested positive by the ACT and Amplicor tests and five swabs that tested negative by ACT and Amplicor were also processed with both RNA-based tests as positive and negative controls. Amplicor was performed on any discrepant samples from pools that had tested negative for chlamydia. Laboratory personnel were masked to the results of the original tests. 
Statistical Analysis
We calculated the sensitivity, specificity, predictive values, and likelihood ratios of the DNA-based test (Amplicor), TF, TI, and TF/TI (TF, TI, or both) using the RNA-based test (ACT) as the gold standard and accounting for within-village correlation when computing 95% CIs. We tested whether the sensitivity of the DNA-based test differed among those with and those without TF/TI using a mixed-effects logistic regression of the RNA-positive population, with community as a random effect. We estimated likelihood ratios from a log Poisson model using a robust variance estimate that adjusted for within-village correlation. 31 Exact confidence intervals were computed for the likelihood ratio of any test with perfect sensitivity or specificity, ignoring the clustered study design (StatXact 3; Cytel Inc., Cambridge, MA). 
Based on numerous previous studies, we assumed that the RNA-based test was the gold standard for our initial analyses. 7 15 As a secondary analysis, we also determined the diagnostic characteristics of four tests (TF, TI, DNA, and RNA) using a latent class analysis that does not assume any of the tests is a gold standard. 32,33 We implemented a clustered variant of the classical latent class model; we assigned a parameter to the latent gold standard prevalence of each village and the sensitivity and specificity of each of the four tests for this latent gold standard. 34 To fit the model, we minimized the sum of the Kullback-Leibler discrepancies for each village. 32,35 We used bootstrap resampling at the village level with 999 replicates and the percentile method to calculate confidence intervals. Pairwise P values were calculated by paired t-test on estimates from each village-level resample. The latent class analysis was performed with technical computing software (Mathematica 7; Wolfram Inc., Champaign, IL); all other analyses were performed with data analysis and statistical software (Stata 10; StataCorp, College Station, TX). 
Ethics Statement
Ethical approval for the study was obtained by the Committee for Human Research at the University of California at San Francisco, the Institutional Review Board at Emory University, and the Ethiopian Science and Technology Commission. Informed consent in Amharic was obtained from all study participants. The research followed the tenets of the Declaration of Helsinki. 
Results
One year after a third annual mass azithromycin treatment, we assessed 583 children aged 0 to 9 years. Six children were excluded from further analysis because either they did not have a documented trachoma grade or no one performed a conjunctival swab on them. A grade of TF was assigned to 201 children (34.8%; 95% CI, 27.7–42.8), TI to 95 children (16.5%; 95% CI, 9.4–27.2), and TF/TI (TF, TI, or both) to 251 children (43.5%; 95% CI, 35.0–52.4). Laboratory evidence of chlamydia was found in 25 children (4.3%; 95% CI, 1.7–10.5) using the DNA-based test and in 41 children (7.1%; 95% CI, 2.7–17.4) using the RNA-based test (Table 1). None of 60 negative control dacron swabs or 59 negative control RNA swabs tested positive for chlamydial DNA or RNA, respectively. 
Table 1.
 
Number of Children with Clinical Signs of Trachoma and Laboratory Evidence of Ocular Chlamydia 1 Year after Three Annual Mass Azithromycin Distributions
Table 1.
 
Number of Children with Clinical Signs of Trachoma and Laboratory Evidence of Ocular Chlamydia 1 Year after Three Annual Mass Azithromycin Distributions
WHO Grade RNA+ RNA−
DNA+ DNA− DNA+ DNA−
TF and TI present 13 5 0 27
TF present, TI absent 7 2 0 147
TF absent, TI present 3 1 0 46
TF and TI absent 2 8 0 316
We calculated the sensitivity, specificity, predictive values, and likelihood ratios of four different measures of trachoma using RNA evidence of chlamydial infection as the gold standard (Table 2). The simplified grading system had sensitivities ranging from 53.7% to 75.6% and specificities ranging from 59.0% to 86.4%, depending on the grade. The test for chlamydial DNA had a sensitivity of 61.0% (95% CI, 47.1–73.3) and a specificity of 100% (95% CI, 99.3–100). The sensitivity of the DNA test was higher in subjects with TF/TI (74.2%; 95% CI, 48.2–89.9) than in those without TF/TI (20.0%; 95% CI, 4.3–58.2; P = 0.01). Positive predictive values were much lower for the simplified grading system (range, 12.4%–23.2%) than for the DNA-based test (100%). 
Table 2.
 
Sensitivity, Specificity, Predictive Values, and Likelihood Ratios for Tests of Ocular Chlamydia, Assuming an RNA-Based Nucleic Acid Amplification Test as a Gold Standard
Table 2.
 
Sensitivity, Specificity, Predictive Values, and Likelihood Ratios for Tests of Ocular Chlamydia, Assuming an RNA-Based Nucleic Acid Amplification Test as a Gold Standard
Characteristic TF/TI TF TI DNA
Sensitivity 75.6 (53.3–89.4) 65.9 (41.6–83.9) 53.7 (23.4–81.5) 61.0 (47.1–73.3)
Specificity 59.0 (51.1–66.4) 67.5 (61.0–73.5) 86.4 (77.3–92.2) 100 (99.3–100)
PPV 12.4 (5.1–27.2) 13.4 (5.5–29.3) 23.2 (9.2–47.3) 100 (86.3–100)
NPV 96.9 (90.3–99.1) 96.3 (88.8–98.8) 96.1 (87.9–98.8) 97.1 (91.4–99.1)
LR+ 1.84 (1.52–2.22) 2.03 (1.61–2.57) 3.89 (2.12–7.17) ∞ (101.1–∞)
LR− 0.41 (0.24–0.73) 0.51 (0.31–0.83) 0.54 (0.30–0.95) 0.39 (0.30–0.52)
Discrepancies between the DNA-based and the RNA-based test were limited to 16 cases that were positive for chlamydial RNA but negative for chlamydial DNA (Table 1). On confirmatory RNA testing of these 16 discrepant samples, ACT confirmed 13 as positive, and AC2 confirmed four as positive and one as equivocal. For comparison, five negative control swabs (negative for ACT and Amplicor) tested negative by both confirmatory RNA-based tests, and nine positive control swabs (positive for ACT and Amplicor) tested positive by both confirmatory RNA-based tests. Amplicor testing was performed on 10 swabs that had come from a negative pool and therefore had not been tested individually. Of these 10 swabs, one tested positive for chlamydial DNA. The Amplicor-positive confirmatory test was also positive for both confirmatory RNA tests, and the five confirmatory samples that tested positive or equivocal by AC2 tested positive by the confirmatory ACT test. 
Our analyses assumed that the RNA-based chlamydial assay was the gold standard. Recognizing the imperfect sensitivity or specificity of this assay, we also performed a latent class analysis in which we allowed an unobservable gold standard. This latent class analysis estimated 12 prevalence parameters and eight test characteristic parameters, including those for the RNA-based test (Table 3). The model estimated the RNA-based test to be considerably more sensitive than the DNA-based test (100% vs. 64.2%; P = 0.004) and slightly less specific (99.6% vs. 100%; P = 0.03). TF was significantly more sensitive than TI (P = 0.04), and TI was more specific than TF (P < 0.001). 
Table 3.
 
Sensitivity and Specificity of Tests for Ocular Chlamydia Using a Clustered Latent Class Analysis
Table 3.
 
Sensitivity and Specificity of Tests for Ocular Chlamydia Using a Clustered Latent Class Analysis
Test Sensitivity Specificity
TF 68.9 (44.4–93.3) 67.6 (62.4–73.0)
TI 56.3 (27.0–84.5) 86.4 (80.1–93.9)
DNA 64.2 (35.4–89.8) 100 (100–100)
RNA 100 (67.1–100) 99.6 (98.1–100)
Discussion
After three rounds of mass azithromycin, the WHO simplified grading system appeared to have comparable or better sensitivity but lower specificity than a DNA-based laboratory test. In other words, clinical examination identified more infected persons than the DNA-based test but at the cost of more false positives. Both TF and TI significantly increase the posttest probability of infection in a person but to a lesser degree than the DNA-based test. 
Consistent with two previous reports, ocular swabs from this trachoma-endemic region were more frequently positive using the test for chlamydial RNA compared with the test for chlamydial DNA. 17,18 Although it is possible that results of the 16 excess RNA-positive tests are false positives, there are several reasons to think they represent a true measure of chlamydial infection. First, the Aptima RNA-based tests have consistently been shown to be more sensitive, and equally or more specific, than DNA-based tests in the sexually transmitted disease literature. 7,10 15 Second, a latent class analysis, which makes no assumptions about the gold standard, suggested that the data were most consistent with a highly specific RNA-based test and a less sensitive DNA-based test. Third, none of the negative control swabs tested positive for RNA, arguing against the possibility of false positives through contamination in the field or in the laboratory. Finally, confirmatory testing with RNA-based tests demonstrated infection in 81% of discrepant cases using ACT and in 31% of cases using AC2. Although one might have expected a higher proportion of discrepant cases to have tested positive with the ACT test, this degree of discrepancy on repeat testing is consistent with the 90% reproducibility of chlamydial NAATs demonstrated in other studies. 16,36 The lower number of positive confirmatory tests with the AC2 assay was expected given that this test has been shown to be less sensitive than the ACT assay. 8,11,16  
Compared with a gold standard of chlamydial RNA, the DNA-based chlamydial NAAT had a sensitivity of only 61%, albeit with wide confidence intervals. This may seem to be lower than expected. However, these results are consistent with those of other studies of these particular RNA- and DNA-based tests in which the DNA-based test detected 64% to 86% of the RNA-positive cases. 11 13 RNA-based methods are thought to more easily detect chlamydia than DNA-based methods, likely because chlamydial organisms contain approximately 1000 copies of 16s rRNA but only 7 to 10 copies of the cryptic DNA plasmid. 9,37 39 In addition, the target capture step in the Aptima assays probably contributes to enhanced sensitivity. This increased sensitivity of the RNA target may be most relevant in the setting of a low load of infectious organisms, which was likely the case in this study of communities monitored after repeated mass azithromycin treatments. A separate study in Ethiopia found evidence for this hypothesis: the sensitivity of the DNA-based test was lower in villages treated with mass azithromycin than in untreated villages. 18 In the present study, the sensitivity of the DNA test was lowest in those without clinically active trachoma, perhaps because these persons have a lower infectious load of chlamydia. 40,41 The increased sensitivity of the RNA-based test—in the face of nearly equivalent specificity—suggests that the RNA-based test is the NAAT of choice for monitoring ocular chlamydia, especially for researchers and trachoma programs interested in trachoma elimination. 
The WHO recommends conjunctival examination of children aged 1 to 9 years in communities treated with three annual mass azithromycin treatments, with further mass treatments until the prevalence of TF in children falls below 5%. 20,21 Although the WHO recommendations are widely implemented, few studies have assessed the diagnostic test performance of the WHO simplified grading system after mass azithromycin treatment (Table 4). Here, we showed that both TF and TI provide diagnostic information regarding chlamydial infection after three mass azithromycin distributions, yet TF and TI are not interchangeable tests. In this and other studies, TF appears to be a more sensitive test than TI for ocular chlamydia infection after mass azithromycin treatments. 42 In this study, TF even had a higher sensitivity than a DNA-based laboratory test. TF is, therefore, a sensible metric if the goal is trachoma elimination and identification of all possible cases of ocular chlamydia is desired. 
Table 4.
 
Sensitivity, Specificity, and Predictive Values of Various Tests for Ocular Chlamydia after Mass Azithromycin Treatments, from Published Studies
Table 4.
 
Sensitivity, Specificity, and Predictive Values of Various Tests for Ocular Chlamydia after Mass Azithromycin Treatments, from Published Studies
Country Month* Gold Standard Test Sensitivity Specificity PPV NPV
Tanzania 42 0 PCR TF 51.6 (40.9–62.3) 91.8 (89.8–93.5) 39.8 (30.9–49.3) 94.7 (93.0–96.2)
TI 45.1 (34.6–55.8) 91.9 (89.9–93.6) 36.9 (28.0–46.6) 94.1 (92.3–95.6)
TF/TI 63.7 (53.0–73.6) 86.6 (84.1–88.8) 33.3 (26.4–40.9) 95.8 (94.1–97.1)
12 PCR TF 62.5 (24.5–91.5) 94.0 (92.2–95.5) 8.5 (2.8–18.7) 99.6 (99.0–99.9)
TI 0 (0–36.9) 96.7 (95.3–97.7) 0 (0–11.6) 99.1 (98.2–99.6)
TF/TI 62.5 (24.5–91.5) 92.0 (90.0–93.7) 6.5 (2.1–14.5) 99.6 (98.9–99.9)
Tanzania 43 0 PCR TI 33.7 (27.9–39.9) 96.9 (95.3–98.1) 81.7 (72.9–88.6) 78.3 (75.2–81.1)
12 PCR TI 32.4 (18.0–49.8) 99.2 (98.1–99.7) 70.6 (44.0–89.7) 96.0 (94.1–97.4)
Egypt 22 0 LCR TF/TI 66.5 (59.7–72.8) 66.9 (58.6–74.5) 74.6 (67.8–80.6) 57.7 (49.9–65.3)
13 LCR TF/TI 50.0 (26.0–74.0) 75.3 (70.3–79.8) 9.8 (4.6–17.8) 96.6 (93.6–98.4)
Ethiopia 18 0 RNA PCR 61.3 (49.7–71.9) 100 (91.2–100) 100 (92.7–100) 56.3 (44.0–68.1)
18 RNA PCR 29.0 (18.2–41.9) 100 (93.8–100) 100 (81.5–100) 56.9 (46.7–66.6)
It is important to note that the positive predictive values for both TF and TI were far lower than those of the DNA-based NAAT. This indicates that basing treatment decisions solely on the simplified grading system will necessarily result in treatment of a considerable number of uninfected persons. For example, in these communities, three mass treatments had a dramatic effect on ocular chlamydia, reducing the prevalence among 0 to 9-year-old children from 42% to 4% (reported elsewhere). 27 The prevalence of TF declined much more slowly, to approximately 35%, much higher than the <5% prevalence required for discontinuing mass antibiotic treatments. Thus, many uninfected persons would receive antibiotics if mass treatments were continued. This is probably appropriate in areas with hyperendemic trachoma, where reinfection can rapidly occur after the cessation of mass treatments, even when these treatments have reduced the prevalence of chlamydial infection to very low levels. 44 In areas with less prevalent trachoma, however, reliance on the WHO simplified grading system will likely result in the overtreatment of communities with low levels of ocular chlamydia. Use of NAATs for trachoma monitoring could reduce unnecessary antibiotic treatments. The perceived costs of NAAT are likely to prevent its use by many trachoma programs though, especially because the expenses of using the simplified grading system are so low. More expensive nucleic acid amplification tests may be worth the added cost in certain situations, such as in communities with a low pretreatment prevalence of trachoma, where reinfection is less likely to occur after mass antibiotics have reduced ocular chlamydia to low levels. 42 Formal cost-effectiveness studies might be helpful in more clearly defining the role of laboratory tests after mass antibiotic treatments. 
A limitation of this study is its cross-sectional nature. We had data for the WHO simplified grading system, the DNA-based NAAT, and the RNA-based NAAT only at a single time point, which did not allow us to comment on the clinical significance of infections detected only by the RNA-based test but not the DNA-based test (e.g., whether these infections are new, almost resolved, or low-level persistent). 
In conclusion, we report the diagnostic test characteristics of the WHO simplified grading system and a DNA-based nucleic acid amplification test after three repeated mass antibiotic distributions in a hyperendemic region of Ethiopia compared with an RNA-based gold standard test. TF was the most sensitive test and appears to be an appropriate test for detecting the maximum amount of ocular chlamydia. However, both TF and TI had much lower positive predictive values than the DNA-based laboratory test, indicating that use of the WHO simplified grading system could result in overtreatment. The positive predictive value of the NAATs remained high even after repeated mass treatments, suggesting these tests would minimize unnecessary antibiotic distributions. If resources allow for the use of NAAT, the RNA-based test, given its superior sensitivity, is the test of choice. 
Footnotes
 Supported by National Institutes of Health Grants NEI U10 EY016214 (TML), NEI K23EY019071 (JDK), and NCRR/OD UCSF-CTSI KL2 RR024130, the Bernard Osher Foundation, That Man May See, the Harper Inglis Trust, the Bodri Foundation, the South Asia Research Fund, Research to Prevent Blindness, and the International Trachoma Initiative.
Footnotes
 Disclosure: J.D. Keenan, None; C.W. See, None; J. Moncada, None; B. Ayele, None; T. Gebre, None; N.E. Stoller, None; C.E. McCulloch, None; T.C. Porco, None; B.D. Gaynor, None; P.M. Emerson, None; J. Schachter, None; T.M. Lietman, None
References
Wright HR Turner A Taylor HR . Trachoma Lancet. 2008;371:1945–1954. [CrossRef]
Wolle MA Munoz BE Mkocha H West SK . Constant ocular infection with Chlamydia trachomatis predicts risk of scarring in children in Tanzania. Ophthalmology. 2009;116:243–247. [CrossRef] [PubMed]
Muñoz B Bobo L Mkocha H Lynch M Hsieh YH West S . Incidence of trichiasis in a cohort of women with and without scarring. Int J Epidemiol. 1999;28:1167–1171. [CrossRef] [PubMed]
Bowman RJ Jatta B Cham B . Natural history of trachomatous scarring in The Gambia: results of a 12-year longitudinal follow-up. Ophthalmology. 2001;108:2219–2224. [CrossRef] [PubMed]
Thylefors B Dawson CR Jones BR West SK Taylor HR . A simple system for the assessment of trachoma and its complications. Bull World Health Organ. 1987;65:477–483. [PubMed]
Solomon AW Peeling RW Foster A Mabey DC . Diagnosis and assessment of trachoma. Clin Microbiol Rev. 2004;17:982–1011. [CrossRef] [PubMed]
Moncada J Schachter J Hook EW3rd . The effect of urine testing in evaluations of the sensitivity of the Gen-Probe Aptima Combo 2 assay on endocervical swabs for Chlamydia trachomatis and Neisseria gonorrhoeae: the infected patient standard reduces sensitivity of single site evaluation. Sex Transm Dis 2004;31:273–277. [CrossRef] [PubMed]
Schachter J Hook EW Martin DH . Confirming positive results of nucleic acid amplification tests (NAATs) for Chlamydia trachomatis: all NAATs are not created equal. J Clin Microbiol. 2005;43:1372–1373. [CrossRef] [PubMed]
Chernesky M Jang D Luinstra K . High analytical sensitivity and low rates of inhibition may contribute to detection of Chlamydia trachomatis in significantly more women by the APTIMA Combo 2 assay. J Clin Microbiol. 2006;44:400–405. [CrossRef] [PubMed]
Lowe P O'Loughlin P Evans K White M Bartley PB Vohra R . Comparison of the Gen-Probe APTIMA Combo 2 assay to the AMPLICOR CT/NG assay for detection of Chlamydia trachomatis and Neisseria gonorrhoeae in urine samples from Australian men and women. J Clin Microbiol. 2006;44:2619–2621. [CrossRef] [PubMed]
Chernesky M Jang D Portillo E . Abilities of APTIMA, AMPLICOR, and ProbeTec assays to detect Chlamydia trachomatis and Neisseria gonorrhoeae in PreservCyt ThinPrep Liquid-based Pap samples. J Clin Microbiol. 2007;45:2355–2358. [CrossRef] [PubMed]
Moller JK Pedersen LN Persson K . Comparison of Gen-probe transcription-mediated amplification, Abbott PCR, and Roche PCR assays for detection of wild-type and mutant plasmid strains of Chlamydia trachomatis in Sweden. J Clin Microbiol. 2008;46:3892–3895. [CrossRef] [PubMed]
Schachter J Moncada J Liska S Shayevich C Klausner JD . Nucleic acid amplification tests in the diagnosis of chlamydial and gonococcal infections of the oropharynx and rectum in men who have sex with men. Sex Transm Dis. 2008;35:637–642. [CrossRef] [PubMed]
Ho MK Lo JY Lo AC Cheng FK Chan FK . Evaluation of replacing the existing diagnostic strategy for Neisseria gonorrhoeae and Chlamydia trachomatis infections with sole molecular testing of urine specimens in a sexually transmitted infection clinic setting. Sex Transm Infect. 2009;85:322–325. [CrossRef] [PubMed]
Masek BJ Arora N Quinn N . Performance of three nucleic acid amplification tests for detection of Chlamydia trachomatis and Neisseria gonorrhoeae by use of self-collected vaginal swabs obtained via an Internet-based screening program. J Clin Microbiol. 2009;47:1663–1667. [CrossRef] [PubMed]
Schachter J Chow JM Howard H Bolan G Moncada J . Detection of Chlamydia trachomatis by nucleic acid amplification testing: our evaluation suggests that CDC-recommended approaches for confirmatory testing are ill-advised. J Clin Microbiol. 2006;44:2512–2517. [CrossRef] [PubMed]
Yang JL Schachter J Moncada J . Comparison of an rRNA-based and DNA-based nucleic acid amplification test for the detection of Chlamydia trachomatis in trachoma. Br J Ophthalmol. 2007;91:293–295. [CrossRef] [PubMed]
Yang JL Hong KC Schachter J . Detection of Chlamydia trachomatis ocular infection in trachoma-endemic communities by rRNA amplification. Invest Ophthalmol Vis Sci. 2009;50:90–94. [CrossRef] [PubMed]
Biebesheimer JB House J Hong KC . Complete local elimination of infectious trachoma from severely affected communities after six biannual mass azithromycin distributions. Ophthalmology. 2009;116:2047–2050. [CrossRef] [PubMed]
Solomon AW Zondervan M Kuper H Buchan JC Mabey DCW Foster A . Trachoma Control: A Guide for Programme Managers. Geneva: World Health Organization; 2006. http://whqlibdoc.who.int/publications/2006/9241546905_eng.pdf . Accessed August 11, 2011.
World Health Organization. Report of the Second Global Scientific Meeting on Trachoma. WHO/PBD/GET 1.04. Geneva: World Health Organization; 2003. http://www.who.int/blindness/2nd%20GLOBAL%20SCIENTIFIC%20MEETING.pdf . Accessed August 11, 2011.
Bird M Dawson CR Schachter JS . Does the diagnosis of trachoma adequately identify ocular chlamydial infection in trachoma-endemic areas? J Infect Dis. 2003;187:1669–1673. [CrossRef] [PubMed]
Wright HR Taylor HR . Clinical examination and laboratory tests for estimation of trachoma prevalence in a remote setting: what are they really telling us? Lancet Infect Dis. 2005;5:313–320. [CrossRef] [PubMed]
House JI Ayele B Porco TC . Assessment of herd protection against trachoma due to repeated mass antibiotic distributions: a cluster-randomised trial. Lancet. 2009;373:1111–1118. [CrossRef] [PubMed]
Porco TC Gebre T Ayele B . Effect of mass distribution of azithromycin for trachoma control on overall mortality in Ethiopian children: a randomized trial. JAMA. 2009;302:962–968. [CrossRef] [PubMed]
Stoller NE Gebre T Ayele B . Efficacy of latrine promotion on emergence of infection with ocular Chlamydia trachomatis after mass antibiotic treatment: a cluster-randomized trial. Int Health. 2011;3:75–84. [CrossRef] [PubMed]
Gebre T Ayele B Zerihun M . Comparison of annual versus twice-yearly mass azithromycin treatment for hyperendemic trachoma in Ethiopia: a clsuter-randomized trial. Lancet. In press.
Keenan JD Ayele B Moncada J . Ribosomal RNA evidence of ocular Chlamydia trachomatis infection following 3 annual mass azithromycin distributions in communities with highly prevalent trachoma. Clin Infect Dis. 2012;54:253–256. [CrossRef] [PubMed]
Keenan JD Moncada J Gebre T . Chlamydial infection during trachoma monitoring: are the most difficult-to-reach children more likely to be infected? Trop Med Int Health. 2011 Nov 28. doi: 10.1111/j.1365-3156.2011.02919.x. [Epub ahead of print]
Basilion EV Kilima PM Mecaskey JW . Simplification and improvement of height-based azithromycin treatment for paediatric trachoma. Trans R Soc Trop Med Hyg. 2005;99:6–12. [CrossRef] [PubMed]
Williams RL . A note on robust variance estimation for cluster-correlated data. Biometrics. 2000;56:645–646. [CrossRef] [PubMed]
Goodman LA . Exploratory latent structure analysis using both identifiable and unidentifiable models. Biometrika 1974;61:215–231. [CrossRef]
Goetghebeur E Liinev J Boelaert M Van der Stuyft P . Diagnostic test analyses in search of their gold standard: latent class analyses with random effects. Stat Methods Med Res. 2000;9:231–248. [CrossRef] [PubMed]
See CW Alemayehu W Melese M . How reliable are tests for trachoma? A latent class approach. Invest Ophthalmol Vis Sci. 2011;52:6133–6137. [CrossRef] [PubMed]
Akaike H . Information theory and an extension of the maximum likelihood principle. In: Petrov BN Csaki F , eds. Second International Symposium on Information Theory. Budapest: Akademiai Kiado; 1973:267–281.
Harding-Esch EM Edwards T Mkocha H . Trachoma prevalence and associated risk factors in The Gambia and Tanzania: baseline results of a cluster randomised controlled trial. PLoS Negl Trop Dis 4:e861. [CrossRef] [PubMed]
Palmer L Falkow S . A common plasmid of Chlamydia trachomatis . Plasmid. 1986;16:52–62. [CrossRef] [PubMed]
Tam JE Davis CH Thresher RJ Wyrick PB . Location of the origin of replication for the 7.5-kb Chlamydia trachomatis plasmid. Plasmid. 1992;27:231–236. [CrossRef] [PubMed]
An Q Radcliffe G Vassallo R . Infection with a plasmid-free variant Chlamydia-related to Chlamydia trachomatis identified by using multiple assays for nucleic acid detection. J Clin Microbiol. 1992;30:2814–2821. [PubMed]
Solomon AW Holland MJ Burton MJ . Strategies for control of trachoma: observational study with quantitative PCR. Lancet. 2003;362:198–204. [CrossRef] [PubMed]
West ES Munoz B Mkocha H . Mass treatment and the effect on the load of Chlamydia trachomatis infection in a trachoma-hyperendemic community. Invest Ophthalmol Vis Sci. 2005;46:83–87. [CrossRef] [PubMed]
Solomon AW Holland MJ Alexander ND . Mass treatment with single-dose azithromycin for trachoma. N Engl J Med. 2004;351:1962–1971. [CrossRef] [PubMed]
West SK Munoz B Mkocha H . Infection with Chlamydia trachomatis after mass treatment of a trachoma hyperendemic community in Tanzania: a longitudinal study. Lancet. 2005;366:1296–1300. [CrossRef] [PubMed]
Lakew T House J Hong KC . Reduction and return of infectious trachoma in severely affected communities in Ethiopia. PLoS Negl Trop Dis. 2009;3:e376. [CrossRef] [PubMed]
Appendix
Donald Everett (National Eye Institute, Bethesda, MD) was the program officer for the underlying clinical trial. The data safety and monitoring committee for the underlying clinical trial included William Barlow (University of Washington, Seattle, WA; Chair), Donald Everett, Larry Schwab (International Eye Foundation, Kensington, MD), Arthur Reingold (University of California, Berkeley, CA), and Serge Resnikoff (Brien Holden Vision Institute, Sydney, Australia, and International Health and Development, Geneva, Switzerland). Logistical support was provided by the head of the Goncha woreda health office, Tadege Alemayehu; the head of the Amhara Regional Health Bureau, Asrat Genet Amnie; and the Ethiopian Ministry of Health. Trachoma monitoring was performed by Mitselal Abrahale, Melkam Andualem, Rebecca Beauregard, Manahlosh Berihun, Michael Chen, Temesgen Demile, Tessema Eneyew, Banchu Gedamu, and Melese Temesgen. 
Table 1.
 
Number of Children with Clinical Signs of Trachoma and Laboratory Evidence of Ocular Chlamydia 1 Year after Three Annual Mass Azithromycin Distributions
Table 1.
 
Number of Children with Clinical Signs of Trachoma and Laboratory Evidence of Ocular Chlamydia 1 Year after Three Annual Mass Azithromycin Distributions
WHO Grade RNA+ RNA−
DNA+ DNA− DNA+ DNA−
TF and TI present 13 5 0 27
TF present, TI absent 7 2 0 147
TF absent, TI present 3 1 0 46
TF and TI absent 2 8 0 316
Table 2.
 
Sensitivity, Specificity, Predictive Values, and Likelihood Ratios for Tests of Ocular Chlamydia, Assuming an RNA-Based Nucleic Acid Amplification Test as a Gold Standard
Table 2.
 
Sensitivity, Specificity, Predictive Values, and Likelihood Ratios for Tests of Ocular Chlamydia, Assuming an RNA-Based Nucleic Acid Amplification Test as a Gold Standard
Characteristic TF/TI TF TI DNA
Sensitivity 75.6 (53.3–89.4) 65.9 (41.6–83.9) 53.7 (23.4–81.5) 61.0 (47.1–73.3)
Specificity 59.0 (51.1–66.4) 67.5 (61.0–73.5) 86.4 (77.3–92.2) 100 (99.3–100)
PPV 12.4 (5.1–27.2) 13.4 (5.5–29.3) 23.2 (9.2–47.3) 100 (86.3–100)
NPV 96.9 (90.3–99.1) 96.3 (88.8–98.8) 96.1 (87.9–98.8) 97.1 (91.4–99.1)
LR+ 1.84 (1.52–2.22) 2.03 (1.61–2.57) 3.89 (2.12–7.17) ∞ (101.1–∞)
LR− 0.41 (0.24–0.73) 0.51 (0.31–0.83) 0.54 (0.30–0.95) 0.39 (0.30–0.52)
Table 3.
 
Sensitivity and Specificity of Tests for Ocular Chlamydia Using a Clustered Latent Class Analysis
Table 3.
 
Sensitivity and Specificity of Tests for Ocular Chlamydia Using a Clustered Latent Class Analysis
Test Sensitivity Specificity
TF 68.9 (44.4–93.3) 67.6 (62.4–73.0)
TI 56.3 (27.0–84.5) 86.4 (80.1–93.9)
DNA 64.2 (35.4–89.8) 100 (100–100)
RNA 100 (67.1–100) 99.6 (98.1–100)
Table 4.
 
Sensitivity, Specificity, and Predictive Values of Various Tests for Ocular Chlamydia after Mass Azithromycin Treatments, from Published Studies
Table 4.
 
Sensitivity, Specificity, and Predictive Values of Various Tests for Ocular Chlamydia after Mass Azithromycin Treatments, from Published Studies
Country Month* Gold Standard Test Sensitivity Specificity PPV NPV
Tanzania 42 0 PCR TF 51.6 (40.9–62.3) 91.8 (89.8–93.5) 39.8 (30.9–49.3) 94.7 (93.0–96.2)
TI 45.1 (34.6–55.8) 91.9 (89.9–93.6) 36.9 (28.0–46.6) 94.1 (92.3–95.6)
TF/TI 63.7 (53.0–73.6) 86.6 (84.1–88.8) 33.3 (26.4–40.9) 95.8 (94.1–97.1)
12 PCR TF 62.5 (24.5–91.5) 94.0 (92.2–95.5) 8.5 (2.8–18.7) 99.6 (99.0–99.9)
TI 0 (0–36.9) 96.7 (95.3–97.7) 0 (0–11.6) 99.1 (98.2–99.6)
TF/TI 62.5 (24.5–91.5) 92.0 (90.0–93.7) 6.5 (2.1–14.5) 99.6 (98.9–99.9)
Tanzania 43 0 PCR TI 33.7 (27.9–39.9) 96.9 (95.3–98.1) 81.7 (72.9–88.6) 78.3 (75.2–81.1)
12 PCR TI 32.4 (18.0–49.8) 99.2 (98.1–99.7) 70.6 (44.0–89.7) 96.0 (94.1–97.4)
Egypt 22 0 LCR TF/TI 66.5 (59.7–72.8) 66.9 (58.6–74.5) 74.6 (67.8–80.6) 57.7 (49.9–65.3)
13 LCR TF/TI 50.0 (26.0–74.0) 75.3 (70.3–79.8) 9.8 (4.6–17.8) 96.6 (93.6–98.4)
Ethiopia 18 0 RNA PCR 61.3 (49.7–71.9) 100 (91.2–100) 100 (92.7–100) 56.3 (44.0–68.1)
18 RNA PCR 29.0 (18.2–41.9) 100 (93.8–100) 100 (81.5–100) 56.9 (46.7–66.6)
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×