|
|
||||||||
Guest Access | Sign In via User Name/Password |
|||||||||
* From the School of Medicine (Ms. Maltas, and Drs. Guerra and Dorman), Johns Hopkins University; and the Maryland State Department of Health and Mental Hygiene (Ms. Hooper, Mr. Baker, Ms. Alborz, Mr. Armstrong, and Dr. Kiehlbauch), Baltimore, MD.
Correspondence to: Susan E. Dorman, MD, School of Medicine, Johns Hopkins University, Room 1M-06, 1550 Orleans St, Baltimore, MD 21231; e-mail: dsusan1{at}jhmi.edu
Abstract
Background: The Amplified Mycobacterium tuberculosis Direct Test (MTD; Gen-Probe; San Diego, CA) is a nucleic-acid amplification test for rapid pulmonary tuberculosis (PTB) diagnosis. In a routine public health setting, test accuracy and impact on clinical decisions are unknown.
Methods: Retrospectively, we evaluated MTD accuracy and impact on clinical decisions in a public health setting. To estimate MTD accuracy, mycobacterial culture was used as the "gold standard." To evaluate MTD impact on clinical decisions, concordance of clinician presumptive diagnosis (at time of MTD and smear availability) and definitive diagnosis, and duration of nonindicated tuberculosis therapy were determined for smear-positive PTB suspects in a period of MTD availability (MTD group) and a prior period of MTD nonavailability (non-MTD group).
Results: A total of 1,151 respiratory specimens from 638 PTB suspects were analyzed. MTD sensitivity, specificity, positive predictive value, and negative predictive value were 91.7%, 98.7%, 96.7%, and 96.5% overall, respectively; and 98.7%, 97.8%, 98.7%, and 97.8% for smear-positive patients; and 62.2%, 98.9%, 85.2%, and 96.1% for smear-negative patients. In the MTD group, concordance between definitive and clinician presumptive diagnoses was 78% (95% confidence interval [CI], 64 to 88%), similar to that for the non-MTD group (79%; 95% CI, 68.4 to 89.6%). However, concordance between definitive diagnosis and the MTD test was 98% (95% CI, 94.1 to 100%). Median duration of nonindicated tuberculosis treatment was 6 days for the MTD group vs 31 days for the non-MTD group (p = 0.002).
Conclusion: In this public health setting, MTD was accurate and rapidly detected more than half of the smear-negative PTB cases. For smear-positive PTB suspects, MTD had excellent concordance with definitive diagnosis, but clinicians often inappropriately initiated TB therapy despite a negative MTD result.
Key Words: Mycobacterium tuberculosis direct test diagnosis respiratory specimens tuberculosis amplified
New tools are needed to increase the efficiency of Mycobacterium tuberculosis detection. The conventional rapid test (smear microscopy for acid-fast bacilli [AFB]) has poor sensitivity and specificity, and its positive predictive value (PPV) for pulmonary tuberculosis (PTB) is lower in settings in which nontuberculous mycobacteria (NTM) are commonly isolated from respiratory secretions.1 The conventional "gold standard" test, mycobacterial culture, is slow because it can take up to 6 to 8 weeks for M tuberculosis to grow.
The Amplified Mycobacterium tuberculosis Direct Test (MTD; Gen-Probe; San Diego, CA) can be used for detection of M tuberculosis nucleic acid directly from respiratory specimens, in approximately the same turnaround time as an AFB smear.2 In clinical trials, the MTD has had high specificity; and for smear-positive respiratory specimens, high sensitivity.34 However, the majority of published MTD studies567 were performed from the laboratory perspective. There is a need for better understanding of MTD performance under routine testing conditions.38 In addition, to our knowledge, no studies have evaluated the impact of the MTD on clinical decisions during initial management of PTB suspects in routine practice.
In December 2003, the tuberculosis laboratory of the Maryland Department of Health and Mental Hygiene (DHMH) initiated routine MTD testing of respiratory specimens submitted for AFB smear and culture. The objectives of this retrospective study were to evaluate, under routine clinical conditions, the accuracy of the MTD test and its impact on clinical decisions.
Materials and Methods
Study Design and Subjects
There were two components to this retrospective study: a laboratory study to determine MTD accuracy, and a clinical study to evaluate impact of MTD use on clinical decisions. This study was approved by institutional review boards of Johns Hopkins University, the Baltimore City Health Department, and the Maryland DHMH.
The TB Laboratory of the Maryland DHMH serves as the primary mycobacteriology laboratory for the Baltimore City Health Department as well as for all public tuberculosis control programs in Maryland. This laboratory routinely performs the MTD on respiratory specimens submitted for AFB smear and mycobacterial culture.
For the laboratory study, records were reviewed from PTB suspects in whom MTD, AFB smear, and mycobacterial culture tests were routinely performed on respiratory specimens at the TB Laboratory of the Maryland DHMH between December 2003 and March 2006. A minimum of one and a maximum of three specimens per patient were included in the study. Individual specimens were not included in the data analysis if either the culture was contaminated or the MTD result was equivocal.
To evaluate the impact of MTD use on clinical decisions, clinical records were reviewed for all smear-positive PTB suspects undergoing initial diagnostic evaluation at the Baltimore City Health Department between December 2000 and March 2006. Patients evaluated between December 2003 and March 2006 were classified as the "MTD group" because MTD testing was performed routinely during this period. Patients evaluated between December 2000 and March 2003 were classified as the "non-MTD group" because the MTD was not available during that period. Patients were excluded if they had received antituberculosis therapy for
7 days prior to specimen collection. The definitive diagnosis was considered to be tuberculosis if culture findings were positive for M tuberculosis, and/or a full course of tuberculosis treatment was prescribed and the patient was reported as a tuberculosis case to the Maryland DHMH. For each group, the following were determined and compared: (1) concordance between definitive diagnosis and clinician presumptive diagnosis (at the time of availability of MTD results and positive smear results); and (2) median duration of tuberculosis treatment for patients who did not have a definitive diagnosis of tuberculosis (duration of "nonindicated" tuberculosis treatment).
AFB Smear
Respiratory specimens were digested, decontaminated, and concentrated by the NALC-NaOH method.9 A smear of the processed sediment was stained by the Truant fluorescence acid-fast staining method (auramine O-rhodamine B). Microscopy and results reporting were according to published standards.9
Culture
A 0.5-mL portion of the decontaminated specimen was inoculated into liquid culture medium (Bactec 12B; Becton, Dickinson and Company; Franklin Lakes, NJ), and 0.2 mL was inoculated onto one Lowenstein Jensen slant. Liquid cultures were incubated at 37°C for 6 weeks. Lowenstein Jensen slants were incubated at 35°C and examined weekly for 8 weeks. Mycobacterial isolates were identified using DNA probes (Accuprobe; Gen-Probe) or by the Bactec NAP test (Becton, Dickinson and Company) or by conventional biochemical tests.10
MTD
The MTD assay was performed according to the protocol of the manufacturer.11 Sample results were interpreted as follows: negative, < 30,000 relative light units (RLU); positive, > 500,000 RLU; and equivocal, 30,000 to 499,999 RLU. For samples read as equivocal, either a second specimen was tested or the first specimen was retested. If the second result was > 30,000 RLU, the test was interpreted as positive; if the second result was < 30,000 RLU, the test was interpreted as negative.11 MTD results were reported if the negative control was < 20,000 RLU and the positive control was > 1,000,000 RLU. To minimize potential impact of endogenous amplification inhibitors, for each clinical respiratory specimen two tests were run in parallel: one using an undiluted aliquot of the concentrated specimen, and the other using a 1:10 dilution of the concentrated specimen.5 If either test result was positive, the respiratory specimen was considered MTD positive.
Statistical Analysis
Sensitivity, specificity, PPV, and negative predictive values (NPV) of the MTD were estimated using mycobacterial culture as the "gold standard." Results were analyzed on a "first-specimen", "per-specimen", or "per-patient" basis. For the per-patient analysis, a patient was considered AFB smear positive if any smear finding was positive, and AFB smear negative if all smear findings were negative.
2 test and Fisher exact test were used to analyze differences between proportions. McNemar test was used to analyze differences in paired-group proportions. Medians were compared using Mann-Whitney test; a p value of 0.05 was considered statistically significant.
Results
Laboratory Performance of the MTD
A total of 1,158 respiratory specimens from 641 PTB suspects were tested. Four specimens were excluded from the analysis: one because the culture was contaminated, and three because the MTD result was equivocal. Three patients (three specimens) were excluded due to receipt of
7 days of tuberculosis treatment prior to specimen collection.
Characteristics of the remaining 1,151 specimens and 638 PTB suspects are shown in Table 1 . Among 420 patients with two or three tested specimens, 20 patients (4.8%) had discordant MTD results between specimens; however, all 20 patients had at least one specimen that was MTD positive and culture positive for M tuberculosis.
|
|
Impact of MTD Test on Clinical Decisions
During the study period, 107 smear-positive PTB suspects were evaluated at the Baltimore City Health Department. Fifty PTB suspects were included in the MTD group, and 57 were included in the non-MTD group. Patient characteristics are shown in Table 3
. In the non-MTD group, 47 of 57 patients (82.5%) had a definitive diagnosis of tuberculosis, including 46 patients who were culture positive for M tuberculosis, and 1 patient with clinical tuberculosis diagnosis in the setting of negative culture findings. In the MTD group, 30 of 50 patients (60%) had a definitive diagnosis of tuberculosis, all of whom had at least one positive culture finding for M tuberculosis.
|
|
To further characterize the observed and the potential impact of MTD on clinical care, we determined the duration of tuberculosis treatment prescribed to each patient whose definitive diagnosis was not tuberculosis. The median duration of nonindicated TB treatment was 6 days for the MTD group, vs 31 days for the non-MTD group (p = 0.002).
Discussion
Under routine testing conditions, the MTD had high accuracy and rapidly detected more than half of smear-negative PTB cases. For smear-positive patients, the potential impact of MTD testing on clinical decision making was high, given 98% concordance between MTD results and definitive diagnoses. However, there was no observed impact: clinicians made correct initial treatment decisions for approximately 80% of patients whether or not MTD was available. Failure of clinicians to correctly use negative MTD results for clinical decision making led to inaccurate initial diagnosis and treatment decisions in approximately half of patients with a final diagnosis of not tuberculosis.
Our study provides much-needed information about MTD performance under routine conditions in a public health laboratory. To date, most published information about MTD performance was obtained in the context of prospective laboratory studies designed to determine assay performance, and performed mostly in academic medical centers. Information obtained under such circumstances may not be reproducible under nonstudy testing conditions due to differences in staff workload, specimen selection, and other factors. Interestingly, however, MTD performance in our study was remarkably similar to that reported in other studies,36713 supporting the robustness of this test and feasibility in routine laboratory settings.
The MTD was able to rapidly detect M tuberculosis in approximately 60% of patients for whom all smear findings were negative. Prompt confirmation of tuberculosis can benefit the individual patient because treatment can be initiated. While it can be argued that many smear-negative PTB suspects are correctly initiated on antituberculosis treatment based on factors such as chest radiograph appearance and/or clinical suspicion, early microbiologic confirmation of a tuberculosis diagnosis can be helpful in cases in which drug toxicity or drug-drug interactions arise. Prompt confirmation of PTB can also have public health benefits because steps to minimize transmission can be taken.
A potential benefit of the MTD (with a demonstrated high NPV) would be to avert tuberculosis treatment in smear-positive individuals who do not have tuberculosis. Unexpectedly, tuberculosis treatment was initiated for approximately half of smear-positive PTB suspects in whom a negative MTD result was available to the clinician; none of these patients had a final diagnosis of tuberculosis. Since MTD results were reported on the same forms as smear results, it is unlikely that problems with result receipt by clinicians played a role. For MTD, the NPV was 98% when all 272 smear-positive TB suspects were considered, and 100% when the 50 MTD group patients were considered. In this situation in which the NPV of the MTD is high but not perfect, the potential risks and costs to the patient (of initiation of treatment that is highly likely to be not indicated) must be weighed against the potential consequences of failure to promptly treat or isolate the very small proportion of smear-positive, MTD-negative tuberculosis patients.
Along these lines, in our study approximately 35% of mycobacterial isolates from smear-positive patients were NTM during the period 2003 to 2006. Although in the United States NTM disease is not reportable, its frequency appears to be increasing over time, with coincident decreases in tuberculosis rates.1415 Therefore, tools for rapid discrimination between tuberculosis and NTM pulmonary disease, especially in smear-positive patients, are increasingly needed in order to facilitate accurate decisions about individual treatment and public health activities.
Our retrospective study has important limitations. The technologists performing the MTD tests were not blinded as to the clinical status of patients, but rather were in communication with tuberculosis clinicians as per routine. While we do not believe that this influenced MTD results, it may have influenced numbers of specimens submitted/tested for individual patients. The MTD group and the non-MTD group were comprised of tuberculosis suspects from different time periods; although all attended the same tuberculosis clinic, there may have been unrecognized differences in clinical suspicion for tuberculosis or clinical decision making (not related to MTD).
In conclusion, in this routine public health setting, MTD performance characteristics were similar to those previously reported under "study" conditions. Incorporation of MTD testing into routine public health laboratory algorithms could aid in the initial management of PTB suspects.
Footnotes
Abbreviations: AFB = acid-fast bacilli; CI = confidence interval; DHMH = Department of Health and Mental Hygiene; MTD = Amplified Mycobacterium tuberculosis Direct Test; NPV = negative predictive value; NTM = nontuberculous mycobacteria; PPV = positive predictive value; PTB = pulmonary tuberculosis; RLU = relative light unit
Dr. Dorman was supported by grants K23AI51528 and U19AI45432 from the National Institutes of Health. Dr. Guerra was supported by grants D43 TW05574–01 and U2R TW006883 from the National Institutes of Health.
The authors have no conflicts of interest to disclose.
Received for publication December 13, 2006. Accepted for publication May 16, 2007.
References
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |