|
|
||||||||
Guest Access | Sign In via User Name/Password |
|||||||||
* From the Division of Pulmonary and Critical Care Medicine (Dr. Heffner), Medical University of South Carolina, Charleston, NC; School of Law (Mr. Heffner), University of Texas, Austin, TX; and Lovelace Health Systems and the University of New Mexico School of Medicine (Dr. Brown), Albuquerque, NM.
Correspondence to: John E. Heffner, MD, FCCP, Medical University of South Carolina, Division of Pulmonary and Critical Care Medicine 812 CSB, 96 Jonathan Lucas St, PO Box 250623, Charleston, SC 29425; e-mail: heffnerj{at}musc.edu
| Abstract |
|---|
|
|
|---|
Data sources: MEDLINE, systematic reviews, article reference lists, and contact with primary authors.
Study selection: Studies that assessed the impact of pleural fluid pH on survival and pleurodesis failure rates among patients with malignant pleural effusions.
Data extraction: Primary authors provided their data in electronic spreadsheets.
Data synthesis: Retrieved data sets included survival and pleurodesis failure rates for 417 patients and 433 patients, respectively. Binary, multilevel, and continuous likelihood ratios were calculated to estimate the likelihood of death within 3 months of pleurodesis or pleurodesis failure rates. Values for the likelihood ratios were compared for each of the three strategies, and relative clinical and statistical significance were assessed. Pleural fluid pH had marginal performance for identifying patients with < 3-month anticipated survival; binary likelihood ratios provided as much information as the multilevel and continuous strategies. Likelihood ratios for identifying patients likely to fail pleurodesis were clinically useful. Continuous likelihood ratios provided statistically more information as compared with the multilevel and binary strategies.
Conclusions: Pleural fluid pH has marginal value for estimating death within 3 months of pleurodesis, and binary likelihood ratios (cut point ≤ 7.20) perform as well as the other strategies assessed. Pleural fluid pH provides more useful information for estimating the likelihood of pleurodesis failure for which continuous likelihood ratios provide the most information as compared with binary or multilevel likelihood ratios.
Key Words: diagnostic testing malignant pH pleura pleural effusions
| Introduction |
|---|
|
|
|---|
No predictive models exist, however, to identify appropriate patients for pleurodesis. Several reports have observed an association between a low pleural fluid pH and failure of pleurodesis.4 5 6 7 8 9 Additional studies have observed a direct correlation between pleural fluid pH and survival.4 10 11 12 13 On the basis of these studies, the ATS/ERS statement on malignant pleural effusions recommends the adjunctive use of pleural fluid pH with other clinical factors to select patients for pleurodesis.1 Expert opinion has suggested that patients with pleural fluid pH values less than a cut-off value of 7.20 should not be considered for pleurodesis.14
Unfortunately, the use of a single cut-off value dichotomizes patients and loses much of the diagnostic information contained within continuous numeric test results, such as pH.15 Dichotomization treats pH results just below and those extremely below the cut-off point the same. Experts in diagnostic test research recommend a Bayesian approach, wherein pH test results would be used to calculate likelihood ratios,16 which allow clinicians to estimate the posttest probabilities of a condition from their pretest clinical suspicions that the condition exists. A likelihood ratio for any test result value is calculated by dividing the number of patients with that test result who have a target condition by the number of patients with the test result who do not have the target condition. A clinicians estimate of the pretest odds that a patient has a target condition can be multiplied by the likelihood ratio for a given test result, which computes the posttest odds. Likelihood ratios can be derived as binary likelihood ratios using a single cut-off test result value, multilevel likelihood ratios for intervals (or "strata") of test result values, or as continuous likelihood ratios calculated for discrete values of a pH test result.
We have previously reported the results of meta-analyses that examined the largest available data set to our knowledge of pleural fluid pH from patients with malignant effusions to determine the operating characteristics of pH binary strategy for selecting patients for pleurodesis.3 17 In the present report, we use the data set from this meta-analysis to calculate multilevel and continuous likelihood ratios for estimating the probability of successful pleurodesis and survival < 3 months for patients with malignant effusions. We also considered whether continuous likelihood ratios provide more clinically and statistically significant information as compared to multilevel and binary likelihood ratios.
| Materials and Methods |
|---|
|
|
|---|
Received data were entered into statistical software (JMP; SAS Institute; Cary, NC), In addition to survival data measured in months, patients were categorized by the "success" or "failure" of pleurodesis. A successful pleurodesis was defined as complete or partial radiographic resolution of a malignant effusion with improvement of dyspnea to a degree that subsequent pleural fluid drainage was not required. A pleurodesis failure encompassed all other patients.
For the determination of multilevel likelihood ratios, pleural fluid pH values were grouped into four ordinal strata: pH ≤ 7.00, pH > 7.00 to ≤ 7.20, pH > 7.20 to ≤ 7.40, and pH > 7.40. Multilevel likelihood ratios with 95% confidence intervals (CIs) were calculated for each rank by the method of Simel and coworkers.18 Binary likelihood ratios were also calculated for the binary testing strategy recommended by expert consensus for identifying patients who were likely to fail pleurodesis or die within a short interval after pleurodesis. This strategy dichotomizes patients with a pH cut-off point of 7.20 and identifies patients with a pH value ≤ 7.20 as having a higher probability of dying within 3 months and a higher probability of failing pleurodesis.
Continuous likelihood ratios were derived from logistic regression. Simple logistic regression was used to model pleural fluid pH test results as an estimate of survival < 3 months and as an estimate of failure of pleurodesis. A survival < 3 months was selected because expert consensus recommends avoiding pleurodesis for patients with short expected survivals.1
Continuous likelihood ratios and their 95% CIs were calculated from the regression equation parameters of the model using discrete pleural fluid pH values.19
This method uses the following equation to calculate continuous likelihood ratios: exp[ß(measured pH - x)], wherein the variable "measured pH" represents a discrete pH value for which a continuous likelihood ratio is being calculated. The logistic regression model derived the constant ß, along with
, using the pH values of the data set as estimates of < 3-months survival and failure of pleurodesis.19
The variable x represents the pH value for which the log odds at the prevalence of survival < 3 months or pleurodesis failure equals
+ ßx in the data set. The equation x = (ln[p/(1 p)]
)/ß was used to calculate x, wherein p is the prevalence in the data set of survival < 3 months or pleurodesis failure.
The following equation was used to calculate 95% CIs for continuous likelihood ratios: exp[(ß ± 1.96SE(ß))(x x)], wherein x is the measured pH and SE is the standard error for ß derived from logistic regression.19
Statistical differences between the multilevel and continuous likelihood ratios in estimating outcome were analyzed by a previously reported method that fits a logistic regression model with the multilevel ordinal predictor and the same model with the addition of the continuous pH predictor.19
A likelihood ratio test (referring to the logistic regression test rather than the likelihood ratios derived in this study) compared the two models to derive a
2 test with 1 degree of freedom. The difference between the
2 statistic for the multilevel likelihood ratios from the two models generated a
2 statistic, which was used to estimate the statistical significance of the added predictive ability provided by continuous likelihood ratios.
The continuous and multilevel likelihood ratios derived from the described methods were compared to the likelihood ratio derived from a binary testing strategy (cut-off value ≤ 7.20) to determine relative clinical advantages. These relative clinical benefits were qualitatively estimated by inspecting the degree by which likelihood ratios differed between testing strategies across a range of pH values.19 Relative clinical advantages were also estimated between a strategy that used multilevel as compared to continuous likelihood ratios. Clinical advantages were examined by comparing the range of continuous likelihood ratios for the lowest and highest pH values in the four ordinal pH strata with the multilevel likelihood ratios calculated for the same strata.19 Clinical advantages of the two testing strategies were also compared qualitatively by examining their plots across the range of continuous pH values. In determining clinical significance, we asked if the degrees of differences in likelihood ratios calculated by the different methods were sufficiently large to cause clinicians to make different decisions in clinical practice.
| Results |
|---|
|
|
|---|
The clinical characteristics of the 417 patients in the database used to calculate likelihood ratios for survival were previously reported.3 The median survival in this group was 4 months, and the prevalence of survival < 3 months was 41.0%. Multilevel likelihood ratios for survival with 95% CIs for the four ordinal pH strata are shown in Table 1 with the number of patients in each pH test result strata. Using the binary pH cut point of 7.20 for identifying patients with poor survival resulted in a binary likelihood ratio for pH values ≤ 7.20 of 1.70 (95% CI, 1.20 to 2.41) and for pH values > 7.20 of 0.31 (95% CI, 0.24 to 0.41) for estimating death within 3 months. These binary likelihood ratios were similar to the multilevel likelihood ratios for survival across the range of pH values (Table 1) . For example, a patient with a pleural fluid pH of 7.10 has a binary likelihood ratio of 1.70 (95% CI, 1.20 to 2.41) for death within 3 months of pleurodesis as compared with a multilevel likelihood ratio of 1.60 (95% CI, 1.06 to 2.42).
|
|
|
By using the above-derived equations, continuous likelihood ratios were calculated for the highest and lowest pH values in each of the strata used to calculate multilevel likelihood ratios for survival and pleurodesis failure (Tables 1 , 2) . These continuous likelihood ratio results were calculated to allow comparisons with binary and multilevel likelihood ratios for similar pleural fluid pH results. As shown in Tables 1 , 2 , continuous likelihood ratios differed from the multilevel likelihood ratios calculated for each strata and from the binary likelihood ratios. For instance, the binary likelihood ratio for death within 3 months at a pH value of 7.21 is 0.30, as compared with a multilevel likelihood ratio of 0.82 and a continuous likelihood ratio of 1.19 (Table 1) . The curves for the continuous likelihood ratios as a function of measured pH and the values for multilevel likelihood ratios within each pH interval are shown in Figures 1 , 2 . Multilevel likelihood ratios both over and under estimated the continuous likelihood ratios within each of the pH strata.
|
|
2 analysis. The
2 statistics for the survival data set (death within 3 months of pleurodesis) were 9.220 and 10.190 for logistic regression models fitted with the multilevel likelihood ratios alone and with the addition of the continuous likelihood ratios, respectively. The difference in the
2 statistics (10.190 - 9.220 = 0.970) indicated that the continuous likelihood ratios did not add statistically significant information to the multilevel likelihood ratios. The equivalent
2 statistics for the failure of pleurodesis data set were 25.445 and 20.110, respectively. The difference between the
2 statistics (25.445 20.110 = 5.34) demonstrated that the continuous likelihood ratios added a statistically significant degree of information to the multilevel likelihood ratios. In qualitatively examining the differences of multilevel vs continuous likelihood ratios for estimating survival shown in Figure 1 and Table 1 , we concluded that differences in likelihood ratio values were not sufficiently large to be clinically important. In inspecting the likelihood ratio values of the different strategies for estimating pleurodesis failure (Fig 2 , Table 2 ), differences appeared sufficiently large to provide a clinically important degree of added information by using the continuous likelihood ratio strategy. No association was found between the specific pleurodesis agent used and any of the measured end points.
| Discussion |
|---|
|
|
|---|
The results of this study assist clinicians in understanding the value of pH in selecting patients for pleurodesis and how pH values should be used to estimate posttest probabilities. Although the ATS/ERS statement on malignant pleural effusions recommends consideration of pleural fluid pH as an adjunctive test for estimating survival, the present study suggests that pH has little value for this purpose. As demonstrated in Figure 1 , continuous likelihood ratios follow a shallow curve across the range of pH values observed in malignant effusions. Consequently, extremely high as compared with extremely low pleural fluid pH results do not generate sufficiently different likelihood ratios to have an important impact on patient selection for pleurodesis. This observation agrees with our previous report that only 54% of patients with a low pH value < 7.28 die within 3 months.3 We can now extend these observations of the poor predictive value of pH on the basis of the present study to the entire range of pleural fluid pH results encountered in clinical practice.
It is clear from the results of this study that dichotomizing patients with a pleural fluid pH cut point of 7.20 and denying pleurodesis for patients with a pH values ≤ 7.20 on the basis of an estimated poor survival, as suggested by some experts, is unwarranted. If physicians choose to follow ATS/ERS recommendations and use pleural fluid pH as adjunctive data to estimate survival, they should adopt a Bayesian approach.15 This approach uses likelihood ratios to calculate the posttest probability of early death from a clinicians estimates of the pretest probability. Our data demonstrate that clinicians who employ this approach can use the simple binary likelihood ratio strategy (likelihood ratio of 1.70 for pH values ≤ 7.20) because it performs as well as multilevel or continuous likelihood ratios in estimating early deaths. For example, a physician who estimates a 50% pretest probability of death within 3 months would calculate a 63% posttest probability if pleural fluid pH was < 7.20 (see Appendix for equations). The modest increase in probability illustrates the marginal impact of pH on estimates of patient survival.
In contrast, pleural fluid pH provides more information for estimating pleurodesis failure. Multilevel likelihood ratios (Table 2) and the curve for the continuous likelihood ratios (Fig 2) for estimating failure increase to a greater degree from high to low pH values as compared to likelihood ratios for estimating death. Consequently, likelihood ratios associated with extremely low and extremely high pH values differ in their impacts on estimates of pleurodesis failure to a clinically important degree. For instance, a clinicians 50% estimate of the pretest probability of pleurodesis failure becomes a posttest probability of 82% for a patient with a pleural fluid pH of 7.00 (continuous likelihood ratio of 4.42 from Table 2 , or use of the equation exp[ 5.019(measured pH 7.296)]). The same 50% pretest probability for pleurodesis failure, however, decreases to a 37% posttest probability of failure if the patient has a pleural fluid pH of 7.40 (continuous likelihood ratio of 0.59 from Table 2 , or use of the equation exp[ 5.019(measured pH 7.296)]).
In using pH to estimate pleurodesis failure, however, our data indicate that continuous likelihood ratios represent the preferred strategy because they provide more information as compared with the binary or multilevel approaches. Our study indicated that continuous likelihood ratios provided more information on the basis of a statistical comparison (
2 analysis) and a clinical comparison (visual inspection of Fig 2
). Continuous likelihood ratios for pleurodesis failure can be easily calculated at the bedside by the equation exp[ 5.019(measured pH 7.296)], which can be entered into a spreadsheet on a personal digital assistant. Equations for the calculation of likelihood ratios for a broad array of diagnostic tests will most likely be included in hospital-based computerized decision support systems as a component of computerized physician order entry in the near future.
The present study is limited by the quality of the primary studies that examined the relationship between pH and outcome for patients with malignant pleural effusions. The limitations of these primary studies have been previously discussed.3 17 Considering that expert consensus recommends the use of pH in decision making, the results of the present study advance our understanding of how these test results should be used in clinical practice pending future primary investigations.
In conclusion, pleural fluid pH offers only modest information for identifying patients who are likely to die within 3 months of pleurodesis. If pH is used as adjunctive information for this purpose, binary likelihood ratios quantify the marginal impact of pH on survival estimates and avoid the unwarranted exclusion of all patients with a low pH from pleurodesis. Pleural fluid pH is more useful for identifying patients likely to fail pleurodesis if continuous likelihood ratios are used to calculate posttest probabilities from pretest estimates of pleurodesis failure. We suggest that large, multicenter studies are needed to identify other explanatory variables that will supplement the modest value of pleural fluid pH in predicting outcome after pleurodesis. The present study, however, provides a quantitative estimate of the predictive value of pleural fluid pH for individual patients to avoid an overinflation of its clinical importance.
| Appendix |
|---|
|
|
|---|
Convert pretest odds to posttest odds: posttest odds = likelihood ratio x pretest odds.
Convert posttest odds to posttest probability: posttest probability = posttest odds/(1 + posttest odds).
Examples of the Use of Likelihood Ratios for Estimating Pleurodesis Failure
| Footnotes |
|---|
This investigation was primarily performed at Medical University of South Carolina.
Received for publication June 5, 2002. Accepted for publication November 11, 2002.
| References |
|---|
|
|
|---|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |