|
|
||||||||
Guest Access | Sign In via User Name/Password |
|||||||||

* From the Department of Medicine (Dr. Schünemann), State University of New York at Buffalo, Buffalo, NY; Department of Clinical Epidemiology and Biostatistics (Ms. Griffith, Ms. Austin, and Dr. Jaeschke) and Department of Medicine (Drs. Stubbing and Guyatt), McMaster University, Hamilton, ON, Canada; and Department of Medicine (Dr. Goldstein), University of Toronto, Toronto, ON, Canada.
Deceased.
Correspondence to: Holger J. Schünemann, MD, PhD, McMaster University Health Sciences Centre, Room 2C12, Hamilton, ON, L8N 3Z5, Canada
| Abstract |
|---|
|
|
|---|
Methods: We enrolled 51 patients who completed the standardized and individualized CRQ before starting a respiratory rehabilitation program, and again 3 months later. We calculated both cross-sectional and longitudinal correlations between the two versions and a number of other HRQL instruments, and tested the relative ability of the individualized and standardized versions of the CRQ to detect improvement with rehabilitation.
Results: The results of the individualized questions suggested greater dysfunction (lower scores) than did the standardized questions both at baseline (3.18 vs 3.92, p < 0.001) and follow-up (4.62 vs 4.84, p = 0.051). The standardized dyspnea domain showed superior discriminative validity. While both techniques detected important, statistically significant improvement with rehabilitation (individualized domain mean change, 1.44; 95% confidence interval [CI], 1.11 to 1.77 [p < 0.001]; standardized domain mean change, 0.92; 95% CI, 0.61 to 1.24 [p < 0.01]), the difference in effect was substantial and statistically significant (mean difference, 0.52; 95% CI, 0.22 to 0.82; p = 0.001). The two versions showed comparable longitudinal validity.
Conclusions: A standardized version of the CRQ dyspnea domain improves the cross-sectional validity, maintains longitudinal validity, but reduces the responsiveness. By increasing sample size, investigators can use the more efficient standardized version of the CRQ without compromising validity.
Key Words: COPD health-related quality of life respiratory questionnaires responsiveness
| Introduction |
|---|
|
|
|---|
Although respondents are provided with a list of activities to choose from during completion of the CRQ dyspnea questions, the composition of chosen activities differs from patient to patient. Investigators have criticized the individualized CRQ on a number of counts. Tu et al7 stated that the individualized dyspnea domain limits comparison across different settings, because individual patients chose different activities causing dyspnea. Other investigators8 9 10 have criticized the individualized dyspnea domain because of the time required to elicit activities from participants, and difficulties with ensuring that patients perform activities regularly to allow evaluation at repeated administrations.
In theory, however, individualization of the dyspnea domain optimizes the evaluative properties of the CRQ by increasing the ability to detect change within patients or patient groups (responsiveness); therefore, individualized administration may avoid missing small but important treatment-mediated differences. While the original CRQ is both responsive and valid,11 the extent to which the individualized questions contribute, or detract from, this responsiveness and validity remains unknown.
Investigators may be interested in the ability of the CRQ dyspnea domain to distinguish between individuals with regard to their shortness of breath in daily activities at a point in time (its discriminative properties) and its ability to measure change in shortness of breath in daily activities over time (its evaluative properties). The aim of this study was to develop a standardized version of the CRQ and test its discriminative and evaluative properties against the individualized instrument. We conducted a study in which we administered the individualized and standardized CRQ before and after a 3-month respiratory rehabilitation program while administering other HRQL instruments used in patients with COPD. The rationale for administering several other disease specific and generic validation instruments was the comparison of measurement properties of the dyspnea domain across a wide range of correlations.
| Materials and Methods |
|---|
|
|
|---|
We therefore had randomized 85 patients with CAL to the blind or informed CRQ and SGRQ and to the administration of the FT with or without rating of three marker states prior to rating of their own health state using a 2 x 2 factorial design.12
13
In addition, patients completed a series of other HRQL instruments both at the baseline and at the visit following the standardized rehabilitation program. We accounted for possible small effects of order of administration by randomizing patients to complete the HRQL instruments. At follow-up, the same interviewer administered or supervised the administration of the instruments to each patient in the same order as at baseline. The SGRQ, health utilities index 3 (HUI3), transition dyspnea index (TDI), sickness impact profile (SIP), and psychological adjustment to illness scale were self-administered and supervised by the interviewer; all other instruments were interviewer administered. For all instruments, we asked patients to rate their health as it had been in the prior 2 weeks. We excluded patients if they were unable to complete questionnaires due to language or cognitive limitations, or if they had a diagnosis of
1-antitrypsin deficiency, silicosis, sarcoidosis, asbestosis, lupus, or cancer.
HRQL Instruments
Because we became increasingly aware of the criticism related to the individualized administration of the CRQ after the original trial had commenced, we introduced a standardized set of questions about dyspnea after the initiation of that trial. Thus, of the 85 patients completing the original trial, only 51 patients completed the standardized dyspnea questions in addition to the individualized dyspnea questions.
We obtained the five activities for inclusion in the standardized dyspnea domain from previous trials.14 15 These activities were as follows: (1) feeling emotional, such as angry or upset; (2) taking care of basic needs (bathing, showering, eating, or dressing); (3) walking; (4) performing chores (such as housework, shopping, groceries); and (5) participating in social activities (see Appendix). The activities we chose were either those that patients who participated in these previous studies14 15 ranked most frequently as among the five important activities causing shortness of breath, or captured important aspects of emotional and social functioning (feeling emotional, such as angry or upset; and participating in social activities).
The individualized dyspnea domain lets patients choose five activities that are most important to them in their daily lives (see Appendix). Patients then rate the degree of dyspnea on these self-selected activities during subsequent administrations of the CRQ. Patients rate their experience on a 7-point scale ranging from 1 (maximum impairment) to 7 (no impairment). The standardized questions were scored in identical fashion, but each patient was required to rate their dyspnea on the same five activities. We calculated the mean score for the individualized and standardized dyspnea domains by summing the scores for each dyspnea question and dividing it by the number of scored dyspnea questions (which ranged from two to five items).
All patients included in this analysis completed the standardized dyspnea questions in addition to the individualized dyspnea questions of the original CRQ. The order of administration of the individualized and standardized dyspnea questions at baseline was as follows: (1) patients chose the individualized activities from the original CRQ and ranked them according to importance, (2) patients rated their shortness of breath for the five standardized dyspnea questions, and (3) patients rated their shortness of breath for their individualized activities. At the follow-up visit, patients first rated their dyspnea on the five standardized activities and then on the individualized activities they had identified at the baseline visit. At this follow-up visit, for both standardized and individualized items, ratings included those activities for which the patients had provided a rating at the baseline visit.
In addition to the CRQ, we administered the following HRQL instruments: SGRQ, the Short-Form 36 (SF-36),16 standard gamble (SG),17 FT,17 HUI3,18 SIP,19 TDI (administered at follow-up),20 and global ratings of change.21 At the follow-up visit, the same interviewer administered or supervised the administration of the instruments to each patient in the same order as at baseline. The SGRQ, HUI3, TDI, and SIP were self-administered and supervised by the interviewer; all other instruments were interviewer administered.
Statistical Analysis
The primary focus of this study was the comparison of the standardized CRG with the individualized CRQ. First, we were interested in the distribution of the scores of the dyspnea questions and the number of missing items. We then compared the mean scores of the standardized and individualized CRQ dyspnea questions. We tested for the presence of interaction between dyspnea domain method (individualized or standardized) and CRQ administration technique (blind or informed) and the format of FT administration (with or without hypothetical health states) using analysis of variance. We found no evidence of an interaction (p > 0.1).
Discriminative Properties:
We evaluated cross-sectional validity of the standardized and the individualized dyspnea domain using data from the baseline and follow-up visit. For this evaluation, we calculated Pearson correlation coefficients of the individualized and standardized dyspnea questions with the other CRQ domains, the SGRQ, FT, SG, HUI3, SF-36, baseline dyspnea, and the SIP domains.
Evaluative Properties:
To assess the relative responsiveness of the standardized and individualized dyspnea domains, we calculated the mean change between baseline and follow-up scores and the corresponding 95% confidence limits for each method. To determine if any apparent differences in responsiveness could be explained by chance, we compared the difference of the change in CRQ scores between the standardized and individualized question groups using a paired t test. To evaluate the longitudinal validity of the standardized and the individualized dyspnea domain, we calculated Pearson correlation coefficients of the change in scores of the two administration modes with the change in the validation instruments.
| Results |
|---|
|
|
|---|
|
|
|
|
|
|
|
|
| Discussion |
|---|
|
|
|---|
Compared to the standardized questions, the individualized items tended to produce a narrower distribution of scores and a lower mean score (Figs 1 , 2) . It is likely that the opportunity to focus on their most important activities led patients to choose individualized items on which they experienced very troublesome dyspnea. The standardized approach does not permit this focus, resulting in items that may make some patients very short of breath, but cause milder degrees of dyspnea in others. Standardizing the dyspnea domain improves the discriminative properties of the CRQ dyspnea domain.
These differences in mean and distribution are associated with important differences in measurement properties. The wider distributions may have contributed to higher correlations between standardized items and other HRQL instruments than between individualized items and those same instruments (Tables 2 , 3) . These higher correlations suggest improved discriminative validity of the standardized approach, an important measurement property for differentiating severity of HRQL impairment between patients.
At the same time, when patients start with a lower mean score at baseline, an intervention can potentially lead to greater improvement and thus greater responsiveness. Several authors3 7 8 9 10 have suggested that the individualization of dyspnea items as an important limitation of the CRQ, sometimes without acknowledging the possible benefits in terms of measurement properties. As it turns out, our results show significantly larger change scores, and lower p values, in the individualized compared to the standardized questions. The greater responsiveness of the individualized approach was both substantial, and statistically significant (Table 4) .
What is the significance of this difference in responsiveness? In terms of effect size, standardization of the dyspnea questions reduced the effect size by approximately 36% (mean change of 0.92 on the standardized domain divided by a mean change of 1.44 on the individualized domain with a SD of 1.0). Maintaining a power of 0.8 at an
of 0.05, this reduction in responsiveness would lead to an approximate 2.5-fold increase in sample size in a trial comparing a new treatment to a control group with the dyspnea domain as primary outcome measure. For example, to show an improvement of 0.5 (SD of 1) using the standardized questions, would increase the sample size from 63 to 154 per group.
The impact of this decreased responsiveness may be important for clinical trials in which limitation of patient numbers potentially compromises the power of the study. In such studies, investigators should consider using the individualized CRQ dyspnea domain. At the same time, changing to standardized items did not attenuate the correlation between change in the CRQ dyspnea domain and change in other HRQL measures. Thus, if increases in sample size are feasible, and investigators feel the greater convenience of the standardized items is important in their study, they can choose the standardized approach without fearing they are compromising the validity of the CRQ as a measure of change over time. Although we did not measure the time needed for administration of the individualized and the standardized version of the CRQ in this study, we have done so as part of another study (unpublished data). The mean duration for administration of the individualized CRQ without the standardized activity questions was 16 min (SD 6 min) at baseline and 10 min (SD 4 min) at follow-up. For the CRQ using the standardized dyspnea domain, the required time was 8 min (SD 3 min) both at baseline and follow-up.
We found that the standardized approach led to a larger number of missing items. This finding is not surprising because in choosing individualized items, patients are instructed to select items that are both important to them and that they have undertaken in the last week. No such restrictions of either importance or recent performance apply to the standardized items, making it far more likely that respondents will not have undertaken the activity during the time frame specified in the questionnaire. At the same time, patients almost invariably completed at least four standardized dyspnea items (Fig 3) . Given prior results suggesting that reducing the number of items from five to two has only a small impact on responsiveness and validity,22 it is not surprising that imputing results on the basis of the items that were completed maintained the measurement properties of the standardized CRQ in terms of validity. It is possible, however, that the missing items contributed to the decreased responsiveness of the standardized approach.
Strengths to the present study include the use of multiple other questionnaires allowing us to thoroughly explore the relative validity of the two formats of measuring the impact of dyspnea on HRQL. We elicited the individualized dyspnea items prior to administering standardized questions. As a result, it is not possible that the standardized item could have influenced the patients choice of their most important activities. In addition, administration of the other instruments was highly standardized. Finally, the use of an intervention with known efficacy in HRQL14 ensured that we could compare responsiveness between the individualized and standardized techniques.
Our study is limited in that we included only 51 of the 85 patients enrolled in the original trial; however, the included patients were similar to those who were enrolled early in the trial (Table 1) and, thus, selection is unlikely to have influenced the results. Another limitation is that we cannot exclude order effects: responses to the individualized questions might have influenced responses to standardized items. A parallel-group, randomized controlled trial in which patients completed only one version of the dyspnea questions would be required to definitively exclude the possible impact of one approach on the other.
In summary, our study suggests that use of a standardized version of the CRQ dyspnea domain improves discriminative properties of the CRQ in terms of cross-sectional validity, but reduces responsiveness. By increasing sample size, investigators can use the more efficient standardized version of the CRQ without compromising validity or statistical power.
| Appendix |
|---|
|
|
|---|
I would now like you to describe how much shortness of breath you have experienced during the last 2 weeks while doing the five most important activities you have selected. Please indicate how much shortness of breath you have had during the last 2 weeks while (interviewer will insert activities 1 through 5 from list 1the question is repeated five times, once for each activity) by choosing one of the following options from the card in front of you:
Not done
List 1
Individualized Dyspnea Questions (Read by Interviewer)
I would like you to think of the activities that you have done during the last 2 weeks that have made you feel short of breath. These should be activities that you do frequently and that are important to your day-to-day life. Please list as many activities as you can that you have done during the last 2 weeks that have made you feel short of breath.
Can you think of any other activities you have done during the last 2 weeks that have made you feel short of breath?
I will now read a list of activities that make some people with lung problems feel short of breath. I will pause after each item long enough for you to tell me if you have felt short of breath doing that activity during the last 2 weeks. If you have not done the activity during the last 2 weeks, just answer "NO." The activities are as follows:
List 2
Of the items you have listed, which is the most important to you in your day-to-day life? I will read through the items. When I am finished, I would like you to tell me which is the most important (interviewer will read through all items spontaneously volunteered, and those on the list that the patient mentioned).
Which of these items is most important to you in your day-to-day life? (Interviewer will list items on response sheet.)
Of the remaining items, which is the most important to you in your day-to-day life? I will read through the items. When I am finished, I would like you to tell me which is the most important (interviewer will read through the remaining items).
Which of these items is most important to you in your day-to-day life? (Interviewer will list items on the response sheet. This question is repeated three more times.)
I would now like you to describe how much shortness of breath you have experienced during the last 2 weeks while doing the five most important activities you have selected. Please indicate how much shortness of breath you have had during the last 2 weeks while (interviewer will insert activities 1 through 5 from the response sheet) by choosing one of the following options from the card in front of you:
| Acknowledgements |
|---|
| Footnotes |
|---|
This work was supported by a grant from the Medical Research Council of Canada (Dr. Guyatt), and by an unrestricted grant from Astra Pharmaceuticals, Mississauga, ON, Canada, and from Astra Draco R&D, Lund, Sweden, and by a Buswell Fellowship (Dr. Schünemann) from the Ralph Hochstetter Medical Research Fund in honor of Drs. Henry C. and Bertha H. Buswell.
Received for publication December 17, 2002. Accepted for publication March 25, 2003.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
W. Harnisch, S. Brosch, M. Schmidt, and R. Hagen Breathing and Voice Quality After Surgical Treatment for Bilateral Vocal Cord Paralysis Arch Otolaryngol Head Neck Surg, March 1, 2008; 134(3): 278 - 284. [Abstract] [Full Text] [PDF] |
||||
![]() |
M Decramer, R Gosselink, M Rutten-Van Molken, J Buffels, O Van Schayck, P-A Gevenois, R Pellegrino, E Derom, and W De Backer Assessment of progression of COPD: report of a workshop held in Leuven, 11-12 March 2004 Thorax, April 1, 2005; 60(4): 335 - 342. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. J. Schunemann, R. Goldstein, M. J. Mador, D. McKim, E. Stahl, M. Puhan, L. E. Griffith, B. Grant, P. Austin, R. Collins, et al. A randomised trial to evaluate the self-administered standardised chronic respiratory questionnaire Eur. Respir. J., January 1, 2005; 25(1): 31 - 40. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |