Chest ACCP Career Connection
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     

Guest Access | Sign In via User Name/Password
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF) Free
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Article Archive
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via ISI Web of Science (17)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Baker, K. M.
Right arrow Articles by Hen, J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Baker, K. M.
Right arrow Articles by Hen, J., Jr
(Chest. 2003;124:2156-2163.)
© 2003 American College of Chest Physicians

Classifying Asthma*

Disagreement Among Specialists

Kirsten M. Baker, MD; Donald A. Brand, PhD and Jacob Hen, Jr, MD, FCCP

* From Children’s Medical Group, Hamden, CT; Department of Pediatrics and Center for Primary Care Education and Research, New York Medical College Valhalla, NY; and Department of Pediatrics, Bridgeport Hospital-Yale New Haven Health, Bridgeport, CT.

Correspondence to: Kirsten M. Baker, MD, Children’s Medical Group, 299 Washington Ave, Hamden, CT 06518; e-mail: kirsten{at}pol.net


    Abstract
 TOP
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 Conclusions
 Appendix
 References
 
Objective: The asthma practice guidelines developed by the National Institutes of Health include a system for classifying asthma severity. The goal of the present study was to assess the interrater reliability of this classification system by measuring agreement among pediatric asthma specialists.

Design: A survey containing eight case summaries was mailed to 24 board-certified pediatric allergists and pulmonologists, who were asked to classify each case according to the national guidelines. The case summaries included the patient’s medical history, physical examination, and chest radiograph and pulmonary function test results. Physicians were also asked to interpret the pulmonary function tests, to indicate the main factors used to classify each case (daytime symptoms, nighttime symptoms, pulmonary function testing, or various combinations), and to make treatment recommendations. {kappa} statistics were used to measure agreement.

Results: Fourteen of 24 surveys mailed (58%) were completed and returned. Agreement was poor for classifying asthma ({kappa} = 0.29; 95% confidence interval [CI], 0.25 to 0.33) and for the main factors used to make the classifications ({kappa} = 0.19; 95% CI, 0.14 to 0.23). Specialists exhibited higher agreement in their interpretation of pulmonary function tests (no asthma, {kappa} = 0.66; asthma on baseline, {kappa} = 0.53; exercise-induced asthma, {kappa} = 0.65). While physicians’ treatment recommendations were consistent with their severity classifications, the low level of agreement in those classifications led to substantial variability in the treatments recommended.

Conclusions: The low level of agreement among pediatric asthma specialists in classifying asthma severity suggests the need to refine the classification system used in the national guidelines to help ensure the consistent application of those guidelines.

Key Words: asthma • classification • guidelines


    Introduction
 TOP
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 Conclusions
 Appendix
 References
 
In response to a rise in asthma mortality during the 1980s,1 the National Institutes of Health convened an expert panel and published patient management guidelines in 1991.2 Updated in 19973 and again in 2002,4 these guidelines offer a system for classifying asthma severity and a set of treatment recommendations based on that classification. The system uses three variables—frequency of daytime symptoms, frequency of nighttime symptoms, and pulmonary function—to define four asthma categories: mild intermittent asthma and three levels of persistent asthma (mild, moderate, and severe).

For a classification system to be useful, different raters must be able to apply it in a consistent manner. A high level of interrater agreement could bolster acceptance of the guidelines among primary care physicians, who have been slow to adopt them.5 6 7 A low level of agreement would suggest the need for refining the classification system.

Although researchers have documented poor agreement among specialists in the interpretation of pulmonary function tests,8 9 we were unable to identify previous observer variation studies concerning the classification of asthma. The goal of the present study was therefore to assess the interrater reliability of the asthma classification system by measuring agreement among pediatric asthma specialists.


    Materials and Methods
 TOP
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 Conclusions
 Appendix
 References
 
Study Design
A survey was mailed to board-certified pediatric allergists and pulmonologists who had agreed to participate in the study. The survey included eight case summaries, and a multiple-choice questionnaire asking the physician to classify each case according to the 1997 guidelines, which were in effect at the time of the study. The classification portion of the guidelines was enclosed with the survey (Table 1 ). The case summaries were developed from the medical records of patients seen at The Pediatric Asthma Center at Bridgeport Hospital/Yale New Haven Health in Bridgeport, CT, between October 2000 and January 2001.


View this table:
[in this window]
[in a new window]

 
Table 1.. Classification of Asthma Severity*

 
The guidelines stipulate that the most severe of the three indicators—daytime symptoms, nighttime symptoms, and pulmonary function—determines the classification (Table 1) . The classification system specifies clinical features prior to treatment. However, in specialty practice many patients present who are receiving controller medications, and the physician needs to classify them. This situation is reflected in four of the eight case summaries, including the case presented in the Appendix. The Institutional Review Board at New York Medical College approved the study.

Survey Instrument
Each case summarized a patient’s first visit to the Pediatric Asthma Center, including medical, family, and environmental histories; physical examination; report of chest radiograph results; and pulmonary function test results if they were performed for the initial evaluation (the Appendix presents case 2 in its entirety). Cases were chosen to represent a variety of age groups and the four classification categories. One patient was included who had respiratory symptoms but did not have asthma in the judgment of the patient’s physician.

In addition to the asthma severity classification question, the questionnaire asked, for each case, whether symptoms vs pulmonary function determined the classification (Appendix). It also asked the physician to note any comorbid conditions and make treatment recommendations.

Since the classification system is based in part on pulmonary function, the physician was asked to interpret pulmonary function test results included with five of the eight case summaries. Three case summaries did not include test results because children < 5 years old are not usually able to perform the test. Respondents were therefore asked to interpret three additional pulmonary function tests to yield a total of eight tests, an adequate number for analyzing interobserver agreement. All of the pulmonary function tests were performed according to the American Thoracic Society standards.10 11 The questionnaire asked the physician to indicate his or her specialty, years in practice, and practice characteristics.

Statistical Analysis
{kappa} Statistics were used to measure agreement among the respondents.12 {kappa} Measures the extent of agreement among different raters by calculating the observed agreement corrected for the agreement that would be expected by chance. {kappa} Can range from – 1 to 1, with the following interpretation: <0.40 represents poor agreement, 0.40 to 0.75 represents fair to good agreement, and > 0.75 represents excellent agreement. The Stata software package (Intercooled Stata 7.0 for Windows 98/95/NT; Stata Corporation; College Station, TX) was used to perform statistical analysis.


    Results
 TOP
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 Conclusions
 Appendix
 References
 
Twenty-four of 26 physicians invited to participate accepted and were sent the survey. Of the 24 surveys sent, 15 were returned (5 of these were returned after reminders were sent), 14 of which were sufficiently complete to analyze. The response rate was therefore 58% (14 of 24 surveys). Respondents practiced in California, Connecticut, Delaware, Massachusetts, Missouri, Ohio, and Washington. Five respondents were allergists, seven were pulmonologists, and two practiced both specialties. Five respondents were community-based physicians, and nine respondents were hospital based. They averaged 13.3 years in specialty practice (range, 4 to 27 years), and 27.4 asthma patient visits per week (range, 3 to 80 visits). All participating physicians were board certified in pulmonology, allergy, or both.

Table 2 shows how the 14 physicians classified each of the eight cases. For example, case 1 was classified no asthma by 11 physicians, mild intermittent by 1 physician, and moderate persistent by 2 physicians.


View this table:
[in this window]
[in a new window]

 
Table 2.. Classification of Eight Cases by 14 Asthma Specialists*

 
Table 3 displays the {kappa} statistics. The overall {kappa} score of 0.29 for question 1 (95% confidence interval [CI], 0.25 to 0.33) indicates that the 14 asthma specialists exhibited poor agreement in classifying these cases. They demonstrated the greatest agreement for the mild intermittent category ({kappa} = 0.44). Even when mild persistent, moderate persistent, and severe persistent were combined into a single "persistent" category (data not shown), the {kappa} value for this combined category was 0.45 (95% CI, 0.41 to 0.49). While reducing the number of categories increased the overall {kappa} value to 0.43 (95% CI, 0.38 to 0.48), this value still represents only fair agreement.


View this table:
[in this window]
[in a new window]

 
Table 3.. Agreement Among Asthma Specialists in Their Responses to Questions About the Diagnosis and Treatment of Eight Patients

 
Question 2 asked the physician to indicate the key factors used to classify each case: daytime symptoms, nighttime symptoms, pulmonary function, both daytime and nighttime symptoms, or a combination of these. The overall level of agreement for this question was poor ({kappa} = 0.20), ranging from 0.03 to 0.31 for the different individual answers.

Since comorbid conditions can mimic or exacerbate asthma symptoms, respondents were asked to identify additional diagnoses that would apply to each case (question 3). Allergic rhinitis, sinusitis, vocal cord dysfunction, and gastroesophageal reflux were listed explicitly, and space was provided for writing in other diagnoses. {kappa} Scores ranged from 0.30 for vocal cord dysfunction to 0.80 for gastroesophageal reflux. It was not possible to compute an overall {kappa} score for question 3, 4, or 5 because the response categories were not mutually exclusive (ie, the physician was able to choose more than one category).

The specialists exhibited a higher level of agreement in their interpretation of the pulmonary function tests (question 4) than in their classification of asthma (question 1). Only one of the five responses to question 4 listed in Table 3 —asthma revealed by bronchodilator—fell into the "poor agreement" range.

One pulmonary function test came from a patient with a known fixed extrathoracic obstruction. Although the questionnaire did not include this abnormality as one of the choices, the physician was provided space to write in additional comments. If the physician noted obstruction of the upper airways or large airways, or described blunted inspiratory and expiratory loops in this space, that response was coded as positive for an extrathoracic obstruction. Otherwise, negative was assumed.

The specialists were asked to choose one or more treatments from a list of options (question 5). To assess agreement level for use of any anti-inflammatory medication, responses for daily inhaled steroid and other anti-inflammatory were combined into a single anti-inflammatory category (data not shown). The {kappa} value for the combined category was 0.41 (95% CI, 0.34 to 0.48).

Table 4 reports the respondents’ treatment recommendations according to their asthma classifications. Altogether, there were 112 classifications (eight cases x 14 respondents). Since the respondent could select more than one treatment option for a given patient, there are > 112 treatment recommendations. No treatment options were selected for five of the classifications, which are indicated as "question left blank" in Table 4 .


View this table:
[in this window]
[in a new window]

 
Table 4.. Summary of Responses to Question About Medication Plan, According to the Asthma Category Assigned by the Respondent*

 
Respondents recommended no asthma medication for 18 of the 25 "no asthma" classifications (72%) and daily inhaled steroids for 9 of the 9 "severe persistent" asthma classifications (100%). When mild, moderate, and severe persistent asthma were combined into a single "persistent" category (data not shown), respondents recommended daily inhaled steroids for 50 of the 54 persistent classifications (93%). They recommended some anti-inflammatory medication (daily inhaled steroid, other anti-inflammatory, or both) for 52 of these 54 classifications (96%).


    Discussion
 TOP
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 Conclusions
 Appendix
 References
 
When presented with the same clinical information about a series of pediatric asthma patients, specialists varied in the conclusions they drew. The 14 pediatric pulmonologists and allergists in this study exhibited poor agreement in their application of the asthma classification guidelines and in their treatment recommendations. Their poor level of agreement in assigning no asthma implies a problem not only in classifying asthma, but also in making the diagnosis. The physicians exhibited better agreement in their interpretation of pulmonary function tests.

Use of a simplified classification that combined mild, moderate, and severe persistent asthma into a single persistent asthma category still yielded only fair agreement among these physicians. This finding suggests that simplifying the existing classification in this manner would not, itself, result in a satisfactory level of agreement.

While it was surprising to discover the extent of disagreement among pediatric asthma specialists in how they classified patients, perhaps the variability should have been expected. Studies have documented observer variability within a number of subspecialties: in radiologists’ readings of sonograms of breast masses,13 in pathologists’ grading of dysplasia in ulcerative colitis,14 and in orthopedic surgeons’ classification of scoliosis,15 16 to name a few. Clearly, some disagreement is inevitable in the application of clinical judgment.

Reasons for Disagreement
What might account for the variability in the application of the asthma classification system by this group of asthma specialists? There are at least three potential explanations: variability in interpretation of symptoms, variability in interpretation of pulmonary function test results, and variability in the importance placed on symptoms vs pulmonary function.

Overlap in the symptoms of asthma and other comorbid conditions can result in differences of interpretation that may affect physicians’ classifications. A patient with frequent cough may be considered to have more severe asthma by a physician who interprets that cough as a symptom of asthma. This same patient may be considered to have mild asthma by a physician who interprets that cough as a symptom of allergic rhinitis. Since respondents exhibited a higher level of agreement in their interpretations of pulmonary function tests than in their asthma classifications, those interpretations probably do not account for a large portion of the variability in the classifications.

In contrast, respondents exhibited very low agreement on which factors—symptoms or pulmonary function—most influenced a patient’s classification. The perceived importance of symptoms vs pulmonary function, not merely how physicians interpreted each of these, affected their classification choices.

The handling of case 2 (Appendix) by different respondents illustrates how variation in the processing of clinical information can lead to different classifications and treatment choices. One respondent interpreted the pulmonary function test as negative for asthma, classified the patient accordingly, and recommended no asthma medications. This respondent indicated that the classification was based primarily on pulmonary function. Another respondent also interpreted the pulmonary function test as negative for asthma, but classified the patient as moderate persistent asthma and recommended daily and as-needed bronchodilator, daily inhaled steroid, and other anti-inflammatory asthma medications. This physician indicated that the classification was based primarily on daytime symptoms. While the treatments selected by these two physicians matched their classifications, their disagreement about the classification would have consequences for the patient: either the first physician recommended inadequate treatment or the second physician recommended excessive treatment.

Implications for Clinical Practice
The asthma guidelines developed by the National Institutes of Health were intended to improve patient outcomes by facilitating the diagnosis and treatment of this chronic condition. While asthma specialists in the present study recommended treatments that usually matched their severity classifications, they disagreed among themselves about those classifications. Since proper therapy depends on proper classification, one is forced to question the effectiveness of the official guidelines in serving their intended purpose.

In 2002, the National Institutes of Health released an update on selected topics of its national guidelines.4 Since the classification system in the updated guidelines remains essentially unchanged except for the omission of pulmonary function testing in patients < 5 years old, the findings reported here continue to be pertinent.

The clinical importance of the present findings rests on a chain of assumptions: (1) that our sample of specialists does not differ substantially from the general population of pediatric asthma specialists in ways that would markedly affect the findings, (2) that physicians would classify and treat actual patients in a manner similar to the way they handled the cases presented in the survey, (3) that disagreements could lead to nontrivial differences in treatment strategies, and (4) that those differences could potentially result in harm to some patients who would receive inadequate or inappropriate therapies.

The first two assumptions cannot be proven from our data, but they seem plausible and we have no reason to believe that they are not true. The remaining assumptions are supported by our findings. At minimum, therefore, our results suggest the need for confirmatory studies.

Study Limitations and Future Research
A survey cannot duplicate the experience of examining a patient and gathering a medical history. While this is a real limitation, it is also an advantage: physicians were all given the same information on which to base their decisions. It follows that disagreements must have occurred because physicians differed in their processing of the information rather than in their gathering of the information.

While a response rate close to 100% would be desirable, it has been shown that response rates to mail surveys are lower for physicians (54%) compared with nonphysicians (68%).17 Our 58% response rate is respectable for such a demanding survey given to busy physicians.

Since our survey was administered to a limited sample of specialists, a larger study could be useful for confirming the results reported here. Nevertheless, it should be noted that observer variation studies typically rely on a relatively small number of experts. For example, in the studies cited earlier13 14 15 16 the number of physicians ranged from 5 to 13. It is also important to note that data from the present sample yielded quite narrow CIs for most of the {kappa} statistics reported in Table 3 . It is therefore unlikely that a larger sample will produce markedly different results.

Future studies should also examine intraobserver reliability, that is, the extent to which an individual physician classifies the same asthma patient the same way when presented with identical information on different occasions. Additional studies should also evaluate these issues using adult asthma patients. Finally, studies should include a more detailed examination of the reliability of pulmonary function test interpretations.


    Conclusions
 TOP
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 Conclusions
 Appendix
 References
 
This study demonstrated substantial disagreement among pediatric asthma specialists in classifying a series of asthma patients. Since some disagreement is clearly inevitable in the application of clinical judgment, the findings of this study should not be viewed as a criticism of pediatric allergists and pulmonologists but as a challenge to develop methods for reducing the variability. As a first step, perhaps the expert panel of the National Institutes of Health, before releasing the next revision of its asthma guidelines, should require a full-scale reliability study to ensure that the guidelines can be applied in a consistent manner by their intended users.


    Appendix
 TOP
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 Conclusions
 Appendix
 References
 
Physician Survey

  1. How would you classify this patient’s asthma? (Choose one answer only)
    No asthma
    Mild intermittent
    Mild persistent
    Moderate persistent
    Severe persistent

  2. The above classification was based primarily on the basis of what? (Choose one answer only)
    Daytime symptoms
    Nighttime symptoms
    Pulmonary function
    Day and nighttime symptoms
    All of the above

  3. What other diagnoses would apply to this patient? (Choose all that apply)
    Allergic rhinitis
    Sinusitis
    Vocal cord dysfunction
    Gastroesophageal reflux
    Other

  4. The pulmonary function tests show the following: (Choose all that apply)
    Inadequate study
    No asthma
    Asthma on baseline
    Exercise-induced asthma
    Normal baseline, asthma revealed by bronchodilator
    Other findings

  5. What medication would you recommend for this patient’s asthma? (Choose all that apply)
    No asthma medications
    As-needed bronchodilator
    Daily bronchodilator
    As-needed inhaled steroid
    Daily inhaled steroid
    Other anti-inflammatory asthma medication

Case 2
John is a 13-year-old boy presenting to the specialist for initial evaluation in October 2000 (certain clinically insignificant details have been altered to ensure patient anonymity).

Pulmonary History: John’s breathing problems began when he was 2 years old, when he received a diagnosis of bronchitis, then pneumonia. Two years later, asthma was diagnosed. He did well until 2 years ago, when his symptoms increased. He did not do well until he was put on his present regimen 1 month ago. Now he has inspiratory wheezing when he is stressed, playing sports, or upset. Respiratory symptoms include shortness of breath, wheeze, dry cough, and tightness in the chest. Inspiratory wheeze can occur daily; nighttime symptoms occur once or twice a month.

Hospitalizations and Emergency Department Visits: John had one emergency department visit 1 year ago for asthma.

Warning Signs: Warning signs include cough, stuffed nose, runny nose, colds, behavior or personality changes, sneezing, dark circles under eyes, and raised shoulders.

Triggers: Triggers include colds, runny nose, changes in weather, spring and fall seasons, cats, air pollutants, cold air, emotions (laughing/upset), smoke, strong smells, dust/dust mites, molds, or mildew.

Other Medical Consultants: When John was 5 years old, he was seen by another pulmonologist, who recommended medications as needed.

Sports/Activities: John plays baseball and basketball. Problems during these activities include respiratory wheeze in the throat.

Allergies: Cat.

Medical History: Birth weight was 8 lb, 7 oz. Pregnancy, labor, and delivery were normal. Growth and development were normal. John as a history of GI reflux, and currently has food come up once a week. He has a history of hay fever. There is no history of sinusitis, eczema, nasal polyps, or ear infections.

Family History: John’s mother is 36 years old and has gastroesophageal reflux disease and allergies. John’s father is 44 years old and has hay fever. John’s brother is healthy, and his sister has seafood allergies. John’s grandmother has asthma, bronchitis, and gastroesophageal reflux disease.

Irritants and Controls in the Home Environment: Irritants include oil heat, damp basement, dog (never in bedroom), smoker at father’s house (visits every other weekend), real Christmas tree, curtains seldom washed, no dust mite covers on pillows/mattress/box spring, dust. Controls include frequently used room air conditioner and no carpets.

Vital Signs: John’s weight is 93 lb, heart rate is 69 beats/min, BP is 94/52 mm Hg, height is 63 inches, respiratory rate is 22 breaths/min, and oxygen saturation on room air is 98%.

Physical Examination: John is well developed, well nourished, and has no respiratory distress. Head examination is within normal limits, except for allergic shiners and mild nasal congestion. Pupils were equal, round, and reactive to light. Tympanic membranes were normal. Nose was clear for rhinorrhea, with gray, pale, and swollen turbinates. Throat showed no erythema or exudates, positive for postnasal drip, and 2+ tonsils. Neck was supple, with no masses; trachea was midline. Chest showed normal anteroposterior diameter, and no retractions. Cardiovascular was benign, and abdomen showed no hepatosplenomegaly. Extremities showed no clubbing. Neurologic evaluation was grossly intact. Skin showed no eczema, and lymph nodes showed no adenopathy.

Chest Radiography: A chest radiograph revealed mild hyperinflation at the time of evaluation.

Pulmonary Function: A pulmonary function test was performed on the day of evaluation (Appendix Table 1 ; Fig 1 ).



View larger version (25K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 1.. Left: Baseline and after exercise. Right: Baseline and after albuterol (albuterol administered after exercise test).

 


View this table:
[in this window]
[in a new window]

 
Table A1.. Pulmonary Function Test Results for Case 2*

 

    Acknowledgements
 
We thank the physicians who completed the surveys and Patricia Patrick, MPH, and Paul Visintainer, PhD, for assistance with statistical analysis.


    Footnotes
 
Abbreviation: CI = confidence interval

This work was performed at New York Medical College.

This study was supported in part by Health Resources and Services Administration award #1D12HP00022.

Received for publication February 25, 2003. Accepted for publication June 24, 2003.


    References
 TOP
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 Conclusions
 Appendix
 References
 

  1. . Centers for Disease Control and Prevention (1998) CDC surveillance summaries: surveillance for asthma-United States, 1960–1995. MMWR Morb Mortal Wkly Rep 47,SS-1
  2. National Asthma Education and Prevention Program. Expert panel report: guidelines for the diagnosis and management of asthma 1991 National Institutes of Health. Bethesda, MD: publication No. 91-3642
  3. National Asthma Education and Prevention Program. Expert panel report 2: guidelines for the diagnosis and management of asthma 1997 National Institutes of Health. Bethesda, MD: publication No. 97-4051
  4. National Asthma Education and Prevention Program. Expert panel report: guidelines for the diagnosis and management of asthma; update on selected topics 2002. J Allergy Clin Immunol 2002;110(5 suppl),S141-S219[Medline]
  5. Cabana, MD, Ebel, BE, Cooper-Patrick, L, et al Barriers pediatricians face when using asthma practice guidelines. Arch Pediatr Adolesc Med 2000;154,685-693[Abstract/Free Full Text]
  6. Picken, HA, Greenfield, S, Teres, D, et al Effect of local standards on the implementation of national guidelines for asthma: primary care agreement with national asthma guidelines. J Gen Intern Med 1998;13,659-663[CrossRef][ISI][Medline]
  7. Cabana, MD, Rand, CS, Becher, OJ, et al Reasons for pediatrician nonadherence to asthma guidelines. Arch Pediatr Adolesc Med 2001;155,1057-1062[Abstract/Free Full Text]
  8. Cary, J, Huseby, J, Culver, B Variability in interpretation of pulmonary function tests. Chest 1979;76,389-390[Abstract/Free Full Text]
  9. Quadrelli, SA, Roncoroni, AJ, Porcel, G Analysis of variability in interpretation of spirometric tests. Respiration 1996;63,131-136[ISI][Medline]
  10. American Thoracic Society. Standardization of spirometry 1994 update. Am J Respir Crit Care Med 1995;152,1107-1136[ISI][Medline]
  11. American Thoracic Society. Guidelines for methacholine and exercise challenge testing-1999. Am J Respir Crit Care Med 2000;161,309-329[Free Full Text]
  12. Fleiss, JL Statistical methods for rates and proportions. 2nd ed. 1984,212-236 John Wiley and Sons. New York, N Y:
  13. Baker, JA, Kornguth, PJ, Soo, MS, et al Sonography of solid breast lesions: observer variability of lesion description and assessment. AJR Am J Roentgenol 1999;172,1621-1625[Abstract/Free Full Text]
  14. Eaden, J, Abrams, K, McKay, H, et al Inter-observer variation between general and specialist gastrointestinal pathologists when grading dysplasia in ulcerative colitis. J Pathol 2001;194,152-157[CrossRef][ISI][Medline]
  15. Lenke, LG, Betz, RR, Bridwell, KH, et al Intraobserver and interobserver reliability of the classification of thoracic adolescent idiopathic scoliosis. J Bone Joint Surg 1998;80,1097-1106[Abstract/Free Full Text]
  16. Cummings, RJ, Loveless, EA, Campbell, J, et al Interobserver reliability and intraobserver reproducibility of the system of King et al. for the classification of adolescent idiopathic scoliosis J Bone Joint Surg 1998;80,1107-1111[Abstract/Free Full Text]
  17. Asch, DA, Jedrziewski, MK, Christakis, NA Response rates to mail surveys published in medical journals. J Clin Epidemiol 1997;50,1129-1136[CrossRef][ISI][Medline]



This article has been cited by other articles:


Home page
Arch Pediatr Adolesc MedHome page
J. W. Stout, C. M. Visness, P. Enright, C. Lamm, G. Shapiro, V. N. Gan, G. K. Adams III, and H. E. Mitchell
Classification of Asthma Severity in Children: The Contribution of Pulmonary Function Testing
Arch Pediatr Adolesc Med, August 1, 2006; 160(8): 844 - 850.
[Abstract] [Full Text] [PDF]


Home page
PediatricsHome page
B. P. Yawn, S. K. Brenneman, F. C. Allen-Ramey, M. D. Cabana, and L. E. Markson
Assessment of Asthma Severity and Asthma Control in Children
Pediatrics, July 1, 2006; 118(1): 322 - 329.
[Abstract] [Full Text] [PDF]


Home page
ChestHome page
L. M. Graham
Classifying Asthma
Chest, July 1, 2006; 130(1_suppl): 13S - 20S.
[Abstract] [Full Text] [PDF]


Home page
Eur Respir JHome page
D. Van Sickle
Perceptions of asthma among physicians: an exploratory study with the ISAAC video
Eur. Respir. J., November 1, 2005; 26(5): 829 - 834.
[Abstract] [Full Text] [PDF]


Home page
PediatricsHome page
S. P. Galant, L. J.R. Crawford, T. Morphew, C. A. Jones, and S. Bassin
Predictive Value of a Cross-Cultural Asthma Case-Detection Tool in an Elementary School Population
Pediatrics, September 1, 2004; 114(3): e307 - e316.
[Abstract] [Full Text] [PDF]


Home page
Clin Med ResHome page
G. L. Colice
Categorizing Asthma Severity: An Overview of National Guidelines
Clin. Med. Res., August 1, 2004; 2(3): 155 - 163.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF) Free
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Article Archive
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via ISI Web of Science (17)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Baker, K. M.
Right arrow Articles by Hen, J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Baker, K. M.
Right arrow Articles by Hen, J., Jr


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS