HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:
Guest Access | Sign In via User Name/Password

This Article Abstract Full Text (PDF) Free Submit a response Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in ISI Web of Science Similar articles in PubMed Alert me to new issues of the journal Add to My Personal Article Archive Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via ISI Web of Science (11) Citing Articles via Google Scholar Google Scholar Articles by Hébert, P. C. Articles by Marshall, J. Search for Related Content PubMed PubMed Citation Articles by Hébert, P. C. Articles by Marshall, J.

The Design of Randomized Clinical Trials in Critically Ill Patients^*

^* From the Critical Care Program (Dr. Hébert), University of Ottawa, Ottawa; University of Toronto (Dr. Marshall), Toronto; Clinical Epidemiology Unit (Dr. Wells), University of Ottawa, Ottawa; and Department of Epidemiology and Biostatistics, McMaster University (Dr. Cook), Hamilton, ON, Canada.

Correspondence to: Paul C. Hébert, MD, MHSc(Epid), Ottawa Health Research Institute, The Ottawa Hospital/General Campus, 501 Smyth Rd, Room 1812H, Box 201, Ottawa, ON, K1H 8 L6 Canada

	Abstract

TOP Abstract What Is Unique About... Overall Design Approaches RCT Design Alternative The Patient Population in... Study Interventions Outcome Measures Conclusion References

 
There are a number of difficulties in the conduct of randomized trials in the critically ill. These include difficulties in the definition of diseases and syndromes, a heterogenous population of patients undergoing a variety of therapeutic interventions, and outcomes that may not be able to discriminate between beneficial and risky therapies. Following a brief description of different randomized clinical trials (RCTs) and design philosophies, we outline the effects of different design choices in the complex critical care environment. Once the study topic has been determined to be relevant and important, then the potential investigator must establish whether efficacy or effectiveness will be the focus of the RCT. If an effectiveness design philosophy is chosen, then broad representation of study sites, liberal eligibility criteria, easily implemented intervention study protocols, and patient-centered outcomes should be chosen. The potential investigator wishing to establish efficacy will conduct the study in the centers of excellence and adopt stringent eligibility criteria, rigorous study protocols, and opt for outcomes that will be sensitive to change. In conclusion, we describe some of the major challenges and possible solutions to help a potential investigator through the myriad of difficulties in initiating an RCT in a complex environment.

Key Words: critical care • methodology • randomized trials • study protocols

Randomized clinical trials (RCTs) have evolved to become the "gold standard" clinical research design used to distinguish the risks and benefits of therapeutic interventions.^{1 2 3 4} In 1948, for the first time, a controlled clinical trial made use of random allocation, a control group, and blinding. Additional principles guiding the design of RCTs were first elaborated by Sir Austin Brandford Hill in the 1960s.^{5 6 7}

Many important questions regarding the management of critically ill patients have not been subjected to well-designed and executed RCTs. Consequently, clinicians frequently base their therapeutic decisions on suboptimal levels of clinical evidence including observational studies, poorly controlled clinical trials, or laboratory studies.^{3 8} The complex nature of critical illness, and a host of methodologic challenges have hampered the development and execution of clinical trials in this discipline. In this article, we will outline some of the methodologic issues central to the development and conduct of critical care RCTs.

	What Is Unique About Critical Care RCTs?

TOP Abstract What Is Unique About... Overall Design Approaches RCT Design Alternative The Patient Population in... Study Interventions Outcome Measures Conclusion References

 
A unique aspect of critical care research is that patients’ eligibility is primarily defined by location of care in the ICU rather than by the presence of a specific disease. Additionally, many clinical entities in the ICU are often nonspecific constellations of physiologic and biological abnormalities forming syndromes, rather than well-defined disease entities such as breast or lung cancer. Finally, the pathologic processes affecting critically ill patients, resulting in homeostatic disturbances severe enough to result in ICU admission, are often in their late stages at the time of ICU admission.

In critical care, as in other disciplines such as surgery, study interventions are administered in conjunction with other treatment modalities by skilled multidisciplinary teams.^{9 10} The large number of therapeutic interventions required in the care of the critically ill also creates special challenges when performing clinical trials in this field. This is because of the significant number of therapeutic choices faced by the clinical investigator.

The selection of outcomes for RCTs in the critical care setting also poses unique challenges. Until recently, the choice of mortality as an RCT outcome was widely advocated by critical care researchers, the pharmaceutical industry, and government agencies such as the US Food and Drug Administration. A mortality rate, ascertained at 28 days or 30 days, is still considered the "gold standard" for the evaluation of ICU therapeutic interventions applying for licensure. However, in the past several years, a large number of clinical trials with negative outcomes have led investigators to suggest that the choice of mortality as an outcome may have significant limitations.¹¹ As a primary outcome in an RCT, mortality might be too insensitive to detect the benefits of interventions when small but clinically important differences truly exist. These unique aspects of patients, interventions, and outcomes in critical care must first be considered in light of the research questions being asked and the design philosophy chosen to address these questions.

	Overall Design Approaches

TOP Abstract What Is Unique About... Overall Design Approaches RCT Design Alternative The Patient Population in... Study Interventions Outcome Measures Conclusion References

 
The ideal RCT establishes whether therapeutic interventions work, and determines the overall benefits and risks of each alternative in predefined patient populations. This is accomplished by minimizing the influence of chance, bias, and confounding through appropriate methodology. In addition, the ideal RCT should attempt to fulfill its objectives with the fewest patients possible (often termed statistical efficiency).¹² Unfortunately, these objectives are frequently in direct conflict rather than complementary. More importantly, economic considerations often limit our ability to fulfill all of these objectives. For instance, by maximizing the efficiency of a study, investigators might sacrifice their ability to draw conclusions in clinically important subgroups because of the much smaller sample size.

The most important consequence of these conflicting objectives is that choices made in the design of RCTs must focus on whether an intervention works or whether it results in more good than harm for patients.^{12 13} Trials that attempt to determine therapeutic "efficacy" address the question of "Will the therapy work under optimal conditions?" while trials attempting to determine therapeutic "effectiveness" address the question of "Will the therapy do more good than harm under usual practice conditions in all patients who are offered the intervention?" Clearly, both questions will yield useful information for health practitioners. Efficacy is often established first, and then the intervention is evaluated for its effectiveness. In pivotal RCTs used in the final phase of obtaining regulatory approval (phase III trials), pharmaceutical companies primarily wish to demonstrate that their product has proven efficacy. Rarely are attempts made to demonstrate therapeutic effectiveness in larger RCTs.

The design characteristics of efficacy and effectiveness trials tend to differ considerably (Table 1 ). As a consequence of design choices, inferences, and threats to the validity of effectiveness and efficacy trials are different. Therefore, one of the first steps in planning an RCT is to determine which of these two design approaches will best reflect the primary study question. Efficacy trials often opt for restricted eligibility, rigorous treatment protocols, and disease-specific outcomes responsive to the potential benefits of the experimental intervention. By using this approach, efficacy studies attempt to maximize internal validity, defined as the extent to which the experimental findings represent the true effect in study participants. Effectiveness trials would enroll most patients, introduce the interventions into the community at large with few controls, and monitor easily measured outcomes that are considered important to patients. As a consequence, the effectiveness approach will attempt to maximize external validity defined as the extent to which the experimental findings in the study represent the true effect in the target population. Hence, there are often trade-offs between the two forms of validity and their design approaches, as efficacy studies maximize internal validity at the expense of external validity while effectiveness studies optimally assess external validity (Fig 1 ).¹⁴

View larger version (23K): [in this window] [in a new window] [Download PPT slide]   Figure 1.. Implication of design approaches on internal and external validity.

The level of control in all aspects of study design exercised by Morris and colleagues¹⁵ may be contrasted to the approach adopted in a study comparing restrictive to liberal transfusion strategies in the critically ill.¹⁶ In the Transfusion Requirements in Critical Care (TRICC) trial,¹⁷ a large number of clinical centers enrolled patients using broad eligibility criteria, followed simple treatment strategies for the administration of packed RBCs, and ascertained mortality rates and rates of organ failure. This approach would be considered more of a hybrid or combined approach especially when compared to the prototypical example of effectiveness trials, the very large International Study of Infarct Survival^{18 19} trials in acute myocardial infarction. In critical care, there are few examples of such large trials.²⁰ Indeed, the largest trials have enrolled only a few thousand patients. RCTs in sepsis syndrome and septic shock have been successfully conducted using a hybrid approach^{21 22 23} rather than a true large, simple trial design. Most of the studies in this field collected significant amounts of data, implemented reasonably detailed but flexible treatment protocols, enrolled heterogeneous patient populations, and evaluated 28-day mortality rates.^{20 21} Therefore, many of the design characteristics adopted in sepsis RCTs could be considered a compromise between efficacy and effectiveness trial approaches. This approach was successfully used in the recently published activated protein C study published in the New England Journal of Medicine.²⁴

At this juncture, we suggest that a compromise between the two extreme design approaches would be desirable for most multicenter trials. Although providing important information in cardiovascular and cancer care, large simple trials (effectiveness trials) have not been used successfully in the intensive-care setting.

	RCT Design Alternative

TOP Abstract What Is Unique About... Overall Design Approaches RCT Design Alternative The Patient Population in... Study Interventions Outcome Measures Conclusion References

 
Once investigators have chosen whether an efficacy, effectiveness, or a hybrid approach will best answer the research question, there are several design options that may be considered (Table 2 ).⁴ A two-group, parallel design is the most common of RCT design choices. In this design, often the simplest to plan, implement, analyze, and interpret, patients are randomly allocated to one of two therapeutic interventions and followed forward in time. Parallel group designs may also be used to independently compare three or more treatments. This is, by far, the most frequently adopted choice of RCT design.

Factorial designs imply concurrent comparisons between at least two therapies. It is also possible to implement a design that compares interventions sequentially. For example, one might compare two therapies in the early treatment of a disease followed by the evaluation of a second intervention(s) in the late phase of care several days later. One such example is the approach adopted by the National Institutes of Health ARDS trials network, where the RCT evaluated two ventilatory strategies (12 mL/kg vs 6 mL/kg of tidal volume) in conjunction with ketoconazole, 400 mg/d, vs placebo. The optimal use of this design requires that the outcome from the initial portion of the trial be ascertained prior to initiation of the second study.

Both the simple parallel-group design and a factorial design are generally implemented with the understanding that the sample size is fixed according to pre-established assumptions prior to the commencement of enrollment. There are other experimental designs that are more responsive to patient outcomes as the study progresses. Sequential designs^{26 27 28} set boundaries for significance levels that consider the increasing number of comparisons and sample size throughout the study. True sequential studies randomly allocate patients to receive one of two therapies. Pairs of patients are then sequentially compared. The study is terminated as soon as one of the significance boundaries is crossed. This design was successfully used by Meduri and colleagues²⁹ to establish the benefits of IV methylprednisolone in the treatment of late-phase ARDS. The authors demonstrated that high-dose methylprednisolone was associated with improvement in lung injury, multiple-organ dysfunction syndrome (MODS) score, and mortality in 24 patients. This study question had all of the necessary attributes for this design. The population was well defined and homogenous; more importantly, the study end points were easily ascertained within a very short time following randomization. In critical care, the sequential design may be limited to select patients in whom a dichotomous outcome is promptly available for analysis, for example, progression of disease or intubation status (yes or no). Therefore, this approach may be considered when performing efficacy evaluations. One of the major concerns with the design may be its inability to conceal the randomization process and the uncertainty of not knowing the exact sample size in advance. From this methodology, several biostatisticians have developed methods of performing interim analyses in large clinical trials referred to as group sequential methods.^{30 31}

Another RCT design option particularly amenable to an efficacy evaluation is a two-period crossover study in which patients are used as their own controls. In a two-period crossover trial,^{27 28 31} patients are randomized to one of two therapies for a fixed period of time and then proceed to receive the other therapy in a second comparable interval. Significant gains in efficiency are made by minimizing "between-subject" variability in this manner. Cooper et al³² determined the hemodynamic consequences of sodium bicarbonate by randomly allocating critically ill patients with lactic acidosis to receive either 2 mmol/kg of sodium bicarbonate or an equimolar amount of sodium chloride, followed by the other therapy. The authors determined that both sodium bicarbonate and sodium chloride equally increased left ventricular filling pressures and cardiac output without significantly changing arterial BP. One of the fundamental assumptions underlying this design is a "carryover effect": a treatment effect from the first period does not persist through the second period introduced. As a second example, Wright and colleagues³³ examined whether bronchodilators decreased airflow resistance in patients with ARDS. The authors demonstrated that airways resistance, a short-term physiologic end point, was decreased in patients with ARDS. This was the optimal design choice given the reversibility of the outcome and the intervention. In our example, the administration of sodium bicarbonate in the first period may have altered acid-base status or calcium homeostasis in the second treatment period, potentially resulting in a bias toward the null hypothesis. Crossover studies are therefore best suited to relatively stable conditions (stability required during the study), interventions with rapid onset of action and a very short half-life (biological effect must disappear prior to second treatment period), and rapidly modifiable end points such as hemodynamic and respiratory measures.

All designs discussed so far have described the evaluation of interventions for individual patients. However, it is sometimes necessary to evaluate therapies, protocols, guidelines, or treatment programs for groups of individuals.^{34 35 36 37} Using this design, groups such as ICU and physician practices, often referred to as clusters, are randomized to receive alternative interventions. A cluster design may be the most appropriate for evaluating interventions such as antibiotic protocols, weaning guidelines, or early discharge programs. One of the major concerns is the possibility of large variations between clusters that may make it difficult to detect actual differences between therapies. Partial clustering in the allocation of patients was used in a study³⁸ of hyperbaric oxygen therapy for acute carbon monoxide poisoning. With access to a single chamber, the investigators were faced with only enrolling one patient at a time or allocating all patients who were poisoned in the same incident to be treated at the same time in one cluster. In this well-conducted RCT,³⁸ the authors not only did not find any benefit to hyperbaric oxygen but may have detected the possibility of harm.

	The Patient Population in Critical Care RCTs

TOP Abstract What Is Unique About... Overall Design Approaches RCT Design Alternative The Patient Population in... Study Interventions Outcome Measures Conclusion References

 
One of the difficulties faced by investigators is that potential study participants must usually be admitted to an ICU in order to be considered critically ill. Eligibility or selection of patients based on a location creates difficulties in precisely defining the entry point into the clinical trial. For example, let us assume that an investigator states that patients will remain eligible only for the first 24 h following ICU admission. By adopting a broad definition for the term ICU, the clock may start ticking from the time of admission to the recovery room, emergency department, the ICU itself, a high-dependency unit, or the ICU of another institution. If a time restriction helps define the study population, then the investigator must clarify whether each of these venues of care is suitable given the target population and study question. If possible, time restrictions are more likely to be meaningful if based on a specific point in the patient’s disease rather than a location alone. Further, the use of time restrictions is optimal when there are easily defined milestones in the disease process. For instance, several studies^{20 21} evaluating immunotherapy in septic shock make use of a time restriction initiated by the development of hypotension.

Second, selection is often based on disease definitions, comprised of a constellation of physiologic and other biological abnormalities rather than well-defined disease entities. One of the major challenges facing critical care investigators in the past several years has been to develop definitions for disease processes such as sepsis, septic shock, and ARDS.^{39 40 41 42 43 44} Unfortunately, few diseases in critical care are simple and clearly defined by a pathologic process such as myocardial infarction or a diagnosis of cancer. Consequently, clinical syndromes are often characterized by using alterations in physiologic, immunologic, and biochemical parameters. Recently, expert opinions from consensus conferences have helped in the formulation of these definitions.^{45 46} Prior to undertaking any clinical trial, it is not only important to understand the pathophysiology of the disease or syndrome, but investigators should also have a sound appreciation of its epidemiology.⁴⁷ A detailed understanding of disease incidence and risk factors, as well as some of the limitations in using the definition of the clinical syndrome to select patients, is essential in the planning of an RCT.⁴⁸ In assessing proposed or established syndrome definitions, investigators should question their validity and reproducibility (or reliability) as well as whether definitions are sufficiently well established and user friendly to warrant their use in a clinical trial.

In addition to concerns related to location and disease definitions, the choice of either an efficacy or effectiveness approach will have a substantial impact on the selection of the study population. Specifically, in choosing an efficacy approach, investigators usually perform the study in a well-defined patient population where the intervention has the highest probability of demonstrating an effect. This may be done by narrowly defining the patient population through the use of restrictive eligibility criteria and disease definitions as well as selecting specialized centers with clinical expertise in the field. Choosing a narrowly defined study population will decrease overall variability attributed to patient selection but may potentially hamper patient recruitment and jeopardize the generalizability of the study results.⁴⁹ Despite these concerns, this approach has been successfully used by the National Institutes of Health ARDS Network.⁵⁰

When defining the eligibility criteria for an effectiveness trial, investigators should consider utilizing more liberal criteria in a wide range of clinical settings. Thus, as the study is being designed, medical or surgical critically ill patients with a broad range of primary diagnoses (or underlying conditions) from a range of tertiary-care centers might be considered for enrollment in the study. Liberal selection of study centers and more permissive eligibility have been adopted in many studies performed by the Canadian Critical Care Trials Group, including the TRICC trial,¹⁷ and the study by Cook et al⁵¹ comparing sucralfate and ranitidine.

On the spectrum between highly selected patients (efficacy) and all ICU patients (effectiveness), we suggest that critical care investigators should consider a number of factors in making the decision. In practice, considerations such as the spectrum of biological activity of the intervention (wide or narrow), funding and resource constraints, the prevalence of the specific condition or disease process, the frequency of the primary outcome, as well as the scientific or clinical interest of the investigative team, will impact on choices made in the selection criteria for potential study participants and study sites. Targeting high-risk patients and possibly centers where the condition of interest is more prevalent may be used as a strategy to maximize the use of study resources.

	Study Interventions

TOP Abstract What Is Unique About... Overall Design Approaches RCT Design Alternative The Patient Population in... Study Interventions Outcome Measures Conclusion References

 
The complexity and multiplicity of interventions used in the care of critically ill patients present unique challenges for the clinical investigator planning an RCT. In general, as the number of potential interventions increase, available options for the pursuit of optimal patient care exponentially rises. A major consequence of complex care is increased biological variation and practice variation that ultimately increases experimental noise, and thereby makes it more difficult to detect therapeutic benefits when they are truly present.

To cope with concerns regarding the complexity of care, investigators must consider the degree of control or constraints imposed on experimental and nonexperimental interventions that will be adopted in an RCT.⁵² Experimental constraints on study interventions can be implemented by instituting rigorous treatment protocols or by the selection of study centers. Thus, a number of choices face the clinical investigator. For example, should the administration of antibiotics be standardized in a septic shock trial? Should the ventilatory management be tightly controlled in an RCT of a weaning intervention?

As outlined in the previous section, the answers to these questions will partially depend on whether investigators wish to evaluate therapeutic efficacy or effectiveness. Elaborate study protocols detailing the use of experimental and nonexperimental therapies characterize efficacy evaluations. It is expected that the development and implementation of elaborate treatment protocols will decrease overall variability attributed to the confounding influence of co-interventions.⁵³ Decreased variation in the study may enable the detection of smaller clinically important treatment differences, if truly present. However, the development of treatment protocols themselves may improve patient care by decreasing unnecessary practice variation, by increasing the general knowledge of practitioners, or by adopting evidence-based practices in participating centers. Just as critical paths are not easily implemented at a site that did not participate in their development, elaborate study protocols may not be easily adopted in a wide variety of practice settings. Also, elaborate treatment protocols may jeopardize accrual of study participants and physician compliance.

An alternative approach would be to let therapeutic decisions (other than the experimental therapy) devolve onto the attending physician. Allowing the attending physician complete autonomy will maximize the generalizability (increased external validity) of study results but potentially increase the effect of confounding from co-interventions (decreased internal validity). The number and intensity of co-interventions invariably magnify underlying random error in an RCT, potentially leading investigators to falsely conclude that there are no benefits to a promising new therapy. To cope with increased variation, investigators must plan to substantially increase the sample size because of diminished benefits of the experimental therapy. Selecting specific ICUs to participate in an RCT may also be a worthwhile method of ensuring compliance with the protocols for the study intervention and co-intervention.

For all interventions, the blinding of the care team to the study interventions should be seriously considered because this study maneuver has been shown to minimize co-interventions and biases in ascertaining outcomes.⁵⁴ Although blinding maneuvers are vitally important, feasibility and patient safety sometimes do not permit blinding of the study intervention. This is more problematic in nonpharmaceutical interventions. However, a number of examples exist in which study investigators have successfully implemented complex blinding maneuvers without jeopardizing either safety or feasibility.⁵⁵ Pilot studies are recommended to determine whether blinding can be maintained safely and successfully. If, during a pilot study, caregivers are able to discern which treatment is being administered, then the blinding process should be reconsidered, improved, or possibly abandoned. When double blinding is not possible, for example in the evaluation of surgical techniques and new devices, other safeguards to minimize bias should include the selection of objective outcomes as well as independent and blinded outcome assessments if more subjective outcomes are chosen. In order to minimize differences in therapy due to inability to blind, regimented treatment protocols should also be considered. In addition, the influence of co-interventions can be tested post hoc using multivariate statistical techniques.

When treatment protocols are complex or controversial, compliance may also be a concern. We suggest investigators consider some or all of the following strategies to improve adherence to study protocols. There are several ways to increase compliance with study protocols: (1) by making study protocols simple and easy to implement; (2) by developing the protocols with as many stakeholders as possible; (3) by extensive dissemination of the study protocol and its rationale in participating study centers; (4) by obtaining formal agreements to respect the protocol from all ICU physicians and other potential collaborators; (5) by implementing a mechanism to minimize crossovers (such as consulting the site investigator and the study chair prior to crossing over), and by developing objective crossover criteria when this is a concern.

	Outcome Measures

TOP Abstract What Is Unique About... Overall Design Approaches RCT Design Alternative The Patient Population in... Study Interventions Outcome Measures Conclusion References

 
In most clinical trials, a number of potential outcomes, both fatal and nonfatal, are considered by the clinical investigative team. An outcome is defined as a measurement (ie, arterial BP) or an event (ie, death) potentially modified following the implementation of an intervention. If all are given equal consideration, concerns arise about multiple comparisons and interpretation of a study with heterogeneous findings. Thus, it is important to choose a primary outcome that will determine the therapeutic success or failure of an intervention, as well as secondary outcomes that will provide supportive evidence in secondary analyses. As a corollary, a predefined hierarchy implies that the investigators believe that clinically or statistically important differences in secondary outcomes, in the absence of important changes in the primary outcome, will not be interpreted as strong evidence of therapeutic benefit. The primary outcome is also essential in determining the sample size requirements in a clinical trial. Thus, once a decision has been made to determine either therapeutic efficacy or effectiveness (or possibly a hybrid approach), the second task facing investigators is ranking outcomes as primary and secondary (Table 3 ).

Outcomes should also measure what they are supposed to measure (validity), they should be precise, and they should be reproducible. There is little doubt that all-cause mortality would meet all of these criteria, but cause-specific mortality and a quality-of-life scale may or may not be a valid and reliable assessment of a patient’s health status following an episode of septic shock. Finally, an outcome must be able to detect a clinically important true positive or negative change in the patient’s condition following a therapy. In critically ill patients, the ability to discriminate or detect the potential benefits of therapy may be less than optimal using mortality rates ascertained at 30 days as the primary outcome.¹¹ Because few sepsis studies have shown any significant impact on 30-day mortality, many investigators^{11 47} have suggested that other outcomes should be considered in RCTs evaluating therapeutic effectiveness.

However, the ability to discriminate between beneficial and risky therapies may be modified by specific design choices including many related to outcomes. Discriminability can easily be increased by increasing the sample size. Using mortality as an example of primary outcome, the sample size in a clinical trial comparing two therapies is based on the baseline event rate, the expected incremental benefit, the level of significance (), and the power to detect differences (1-ß). Establishing the anticipated incremental benefit of a new therapy is vitally important because of the enormous sample size repercussions. A sample size calculation for an RCT requires that the investigators establish the minimum therapeutic effect detectable within the trial. This difference in outcomes between interventions is referred to as the minimally important difference or minimal clinically important difference. The minimally important difference is essentially establishing the level of discrimination in the study population exposed to the interventions given acceptable levels of type I and type II error and the baseline event rate. Too often, investigators calculate a sample size based on very large and unrealistic expected differences in outcomes. To determine a plausible effect size, investigators should ask themselves the following questions: (1) what difference or incremental benefit can be realistically expected of the experimental therapy (anticipated biological effect of therapy); (2) are the required number of patients available to participate in the clinical trial (feasibility); and (3) how much of a survival benefit, given the added costs and expected side effects of therapy, would be required for clinicians, patients and administrators to adopt a new therapy (overall benefit of therapy)?

As a concrete example, let us assume that a given study population has an expected mortality rate of 25% in the standard-therapy group while the experimental therapy is expected to decrease mortality by an absolute difference of 12.5% (a 50% relative risk reduction). The total number of patients required would approximate 250. Most therapies used in the ICU would not be expected to decrease mortality so dramatically. More realistic expectations may be in the range of a 5% absolute decrease (a 20% relative risk reduction), which would require a total sample size of 2,200 patients, respectively, if the baseline mortality was 25%. Investigators need to consider whether an absolute incremental benefit in the range of 5 to 10% is attainable using the experimental therapy. If not, another more discriminating outcome should be sought.

As an alternate approach, discriminability may be improved by altering the ascertainment period. In other words, mortality rates may be determined at 24 h, 7 days, or at ICU discharge, rather than longer time intervals such as 30 days or 6 months. The timing of the ascertainment will have opposing influences on its ability to discriminate and its clinical relevance. As the ascertainment period of mortality is lengthened, the clinical importance of the outcome is increased. However, as the time from the administration of the therapy to the assessment of mortality is increased, the relationship between the effects of the therapy and the outcome may be confounded by extraneous factors and intervention. Therefore, the ability of an intervention to discriminate between groups on the basis of mortality may decrease as time progresses (Fig 2 ).

View larger version (16K): [in this window] [in a new window] [Download PPT slide]   Figure 2.. Effect of co-interventions on ability to discriminate and generalize. This diagram illustrates that discriminability decreases and generalizability increases as we move away from the point of randomization.

	Conclusion

TOP Abstract What Is Unique About... Overall Design Approaches RCT Design Alternative The Patient Population in... Study Interventions Outcome Measures Conclusion References

 
In this article on RCTs in the critical care setting, several major RCT design characteristics were discussed. We outlined issues of special interest to critical care investigators related to RCT design approaches, disease definitions, patient selection, study interventions, and outcome measures. Although RCTs provide the most unbiased and accurate assessment of the efficacy and effectiveness of therapeutic and preventive interventions, they remain challenging and expensive to conduct. As more research groups form to address unanswered therapeutic questions in critical care, investigators will invariably better understand strengths and limitations of different RCT design characteristics in critical-care trials (Table 4 ).

	Acknowledgements

 
We thank our students, teachers, and colleagues who contributed many of the ideas outlined in this article. We also thank Drs. Peter Tugwell, Andreas Laupacis, and Arthur Slutsky for reviewing this article, and Christine Piché for secretarial support. We also thank our collaborators, without whom many of the studies used as examples in this series would not have been possible.

	Footnotes

 
Abbreviations: MODS = multiple-organ dysfunction syndrome; RCT = randomized clinical trial; TRICC =Transfusion Requirements in Critical Care

Drs. Hébert and Cook are Career Scientists of the Ontario Ministry of Health.

Received for publication March 29, 2000. Accepted for publication September 24, 2001.

	References

TOP Abstract What Is Unique About... Overall Design Approaches RCT Design Alternative The Patient Population in... Study Interventions Outcome Measures Conclusion References

 

1. McGrae, MM, Lefevre, F, Feinglass, J, et al (1995) Changes in study design, gender issues, and other characteristics of clinical research published in three major medical journals from 1971 to 1991. J Gen Intern Med 10,13-18[ISI][Medline]
2. Sackett, DL, Haynes, RB, Guyatt, GH, et al (1991) Clinical epidemiology: a basic science for clinical medicine 2nd ed. Little, Brown and Company Boston, MA.
3. Guyatt, GH, Sackett, DL, Cook, DJ (1993) Users’ guides to the medical literature. II: How to use an article about therapy or prevention; A. Are the results of the study valid? JAMA 270,2598-2601[Free Full Text]
4. Friedman, LM, Furberg, CD, Demets, DL (1996) Fundamentals of clinical trials 3rd ed. Mosby-Year Book St. Louis, MO.
5. Hill, AB (1951) The clinical trial. Br Med Bull 7,278-282[Free Full Text]
6. Hill, AB (1952) The clinical trial. N Engl J Med 247,113-119
7. Hill, AB (1962) Statistical methods of clinical and preventive medicine Oxford University Press New York, NY.
8. Cook, DJ, Guyatt, GH, Laupacis, A, et al (1992) Rules of evidence and clinical recommendations on the use of antithrombotic agents. Chest 102,305S-311S[Free Full Text]
9. Fielding, LP, Stewart-Brown, S, Dudley, HAF (1978) Surgeon-related variables and the clinical trial. Lancet 1,778-779
10. van der Linden, W (1980) Pitfalls in randomized surgical trials. Surgery 87,258-262[ISI][Medline]
11. Petros, AJ, Marshall, JC, van Saene, HKF (1995) Should morbidity replace mortality as an endpoint for clinical trials in intensive care? Lancet 345,369-371[CrossRef][ISI][Medline]
12. Sackett, DL (1980) The competing objectives of randomized trials. N Engl J Med 303,1059-1060[ISI][Medline]
13. Sackett, DL, Gent, M (1979) Controversy in counting and attributing events in clinical trials. N Engl J Med 301,1410-1412[ISI][Medline]
14. Lubsen, J, Tijssen, JGP (1989) Large trials with simple protocols: indications and contraindications. Control Clin Trials 10,151s-160s
15. Morris, AH, Wallace, CJ, Menlove, RL, et al (1994) Randomized clinical trial of pressure-controlled inverse ratio ventilation and extracorporeal CO₂ removal for adult respiratory distress syndrome. Am J Respir Crit Care Med 149,295-305[Abstract]
16. Hebert, PC, Wells, GA, Marshall, JC, et al (1995) Transfusion requirements in critical care: a pilot study. JAMA 273,1439-1444[Abstract]
17. Hebert, PC, Wells, G, Blajchman, MA, et al (1999) A multicenter, randomized, controlled clinical trial of transfusion requirements in critical care. N Engl J Med 340,409-417[Abstract/Free Full Text]
18. . ISIS-4 (Fourth International Study of Infarct Survival) Collaborative Group (1995) A randomised factorial trial assessing early oral captopril, oral mononitrate, and intravenous magnesium sulphate in 58, 050 patients with suspected acute myocardial infarction: ISIS-4. Lancet 345,669-685[CrossRef][ISI][Medline]
19. . ISIS-2 (Second International Study of Infarct Survival) Collaborative Group (1988) Randomised trial of intravenous streptokinase, oral aspirin, both, or neither among 17187 cases of suspected acute myocardial infarction: ISIS-2. Lancet 2,349-360[Medline]
20. McCloskey, RV, Straube, RC, Sanders, C, et al (1994) Treatment of septic shock with human monoclonal antibody HA-1A: a randomized, double-blind, placebo-controlled trial. Ann Intern Med 121,1-5[Abstract/Free Full Text]
21. Ziegler, EJ, Fisher, CJ, Jr, Sprung, CL, et al (1991) Treatment of gram-negative bacteremia and septic shock with HA-1A human monoclonal antibody against endotoxin: a randomized, double-blind, placebo-controlled trial. N Engl J Med 324,429-436[Abstract]
22. Fisher, CJ, Jr, Dhainaut, J-FA, Opal, SM, et al (1994) Recombinant human interleukin-1 receptor antagonist in the treatment of patients with sepsis syndrome: results from a randomized double-blind, placebo-controlled trial. JAMA 271,1836-1843[Abstract]
23. Abraham, E, Raffin, TA (1994) Sepsis therapy trials: continued disappointment or reason for hope? JAMA 271,1876-1878[CrossRef][ISI][Medline]
24. Bernard, GR, Vincent, J-L, Laterre, P-F, et al (2001) Efficacy and safety of recombinant human activated protein C for severe sepsis. N Engl J Med 344,699-709[Abstract/Free Full Text]
25. Theroux, P, Ouimet, H, McCans, J, et al (1988) Aspirin, heparin, or both to treat acute unstable angina. N Engl J Med 319,1105-1111[Abstract]
26. Armitage, P (1975) Sequential experimentation. Anonymous sequential medical trials 2nd ed. ,23-40 Blackwell Scientific Publications Oxford, UK.
27. Hills, M, Armitage, P (1979) The two-period cross-over clinical trial. Br J Clin Pharmacol 8,7-20[ISI][Medline]
28. Armitage, P, Hills, M (1982) The two-period crossover trial. Statistician 31,119-131[CrossRef]
29. Meduri, GU, Headley, AS, Golden, E, et al (1999) Effect of prolonged methylprednisolone therapy in unresolving acute respiratory distress syndrome: a randomized controlled trial. JAMA 280,159-165[Abstract/Free Full Text]
30. O’Brien, PC, Fleming, TR (1979) A multiple testing procedure for clinical trials. Biometrics 35,549-556[CrossRef][ISI][Medline]
31. Pocock, SJ (1983) Clinical trials: a practical approach John Wiley and Sons Chichester, UK.
32. Cooper, DJ, Walley, KR, Wiggs, BR, et al (1990) Bicarbonate does not improve hemodynamics in critically ill patients who have lactic acidosis. Ann Intern Med 112,492-498
33. Wright, PE, Carmichael, LC, Bernard, GR (1994) Effect of bronchodilators on lung mechanisms in the acute respiratory distress syndrome (ARDS). Chest 106,1517-1523[Abstract/Free Full Text]
34. Neuhauser, D (1991) Parallel providers, ongoing randomization and continuous improvement. Med Care 29,JS5-JS8[ISI][Medline]
35. Cebul, RD (1991) Randomized, controlled trials using the Metro Firm System. Med Care 29,JS9-JS18[ISI][Medline]
36. Simmer, TL, Nerenz, DR, Rutt, WM, et al (1991) A randomized, controlled trial of an attending staff service in general internal medicine. Med Care 29,JS31-JS40[ISI][Medline]
37. Tierney, WM, Miller, ME, Hui, SL, et al (1991) Practice randomization and clinical research: the Indiana experience. Med Care 29,JS57-JS64[ISI][Medline]
38. Scheinkestel, CD, Bailey, M, Myles, PS, et al (1999) Hyperbaric or normobaric oxygen for acute carbon monoxide poisoning: a randomised controlled clinical trial. Med J Aust 170,203-210[ISI][Medline]
39. Bone, RC, Fisher, CJ, Jr, Clemmer, TP, et al (1989) Sepsis syndrome: a valid clinical entity. Crit Care Med 17,389-393[ISI][Medline]
40. Bone, RC (1991) Let’s agree on terminology: definitions of sepsis. Crit Care Med 19,973-976[ISI][Medline]
41. Bone, RC, Balk, RA, Cerra, FB, et al (1992) Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. Chest 101,1644-1655[Abstract/Free Full Text]
42. Bone, RC (1995) Sepsis, sepsis syndrome, and the systemic inflammatory response syndrome (SIRS): Gulliver in Laputa. JAMA 273,155-156[CrossRef][ISI][Medline]
43. Amaha, K (1989) Controversies on the concept of ARDS. Intensive Care Med 6,59-60
44. Summer, WR (1990) Editorial: should we redefine ARDS? Crit Care Rep 1,169-171
45. . American College of Chest Physicians/Society of Critical Care Medicine Consensus Conference Committee (1992) American College of Chest Physicians/Society of Critical Care Medicine Consensus Conference: definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. Crit Care Med 20,864-874[ISI][Medline]
46. Brand, A, Lagaaij, EL (1989) Blood transfusion and constituent transfusion. Curr Opin Immunol 1,1184-1190[CrossRef][ISI][Medline]
47. Bernard, GR (1995) Sepsis trials: intersection of investigation, regulation, funding, and practice. Am J Respir Crit Care Med 152,4-10[ISI][Medline]
48. Garber, BG, Hebert, PC, Yelle, JD, et al (1996) Adult respiratory distress syndrome: a systematic overview of incidence and risk factors. Crit Care Med 24,687-695[CrossRef][ISI][Medline]
49. Fletcher, RH, Fletcher, SW, Wagner, EH (1988) Clinical epidemiology: the essentials 2nd ed. Williams and Wilkins Baltimore, MD.
50. Bernard, GR, Wheeler, AP, Russell, JA, et al (1997) The effects of ibuprofen on the physiology and survival of patients with sepsis. N Engl J Med 336,912-918[Abstract/Free Full Text]
51. Cook, D, Guyatt, G, Marshall, J, et al (1998) A comparison of sucralfate and ranitidine for the prevention of upper gastrointestinal bleeding in patients requiring mechanical ventilation. N Engl J Med 338,791-797[Abstract/Free Full Text]
52. Ratain, JS, Hochberg, MC (1990) Clinical trials: a guide to understanding methodology and interpreting results. Arthritis Rheum 33,131-139[ISI][Medline]
53. Kubinski, JA, Rudy, TE, Boston, JR (1991) Research design and analysis: the many faces of validity. J Crit Care 6,143-151
54. Pocock, SJ (1983) Blinding and placebos. Wiley, JS eds. Clinical trials: a practical approach 1st ed. ,90-99 John Wiley and Sons New York, NY.
55. . The Neonatal Inhaled Nitric Oxide Study Group (NINOS) (1997) Inhaled nitric oxide and hypoxic respiratory failure in infants with congenital diaphragmatic hernia. Pediatrics 99,838-845[Abstract/Free Full Text]
56. Kirshner, B, Guyatt, G (1985) A methodological framework for assessing health indices. J Chronic Dis 38,27-36[CrossRef][ISI][Medline]
57. Guyatt, GH, Veldhuyzen Van Zanten, SJO, Feeny, DH, et al (1989) Measuring quality of life in clinical trials: a taxonomy and review. Can Med Assoc J 140,1441-1448[Abstract]
58. Chelluri, L, Grenvik, A, Silverman, M (1995) Intensive care for critically ill elderly: mortality, costs, and quality of life. Arch Intern Med 155,1013-1022[Abstract]
59. Tsevat, J, Dawson, NV, Matchar, DB (1990) Assessing quality of life and preferences in the seriously ill using utility theory. J Clin Epidemiol 43,73S-77S
60. Ridley, SA, Wallace, PGM (1990) Quality of life after intensive care. Anaesthesia 45,808-813[ISI][Medline]
61. Parno, JR, Teres, D, Lemeshow, S, et al (1984) Two-year outcome of adult intensive care patients. Med Care 22,167-176[CrossRef][ISI][Medline]
62. Heyland, DK, Guyatt, G, Cook, DJ, et al (1998) Frequency and methodologic rigor of quality-of-life assessments in the critical care literature [abstract]. Crit Care Med 26,591-598[CrossRef][ISI][Medline]

This article has been cited by other articles:

				H Mann Controversial choice of a control intervention in a trial of ventilator therapy in ARDS: standard of care arguments in a randomised controlled trial J. Med. Ethics, September 1, 2005; 31(9): 548 - 553. [Abstract] [Full Text] [PDF]

				D. Cook Is Albumin Safe? N. Engl. J. Med., May 27, 2004; 350(22): 2294 - 2296. [Full Text] [PDF]

				K. D. Chinsky Ventilator-Associated Pneumonia: Is There Any Gold in These Standards? Chest, December 1, 2002; 122(6): 1883 - 1885. [Full Text] [PDF]

This Article Abstract Full Text (PDF) Free Submit a response Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in ISI Web of Science Similar articles in PubMed Alert me to new issues of the journal Add to My Personal Article Archive Download to citation manager Citing Articles Citing Articles via HighWire