|
|
||||||||
Guest Access | Sign In via User Name/Password |
|||||||||
* From the Departments of Preventive Medicine & Public Health (Drs. Shireman, Mahnken, Ellerbeck and Mr. Hou) and Pharmacy Practice (Dr. Howard), University of Kansas Medical Center, Kansas City, KS; and the Department of Surgery (Dr. Kresowik), University of Iowa College of Medicine, Iowa City, IA.
Correspondence to: Theresa I. Shireman, PhD, RPh, Preventive Medicine & Public Health, University of Kansas Medical Center, 3901 Rainbow Blvd, Mail Stop 1008, Kansas City, KS 66160; e-mail: tshireman{at}kumc.edu
Abstract
Background and purpose: Develop and validate a contemporary bleeding risk model to guide the clinical use of warfarin in the elderly atrial fibrillation (AF) population.
Methods: Chart-abstracted data from the National Registry of Atrial Fibrillation was combined with Medicare part A claims to identify major bleeding events requiring hospitalization. Using a split-sample technique, candidate variables that provided statistically stable relationships with major bleeding events were selected for model development. Three risk categories were created and validated. The new model was compared to existing bleeding risk models using c-statistics and Kaplan-Meier curves.
Results: Model development and validation was conducted on 26,345 AF patients who were > 65 years of age and had been discharged from the hospital while receiving warfarin therapy. The following eight variables were included in the final risk score model: age
70 years; gender; remote bleeding; recent (ie, during index hospitalization) bleeding; alcohol/drug abuse; diabetes; anemia; and antiplatelet use. Bleeding rates were 0.9%, 2.0%, and 5.4%, respectively, for the groups with low, moderate, and high risk, compared to the bleeding rates for groups with moderate risk (1.5% and 1.0%) and high risk (1.8% and 2.5%) from other models.
Conclusions: Using a nationally derived data set, we developed a model based on contemporary practice standards for determining major bleeding risk among AF patients receiving warfarin therapy. The larger sample size afforded the opportunity to incorporate additional risk factors. In addition, since the majority of our population was > 65 years of age, we had greater ability to stratify risk among the elderly.
Key Words: adverse effects anticoagulants atrial fibrillation complications drug therapy epidemiology hemorrhage risk therapeutic use warfarin
Warfarin has been proven to be the most effective antithrombotic agent for the primary or secondary prevention of stroke in patients with atrial fibrillation (AF),1 yet it is associated with a risk of major bleeding events. Numerous studies2345 have documented the underutilization of warfarin therapy in eligible patients with AF, and physician surveys have shown that, while most believe warfarin is efficacious, fears of bleeding may prevent its utilization.6
Previously, two bleeding risk models have been developed and validated to assist clinicians in balancing the risks and benefits of antithrombotic therapy. The Outpatient Bleeding Risk Index (OBRI) considers age > 65 years, prior stroke, prior GI bleeding, and any of four comorbidities (eg, recent myocardial infarction [MI], anemia, diabetes, or renal insufficiency) in order to stratify patients into three risk groups.78910 Kuijer et al11 developed another model that uses age > 60 years, gender, and malignancy to stratify patients into three risk groups.
While these models have proven validity, there remains a need for a model that more fully addresses the contemporary use of warfarin therapy in elderly AF patients. Both the OBRI model and the Kuijer et al11 model stratified risk by age at 60 to 65 years, while the mean age of AF patients is 75 years.1 Since advanced age has consistently been associated with the underutilization of warfarin therapy,1312 a model that can address issues among the elderly is clearly needed. Second, these models did not include many other known factors that may be predictive of bleeding.781113141516171819 Given the extremely low incidence of the bleeding events, much larger sample sizes are needed to adequately model additional risk factors. Third, while there are an increasing number of medications that may alter bleeding risks when used concurrently with warfarin,2021 previous bleeding risk models222324 have not accounted for common drug interactions in AF patients. Finally, prior models13141516 were primarily developed prior to the use of lower intensity warfarin anticoagulation therapy. The goals of our study were to develop a contemporary bleeding risk model for users of warfarin to help predict a given elderly patients risk for major bleeding events, to examine the capability of this new model to predict bleeding events in a validation cohort, and to compare our new model with predictions based on previous bleeding risk models.
Materials and Methods
The study design was a retrospective cohort analysis using the National Registry of Atrial Fibrillation. Briefly, the Centers for Medicare & Medicaid Services authorized the collection of data on a national, random sample of patients discharged from the hospital between April 1998 and March 1999, and between July 2000 and June 2001 with a diagnosis of AF (International Classification of Diseases, ninth revision, clinical modification, code 427.31) as part of the National Stoke Project.45 We used the hospitalization selected in this random sample as the index hospitalization.
Patients who were at least 65 years of age were included in the present study if they had been discharged from the hospital while receiving warfarin therapy. The exclusion criteria included situations in which inadequate follow-up data or hospital discharge information would have been available, as follows: transfer to another acute care hospital; death during the hospitalization; discharged from the hospital against medical advice; and enrollment in a Medicare managed care organization during the 90-day follow-up period.
Data Sources
The following four sources of data were linked to carry out this study: (1) the initial Medicare part A claim identifying the index AF hospitalization; (2) the Medicare enrollment database to identify dates of death and managed care enrollment; (3) data abstracted from the medical record for the index AF hospitalization; and (4) 90-day follow-up Medicare part A claims. Data were obtained through collaboration with the Iowa Foundation for Medical Care and the Centers for Medicare & Medicaid Services. Data reliability for the chart-abstracted data ranged from 80 to 95%; the median interrater reliability was 90%.4
Study Variables
The primary outcome variable was hospitalization for a major acute bleeding event within 90 days of the hospital discharge date from the index AF hospital admission for either a GI hemorrhage (Diagnosis-Related Group code 174 or 175) or intracranial hemorrhage (International Classification of Diseases, ninth revision, clinical modification, codes 430 [subarachnoid], 431 [intracerebral], and 432 [other intracranial hemorrhage]).242526 We classified bleeding events by the presence/absence of a bleeding event and the time to the bleeding event (ie, the number of days between hospital discharge and readmission for a major bleeding event). Only the first bleeding event for a study subject was included in the analysis.
Predictor variables were determined from the chart-abstracted data. A host of risk factors for bleeding events have been identified in the literature.7811131415161718192021 In general, these risk factors can be grouped into demographics (age, gender, and nursing facility residence), current or remote bleeding event, alcohol/drug abuse, concomitant diseases (anemia, cancer, stroke, transient ischemic attacks, MI, hypertension, heart failure/cardiomyopathy, ischemic heart disease, diabetes, hepatic failure, or peptic ulcer disease), concomitant risks for injury (risk for falls, cognitive impairment, or surgery during index hospitalization), and concurrent medications that can influence hemostasis. Anemia was defined as a hematocrit of < 30% during the index hospitalization. Concurrent medications prescribed at hospital discharge included aspirin, ticlopidine, and clopidogrel, and agents from the following classes that have documented interactions: nonsteroidal antiinflammatory drugs (NSAIDs); dipyridamole; antibiotics; antiarrhythmic agents; histamine-2 antagonists; proton pump inhibitors; antifungal agents; pulmonary drugs; leukotriene antagonist agents; and lipid-lowering agents. We also tracked whether warfarin therapy was initiated during the index hospitalization or the subject had been admitted to the hospital while receiving warfarin therapy.
Statistical Analysis
We randomly split the sample for model development (75%) and validation (25%) using a random number generator. Bivariate relationships between the predictors and bleeding risk were examined using Kaplan-Meier curves, the log rank test, and Cox regression hazard ratios (HRs). Predictors with sufficient numbers and potential association indicated by at least one of the bivariate methods were considered for inclusion in the multivariable model.
Stepwise selection was used to determine the final Cox regression model (p < 0.15 to enter the study; p < 0.1 to remain in the study). Selected predictor variables were checked for collinearity. Risk scores were then created for each subject based on their adjusted HR of a bleeding event from the final model. All possible sets of cut points to determine a low, moderate, or high bleeding risk based on these scores were tested as predictors of a bleeding event using the development cohort. The cut points with the largest log-likelihood were selected as the optimal set of cut points for the contemporary bleeding risk model.
Risk scores were then generated for subjects in the validation sample and categorized based on the cut points as low, moderate, or high risk. The Pearson
2 statistic was used to compare the proportion of bleeding events across risk categories. Unconditional logistic regression predicting bleeding events by risk category was used to perform pairwise comparisons of bleeding event proportions and to estimate the area under the receiver operating characteristic (ROC) curve.27 (The Bonferroni correction was used for these pairwise comparisons.28) Area under the ROC curve was estimated using the c-statistic.29 Kaplan-Meier survival curves were generated for each risk category, and the HRs of a bleeding event were compared using the log-rank test for trend.30
Using the validation sample, subjects were categorized into risk groups based on the model of Kuijer et al11 and the OBRI model. Modifications were made to best fit this risk model to the data available in our data set. The OBRI model combined all prior bleeding events, while we differentiated between bleeding events occurring during index hospitalization and remote bleeding events. Likewise, the OBRI included only recent MIs, whereas our data only contained a variable indicating any prior MI. Last, our data did not allow for us to examine the effect of renal insufficiency, thereby excluding one of the comorbidities from the OBRI model. Because all subjects were > 65 years old, there was no low-risk group in either the model of Kuijer et al11 or the OBRI model. The comparisons of our model to the Kuijer et al11 and OBRI models followed the same steps as our validation process. The University of Kansas Advisory Committee on Human Experimentation approved the research protocol.
Results
The cohort consisted of 76,177 unique observations. Reasons and counts for exclusion were made in the following order: failure to match with the Medicare denominator file; death before hospital discharge; discharged from the hospital against medical advice or discharged to an acute care hospital (n = 6,666); managed care enrollment (n = 3,215); no warfarin prescribed at the time of hospital discharge (n = 38,089); and age < 65 years (n = 1,862). There were 26,345 study subjects remaining for model development and validation. Cohort characteristics are found in Table 1 .
|
![]() |
1.07, > 1.07 but < 2.19, and
2.19, respectively, were classified as low, moderate, and high risk.
|
|
The OBRI model78910 performed better than the Kuijer et al11 model, with 1.0% of the intermediate-risk individuals and 2.5% of the high-risk individuals having experienced bleeding events (p < 0.0001). The area under the ROC curve was 0.613, representing a level between "no discrimination" and "acceptable discrimination."27 Kaplan-Meier curves (Fig 1, bottom, C) also showed the expected trends in the risk of bleeding events (p < 0.0001).
Discussion
We were able to identify eight variables that were significant predictors of major bleeding events. The resulting model combining these risk factors performed well in differentiating among low-risk, moderate-risk, and high-risk groups, and likewise performed well when compared with two previous bleeding risk models. Our contemporary model improved the discrimination between subjects at risk for a bleeding event based on areas under the ROC curve and had three categories that demonstrated a trend toward increasing bleeding risk with increasing risk category. The bleeding event rate was greatest in the high-risk group from our contemporary model. In addition, the bleeding rate of the high-risk group was more than twice that of the moderate-risk group in our model, and more than twice that of the high-risk categories from the other models.
Our entire study population was > 65 years of age, and 43% of subjects were
80 years of age, which is a substantially higher rate than that reported in either of the previous models. For instance, in the second OBRI model,8 only 6% of persons in the derivation and validation cohorts were > 80 years of age. Advanced age has consistently been associated with the underutilization of warfarin therapy, despite the fact that benefits are potentially greater since the risk of stroke and death increase with age.1312 Women have inconsistently been found to have higher bleeding rates.11131819
A clinically important advantage of our model over the two existing models is the identification of additional risk factors and our ability to separately quantify the effects of each risk factor. The added bleeding risk associated with concomitant antiplatelet therapy is particularly important given its prevalent use in treating comorbidities such as coronary heart disease. Approximately 20% of AF patients received concomitant warfarin-antiplatelet therapy,2224 and antiplatelet therapy increases major bleeding rates in warfarin users, as noted in a previous analysis of these data and other work.2431
In examining the weights for the eight risk factors, alcohol/drug abuse and anemia were particularly important risk factors. While the OBRI model78910 includes anemia as one of several important comorbidities, it did not include alcohol/drug abuse. Chronic alcohol/drug abuse is likely to cause liver impairment, and although it is considered to be a contraindication to warfarin therapy, its presence was noted in nearly 2% of the study cohort.
The finding that bleeding risk was increased in diabetic patients is significant given the epidemiologic association between AF and diabetes,3233 and the increasing prevalence of this comorbidity. Our findings confirm recent findings34 showing increased bleeding risk in AF patients with diabetes. As with the Kuijer et al model11 and other studies,12131819 we found increased bleeding rates among women, although gender was not included in the OBRI model.78910
Limitations to our approach included the lack of ability to track compliance with, continuation of, or initiation of drug therapy after hospitalization and the inability to observe clinical laboratory values. We were left with the assumption that patients continued to receive the therapies they had been prescribed at hospital discharge throughout the study period, which is an intention-to-treat approach. We limited the follow-up time to 90 days, although this time frame should be adequate since studies1519353637 have shown that major bleeding events most often occur early in the course of warfarin therapy. However, we found no significant difference in the number of bleeding events between those who had been admitted to the hospital while receiving warfarin therapy and new users.
International normalized ratio (INR) values at hospital discharge or during follow-up were not documented in our data set. While INRs are used to monitor warfarin levels and to adjust therapy in order to avoid bleeding events, additional patient characteristics must also be considered. The availability of INR values may have improved the strength of the predictive model; however, the ability to stratify risk indicates that there was significant variation in bleeding events based on other patient-specific factors. These variables can assist clinicians who want to estimate the bleeding risk prior to drug initiation and INR monitoring.
Finally, we only examined risk among persons receiving warfarin therapy, and it is quite likely that additional AF patients who were not discharged from the hospital while warfarin therapy would have benefited from antithrombotic therapy. The Stroke Patient Outcomes Research Team concluded that improved antithrombotic therapy in AF patients could prevent an additional 40,000 strokes annually and save an estimated $600 million.38 Nonetheless, clinicians must weigh the potential benefits against each individual patients risk for major bleeding. For example, although diabetes and age were independent risk factors for bleeding, they were also independent risk factors for stroke. The 5.4% risk of major bleeding events that was seen in our group with the highest risk of stroke must be weighed against the > 7% annual stroke risk faced by the highest risk patients with AF.39 At the patient level, this tradeoff can be difficult for clinicians to estimate.40
Summary
Using a nationally derived data set, we have developed a model based on contemporary practice standards for determining the risk of major bleeding events among AF patients receiving warfarin therapy. Risk scores can be computed for individuals considering the following eight separately weighted factors: age; gender; recent bleeding event; remote bleeding event; alcohol/drug abuse; diabetes; anemia; and concomitant antiplatelet therapy. Validation of this model in other study populations is warranted.
Acknowledgements
The authors acknowledge the assistance of the Iowa Foundation for Medical Care and the Centers for Medicare & Medicaid Services in providing the data that made this research possible.
Footnotes
Abbreviations: AF = atrial fibrillation; HR = hazard ratio; INR = international normalized ratio; MI = myocardial infarction; NSAID = nonsteroidal antiinflammatory drug; OBRI = Outpatient Bleeding Risk Index; ROC = receiver operating characteristic
The American Heart Association provided funding for this project through grant-in-aid No. 0450071Z.
The conclusions presented are solely those of the authors and do not represent those of the Iowa Foundation for Medical Care or the Centers for Medicare & Medicaid Services.
The authors have reported to the ACCP that no significant conflicts of interest exist with any companies/organizations whose products or services may be discussed in this article.
Received for publication June 8, 2006. Accepted for publication June 13, 2006.
References
This article has been cited by other articles:
![]() |
D. A. Lane and G. Y. H. Lip Maintaining Therapeutic Anticoagulation: The Importance of Keeping "Within Range" Chest, May 1, 2007; 131(5): 1277 - 1279. [Full Text] [PDF] |
||||
![]() |
P. Kakar, D. Lane, and G. Y. H. Lip Bleeding risk stratification models in deciding on anticoagulation in patients with atrial fibrillation: a useful complement to stroke risk stratification schema. Chest, November 1, 2006; 130(5): 1296 - 1299. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |