Original Research

Resuming Anticoagulation following Upper Gastrointestinal Bleeding among Patients with Nonvalvular Atrial Fibrillation—A Microsimulation Analysis


BACKGROUND: Among patients with nonvalvular atrial fibrillation (NVAF) who have sustained an upper gastrointestinal bleed (UGIB), the benefits and harms of oral anticoagulation change over time. Early resumption of anticoagulation increases recurrent bleeding, while delayed resumption exposes patients to a higher risk of ischemic stroke. We therefore set out to estimate the expected benefit of resuming anticoagulation as a function of time after UGIB among patients with NVAF.
METHODS: We created a decision-analytic model estimating discounted quality-adjusted life-years when patients with NVAF resume anticoagulation on each day following UGIB. We simulated from a health system perspective over a lifelong time horizon.
RESULTS: Peak utility for warfarin was achieved by resumption 41 days after hemostasis from the index UGIB. Resumption between days 32 and 51 produced greater than 99.9% of the peak utility. Peak utility for apixaban was achieved by resumption 32 days after the index UGIB. Resumption between days 21 and 47 produced greater than 99.9% of the peak utility. Of input parameters, results were most sensitive to underlying stroke risk. Specifically, across the range of CHA2DS2-Vasc scores, the optimal day of resumption varied by around 11 days for patients resuming warfarin and by around 15 days for patients resuming apixaban. Results were less sensitive to underlying risk of rebleeding.
CONCLUSIONS: For patients with NVAF following UGIB, warfarin is optimally restarted approximately six weeks following hemostasis, and apixaban is optimally restarted approximately one month following hemostasis. Modest changes to this timing based on probability of thromboembolic stroke are reasonable.

© 2019 Society of Hospital Medicine

Anticoagulation is commonly used in the management of atrial fibrillation to reduce the risk of ischemic stroke. Warfarin and other anticoagulants increase the risk of hemorrhagic complications, including upper gastrointestinal bleeding (UGIB). Following UGIB, management of anticoagulation is highly variable. Many patients permanently discontinue anticoagulation, while others continue without interruption.1-4 Among patients who resume warfarin, different cohorts have measured median times to resumption ranging from four days to 50 days.1-3 Outcomes data are sparse, and clinical guidelines offer little direction.5

Following UGIB, the balance between the risks and benefits of anticoagulation changes over time. Rebleeding risk is highest immediately after the event and declines quickly; therefore, rapid resumption of anticoagulation causes patient harm.3 Meanwhile, the risk of stroke remains constant, and delay in resumption of anticoagulation is associated with increased risk of stroke and death.1 At some point in time following the initial UGIB, the expected harm from bleeding would equal the expected harm from stroke. This time point would represent the optimal time to restart anticoagulation.

Trial data are unlikely to identify the optimal time for restarting anticoagulation. A randomized trial comparing discrete reinitiation times (eg, two weeks vs six weeks) may easily miss the optimal timing. Moreover, because the daily probability of thromboembolic events is low, large numbers of patients would be required to power such a study. In addition, a number of oral anticoagulants are now approved for prevention of thromboembolic stroke in atrial fibrillation, and each drug may have different optimal timing.

In contrast to randomized trials that would be impracticable for addressing this clinical issue, microsimulation modeling can provide granular information regarding the optimal time to restart anticoagulation. Herein, we set out to estimate the expected benefit of reinitiation of warfarin, the most commonly used oral anticoagulant,6 or apixaban, the direct oral anticoagulant with the most favorable risk profile,7 as a function of days after UGIB.


We previously described a microsimulation model of anticoagulation among patients with nonvalvular atrial fibrillation (NVAF; hereafter, we refer to this model as the Personalized Anticoagulation Decision-Making Assistance model, or PADMA).8,9 For this study, we extended this model to incorporate the probability of rebleeding following UGIB and include apixaban as an alternative to warfarin. This model begins with a synthetic population following UGIB, the members of which are at varying risk for thromboembolism, recurrent UGIB, and other hemorrhages. For each patient, the model simulates a number of possible events (eg, thromboembolic stroke, intracranial hemorrhage, rebleeding, and other major extracranial hemorrhages) on each day of an acute period of 90 days after hemostasis. Patients who survive until the end of the acute period enter a simulation with annual, rather than daily, cycles. Our model then estimates total quality-adjusted life-years (QALYs) for each patient, discounted to the present. We report the average discounted QALYs produced by the model for the same population if all individuals in our input population were to resume either warfarin or apixaban on a specific day. Input parameters and ranges are summarized in Table 1, a simplified schematic of our model is shown in the Supplemental Appendix, and additional details regarding model structure and assumptions can be found in earlier work.8,9 We simulated from a health system perspective over a lifelong time horizon. All analyses were performed in version 14 of Stata (StataCorp, LLC, College Station, Texas).

Synthetic Population

To generate a population reflective of the comorbidities and age distribution of the US population with NVAF, we merged relevant variables from the National Health and Nutrition Examination Survey (NHANES; 2011-2012), using multiple imputation to correct for missing variables.10 We then bootstrapped to national population estimates by age and sex to arrive at a hypothetical population of the United States.11 Because NHANES does not include atrial fibrillation, we applied sex- and age-specific prevalence rates from the AnTicoagulation and Risk Factors In Atrial Fibrillation study.12 We then calculated commonly used risk scores (CHA2DS2-Vasc and HAS-BLED) for each patient and limited the population to patients with a CHA2DS2-Vasc score of one or greater.13,14 The population resuming apixaban was further limited to patients whose creatinine clearance was 25 mL/min or greater in keeping with the entry criteria in the phase 3 clinical trial on which the medication’s approval was based.15

To estimate patient-specific probability of rebleeding, we generated a Rockall score for each patient.16 Although the discrimination of the Rockall score is limited for individual patients, as with all other tools used to predict rebleeding following UGIB, the Rockall score has demonstrated reasonable calibration across a threefold risk gradient.17-19 International consensus guidelines recommend the Rockall score as one of two risk prediction tools for clinical use in the management of patients with UGIB.20 In addition, because the Rockall score includes some demographic components (five of a possible 11 points), our estimates of rebleeding risk are covariant with other patient-specific risks. We assumed that the endoscopic components of the Rockall score were present in our cohort at the same frequency as in the original derivation and are independent of known patient risk factors.16 For example, 441 out of 4,025 patients in the original Rockall derivation cohort presented with a systolic blood pressure less than 100 mm Hg. We assumed that an independent and random 10.96% of the cohort would present with shock, which confers two points in the Rockall score.

The population was replicated 60 times, with identical copies of the population resuming anticoagulation on each of days 1-60 (where day zero represents hemostasis). Intermediate data regarding our simulated population can be found in the Supplemental Appendix and in prior work.

Event Type, Severity, and Mortality

Each patient in our simulation could sustain several discrete and independent events: ischemic stroke, intracranial hemorrhage, recurrent UGIB, or extracranial major hemorrhage other than recurrent UGIB. As in prior analyses using the PADMA model, we did not consider minor hemorrhagic events.8

The probability of each event was conditional on the corresponding risk scoring system. Patient-specific probability of ischemic stroke was conditional on CHA2DS2-Vasc score.21,22 Patient-specific probability of intracranial hemorrhage was conditional on HAS-BLED score, with the proportions of intracranial hemorrhage of each considered subtype (intracerebral, subarachnoid, or subdural) bootstrapped from previously-published data.21-24 Patient-specific probability of rebleeding was conditional on Rockall score from the combined Rockall and Vreeburg validation cohorts.17 Patient-specific probability of extracranial major hemorrhage was conditional on HAS-BLED score.21 To avoid double-counting of UGIB, we subtracted the baseline risk of UGIB from the overall rate of extracranial major hemorrhages using previously-published data regarding relative frequency and a bootstrapping approach.25

Probability of Rebleeding Over Time

To estimate the decrease in rebleeding risk over time, we searched the Medline database for systematic reviews of recurrent bleeding following UGIB using the strategy detailed in the Supplemental Appendix. Using the interval rates of rebleeding we identified, we calculated implied daily rates of rebleeding at the midpoint of each interval. For example, 39.5% of rebleeding events occurred within three days of hemostasis, implying a daily rate of approximately 13.2% on day two (32 of 81 events over a three-day period). We repeated this process to estimate daily rates at the midpoint of each reported time interval and fitted an exponential decay function.26 Our exponential fitted these datapoints quite well, but we lacked sufficient data to test other survival functions (eg, Gompertz, lognormal, etc.). Our fitted exponential can be expressed as:

P rebleeding = b 0 *exp(b 1 *day)

where b0 = 0.1843 (SE: 0.0136) and b1 = –0.1563 (SE: 0.0188). For example, a mean of 3.9% of rebleeding episodes will occur on day 10 (0.1843 *exp(–0.1563 *10)).

Relative Risks of Events with Anticoagulation

For patients resuming warfarin, the probabilities of each event were adjusted based on patient-specific daily INR. All INRs were assumed to be 1.0 until the day of warfarin reinitiation, after which interpolated trajectories of postinitiation INR measurements were sampled for each patient from an earlier study of clinical warfarin initiation.27 Relative risks of ischemic stroke and hemorrhagic events were calculated based on each day’s INR.

For patients taking apixaban, we assumed that the medication would reach full therapeutic effect one day after reinitiation. Based on available evidence, we applied the relative risks of each event with apixaban compared with warfarin.25

Future Disability and Mortality

Each event in our simulation resulted in hospitalization. Length of stay was sampled for each diagnosis.28 The disutility of hospitalization was estimated based on length of stay.8 Inpatient mortality and future disability were predicted for each event as previously described.8 We assumed that recurrent episodes of UGIB conferred morbidity and mortality identical to extracranial major hemorrhages more broadly.29,30


We used a multiplicative model for disutility with baseline utilities conditional on age and sex.31 Each day after resumption of anticoagulation carried a disutility of 0.012 for warfarin or 0.002 for apixaban, which we assumed to be equivalent to aspirin in disutility.32 Long-term disutility and life expectancy were conditional on modified Rankin Score (mRS).33,34 We discounted all QALYs to day zero using standard exponential discounting and a discount rate centered at 3%. We then computed the average discounted QALYs among the cohort of patients that resumed anticoagulation on each day following the index UGIB.

Sensitivity Analyses and Metamodel

To assess sensitivity to continuously varying input parameters, such as discount rate, the proportion of extracranial major hemorrhages that are upper GI bleeds, and inpatient mortality from extracranial major hemorrhage, we constructed a metamodel (a regression model of our microsimulation results).35 We tested for interactions among input parameters and dropped parameters that were not statistically significant predictors of discounted QALYs from our metamodel. We then tested for interactions between each parameter and day resuming anticoagulation to determine which factors may impact the optimal day of reinitiation. Finally, we used predicted marginal effects from our metamodel to assess the change in optimal day across the ranges of each input parameter when other parameters were held at their medians.


Resuming warfarin on day zero produced the fewest QALYs. With delay in reinitiation of anticoagulation, expected QALYs increased, peaked, and then declined for all scenarios. In our base-case simulation of warfarin, peak utility was achieved by resumption 41 days after the index UGIB. Resumption between days 32 and 51 produced greater than 99.9% of peak utility. In our base-case simulation of apixaban, peak utility was achieved by resumption 32 days after the index UGIB. Resumption between days 21 and 47 produced greater than 99.9% of peak utility. Results for warfarin and apixaban are shown in Figures 1 and 2, respectively.

The optimal day of warfarin reinitiation was most sensitive to CHA2DS2-Vasc scores and varied by around 11 days between a CHA2DS2-Vasc score of one and a CHA2DS2-Vasc score of six (the 5th and 95th percentiles, respectively) when all other parameters are held at their medians. Results were comparatively insensitive to rebleeding risk. Varying Rockall score from two to seven (the 5th and 95th percentiles, respectively) added three days to optimal warfarin resumption. Varying other parameters from the 5th to the 95th percentile (including HAS-BLED score, sex, age, and discount rate) changed expected QALYs but did not change the optimal day of reinitiation of warfarin. Optimal day of reinitiation for warfarin stratified by CHA2DS2-Vasc score is shown in Table 2.

Sensitivity analyses for apixaban produced broadly similar results, but with greater sensitivity to rebleeding risk. Optimal day of reinitiation varied by 15 days over the examined range of CHA2DS2-Vasc scores (Table 2) and by six days over the range of Rockall scores (Supplemental Appendix). Other input parameters, including HAS-BLED score, age, sex, and discount rate, changed expected QALYs and were significant in our metamodel but did not affect the optimal day of reinitiation. Metamodel results for both warfarin and apixaban are included in the Supplemental Appendix.


Anticoagulation is frequently prescribed for patients with NVAF, and hemorrhagic complications are common. Although anticoagulants are withheld following hemorrhages, scant evidence to inform the optimal timing of reinitiation is available. In this microsimulation analysis, we found that the optimal time to reinitiate anticoagulation following UGIB is around 41 days for warfarin and around 32 days for apixaban. We have further demonstrated that the optimal timing of reinitiation can vary by nearly two weeks, depending on a patient’s underlying risk of stroke, and that early reinitiation is more sensitive to rebleeding risk than late reinitiation.

Prior work has shown that early reinitiation of anticoagulation leads to higher rates of recurrent hemorrhage while failure to reinitiate anticoagulation is associated with higher rates of stroke and mortality.1-4,36 Our results add to the literature in a number of important ways. First, our model not only confirms that anticoagulation should be restarted but also suggests when this action should be taken. The competing risks of bleeding and stroke have left clinicians with little guidance; we have quantified the clinical reasoning required for the decision to resume anticoagulation. Second, by including the disutility of hospitalization and long-term disability, our model more accurately represents the complex tradeoffs between recurrent hemorrhage and (potentially disabling) stroke than would a comparison of event rates. Third, our model is conditional upon patient risk factors, allowing clinicians to personalize the timing of anticoagulation resumption. Theory would suggest that patients at higher risk of ischemic stroke benefit from earlier resumption of anticoagulation, while patients at higher risk of hemorrhage benefit from delayed reinitiation. We have quantified the extent to which patient-specific risks should change timing. Fourth, we offer a means of improving expected health outcomes that requires little more than appropriate scheduling. Current practice regarding resuming anticoagulation is widely variable. Many patients never resume warfarin, and those that do resume do so after highly varied periods of time.1-5,36 We offer a means of standardizing clinical practice and improving expected patient outcomes.

Interestingly, patient-specific risk of rebleeding had little effect on our primary outcome for warfarin, and a greater effect in our simulation of apixaban. It would seem that rebleeding risk, which decreases roughly exponentially, is sufficiently low by the time period at which warfarin should be resumed that patient-specific hemorrhage risk factors have little impact. Meanwhile, at the shorter post-event intervals at which apixaban can be resumed, both stroke risk and patient-specific bleeding risk are worthy considerations.

Our model is subject to several important limitations. First, our predictions of the optimal day as a function of risk scores can only be as well-calibrated as the input scoring systems. It is intuitive that patients with higher risk of rebleeding benefit from delayed reinitiation, while patients with higher risk of thromboembolic stroke benefit from earlier reinitiation. Still, clinicians seeking to operationalize competing risks through these two scores—or, indeed, any score—should be mindful of their limited calibration and shared variance. In other words, while the optimal day of reinitiation is likely in the range we have predicted and varies to the degree demonstrated here, the optimal day we have predicted for each score is likely overly precise. However, while better-calibrated prediction models would improve the accuracy of our model, we believe ours to be the best estimate of timing given available data and this approach to be the most appropriate way to personalize anticoagulation resumption.

Our simulation of apixaban carries an additional source of potential miscalibration. In the clinical trials that led to their approval, apixaban and other direct oral anticoagulants (DOACs) were compared with warfarin over longer periods of time than the acute period simulated in this work. Over a short period of time, patients treated with more rapidly therapeutic medications (in this case, apixaban) would receive more days of effective therapy compared with a slower-onset medication, such as warfarin. Therefore, the relative risks experienced by patients are likely different over the time period we have simulated compared with those measured over longer periods of time (as in phase 3 clinical trials). Our results for apixaban should be viewed as more limited than our estimates for warfarin. More broadly, simulation analyses are intended to predict overall outcomes that are difficult to measure. While other frameworks to assess model credibility exist, the fact remains that no extant datasets can directly validate our predictions.37

Our findings are limited to patients with NVAF. Anticoagulants are prescribed for a variety of indications with widely varied underlying risks and benefits. Models constructed for these conditions would likely produce different timing for resumption of anticoagulation. Unfortunately, large scale cohort studies to inform such models are lacking. Similarly, we simulated UGIB, and our results should not be generalized to populations with other types of bleeding (eg, intracranial hemorrhage). Again, cohort studies of other types of bleeding would be necessary to understand the risks of anticoagulation over time in such populations.

Higher-quality data regarding risk of rebleeding over time would improve our estimates. Our literature search identified only one systematic review that could be used to estimate the risk of recurrent UGIB over time. These data are not adequate to interrogate other forms this survival curve could take, such as Gompertz or Weibull distributions. Recurrence risk almost certainly declines over time, but how quickly it declines carries additional uncertainty.

Despite these limitations, we believe our results to be the best estimates to date of the optimal time of anticoagulation reinitiation following UGIB. Our findings could help inform clinical practice guidelines and reduce variation in care where current practice guidelines are largely silent. Given the potential ease of implementing scheduling changes, our results represent an opportunity to improve patient outcomes with little resource investment.

In conclusion, after UGIB associated with anticoagulation, our model suggests that warfarin is optimally restarted approximately six weeks following hemostasis and that apixaban is optimally restarted approximately one month following hemostasis. Modest changes to this timing based on probability of thromboembolic stroke are reasonable.


The authors have nothing to disclose.


The authors received no specific funding for this work.


Online-Only Materials

   Comments ()

Related Articles from PubMed

Med Decis Making. 2016 Apr;36(3):366-74. doi: 10.1177/0272989X15593083. Epub 2015 Jul 2.