Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Sequential organ failure assessment in predicting mortality after paraquat poisoning: A meta-analysis

  • Wen Jie Wang ,

    Contributed equally to this work with: Wen Jie Wang, Li Wei Zhang

    Roles Conceptualization, Writing – original draft

    Affiliation Emergency Department, Cangzhou Central Hospital, Yunhe Qu, Cangzhou, China

  • Li Wei Zhang ,

    Contributed equally to this work with: Wen Jie Wang, Li Wei Zhang

    Roles Data curation, Methodology

    Affiliation Laboratory Department, Yutian County Hospital, Yutian Xian, Tangshan, China

  • Shun Yi Feng,

    Roles Data curation, Formal analysis, Software

    Affiliation Emergency Department, Cangzhou Central Hospital, Yunhe Qu, Cangzhou, China

  • Jie Gao,

    Roles Data curation, Project administration, Writing – original draft

    Affiliation Emergency Department, Cangzhou Central Hospital, Yunhe Qu, Cangzhou, China

  • Yong Li

    Roles Conceptualization, Writing – review & editing

    ly13333367871@hotmail.com

    Affiliation Emergency Department, Cangzhou Central Hospital, Yunhe Qu, Cangzhou, China

Abstract

Sequential organ failure assessment (SOFA) score is commonly used to determine disease severity and predict prognosis in critically ill patients. However, the prognostic value of SOFA after acute paraquat (PQ) poisoning remains unclear. This meta-analysis aimed to study the capability of SOFA to predict mortality in patients with PQ poisoning. Databases that included PubMed, Embase, Web of Science, ScienceDirect, Embase, and Cochrane Library were searched through May 2018. Six studies involving 946 patients were included in the meta-analysis. Study-specific odds ratios (ORs) and 95% confidence intervals (CIs) were calculated, and then ORs with 95% CIs were pooled for the estimation of the prognostic role of SOFA in patients with PQ poisoning. Results showed that higher SOFA in patients with PQ poisoning was related to severe mortality (OR = 8.14, 95%CI 4.26–15.58, p<0.001). The pooled sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, diagnostic OR, and area under the curve were 72% (95%CI 0.65–0.79), 75% (95%CI 0.65–0.83), 2.9 (95%CI 2.0–4.1), 0.37 (95%CI 0.28–0.41), 8 (95%CI 4–14), and 0.79 (95%CI 0.76–0.83), respectively. No evidence of publication bias was detected by funnel plot analysis and formal statistical tests. Sensitivity analyses showed no important differences in the estimates of effects. The high SOFA score (8.1-fold) was associated with severe mortality in patients with PQ poisoning.

Introduction

As a highly effective, nonselecting, and fast-acting herbicide, paraquat (PQ) is harmless to the environment because of its rapid decomposition into nontoxic compounds after soil contact. These excellent properties led to the adoption of PQ worldwide over the past few decades. PQ ingestion occurs frequently in the agricultural countryside, either accidentally or as a suicide attempt, thereby posing a serious public health problem. PQ accounts for an estimated 20 deaths per million person-years worldwide [13]. Although many investigators have attempted to find efficacious treatments for the management of acute PQ poisoning, the clinical therapeutics are still unsatisfactory, and the mortality rate remains tremendously high (50%–90%) [2, 4, 5]. Therefore, confirming the diagnosis of PQ poisoning and risk assessment in a timely manner are particularly important.

Toxicological analysis of plasma and urine samples is used to establish the diagnosis. The mortality rate of PQ poisoning is directly related to plasma and urine PQ concentrations. Unfortunately, PQ assays are not widely available, particularly in developing countries. Another important predictor of mortality is the amount of PQ consumed [6]. However, estimates on the amount ingested are often unobtainable or unreliable in many intoxicated patients. Current studies propose some predictive equations based on similar sample sizes. Unfortunately, these equations have not been widely used in clinical situations because of their difficult calculation [7, 8]. Therefore, alternative prognostic indicators for acute PQ poisoning are still required for clinical practice.

Sequential organ failure assessment (SOFA) score calculates a summary value for the degree of dysfunction of six parameters (PaO2/FiO2, platelet count, serum bilirubin level, hypotension, Glasgow coma score, and serum creatinine or urine output). Four levels of dysfunction are identified in the SOFA score for each organ system. This scoring system has been commonly used to assess the severity and prognosis of diseases, especially in intensive care units. Currently, SOFA can predict the prognosis and mortality of patients with PQ poisoning [914]. However, these studies[914] showed a discordant predictive value of this scoring system. Therefore, the present study aimed to investigate the potential role of SOFA as a prognostic marker in patients with PQ poisoning.

Materials and methods

This meta-analysis was performed in accordance with the guidelines of Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines [15], and it was conducted following a priori established protocol (PROSPERO: CRD42018095915). Ethical approval was not required because this study was a literature-based work.

Search strategy

The related clinical research was obtained from the electronic databases, including PubMed, Web of Science, ScienceDirect, Embase, and Cochrane Library, using terms such as paraquat, predictive, prediction, prognostic, and sequential organ failure assessment, and a deadline of May 1, 2018. Simultaneously, references in corresponding literature included in the above databases were retrieved artificially based on the title of the literature to screen applicable studies.

Inclusion and exclusion criteria

Inclusion criteria were as follows: focus on the association of SOFA with mortality risk in patients with PQ poisoning; the standard diagnostic criteria of PQ poisoning are met; and SOFA data are available to calculate odds ratio (OR) and its 95% confidence interval (CI). In cases of repeated studies or overlapping data, studies that involved large sample sizes or were published more recently were selected. If the reported data were incomplete, then the corresponding author was contacted to obtain complete data. Exclusion criteria were as follows: reviews, comments, abstracts, and case reports; literature with unavailable full text or data; and repeated publication.

Data extraction

The substantial contents of each selected article were extracted by WJW and LWZ. Extracted information included the name of the first author, publication time, study design, sample size, mortality percentage, cut-off value, SOFA score, blood PQ level, time from ingestion to arrival and treatment protocol. Any disagreements were resolved by consensus or by consulting a third author (YL).

Risk of bias

The risk of bias was independently evaluated by two reviewers (WJW and SYF) for each study as low, moderate, or high, using criteria adopted from the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) [16]. Conflict was resolved by discussion or by consulting a third author (YL).

Statistical analysis

All pooled analyses were conducted using STATA 12.0 software (StataCorp LP, College Station, TX, USA). The Cochrane’s Q statistic and I2 statistic were computed to test the significance of potential heterogeneity. If studies reported moderate or low heterogeneity (I2 <50%), then the fixed effects model was used for pooling. Otherwise, the random effects model was adopted for I2 ≥50% [17]. The I2 statistic was used to evaluate heterogeneity; values of 25%, 50%, and 75% were considered low, moderate, and high heterogeneity, respectively [17]. Presence of heterogeneity warrant examining their sources where we used covariates in a meta-regression analysis. In this analysis, the following covariates were used: patients’ mortality percentage (≥50% vs. <50%), study design (prospective vs. retrospective), sample size (≥150 vs. <150), and cut-off value (≥3 vs. <3). We further conducted a sensitivity analysis to examine the impact of each study to the pooled effect. Begg’s test and Egger’s test were applied to assess publication bias among the included studies. Quality assessment of the included studies was conducted using RevMan 5.3 software (Nordic Cochrane Centre, Copenhagen, Denmark). p<0.05 was considered statistically significant.

Result

Literature search

On the basis of the search strategy, a total of 762 potentially relevant articles were identified in PubMed, Web of Science, ScienceDirect, Embase, and Cochrane Library. After browsing the titles and abstracts and then assessing the full text, six studies [914]. which included a total of 946 enrolled patients, were available for this meta-analysis. As shown in Fig 1, the literature search process is summarized in a flow diagram in accordance with PRISMA.

Characteristics of the included studies

The baseline characteristics of these studies are listed in Table 1. The studies, which were published between 2012 and 2016, contained a total of 946 patients with a mean patient sample size of 157.67 (range 97–219). Of the six studies, five originated from China, and the remaining one originated from Korea.

Quality assessment

According to the QUADAS-2, each of the six eligible studies included in our meta-analysis was assessed for quality. All of them demonstrated moderate to high quality, so they were appropriate for this meta-analysis (Fig 2).

thumbnail
Fig 2. Forest plot for the association of SOFA and mortality.

https://doi.org/10.1371/journal.pone.0207725.g002

Meta-analysis of mortality

The heterogeneity of the six studies was statistically significant (I2 = 74.2%, p<0.001). The random effects model was used to calculate the pooled OR and its 95% CI, yielding a significant difference (OR = 8.14, 95%CI 4.26–15.58, p<0.001). Thus, high SOFA in patients with PQ poisoning was related to severe mortality (Fig 3). The pooled sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, and diagnostic OR were 72% (95%CI 0.65–0.79), 75% (95%CI 0.65–0.83), 2.9 (95%CI 2.0–4.1), 0.37 (95% CI 0.28–0.41), and 8 (95%CI 4–14), respectively. An area under the curve of 0.79 (95%CI 0.76–0.83) could effectively detect prognosis (Fig 4).

thumbnail
Fig 4. Summary ROC curve for the 6 included studies.

Numbers in brackets are 95% CIs. AUC = area under ROC curve, SENS = sensitivity, SPEC = specificity.

https://doi.org/10.1371/journal.pone.0207725.g004

Heterogeneity, sensitivity analysis, and publication bias assessment

Meta-regression analyses were performed in accordance with some covariates, including study design, sample size, mortality percentage, and cut-off value; however, meta-regression outcomes did not identify the sources of heterogeneity (Table 2). A funnel plot was employed to explore bias among the included studies. No apparent publication bias was detected (Begg’s test p = 0.260, Fig 5A; Egger’s test p = 0.406, Fig 5B). Given that no single study influenced the pooled effect, our result was considered robust (Fig 6).

thumbnail
Fig 5. Funnel plot of the publication bias test.

(A)Begg’s test; and (B) Egger’s test.

https://doi.org/10.1371/journal.pone.0207725.g005

thumbnail
Fig 6. Sensitivity analysis of the relationship between SOFA and mortality.

https://doi.org/10.1371/journal.pone.0207725.g006

thumbnail
Table 2. Meta-regression analysis of potential sources of heterogeneity.

https://doi.org/10.1371/journal.pone.0207725.t002

Discussion

This study aimed to develop a reliable indicator to predict survival after PQ poisoning. Identifying the factors associated with early mortality may offer primary clinical information, which will be used to make correct evaluations and decisions and increase the chances of survival. Currently, the plasma PQ concentration is the most remarkable and consistent potential prognostic marker with acceptable sensitivity and specificity that can predict mortality [1820]. We reviewed some articles [10, 11, 21] to validate and compare the performance of plasma PQ concentration and SOFA in various populations. The area under the ROC curves for plasma PQ concentration ranged from 0.679 to 0.866, and those for SOFA ranged from 0.631 to 0.867 in various populations.

Several variables inherent to SOFA, including low PaO2/FiO2, increased serum creatinine, elevated bilirubin levels, deteriorated state of circulation, inferior Glasgow coma score, and decreased platelet count, were associated with high mortality. Within the first few hours of PQ intoxication, PQ cation radicals with high affinity for alveoles directly damage the lungs and frequently cause death from hypoxemia and respiratory failure. Previous studies have shown that non-survivors have lower PaO2/FiO2 levels than survivors [9, 22]. Notably, a low PaO2/FiO2 level indicates a rapid and often fatal clinical evolution [23, 24]. As the kidney is the primary excretory pathway for absorbed PQ, PQ specially causes kidney damage. Renal failure may be manifested by proteinuria and oliguria, which then progresses to acute tubular necrosis [25]. Main lesions, including swelling, degeneration, and partial necrosis of epithelial cells, interstitial congestion, and edema, are located in renal proximal tubule [26]. Renal failure develops quite rapidly from moderate to severe PQ poisoning, and increased creatinine concentrations can be monitored for the detection of renal failure and prediction of long-term outcome [2, 9, 22, 27, 28]. The unchanged form of PQ are usually excreted in the urine, and, to a limited extent, in the liver and bile [29]. The liver is the main site for xenobiotic metabolism and has a high potential for generating reactive oxygen species. Thus, the liver is at high risk of suffering toxic damage [30]. Remarkable increase in bilirubin, alanine transaminase, and aspartate aminotransferase was observed in PQ-exposed patients [3134]. Deteriorated circulation [35, 36] is also common in moderate and severe PQ poisoning. Initially, hypotension is generally due to hypovolemia, and then deteriorated lactic acidosis, hypoxemia, metabolic acidosis, and myocardial contraction asthenia generate circulatory failure [37]. PQ-intoxicated patients generally maintain a normal level of consciousness. Severe toxicity due to hypoxia, hypotension, and severe acidosis results in altered consciousness [38]. Toxic thrombocytopenia [22] was observed; however, the biological explanation for this clinical observation remains unclear. The causes of thrombocytopenia are multifactorial, including hypovolemia, hypothermia, circulatory failure, septicemia, and direct toxicity related to redox cycling. SOFA is based on the extent of organ function, and PQ poisoning is characterized by multi-organ failure; therefore, the SOFA system may be useful in predicting the prognosis of patients with acute PQ poisoning.

Given that significant heterogeneity was present in the evaluation of SOFA accuracy, our study explored factors that may be responsible for heterogeneity via meta-regression analysis. Although the specific covariates of patients and studies were examined, no factors could affect SOFA accuracy. The cause for this finding has yet to be determined.

To the best of our knowledge, we are the first to investigate the capability of SOFA through meta-analysis and to predict mortality in patients with PQ poisoning through a comprehensive literature search and the retrieval of all relevant trials. We used aggregated study-level data rather than individual patient data and thus we were able to use information from nearly all available trials. This approach enabled us render the results generalizable across a broad spectrum of patients with PQ poisoning. However, this meta-analysis study has some limitations that require the cautious interpretation of results. First, only six studies were included in this meta-analysis, which may inefficiently assess the accuracy of SOFA. Second, unpublished studies were not identified in our study, and no attempt was made to include articles in other languages. Third, significant heterogeneity was observed across trials. Four, the wide confidence intervals (OR = 8.14, 95%CI 4.26–15.58, p<0.001) may diminish the surety of any conclusions regarding efficacy [39]. Finally, the cut-off value varied among studies. In the perspective of statistical significance, this might introduce heterogeneity and bias to our pooled analysis. In addition, it made our meta-analysis fail to provide a precision guidance to clinical practice. Thus, in future more well-designed studies with large sample size are needed to solve this problem.

In conclusion, this meta-analysis of currently available studies proved that SOFA was likely an independent prognostic predictor for patients with PQ poisoning. Thus, clinicians should consider SOFA levels. However, further clinical trials with standardized methodology and criteria are required for confirmation.

Acknowledgments

The authors would like to thank Li Zhao and Liu Yong Hong for assistance in statistical analysis. The authors declare no conflict of interest.

References

  1. 1. Gil HW, Hong JR, Jang SH, Hong SY. Diagnostic and therapeutic approach for acute paraquat intoxication. J Korean Med Sci. 2014;29(11):1441–9. pmid:25408572.
  2. 2. Wu WP, Lai MN, Lin CH, Li YF, Lin CY, Wu MJ. Addition of immunosuppressive treatment to hemoperfusion is associated with improved survival after paraquat poisoning: a nationwide study. PLoS One. 2014;9(1):e87568. pmid:24475310.
  3. 3. Zhang YJ, Yu BX, Wang NN, Li TG. Acute poisoning in Shenyang, China: a retrospective and descriptive study from 2012 to 2016. BMJ Open. 2018;8(8):e021881. pmid:30158226.
  4. 4. Gao J, Feng S, Wang J, Yang S, Li Y. Prolonged methylprednisolone therapy after the pulse treatment for patients with moderate-to-severe paraquat poisoning: A retrospective analysis. Medicine (Baltimore). 2017;96(25):e7244. pmid:28640126.
  5. 5. Tan JT, Letchuman Ramanathan G, Choy MP, Leela R, Lim BK. Paraquat poisoning: experience in hospital taiping (year 2008—october 2011). Med J Malaysia. 2013;68(5):384–8. pmid:24632866.
  6. 6. Suzuki K, Takasu N, Arita S, Maenosono A, Ishimatsu S, Nishina M, et al. A new method for predicting the outcome and survival period in paraquat poisoning. Hum Toxicol. 1989;8(1):33–8. pmid:2714808.
  7. 7. Koo JR, Yoon JW, Han SJ, Choi MJ, Park I I, Lee YK, et al. Rapid analysis of plasma paraquat using sodium dithionite as a predictor of outcome in acute paraquat poisoning. Am J Med Sci. 2009;338(5):373–7. pmid:19826241.
  8. 8. Senarathna L, Eddleston M, Wilks MF, Woollen BH, Tomenson JA, Roberts DM, et al. Prediction of outcome after paraquat poisoning by measurement of the plasma paraquat concentration. QJM. 2009;102(4):251–9. pmid:19228776.
  9. 9. Jiao FJ, Zhu W, Wang TN, Yuan YY, Kang K, Liu M. Analysis of risk factors for prognosis of patients with acute paraquat intoxication. Zhonghua Wei Zhong Bing Ji Jiu Yi Xue. 2015;27(11):906–10. pmid:27132458.
  10. 10. Kang X, Hu DY, Li CB, Li XH, Fan SL, Liu Y, et al. The volume ratio of ground glass opacity in early lung CT predicts mortality in acute paraquat poisoning. PLoS One. 2015;10(4):e0121691. pmid:25830638.
  11. 11. Lee JH, Hwang SY, Kim HR, Kim YW, Kang MJ, Cho KW, et al. Effectiveness of the sequential organ failure assessment, acute physiology and chronic health evaluation II, and simplified acute physiology score II prognostic scoring systems in paraquat-poisoned patients in the intensive care unit. Hum Exp Toxicol. 2016;36(5):431–7. pmid:27387349.
  12. 12. Li Y, Wang M, Gao Y, Yang W, Xu Q, M E, et al. Abnormal pancreatic enzymes and their prognostic role after acute paraquatpoisoning. Sci Rep. 2015;5:17299. pmid:26603772.
  13. 13. Sun YQ, liu Z. Early evaluation of paraquat plasma concentration and urine sodium dithionite assay for prognosis in patients with acute paraquat poisoning. Chin Crit Care Med. 2016;28(10):886–90.
  14. 14. Weng CH, Hu CC, Lin JL, Lin-Tan DT, Huang WH, Hsu CW, et al. Sequential organ failure assessment score can predict mortality in patients with paraquat intoxication. PLoS One. 2012;7(12):e51743. pmid:23272154.
  15. 15. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Ann Intern Med. 2009;151(4):W65–94. pmid:19622512.
  16. 16. Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529–36. pmid:22007046.
  17. 17. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557–60. pmid:12958120
  18. 18. Min YG, Ahn JH, Chan YC, Ng SH, Tse ML, Lau FL, et al. Prediction of prognosis in acute paraquat poisoning using severity scoring system in emergency department. Clin Toxicol (Phila). 2011;49(9):840–5. pmid:22077247.
  19. 19. Jones AL, Elton R, Flanagan R. Multiple logistic regression analysis of plasma paraquat concentrations as a predictor of outcome in 375 cases of paraquat poisoning. QJM. 1999;92(10):573–8. pmid:10627878.
  20. 20. Proudfoot AT, Stewart MS, Levitt T, Widdop B. Paraquat poisoning: significance of plasma-paraquat concentrations. Lancet. 1979;2(8138):330–2. pmid:89392.
  21. 21. Liu S, Wang Q, Zhou R, Li C, Hu D, Xue W, et al. Hyperamylasemia as an early predictor of mortality in patients withacute paraquat poisoning. Med Sci Monit. 2016;22:1342–8. pmid:27101346.
  22. 22. Kang C, Kim SC, Lee SH, Jeong JH, Kim DS, Kim DH. Absolute lymphocyte count as a predictor of mortality in emergency department patients with paraquat poisoning. PLoS One. 2013;8(10):e78160. pmid:24205140.
  23. 23. Dinis-Oliveira RJ, Duarte JA, Sánchez-Navarro A, Remião F, Bastos ML, Carvalho F. Paraquat poisonings: mechanisms of lung toxicity, clinical features, and treatment. Crit Rev Toxicol. 2008;38(1):13–71. pmid:18161502.
  24. 24. Vale JA, Meredith TJ, Buckley BM. Paraquat poisoning: clinical features and immediate general management. Hum Toxicol. 1987;6(1):41–7. pmid:3546085.
  25. 25. Wen X, Gibson CJ, Yang I, Buckley B, Goedken MJ, Richardson JR, et al. MDR1 transporter protects against paraquat-induced toxicity in human and mouse proximal tubule cells. Toxicol Sci. 2014;141(2):475–83. pmid:25015657.
  26. 26. Molck AM, Friis C. The cytotoxic effect of paraquat to isolated renal proximal tubular segments from rabbits. Toxicology. 1997;122(1–2):123–32. pmid:9274808.
  27. 27. Scherrmann JM, Houze P, Bismuth , Bourdon R. Prognostic value of plasma and urine paraquat concentration. Hum Toxicol. 1987;6(1):91–3. pmid:3817835.
  28. 28. Roberts DM, Wilks MF, Roberts MS, Swaminathan R, Mohamed F, Dawson AH, et al. Changes in the concentrations of creatinine, cystatin C and NGAL in patients with acute paraquat self-poisoning. Toxicology letters. 2011;202(1):69–74. pmid:21291964.
  29. 29. Suntres ZE. Role of antioxidants in paraquat toxicity. Toxicology. 2002;180(1):65–77. pmid:12324200.
  30. 30. Lattuca ME, Malanga G, C AH, Perez AF, Calvo J, Puntarulo S. Main features of the oxidative metabolism in gills and liver of Odontesthes nigricans Richardson (Pisces, Atherinopsidae). Comp Biochem Physiol B Biochem Mol Biol. 2009;154(4):406–11. pmid:19706336.
  31. 31. Ahmad I, Shukla S, Kumar A, Singh BK, Kumar V, Chauhan AK, et al. Biochemical and molecular mechanisms of N-acetyl cysteine and silymarin-mediated protection against maneb- and paraquat-induced hepatotoxicity in rats. Chem Biol Interact. 2013;201(1–3):9–18. pmid:23159886.
  32. 32. Hong SY, Yang DH, Hwang KY. Associations between laboratory parameters and outcome of paraquat poisoning. Toxicol lett. 2000;118(1):53–9. PubMed PMID: 18161502.
  33. 33. Delirrad M, Majidi M, Boushehri B. Clinical features and prognosis of paraquat poisoning: a review of 41 cases. Int J Clin Exp Med. 2015;8(5):8122–8. pmid:26221379.
  34. 34. Hu L, Li H, Cai Z, Lin F, Hong G, Chen H, et al. A new machine-learning method to prognosticate paraquat poisoned patients by combining coagulation, liver, and kidney indices. PLoS One. 2017;12(10):e0186427. pmid:29049326.
  35. 35. Cai Q, Liu Z. An analysis of relevant factors of early death in acute paraquat poisoning. Zhonghua Wei Zhong Bing Ji Jiu Yi Xue. 2014;26(6):379–82. pmid:24912634.
  36. 36. Lee Y, Lee JH, Seong AJ, Hong CK, Lee HJ, Shin DH, et al. Arterial lactate as a predictor of mortality in emergency department patients with paraquat intoxication. Clin Toxicol (Phila). 2012;50(1):52–6. pmid:22175790.
  37. 37. Hou H, He B. Clinical study on early death reasons in patients with acute paraquat poisoning. Journal of Heze Medical College. 2016;28(1):29–31.
  38. 38. Gawarammana IB, Buckley NA. Medical management of paraquat ingestion. Br J Clin Pharmacol. 2011;72(5):745–57. pmid:21615775
  39. 39. Gibson CM, Mehran R, Bode C, Halperin J, Verheugt FW, Wildgoose P, et al. Prevention of bleeding in patients with atrial fibrillation undergoing PCI. N Engl J Med. 2016;375(25):2423–34. pmid:27959713.