Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Comparative efficacy of single-inhaler triple therapies for COPD: A protocol for systematic review and network meta-analysis

  • Yixuan Jiang,

    Roles Formal analysis, Methodology, Writing – original draft

    Affiliation State Key Laboratory of Quality Research in Chinese Medicine, Institute of Chinese Medical Sciences, University of Macau, Taipa, Macau SAR, China

  • Hao Hu,

    Roles Conceptualization, Funding acquisition, Methodology, Writing – review & editing

    Affiliation State Key Laboratory of Quality Research in Chinese Medicine, Institute of Chinese Medical Sciences, University of Macau, Taipa, Macau SAR, China

  • Siu-wai Leung

    Roles Funding acquisition, Methodology, Project administration, Writing – review & editing

    siuwai.leung@ed.ac.uk

    Affiliations Shenzhen Institute of Artificial Intelligence and Robotics for Society, Shenzhen, China, Edinburgh Bayes Centre for AI Research in Shenzhen, College of Science and Engineering, University of Edinburgh, Edinburgh, United Kingdom

Abstract

Introduction

2021 Global Initiative for Chronic Obstructive Lung Disease (GOLD) Reports recommends that patients with clinically significant symptoms and exacerbations of chronic obstructive pulmonary disease (COPD) should escalate to triple therapy, a combined use of inhaled corticosteroids (ICS), long-acting muscarinic antagonists (LAMA) and long-acting b2-agonists (LABA)(ICS/LAMA/LABA). Triple therapy in fixed-dose combinations (FDCs), i.e., combining ICS, LABA with LAMA and administrating by a single inhalation device, has appeared in recent years. This study aims to compare the efficacy of triple therapy in FDCs in treating patients with moderate to severe COPD.

Methods and analyses

Literature search will be conducted on PubMed, Embase and Web of science, according to pre-specified and corresponding search strategies, for relevant reports published since the inception dates of the databases. Randomised controlled trials (RCT) which compared the triple therapy in FDCs with other pharmacological therapies will be included. The Cochrane risk of bias assessment tool (RoB 2) will be used to assess the RCT quality. The outcomes will be analyzed as rate ratios and mean differences under a random-effects model in a frequentist network meta-analysis (NMA). Additional statistical analyses including subgroup analysis, sensitivity analysis, and publication bias analysis will be performed to assess the evidential heterogeneity and robustness. The strength of evidence from the NMA will be evaluated with the Grading of Recommendation, Assessment, Development and Evaluation (GRADE) methods.

Ethics and dissemination

No ethics approval is required as this systematic review and network meta-analysis do not collect confidential personal data and do not carry out interventions in treating patients.

Protocol registration number

CRD42021240823.

Introduction

Chronic obstructive pulmonary disease (COPD) is a type of obstructive lung diseases characterised by persistent respiratory symptoms especially airflow limitation [1]. Its main symptoms include shortness of breath and cough with sputum production [1]. Tobacco smoking is the most common cause of COPD, followed by air pollution and genetics [2]. Significant comorbidities may have an impact on morbidity and mortality [3]. The latest statistical analyses indicated that there were about 174.5 million [4] COPD cases and 3.2 million deaths [5] worldwide as of 2015. These numbers are likely to increase in coming years with the increasing smoking prevalence and aging populations in many countries [6].

COPD is a progressive disease. Pharmacotherapy of COPD improves common symptoms, exacerbations, general health, and exercise tolerance [7]. Global Initiative for Chronic Obstructive Lung Disease (2021 REPORT) recommended that the COPD patients with persistent symptoms or history of exacerbations should be treated with combined long-acting muscarinic antagonists (LAMA) and long-acting b2-agonists (LABA)(LAMA/LABA), or combined LABA and inhaled corticosteroids (ICS)(LABA/ICS). The patients who are on LABA/LAMA therapy or LABA/ICS therapy but still suffer from persistent breathlessness, exercise limitation, or further exacerbations should be escalated to triple (i.e., LABA/LAMA/ICS) therapy [1, 8, 9]. As of March 2021, the triple therapies in FDCs available on the market are listed in Table 1.

There are three methods of administration for triple therapy: (a) three single drugs to be administrated with three separate inhalation devices, (b) administration with two inhalation devices to combine ICS/LABA with a LAMA (designated as “ICS/LABA + LAMA”) or LABA/LAMA with ICS (designated as “LABA/LAMA + ICS”), and (c) combining three drugs ICS, LABA, and LAMA in a single inhalation device [10]. Administration by method (a) and method (b) is called “open triple combination therapy”, while method (c) is called “triple therapy in a fixed-dose combination (FDC)” [10]. It was suggested that “LABA/LAMA + ICS” is more suitable for patients in COPD, while “ICS/LABA + LAMA” is more suitable for the patients suffering from asthma [11]. López [10] recommended that the administration by method (c) is a simple, efficient, and potentially cost-effective treatment, better than the methods (a) and (b). However, as yet no large-scale RCTs nor network meta-analyses of RCTs have been conducted to confirm their findings.

Published systematic reviews [12, 13] and pairwise meta-analyses [1417] on previous RCTs [1825] claimed that triple therapy in FDCs, e.g., BDP/FF/G, FF/UMEC/VI and BUD/GLY/FF, could be better than monotherapy and dual therapy in improving lung function and quality of life. The only network meta-analysis [26] included merely seven [1823, 27] RCTs with 8762 participants on triple therapy in FDCs well before August 2019. It left out the 4987 participants and new findings from recent large-scale RCTs [24, 25] on triple therapy. It is thus warranted to conduct a new network meta-analysis like the present study to investigate whether the new findings of the recent large-scale RCTs would support or invalidate the past recommendations.

Even if there were no uncovered large-scale RCTs, the past systematic reviews and meta-analyses should be revisited as they were not fully (albeit claimed to be) compliant with the PRISMA 2009 statement [28], let alone PRISMA-NMA statement [29] and PRISMA 2020 statement [30]. They did not meet essential requirements for meta-analysis, e.g., protocol registration [13, 16, 17], assessment of the study quality by Cochrane risk of bias tool version 2 (RoB 2) [13, 31], evidence strength evaluation by the Grades of Recommendations, Assessment, Development and Evaluation (GRADE) [12, 13, 16, 17, 32], and statistical analyses such as subgroup analysis and publication bias [1214, 16, 17]. In addition to PRISMA 2009 [28] and PRISMA 2020 [30], the latest network meta-analysis was not fully compliant with the PRISMA-NMA statement [29] that network meta-analyses should observe.

For the above reasons, this study aims to conduct a PRISMA-NMA compliant and comprehensive NMA on the RCTs comparing the efficacies of various triple therapies in fixed-dose combinations in treating the patients suffering from moderate to severe COPD.

Materials and methods

The protocol of this systematic review and network meta-analysis will be reported in accordance with the Preferred Reporting Item for Systematic Review and Meta-analysis Protocols (PRISMA-P) [33]. The completed study will be compliant with the PRISMA 2020 [30] and PRISMA-NMA [29].

Eligibility criteria

Detailed eligibility criteria were developed following the PICOS heuristic, i.e., Population/participants, Intervention, Comparators, Outcomes, and Study design (PICOS) [34], as summarised in Table 2.

Eligible participants must be aged over 40 years and suffering from moderate to severe COPD (defined by Forced Expiratory Volume in the first second [FEV1] less than 80% and more than 30%), regardless of their genders, regions, or any non-specified baseline characteristics. Asthma patients will be excluded. Eligible interventions in the RCTs are treatments with at least one of the fixed triple therapies, e.g., BDP/FF/G, FF/UMEC/VI, and BUD/GLY/FF, against controls such as triple therapy in open combination, dual therapy (ICS/LABA and LAMA/LABA), monotherapy (ICS, LAMA and LABA), and placebo. Eligible outcome measures in the RCTs include changes from baseline in trough FEV1, rates of moderate or severe exacerbations, and total scores of St George’s Respiratory Questionnaire (SGRQ). In addition to the above criteria, eligible study design must be RCTs with follow-up periods of 10 weeks or more. Observational cohort studies, case-control studies, case reports, and reviews will be excluded.

Literature search

Two investigators will search for relevant RCT reports from three electronic databases (PubMed, Web of Science, and Embase) for relevant publications starting from the inception dates of databases. References cited in the included publications will be manually searched to check for additional relevant RCT reports. The terms “COPD”, drug names, “RCT” will be used as keywords to search titles or abstracts. Search strategies for PubMed, Web of Science, and Embase are as shown in S1 Appendix.

Study selection

All retrieved records will be imported into EndNote (X8) for data management. Duplicates will be removed. Two investigators will independently screen the retrieved records according to the eligibility criteria. Disagreements between investigators will be resolved by discussion with the principal investigator. The process of study selection will be shown in a PRISMA-compliant [30] flowchart as exemplified in Fig 1.

thumbnail
Fig 1. Flow chart of the study selection.

RCT, randomised controlled trial.

https://doi.org/10.1371/journal.pone.0255545.g001

Data management

Two investigators will independently extract the data from the included full reports using a standard template. Any discrepancies between two sets of data will be resolved by discussion. Unresolved discrepancies will be brought up to the principal investigator for final decision. Specific data points of interest that were only presented in graphs will be extracted using WebPlotDigitizer [35].

Specific information of the following items will be extracted: (a) study characteristics including author names, publication years, follow-up durations, etc., (b) participant/population characteristics including sample sizes, mean ages, proportions of males, proportions of smokers, proportions of the participants with exacerbation history, FEV1 predicted and inclusion criteria, (c) interventions and comparators including drug names, doses, regimens, and devices, and (d) outcomes including the definitions of exacerbation and time points of assessment.

Changes from baseline in trough FEV1 are the common endpoints to measure lung function among the RCTs are the main outcome. St George’s Respiratory Questionnaire (SGRQ) total scores, as a measure of health-related quality of life (HRQoL), and rates of moderate or severe exacerbations, are additional outcomes. For changes from baseline in trough FEV1 and SGRQ total scores, observation time points of 12 and 24 weeks will be chosen. In the absence of 24-week data, data within a 2-week range for each time point of interest will be allowed (i.e., between 24 and 22 weeks for the 26-week time point). Rates of moderate or severe exacerbations up to week 24 will be evaluated.

Risk of bias assessment

The quality of eligible studies will be evaluated independently by two investigators according to Version 2 of the Cochrane tool for assessing risk of bias in randomised trials (RoB 2) [31] for assessing risk of bias (Table 3). RoB 2 will assess five domains, including randomisation process, deviations from intended interventions, missing outcome data, measurement of the outcome, selection of the reported result. Each domain will be judged as “low risk of bias,” “some concerns,” or “high risk of bias” by the answers (i.e., yes / probably yes / probably no / no / no information) to the respective signalling questions. Any discrepancy and disagreement between investigators will be resolved by discussion among investigators or consulting the principal investigator.

thumbnail
Table 3. RCT quality assessment according to the Cochrane risk-of-bias assessment tool (version 2).

https://doi.org/10.1371/journal.pone.0255545.t003

Meta-analysis

A network meta-analysis based on a frequentist framework [36] will be conducted with a random effects model due to the expected heterogeneity, using the package ‘netmeta’ under the R environment version 4.0.4. [37, 38] Continuous outcomes will be represented by mean difference (MD) and 95% confidence intervals (CIs). Rate ratios (RR) and 95% CI will represent the dichotomous outcomes. P-scores will be used to rank the treatments according to individual outcome measures [39]. If sufficient data are available, subgroup analysis based on study characteristics, such as mean ages, history of exacerbation, and lung function, will be conducted to explain the heterogeneity. Sensitivity analysis will be also conducted, e.g., excluding the studies of poor quality or with a high risk of bias.

Publication bias

Funnel plots [40] will be generated with the package ‘metafor’ under the R environment version 4.0.4 [38, 41, 42] to visualise potential publication bias. Begg’s method [43] and Egger’s method [44] will be carried out to quantify the potential publication bias and its statistical significance.

Strength of evidence

Two investigators will independently evaluate the quality of evidence for outcomes in accordance with the GRADE [32] by the software GRADEpro [45]. The strength of evidence will be reported as high, moderate, low, or very low, according to the five domains, i.e., study limitations, inconsistency, indirectness, imprecision, and publication bias.

Discussion

This network meta-analysis will summarise the available evidence from randomised controlled trials compared the efficacy of triple therapy in fixed-dose combinations including BDP/FF/G, FF/UMEC/VI and BUD/GLY/FF MDI in treating patients suffering from moderate to severe COPD. To compensate the inadequacy of the past meta-analyses, we will conduct subgroup and sensitivity analyses based on the study quality of the included RCTs according to the RoB 2 [31], to reveal the potential impact of the study quality of RCTs on the overall results. The evaluation for the strength of evidence, particularly according to the GRADE approach, that were left out from the past network meta-analyses will be assessed for the first time. It is anticipated that the present study provides a PRISMA-NMA-compliant network meta-analysis together with required subgroup analysis, sensitivity analysis, and publication bias analysis to reveal the robustness and strength of evidence for comparative efficacies of available triple therapies in FDCs. This study will inform physicians, patients and their families, and guideline developers of the best available evidence for their decision making.

References

  1. 1. 2021 Global strategy for prevention, diagnosis and management of COPD. https://goldcopd.org/wp-content/uploads/2020/11/GOLD-REPORT-2021-v1.1-25Nov20_WMV.pdf.
  2. 2. Decramer M, Janssens W. Chronic obstructive pulmonary disease and comorbidities. The Lancet Respiratory Medicine. 2013;1(1):73–83. pmid:24321806
  3. 3. Murray CJL, Lopez AD. Measuring the global burden of disease. New England Journal of Medicine. 2013;369(5):448–57. pmid:23902484
  4. 4. Vos T, Allen C, Arora M, Barber RM, Bhutta ZA, Brown A, et al. Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990–2015: a systematic analysis for the Global Burden of Disease Study 2015. The Lancet. 2016;388(10053):1545–602. https://doi.org/10.1016/S0140-6736(16)31678-6.
  5. 5. Wang H, Naghavi M, Allen C, Barber RM, Bhutta ZA, Carter A, et al. Global, regional, and national life expectancy, all-cause mortality, and cause-specific mortality for 249 causes of death, 1980–2015: a systematic analysis for the Global Burden of Disease Study 2015. The Lancet. 2016;388(10053):1459–544. https://doi.org/10.1016/S0140-6736(16)31012-1.
  6. 6. Chronic obstructive pulmonary disease (COPD). https://www.who.int/news-room/fact-sheets/detail/chronic-obstructive-pulmonary-disease-(copd).
  7. 7. Hutchinson A, Brand C, Irving L, Roberts C, Thompson P, Campbell D. Acute care costs of patients admitted for management of chronic obstructive pulmonary disease exacerbations: contribution of disease severity, infection and chronic heart failure. Internal Medicine Journal. 2010;40(5):364–71. https://doi.org/10.1111/j.1445-5994.2010.02195.x pmid:20180870
  8. 8. Malerba M, Nardin M, Santini G, Mores N, Radaeli A, Montuschi P. Single-inhaler triple therapy utilizing the once-daily combination of fluticasone furoate, umeclidinium and vilanterol in the management of COPD: the current evidence base and future prospects. Therapeutic Advances in Respiratory Disease. 2018;12:1753466618760779. pmid:29537340
  9. 9. Brusselle G, Price D, Gruffydd-Jones K, Miravitlles M, Keininger DL, Stewart R, et al. The inevitable drift to triple therapy in COPD: an analysis of prescribing pathways in the UK. International Journal of Chronic Obstructive Pulmonary Disease. 2015;10:2207–17. pmid:26527869.
  10. 10. López-Campos JL, Carrasco-Hernández L, Román Rodríguez L, Quintana-Gallego E, Carmona Bernal C, Alcázar Navarrete B. The clinical implications of triple therapy in fixed-dose combination in COPD: from the trial to the patient. Archivos de Bronconeumología (English Edition). 2020;56(4):242–8. https://doi.org/10.1016/j.arbr.2020.02.002 pmid:31983474
  11. 11. Lopez-Campos JL, Marquez-Martín E, Ortega-Ruiz F. Triple therapy vs. triple therapy in COPD. Arch Bronconeumol. 2017;53(8):419–20. pmid:28314634
  12. 12. Langham S, Lewis J, Pooley N, Embleton N, Langham J, Han MK, et al. Single-inhaler triple therapy in patients with chronic obstructive pulmonary disease: a systematic review. Respiratory Research. 2019;20(1):242. pmid:31684965
  13. 13. Lopez-Campos JL, Carrasco-Hernandez L, Quintana-Gallego E, Calero-Acuña C, Márquez-Martín E, Ortega-Ruiz F, et al. Triple therapy for COPD: a crude analysis from a systematic review of the evidence. Therapeutic Advances in Respiratory Disease. 2019;13:1753466619885522. pmid:31694491
  14. 14. Cazzola M, Rogliani P, Calzetta L, Matera MG. Triple therapy versus single and dual long-acting bronchodilator therapy in COPD: a systematic review and meta-analysis. European Respiratory Journal. 2018;52(6):1801586. pmid:30309975
  15. 15. Zheng Y, Zhu J, Liu Y, Lai W, Lin C, Qiu K, et al. Triple therapy in the management of chronic obstructive pulmonary disease: systematic review and meta-analysis. BMJ. 2018;363:k4388. pmid:30401700
  16. 16. Lai C-C, Chen C-H, Lin CYH, Wang C-Y, Wang Y-H. The effects of single inhaler triple therapy vs single inhaler dual therapy or separate triple therapy for the management of chronic obstructive pulmonary disease: a systematic review and meta-analysis of randomized controlled trials. International Journal of Chronic Obstructive Pulmonary Disease. 2019;14:1539. pmid:31371939
  17. 17. Zayed Y, Barbarawi M, Kheiri B, Haykal T, Chahine A, Rashdan L, et al. Triple versus dual inhaler therapy in moderate-to-severe COPD: A systematic review and meta-analysis of randomized controlled trials. The Clinical Respiratory Journal. 2019;13(7):413–28. https://doi.org/10.1111/crj.13026 pmid:30947394
  18. 18. Singh D, Papi A, Corradi M, Pavlišová I, Montagna I, Francisco C, et al. Single inhaler triple therapy versus inhaled corticosteroid plus long-acting β2-agonist therapy for chronic obstructive pulmonary disease (TRILOGY): a double-blind, parallel group, randomised controlled trial. The Lancet. 2016;388(10048):963–73. pmid:27598678
  19. 19. Lipson DA, Barnacle H, Birk R, Brealey N, Locantore N, Lomas DA, et al. FULFIL trial: once-daily triple therapy for patients with chronic obstructive pulmonary disease. American Journal of Respiratory and Critical Care Medicine. 2017;196(4):438–46. pmid:28375647
  20. 20. Vestbo J, Papi A, Corradi M, Blazhko V, Montagna I, Francisco C, et al. Single inhaler extrafine triple therapy versus long-acting muscarinic antagonist therapy for chronic obstructive pulmonary disease (TRINITY): a double-blind, parallel group, randomised controlled trial. The Lancet. 2017;389(10082):1919–29. pmid:28385353
  21. 21. Ferguson GT, Rabe KF, Martinez FJ, Fabbri LM, Wang C, Ichinose M, et al. Triple therapy with budesonide/glycopyrrolate/formoterol fumarate with co-suspension delivery technology versus dual therapies in chronic obstructive pulmonary disease (KRONOS): a double-blind, parallel-group, multicentre, phase 3 randomised controlled trial. The Lancet Respiratory Medicine. 2018;6(10):747–58. pmid:30232048
  22. 22. Lipson DA, Barnhart F, Brealey N, Brooks J, Criner GJ, Day NC, et al. Once-daily single-inhaler triple versus dual therapy in patients with COPD. New England Journal of Medicine. 2018;378(18):1671–80.
  23. 23. Papi A, Vestbo J, Fabbri L, Corradi M, Prunier H, Cohuet G, et al. Extrafine inhaled triple therapy versus dual bronchodilator therapy in chronic obstructive pulmonary disease (TRIBUTE): a double-blind, parallel group, randomised controlled trial. The Lancet. 2018;391(10125):1076–84. pmid:29429593
  24. 24. Rabe KF, Martinez FJ, Ferguson GT, Wang C, Singh D, Wedzicha JA, et al. Triple inhaled therapy at two glucocorticoid doses in moderate-to-very-severe COPD. New England Journal of Medicine. 2020;383(1):35–48. pmid:32579807
  25. 25. Ferguson GT, Brown N, Compton C, Corbridge TC, Dorais K, Fogarty C, et al. Once-daily single-inhaler versus twice-daily multiple-inhaler triple therapy in patients with COPD: lung function and health status results from two replicate randomized controlled trials. Respiratory Research. 2020;21(1):131. pmid:32471423
  26. 26. Ferguson GT, Darken P, Ballal S, Siddiqui MK, Singh B, Attri S, et al. Efficacy of budesonide/glycopyrronium/formoterol fumarate metered dose inhaler (BGF MDI) versus other inhaled corticosteroid/long-acting muscarinic antagonist/long-acting β2-agonist (ICS/LAMA/LABA) triple combinations in COPD: a systematic literature review and network meta-analysis. Advances in Therapy. 2020;37(6):2956–75. pmid:32335859
  27. 27. Bremner PR, Birk R, Brealey N, Ismaila AS, Zhu C-Q, Lipson DA. Single-inhaler fluticasone furoate/umeclidinium/vilanterol versus fluticasone furoate/vilanterol plus umeclidinium using two inhalers for chronic obstructive pulmonary disease: a randomized non-inferiority study. Respiratory Research. 2018;19(1):19. pmid:29370819
  28. 28. Moher D, Liberati A, Tetzlaff J, Altman DG, The PG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Medicine. 2009;6(7):e1000097. pmid:19621072
  29. 29. Hutton B, Salanti G, Caldwell DM, Chaimani A, Schmid CH, Cameron C, et al. The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Annals of Internal Medicine. 2015;162(11):777–84. pmid:26030634
  30. 30. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. PLoS Medicine. 2021;18(3):e1003583. pmid:33780438
  31. 31. Sterne JAC, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. 2019;366:l4898. pmid:31462531
  32. 32. Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924. pmid:18436948
  33. 33. Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Systematic Reviews. 2015;4(1):1. pmid:25554246
  34. 34. Counsell C. Formulating questions and locating primary studies for inclusion in systematic reviews. Annals of Internal Medicine. 1997;127(5):380–7. pmid:9273830
  35. 35. WebPlotDigitizer Version 4.4 [updated November 28, 2020]. https://automeris.io/WebPlotDigitizer/.
  36. 36. Tonin FS, Rotta I, Mendes AM, Pontarolo R. Network meta-analysis: a technique to gather evidence from direct and indirect comparisons. Pharmacy Practice (Granada). 2017;15. pmid:28503228
  37. 37. Network meta-analysis using frequentist methods. https://cran.r-project.org/web/packages/netmeta/netmeta.pdf.
  38. 38. The R project for statistical computing. https://www.r-project.org/.
  39. 39. Rücker G, Schwarzer G. Ranking treatments in frequentist network meta-analysis works without resampling methods. BMC Medical Research Methodology. 2015;15(1):58. pmid:26227148
  40. 40. Sterne JAC, Egger M. Funnel plots for detecting bias in meta-analysis: Guidelines on choice of axis. Journal of Clinical Epidemiology. 2001;54(10):1046–55. pmid:11576817
  41. 41. Viechtbauer W. Conducting meta-analyses in R with the metafor package. Journal of Statistical Software. 2010;36(3):1–48.
  42. 42. Meta-analysis package for R. https://cran.r-project.org/web/packages/metafor/metafor.pdf.
  43. 43. Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics. 1994;50(4):1088–101. pmid:7786990
  44. 44. Egger M, Smith GD, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315(7109):629. pmid:9310563
  45. 45. GRADEpro. https://gradepro.org/.