https://orcid.org/0000-0001-9835-2669
Figures
Abstract
Background
Efficacy and safety of treatments for hospitalized COVID-19 are uncertain. We systematically reviewed efficacy and safety of remdesivir for the treatment of COVID-19.
Methods
Studies evaluating remdesivir in adults with hospitalized COVID-19 were searched in several engines until August 21, 2020. Primary outcomes included all-cause mortality, clinical improvement or recovery, need for invasive ventilation, and serious adverse events (SAEs). Inverse variance random effects meta-analyses were performed.
Results
We included four randomized controlled trials (RCTs) (n = 2296) [two vs. placebo (n = 1299) and two comparing 5-day vs. 10-day regimens (n = 997)], and two case series (n = 88). Studies used intravenous remdesivir 200mg the first day and 100mg for four or nine more days. One RCT (n = 236) was stopped early due to AEs; the other three RCTs reported outcomes between 11 and 15 days. Time to recovery was decreased by 4 days with remdesivir vs. placebo in one RCT (n = 1063), and by 0.8 days with 5-days vs. 10-days of therapy in another RCT (n = 397). Clinical improvement was better for 5-days regimen vs. standard of care in one RCT (n = 600). Remdesivir did not decrease all-cause mortality (RR 0.71, 95%CI 0.39 to 1.28, I2 = 43%) and need for invasive ventilation (RR 0.57, 95%CI 0.23 to 1.42, I2 = 60%) vs. placebo at 14 days but had fewer SAEs; 5-day decreased need for invasive ventilation and SAEs vs. 10-day in one RCT (n = 397). No differences in all-cause mortality or SAEs were seen among 5-day, 10-day and standard of care. There were some concerns of bias to high risk of bias in RCTs. Heterogeneity between studies could be due to different severities of disease, days of therapy before outcome determination, and how ordinal data was analyzed.
Citation: Piscoya A, Ng-Sueng LF, Parra del Riego A, Cerna-Viacava R, Pasupuleti V, Roman YM, et al. (2020) Efficacy and harms of remdesivir for the treatment of COVID-19: A systematic review and meta-analysis. PLoS ONE 15(12): e0243705. https://doi.org/10.1371/journal.pone.0243705
Editor: Girish Chandra Bhatt, All India Institute of Medical Sciences, Bhopal, INDIA
Received: June 18, 2020; Accepted: November 30, 2020; Published: December 10, 2020
Copyright: © 2020 Piscoya et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting information files.
Funding: MedErgy Health Group Inc. provided support in the form of salary for author VP, and Hemex Health Inc. provided support in the form of salary for author PT. The funders did not have any role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘Author contributions’ section.
Competing interests: The authors have read the journal’s policy and have the following potential competing interests: VP is a paid employee of MedErgy Health Group Inc., and PT is a paid employee of Hemex Health Inc. This does not alter our adherence to PLOS ONE policies on sharing data and materials. There are no patents, products in development or marketed products associated with this research to declare.
Introduction
Worldwide, ~50 million patients have been infected with Coronavirus Disease 2019 (COVID-19), resulting in over 1.2 million deaths [1]. Older populations with obesity, hypertension, diabetes, and chronic kidney disease have a poorer prognosis when infected [2]. In the most severely ill COVID-19 patients, corticosteroid therapy has been shown to prolong survival but no other drugs have demonstrated efficacy in randomized controlled trials (RCTs) with a reasonable safety profile [3–5].
Remdesivir inhibits ribonucleic acid (RNA) polymerase limiting viral replication [6, 7]. It was originally developed to treat Ebola but promising in vitro effects were not translated into acceptable clinical efficacy. Remdesivir provides antiviral effects on coronaviruses in vitro and early initiation of therapy significantly reduced pulmonary damage in monkeys infected with COVID-19 [6, 8]. Remdesivir received Food and Drug Administration (FDA) Emergency Use Authorization (EUA) on May 1st 2020 and was approved on October 22, 2020 [9]. We systematically evaluated the human studies assessing the efficacy and safety of remdesivir for the treatment of COVID-19.
Materials and methods
Search strategy and selection criteria
We performed a systematic review of RCTs and observational studies evaluating the effects of remdesivir in adult hospitalized COVID-19 patients with pneumonia and/or respiratory insufficiency. We searched for studies in PubMed, Web of Science, Scopus, Embase and the Cochrane Library, and medRxiv.org and for ongoing RCTs in www.ClinicalTrials.gov, www.who.int/ictrp/about/en/, and www.clinicaltrialsregister.eu/. Databases were searched on May 5th, 2020 and updated on June 5th, 2020 and August 21, 2020.
Search strategies were adjusted for each engine using the keywords: remdesivir AND (COVID-19 OR coronavirus OR coronavirus disease OR coronavirus disease-19 OR severe acute respiratory syndrome OR SARS-CoV-2) with no limitations for time or language. The PubMed strategy is included in the S1 File. Included studies in our search involved case series, cohorts and RCTs that specified at least one efficacy or harm outcome. We excluded studies with hepatitis B or HIV coinfection patients.
Data extraction
Three reviewers (VP, AP, LFN-S) collected records in www.myendnoteweb.com. Two independent reviewers (APdR, RC-V) assessed titles and abstracts for eligibility according to the inclusion and exclusion criteria. Discrepancies were resolved by discussion. Three reviewers (LFN-S, APdR, RC-V) assessed full-text articles of selected studies. If two reviewers were unable to reach consensus, they consulted a third review author (AP). Three independent reviewers (LFN-S, APdR, RC-V) extracted data with disagreements resolved by a third reviewer (AP). Extracted information included: study authors, year of publication, study design, number of patients, country, median age, proportion of males, comorbidities (obesity, hypertension, diabetes, coronary artery disease (CAD), chronic kidney disease, chronic obstructive pulmonary disease), PCR method for COVID-19 diagnosis, remdesivir dose and duration, concomitant treatments for both arms, primary outcomes per arm, and secondary outcomes per arm.
Outcomes
Primary outcomes were: all-cause mortality, clinical improvement (e.g. 2-point reduction in a 6-point ordinal severity scale), time to recovery (defined as first day, during 28-day enrollment, on which a patient satisfied categories 1, 2, or 3 of an 8-point ordinal scale), need for invasive ventilation (mechanical [MV], extracorporeal membrane oxygenation [ECMO]), and serious adverse events (SAE). Secondary outcomes were length of hospital stay, components of ordinal severity scales, radiological progression of pneumonia, and adverse events (AE).
Assessment of risk of bias
Assessment of risk of bias was performed independently by two investigators (VP, AVH) using the Cochrane RoB 2.0 tool [10] for RCTs. We planned to independently use the ROBINS-I tool [11] for cohort studies but no observational studies were found. A third reviewer (AP) resolved discrepancies when needed.
Statistical analyses
We reported our systematic review according to 2009 PRISMA guidelines [12]. Effects of remdesivir on outcomes from individual studies were reported as hazard ratio (HR) or risk difference (RD) or relative risk (RR) for dichotomous outcomes and mean differences (MD) for continuous outcomes, each with 95% confidence intervals (95% CIs). Inverse variance random effect meta-analyses were performed when outcome data was available for at least two RCTs judged to have homogeneous study characteristics. Between study variance tau2 was calculated with the Paule-Mandel method. Effects of meta-analyses were reported as relative risks (RR) and their 95%CIs, and heterogeneity of effects among studies was quantified with the I2 statistic (an I2>60% means high heterogeneity of effects). R 3.5.1 (www.r-project.org) was used for meta-analyses. The quality or certainty of evidence was evaluated using the GRADE methodology, which covers 5 items: risk of bias, inconsistency, indirectness, imprecision, and publication bias [13]. Quality of evidence was evaluated per specific comparison and per outcome, and described in summary of findings (SoF) tables; GRADEpro GDT was used to create SoF tables [14].
Results
From our searches, 553 records were screened for eligibility and eleven full-text articles were assessed (Fig 1). One RCT planned in China (NCT04252664) was suspended on April 15th, 2020. Five articles were excluded leaving two placebo-controlled RCTs (n = 1300), two RCTs comparing 5-day vs. 10-day regimens of remdesivir with or without a standard of care arm (n = 997), and two case series (n = 88) [15–20].
Five of the six included studies had patients with similar baseline characteristics including severe or life-threatening patients with an oxygen saturation <94%. The Spinner et al. trial was unique in that it evaluated patients with mild to moderate severity of disease. The sample sizes ranged from 35 to 53 participants across case series, and 236 to 1063 across trials. Most of these studies compared intravenous (IV) remdesivir 200 mg as a loading dose and then 100 mg daily for 10 days vs. placebo or standard of care. However, Goldman et al. provided the 200mg loading dose to all participants and compared the 100mg daily dose for10 days vs. 5 days. The follow-up timeframe was 28 days in both case series and ranged between 11 and 29 days across trials.
The description and demographic information of the included studies are shown in Table 1. The median age of patients was between 63 to 64 years across case series and 58 to 66 years across trials. There was a predominance of male gender ranging between 56.3% to 75.4% across studies and comorbidities such as hypertension (24.5% to 50%) and diabetes (8.6% to 30.6%) varied between trials. Similar concomitant treatments were given in the trials such as corticosteroids, antivirals, antibiotics, and support therapy according to each hospital policy.
Description of studies
Wang et al. RCT.
The RCT by Wang et al. (NCT04257656) assessed IV remdesivir 200 mg on day one, followed by 100mg IV once-daily for nine more days vs. placebo in adults with RT-PCR confirmed SARS-CoV-2 infection, pneumonia, and respiratory insufficiency in Wuhan, China (Table 1) [15]. The primary outcome was the time to clinical improvement within 28 days after randomization or time discharged alive from the hospital, whichever came first. Clinical improvement was defined as a decline of two points using a 6-point ordinal severity scale (Table 1). This scale was modified from a 7-point ordinal severity scale used by the COVID-19 lopinavir/ritonavir RCT by Cao et al. [21], which has been used in previous influenza studies by Wang et al. [22] and recommended by the World Health Organization (WHO) R&D Blueprint expert group [23].
Due to higher occurrence of AEs leading to drug discontinuation vs. placebo (12% vs 5%), the trial was stopped early, with 236 patients and a statistical power of 56%. Authors mentioned that they followed specific a priori termination criteria, but these are not available in the protocol [24]. Some imbalances existed at enrollment between arms, including more patients with hypertension, diabetes, or CAD in the remdesivir arm. Also, more patients in the control group had been symptomatic for ≤10 days at the time the intervention was started.
Beigel et al. Adaptive COVID-19 Treatment Trial (ACTT-1).
The multinational Beigel et al. ACTT-1 RCT (NCT04280705) evaluated remdesivir 200 mg IV on day 1, followed by a 100mg IV once-daily for nine more days vs. placebo in adults with RT-PCR confirmed SARS-CoV-2 infection, pneumonia, and respiratory insufficiency (Table 1) [16, 25]. According to clinicaltrials.gov, on February 20th 2020, its primary outcome was supposed to be percentage of each severity category at 15 days on the 7-point ordinal scale by Cao et al. [21]. On March 20th 2020, the primary outcome was changed to a new 8-point ordinal severity scale, in which a subdivision into two groups was made on hospitalized patients (Table 1).
On March 22nd 2020, blinded statisticians recommended again changing the outcome to time to recovery, defined as the first day during the 28 days satisfying category 1, 2 or 3 of the 8-point scale [16]. This trial was stopped on April 29th 2020, as its safety monitoring board determined the primary efficacy endpoint had been achieved [25, 26]. At that moment, 1063 had been recruited with 482 recoveries and 81 deaths entered to the database [16]. No substantial imbalances in baseline characteristics were observed between the remdesivir and placebo arms.
Goldman et al. GS-US-540-5773 RCT.
The multinational Goldman et al. GS-US-540-5773 Gilead RCT (NCT04292899) evaluated the efficacy and safety of 5-day vs. 10-day remdesivir in patients ≥12 years-old, PCR confirmed SARS-CoV-2 infection, pneumonia and respiratory insufficiency (Table 1) [19]. The primary outcome was changed after enrollment from proportion of patients with normalization of temperature at day 14 to clinical status evaluated at 14 days by a 7-point ordinal severity scale based on the 6-point scale of Wang et al. [15] but divided their non-oxygen user hospitalized patients into two categories regarding their need for clinical care. Both groups received supportive therapy at the discretion of the clinician. Secondary outcomes were time to clinical improvement (≥2 points of ordinal scale), time to recovery (improvement from a baseline score of 2–5 to 6–7), time to modified recovery (improvement from a baseline score of 2–4 to 5–7 or from 5 to 6–7), all-cause mortality and safety.
Spinner et al. SIMPLE RCT.
Gilead’s open-label SIMPLE trial (NCT04292730) evaluated the efficacy and safety of remdesivir 5-day or 10-day plus standard of care vs. standard of care alone in hospitalized patients with SARS-CoV-2 confirmed infection and moderate pneumonia (e.g. without reduced oxygen levels) [20]. The primary outcome was clinical status evaluated by a 7-point ordinal severity scale at day 11 and the secondary outcome was the rate of adverse events between treatment arms. Clinical improvement was defined as 2 points improvement in the 7-point ordinal scale; also, a one-point improvement was assessed as well as the requirement of oxygen support or worsening of one point in the scale.
Case series.
The case series by Grein et al. [17] assessed 53 RT-PCR confirmed COVID-19 patients, with oxygen saturation <94% receiving a similar 10-day remdesivir regimen and follow up as placebo-controlled RCTs [15, 16]. Clinical improvement (live discharge from the hospital, a decrease of ≥2 points on a modified 6-point ordinal scale) as suggested by the WHO [23], changes in oxygen support, AEs, discharge, and deaths were recorded. Mean age was 64 years and 75% were male. About 60% had hypertension, diabetes, hyperlipidemia and asthma and most were on low flow oxygen support or invasive ventilation.
The case series by Antinori et al. evaluated 35 RT-PCR confirmed COVID-19 patients, with oxygen saturation <94% or mechanically ventilated or NEWS-2 score ≥4 [18] with similar remdesivir regimen and follow up as RCTs. They used the 7-point ordinal scale used by Cao et al. [21] Median age was 63 years, 74% male, with 9% diabetes and 34% hypertension. Eighteen patients were in the ICU and 17 in an infectious disease ward.
Effect of remdesivir on primary outcomes
There was no significant reduction in all-cause mortality vs. placebo at 14 days (RR 0.71, 95%CI 0.39 to 1.28, I2 = 43%, Fig 2). There was no difference in mortality between 5-day and 10-day remdesivir arms in Goldman et al. (RR 0.75, 95%CI 0.40 to 1.40) [19]. All-cause mortality was not different between the 10-day, 5-day and SOC arms at 11 days (1%, 0%, 2%, respectively), and at 28 days (2%, 1%, 2%, respectively) in the Spinner et al. trial. [20] Grein et al. reported that 13% died [17], whereas in Antinori et al. 26% died [18].
Time to clinical improvement was not different between arms in Wang et al. (HR 1.23, 95% CI 0.87–1.75), but time to recovery was significantly shorter with remdesivir in Beigel et al. (11 days, 95%CI 9 to 12 vs. 15 days, 95% CI 13 to 19, RR for recovery 1.32; 95%CI 1.12 to 1.55) in comparison with placebo. In Goldman et al., time to recovery (HR 0.81, 95%CI 0.64 to 1.04) and time to clinical improvement (HR 0.79, 95%CI 0.61 to 1.01) were different between arms [19]. In the Spinner et al. trial, the odds of clinical improvement at day 11 was higher for 5-day (134/191 [70.2%], RD 9.7%, 95%CI 0.1% to 19.1%) but not for 10-day (126/193 [65.3%], RD 4.8%, 95%CI -5.0% to 14.4%) remdesivir vs. standard of care (121/200 [60.5%]) [20].
Remdesivir did not decrease the need for invasive ventilation vs. placebo at 14 days (RR 0.57, 95%CI 0.23 to 1.42, I2 = 60%, Fig 3). Five-days of remdesivir treatment reduced the need for invasive ventilation vs. 10-day in Goldman et al. (RR 0.48, 0.27 to 0.84) [19]. SAEs were significantly lower with remdesivir vs. placebo (RR 0.77, 95%CI 0.63 to 0.94) (S1 Fig). In Beigel et al. ACCT-1, SAEs were present in 21% vs. 27% in remdesivir and placebo, respectively [16]. The most common SAEs were acute respiratory failure, hypotension, viral pneumonia and acute kidney injury but were more frequent in the placebo arm. In Goldman et al., SAEs were more frequent in the 10-day remdesidivir arm (21% vs 35%), with respiratory failure being the most commonly seen [19]. SAEs were less frequent in the 5-day and 10-day remdesivir vs. SOC arms (4.7%, 5.2%, and 9.0%) in the Spinner et al. trial [20]. Grein et al. reported 23% of SAEs, most commonly multiple organ failure, septic shock, kidney injury and hypotension with an 8% drug discontinuation rate [17].
Effect of remdesivir on secondary outcomes
There was no effect of remdesivir on hospitalization without oxygen or with oxygen support/non-invasive ventilation vs. placebo (S2 and S3 Figs; explanation of ordinal scale re-categorization across RCTs in S3 File). A higher proportion of patients were discharged if treated with remdesivir (S4 Fig), and there was no difference in treatment discontinuation (S5 Fig) vs. placebo. There was no difference in AEs in the two placebo-controlled RCTs (RR 0.94, 95%CI 0.81 to 1.10) (S6 Fig). AEs were similar between 5-day and 10-day remdesivir arms (71 vs 74%) [17], but higher in 5-day or 10-day arm vs. standard of care arm (51.3%, 58.5%, 46.5%) [18]. No differences were found between remdesivir vs. placebo on specific AEs such as anemia, elevated liver enzymes, hyperbilirubinemia, hypoalbuminemia, deep vein thrombosis, pulmonary embolism or renal impairment (S7–S13 Figs).
Antinori et al. reported that 43% of subjects had elevated liver enzymes, 23% had acute kidney injury, and 20% had elevated bilirubin levels [18]. Overall, 23% of AEs led to drug discontinuation [18]. Grein et al. reported that 60% of patients experienced AEs including elevated liver enzymes (23%), diarrhea (9%) and rash (8%) [17]. None of the studies documented radiological progression of pulmonary disease or viral clearance.
Quality of evidence and risk of bias of RCTs
The quality of evidence for primary and secondary outcomes per comparison are shown in Table 2 (remdesivir 10 days vs. placebo), Table 3 (remdesivir 5 days vs. 10 days), Table 4 (remdesivir 5 days vs. standard of care), and S1 Table (remdesivir 10 days vs. standard of care). Overall quality of evidence was low or very low for all primary and secondary outcomes, mainly due to some concerns or high risk of bias among RCTs, and inconsistency and imprecision of effects. Indirectness was present when assessing the Spinner et al. trial as its population were moderate COVID-19 patients in contrast to severe COVID-19 patients in other three trials. The risk of bias analysis of four RCTs using Cochrane’s RoB 2.0. tool is shown in S14 and S15 Figs. The Wang et al. trial was judged to have some concerns due to potential confounding on the randomization process. The Beigel et al. trial was judged to have high risk of bias due to selection of the reported results, as their primary outcome was time to recovery after two previous changes. The Goldman et al. trial was judged to have serious risk of bias due to the measurement of the outcome, as they used a non-validated 7-point disease severity scale. The Spinner et al. trial was judged to have some concerns due to selection of the reported results.
Discussion
In adult, hospitalized, RT-PCR confirmed COVID-19 patients with respiratory insufficiency or pneumonia, there were scarce data on efficacy and safety associated with the use of 10-day remdesivir regimens, or with the comparison of 5-day or 10-day regimens vs. standard of care. Two RCTs used a common treatment regimen and a true placebo control, and two RCTs compared two different doses of remdesivir, including one RCT with standard of care. Three trials were focused on severely ill COVID-19 patients, while one RCT was in mild to moderate COVID-19 patients. Remdesivir did not decrease all-cause mortality and need for invasive ventilation vs. placebo at 14 days but had fewer SAEs. Five-days of remdesivir decreased need for invasive ventilation and SAEs vs. 10-days of therapy. No differences in all-cause mortality or SAEs were seen among 5-days of 10-days of remdesivir and standard of care. Time to recovery was decreased by 4 days when remdesivir was compared to placebo, and by 0.8 days when patients were given 5-days of remdesivir vs. 10-days of therapy. Clinical improvement was higher with5-days of remdesivir vs. standard of care. The RCTs ranged from some concerns of bias to high risk of bias, and quality of evidence was low to very low for all outcomes and all comparisons.
The RCTs used different primary outcomes. The Wang et al. trial evaluated time to clinical improvement at 28 days, Beigel et al. trial evaluated time to recovery at 29 days and reported at 15 days, Goldman et al. evaluated clinical status at day 14, and Spinner et al. evaluated clinical status at day 11. Each of them used similar ordinal scale of disease severity. Furthermore, the four RCTs assessed the safety of this drug by measuring overall, specific and serious adverse events. The two-case series provided additional information about these outcomes as well.
While overall mortality is the most important final health outcome, it was not the primary endpoint of any of the available trials. Clinical severity is a relevant clinical outcome, but the ordinal scale used in these trials has not been validated before or appropriately analyzed. Indeed, there is not a correlation between clinical important differences and changes in scale scores in these trials. That may be because only the Beigel et al. and Spinner et al. trials used the proportional odds models and no trial used other methods such as the sliding dichotomy model. Serious adverse events, such as acute respiratory failure, acute kidney injury, and hypotension, are relevant as main metrics of safety.
Wang et al. RCT was stopped prematurely due to an excess of serious adverse events causing drug discontinuation, and Beigel et al. preliminarily reported their data at 15-days. While Wang et al. stated the use of a priori protocol that specified their stopping rule, there is no independent verification in their publicly available protocol. The demographic differences, with more remdesivir patients having hypertension, diabetes, or CAD, would be more likely to work against remdesivir efficacy. While more patients in the control group had been symptomatic for ≤10 days at the time of starting the intervention, this is not expected to cause more outcomes to occur. In Beigel et al., they changed their primary outcome twice [25] with no clear rationale for this alteration. Goldman et al. RCT also changed their primary outcome after the beginning of enrollment, and Spinner et al. trial reported their primary outcome at 11 days. In comparison to placebo, remdesivir did not significantly impact all-cause mortality, need of invasive ventilation, hospitalization without oxygen, hospitalization with oxygen or non-invasive ventilation, or treatment discontinuation. There was a significantly lower incidence of SAEs and higher proportion of discharged patients in RCTs comparing remdesivir to placebo. In comparison to 10-days of remdesivir therapy in Goldman et al., the 5-day regimen did not decrease mortality but decreased need for invasive ventilation and SAEs. AEs were similar between remdesivir and placebo arms and between the 5-day vs 10-day remdesivir arms. No differences in all-cause mortality, SAEs or AEs were seen among the 5-day, 10-day and standard of care arms in the Skinner et al. trial. There were substantial differences between the two-case series in the magnitude of their outcomes.
There were some differences in the scales used to assess outcomes across studies as shown in Table 1. Wang et al. and Grein et al. used the same 6-point ordinal scale, [15, 17] Beigel et al. used an 8-point scale, and Antinori et al used a 7-point scale. [16, 18]. Goldman et al. used a 7-point scale based on the 6-point scale of Wang et al. [19, 15] and Spinner et al. trial used a 7-point ordinal severity scale without further description [20]. These scales were strongly correlated, and that allowed us to formally group those scale categories in five in order to perform our meta-analyses for the two placebo-controlled RCTs [15, 16]; explanations are shown in S3 File. It is important to highlight that although these types of scales are based on a blueprint from WHO, neither of them has been fully validated as a disease severity index, and there is no current information about a more proper tool to assess the severity of COVID-19 [23].
Remdesivir is FDA approved and indicated for the treatment of hospitalized COVID-19 patients who are 12 years of age and older, and who weigh at least 40 kg. It should only be administered in a hospital or in a healthcare setting capable of providing acute care comparable to inpatient hospital care. We disagree that the currently available data is sufficiently strong to support its FDA approval, given that it is not possible to fully assess the balance of benefits to harms in COVID-19 infected patients. There is a risk that the benefits and harms of remdesivir will remain unknown if other remdesivir RCTs vs. placebo are stopped and substituted with trials where remdesivir becomes the standard of care and other experimental drugs are added onto remdesivir versus remdesivir alone. Patients may specifically ask for remdesivir therapy if they are not candidates for corticosteroid therapy and feel a failure to use an FDA approved option is a substandard practice.
Our systematic review has several strengths. We ran a recent and extensive systematic search in several engines and websites, and we did not restrict by language. We found commonalities across all studies: adult, hospitalized patients with COVID-19, and in particular patients with pneumonia and respiratory insufficiency. All six studies evaluated the same loading dose and a similar daily dose, albeit for different days of therapy, and two RCTs were compared to placebo. We also systematically searched for worldwide ongoing RCTs and ongoing systematic reviews in PROSPERO that can be found in S3 Table.
Some limitations can be highlighted. First, the number of RCTs was scarce, the reporting of the Beigel et al. trial is based on 15-day outcomes of the totality of recruited patients, and the Spinner et al. trial compared outcomes over11 days. Second, the Wang et al. RCT was stopped early because a higher proportion of adverse events leading to drug discontinuation was found in an unplanned interim analysis [15]. Third, our meta-analyses for primary outcomes and secondary outcomes were based only on two placebo-controlled RCTs and we used outcomes at similar time points of follow up and re-categorized heterogeneous ordinal outcome scales into five categories. Based on this, conclusions about mortality, need for invasive ventilation, and SAEs should be interpreted with caution. Whether it is the six- or seven-point scales used by investigators, these scales do not have an established minimum clinically important difference. Finally, three of the RCTs included patients given therapy within 10 to 15 days of when symptoms began. Remdesivir’s antiviral activity should be the highest during the first few days of active viral multiplication, as supported by a study performed in monkeys where early administration of remdesivir prevent progression to pneumonia after SARS-CoV-2 inoculation [8].
Conclusions
There is paucity of adequately powered and fully reported RCTs evaluating efficacy and harms of remdesivir use in adult, hospitalized, COVID-19 patients. One RCT was stopped early without a clear description of the reasons, the largest trial (Beigel et al. ACTT-1), altered their primary endpoint twice and only reported 15-day outcomes, the Goldman et al. and Spinner et al. SIMPLE trials did not have a placebo arm, and the Spinner et al. SIMPLE trial outcomes were reported at 11 days. Conclusions about overall mortality, need for invasive ventilation, and SAEs from meta-analyses of two trials should be interpreted with caution. Several ongoing RCTs should be completed despite the FDA approval in order to determine remdesivir’s clinical efficacy and harm profile. Until stronger evidence emerges, we cannot conclude that remdesivir is efficacious for treating COVID-19.
Supporting information
S2 File. Description of ongoing RCTs evaluating remdesivir.
https://doi.org/10.1371/journal.pone.0243705.s002
(PDF)
S3 File. Explanation of combination of categories of ordinal severity scales from RCTs.
https://doi.org/10.1371/journal.pone.0243705.s003
(PDF)
S1 Fig. Effect of remdesivir vs. placebo on serious adverse events.
https://doi.org/10.1371/journal.pone.0243705.s004
(PDF)
S2 Fig. Effect of remdesivir vs. placebo on hospitalized patients with no oxygen.
https://doi.org/10.1371/journal.pone.0243705.s005
(PDF)
S3 Fig. Effect of remdesivir vs. placebo on hospitalized patients with oxygen support or non-invasive ventilation.
https://doi.org/10.1371/journal.pone.0243705.s006
(PDF)
S4 Fig. Effect of remdesivir vs. placebo on discharged patients.
https://doi.org/10.1371/journal.pone.0243705.s007
(PDF)
S5 Fig. Effect of remdesivir vs. placebo on treatment discontinuation.
https://doi.org/10.1371/journal.pone.0243705.s008
(PDF)
S6 Fig. Effect of remdesivir vs. placebo on adverse events.
https://doi.org/10.1371/journal.pone.0243705.s009
(PDF)
S7 Fig. Effect of remdesivir vs. placebo on anemia.
https://doi.org/10.1371/journal.pone.0243705.s010
(PDF)
S8 Fig. Effect of remdesivir vs. placebo on elevated liver enzymes.
https://doi.org/10.1371/journal.pone.0243705.s011
(PDF)
S9 Fig. Effect of remdesivir vs. placebo on hyperbilirubinemia.
https://doi.org/10.1371/journal.pone.0243705.s012
(PDF)
S10 Fig. Effect of remdesivir vs. placebo on hypoalbuminemia.
https://doi.org/10.1371/journal.pone.0243705.s013
(PDF)
S11 Fig. Effect of remdesivir vs. placebo on deep vein thrombosis.
https://doi.org/10.1371/journal.pone.0243705.s014
(PDF)
S12 Fig. Effect of remdesivir vs. placebo on pulmonary embolism.
https://doi.org/10.1371/journal.pone.0243705.s015
(PDF)
S13 Fig. Effect of remdesivir vs. placebo on renal impairment.
https://doi.org/10.1371/journal.pone.0243705.s016
(PDF)
S14 Fig. Detailed and individual risk of bias of included randomized controlled trials.
https://doi.org/10.1371/journal.pone.0243705.s017
(PDF)
S15 Fig. Risk of bias of included randomized controlled trials.
https://doi.org/10.1371/journal.pone.0243705.s018
(PDF)
S1 Table. Summary of findings table of the comparison remdesivir 10 days vs. standard of care in moderate COVID-19 patients.
https://doi.org/10.1371/journal.pone.0243705.s019
(PDF)
S2 Table. List of ongoing remdesivir RCTs from trial registries.
https://doi.org/10.1371/journal.pone.0243705.s020
(PDF)
S3 Table. List of ongoing remdesivir systematic reviews from PROSPERO registry.
https://doi.org/10.1371/journal.pone.0243705.s021
(PDF)
References
- 1.
Worldometer. COVID-19 Coronavirus Pandemic. [Accessed 8 May 2020] https://www.worldometers.info/coronavirus/.
- 2. The OpenSAFELY Collaborative, Williamson E, Walker AJ, Bhaskaran KJ, Bacon S, Bates C, et al. OpenSAFELY: factors associated with COVID-19 related hospital deaths in the linked electronic health records of 17 million adult NHS patients. medRxiv [Pre-Print] 2020; May 7.
- 3.
World Health Organization. International Clinical Trials Registry Platform (ICTRP). https://www.who.int/ictrp/en/. Accessed May 8 2020.
- 4. Tomazini BM, Maia IS, Cavalcanti AB, Berwanger O, Rosa RG, Veiga VC, et al. Effect of Dexamethasone on Days Alive and Ventilator-Free in Patients With Moderate or Severe Acute Respiratory Distress Syndrome and COVID-19: The CoDEX Randomized Clinical Trial. JAMA. 2020;324(13):1307–1316. pmid:32876695
- 5. RECOVERY Collaborative Group, Horby P, Lim WS, Emberson JR, Mafham M, Bell JL, et al. Dexamethasone in Hospitalized Patients with Covid-19—Preliminary Report. N Engl J Med. 2020 Jul 17: Epub ahead of print. pmid:32678530
- 6. Amirian ES, Levy JK. Current knowledge about the antivirals Remdesivir (GS-5734) and GS-441524 as therapeutic options for coronaviruses. One Health. 2020 Jun;9 100128. pmid:32258351
- 7. Ko WC, Rolain JM, Lee NY, Chen PL, Huang CT, Lee PI, Hsueh PR. Arguments in favour of remdesivir for treating SARS-CoV-2 infections. Int J Antimicrob Agents. 2020;55(4):105933. pmid:32147516
- 8. Williamson BN, Feldmann F, Schwarz B, Meade-White K, Porter DP, Schulz J, et al. Clinical benefit of remdesivir in rhesus macaques infected with SARS-CoV-2. BioRxiv. [Pre-Print] bioRxiv [posted 2020 April 15; cited 2020 May 8]: [21 p.] pmid:32511319
- 9.
Food and Drug Administration. FDA approves first treatment for COVID-19. October 22, 2020. https://www.fda.gov/news-events/press-announcements/fda-approves-first-treatment-covid-19 (Accessed on November 08, 2020).
- 10. Sterne JAC, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. 2019; 366:l4898. pmid:31462531
- 11. Sterne JA, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 2016; 355:i4919. pmid:27733354
- 12. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009; 339:b2700. pmid:19622552
- 13. Balshem H, Helfand M, Schünemann HJ, Oxman AD, Kunz R, Brozek J, et al. GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol. 2011;64(4):401–406. pmid:21208779
- 14.
GRADEpro GDT: GRADEpro Guideline Development Tool [Software]. McMaster University, 2020 (developed by Evidence Prime, Inc.). gradepro.org.
- 15. Wang Y, Zhang D, Du G, Zhao J, Jin Y, Fu S, et al. Remdesivir in adults with severe COVID-19: a randomised, double-blind, placebo-controlled, multicentre trial. Lancet 2020; 395: 1569–78. 10.1016/S0140-6736(20)31022-9 pmid:32423584
- 16. Beigel JH, Tomashek KM, Dodd LE, Mehta AK, Zingman BS, Kalil AC. Remdesivir for the Treatment of Covid-19—Preliminary Report. N Eng J Med, May 20. pmid:32445440
- 17. Grein J, Ohmagari N, Shin D, Diaz G, Asperges E, Castagna A, et al. Compassionate Use of Remdesivir for Patients with Severe Covid-19. N Engl J Med. [Epub ahead of print] 2020 Apr 10. pmid:32275812
- 18. Antinori S, Cossu MV, Ridolfo AL. Compassionate remdesivir treatment of severe COVID-19 pneumonia in intensive care unit (ICU) and non-ICU patients: clinical outcome and differences in post treatment hospitalisation status. Pharm Res. 2020 May. https://doi.org/10.1016/j.phrs.2020.104899
- 19. Goldman JD, Lye DCB, Hui DS, Marks KM, Bruno R, Montejano R, et al. Remdesivir for 5 or 10 days in patients with severe Covid-19. N Engl J Med. pmid:32459919
- 20. Spinner CD, Gottlieb RL, Criner GJ, Arribas Lopez JR, Cattelan AM, Soriano Viladomiu A et al. Effects of Remdesivir vs. Standard Care on Clinical Status at 11-Day in patients with Moderate COVID-19: A Randomized Clinical Trial. JAMA. Published online August 21, 2020. pmid:32821939
- 21. Cao B, Wang Y, Wen D, Liu W, Wang J, Fan G, et al. A Trial of Lopinavir–Ritonavir in Adults Hospitalized with Severe Covid19. N Engl J Med 2020; 382:1787–1799. pmid:32187464
- 22. Wang Y, Fan G, Salam A, Horby P, Hayden F, Chen C, et al. Comparative effectiveness of combined favipiravir and oseltamivir therapy versus oseltamivir monotherapy in critically ill patients with influenza virus infection. J Infect Dis 2020 Apr 27;221(10):1688–1698. pmid:31822885
- 23.
Coronavirus disease (COVID-2019) R&D. Geneva: World Health Organization. http://www.who.int/blueprint/priority-diseases/key-action/novel-coronavirus/en/. Accessed May 12 2020.
- 24.
Horby PW, Cao B, Wang Y, Wang C. Evaluation of the Efficacy and Safety of Intravenous Remdesivir in Adult Patients with Severe Pneumonia caused by COVID-19 virus Infection: study protocol for a Phase 3 Randomized, Double-blind, Placebo-controlled, Multicentre trial. https://www.researchsquare.com/article/rs-14618/v2. Accessed 17 May 2020.
- 25.
ClinicalTrials.gov [Internet]. Bethesda (MD): National Library of Medicine (US). 2000 Feb 29. Identifier NCT04280705, Adaptive COVID-19 Treatment Trial (ACTT); 2020 February 21. https://clinicaltrials.gov/ct2/show/record/NCT04280705?term=NCT04280705&draw=2&rank=1&view=record. Accessed May 11 2020.
- 26.
National Institutes of Health. NIH clinical trial shows Remdesivir accelerates recovery from advanced COVID-19 [Internet]. 2020 Apr 29. https://www.nih.gov/news-events/news-releases/nih-clinical-trial-shows-remdesivir-accelerates-recovery-advanced-covid-19. Accessed May 10 2020.
- 27.
Iran Registry of Clinical Trials [Internet]. Tehran: Iran University of Medical Sciences. 2008. Identifier IRCT20200405046953N1, Randomized trial of additional treatments for COVID-19 in hospitalized patients who are all receiving the local standard of care- Iranian SOLIDARITY multicenter trial; 2020 April 6. https://www.irct.ir/trial/46930. Accessed May 11 20.
- 28.
ClinicalTrials.gov [Internet]. Bethesda (MD): National Library of Medicine (US). 2000 Feb 29. Identifier NCT04321616, The (Norwegian) NOR Solidarity Multicenter Trial on the Efficacy of Different Anti-viral Drugs in SARS-CoV-2 Infected Patients; 2020 March 25. https://clinicaltrials.gov/ct2/show/NCT04321616. Accessed 11 May 20.
- 29.
EU Clinical Trials Register [Internet]. European Medicines Agency. 2004 May 4. Identifier 2020-001366-11, An international randomized trial of additional treatments for COVID-19 in hospitalized patients who are all receiving the local standard of care; 2020 Mar 07; https://www.clinicaltrialsregister.eu/ctr-search/search?query=eudract_number:2020-001366-11. Accessed May 11 2020.
- 30.
ClinicalTrials.gov [Internet]. Bethesda (MD): National Library of Medicine (US). 2000 Feb 29. Identifier NCT04330690, A Multi-centre, Adaptive, Randomized, Open-label, Controlled Clinical Trial of the Safety and Efficacy of Investigational Therapeutics for the Treatment of COVID-19 in Hospitalized Patients (CATCO: Canadian Treatments for COVID-19), in Conjunction With the Public Health Emergency SOLIDARITY Trial (World Health Organization); 2020 April 1. https://clinicaltrials.gov/ct2/show/NCT04330690. Accessed May 11 2020.
- 31.
ClinicalTrials.gov [Internet]. Bethesda (MD): National Library of Medicine (US). 2000 Feb 29. Identifier NCT0439410, The Fleming [FMTVDM] Directed CoVid-19 Treatment Protocol (FMTVDM); 2020 Apr 16. https://clinicaltrials.gov/ct2/show/NCT04349410. Accessed May 11 2020.
- 32.
ClinicalTrials.gov [Internet]. Bethesda (MD): National Library of Medicine (US). 2000 Feb 29. Identifier NCT04315948, Trial of Treatments for COVID-19 in Hospitalized Patients (DisCoVeRy); 2020 Mar 16. https://clinicaltrials.gov/ct2/show/NCT04315948. Accessed May 11 2020.
- 33.
EU Clinical Trial Registries [Internet] European Medicines Agency. 2004 May 4. Identifier 2020-001052-18. Adaptive COVID-19 Treatment Trial in the EU & UK (ACTT-EU/UK); 2020 Mar 15; https://www.clinicaltrialsregister.eu/ctr-search/search?query=2020-001052-18. Accessed May 11 2020.