WHO Leaked Study Data Finds No Benefits Of Gilead’s Remdesivir On Coronavirus Patients
That the antiviral medicine failed to speed the improvement of patients with Covid-19 or prevent them from dying, according to results from a long-awaited clinical trial conducted in China.
Key Facts
- The World Health Organization prematurely posted a draft summary of the China-based trial that was seen by STAT News before it was removed, with a WHO spokesperson telling the publication it’s still being peer reviewed and finalized.
- Gilead challenged the results in an emailed statement, however, deeming them “inconclusive” given the clinical trial was ended early resulting in low enrollment, though it noted there were trends suggesting potential benefit for patients who received treatment early.
- The trial was ended early because enrolling new patients became too challenging in China where cases are decreasing, according to STAT; but results indicated statistically insignificant differences between patients who died after taking remdesivir after one month (13.9%) versus patients in the control group (12.8%).
- Gilead’s stock jumped up nearly 10% after a leaked clinical trial obtained by STAT from the University of Chicago Medicine found “rapid recoveries in fever and respiratory symptoms,” though it was not a randomized study.
- There are other trials being conducted with the drug, including some in partnership with the National Institute of Allergy and Infectious Diseases (NIAID).
NIAID led by leading infectious disease expert Dr. Anthony Fauci, released guidelines reiterating that there is still no proven drug to treat the coronavirus. It further stated there is insufficient evidence that the anti-malaria drug hydroxychloroquine benefits patients, one of the drugs President Trump has championed during White House briefings. Regardless of how trials for remdesivr or hydroxychloroquine pan out, they would not be preventive drugs. A vaccine would serve that purpose but is at the earliest a year away.
Apparently the Gilead’s “study” was basically cherry picking patients and choosing data points that made remdesivir appear effective.
Here is an article from an expert who actually has the necessary knowledge:-
PulmCrit – Eleven reasons the NEJM paper on remdesivir reveals nothing
by
Grein et al. just published a case series of patients with COVID-19 treated with remdesivir via a compassionate use program. I’ve been expecting this paper with cold dread for some time now. There are several reasons that this publication is a media show, rather than a serious scientific endeavor.
#1. Lack of a control group
As a multi-billion-dollar pharma giant, Gilead has the ability to perform RCTs. Administration of a relatively new drug with unclear side-effects should occur within the context of a controlled trial. Administration of unproven medications under the auspice of compassionate use opens the door to all sorts of unknown toxicities and dangerous practices.
Lack of any control group makes it extremely important that the patients were selected in an unbiased fashion, representing an average group of patients with COVID-19. Unfortunately, this wasn’t the case…
#2. Cherry-picking Patients
Remdesivir was aggressively sought-after by thousands of patients with COVID-19. Of these patients, 61 ended up receiving the drug. Why did these 61 patients receive medication, out of scores of patients applying to receive it?
The manuscript is extremely coy regarding how many patients applied to use remdesivir and how this application process worked. For example, there is no documentation of how many patients applied. There is no data comparing characteristics of patients included in the study versus patients denied medication. Given lack of any control group (#1 above), lack of transparency about this selection process is stunning.
The fact is that Gilead excluded many patients at a higher likelihood of dying (e.g., patients on vasopressors or patients with renal failure). The manuscript doesn’t mention vasopressors, but this was an exclusion factor in the United States.
Through reliable sources, I am aware of one case where a patient was initially denied remdesivir because the patient was too ill (renal failure, vasopressor requirement). Subsequently this patient improved clinically, so Gilead changed their mind and decided that the patient was a candidate for remdesivir! Thus, it seems that the selection process may have been designed to capture patients maximally likely to recover, rather than patients maximally likely to benefit from remdesivir.
#3. Loss of patients due to “no post Day 1 clinical data”
Of 61 patients initially included in the trial, 7 were excluded due to an absence of clinical data after the first trial day. This is disconcerting. What happened to these patients? Did they die from anaphylaxis? Did they get well, sign out against medical advice, and go party? This is unknown – but I’m worried that these patients actually didn’t fare so well.
#4. Lack of defined sample size or stopping rule
Most clinical trials have some pre-determined sample size. Interim analyses may be performed to evaluate for safety. If the study is stopped prior to reaching the goal size, this is frowned upon (as it may introduce an element of bias to the statistical analysis).
This study has no apparent power, or sample size, or anything. It’s undefined as to who decided to stop recruiting for the study or why. If data was being continuously analyzed, it’s possible that the study was terminated at a time when random trends in the data would favor Remdesivir.
#5. Lack of a primary endpoint
Most clinical trials also have a primary endpoint. We could debate whether over-reliance on the primary endpoint is problematic, but nonetheless – having pre-defined primary and secondary endpoints is important to prevent cherry-picking endpoints in a post-hoc fashion.
This study doesn’t seem to have any pre-defined endpoints at all. This allowed the authors to evaluate numerous endpoints and focus on whatever data they wanted to.
#6. Lack of information about the subjects
The baseline data about subjects is very scanty. For example, there is no information about disease biomarkers (e.g. D-dimer, LDH, C-reactive protein, ferritin). There are no markers of global physiologic severity (e.g. SOFA score or APACHE-II scores). Compared to most high-quality retrospective cohort series, this table is notable for its lack of information. In some cases (e.g. absolute lymphocyte count) – we know that this data was collected based on the study protocol – why was this basic data not presented? (My guess is that this data would have shown that the patients weren’t very sick at baseline).
#7. Inclusion of many patients who weren’t very ill
The initial inclusion criterion was anyone saturating 94% or less on room air. This allows the study to include some patients who were minimally ill. Nineteen patients who were included were not intubated, including 2 patients on room air and 10 patients on low-flow nasal cannula. These patients probably would have done well regardless of treatment. Some may not have even warranted hospital admission at all.
#8. Delayed administration of Remdesivir
Remdesivir was administered a median of 12 days after the onset of symptoms (interquartile range of 9-15). This delay may have been partly due to patient application for the drug and selection of patients.
Claiming benefit from a drug administered 12 days after disease onset is dubious for two reasons:
The natural course of COVID is generally to deteriorate before day #12. So if you select for a group of patients who are still doing OK on day #12, the patients are likely to continue doing fine.
By 12 days after symptom onset, viremia is generally beginning to decrease (due to immune activation). In fact, most of the clinical illness seen after 12 days may relate more to pathological hyperinflammation, not to direct viral damage. Thus, it doesn’t make sense that an antiviral drug administered this late in the disease course would have much clinical efficacy.
#9. Outcomes weren’t that awesome
Outcomes are shown above:
Patients on room air or low-flow oxygen did fine (no surprise there).
Among patients on non-invasive support, 5/7 did well but 1 died and 1 remained intubated at study end (which is about what might be expected for patients who survived off a ventilator for ~12 days).
Among intubated patients, half did well, but the remainder either died or remained on ventilatory support.
These outcomes are pretty good (i.e., 50% extubation rate). Given the presence of considerable selection bias at every step along the way, they don’t represent anything to get too excited about.
#10. Possible signs of harm are obscured without a control group
23% of patients had serious adverse events (including multi-organ failure, septic shock, acute kidney injury, and hypotension)(table below). Are these true adverse events due to remdesivir? Or are these simply due to COVID infection? Without a control group, it’s anyone’s guess.
The authors concluded that “no new safety signals were detected during short-term remdesivir therapy.” I suppose that it technically correct. Based on the design of this trial, it’s impossible to say anything about the safety of remdesivir at all.
#11. Heavy involvement of pharma
Patient selection was performed by Gilead. Funding was provided by Gilead. Subsequently, the manuscript was largely written by professional writers employed by Gilead.
Over fifty doctors are listed as the co-authors. This author pool obviously has the talent and knowledge to draft an original manuscript. Why couldn’t they write the manuscript on their own, without professional help? Gilead probably didn’t want them to write an original and bias-free manuscript.
Summary
- This publication is grossly flawed, with many sources of bias. Overall, it reveals no meaningful information about Remdesivir.
- Like any new medication with unclear side-effects, Remdesivir should be subjected to RCTs.
- Gilead is a multi-billion-dollar pharmaceutical company, with ample resources. We are in the midst of a pandemic, with an abundance of COVID patients. There is no excuse for Gilead not to perform a well-powered, double-blind RCT. Hopefully such studies will be forthcoming shortly.
- Until an RCT is performed, further compassionate use of remdesivir probably isn’t justified. This may simply represent a distraction when managing these extremely complex patients.
Whaddaya Say?