Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Examining the potential benefits of the influenza vaccine against SARS-CoV-2: A retrospective cohort analysis of 74,754 patients

  • Susan M. Taghioff ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    ‡ Denotes equal contribution as co-first authors.

    Affiliation Division of Plastic & Reconstructive Surgery, University of Miami Miller School of Medicine, Miami, Florida, United States of America

  • Benjamin R. Slavin ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    ‡ Denotes equal contribution as co-first authors.

    Affiliation Division of Plastic & Reconstructive Surgery, University of Miami Miller School of Medicine, Miami, Florida, United States of America

  • Tripp Holton,

    Roles Project administration, Resources, Software, Supervision, Writing – review & editing

    Affiliation Anne Arundel Medical Center, Annapolis, Maryland, United States of America

  • Devinder Singh

    Roles Conceptualization, Investigation, Methodology, Project administration, Supervision, Writing – review & editing

    DSingh.MD@med.miami.edu

    Affiliation Division of Plastic & Reconstructive Surgery, University of Miami Miller School of Medicine, Miami, Florida, United States of America

Abstract

Introduction

Recently, several single center studies have suggested a protective effect of the influenza vaccine against severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2). This study utilizes a continuously updated Electronic Medical Record (EMR) network to assess the possible benefits of influenza vaccination mitigating critical adverse outcomes in SARS-CoV-2 positive patients from 56 healthcare organizations (HCOs).

Methods

The de-identified records of 73,346,583 patients were retrospectively screened. Two cohorts of 37,377 patients, having either received or not received influenza vaccination six months–two weeks prior to SARS-CoV-2 positive diagnosis, were created using Common Procedural Terminology (CPT) and logical observation identifiers names and codes (LOINC) codes. Adverse outcomes within 30, 60, 90, and 120 days of positive SARS-CoV-2 diagnosis were compared between cohorts. Outcomes were assessed with stringent propensity score matching including age, race, ethnicity, gender, hypertension, diabetes, hyperlipidemia, chronic obstructive pulmonary disease (COPD), obesity, heart disease, and lifestyle habits such as smoking.

Results

SARS-CoV-2-positive patients who received the influenza vaccine experienced decreased sepsis (p<0.01, Risk Ratio: 1.361–1.450, 95% CI:1.123–1.699, NNT:286) and stroke (p<0.02, RR: 1.451–1.580, 95% CI:1.075–2.034, NNT:625) across all time points. ICU admissions were lower in SARS-CoV-2-positive patients receiving the influenza vaccine at 30, 90, and 120 days (p<0.03, RR: 1.174–1.200, 95% CI:1.003–1.385, NNT:435), while approaching significance at 60 days (p = 0.0509, RR: 1.156, 95% CI:0.999–1.338). Patients who received the influenza vaccine experienced fewer DVTs 60–120 days after positive SARS-CoV-2 diagnosis (p<0.02, RR:1.41–1.530, 95% CI:1.082–2.076, NNT:1000) and experienced fewer emergency department (ED) visits 90–120 days post SARS-CoV-2-positive diagnosis (p<0.01, RR:1.204–1.580, 95% CI: 1.050–1.476, NNT:176).

Conclusion

Our analysis outlines the potential protective effect of influenza vaccination in SARS-CoV-2-positive patients against adverse outcomes within 30, 60, 90, and 120 days of a positive diagnosis. Significant findings favoring influenza vaccination mitigating the risks of sepsis, stroke, deep vein thrombosis (DVT), emergency department (ED) & Intensive Care Unit (ICU) admissions suggest a potential protective effect that could benefit populations without readily available access to SARS-CoV-2 vaccination. Thus further investigation with future prospective studies is warranted.

Introduction

With cases in excess of 140 million and a death toll over 3 million, COVID-19 has greatly impacted the global community [1]. In the nascency of severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2), demand for rapid, yet accurate data was voracious [2]. As the world continues to attempt to overcome the current pandemic and readies itself to combat a future one, the need for expeditious clinical answers remains paramount.

Federated electronic medical record (EMR) networks, such as TriNetX (TriNetX Inc, Cambridge, MA), aggregate the de-identified records of millions of patients from participating healthcare organizations (HCOs) into an accessible and searchable database in real-time [3, 4]. Several publications have already demonstrated the utility of federated EMR networks in addressing research questions regarding the implications of SARS-CoV-2 on maladies including obesity, rheumatological disease, gastrointestinal bleeding, and psychiatric illness [58]. The efficiency and speed with which these previous retrospective studies were able to examine topics of interest, using real-time EMRs, allows for the collective advancement of COVID-19 knowledge in hopes of optimizing prevention and management.

Recently, several studies have suggested a possible protective effect of the influenza vaccine against SARS-CoV-2 [912]. Although no cross-reactivity between influenza-induced antibodies and SARS-CoV-2 protection has been demonstrated, several theorized mechanisms of the potential protective effect of influenza vaccination have been proposed in the recent literature [9, 13, 14]. The first hypothesis centers around the presence of MF59 in the influenza vaccine: an oil-in-water squalene emulsion that has been shown to assist in potentiating an immune response to SARS-CoV variants [14]. Alternatively, influenza vaccination’s potential protective effect may be explained by its ability to stimulate the activation of natural killer cells, the levels of which have been found to be considerably decreased in moderate and severe SARS-CoV-2 cases [15, 16]. Another proposed mechanism was described in a recent case-control study of 261 healthcare workers. The authors noted several prior studies that suggested both coronaviruses and influenza viruses engage with the angiotensin-converting enzyme 2 (ACE-2) and tetraspanin antibodies. Thus, there is belief that ACE-2 and tetraspanin antibodies may inhibit both coronavirus and low-pathogenic influenza A virus infections. Outcomes of this study pointed to a potential protective effect in those with influenza vaccination [11]. Additional studies reported that the influenza vaccine may lead to decreased risk of cardiovascular events due to potential interaction with immune and inflammatory systems to promote plaque stabilization [17, 18]. It has also been recently reported that influenza vaccine-induced antibodies may interact with the bradykinin 2 receptor, leading to an anti-inflammatory effect secondary to increasing nitric oxide [18, 19].

In a single-center study of 2,005 patients, Yang et al. were the first to perform a retrospective review highlighting a potential protective effect of influenza vaccination against adverse outcomes associated with SARS-CoV-2. Only 10.7% of patients in this study were considered up to date on their influenza immunization. The authors reported a 2.44 greater odds ratio (OR) for hospitalization and 3.29 greater OR for intensive care unit (ICU) admission indicating a protective effect for SARS-CoV-2 positive patients who were up to date on their influenza immunization [9].

This investigation seeks to explore the potential protective effects of influenza vaccination against SARS-CoV-2 using the TriNetX database. Specifically, this study aims to assess the possible benefit of influenza vaccination in mitigating critical adverse outcomes in SARS-CoV-2 positive patients using 73 million deidentified EMRs from 56 HCOs provided by a continuously updated network.

Methods

At the time of our search in January 2021, the analytics subset contained EMRs from 56 HCOs distributed predominantly throughout the United States of America, but also with participating institutions in the United Kingdom, Italy, Germany, Israel, and Singapore. Within the US, the geographic distribution of HCOs is 6% in the Northwest, 33% in the Midwest, 42% in the South, and 19% in the West [3]. The deidentified records of 73,346,583 patients were retrospectively screened using the TriNetX platform (Fig 1).

thumbnail
Fig 1. TriNetX search strategy that allowed the authors to narrow down the EMRs of an initial 73,346,583 patients into two propensity score matched 37,377-patient cohorts (N = 74,754) for direct comparison of adverse outcomes within 30, 60, 90, & 120 days of SARS-CoV-2-positive diagnosis.

https://doi.org/10.1371/journal.pone.0255541.g001

In order to ensure accuracy, logical observation identifiers names and codes (LOINCs), the universal standard for identification of medical laboratory data, were used to identify patients positive for SARS-CoV-2 (LOINC 94500–6). CPT codes were used to identify patients who had received either the trivalent live intranasal (90660) or inactivated intramuscular influenza vaccine (90653) within a timeframe of six months–two weeks prior to receiving a SARS-CoV2-positive diagnosis. Additionally, Medicare patients receiving either the intranasal or intramuscular influenza vaccine were captured using the corresponding healthcare common procedure coding system (HCPCS) code (G0008). Any EMRs belonging to patients that were pregnant, incarcerated, experienced an outcome outside of a 120-day post-SARS-CoV-2 diagnosis window, or not meeting all of the aforementioned criteria by CPT code were excluded. Following application of inclusion and exclusion criteria, a cohort of 2,814,377 patients who had not received the influenza vaccine six months–two weeks prior to a positive SARS-CoV-2 diagnosis was compared to a second cohort of 37,377, patients who had received the influenza vaccine six months–two weeks prior to a positive SARS-CoV-2 diagnosis. We selected two weeks as the minimum end of our study’s timespan as it takes approximately two weeks for the immune system to fully develop antibodies following influenza vaccination. Conversely, six months was chosen as the maximum end of the timespan between influenza vaccination and SARS-CoV-2-positive diagnosis because the accepted standard for adequate protection without a waning effect is six months [20].

Following the creation of these two cohorts, we used the TriNetX platform to facilitate propensity score matching between cohorts with ICD-10 codes for numerous factors including age, race, gender, ethnicity, diabetes mellitus (E08-E13), elevated BMI status (E65-E68), hypertension (I10-I16), chronic ischemic heart disease (I25), heart failure (I50), COPD (J44), musculoskeletal disease (M00-M99), and factors influencing health status and contact with human services (Z00-Z99) which includes factors influencing health status including tobacco use, body mass index (BMI), and socioeconomic status. After propensity score matching, a cohort of 37,377 SARS-CoV-2 positive patients without influenza vaccination was paired with a second cohort of 37,377 SARS-CoV-2 positive patients, comparable in demographics and co-morbidities, that had received influenza vaccination within the aforementioned time frame.

Propensity score 1:1 balancing was completed within the TriNetX platform via logistic regression utilizing version 3.7 of Python Software Foundation’s Scikit-Learn package (Python Software Foundation, Delaware, USA). A greedy nearest neighbor matching algorithm approach was used, setting standard differences to a value of less than 0.1 to indicate appropriate matching. To eliminate record order bias, randomization of the record order in a covariate matrix occurs before matching. Baseline characteristics with a standardized mean difference between cohorts lower than 0.1 were considered well balanced.

Following optimization of the two cohorts for direct comparison, adverse outcomes were identified with ICD-10 or CPT codes as sepsis (A41.9), deep vein thrombosis (DVT) (I82.220, I82.40-I82.89, I82.A19), pulmonary embolism (I26), acute myocardial infarction (I21), stroke(I63), arthralgia(M25.5), ICU admission (99291, 1013729, 1014309), ED visits (1013711), hospital admission (1013659, 1013660, 1013699), renal failure (N19), acute respiratory distress syndrome (J80), acute respiratory failure (J96), anorexia (R63), pneumonia (J18), and death. Following identification, adverse outcomes within 30, 60, 90, and 120 days of SARS-CoV-2-positive diagnosis were analyzed and compared between the two cohorts. 120 days was made the maximum endpoint of our study window to account for the presence of the poorly understood Post-Acute Covid Syndrome (PACS), an autonomic dysfunction phenomenon observed in many patients after recovering from SARS-CoV-2 [17].

Using the TriNetX platform’s Analytics function, statistical analysis and logistical regression were performed by comparing indices and relative risks of outcomes following the successful matching of cohorts with a p-value greater than 0.05. Outcomes for all measures were calculated using 95% confidence intervals (CIs). All p-values were two-sided and the alpha level was set at 0.05. Risk ratio was defined in this study as the ratio of the probability of an adverse SARS-CoV-2-related event occurring without history of up-to-date influenza vaccination versus the probability of the same adverse SARS-CoV-2-related event occurring in a patient with history of up-to-date influenza vaccination [21].

Subsequently, Absolute Risk Reduction (ARR), defined as the difference in risk of an adverse SARS-CoV-2-related outcome between the influenza-vaccinated group and non-influenza-vaccinated group, was calculated for each adverse outcome. The reciprocal of ARR was then obtained to determine number needed to treat, henceforth referred to in this study as number needed to vaccinate (NNV), for all statistically significant variables. The NNV is a calculation specifying the average number of patients who needed to be up-to-date on their influenza vaccination in order to have prevented one adverse SARS-CoV-2-related outcome [22, 23].

Results

Propensity score matching resulted in 37,377 patients in each cohort. Prior to matching, all between-groups factors were found to be significantly different (p<0.0001). However, following matching, all demographic and diagnostic factors were no longer significant (p>0·05) (Table 1), indicating successful balancing.

thumbnail
Table 1. Propensity score matching results, all factors were significantly different between the 2 cohorts prior to matching (p<0.0001).

https://doi.org/10.1371/journal.pone.0255541.t001

Following propensity score matching by the TriNetX system, statistical analysis was performed for all adverse outcomes of interest at 4 time points: 30, 60, 90, and 120 days following a SARS-CoV-2-positive diagnosis (Tables 25).

thumbnail
Table 2. Statistical analysis of adverse outcomes within 30 days of SARS-CoV-2-positive diagnosis.

https://doi.org/10.1371/journal.pone.0255541.t002

thumbnail
Table 3. Statistical analysis of adverse outcomes within 60 days of SARS-CoV-2-positive diagnosis.

https://doi.org/10.1371/journal.pone.0255541.t003

thumbnail
Table 4. Statistical analysis of adverse outcomes within 90 days of SARS-CoV-2-positive diagnosis.

https://doi.org/10.1371/journal.pone.0255541.t004

thumbnail
Table 5. Statistical analysis of adverse outcomes within 120 days of SARS-CoV-2-positive diagnosis.

https://doi.org/10.1371/journal.pone.0255541.t005

SARS-CoV-2-positive patients who received the influenza vaccine experienced significantly decreased sepsis (p = 0.0001–0.0020, Risk Ratio: 1.361–1.450, 95% CI: 1.123–1.699) and stroke (p = 0.0003–0.0154, Risk Ratio: 1.451–1.580, 95% CI: 1.075–2.034) across all time points. ICU admissions were significantly lower in SARS-CoV-2-positive patients receiving the influenza vaccine at 30, 90, and 120 days (p = 0.0073–0.0240, Risk Ratio: 1.174–1.200, 95% CI: 1.003–1.385), while approaching significance at 60 days (p = 0.0509, Risk Ratio: 1.156, 95% CI: 0.999–1.338) (Fig 2A).

thumbnail
Fig 2.

Significant adverse outcome trends 30–120 days (a), 60–120 days (b) & 90–120 days (c) (p<0.05). ** ICU Admissions Within 60 Days approaching significance (p = 0.0509, 95%).

https://doi.org/10.1371/journal.pone.0255541.g002

Patients who received influenza vaccination experienced significantly fewer DVTs 60–120 days after positive SARS-CoV-2 diagnosis (p = 0.0058–0.0108, Risk Ratio: 1.411–1.530, 95% CI: 1.082–2.076) (Fig 2B) and experienced significantly fewer ED visits 90–120 days post SARS-CoV-2-positive diagnosis (p = 0.0001–0.0076, Risk Ratio: 1.204–1.580, 95% CI: 1.050–1.476) (Fig 2C).

Additional findings included patients up-to-date on their influenza vaccination experiencing significantly less anorexia within 90 days of SARS-CoV-2-positive diagnosis (p = 0.0486, Risk Ratio: 1.276, 95% CI: 1.001–1.627) as well as decreased arthralgia within 120 days of SARS-CoV-2-positive diagnosis (p = 0.0041, Risk Ratio: 1.218, 95% CI: 1.064–1.395).

NNV with influenza vaccination to prevent one adverse SARS-CoV-2-related outcome calculations for significant findings for sepsis, stroke, and ICU Admission within 30, 60, 90, and 120 days of positive SARS-CoV-2 diagnosis are illustrated in Fig 3, along with NNV to prevent DVT within 60–120 days, and NNV to prevent ED Visits within 90–120 days (Fig 3).

thumbnail
Fig 3. NNV to prevent adverse outcomes within 30–120 days, 60–120 days, and 90–120 days of SARS-CoV-2-positive diagnosis.

https://doi.org/10.1371/journal.pone.0255541.g003

Discussion

This study underscores the utility of federated EMR networks as a potential solution for the need for urgent clinical data, particularly during health crises such as pandemics. While the work of retrospective single-center studies continues to have advantages such as detailed historical patient information that deidentified EMR networks cannot provide, the ability to scan, in minutes, the charts of 73 million patients from 56 HCOs in real-time to guide clinical decision-making is invaluable.

EMRs included in our study monitored patients with positive SARS-CoV-2 diagnoses for adverse outcomes during a period of 120 days. This time window was chosen intentionally to account for the possible presence of PACS. Although poorly understood, previous studies of PACS have reported orthostatic intolerance, often without objective hemodynamic abnormalities upon testing, as well as new illness-related fatigue to be the most common presentations. Development of these symptoms was found to occur between 0–122 days and 29–71 days post-SARS-CoV-2 diagnosis respectively [24, 25].

By focusing on rates of hospitalization and ICU admission, the study of Yang et al., garnered a sizable amount of media coverage [23, 24]. This study most closely mirrors this study’s aim of appraising the potential impact of influenza vaccination on adverse outcomes associated with SARS-CoV-2. Prior to comparing findings between these two studies, it is important to note several key differences in methodology [9]. While both studies relied on medical coding to identify SARS-CoV-2 positivity and influenza vaccination status, the timeframes were different, with this study encompassing the first full year of SARS-CoV-2 cases globally from January 2020-January 2021 [1, 25]. This timespan enabled our study to include data from the 2019–2020 influenza vaccine formulation as well as the most recent 2020–2021 influenza season formulation. This contrasts with the timespan of the previously mentioned study, as well as the recently published retrospective review of 27,000 patients by Conlon et al. Both of these studies analyzed SARS-CoV-2 cases between March-August 2020, a period overlapping between two different influenza vaccinations and seasons which excludes peak influenza season, and did not set a 2 week– 6 month time limit for influenza vaccine being “current/active” [9, 12]. Additionally, the Yang and Conlon study timeframes began 6 months after the CDC’s recommended influenza vaccination time in October, therefore the vaccine antibodies were likely already waning [9, 12, 20].

Our study found no association between influenza vaccination and risk of death in SARS-CoV-2-positive patients. This confirms the previous findings of Umasabor-Bubu et al., Pedote et al. and Ragni et al., which found that a history of influenza vaccination did not confer protection against death in reviews of 558, 664, and 17,600 patients respectively [2628].

Alternatively, two macro-scale studies have found there to be conflicting relationships between influenza vaccination and mortality in the elderly population. In a large scale study of over 2,000 counties in the United States, Zanettini et al. demonstrated a potential protective effect of influenza vaccination on SARS-CoV-2 mortality [29]. Conversely, Wehenkel et al. performed a macro-scale study of association between influenza vaccination rate and SARS-CoV-2 deaths in an examination of over 500,000 patients across 39 countries [30]. This study showed a positive association between COVID-19 deaths and influenza vaccination rates in elderly people 65 years of age and older. The conflicting findings of these studies may be attributable to their large scale nature and lack of analysis of individual patient EMRs, thereby further increasing the need for prospective randomized control studies to better define the potential protective effect of influenza vaccination against SARS-CoV-2.

In light of the over 140 million confirmed positive cases worldwide1, the use of NNV calculations allows for a deeper appreciation of the potential benefit of influenza vaccination. In addition to guarding against a possible “twindemic” of simultaneous outbreaks of influenza and SARS-CoV-2 [31], the NNV trends observed within 30–120 days of SARS-CoV-2 diagnosis for sepsis, stroke, ICU admission, DVT, and ED visits further strengthen the case in favor of a protective effect of influenza vaccination (Fig 3). Specifically, in order to prevent one individual from visiting the ED, developing sepsis, being admitted to the ICU, suffering a stroke, or having a DVT within 120 days of positive SARS-CoV-2 diagnosis, 176, 286, 435, 625, and 1,000 people respectively would need to have been up-to-date with their influenza vaccination. When considered on a global scale, the NNVs calculated in this study may serve to benefit not only those that will be infected with SARS-CoV-2, a diagnosis that has already affected over 140 million to date, but also the finances and resources of the health systems responsible should patients suffer these adverse outcomes [32]. Even more encouraging, apart from DVT for which NNV remained stable, the NNVs for sepsis, stroke, ICU Admissions, and ED Visits were down trending at the 120-day mark, implying that the NNV and thus potential protective benefit of influenza vaccination may be even stronger than observed in the present study.

Expanding upon our prospective understanding of the relationship between influenza vaccination and protection against adverse outcomes during SARS-CoV-2 is the work of Pawlowski et al. This retrospective review found that a history of eight different vaccines including Polio, H. influenzae type-B, measles-mumps-rubella, and Varicella, amongst others, within the past one, two, or five years is associated with decreased SARS-CoV-2 infection rates, even after cohort balancing [33]. This suggests that the protective effect observed by our group and others against SARS-CoV-2 may not be unique to influenza vaccination.

This study has the benefits of large cohort size and a tightly matched patient population, however reliance on a global database also introduces limitations that must be acknowledged. These limitations include our study’s retrospective nature, absence of detailed historical patient data, and lack of ability to follow up regarding new symptoms. Our search query’s reliance on the CPT, ICD-10, and LOINC coding of individual HCOs is another potential source of confounding as the accuracy of these factors is inherent to the EMRs comprising the database. This statement is particularly of interest as relates to false positive and false negative cases of SARS-CoV-2, which relies on the specificity and sensitivity of PCR and rapid antigen testing.

Federated EMR networks, such as TriNetX, have vast potential to challenge or verify scientific findings using sample sizes and turnaround times unachievable by individual centers, particularly during health crises such as pandemics. Our study was able to verify and challenge the relatively large difference in the potential protective effect of influenza vaccination observed by the previous study with a much more modest effect backed by nearly 75,000 global EMRs [9]. The potential protective effects of the vaccine against sepsis, stroke, DVT, ED visits, and ICU admissions at 30, 60, 90, and 120 days following SARS-CoV-2-positive diagnosis reaffirms the importance of annual influenza immunization.

While this observed potential protective effect is relatively small, the stringently matched cohort balancing and sample size afforded by TriNetX substantially increases our confidence in the fidelity of our findings. In the context of over 140 million cases globally, the potential protective benefits further elucidated by the NNV calculations for these same adverse outcomes suggests that a concerted effort to continue ramping up influenza vaccination in parallel with SARS-CoV-2 vaccination is strongly worth consideration. Although production and distribution of SARS-CoV-2 vaccines continues to increase daily, the fact remains that certain populations in the global community may still have to wait a long period of time before they are vaccinated and could therefore benefit from a more readily available source of even marginally increased protection [34]. That being said, less than half of US adults receive influenza vaccination each year, with Non-Hispanic Black, Hispanic, and American Indian/Alaskan Native individuals having had the lowest influenza vaccination coverage while also being disproportionately affected by SARS-CoV-2 [35].

The influenza vaccine may be a viable option to attenuate the adverse effects of SARS-CoV-2 worldwide, with a specific potential to benefit populations struggling with access to or distribution of SARS-CoV-2 vaccination. Even patients who have already received SARS-CoV-2 vaccination may stand to benefit given that the SARS-CoV-2 vaccine does not convey complete immunity, although further research into the relationship and potential interaction between influenza vaccination and SARS-CoV-2 vaccination should be performed.

Conclusion

Using a federated EMR network of over 73 million patients across 56 global HCOs, this analysis examines the potential protective effect of the influenza vaccine against various adverse outcomes at 30, 60, 90, and 120 days of SARS-CoV-2-positive diagnosis. Significant findings in favor of the influenza vaccine in mitigating the risks of sepsis, stroke, DVT, ED visits, and ICU admissions suggest a protective effect that merits further investigation. Limitations include this study’s retrospective nature and its reliance on the accuracy of medical coding. Future prospective controlled studies to validate these findings and determine if an increased emphasis on influenza vaccination will improve adverse outcomes in SARS-CoV-2-positive patients will be beneficial.

References

  1. 1. COVID-19 map—johns Hopkins Coronavirus resource Center. Jhu.edu. Accessed January 29, 2021. https://coronavirus.jhu.edu/map.html.
  2. 2. Vandenberg O, Martiny D, Rochas O, van Belkum A, Kozlakidis Z. Considerations for diagnostic COVID-19 tests. Nat Rev Microbiol. 2020. pmid:33057203
  3. 3. TriNetX. Trinetx.com. Published May 18, 2018. Accessed January 29, 2021. https://www.trinetx.com.
  4. 4. Topaloglu U, Palchuk MB. Using a federated network of real-world data to optimize clinical trials operations. JCO Clin Cancer Inform. 2018;2:1–10. pmid:30652541
  5. 5. Singh S, Bilal M, Pakhchanian H, Raiker R, Kochhar GS, Thompson CC. Impact of obesity on outcomes of patients with coronavirus disease 2019 in the united states: A multicenter electronic health records network study. Gastroenterology. 2020;159(6):2221-2225.e6. doi: S0016-5085(20)35067-8 [pii]. pmid:32835663
  6. 6. Perisetti A, Goyal H, Syed M, et al. Endoscopic Utilization and Outcomes of Upper Gastrointestinal Bleeding in COVID-19: A Global Real-World Database Analysis. SSRN; 2020.
  7. 7. Taquet M, Luciano S, Geddes JR, Harrison PJ. Bidirectional associations between COVID-19 and psychiatric disorder: Retrospective cohort studies of 62 354 COVID-19 cases in the USA. Lancet Psychiatry. 2021;8(2):130–140. doi: S2215-0366(20)30462-4 [pii]. pmid:33181098
  8. 8. Jorge A, D’Silva KM, Cohen A, et al. Temporal trends in severe COVID-19 outcomes in patients with rheumatic disease: A cohort study. Lancet Rheumatol. 2020. pmid:33392516
  9. 9. Yang M-J, Rooks BJ, Thi Le T-T, et al. Influenza vaccination and hospitalizations among COVID-19 infected adults. Journal of the American Board of Family Medicine. https://www.jabfm.org/sites/default/files/COVID_20-0528.pdf. Accessed January 25, 2021. pmid:33622834
  10. 10. Erismis B, Karabela SN, Eksi F, et al. Annual influenza vaccination effect on the susceptibility to COVID-19 infection. Cent Eur J Public Health. 2021;29(1):14–17. pmid:33831281
  11. 11. Massoudi N, Mohit B. A case-control study of the 2019 influenza vaccine and incidence of COVID-19 among healthcare workers. J Clin Immunol. 2021;41(2):324–334. pmid:33244671
  12. 12. Conlon A, Ashur C, Washer L, Eagle KA, Hofmann Bowman MA. Impact of the influenza vaccine on COVID-19 infection rates and severity. Am J Infect Control. 2021. doi: S0196-6553(21)00089-4 [pii]. pmid:33631305
  13. 13. Jiang S, Du L. Effect of Low-Pathogenic Human Coronavirus-Specific Antibodies on SARS-CoV-2. Trends Immunol. 10 2020;41(10):853–854. pmid:32863133
  14. 14. Gupta T, Gupta SK. Potential adjuvants for the development of a SARS-CoV-2 vaccine based on experimental results from similar coronaviruses. Int Immunopharmacol. Sep 2020;86:106717. pmid:32585611
  15. 15. Jost S, Altfeld M. Control of human viral infections by natural killer cells. Annu Rev Immunol. 2013;31:163–194. pmid:23298212
  16. 16. Jewett A. The Potential Effect of Novel Coronavirus SARS-CoV-2 on NK Cells; A Perspective on Potential Therapeutic Interventions. Front Immunol. 2020 2020;11:1692. pmid:32754162
  17. 17. Bermudez-Fajardo A, Oviedo-Orta E. Influenza vaccination promotes stable atherosclerotic plaques in apoE knockout mice. Atherosclerosis. 2011;217(1):97–105. pmid:21507404
  18. 18. Behrouzi B, Araujo Campoverde MV, Liang K, et al. Influenza vaccination to reduce cardiovascular morbidity and mortality in patients with COVID-19: JACC state-of-the-art review. J Am Coll Cardiol. 2020;76(15):1777–1794. doi: S0735-1097(20)36325-7 [pii]. pmid:33032740
  19. 19. Veljkovic V, Glisic S, Veljkovic N, et al. Influenza vaccine as prevention for cardiovascular diseases: Possible molecular mechanism. Vaccine. 2014;32(48):6569–6575. pmid:25045818
  20. 20. Cdc.gov. 2021. The Flu Season | CDC. [online] Available at: <https://www.cdc.gov/flu/about/season/flu-season.htm> [Accessed 21 April 2021].
  21. 21. Tenny S, Hoffman MR. Relative risk. In: StatPearls. Treasure Island (FL): StatPearls Publishing LLC; 2021. NBK430824 [bookaccession].
  22. 22. Hashim A, Dang V, Bolotin S, Crowcroft NS. How and why researchers use the number needed to vaccinate to inform decision making—a systematic review. Vaccine. 2015;33(6):753–758. pmid:25543164
  23. 23. Tramer MR, Walder B. Number needed to treat (or harm). World J Surg. 2005;29(5):576–581. pmid:15827840
  24. 24. Shouman K, Vanichkachorn G, Cheshire WP, et al. Autonomic dysfunction following COVID-19 infection: An early experience. Clin Auton Res. 2021. pmid:33860871
  25. 25. Halpin SJ, McIvor C, Whyatt G, et al. Postdischarge symptoms and rehabilitation needs in survivors of COVID-19 infection: A cross-sectional evaluation. J Med Virol. 2021;93(2):1013–1022. pmid:32729939
  26. 26. Umasabor-Bubu OQ, Bubu OM, Mbah AK, Nakeshbandi M, Taylor TN. Association between influenza vaccination and severe COVID-19 outcomes at a designated COVID-only hospital in brooklyn. Am J Infect Control. 2021. doi: S0196-6553(21)00201-7 [pii].
  27. 27. Ragni P, Marino M, Formisano D, et al. Association between exposure to influenza vaccination and COVID-19 diagnosis and outcomes. Vaccines (Basel). 2020;8(4): doi: E675 [pii]. pmid:33198368
  28. 28. Pedote PD, Termite S, Gigliobianco A, Lopalco PL, Bianchi FP. Influenza vaccination and health outcomes in COVID-19 patients: A retrospective cohort study. Vaccines (Basel). 2021;9(4): doi: 358 [pii]. pmid:33917898
  29. 29. Zanettini C, Omar M, Dinalankara W, et al. Influenza vaccination and COVID19 mortality in the USA. medRxiv. 2020. doi: 2020.06.24.20129817 [pii]. pmid:32607525
  30. 30. Wehenkel C. Positive association between COVID-19 deaths and influenza vaccination rates in elderly people worldwide. PeerJ 8:e10112. 2020. https://doi.org/10.7717/peerj.10112.
  31. 31. Ferdinand KC, Nedunchezhian S, Reddy TK. The COVID-19 and influenza "twindemic": Barriers to influenza vaccination and potential acceptance of SARS-CoV2 vaccination in african americans. J Natl Med Assoc. 2020;112(6):681–687. doi: S0027-9684(20)30408-9 [pii]. pmid:33276969
  32. 32. Flu Shot May Shield You From Severe COVID. [online] WebMD. Available at: <https://www.webmd.com/lung/news/20201102/get-your-flu-shot-it-might-shield-you-from-severe-covid#1> [Accessed 21 April 2021].
  33. 33. Pawlowski C, Puranik A, Bandi H, et al. Exploratory analysis of immunization records highlights decreased SARS-CoV-2 rates in individuals with recent non-COVID-19 vaccinations. Sci Rep. 2021;11(1):4741-y. pmid:33637783
  34. 34. ’Shocking imbalance’ of COVID-19 vaccine distribution underscores inequity. Healio. https://www.healio.com/news/infectious-disease/20210514/shocking-imbalance-of-covid19-vaccine-distribution-underscores-inequity. Accessed June 18, 2021.
  35. 35. Grohskopf LA, Sokolow LZ, Broder KR, Walter EB, Fry AM, Jernigan DB. Prevention and control of seasonal influenza with vaccines: Recommendations of the Advisory Committee on Immunization Practices-United States, 2018–19 influenza season. MMWR Recomm Rep. 2018;67(3):1–20. pmid:30141464