http://orcid.org/0000-0001-7420-9024
Figures
Abstract
Severe influenza A virus infection causes high mortality and morbidity worldwide due to delayed antiviral treatment and inducing overwhelming immune responses, which contribute to immunopathological lung injury. Sirolimus, an inhibitor of mammalian target of rapamycin (mTOR), was effective in improving clinical outcomes in patients with severe H1N1 infection; however, the mechanisms by which it attenuates acute lung injury have not been elucidated. Here, delayed oseltamivir treatment was used to mimic clinical settings on lethal influenza A (H1N1) pdm09 virus (pH1N1) infection mice model. We revealed that delayed oseltamivir plus sirolimus treatment protects mice against lethal pH1N1 infection by attenuating severe lung damage. Mechanistically, the combined treatment reduced viral titer and pH1N1-induced mTOR activation. Subsequently, it suppressed the NOD-like receptor family pyrin domain containing 3 (NLRP3) inflammasome-mediated secretion of interleukin (IL)-1β and IL-18. It was noted that decreased NLRP3 inflammasome activation was associated with inhibited nuclear factor (NF)-κB activation, reduced reactive oxygen species production and increased autophagy. Additionally, the combined treatment reduced the expression of other proinflammatory cytokines and chemokines, and decreased inflammatory cell infiltration in lung tissue and bronchioalveolar lavage fluid. Consistently, it inhibited the mTOR-NF-κB-NLRP3 inflammasome-IL-1β axis in a lung epithelial cell line. These results demonstrated that combined treatment with sirolimus and oseltamivir attenuates pH1N1-induced severe lung injury, which is correlated with suppressed mTOR-NLRP3-IL-1β axis and reduced viral titer. Therefore, treatment with sirolimus as an adjuvant along with oseltamivir may be a promising immunomodulatory strategy for managing severe influenza.
Author summary
The severity and lethality of influenza A virus infection are frequently aggravated by virus-induced tissue destruction and overwhelming immune responses. Combined therapy with antiviral medications and immunomodulators, which not only inhibit viral replication, but also reduce the damaging consequences of host immune responses, will be beneficial in the treatment of severe influenza. In the present study, we revealed that pH1N1-induced activation of mTOR promotes lung immunopathological injury, which is correlated with upregulated NF-κB activity and increased reactive oxygen species production. Subsequently, it induces NLRP3 inflammasome activation and the secretion of IL-1β and IL-18. Combined treatment with oseltamivir and the mTOR inhibitor sirolimus (as an adjuvant) not only blocks viral replication, but also suppresses mTOR-NLRP3-IL-1β axis-mediated immune damage, thus protecting mice against lethal pH1N1 infection. Our findings provide the theoretical and experimental basis for the clinical investigation of sirolimus as an adjunct treatment for severe influenza.
Citation: Jia X, Liu B, Bao L, Lv Q, Li F, Li H, et al. (2018) Delayed oseltamivir plus sirolimus treatment attenuates H1N1 virus-induced severe lung injury correlated with repressed NLRP3 inflammasome activation and inflammatory cell infiltration. PLoS Pathog 14(11): e1007428. https://doi.org/10.1371/journal.ppat.1007428
Editor: Paul G. Thomas, St. Jude Children's Research Hospital, UNITED STATES
Received: April 10, 2018; Accepted: October 22, 2018; Published: November 13, 2018
Copyright: © 2018 Jia et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This work was supported by grants from National Natural Science Foundation of China (81373114) (http://www.nsfc.gov.cn/) and Beijing Municipal Natural Science Foundation (7182013) (http://bjnsf.bjkw.gov.cn/) to XZ, National Science Grant for Distinguished Young Scholars (81425001/H0104) (http://www.nsfc.gov.cn/) and National Key Technology Support Program from Ministry of Science and Technology (2015BAI12B11) (http://www.most.gov.cn/) to BC, and CAMS Innovation Fund for Medical Sciences (2016-I2M-1-014, 2016-12M-006) (www.pumc.edu.cn/) to LB. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Influenza A virus (IAV) infection represents a leading threat to global public health. New estimates have indicated that up to approximately 645,000 influenza-associated respiratory deaths occur annually [1]. Our previous clinical data showed that critically ill patients infected with influenza A (H1N1) pdm09 virus (pH1N1) is usually accompanied by acute lung injury (ALI) and acute respiratory distress syndrome (ARDS), which is characterized by sudden onset of respiratory failure, refractory hypoxemia, and noncardiogenic pulmonary edema, and pathologically by necrosis of bronchiolar walls, diffuse alveolar injury, and substantial inflammatory cell infiltration [2]. Our experimental and clinical studies on severe influenza infection have indicated that virus-induced tissue destruction and dysregulated systemic inflammation are associated with the severity and progression of the disease [2–7]. Combined therapy with antiviral medications and immunomodulators, which not only inhibit viral replication, but also reduce the damaging consequences of host immune responses, has been believed to be beneficial in the treatment for severe influenza pneumonia [8–10].
Rapamycin (sirolimus) is an inhibitor of mammalian target of rapamycin (mTOR). It not only blocks host pathways needed for viral replication [11–13], but also modulates the immune responses during infection [14–16]. Consequently, it may be a promising drug for treating influenza. It was reported that sirolimus combined with oseltamivir and corticosteroid treatment decreases viral titer and improves respiratory function in patients with severe H1N1 virus-induced pneumonia [17]. Furthermore, sirolimus contributes to delay the onset of morbidity in PR8 virus-infected mice [18]. Moreover, everolimus, a derivative of sirolimus, significantly reduces viral titer, lung weight, and hemorrhage score in H5N1 virus-infected mice [19]. However, the mechanisms of action of sirolimus plus oseltamivir in severe pneumonia induced by influenza infection have not been elucidated.
mTOR is a serine/threonine kinase that plays pivotal roles in cell survival, proliferation and metabolism [20]. It is composed of two different protein complexes: mTORC1, which directly phosphorylates S6 kinase (S6K), 4E-binding protein 1 (4EBP1), and subsequently activates the downstream target ribosomal protein S6 (S6RP); and mTORC2, which phosphorylates AKT [20]. It was reported that influenza virus HA and M2 protein promotes mTORC1 activation, and viral protein expression is mainly relied on mTORC1, but not mTORC2 [11]. The activation and functions of mTORC2 are not as well characterized as mTORC1. Previous studies suggested that mTORC2 may contribute to the regulation of apoptosis by the viral NS1 protein during infection [11, 21]. Aberrant mTOR activation plays critical roles in the pathogenesis of proinflammatory diseases including lipopolysaccharide induced-ALI, sepsis, atherosclerosis and neurodegenerative diseases, which make mTOR an important therapeutic target for these diseases [14]. Whether mTOR activation by influenza virus contributes to pathogenesis has not yet been fully elucidated.
NOD-like receptor family pyrin domain containing 3 (NLRP3) inflammasome is a multiprotein complex consisting of NLRP3, apoptosis-associated speck-like protein with CARD domain (ASC), and pro-caspase-1. It is a critical cytoplasmic pattern recognition receptor. Once NLRP3 inflammasome is activated, pro-caspase-1 undergoes autoactivation and cleavage to produce an enzymatically mature caspase-1, which further cleaves pro-IL-1β and pro-IL-18 into mature IL-1β and IL-18, respectively [22]. The NLRP3 inflammasome plays protective roles by initiating innate immune responses and promoting elimination of virus [23, 24]. Genetic deficiency of NLRP3, ASC, or caspase-1 in mice results in low concentrations of IL-1β and IL-18 in the bronchoalveolar lavage fluid (BALF) and serum, reduces the infiltration of leukocytes into the lungs, and increases viral titer [23–25]. However, recent studies suggest that excessive NLRP3 inflammasome activity can contribute to IAV-induced lung injury [26]. The use of a specific NLRP3 inhibitor has been noted to significantly protect mice from lethal influenza by reducing the BALF levels of proinflammatory cytokines, such as IL-1β and IL-18, and decreasing the recruitment of inflammatory cells into the lungs [27–29].
mTOR signaling has been reported to modulate the activity of NLRP3 inflammasome in different in vivo and in vitro models. Couchie et al. reported that the mTORC1/p-S6K signaling axis plays a key role in thioredoxin-80-induced inflammasome activity [30]. Furthermore, it has been shown that NLRP3 inflammasome-induced ischemia reperfusion injury can be averted by mTORC1 inhibition [31]. Additionally, mTORC1 can activate NLRP3 inflammasome in macrophages, whereas sirolimus sufficiently restricts NLRP3 inflammasome via mTORC1 inhibition [32]. Sirolimus can also induce the degradation of pro-IL-1β, and prevent maturation and secretion of cytokines by inhibiting NLRP3 inflammasome activity [33]. However, the effects of sirolimus on severe influenza virus-induced NLRP3 inflammasome activation have not yet been fully researched.
In the present study, we investigated the effects and mechanisms of delayed oseltamivir plus sirolimus on lethal influenza infection in mice. Our data showed that the combined treatment remarkably reduced ALI and systemic inflammation. Sirolimus may be a promising adjunctive therapy for severe viral pneumonia.
Results
Delayed oseltamivir plus sirolimus treatment attenuated pH1N1-induced mortality
To explore the therapeutic potential of oseltamivir plus sirolimus, a mouse model of severe pH1N1 infection was established as described in our previous report [34]. As shown in Fig 1A, the mean survival time of mice in the PBS-treated control group was 11.1 ± 2.6 days, with the survival rate of only 37.5%. Sirolimus monotherapy did not result in a protective effect at 2 hours post infection (hpi); however, a slight protective effect was observed at 2 days post infection (dpi). Furthermore, oseltamivir monotherapy at 2 hpi, and combined therapy with oseltamivir at 2 hpi plus sirolimus at 2 hpi or 2 dpi resulted in a significant increase in survival rate. Additionally, body weight loss was less in mice in these groups compared to the PBS-control group at 14 dpi (Fig 1A and 1B).
BALB/c mice were infected with pH1N1. Survival rate (A) and weight change ratio (B) following treatment with PBS, sirolimus (2 hpi), sirolimus (2 dpi), oseltamivir (2 hpi), oseltamivir (2 hpi) + sirolimus (2 hpi), or oseltamivir (2 hpi) + sirolimus (2 dpi). Survival rate (C) and weight change ratio (D) after treatment with PBS, oseltamivir (2 dpi), sirolimus (2 dpi), or oseltamivir (2 dpi) + sirolimus (2 dpi). Data are representative of two independent experiments (n = 8 for each group). In Fig 1A and 1B, ** and *** represent p < 0.01 and 0.001, respectively, when compared to the PBS-treated group. In Fig 1C, ** represent p < 0.01 when oseltamivir (2 dpi) + sirolimus (2 dpi) group compared to the oseltamivir group; ‡ represent p < 0.01 when oseltamivir (2 dpi) + sirolimus (2 dpi) group compared to the PBS group.
Unfortunately, patients are usually not administered antiviral medications until 2–4 dpi after the onset of symptoms. Consequently, severe influenza-induced high mortality and morbidity are partially due to the delayed initiation of antiviral therapy. To simulate the clinical situation and real-life scenario, delayed oseltamivir and/or sirolimus treatment at 2 dpi were provided in subsequent experiments. Not surprisingly, delayed oseltamivir or sirolimus monotherapy did not confer any survival rate benefit. However, delayed therapy with both drugs resulted in a significantly higher survival rate than oseltamivir alone (87.5% vs 37.5%, P = 0.005) or sirolimus alone (87.5% vs 50%, P = 0.018) (Fig 1C). Consistent with the survival rate data, body weight loss was less with delayed combined therapy at 14 dpi (Fig 1D). These results demonstrate that combined therapy could provide significant survival benefits against lethal pH1N1 infection even if the treatment is delayed for 2 days.
Delayed oseltamivir plus sirolimus treatment alleviated pH1N1-induced severe lung damage and decreased viral titer
Excessive viral load and immune pathogenesis are important causes of severe lung injury [35–37]. To investigate the protective mechanisms of the combined therapy, pathological damage and viral titer in the lung were assessed. As shown in Fig 2A, PBS-treated pH1N1-infected lungs exhibited extensive lung damage, including desquamation of bronchiolar epithelial cells, diffused alveolar damage, and interstitial inflammatory infiltration at 5 dpi; moreover, lung damage at 7 dpi was more severe. Delayed oseltamivir or sirolimus monotherapy only slightly alleviated pathological damage, whereas delayed combined therapy significantly ameliorated lung pathological injury (Fig 2A and 2B). In addition, the activity of lactate dehydrogenase (LDH) in the BALF, which is representative of pathological damage to the lungs, was dramatically decreased in the delayed combined treatment group compared to the mock or monotherapy group (Fig 2C). Surprisingly, at 7 dpi, viral titer was also dramatically lower in the mice that underwent delayed combined treatment than in the PBS-treated mice (Fig 2D). These results suggest that delayed adjuvant sirolimus plus oseltamivir treatment synergistically alleviates lung immunopathological injury and decreases viral titer.
(A) Lung tissue injury was assessed by hematoxylin and eosin staining at 5 and 7 dpi. Scale bar = 100 μm, original magnification: ×200. (B) Semiquantitative histological scoring of lung injury. This experiment was done in a blinded manner. (C) Relative LDH activity in the bronchioalveolar lavage fluid of the infected mice following different treatments at the indicated dpi. (D) Viral titer in the lung homogenates of the infected mice following different treatments at the indicated dpi. Data are representative of two independent experiments and presented as mean ± SEM (n = 5 for each group). *, **, and *** represent p < 0.05, 0.01, and 0.001, respectively.
Sirolimus significantly inhibited pH1N1-induced mTOR pathway activation in vivo
Previous studies have proved that mTOR activation plays important roles in diverse animal models of ALI [38–40]. Therefore, we investigated whether sirolimus alleviates ALI by suppressing pH1N1-induced mTOR pathway activation. The activation of mTOR and related molecules was assayed by western blotting and immunohistochemical analyses. The expression of phosphorylated (p)-mTOR and downstream p-S6K and p-S6RP were significantly increased in the lung tissues of pH1N1-infected mice (S1A Fig). Histological analysis further revealed the activation of the mTOR signaling pathway, as indicated by the expression of p-mTOR and p-S6RP, which were predominant in both bronchiolar and alveolar epithelial cells after infection with pH1N1 (S1B and S1C Fig).
Next, we tested the ability of sirolimus to inhibit mTOR activation in vivo. The results showed that mTOR activation was lower in mice treated with sirolimus only or oseltamivir plus sirolimus than it was in the control mice or mice treated with oseltamivir only (Fig 3A and 3B). Moreover, immunohistochemical analysis of p-mTOR and p-S6RP further revealed that mTOR activity was markedly decreased in both alveolar and bronchiolar epithelial cells after treatment with sirolimus (Fig 3C and 3D). The results suggest that the mTOR pathway is activated during pH1N1 infection. Additionally, the pathway might mediate virus-induced lung injury; however, delayed treatment with sirolimus alleviates immunopathological lung injury via inhibition of mTOR activation.
(A) Western blot analysis of p-mTOR, mTOR, p-S6K, S6K, p-S6RP, and S6RP expression in the lungs of different treatment groups at 5 dpi. (B) Expression of p-mTOR relative to mTOR, p-S6K relative to S6K, p-S6RP relative to S6RP, and the mTOR, S6K, and S6RP relative to β-actin in the different treatment groups. (C) Representative immunohistochemical images of p-mTOR and p-S6RP expression in the lungs of mice in the different treatment groups at 5 dpi. Scale bar = 200 μm, original magnification: ×100. (D) Quantitative analysis of p-mTOR- and p-S6RP-positive cells in the lungs of infected mice after the different treatments. Data are representative of two independent experiments and presented as mean ± SEM (n = 3 for each group). *, **, and *** represent p < 0.05, 0.01, and 0.001, respectively.
Improved ALI by delayed oseltamivir plus sirolimus treatment was correlated with suppressed NLRP3 inflammasome-mediated secretion of IL-1β and IL-18
Excessive NLRP3 inflammasome activation contributes to aberrant inflammatory responses and causes severe ALI after influenza infection [26–29]. The NLRP3 inflammasome is a major downstream target of the mTOR signaling pathway [31, 32]. We next investigated whether the reduced immunopathological injury induced by sirolimus was associated with inhibition of NLRP3 inflammasome activation. As shown in Fig 4A–4E, delayed oseltamivir plus sirolimus treatment significantly decreased both mRNA and protein levels of NLRP3, ASC, and caspase-1 when compared with oseltamivir or sirolimus monotherapy (Fig 4A–4E). Once NLRP3 inflammasome is activated, pro-caspase-1 undergoes autocleavage to produce active caspase-1 (p20 subunit). The delayed combined treatment also significantly decreased the amount of active caspase-1 p20 in the lung tissue (Fig 4D and 4E).
Real-time PCR analysis of the NLRP3 inflammasome components, NLRP3 (A), ASC (B), and caspase-1 (C) in the lungs of infected mice in different treatment groups at 5 dpi. (D) Western blot analysis of NLRP3 inflammasome components in the lungs of infected mice in different treatment groups at 5 dpi. (E) Expression of NLRP3 and ASC relative to β-actin, and caspase 1 p20 relative to pro-caspase1. Concentrations of IL-1β (F) and IL-18 (G) in the BALF of infected mice in different treatment groups at 5 dpi. Real-time PCR analysis of IL-1β (H) and IL-18 (I) levels in the lungs of infected mice in different treatment groups at 5 dpi. (J) Western blot analysis of IL-1β and pro-IL-1β expression in the lungs of infected mice in different treatment groups at 5 dpi. Expression of IL-1β (K) and pro-IL-1β (L) relative to β-actin. Data are representative of two independent experiments and presented as mean ± SEM (n = 5 for each group). *, **, and *** represent p < 0.05, 0.01, and 0.001, respectively.
Active caspase-1 can in turn cleave pro-IL-1β and pro-IL-18 into their mature forms. Influenza virus infection can dramatically induce the transcription and translation of pro-IL-1β and pro-IL-18 in the lung. The concentrations of IL-1β and IL-18 in the BALF at 5 dpi were markedly decreased by the combined treatment (Fig 4F and 4G). Additionally, lower IL-1β/IL-18 mRNA and IL-1β protein levels were also observed in the delayed combined treatment group than in the monotherapy group (Fig 4H–4L). These data suggest that the delayed combined therapy alleviates lung immunopathological damage, which is correlated with reduced NLRP3 inflammasome-mediated secretion of IL-1β and IL-18.
Suppressed NLRP3 inflammasome activity was associated with inhibited nuclear factor (NF)-κB activation, reduced reactive oxygen species (ROS) production and elevated autophagy
The potential mechanisms underlying reduced NLRP3 inflammasome activity by the delayed combined therapy were investigated. NF-κB and ROS are well-recognized factors that cooperatively mediate the activation of NLRP3 inflammasome [41–43]. Influenza virus induced NF-κB activation through phosphorylation of p65 and IκBα. Treatment with sirolimus and/or oseltamivir effectively decreased the levels of p-p65 and p-IκBα in the lungs of the virus-infected mice (Fig 5A and 5B). Moreover, the delayed combined therapy, but not monotherapy, significantly reduced ROS production in the lung homogenates (Fig 5C). Sirolimus can also induce autophagy to inhibit the NLRP3 inflammasome activation [44]. The autophagy-related hallmarks were also measured in pH1N1-infected mice. As shown in Fig 5D and 5E, delayed sirolimus or sirolimus plus oseltamivir treatment could dramatically induce autophagic flux, including decreased expression of autophagy substrate SQSTM1/p62, as well as increased expression of autophagosomes protein Beclin and LC3-II in the lung tissue at 5 dpi. These data suggest that delayed oseltamivir plus sirolimus treatment reduces NLRP3 inflammasome activity, which is correlated with downregulated NF-κB activity and ROS production, and induced autophagy after pH1N1 infection.
(A) Western blot analysis of p-p65, p65, p-IκB-α, and IκB-α expression in the lungs of infected mice in different treatment groups at 5 dpi. (B) Expression of p-p65 relative to p65, p-IκB-α relative to IκB-α, and p65 or IκB-α relative to β-actin. (C) ROS content in the lung homogenates of infected mice in different treatment groups at 5 dpi. (D) Western blot analysis of SQSTM1/p62, Beclin and LC3 I/II expression in the lungs of infected mice in different treatment groups at 5 dpi. (E) Expression of SQSTM1/p62, Beclin, and LC3 II relative to β-actin, and LC3 II relative to LC3 I in the different treatment groups. Data are representative of two independent experiments and presented as mean ± SEM (n = 5 for each group). *, **, and *** represent p < 0.05, 0.01, and 0.001, respectively.
Delayed oseltamivir plus sirolimus treatment decreased the expression of various proinflammatory cytokines and chemokines
We have reported that cytokine storm contributes to pH1N1-induced lung immunopathological damage [4, 5]. To further elucidate whether the delayed oseltamivir plus sirolimus treatment can repress the cytokine storm after pH1N1 infection, the concentrations of multiple cytokines/chemokines in BALF were measured at 7 dpi using Bio-Plex. The delayed combined therapy significantly decreased the concentrations of eotaxin, IFN-γ, IL-1α, IL-10, KC, MCP-1, MIP-1β, RANTES and TNF-α compared with untreated control or monotherapy group; however, the levels of G-CSF, GM-CSF, IL-6, IL-12 (p40), IL-12 (p70), IL-17 and MIP-1α were not noticeably affected (Fig 6).
The concentrations of eotaxin, IFN-γ, IL-1α, IL-10, KC, MCP-1, MIP-1β, RANTES, TNF-α, G-CSF, GM-CSF, IL-6, IL-12 (p40), IL-12 (p70), IL-17 and MIP-1α in the BALF of infected mice in different treatment groups at 7 dpi. Data are representative of two independent experiments and presented as mean ± SEM (n = 5 for each group). *, **, and *** represent p < 0.05, 0.01, and 0.001, respectively.
Delayed oseltamivir plus sirolimus treatment reduced inflammatory cell infiltration
Abrupt increases in the levels of cytokines and chemokines may contribute to cell recruitment. We then measured the effect of combination treatment on inflammatory cell infiltration after pH1N1 infection. As shown in Fig 7A and 7B, pH1N1 infection caused a large amount of leukocytes infiltration, whereas delayed sirolimus or oseltamivir plus sirolimus treatment significantly reduced inflammatory cell infiltration into the lungs, which was evidenced by low infiltration scores (Fig 7A and 7B). Particularly, the delayed combined therapy significantly decreased macrophage infiltration into the lung tissue (Fig 7C and 7D). Myeloperoxidase (MPO) activity, which reflects the number of neutrophils in the lung, was also dramatically decreased after the treatment with sirolimus or oseltamivir plus sirolimus (Fig 7E).
(A) Histopathological examination of the inflammatory cell infiltration into the lungs of infected mice in different treatment groups at 5 dpi. Scale bar = 100 μm. (B) Lung inflammatory cell infiltration scores of infected mice in different treatment groups. (C) Representative immunohistochemical images of CD68 expression in the lungs of the infected mice in different treatment groups at 5 dpi. Scale bar = 200 μm, original magnification: ×100. (D) Quantitative analysis of CD68-positive cells in the lungs of infected mice in different treatment groups. (E) Relative MPO activity in the lung homogenates of infected mice in different treatment groups at 5 dpi. (F) Total cell counts and (G) the numbers of neutrophils, macrophages, and lymphocytes in BALF samples from different treatment groups at 5 and 7 dpi. Data are representative of two independent experiments and presented as mean ± SEM (n = 5 per group). *, **, and *** represent p < 0.05, 0.01, and 0.001, respectively.
The total number of cells and the numbers of different cell types in BALF were also examined. Delayed sirolimus or oseltamivir plus sirolimus treatment significantly reduced the total number of leukocytes, as well as the number of neutrophils, macrophages and lymphocytes at 5 and 7 dpi (Fig 7D and 7E). These data suggest that the delayed combined therapy can alleviate cytokine storm and inflammatory cell infiltration.
Combined oseltamivir and rapamycin treatment inhibited viral spread and reduced mTOR-NF-κB-NLRP3 inflammasome-IL-1β signaling in lung epithelial cells in vitro
Airway epithelial cells are the primary targets of influenza virus. We had demonstrated that the viral titers were synergistically reduced in combined treatment group at 7 dpi in vivo (Fig 2D). To further confirm the impact of rapamycin on viral replication, mouse lung epithelial cells (MLE12) were treated with oseltamivir and/or rapamycin after pH1N1 infection in vitro. The copies of viral RNA genomes in the cell-free supernatant were measured in control, oseltamivir, rapamycin, and oseltamivir plus rapamycin treatment groups. As shown in S2 Fig, oseltamivir, as well as rapamycin, could significantly decrease the copies of viral RNA genomes in the cell-free supernatant. Moreover, the combined oseltamivir and rapamycin treatment further decreased the copies of viral RNA genomes at 24 hpi (S2 Fig). The results suggested that rapamycin could decrease viral replication through inhibiting mTOR-mediated initiation and enhancement of viral mRNAs translation in vitro.
In addition to hematopoietic cells, NLRP3 inflammasome activation also occurs in non-immune cells, such as primary bronchial epithelial cells, lung fibroblasts, and various epithelial cell lines infected with influenza virus [25, 35, 41, 45, 46]. To further confirm the effects of the combined treatment on the mTOR-NF-κB-NLRP3 inflammasome-IL-1β pathway, the activation of mTOR and related downstream molecules S6K were assayed by western blotting. As expected, the levels of p-mTOR and p-S6K were dramatically increased after pH1N1 infection in MLE12 cells, whereas oseltamivir and rapamycin reduced mTOR activity synergistically (Fig 8A and 8B). Meanwhile, H1N1 virus-induced NLRP3 inflammasome activation was synergistically repressed by the combined treatment. This was shown by the significantly low levels of NLRP3 and activated caspase-1 p20 (Fig 8C and 8D). Consistently, the combined treatment further reduced NLRP3 inflammasome-mediated maturation and secretion of IL-1β (Fig 8E and 8F). Mechanistically, oseltamivir plus rapamycin synergistically inhibited NF-κB signaling by significantly decreasing p-p65 and p-IκB expression in MLE12 cells (Fig 8G and 8H). Because rapamycin inhibits viral replication, and may further cause decreased immune responses. To rule out the effect of rapamycin induced virus titer depression on immune responses, the MLE12 cells were treated with oseltamivir and/or rapamycin without pH1N1 infection in vitro. As shown in S3 Fig, oseltamivir had no effect on the expression of NLRP3 and IL-1β, however, rapamycin or rapamycin plus oseltamivir significantly decreased the expression of NLRP3 and IL-1β in MLE12 cells. The results suggested that rapamycin could directly modulate the host immune responses. Furthermore, rapamycin induced autophagy-related hallmarks were also measured in vitro experiments. Consistent with the results of the in vivo studies, oseltamivir plus rapamycin treatment also significantly decreased the expression of autophagy substrate SQSTM1/p62 and increased the expression of autophagosomes protein Beclin or LC3-II in MLE12 cells at 24, 48 or 72 hpi (S4 Fig). All the data demonstrate that combined oseltamivir and rapamycin treatment reduces the NLRP3 inflammasome-mediated secretion of IL-1β in lung epithelial cells, which is correlated with inhibited mTOR-NF-κB signaling and induced autophagy.
Infected MLE12 cells were harvested and analyzed for protein expression by western blotting. (A) Protein levels of p-mTOR, mTOR, p-S6K, and S6K. (B) Expression of p-mTOR relative to mTOR, p-S6K relative to S6K, and p-mTOR, mTOR, p-S6K, and S6K relative to β-actin. (C) Protein levels of NLRP3, caspase-1 p20, and pro-caspase-1. (D) Expression of NLRP3 and pro-caspase-1 relative to β-actin, and caspase-1 p20 relative to pro-caspase-1. (E) Protein levels of IL-1β and pro-IL-1β. (F) Expression of IL-1β and pro-IL-1β relative to β-actin. (G) Protein levels of p-p65, p65, p-IκB-α, and IκB-α. (H) Expression of p-p65 relative to p65, p-IκB-α relative to IκB-α, and p-p65, p65, p-IκB-α, and IκB-α relative to β-actin. Data are representative of two independent experiments and presented as mean ± SEM. *, **, and *** represent p < 0.05, 0.01, and 0.001, respectively.
Discussion
Pandemic influenza infection causes substantial mortality. Oseltamivir is most effective against the infection only when it is administered within 48 h from the onset of symptoms. However, in clinical settings, patients usually can’t receive treatment until overt illness symptoms occur after infection, by which time viral load may already be high. Therefore, the high inoculum and delayed therapy used in the presently reported mouse model can better simulate the real clinical situation.
Host immune responses that are elicited by IAV infection play important roles in promoting viral clearance. However, aberrant or uncontrolled immune responses, such as cytokine storm and excessive cellular activation, are also important in the pathogenesis of influenza-induced ALI [35, 37, 47]. Previous reports have suggested that once the viral infection triggers a cytokine storm, proinflammatory cytokines and chemokines continue to induce immunopathological damage even if viral replication is suppressed [48]. All the results indicated that overwhelming immune responses and viral virulence were the main reasons for the severe disease or even death [2–7, 37, 49–53]. Adjuvant corticosteroid therapies are often used in the management of patients with ALI/ARDS, as they are hoped to reduce lung inflammation and improve clinical outcomes. However, clinical data of our study as well as results of other groups have demonstrated that adjuvant corticosteroid therapy may be harmful in patients with influenza pneumonia [54–59]. Novel drugs that attenuate the severity of the infection by reducing the inflammatory response might be promising agents for influenza treatment.
In the present study, we found that the delayed oseltamivir plus sirolimus treatment significantly improves survival rate and reduces inflammatory lung tissue damage during pH1N1 infection. We noted that sirolimus potently reduces pH1N1 virus-induced mTOR activation, and subsequently suppresses the NLRP3 inflammasome-mediated secretion of IL-1β and IL-18. The decreased activation of NLRP3 inflammasome by sirolimus was associated with inhibited NF-κB activation, reduced ROS production, and increased autophagy (Fig 9). Furthermore, the delayed combined treatment significantly reduced the BALF levels of various cytokines and chemokines. Additionally, inflammatory cell infiltration into the lungs and BALF was reduced after combination treatment. Consistent with the results of the in vivo studies, oseltamivir plus rapamycin reduced mTOR-NF-κB-NLRP3 inflammasome-IL-1β axis signaling in epithelial cells.
After pH1N1 virus infection, mTOR signaling is activated, which promotes NF-κB activity and ROS production, and leads to the activation of NLRP3 inflammasome. Two signals are needed for the activation of NLRP3 inflammasome. Signal one is associated with the activation of the transcription factor NF-κB, which upregulates the transcription and expression of NLRP3, ASC, caspase-1, pro-IL-1β, and pro-IL-18. Signal two is mediated by pH1N1 virus-induced ROS production. The two signals cooperatively mediate the assembly of NLRP3 inflammasome and the cleavage of pro-caspase-1 into active caspase-1. The active caspase-1 can further cleave pro-IL-1β and pro-IL-18 into activated IL-1β and IL-18, respectively, and induce their secretion out of the cells. The bioactive IL-1β and IL-18 produced by NLRP3 inflammasome promotes pH1N1-induced lung injury. Sirolimus inhibits the activation of NF-κB by targeting mTOR. This decreases the expression of NLRP3 inflammasome components, pro-IL-1β and pro-IL-18. Furthermore, sirolimus induces autophagy and reduces ROS production to inhibit NLRP3 inflammasome assembly, which further decreases IL-1β and IL-18 release. Subsequently, there is a decline in the levels of various cytokines and chemokines, which reduces inflammatory cell infiltration into the lungs and BALF. As a result, combined therapy with oseltamivir and sirolimus inhibits viral replication and attenuates virus-induced severe immunopathological lung injury.
The mTOR inhibitor sirolimus is widely used in transplant medicine and oncology. It has pivotal roles in immune responses and cellular metabolism. The mTOR inhibition not only leads to the reduction of NF-κB-mediated inflammatory cytokine production [60], but also results in the potent suppression of CD4+ effector T cells and the promotion of Treg cells [61, 62]. It has been shown that organ transplant patients who received mTOR inhibitors exhibits decreased efficacy of H1N1 pandemic vaccination [63].
A recent report indicated that influenza virus induces metabolic phosphatidylinositide 3-kinase (PI3K)/mTOR changes; however, the PI3K/mTOR inhibitor BEZ235 restores PI3K/mTOR pathway homeostasis and significantly reduces viral titer to alleviate lethal influenza infection [64]. We found that rapamycin significantly decreased the copies of viral RNA genomes in the cell-free supernatant in vitro. Although sirolimus monotherapy could inhibit pH1N1-induced excessive immune responses (Figs 5, 6 and 7), which may affect host anti-viral capability, the viral titers were not increased at 5 or 7 dpi in vivo. These results suggested that sirolimus may have the ability to depress viral replication through inhibiting mTOR-mediated initiation and enhancement of viral mRNAs translation.
As shown in Fig 2, although the viral titers were reduced after oseltamivir monotherapy at 5 dpi and 7 dpi, the lung injury was not significantly improved in our animal experiments. Otherwise, although the viral titers in oseltamivir and sirolimus combined therapy group were only slightly lower compared with PBS treatment control group at 5 dpi, the combined therapy still showed significantly improved pathological damage and less body weight loss (Fig 2 and Fig 1D). Meanwhile, the combined therapy significantly decreased the levels of some proinflammatory cytokines and chemokines, as well as cell infiltration (Figs 6 and 7). The results suggested that the depression of excessive immune responses by sirolimus might be one of important mechanisms for the enhanced protection following infection. In addition, although sirolimus monotherapy partially inhibited the dysregulated immune responses (Figs 6 and 7), it only slightly improved the survival rate (Fig 1C). The results indicated that antiviral treatment using oseltamivir to depress viral titers and reduce virus-induced cell death is also necessary. Modulating dysregulated immune responses and inhibiting viral titers can ameliorate immunopathological injury of lung.
The assembly of the NLRP3 inflammasome results in the activation of caspase-1 and mediates the processing and release of IL-1β. Consequently, it plays central roles in inflammatory responses in diverse human diseases. However, NLRP3 inflammasome signaling must be tightly controlled to avoid inducing a hyperinflammatory state after lethal influenza infection [26–28, 41, 65]. The mTORC1 signaling axis plays key roles in regulating NLRP3 inflammasome through multiple mechanisms [30–33, 44]. Our data showed that sirolimus significantly suppressed the NLRP3 inflammasome-mediated secretion of IL-1β and IL-18. During IAV infection, two signals are required for NLRP3 inflammasome activation [42]. Firstly, NF-κB activation is needed to increase the expression of pro-IL-1β and pro-IL-18, as well as inflammasome components, NLRP3, ASC, and pro-caspase-1. Secondly, the NLRP3 inflammasome is activated by stimuli including potassium efflux, lysosomal maturation, and ROS production [43]. Several studies have shown that there is a positive crosstalk between mTOR and NF-κB/ROS during inflammation [44, 66–71]. Consistent with those data, our results showed that sirolimus significantly inhibited NF-κB and ROS by inhibiting mTOR. Furthermore, we found that combination treatment significantly increased autophagy, which may further reduce ROS and inhibit the NLRP3 inflammasome [44]. In conclusion, our results suggest that sirolimus suppresses NLRP3 inflammasome, which is correlated with inhibited NF-κB activation and ROS production, and induced autophagy after pH1N1 infection; however, it is not clear whether other inflammasomes, such as AIM2, are also inhibited.
Our experimental and clinical studies have revealed that dysregulated cytokine storm and excessive inflammatory cell infiltration are associated with disease severity [2–6]. In the present study, our results showed that the combined treatment significantly decreased the concentrations of cytokines and chemokines in BALF. Moreover, immune cell recruitment into the lungs and BALF was also reduced. Inhibition of immune cell infiltration and the expression of inflammatory mediators might have contributed to the beneficial effects of the combination treatment. It has been found that inflamed neutrophils contribute to aberrant pulmonary inflammation and ARDS during influenza infection [52, 72]. We found that the combined treatment significantly reduces neutrophil count in the BALF and lung tissue. It has been reported that inflamed macrophages contribute to secondary bacterial infections, which ultimately result in morbidity and mortality [73]. We also confirmed that the combined treatment significantly reduces the number of macrophages in the BALF and lung tissue. However, it was not clarified if oseltamivir plus sirolimus can prevent bacterial infections after IAV infection.
A few studies have shown that sirolimus increases disease severity after influenza infection. Alsuwaidi et al. reported that sirolimus treatment exacerbates respiratory function by increasing viral titer and worsening lung inflammation [74]. Huang et al. found that sirolimus treatment accelerates disease progression and abolishes the protective effect of oseltamivir treatment by suppressing antigen-specific T cell immunity and impairing virus clearance [75]. However, our results showed protective roles of sirolimus against severe infection when combined with oseltamivir. Possible explanations for this discrepancy include differences in the administration route, dosage, and administration or maintenance time of sirolimus. The prerequisite immune responses to virus infection may be completely suppressed by high dosage of sirolimus (3–5 μg/g) [74, 75], and low dosage of sirolimus (0.03 μg/g) may have no effect on the severe influenza infection-induced excessive immune response [75]. As an immunosuppressant drug, improper medication is not conducive to achieve the homeostasis of immune response, which not only inhibits excessive immune response, but also does not impede cellular and humoral responses to promote virus clearance. The dosage of sirolimus used in our study (initial dosage, 0.6 μg/g; maintenance dosage, 0.3 μg/g) was similar to those used in a clinical trial (2 mg/day) and previous studies in mice (0.6–1 μg/g) which indicated the protective roles of sirolimus [17, 18]. Moreover, using different virus strains and infective doses may lead to different results. Lethal dose of IAV A/PR/8/34 (H1N1) (108.1 TCID50 or 1.25 × 104 PFU) [74, 75], and sub-lethal dose (2.5 × 103 PFU) of IAV A/PR/8/34 (H1N1) [75] were used. The virus strain and infective dose used in our study can better simulate the clinical situation. The detailed mechanisms as to why sirolimus can be either protective or deleterious in lung injury should be further investigated.
In conclusion, our findings show that delayed combined oseltamivir plus sirolimus therapy protects against lethal pH1N1 infection by inhibiting lung immunopathologic injury. The combined therapy inhibited viral replication, restored PI3K/mTOR pathway homeostasis, and repressed inappropriate aggressive immune responses. This indicates that sirolimus can be used as a novel treatment alongside existing antiviral therapies in severe influenza. Our findings provided the theoretical and experimental basis for its use in further clinical trials. Future studies investigating detailed medication time and dosage strategies will contribute to the development of sirolimus as an effective adjunct in the treatment of influenza infection.
Materials and methods
Mice, influenza virus and cells
Specific pathogen free female BALB/c mice, at 6–8 weeks old, were obtained from the Institute of Laboratory Animal Sciences, Beijing, China.
Influenza A (H1N1) pdm09 virus was amplified for 3 days at 37°C in the allantoic cavities of 10-day-old embryonated chicken eggs. Clarified allantoic fluid was aliquoted and immediately frozen at −80°C until use.
Madin-Darby canine kidney cells (MDCK) cells were obtained from American Type Culture Collection (ATCC). MDCK cells were maintained in Eagle’s minimal essential medium (EMEM) (Gibco, Life Technologies, NY) supplemented with 10% fetal bovine serum (FBS) (Gibco, Life Technologies, NY), 100 μg/ml streptomycin and 100 IU/ml penicillin (Gibco, Life Technologies, NY), and were cultured at 37°C in 5% CO2.
Mouse lung epithelial cells (MLE12) (ATCC) were maintained in Dulbecco's modified eagle medium (DMEM/F-12) (Gibco, Life Technologies, NY) supplemented with 10% fetal bovine serum (FBS), 100 μg/ml streptomycin and 100 IU/ml penicillin, and were cultured at 37°C in 5% CO2.
Influenza virus infection
Mice were anesthetized and inoculated intranasally with 102 50% tissue culture infective doses (TCID50) of virus in a total volume of 50 μl. Control mice were administered with an equal volume of PBS. The TCID50 was determined in MDCK cells after serial dilution of the stock. After infection, mice were weighed and survival of mice was monitored for up to 14 days post infection or until death.
Oseltamivir and rapamycin treatment
Oseltamivir (Roche, Basel, Switzerland) and sirolimus (Pfizer, NY) were administered by gavage once per day for consecutive 7 days at the indicated days post infection. The administered dosage for oseltamivir was 30 mg/kg. For the mice treated with sirolimus, a loading dose of 600 μg/kg was used on the first day of treatment to facilitate achievement of steady-state blood concentrations, a maintain dose of 300 μg/kg was used during the following 6 days. Control mice were administered with an equal volume of PBS. Five randomly selected mice in each of the groups were euthanized on days 5 and 7 post infection, respectively. BALF and lung tissue samples were collected from these mice for pathologic, immunologic and virologic assays.
Cell intervention
Pre-treated MLE12 cells with rapamycin (100 nM) (Cell Signaling Technology, MA) for 1 h, were re-stimulated with H1N1 virus at multiplicity of infection (MOI) = 0.01 for 2 h and co-cultured with rapamycin (100 nM) with or without oseltamivir carboxylate (10 μg/ml) for 22 hours. After 24 h of culture, cells were harvested for analyzing the protein expressions.
Measurement of viral RNA copies from cell-free supernatant
The MLE12 cells were pretreated with or without rapamycin (100nM) for 1 h. After washing with PBS, cells were infected with pH1N1 (MOI = 0.01) for 2 h. The infected cells were washed with PBS and incubated with rapamycin (100 nM) with or without oseltamivir carboxylate (10 μg/ml). Cell-free supernatants were harvested at the indicated hpi. Viral RNA was extracted from the supernatants (100 μl) using RNeasy Mini Kit (QIAGEN, Germany) following the manufacturer's instructions. Viral matrix (M) genes were measured by the QuantiTect Probe RT-PCR Kit (QIAGEN, Germany).
The following primer and probe were used: forward, 5’- GACCRATCCTGTCACCTCTGAC-3’, reverse, 5’-AGGGCATTYTGGACAAAKCGTCTA-3’, probe, 5’-FAM-TGCAGTCCT CGCTCACTGGGCACG-BHQ1-3’.
Hematoxylin and eosin (H&E) staining
The lung samples were immediately fixed in 10% formalin, embedded in paraffin, and sectioned (4μm thickness) for histopathologic analysis. The sections were stained with hematoxylin and eosin (H&E) for examination by light microscopy.
Lung injury score
Slides were randomized, read blindly, and then scored using a semiquantitative scoring system as described previously [76]. Edema, alveolar and interstitial inflammation, alveolar and interstitial hemorrhage, atelectasis, necrosis, and hyaline membrane formation were each scored on a 0-to 4-point scale: no injury = score of 0; injury in 25% of the field = score of 1; injury in 50% of the field = score of 2; injury in 75% of the field = score of 3; and injury throughout the field = score of 4. Results were confirmed by an experienced and qualified pathologist.
Infiltration score
Each slide were assessed the degree of inflammatory cell infiltration of the main bronchus and the surrounding three large vessels, the mean values were obtained [77]. The criteria were no inflammatory cells = score of 0, a few inflammatory cells = score of 1, more uneven distribution of inflammatory cells = score of 2, a large number of inflammatory cells in relatively uniform distribution and rare gathered into a group = score of 3, a large number of inflammatory cells clump = score of 4. Results were confirmed by an experienced and qualified pathologist.
Immunohistochemical staining
Paraffin-embedded lung sections were deparaffinized with xylene and hydrated using graded alcohols. The mTORC1 activity was assessed using anti-p-mTOR antibody (1:800, Abcam, Cambridge, UK) and anti-p-S6RP antibody (1:200, Cell Signaling Technology, MA). Macrophage infiltration was detected using anti-CD68 antibody (1:200, Abcam, Cambridge, UK) [78, 79]. The antibody was then detected using a standard streptavidin-biotin detection system (Beijing Zhongshan Biotechnology Co., Ltd., Beijing, China) according to the manufacturer’s instructions.
Viral titer determination
The virus titrations were performed by end-point titration in MDCK cells. Lung samples were homogenized in 1 ml of sterile PBS. MDCK cells were inoculated with tenfold serial dilutions of homogenized lung tissues in 96-well plates. At 1 h post infection, cells were washed once with PBS and incubated in 200 μl of infection medium, consisting of EMEM, 100 μg/ml streptomycin, 100 IU/ml penicillin and 1 μg/ml TPCK-trypsin (Gibco, Life Technologies, NY). At 3 dpi, supernatants of infected cell cultures were tested for agglutinating activity using turkey erythrocytes as an indicator of cellular infection. Infectious titers were calculated from five replicates using the Reed-Muench method [80].
Myeloperoxidase (MPO) and reactive oxygen species (ROS) assay
Lung samples were homogenized in 1 ml of sterile PBS and the supernatants were collected. The activity of MPO was measured using myeloperoxidase assay kit (Nanjing jiancheng bioengineering institute, Jiangsu, China). The activity of ROS was measured using ELISA kit (Bio swamp, Hubei, China) according to the manufacturer’s instructions.
Analysis of BALF
The lungs were lavaged with 4 × 0.5 ml of PBS. The BALF was centrifuged 207 g at 4°C for 10 minutes, and the supernatant was collected and stored at -80°C for further analysis. The cells were resuspended in 1 ml of PBS and the total cell numbers were counted with a hemocytometer. Cytospin samples were prepared by centrifuging the suspensions at 350 rpm for 10 minutes using Shandon Cytospin 4 (Thermo scientific, Cheshire, UK) and cell differentials were determined by counting at least 300 leukocytes on Giemsa stain according to manufacturer’s instructions.
Lactate dehydrogenase (LDH) assay
LDH activity in BALF was measured using lactate dehydrogenase assay kit (Nanjing jiancheng bioengineering institute, Jiangsu, China).
Cytokine and chemokine analysis
The IL-1β, eotaxin, IFN-γ, IL-1α, IL-1α, IL-10, KC, MCP-1, MIP-1β, RANTES, TNF-α, G-CSF, GM-CSF, IL-6, IL-12 (p40), IL-12 (p70), IL-17 and MIP-1α levels in BALF were measured by Bio-Plex Mouse Cytokine Panel Assay Kit (Bio-Rad Laboratories, CA) according to the manufacturer’s instructions. The IL-18 level in BALF was measured by ELISA Kit (Mouse IL-18 ELISA KIT, Abcam, Cambridge, UK).
Real-time PCR
Total RNA was extracted using the RNeasy Mini kit (Qiagen, Germany), and complementary DNA was synthesized with the PrimeScript RT Master Mix (Perfect Real Time) (TaKaRa, China). Real-time PCR (RT-PCR) was performed using the SYBR Premix Ex Taq II (Tli RNaseH Plus) (TaKaRa, China).
The following primers were used: NLRP3, forward: 5’-AATGCTGCTTCGACATCTCC-3’, reverse: 5’-CCAATGCGAGATCCTGACAA-3’; ASC, forward: 5’-TGAGCAGCTGCAAACGACTA-3’, reverse: 5’-CACGAACTGCCTGGTACTGT-3’; Caspase-1, forward: 5’-GTGGAGAGAAACAAGGAGTGG-3’, reverse: 5’-AATGAAAAGTGAGCCCCTGAC-3’; IL-1β, forward: 5’-GGTGTGTGACGTTCCCATTA-3’, reverse: 5’-GGCCACAGGTATTTTGTCGT-3’; IL-18, forward: 5’-ACAGGCCTGACATCTTCTGC-3’, reverse: 5’-CCTTGAAGTTGACGCAAGAGT-3’; GAPDH, forward: 5’-ATTCCACCCATGGCAAATTC-3’, reverse: 5’-CGCTCCTGGAAGATGGTGAT-3’.
Western blot analysis
Protein samples were extracted from lung tissues and MLE12 cells. Proteins were separated by 10% SDS-polyacrylamide gel electrophoresis. After electrophoresis, the proteins were transferred to PVDF membranes by the wet transfer method. Each membrane was blocked with TBST with 5% non-fat dried milk for 1 hour at room temperature, and then incubated overnight at 4°C with primary antibodies directed against mTOR (1:1000, Cell Signaling Technology, MA), p-mTOR (1:500, Cell Signaling Technology, MA), S6K (1:1000, Cell Signaling Technology, MA), p-S6K (1:500, Cell Signaling Technology, MA), S6RP (1:1000, Cell Signaling Technology, MA), p-S6RP (1:500, Cell Signaling Technology, MA), NLRP3 (1:500, Adipogen, CA), ASC (1:1000, Cell Signaling Technology, MA), pro-caspase-1 (1:1000, Adipogen, CA), caspase-1 p20 (1:500, Adipogen, CA), pro-IL-1β (1:1000, Abcam, Cambridge, UK), IL-1β (1:500, Abcam, Cambridge, UK), p65 (1:1000, Cell Signaling Technology, MA), p-p65 (1:500, Cell Signaling Technology, MA), IκB (1:2000, Cell Signaling Technology, MA), p-IκB (1:1000, Cell Signaling Technology, MA), SQSTM1/p62 (1:1000, Cell Signaling Technology, MA), Beclin (1:1000, Cell Signaling Technology, MA), LC3 I/II (1:500, Cell Signaling Technology, MA) and β-actin (1:5000, Abcam, Cambridge, UK). The appropriate HRP-coupled secondary antibody was added and incubated for 1 hour at room temperature. The membranes were then treated with enhanced chemiluminescence western blot detection reagents (Millipore corporation, MA), and the binding of specific antibodies was detected by chemiluminescence.
Statistical analysis
Survival curves were generated by the Kaplan-Meier method and statistical analyses were performed using the log-rank test. The statistical significance between two groups was assessed by Student’s t-tests. For comparisons between ≥ 3 groups, analysis was done by one-way ANOVA. A two-sided p value < 0.05 was considered statistically significant.
Ethics statement
The experiments were performed in biosafety level 3 facilities in compliance with governmental and institutional guidelines. This study was carried out in accordance with the recommendations of the Chinese National Guidelines for the Care of Laboratory Animals and the Institutional Animal Care and Use Committee of the Institute of Laboratory Animal Science, Peking Union Medical College [81]. The protocol was approved by the Institutional Animal Care and Use Committee (ILAS-PC-2015-016).
Supporting information
S1 Fig. mTOR signaling pathway was activated after pH1N1 infection.
(A) Western blot analysis of p-mTOR, mTOR, p-S6K, S6K, p-S6RP, and S6RP expression in the lungs of control and infected mice at 5 dpi. Representative immunohistochemical images of p-mTOR (B) and p-S6RP (C) expression in the bronchiolar epithelium and other severely inflamed lung tissues at 5 dpi. Scale bar = 200 or 100 μm, original magnification: ×100 or ×200. Data are representative of two independent experiments (n = 3 for each group).
https://doi.org/10.1371/journal.ppat.1007428.s001
(TIF)
S2 Fig. Oseltamivir and rapamycin could inhibit viral spread in vitro.
The MLE12 cells were infected with pH1N1 (MOI = 0.01) for 2 h. After washing with PBS, the cell-free supernatants in different treatment groups were collected to detect copies of viral RNA by RT-PCR at 24 hpi. Data are representative of two independent experiments and presented as mean ± SEM. * and ** represent p < 0.05 and 0.01, respectively.
https://doi.org/10.1371/journal.ppat.1007428.s002
(TIF)
S3 Fig. Rapamycin can directly modulate the host immune response.
Uninfected MLE12 cells were co-incubated with oseltamivir carboxylate (10 μg/ml), rapamycin (100 nM) or oseltamivir carboxylate (10 μg/ml) plus rapamycin (100 nM). The cells were harvested and analyzed for NLRP3, IL-1β and pro-IL-1β protein expression by western blotting after 24 hours (A). (B) Expression of NLRP3 relative to β-actin. (C) Expression of IL-1β and pro-IL-1β relative to β-actin. Data are representative of two independent experiments and presented as mean ± SEM. *, ** and *** represent p < 0.05, 0.01 and 0.001, respectively.
https://doi.org/10.1371/journal.ppat.1007428.s003
(TIF)
S4 Fig. Rapamycin induced autophagy in vitro.
The MLE12 cells were infected with pH1N1 (MOI = 0.01) for 2 h. After washing with PBS, cells were incubated with oseltamivir carboxylate (10 μg/ml), rapamycin (100 nM) or oseltamivir carboxylate (10 μg/ml) plus rapamycin (100 nM). The cells were harvested and analyzed for protein expression by western blotting at indicated time. (A) Protein levels of SQSTM1/p62 and LC3 I/II at 24 hpi. (B) Expression of SQSTM1/p62, LC3 I and LC3 II relative to β-actin, and LC3 II relative to LC3 I. (C) Protein levels of SQSTM1/p62 and Beclin at 48 hpi. (D) Expression of SQSTM1/p62 and Beclin relative to β-actin. (E) Protein levels of SQSTM1/p62 and Beclin at 72 hpi. (F) Expression of SQSTM1/p62 and Beclin relative to β-actin. Data are representative of two independent experiments and presented as mean ± SEM. * and ** represent p < 0.05 and 0.01, respectively.
https://doi.org/10.1371/journal.ppat.1007428.s004
(TIF)
References
- 1. Iuliano AD, Roguski KM, Chang HH, Muscatello DJ, Palekar R, Tempia S, et al. Estimates of global seasonal influenza-associated respiratory mortality: a modelling study. Lancet. 2017.
- 2. Bai L, Gu L, Cao B, Zhai XL, Lu M, Lu Y, et al. Clinical features of pneumonia caused by 2009 influenza A(H1N1) virus in Beijing, China. Chest. 2011;139(5):1156–64. pmid:20864615
- 3. Wang C, Yu H, Horby PW, Cao B, Wu P, Yang S, et al. Comparison of patients hospitalized with influenza A subtypes H7N9, H5N1, and 2009 pandemic H1N1. Clin Infect Dis. 2014;58(8):1095–103. pmid:24488975
- 4. Wang W, Yang P, Zhong Y, Zhao Z, Xing L, Zhao Y, et al. Monoclonal antibody against CXCL-10/IP-10 ameliorates influenza A (H1N1) virus induced acute lung injury. Cell Res. 2013;23(4):577–80. pmid:23419516
- 5. Li C, Yang P, Sun Y, Li T, Wang C, Wang Z, et al. IL-17 response mediates acute lung injury induced by the 2009 pandemic influenza A (H1N1) virus. Cell Res. 2012;22(3):528–38. pmid:22025253
- 6. Cao B, Li XW, Mao Y, Wang J, Lu HZ, Chen YS, et al. Clinical features of the initial cases of 2009 pandemic influenza A (H1N1) virus infection in China. N Engl J Med. 2009;361(26):2507–17. pmid:20007555
- 7. Li H, Bradley KC, Long JS, Frise R, Ashcroft JW, Hartgroves LC, et al. Internal genes of a highly pathogenic H5N1 influenza virus determine high viral replication in myeloid cells and severe outcome of infection in mice. PLoS Pathog. 2018;14(1):e1006821. pmid:29300777
- 8. Hui DS, Lee N, Chan PK. Adjunctive therapies and immunomodulatory agents in the management of severe influenza. Antiviral Res. 2013;98(3):410–6. pmid:23578727
- 9. Zumla A, Memish ZA, Maeurer M, Bates M, Mwaba P, Al-Tawfiq JA, et al. Emerging novel and antimicrobial-resistant respiratory tract infections: new drug development and therapeutic options. Lancet Infect Dis. 2014;14(11):1136–49. pmid:25189352
- 10. Ison MG. Antiviral Treatments. Clin Chest Med. 2017;38(1):139–53. pmid:28159156
- 11. Kuss-Duerkop SK, Wang J, Mena I, White K, Metreveli G, Sakthivel R, et al. Influenza virus differentially activates mTORC1 and mTORC2 signaling to maximize late stage replication. PLoS Pathog. 2017;13(9):e1006635. pmid:28953980
- 12. Konig R, Stertz S, Zhou Y, Inoue A, Hoffmann HH, Bhattacharyya S, et al. Human host factors required for influenza virus replication. Nature. 2010;463(7282):813–7. pmid:20027183
- 13. Mata MA, Satterly N, Versteeg GA, Frantz D, Wei S, Williams N, et al. Chemical inhibition of RNA viruses reveals REDD1 as a host defense factor. Nat Chem Biol. 2011;7(10):712–9. pmid:21909097
- 14. Soltani A, Bahreyni A, Boroumand N, Roshan MK, Khazaei M, Ryzhikov M, et al. Therapeutic potency of mTOR signaling pharmacological inhibitors in the treatment of proinflammatory diseases, current status and perspectives. J Cell Physiol. 2017.
- 15. Thomson AW, Turnquist HR, Raimondi G. Immunoregulatory functions of mTOR inhibition. Nat Rev Immunol. 2009;9(5):324–37. pmid:19390566
- 16. Weichhart T, Hengstschlager M, Linke M. Regulation of innate immune cell function by mTOR. Nat Rev Immunol. 2015;15(10):599–614. pmid:26403194
- 17. Wang CH, Chung FT, Lin SM, Huang SY, Chou CL, Lee KY, et al. Adjuvant treatment with a mammalian target of rapamycin inhibitor, sirolimus, and steroids improves outcomes in patients with severe H1N1 pneumonia and acute respiratory failure. Crit Care Med. 2014;42(2):313–21. pmid:24105455
- 18. Liepkalns JS, Pandey A, Hofstetter AR, Kumar A, Jones EN, Cao W, et al. Rapamycin Does Not Impede Survival or Induction of Antibody Responses to Primary and Heterosubtypic Influenza Infections in Mice. Viral Immunol. 2016;29(8):487–93. pmid:27447349
- 19. Murray JL, McDonald NJ, Sheng J, Shaw MW, Hodge TW, Rubin DH, et al. Inhibition of influenza A virus replication by antagonism of a PI3K-AKT-mTOR pathway member identified by gene-trap insertional mutagenesis. Antivir Chem Chemother. 2012;22(5):205–15. pmid:22374988
- 20. Laplante M, Sabatini DM. mTOR signaling in growth control and disease. Cell. 2012;149(2):274–93. pmid:22500797
- 21. Ayllon J, Garcia-Sastre A. The NS1 protein: a multitasking virulence factor. Curr Top Microbiol Immunol. 2015;386:73–107. pmid:25007846
- 22. Jo EK, Kim JK, Shin DM, Sasakawa C. Molecular mechanisms regulating NLRP3 inflammasome activation. Cell Mol Immunol. 2016;13(2):148–59. pmid:26549800
- 23. Allen IC, Scull MA, Moore CB, Holl EK, McElvania-TeKippe E, Taxman DJ, et al. The NLRP3 inflammasome mediates in vivo innate immunity to influenza A virus through recognition of viral RNA. Immunity. 2009;30(4):556–65. pmid:19362020
- 24. Thomas PG, Dash P, Aldridge JR Jr., Ellebedy AH, Reynolds C, Funk AJ, et al. The intracellular sensor NLRP3 mediates key innate and healing responses to influenza A virus via the regulation of caspase-1. Immunity. 2009;30(4):566–75. pmid:19362023
- 25. Ichinohe T, Lee HK, Ogura Y, Flavell R, Iwasaki A. Inflammasome recognition of influenza virus is essential for adaptive immune responses. J Exp Med. 2009;206(1):79–87. pmid:19139171
- 26. McAuley JL, Tate MD, MacKenzie-Kludas CJ, Pinar A, Zeng W, Stutz A, et al. Activation of the NLRP3 inflammasome by IAV virulence protein PB1-F2 contributes to severe pathophysiology and disease. PLoS Pathog. 2013;9(5):e1003392. pmid:23737748
- 27. Pinar A, Dowling JK, Bitto NJ, Robertson AA, Latz E, Stewart CR, et al. PB1-F2 Peptide Derived from Avian Influenza A Virus H7N9 Induces Inflammation via Activation of the NLRP3 Inflammasome. J Biol Chem. 2017;292(3):826–36. pmid:27913620
- 28. Tate MD, Ong JD, Dowling JK, McAuley JL, Robertson AB, Latz E, et al. Reassessing the role of the NLRP3 inflammasome during pathogenic influenza A virus infection via temporal inhibition. Sci Rep. 2016;6:27912. pmid:27283237
- 29. Coates BM, Staricha KL, Ravindran N, Koch CM, Cheng Y, Davis JM, et al. Inhibition of the NOD-Like Receptor Protein 3 Inflammasome Is Protective in Juvenile Influenza A Virus Infection. Front Immunol. 2017;8:782. pmid:28740490
- 30. Couchie D, Vaisman B, Abderrazak A, Mahmood DFD, Hamza MM, Canesi F, et al. Human Plasma Thioredoxin-80 Increases With Age and in ApoE(-/-) Mice Induces Inflammation, Angiogenesis, and Atherosclerosis. Circulation. 2017;136(5):464–75. pmid:28473446
- 31. Nazir S, Gadi I, Al-Dabet MM, Elwakiel A, Kohli S, Ghosh S, et al. Cytoprotective activated protein C averts Nlrp3 inflammasome induced ischemia reperfusion injury via mTORC1 inhibition. Blood. 2017;130(24):2664–77. pmid:28882883
- 32. Moon JS, Hisata S, Park MA, DeNicola GM, Ryter SW, Nakahira K, et al. mTORC1-Induced HK1-Dependent Glycolysis Regulates NLRP3 Inflammasome Activation. Cell Rep. 2015;12(1):102–15. pmid:26119735
- 33. Harris J, Hartman M, Roche C, Zeng SG, O'Shea A, Sharp FA, et al. Autophagy controls IL-1beta secretion by targeting pro-IL-1beta for degradation. J Biol Chem. 2011;286(11):9587–97. pmid:21228274
- 34. Xue C, Wen M, Bao L, Li H, Li F, Liu M, et al. Vgamma4(+)gammadeltaT Cells Aggravate Severe H1N1 Influenza Virus Infection-Induced Acute Pulmonary Immunopathological Injury via Secreting Interleukin-17A. Front Immunol. 2017;8:1054. pmid:28912779
- 35. Short KR, Kroeze EJ, Fouchier RA, Kuiken T. Pathogenesis of influenza-induced acute respiratory distress syndrome. Lancet Infect Dis. 2014;14(1):57–69. pmid:24239327
- 36. Vogel AJ, Harris S, Marsteller N, Condon SA, Brown DM. Early cytokine dysregulation and viral replication are associated with mortality during lethal influenza infection. Viral Immunol. 2014;27(5):214–24. pmid:24787235
- 37. Herold S, Becker C, Ridge KM, Budinger GR. Influenza virus-induced lung injury: pathogenesis and implications for treatment. Eur Respir J. 2015;45(5):1463–78. pmid:25792631
- 38. Hu Y, Lou J, Mao YY, Lai TW, Liu LY, Zhu C, et al. Activation of MTOR in pulmonary epithelium promotes LPS-induced acute lung injury. Autophagy. 2016;12(12):2286–99. pmid:27658023
- 39. Lorne E, Zhao X, Zmijewski JW, Liu G, Park YJ, Tsuruta Y, et al. Participation of mammalian target of rapamycin complex 1 in Toll-like receptor 2- and 4-induced neutrophil activation and acute lung injury. Am J Respir Cell Mol Biol. 2009;41(2):237–45. pmid:19131641
- 40. Huang J, Tian R, Yang Y, Jiang R, Dai J, Tang L, et al. The SIRT1 inhibitor EX-527 suppresses mTOR activation and alleviates acute lung injury in mice with endotoxiemia. Innate Immun. 2017;23(8):678–86. pmid:28952835
- 41. Ong JD, Mansell A, Tate MD. Hero turned villain: NLRP3 inflammasome-induced inflammation during influenza A virus infection. J Leukoc Biol. 2017;101(4):863–74. pmid:27707881
- 42. Sutterwala FS, Haasken S, Cassel SL. Mechanism of NLRP3 inflammasome activation. Ann N Y Acad Sci. 2014;1319:82–95. pmid:24840700
- 43. Lietzen N, Ohman T, Rintahaka J, Julkunen I, Aittokallio T, Matikainen S, et al. Quantitative subcellular proteome and secretome profiling of influenza A virus-infected human primary macrophages. PLoS Pathog. 2011;7(5):e1001340. pmid:21589892
- 44. Ko JH, Yoon SO, Lee HJ, Oh JY. Rapamycin regulates macrophage activation by inhibiting NLRP3 inflammasome-p38 MAPK-NFkappaB pathways in autophagy- and p62-dependent manners. Oncotarget. 2017;8(25):40817–31. pmid:28489580
- 45. Pothlichet J, Meunier I, Davis BK, Ting JP, Skamene E, von Messling V, et al. Type I IFN triggers RIG-I/TLR3/NLRP3-dependent inflammasome activation in influenza A virus infected cells. PLoS Pathog. 2013;9(4):e1003256. pmid:23592984
- 46. Tzeng TC, Schattgen S, Monks B, Wang D, Cerny A, Latz E, et al. A Fluorescent Reporter Mouse for Inflammasome Assembly Demonstrates an Important Role for Cell-Bound and Free ASC Specks during In Vivo Infection. Cell Rep. 2016;16(2):571–82. pmid:27346360
- 47. Liu Q, Zhou YH, Yang ZQ. The cytokine storm of severe influenza and development of immunomodulatory therapy. Cell Mol Immunol. 2016;13(1):3–10. pmid:26189369
- 48. Zheng BJ, Chan KW, Lin YP, Zhao GY, Chan C, Zhang HJ, et al. Delayed antiviral plus immunomodulator treatment still reduces mortality in mice infected by high inoculum of influenza A/H5N1 virus. Proc Natl Acad Sci U S A. 2008;105(23):8091–6. pmid:18523003
- 49. Fukuyama S, Kawaoka Y. The pathogenesis of influenza virus infections: the contributions of virus and host factors. Curr Opin Immunol. 2011;23(4):481–6. pmid:21840185
- 50. Kuiken T, Riteau B, Fouchier RA, Rimmelzwaan GF. Pathogenesis of influenza virus infections: the good, the bad and the ugly. Curr Opin Virol. 2012;2(3):276–86. pmid:22709515
- 51. Short KR, Kroeze E, Fouchier RAM, Kuiken T. Pathogenesis of influenza-induced acute respiratory distress syndrome. Lancet Infect Dis. 2014;14(1):57–69. pmid:24239327
- 52. Brandes M, Klauschen F, Kuchen S, Germain RN. A systems analysis identifies a feedforward inflammatory circuit leading to lethal influenza infection. Cell. 2013;154(1):197–212. pmid:23827683
- 53. Iwasaki A, Pillai PS. Innate immunity to influenza virus infection. Nat Rev Immunol. 2014;14(5):315–28. pmid:24762827
- 54. Brun-Buisson C, Richard JC, Mercat A, Thiebaut AC, Brochard L. Early corticosteroids in severe influenza A/H1N1 pneumonia and acute respiratory distress syndrome. Am J Respir Crit Care Med. 2011;183(9):1200–6. pmid:21471082
- 55. Cao B, Gao H, Zhou B, Deng X, Hu C, Deng C, et al. Adjuvant Corticosteroid Treatment in Adults With Influenza A (H7N9) Viral Pneumonia. Crit Care Med. 2016;44(6):e318–28. pmid:26934144
- 56. Kim SH, Hong SB, Yun SC, Choi WI, Ahn JJ, Lee YJ, et al. Corticosteroid treatment in critically ill patients with pandemic influenza A/H1N1 2009 infection: analytic strategy using propensity scores. Am J Respir Crit Care Med. 2011;183(9):1207–14. pmid:21471084
- 57. Lee N, Chan PK, Hui DS, Rainer TH, Wong E, Choi KW, et al. Viral loads and duration of viral shedding in adult patients hospitalized with influenza. J Infect Dis. 2009;200(4):492–500. pmid:19591575
- 58. Lee N, Leo YS, Cao B, Chan PK, Kyaw WM, Uyeki TM, et al. Neuraminidase inhibitors, superinfection and corticosteroids affect survival of influenza patients. Eur Respir J. 2015;45(6):1642–52. pmid:25573405
- 59. Li H, Yang SG, Gu L, Zhang Y, Yan XX, Liang ZA, et al. Effect of low-to-moderate-dose corticosteroids on mortality of hospitalized adolescents and adults with influenza A(H1N1)pdm09 viral pneumonia. Influenza Other Respir Viruses. 2017;11(4):345–54. pmid:28464462
- 60. Weichhart T, Costantino G, Poglitsch M, Rosner M, Zeyda M, Stuhlmeier KM, et al. The TSC-mTOR signaling pathway regulates the innate inflammatory response. Immunity. 2008;29(4):565–77. pmid:18848473
- 61. San Segundo D, Fernandez-Fresnedo G, Gago M, Beares I, Ruiz-Criado J, Gonzalez M, et al. Number of peripheral blood regulatory T cells and lymphocyte activation at 3 months after conversion to mTOR inhibitor therapy. Transplant Proc. 2010;42(8):2871–3. pmid:20970555
- 62. Chi H. Regulation and function of mTOR signalling in T cell fate decisions. Nat Rev Immunol. 2012;12(5):325–38. pmid:22517423
- 63. Cordero E, Perez-Ordonez A, Aydillo TA, Torre-Cisneros J, Gavalda J, Lara R, et al. Therapy with m-TOR inhibitors decreases the response to the pandemic influenza A H1N1 vaccine in solid organ transplant recipients. Am J Transplant. 2011;11(10):2205–13. pmid:21831151
- 64. Smallwood HS, Duan S, Morfouace M, Rezinciuc S, Shulkin BL, Shelat A, et al. Targeting Metabolic Reprogramming by Influenza Infection for Therapeutic Intervention. Cell Rep. 2017;19(8):1640–53. pmid:28538182
- 65. Liu J, Cao X. Cellular and molecular regulation of innate inflammatory responses. Cell Mol Immunol. 2016;13(6):711–21. pmid:27818489
- 66. Dan HC, Cooper MJ, Cogswell PC, Duncan JA, Ting JP, Baldwin AS. Akt-dependent regulation of NF-{kappa}B is controlled by mTOR and Raptor in association with IKK. Genes Dev. 2008;22(11):1490–500. pmid:18519641
- 67. Okamoto T, Ozawa Y, Kamoshita M, Osada H, Toda E, Kurihara T, et al. The Neuroprotective Effect of Rapamycin as a Modulator of the mTOR-NF-kappaB Axis during Retinal Inflammation. PLoS One. 2016;11(1):e0146517. pmid:26771918
- 68. Hassanian SM, Dinarvand P, Smith SA, Rezaie AR. Inorganic polyphosphate elicits pro-inflammatory responses through activation of the mammalian target of rapamycin complexes 1 and 2 in vascular endothelial cells. J Thromb Haemost. 2015;13(5):860–71. pmid:25776944
- 69. Hassanian SM, Avan A, Ardeshirylajimi A. Inorganic polyphosphate: a key modulator of inflammation. J Thromb Haemost. 2017;15(2):213–8. pmid:27925683
- 70. Martinez-Cisuelo V, Gomez J, Garcia-Junceda I, Naudi A, Cabre R, Mota-Martorell N, et al. Rapamycin reverses age-related increases in mitochondrial ROS production at complex I, oxidative stress, accumulation of mtDNA fragments inside nuclear DNA, and lipofuscin level, and increases autophagy, in the liver of middle-aged mice. Exp Gerontol. 2016;83:130–8. pmid:27498120
- 71. Xu C, Wang X, Zhu Y, Dong X, Liu C, Zhang H, et al. Rapamycin ameliorates cadmium-induced activation of MAPK pathway and neuronal apoptosis by preventing mitochondrial ROS inactivation of PP2A. Neuropharmacology. 2016;105:270–84. pmid:26805420
- 72. Ichikawa A, Kuba K, Morita M, Chida S, Tezuka H, Hara H, et al. CXCL10-CXCR3 enhances the development of neutrophil-mediated fulminant lung injury of viral and nonviral origin. Am J Respir Crit Care Med. 2013;187(1):65–77. pmid:23144331
- 73. Chen WH, Toapanta FR, Shirey KA, Zhang L, Giannelou A, Page C, et al. Potential role for alternatively activated macrophages in the secondary bacterial infection during recovery from influenza. Immunol Lett. 2012;141(2):227–34. pmid:22037624
- 74. Alsuwaidi AR, George JA, Almarzooqi S, Hartwig SM, Varga SM, Souid AK. Sirolimus alters lung pathology and viral load following influenza A virus infection. Respir Res. 2017;18(1):136. pmid:28693498
- 75. Huang CT, Hung CY, Chen TC, Lin CY, Lin YC, Chang CS, et al. Rapamycin adjuvant and exacerbation of severe influenza in an experimental mouse model. Sci Rep. 2017;7(1):4136. pmid:28646236
- 76. Smith KM, Mrozek JD, Simonton SC, Bing DR, Meyers PA, Connett JE, et al. Prolonged partial liquid ventilation using conventional and high-frequency ventilatory techniques: gas exchange and lung pathology in an animal model of respiratory distress syndrome. Crit Care Med. 1997;25(11):1888–97. pmid:9366775
- 77. Zhang J, Ma M, Qin D, Huang J, Cui X, Wu Y, et al. Lung morphometry changes in prevention of airway remodeling by protocatechuic aldehyde in asthmatic mice. Int J Clin Exp Med. 2015;8(5):6890–901. pmid:26221226
- 78. Li X, Jin Q, Yao Q, Zhou Y, Zou Y, Li Z, et al. Placental Growth Factor Contributes to Liver Inflammation, Angiogenesis, Fibrosis in Mice by Promoting Hepatic Macrophage Recruitment and Activation. Front Immunol. 2017;8:801. pmid:28744285
- 79. Wu P, Han N, Yu H, Wang L, Li X, Dong Z, et al. Amelioration of salvianolic acid C on aortic structure in apolipoprotein E-deficient mice treated with angiotension II. Life Sci. 2016;166:75–81. pmid:27663582
- 80. Pizzi M. Sampling variation of the fifty percent end-point, determined by the Reed-Muench (Behrens) method. Hum Biol. 1950;22(3):151–90. pmid:14778593
- 81.
National Research Council Committee for the Update of the Guide for the C, Use of Laboratory A. The National Academies Collection: Reports funded by National Institutes of Health. In: th, editor. Guide for the Care and Use of Laboratory Animals. Washington (DC): National Academies Press (US); National Academy of Sciences.; 2011. https://doi.org/10.1258/la.2010.010031 pmid:21123303