Skip to main content
Advertisement
  • Loading metrics

Modelling how responsiveness to interferon improves interferon-free treatment of hepatitis C virus infection

  • Vishnu Venugopal,

    Roles Conceptualization, Formal analysis, Methodology, Writing – original draft

    Affiliation Department of Chemical Engineering, Indian Institute of Science, Bangalore, India

  • Pranesh Padmanabhan,

    Roles Conceptualization, Methodology, Writing – original draft, Writing – review & editing

    Affiliation Department of Chemical Engineering, Indian Institute of Science, Bangalore, India

  • Rubesh Raja,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Writing – original draft

    Affiliation Department of Chemical Engineering, Indian Institute of Science, Bangalore, India

  • Narendra M. Dixit

    Roles Conceptualization, Funding acquisition, Methodology, Supervision, Writing – review & editing

    narendra@iisc.ac.in

    Affiliations Department of Chemical Engineering, Indian Institute of Science, Bangalore, India, Centre for Biosystems Science and Engineering, Indian Institute of Science, Bangalore, India

Abstract

Direct-acting antiviral agents (DAAs) for hepatitis C treatment tend to fare better in individuals who are also likely to respond well to interferon-alpha (IFN), a surprising correlation given that DAAs target specific viral proteins whereas IFN triggers a generic antiviral immune response. Here, we posit a causal relationship between IFN-responsiveness and DAA treatment outcome. IFN-responsiveness restricts viral replication, which would prevent the growth of viral variants resistant to DAAs and improve treatment outcome. To test this hypothesis, we developed a multiscale mathematical model integrating IFN-responsiveness at the cellular level, viral kinetics and evolution leading to drug resistance at the individual level, and treatment outcome at the population level. Model predictions quantitatively captured data from over 50 clinical trials demonstrating poorer response to DAAs in previous non-responders to IFN than treatment-naïve individuals, presenting strong evidence supporting the hypothesis. Model predictions additionally described several unexplained clinical observations, viz., the percentages of infected individuals who 1) spontaneously clear HCV, 2) get chronically infected but respond to IFN-based therapy, and 3) fail IFN-based therapy but respond to DAA-based therapy, resulting in a comprehensive understanding of HCV infection and treatment. An implication of the causal relationship is that failure of DAA-based treatments may be averted by adding IFN, a strategy of potential use in settings with limited access to DAAs. A second, wider implication is that individuals with greater IFN-responsiveness would require shorter DAA-based treatment durations, presenting a basis and a promising population for response-guided therapy.

Author summary

Treatment of hepatitis C virus (HCV) infection is seeing a paradigm shift with powerful drugs called direct-acting antiviral agents (DAAs) replacing earlier treatments involving interferon (IFN). DAAs target specific HCV proteins. IFN stimulates our immune response against HCV. The two should thus work independently. Surprisingly, DAAs appear to work better in individuals who also tend to respond well to IFN. We hypothesized here that responsiveness to DAAs and IFN are causally linked. IFN can suppress viral replication, preventing the development of resistance to DAAs and improve DAA treatments. Using a new multiscale mathematical model and analysis of a vast body of clinical data, we found strong evidence supporting this hypothesis. Leveraging the causal relationship, we suggest new ways of optimizing DAA treatments, potentially improving their efficacy, tolerability, affordability and access.

Introduction

Direct-acting antiviral agents (DAAs) are revolutionizing the treatment of chronic hepatitis C virus (HCV) infection. Sustained virological response (SVR) rates of over 90% have been achieved in recent clinical trials with all-oral DAA treatments lasting as short as 12 weeks, in striking contrast to the combination of pegylated interferon and ribavirin (PR), which elicited SVR rates of only ~50% with 24–48 weeks of treatment [1, 2]. Indeed, DAAs are rapidly replacing PR as the treatment of choice for chronic HCV infection [2]. An intriguing feature of DAAs is the differential response they elicit in individuals who respond differently to PR: They seem to work better in individuals who also tend to be more responsive to PR. For instance, with the combination of the DAAs ledipasvir and sofosbuvir, SVR rates dropped from nearly 100% in treatment-naive individuals to ~87% in PR-experienced individuals infected with HCV genotype 1b [1]. This differential response appears more significant with the older generation of DAAs than the newer ones, but is evident across clinical trials and across DAAs (Table 1). Treatment guidelines for those who previously failed PR treatment are different from treatment naïve patients [3]. Interferon (IFN) acts primarily by stimulating the innate immune response to HCV [4]. Ribavirin is thought to potentiate the activity of IFN [5, 6]. DAAs, on the other hand, target specific HCV proteins, independently of host immune responses [7]. Why responsiveness to IFN should improve outcomes of DAA-based treatments is thus puzzling.

thumbnail
Table 1. Response to DAA-based treatments.

SVR rates elicited by various IFN-free and IFN-containing DAA combinations in treatment-naïve and prior null responders to PR from recent clinical trials. The treated population size is indicated in brackets. The significance of the difference in the SVR rates in the two populations is computed using the χ2 test. The HCV genotype and whether the patients had liver cirrhosis is indicated. The details of the treatment regimens along with the sources of the data are in S1 Table.

https://doi.org/10.1371/journal.pcbi.1006335.t001

Here, we hypothesized that the responsiveness of individuals to IFN and DAAs are causally linked. DAAs are susceptible to viral mutation-driven development of drug resistance [8, 9]. Resistance-associated amino acid variants (RAVs) have been identified that possess high level resistance (>1000-fold increase in EC50) to DAAs [9]. Given the rapid turnover of HCV in vivo [10] and its high mutation rate [11], RAVs are likely to pre-exist in chronically infected individuals [12] and/or arise during treatment [13], potentially lowering the efficacy of DAAs. Indeed, in retrospective analyses, RAVs were detected more frequently in individuals who failed DAA treatment than in those who achieved SVR [1]. With the combination of ledipasvir and sofosbuvir, for example, 16% of all the patients treated had detectable RAVs at baseline, whereas of those who suffered virological failure, 43% had detectable RAVs at baseline [14]. Although systematic resistance testing is not recommended, current treatment guidelines suggest resistance testing, where such testing is readily accessible and reliable, in the NS5A region to decide appropriate treatment regimens [3]. IFN, a cytokine produced in response to viral infections, triggers the expression of several hundred IFN-stimulated genes (ISGs) in infected cells, creating an antiviral state that restricts viral replication [4, 15]. Higher responsiveness to IFN may thus restrict viral replication to a greater extent, exerting better control on RAVs and leading to improved outcomes of DAA-based treatments. This causal relationship may underlie the positive correlation between responsiveness to PR and DAAs observed in clinical trials. We tested this hypothesis using mathematical modelling and analysis of clinical data.

Mathematical models of HCV kinetics have played a crucial role in our understanding of HCV infection and guided treatments [16]. A model to test the hypothesis above had to address the following questions. 1) What is the origin of the differential responsiveness of HCV-infected individuals to IFN? 2) How can the IFN-responsiveness of an individual be quantified? 3) Given the IFN-responsiveness of an individual, how does the individual respond to DAAs, assuming the hypothesized causal link above? 4) How is IFN-responsiveness distributed across individuals in a population? 5) Does this latter distribution, coupled with the predicted responses of individuals to treatments, explain the differences in SVR rates between treatment-naive and treatment-experienced populations observed across DAAs and across clinical trials?

Existing models [5, 10, 12, 1727] have addressed some but not all of these questions. For instance, IFN-responsiveness has been shown recently to be an emergent property of the IFN signaling network in HCV infected cells [17]. Due to the competing interactions between ISGs and HCV [2833], the network exhibits bistability, with one steady state responsive and the other refractory to IFN. The proportion of cells in an individual that preferentially assume the responsive state determines the IFN-responsiveness of the individual [17]. Although variations in ISG protein copy numbers and other factors across cells [25, 34] and across individuals [35, 36] and effects such as those attributed to the polymorphisms in the IL28B gene locus [37] that collectively result in different levels of IFN-responsiveness in different individuals have been identified, how IFN-responsiveness is distributed across individuals remains unknown. Inspired by the success of models in describing HIV drug resistance [38], similar models of HCV kinetics incorporating mutations and their fitness effects have been developed to estimate the pre-existing frequencies of RAVs in chronically HCV infected individuals and to predict their growth during treatment with DAAs [12, 16, 1822]. The latter models, however, do not treat IFN-responsiveness as a factor influencing the pre-existence and growth of RAVs and hence treatment outcomes. Finally, no models, barring those invoking empirical correlations [20, 39, 40], have described SVR rates elicited by different DAA-based treatment regimens.

Constructing a mathematical model to test the proposed causal relationship thus faced two broad challenges. First, phenomena spanning multiple length and time scales–from the cellular to the population level–had to be integrated into a single mathematical framework. Second, several missing pieces in the puzzle, not considered by existing models, had to be identified. We developed a model that overcame both these challenges. Model predictions captured the vast body of clinical data of the differential response of patients to DAA-based treatments quantitatively, making a strong case for the proposed causal relationship. The model additionally explained several longstanding but poorly understood clinical observations, presenting a far more comprehensive understanding of HCV infection and treatment response than earlier. Finally, using the model, we suggest new strategies, exploiting the causal relationship, to improve DAA-based treatments.

Results

Correlation between responsiveness to PR and DAAs

To establish the correlation between the responsiveness of chronically HCV infected individuals to PR and DAAs, we collated data from all (over 50) clinical trials that reported SVR rates achieved with DAA-based treatments in treatment-naïve individuals, SVRnaive, and in previous null responders to PR, SVRnull (Methods). The data are grouped according to treatment regimen and summarized in Table 1. Individual datasets are listed in S1 Table. We found that SVRnaive>SVRnull with P≈10−59 overall (using the χ2-test). The difference was starker when the analysis was restricted to treatments that included PR (P≈10−65), but, importantly, was highly significant when interferon-free regimens alone were considered (P = 0.007). The difference remained when only individuals with (S2 Table; P≈10−5) or without (S3 Table; P≈10−29) liver cirrhosis were considered or when the analysis was restricted to studies that did not factor liver cirrhosis (S4 Table; P≈10−30). The difference was clearer for treatments that elicited <100% SVR than for more recent, stronger treatments that elicited ~100% SVR regardless of treatment experience. Nonetheless, the clinical evidence of a positive correlation between responsiveness to PR and DAAs was overwhelming and suggested a causal relationship between the two. We proposed a mechanistic hypothesis underlying this relationship, where greater IFN-responsiveness exerted better control on RAVs and improved DAA treatment outcomes (see above), and constructed a mathematical model to test it.

Mathematical model

We present an overview of the model here (Fig 1). A detailed description of the various components of our model and how we integrated them into a single framework is in Methods.

thumbnail
Fig 1. Schematic of the model.

(A) Hepatocytes in an HCV infected individual display a range of phenotypic responses to IFN, from refractory (red) to responsive (blue). (B) Different individuals carry different fractions of hepatocytes displaying these distinct responses, yielding a distribution of IFN-responsiveness in an HCV infected population. Individuals with a small proportion of IFN-refractory hepatocytes respond to treatment (left inset), whereas those with a large proportion see virologic breakthrough due to the growth of drug resistant (RAV) and/or wild-type (WT) strains (right inset). (C) The threshold or admissible proportion of IFN-refractory hepatocytes depends on the drugs and treatment protocol employed and defines the SVR rate the treatment elicits in a population.

https://doi.org/10.1371/journal.pcbi.1006335.g001

To describe the response of an individual to PR, we employed the formalism we developed previously, where cells were divided into distinct IFN-responsive and IFN-refractory phenotypes based on the properties of the IFN-signaling network in HCV-infected cells [17]. At the cellular level, interferon triggers the expression of several hundred interferon-stimulated genes (ISGs) that collectively create an antiviral state in cells [15]. HCV suppresses the interferon response via multiple mechanisms [4, 41], the prominent one involving a block in ISG translation it induces via dimerization and autophosphorylation of protein kinase R [30, 42, 43]. We constructed a comprehensive model of the IFN signaling network in the presence of HCV, accounting for the competing effects above which amounted to a double negative feedback, and found that the network exhibited bistability [17]. In one steady state, HCV overcame the IFN response and established lasting infection. In the other, IFN cleared HCV. Intrinsic variations of the factors defining the IFN signaling network, which defined the strength of the IFN response relative to the strength of its subversion by HCV, resulted in individual cells admitting either one or both the states. Cells that admitted the first steady state alone were refractory to IFN. Cells that admitted the latter alone were responsive to IFN. Cells that admitted both were bistable and the state they eventually realized depended on whether they were exposed earlier to HCV or IFN.

Based on the description above, we divided cells in an individual into three distinct IFN-response phenotypes, IFN-refractory, bistable, and IFN-responsive. With this classification, we constructed a model of viral kinetics that described viral load changes in individuals following the onset of PR treatment. HCV thrived in the IFN-refractory compartment despite exposure to PR. The relative proportion of cells that were of the IFN-refractory phenotype thus quantified the IFN-responsiveness of individuals. By increasing this proportion, which decreased IFN-responsiveness, the formalism was shown to quantitatively capture the observed patterns of viral load decline, from rapid response to null response, in patients undergoing PR treatment [17].

To describe the pre-existence and growth of RAVs under DAA-based treatment, we built on previous models of viral kinetics and evolution [12, 16, 1822], which have provided good fits to patient data of wild-type and RAV population dynamics [12, 16]. The models allowed mutations, which occurred during viral replication, at specific loci to confer resistance to DAAs. The mutations, however, came with fitness costs. The models could thus predict the pre-existing frequencies of RAVs and their growth rates during treatment with DAAs. We combined the models above by integrating the distinct cellular phenotypes with viral kinetics and evolution to arrive at a description of the response of an individual to DAA-based treatments and the influence IFN has on the response. The poorer the IFN-responsiveness of an individual, the greater the level of ongoing replication during treatment, and hence the higher the likelihood of the development of resistance to DAAs. The combined model thus yielded threshold levels of IFN-responsiveness required for treatments to succeed.

We next developed independent descriptions of the distribution of IFN-responsiveness in populations. We showed that the pre-treatment set-point viral load was directly related to the IFN-responsiveness of an individual, allowing us to quantify the distribution of IFN-responsiveness using measurements of viral load in populations. The fraction of individuals with IFN-responsiveness above the threshold IFN-responsiveness predicted above for any treatment yielded the SVR rates elicited by that treatment. In particular, the threshold for a null response to PR yielded the percentage of null responders and hence, truncating the distribution above to the latter threshold, the distribution of IFN-responsiveness in null responders to PR. Linking the distribution of IFN-responsiveness in populations to the individual-level models of viral kinetics and treatment response thus allowed estimation of SVR rates across different populations, particularly treatment naïve and previous null responders to PR, elicited by different treatment regimens.

Pre-treatment RAV frequencies

We applied the model first to examine whether greater IFN-responsiveness lowered the pre-existence of RAVs in infected individuals (Fig 2). We quantified the IFN-responsiveness of an individual by the fraction of target cells produced in the individual that exhibited the IFN-refractory phenotype [17], denoted . The smaller the value of , the more IFN-responsive was the individual. Using our model, we estimated the steady state pre-treatment populations of wild-type and RAV-carrying virions, V0 and V1, respectively, and the frequency, ρ1 = V1/(V0+V1), of RAVs, as functions of (Eqs (1)–(4), Methods). A single point mutation was assumed first to confer resistance to the DAA. Mutation occurred at the rate μ and allowed the production of V1 from cells infected with V0. The mutations came with a fitness cost to the virus, determined by lower values of viral infectivity and/or productivity, γ, relative to the wild-type. We found that ρ1 was independent of (Fig 2A). As increased, fewer cells were IFN-responsive, which resulted in an increase in V1 (Fig 2C). However, of the virions produced (Fig 2B and 2C), a constant fraction, determined by the mutation rate, μ, and the relative fitness of the RAV, γ, carried the RAV, leaving ρ1 unaffected. Further, both V1 and ρ1 but not V0 increased significantly with μ and γ (Fig 2A–2C). We derived analytical approximations (S1 Text) that quantitatively explained these variations (Fig 2A–2C). The results were readily extended to multiple loci (S2 and S3 Texts; Fig 2D–2G).

thumbnail
Fig 2. Pre-treatment frequencies and populations of virions.

Model predictions (lines) and analytical approximations (symbols) (S1S3 Texts) of the mutant frequencies (left) and viral populations (right) in the pre-treatment steady state as a function of the level of IFN-responsiveness, , for different combinations of the mutation rate, μ, and the relative fitness of the RAV, γ: (μ,γ) = (3×10−4,0.9) (blue), (3×10−4,0.8) (red), (3×10−4,0.7) (green) and (3×10−5,0.8) (black). Here, γ = p1/p0, the ratio of the viral production rates, or equivalently the replicative abilities, of the mutant and wild-type strains; without loss of generality, the RAV was assumed not to compromise viral infectivity (see S1S3 Texts). Single mutant frequencies (A) and the populations of wild-type (B) and single mutant (C) virions when the genetic barrier is 1. Double mutant frequencies (D) and the populations of wild-type (E), single mutant (F), and double mutant (G) virions when the genetic barrier is 2. In the latter case, the two single mutants have the same relative fitness, γ, and the double mutant, γ2. In (B) and (E), the different lines and symbols are indistinguishable. Parameter values employed are in S5 Table. The parameters to which these predictions are sensitive are as expected from the analytical approximations (S1 Fig).

https://doi.org/10.1371/journal.pcbi.1006335.g002

Thus, greater IFN-responsiveness did not significantly alter the pre-treatment frequencies of RAVs, although it did lead to lower pre-treatment viral loads and populations of RAVs, indicating greater control over ongoing viral replication. This greater control could influence the growth of RAVs during treatment with DAAs, which we examined next.

Growth of RAVs during IFN-free treatment

We predicted the viral load decline under DAA treatment for a range of treatment efficacies against the wild-type, , and the RAV, , and for different fitness penalties, γ, associated with the RAV (Eqs (1)–(4), Methods). We defined the effective relative fitness of the RAV during treatment as , combining the intrinsic fitness disadvantage of the RAV and its advantage in the presence of the drug. We defined as the IFN-responsiveness during treatment. depended on the total IFN exposure, the sum of endogenous and exogenous levels [17]. For IFN-free treatments, where exogenous IFN is absent, we let (Methods). We found that the response to treatment was determined predominantly by , and γt (Fig 3). With high , the wild-type could be cleared by the DAA regardless of . Then, for any γt, the decline of the RAVs was faster for lower . Below a critical value of , SVR was achieved, whereas above this critical value, virological breakthrough occurred (Fig 3A and 3C). Similarly, for a fixed , RAVs declined faster for lower γt (Fig 3A and 3B). A locus of points on a plot delineated the region where SVR occurred from that where virological failure resulted due to drug resistance (Fig 3A). For lower , breakthrough occurred at higher γt, indicating that higher degrees of resistance were necessary for virological breakthrough with higher IFN-responsiveness.

thumbnail
Fig 3. Response to IFN-free DAA treatment.

(A) Phase diagram indicating regimes of the level of IFN-responsiveness, , and the relative fitness of the RAV during treatment, γt, that lead to SVR (dark blue) or treatment failure due to virological breakthrough by the RAV (light blue). (B,C) Dynamics of wild-type (solid) and RAV (dashed) viral populations following treatment initiation for different parameter combinations numbered in (A). Here, the efficacy of treatment against the wild-type is assumed to be high: . Also, γ = 0.2. (D) Phase diagram with lower efficacy, , showing regions leading to SVR (dark blue) or treatment failure due to the RAV (light blue), wild-type (green), or both (brown). (E,F) Dynamics of wild-type (solid) and RAV (dashed) viral populations for the points numbered in (D). Here, γ = 0.4. Other parameter values employed are in S5 Table. Phase diagrams for other values of are in S2 Fig.

https://doi.org/10.1371/journal.pcbi.1006335.g003

With lower , the DAA was not potent enough to suppress the wild-type at all . With large and γt small (<1), the wild-type drove failure (Fig 3D and 3F). The value of above which failure occurred decreased as decreased, indicating that failure occurred even with higher IFN-responsiveness as the DAA efficacy dropped (Fig 3A and 3D). Conversely, poorer IFN-responsiveness placed more stringent demands on the DAA. As γt increased, both the wild-type and RAV co-existed during treatment failure and when γt rose above ~1, the RAV outcompeted the wild-type and drove treatment failure (Fig 3D and 3E).

Growth of RAVs during PR+DAA treatment

With exogenous IFN present, . We therefore let and (Fig 4). For fixed , γt and , RAVs declined faster for lower (Fig 4B). Again, a threshold existed below which SVR was achieved and above which RAVs drove virological breakthrough when was high (Fig 4A). This threshold was weakly sensitive to because pre-treatment variations were rapidly subsumed post treatment initiation by the dynamics dictated by (Fig 4B). The threshold, however, was sensitive to γt. As γt increased, the threshold dropped, indicating that treatment failure occurred even with higher IFN-responsiveness as the RAVs became more fit (Fig 4C and 4D). Similarly, as decreased, failure occurred at lower , indicating again that poorer IFN-responsiveness contributed to the failure of DAAs (Fig 4E and 4F). Further, as γt increased from <<1 to >>1, failure occurred first due to the wild-type, then the combination of wild-type and RAVs, and finally due to the RAVs alone (Fig 4G and 4H).

thumbnail
Fig 4. Response to PR+DAA treatment.

(A) Phase diagram indicating regimes of IFN-responsiveness pre- and during treatment, and , leading to SVR (dark blue) and treatment failure due to virological breakthrough by the RAV (light blue) for a fixed relative fitness of the RAV during treatment, γt. (B) Dynamics of wild-type (solid) and RAV (dashed) viral populations following treatment initiation for parameter combinations numbered in (A). (C) Phase diagram on a plot for fixed . (D) Dynamics for the points numbered in (C). In (A)-(D), the DAA efficacy against the wild-type, . Also, γ = 0.4. (E)-(H) Corresponding predictions with . In (E) and (G), treatment failure occurred due to the RAV (light blue), wild-type (green), or both (brown). Here, γ = 0.2. Other parameter values employed are in S5 Table. Phase diagrams for other values of are in S3 Fig.

https://doi.org/10.1371/journal.pcbi.1006335.g004

Thus, with DAA-based treatment, with or without PR, IFN-responsiveness controlled the growth of RAVs and contributed to treatment success. We examined next the implications of these findings at the population level. For this, we first estimated the distribution of IFN-responsiveness across individuals.

Distribution of IFN-responsiveness in patient populations

We recognized that was linked directly to the chronic set-point viral load in our model (Methods; Eq. (S1.10)). The set-point viral load has been found to be log-normally distributed in chronically-infected individuals [44]. We therefore let also be log-normally distributed (Eq (5); Fig 5A). Chronic infection was only possible in our model when was larger than a threshold, . When , the set-point viral load was zero, marking spontaneous clearance of infection. Using representative model parameter values, we solved our model (Eqs (1)–(4), Methods) using different values of and identified as the maximum value of for which the set-point viral load vanished. We thus obtained . We next fit a truncated log-normal distribution for (Eq (6), Fig 5B) to patient data of the distribution of set-point viral load and identified parameter values defining the log-normal distribution of in a treatment-naïve population (Fig 5D, inset).

thumbnail
Fig 5. Distribution of IFN-responsiveness across patients and SVR rates to DAA-based treatments.

(A) The log-normal probability density of the level of IFN-responsiveness, , across individuals. The values of below which we observe spontaneous clearance, , and below which the DAA would elicit SVR either alone, , or with PR, , are indicated. above which PR would elicit a null response, ϕnull, is also indicated. The resulting probability density of in (B) treatment-naïve patients and (C) prior null responders to PR. (D) Comparisons of our model predictions (lines) of SVR rates in treatment-naive versus prior null responders to PR with corresponding observations from clinical trials involving IFN-free DAA regimens (open symbols) or PR+DAA combinations (filled symbols). Studies either distinguished individuals with (red) and without (blue) liver cirrhosis or not (black). The clinical data is collated in Tables 1 and S1. Model predictions (Eqs (1)–(13), Methods) with (orange) and without (green) PR overlap. The best-fit (black solid) along with 95% CI (black dashed) of Eq (18) to the data where cirrhosis is not distinguished (collated in S4 Table) is shown. Inset: The log-normal probability density of in treatment-naïve individuals (line) fit to data of baseline viral loads from patients (symbols). The best-fit parameters were ν = −2.775 and σ = 1.027 (Methods).

https://doi.org/10.1371/journal.pcbi.1006335.g005

With the resulting distribution, we estimated the percentage of individuals with (Eq (8)), i.e., the fraction of infected individuals who spontaneously clear the infection, and found it to be ~21%, close to the mean of ~26% obtained from 31 longitudinal studies [45].

We next considered null responders to PR, defined by . To estimate ϕnull, we employed clinical data of telaprevir-based treatments. Using parameter values similar to previous estimates [12, 46], , , and γ = 0.4, we applied our model (Eqs (1)–(4)) and estimated as the value of below which telaprevir monotherapy would elicit SVR (Methods). (Note that telaprevir monotherapy can induce SVR [47].) We next estimated , the value of below which PR+telaprevir triple therapy would yield SVR, by comparing model predictions of SVR rates in treatment-naïve patients (Eq (9)) with corresponding clinical data [48], . Given the distribution of , the value of below which a defined percentage of the population lies can be calculated. Thus, the value of below which of the population lies yielded . This implied was the increase in IFN-responsiveness due to exogenous IFN administered as part of PR treatment. With this Δϕ, we could estimate for any , allowing us to use our model (Eqs (1)–(4)) to predict the response to PR-containing regimens. In particular, we could predict the response to PR. Solving our model, we thus identified ϕnull as the minimum that yielded a null response to PR, defined as having occurred when <2 log10 decline in viral load resulted from 12 weeks of treatment. We found that ϕnull = 0.12±0.01 (Eqs (1)–(4), Methods). Truncating the distribution of to values of above ϕnull yielded the distribution of in null responders to PR (Eq (7), Fig 5C).

With these estimates, we predicted the percentage of null responders to PR in a treatment-naïve population as the fraction of the population with above ϕnull (Eq (11)) and found , which was in close agreement with corresponding clinical observations of 32% [49]. Further, we predicted the response of null responders to PR+telaprevir triple therapy (Eq (13)) as the fraction of null responders with below estimated above, and found , again in good agreement with the 32% observed experimentally [48].

This quantitative agreement of our model with independent observations gave us confidence in our model and our estimates of the distribution of IFN-responsiveness. In addition, that the same Δϕ captured the observed influence of PR with and without telaprevir implied that the proposed synergy between IFN and DAAs [17, 50, 51] may be small in vivo. We next predicted the response of different patient subpopulations to DAA-based treatments.

SVR rates elicited by DAA-based treatments

Using the distributions of IFN-responsiveness identified above, we applied our model (Eqs (1)–(13), Methods) to predict SVR rates elicited by DAA-based treatments. We varied parameters to mimic the entire spectrum of accessible DAA efficacies and relative fitness values of RAVs. We found that SVRnull was consistently lower than SVRnaive (Fig 5D). Further, our predictions were in good agreement with clinical data (Fig 5D; Table 1). The predictions employed some parameters estimated above from telaprevir-based therapy. We derived an analytical expression linking SVRnaive and SVRnull that was independent of the DAA and of whether PR was part of the treatment (Eq (18), Methods): . The expression too fit the clinical data well and the fit was close to our predictions above (Fig 5D). The best-fit estimate of was in agreement with the corresponding clinical estimate [49] of 32%. Further, the latter expression explained more vividly the diminishing difference between SVRnaive and SVRnull as treatment became more potent. It showed that when SVRnaive approached 100%, so did SVRnull, in agreement with observations from recent trials where nearly all patients were cured regardless of their treatment experience (Table 1).

This agreement between our predictions, in two ways, and clinical data demonstrating SVRnullSVRnaive presents strong evidence supporting our hypothesis of the causal relationship between IFN-responsiveness and the success of DAA-based treatments. We examined ways of exploiting this relationship to improve treatments.

Potential strategies to improve DAA-based treatments

IFN-responsiveness could be exploited to improve DAA-based treatments in two ways: 1) to prevent failure and 2) to shorten the treatment duration (Fig 6). IFN-free treatment would fail in an individual if in the individual were larger than a threshold. Adding PR would lower by Δϕ. Δϕ is expected to be different for individuals with (denoted Δϕc) and without (denoted Δϕnc) liver cirrhosis. We fit the analytical expression above (Eq (18)) to SVR data on populations with and without liver cirrhosis separately (Fig 6A and 6B) and estimated Δϕc = 0.046 and Δϕnc = 0.091 (Methods). PR thus appeared only half as effective in improving IFN-responsiveness in cirrhotic individuals as non-cirrhotic individuals. Adding PR would thus induce SVR if the individual had a cirrhotic (non-cirrhotic) liver and the were within Δϕcϕnc) of the threshold (Fig 6C, 6D, 6E and 6G). If were farther away from the threshold, adding PR alone would prove inadequate (Fig 6D, 6F and 6H). Increasing the DAA dosage or including additional DAAs to lower the effective fitness of the RAV may then be a way to induce SVR (Fig 6C–6G). Of course, adding PR may require a smaller increase in the DAA dosage, rendering the DAA more tolerable.

thumbnail
Fig 6. Strategies to overcome DAA failure.

The best-fit (solid line) and 95% CIs (dashed lines) of Eq (18) (Methods) to data (symbols) of SVR rates in treatment-naïve versus treatment-experienced patients (A) without liver cirrhosis and (B) with liver cirrhosis, treated with DAAs with (filled) or without (open) PR. The list of clinical trials from which data has been collated is presented in S2 and S3 Tables, respectively. The fits yielded and 33±14% in the two subpopulations, respectively, and using which, we estimated the corresponding ϕnull = 0.07 and 0.12. (C) Regions in the phase diagram (see Fig 2A) where addition of PR to the DAA would elicit cure in otherwise failing patients with (orange) or without (orange and red) liver cirrhosis. SVR would be elicited in the dark blue region of the phase diagram. (D) The yellow box in (C) zoomed to demonstrate the influence of adding PR to an individual with a cirrhotic (small white arrow) or a non-cirrhotic (large white arrow) liver, adding a new DAA or increasing DAA dosage (yellow arrow), or adding PR and a new DAA (green arrow). (E-H) Dynamics of wild-type (solid) and RAV (dashed) viral populations following treatment initiation for the different conditions marked in (D). (I) The duration of treatment in weeks required to achieve SVR for a range of values of IFN-responsiveness, , and the relative fitness of the RAV, γt. (J) Dynamics of wild-type (solid) and RAV (dashed) viral populations following treatment initiation for the different conditions marked in (I), corresponding to daclatasvir treatment (Methods). Inset: The percentage of patients predicted to achieve SVR as a function of the duration of treatment with daclatasvir. The percentages corresponding to the conditions marked in (I) are indicated. Thus, 19.2%, 46% and 60.6% SVR rates are expected in 8, 10, and 12 weeks of treatment, respectively.

https://doi.org/10.1371/journal.pcbi.1006335.g006

Even where DAA-based treatment is likely to succeed, greater IFN-responsiveness would induce faster viral load decline and allow shorter treatment durations (Fig 6I and 6J). Using parameters representative of daclatasvir (Methods), we found that as decreased from ~0.1 to ~0.04, the treatment duration required for SVR dropped from ~12 weeks to ~8 weeks (Fig 6I and 6J). Although daclatasvir is not recommended for use as monotherapy, we use it here for illustration and because the NS5A region, the target of daclatasvir, is the one region where resistance testing may decide the choice of regimen [3]. Thus, individuals highly responsive to IFN present promising candidates for reducing DAA treatment durations. Indeed, we estimated that ~50% of the individuals treated with daclatasvir would achieve SVR in ~10 weeks and ~20% in ~8 weeks, durations expected to decrease further with DAA combinations, presenting a basis and a novel avenue for response-guided treatment.

Discussion

DAAs, with >90% SVR rates in clinical trials, are bringing hope to the millions of chronically HCV infected individuals worldwide. In the present study, we elucidated a hypothesis underlying the unexpected positive correlation between the response elicited by DAAs and PR, which explains several confounding clinical observations and presents new potential avenues to improve DAA-based treatments. The hypothesis is that greater IFN-responsiveness restricts the replication space available for the virus, inhibiting the development of resistance to DAAs and improving treatment response. We developed a novel multiscale mathematical model to test this hypothesis. Analysis of a large body of clinical data using the model presented evidence in strong support of the hypothesis. The resulting causal relationship between responsiveness to PR and DAAs implied that increased responsiveness to PR could be exploited to prevent DAA failure and/or shorten the treatment duration, potentially positively impacting treatment response, tolerability, affordability and access.

Despite the high SVR rates they elicit, access to DAA-based treatments has seen limited so far; <1.3% of the ~150 million chronically HCV infected individuals are estimated to have received DAA-based treatment, with the proportion far smaller in resource-limited settings [52, 53]. To improve affordability and access, DAA-based treatments that would exert the most potent antiviral activity and/or patient subpopulations that would require the shortest durations are keenly being sought [5459]. Our study informs these efforts by presenting new avenues to optimize DAA-based treatments. The standard strategy to avert DAA failure is to increase the genetic barrier to resistance by including more DAAs in the drug cocktail [12, 54]. In a recent set of studies, for instance, numerous DAA combinations were evaluated preclinically to identify the “best” candidates for clinical development and 3 DAA combinations were found to be more potent than 2 DAA combinations [5456]. We suggest that an alternative strategy may often be feasible: improving IFN-responsiveness by adding IFN (or PR). Where additional DAAs remain inaccessible, especially in resource-limited settings, such a strategy may be useful. A previous modeling study also found that the efficacy of combining PR with a DAA significantly improved the treatment efficacy against DAA-resistant strains compared to the DAA alone [12]. Furthermore, our study quantified the gain in IFN-responsiveness due to standard PR dosage in patients with and without liver cirrhosis, representing a key potential step in personalizing the strategy. Response-guided treatment (RGT) is being considered now to define reduced treatment durations for select populations [27, 57, 58, 60, 61]. For instance, in a recent study, patients who achieved an ultra-rapid early viral load decline (plasma HCV RNA <500 copies/mL by day 2) were found to be cured with just 3 weeks of treatment [57]. Our prediction that individuals with high IFN-responsiveness are amenable to shorter treatment durations presents a much sought-after basis and a promising candidate population for reducing treatment durations, informing ongoing efforts to develop RGT protocols.

Personalizing treatment based on the avenues above requires estimation of the level of IFN-responsiveness of individuals. For a treatment-experienced individual, this may be achieved through analysis of viral load changes recorded during the previous PR treatment [17]. For a treatment-naive individual, short-term PR exposure and subsequent measurements of viral load may be necessary. Viral load changes as early as 24 h following the start of PR treatment have been argued to be good indicators of eventual response [62, 63]. Previous modeling studies have suggested a lead-in period of PR to assess the level of ongoing viral replication and the responsiveness to PR in order to decide optimal treatments [12, 64]. Developing such indicators to quantify the level of IFN-responsiveness, a promising future research direction based on our present study, would allow personalizing the course of DAA treatments also for treatment-naive individuals. Further, a correlation between IFN-responsiveness and the duration of DAA-based treatment required to achieve SVR would present a direct clinical test of our hypothesis.

Recent studies present further evidence in support of our hypothesis. In a study involving 240 chronic HCV patients treated with sofosbuvir and either daclatasvir or simeprevir for 12 weeks, slow responders, defined as those with detectable viremia at week 12, had a much higher representation of treatment (PR)-experienced patients than the overall population, viz., 82% versus 68%, indicating that IFN-free DAA treatments elicited slower viral load declines in individuals with poorer IFN-responsiveness [65]. Another study involving 216 patients treated with sofosbuvir and either daclatasvir or ledipasvir for 12 weeks found that baseline RAVs and treatment experience did not influence SVR in patients without cirrhosis but had a significant influence in patients with cirrhosis [66]. In yet another study [13], 6 of the 8 patients treated with daclatasvir and PR achieved SVR, of which 4 had RAVs detected pre-treatment, but had favourable IL28B genotypes (TT/GT) [37] and were treatment-naive or partial responders to prior IFN therapy. The 2 who failed treatment had unfavorable/partially favorable IL28B genotypes (GG/GT) and were null responders to prior IFN therapy. They experienced virological breakthrough due to the growth of RAVs although the RAVs were not detected pre-treatment. Earlier studies with the first generation DAAs provide further evidence. In a pooled study involving a large number of patients treated with boceprevir and PR, SVR rates were 78% and 76% in IFN-responders with and without baseline RAVs, respectively, whereas in poor IFN-responders, the corresponding SVR rates were 22% and 37% [67]. Similarly, with telaprevir, on-treatment virological failure rates were 1% in previous relapsers to PR, 19% in previous partial responders to PR, and 52% in previous null responders to PR [68]. Thus, in all the above cases, treatment failure was due to drug resistance, which did not depend on the pre-existence of RAVs but was facilitated by poor IFN-responsiveness. Conversely, strong IFN responses appeared to prevent the growth of RAVs and avert treatment failure. These findings are consistent with our model predictions.

Our study makes key advances in our understanding of HCV infection and treatment. To test the hypothesized causal relationship between responsiveness to IFN and DAAs, we had to construct a model that integrated phenomena across multiple length and time scales, starting from the cellular to the population level. Responsiveness to IFN manifests at the cellular level, defining the fraction of cells that can be rid of HCV by IFN. The consequence at the level of an infected individual is in restricting viral replication and evolution and hence improving responsiveness to DAAs. At the population level, this effect, given the distribution of IFN-responsiveness, determines SVR rates. Integration of phenomena across these scales into a single mathematical framework had not been accomplished thus far. Our model, by doing so, was able to capture the implications of variations at the cellular level, due to drugs, for instance, for the population-level treatment response. This allowed us to describe many clinical observations of which several had long remained unexplained, viz., 1) the percentage of infected individuals who spontaneously clear HCV, 2) the percentage of chronically infected individuals who exhibit a null response to PR, 3) the percentage of null responders to PR who respond to triple therapy with PR and a DAA such as telaprevir, and 4) the relationship between SVR rates in treatment-naive and treatment-experienced patients elicited by different treatments. A far more comprehensive view of HCV infection and treatment than earlier thus emerges.

The model we developed is complex. Yet, we only considered phenomena essential to establishing the causal relationship between IFN-responsiveness and DAA-based treatment outcomes. We thus ignored alternative mechanisms of DAA action [23, 69], specific intracellular viral replication events [11, 24], modes of synergy between IFN and DAAs [17, 51], and factors such as race, gender, viral genotype, and IL28B polymorphisms [1]. Furthermore, we did not estimate the IFN-responsiveness of an individual a priori. The key components of the IFN signaling network in cells have been identified [28], but variations in their levels and interactions across cells in an individual, which would determine the fraction of cells responsive to IFN, remain to be established. Finally, we assumed SVR to have been achieved when the viral load dropped below the “cure boundary” of 1 virion in the ~15 liters of fluid volume in an individual [5, 16]. With the new DAA combinations, some individuals with detectable viremia at the end of treatment have been found recently to achieve SVR [70]. The origins of this intriguing phenomenon, which may lead to the definition of a new cure boundary, remain poorly elucidated [7173]. By employing the “stricter” cure boundary, our model yields conservative estimates of SVR rates.

Methods

Mathematical model

IFN-responsiveness and viral kinetics in an individual undergoing DAA-based treatment.

We considered an individual chronically infected with HCV, subjected to a DAA-based treatment regimen. We constructed the following equations to describe the viral kinetics in the individual following the start of treatment when a single point mutation was adequate to confer resistance to the DAA: (1) (2) (3) (4)

Here, we classified uninfected target cells into 3 categories, denoted Ti with iϵ{1,2,3}, based on the properties of the IFN signalling network in cells we identified earlier [17] (see Results). Broadly, IFN induces the expression of ISGs that suppress HCV, whereas HCV subverts the IFN response by blocking ISG translation. The resulting network, with the double negative feedback, exhibits bistability, i.e., two stable steady states, with HCV thriving in one and cleared by IFN in the other. The steady states define the 3 cell categories based on their IFN response phenotypes. Cells T1 admitted the first steady state alone and were refractory to IFN. IFN would prevent neither the infection of T1 nor viral production from them following their infection. Cells T2 admitted both the steady states and were bistable. Such cells are driven to the IFN-refractory state following their infection if the HCV RNA level crosses a threshold before exposure to IFN [17, 30]. Else, they are driven to the IFN-responsive state. Thus, as an approximation, we assumed that IFN would prevent infection of T2 if they were exposed to IFN before the virus, but fail to prevent viral production from such cells once infected. Cells T3 admitted the second steady state alone and were sensitive to IFN. IFN would thus prevent infection of T3 and if infected block viral production from such cells.

s was the production rate of target cells, and ϕi was the fraction of the cells produced that was of type Ti. In the absence of infection and when cell proliferation is small, ϕi equals the fraction of the target cells that is of type Ti. ϕ1 was thus the fraction of cells refractory to IFN and quantified the level of IFN-responsiveness of an individual. Lower values of ϕ1 represented greater IFN-responsiveness. We set pre-treatment and during IFN-free treatment and during IFN-containing treatment. The cells died with the rate constant dT. The cells were also lost due to infection by free virions.

V0 and V1 were the wild-type and RAV viral populations, respectively. When a cell Ti was infected by a virion Vj, it gave rise to an infected cell of the type . The infectivity of the virions Vj was denoted βj. Further, successful infection of the cell Ti was blocked by IFN with efficacy ηi. From the description above, it followed that η1 = 0 and η2 = η3 = 1. Target cells and infected cells proliferated with rate constants rT and rI, respectively, constrained by a logistic term with carrying capacity Tmax. N represented the population of target cells not susceptible to infection, due, for instance, to the lack of adequate entry receptors [74]. Infected cells were lost with the rate constant δ.

pj represented the per cell production rate of virions from cells . IFN constrained this production with effectiveness εi, dependent on the cell phenotype. Again, from the description above, ε1 = ε2 = 0 and ε3 = 1.

DAAs limited viral production from all cells with effectiveness , dependent on the viral variant. Mutations arose randomly and compromised DAA activity. The mutations came with a fitness cost to the virus, determined here by lower values of βj and/or pj. Specifically, mutation at the rate μ allowed the production of V1 from cells , infected with V0. We ignored back mutation of V1 to V0 (e.g., see [12, 22, 75]). Free virions were cleared with the rate constant c.

A generalization of the formalism to multiple resistance loci is presented in S2 Text.

Distribution of IFN-responsiveness across treatment-naive and -experienced individuals.

We assumed that was log-normally distributed with parameters ν and σ across individuals in a treatment-naive HCV-infected population. The density function for was thus (5) where ensured that .

When (Eq. (S1.10)), the model above (Eqs (1)–(4)) resulted in vanishing set-point viral load pre-treatment, potentially representing individuals who spontaneously clear HCV [17, 45]. The distribution of in chronically infected, treatment-naive individuals thus became the truncated log-normal, (6)

We denoted by ϕnull the value of above which PR treatment elicited a null response. Null response, or non-response, was defined as having occurred when <2 log10 decline in viral load resulted from 12 weeks of treatment. Given ϕnull, the density function of in null responders, (7)

Rates of spontaneous clearance, null response, and SVR in populations.

The fraction, CL, of HCV infected individuals who spontaneously clear the infection would include all those with ; i.e., (8)

We defined as the highest value of for which a treatment-naive individual would achieve SVR when subjected to a particular IFN-free DAA regimen. SVR was defined as achieved when the viral load reached a value <1 virion in the 15 liters of fluid volume in an individual by the end of treatment [5, 16]. The fraction of the population treated with the regimen that would achieve SVR, which we called , would therefore be (9)

Similarly, if was the highest value of for which SVR was achieved with the above DAA regimen combined with PR, the fraction of a treatment-naive population that would achieve SVR with this combination would be (10) The fraction of a treatment-naive population that would exhibit a null response to PR, denoted , would be (11) Of the prior null responders to PR, the fraction that would respond to the above DAA would be (12) and, finally, to the PR+DAA combination would be (13)

The distributions and threshold values of and the linkage between individual- and population-level models.

We identified the various threshold values of mentioned above as follows. We first solved our viral dynamics model (Eqs (1)–(4)) using parameter values listed in S5 Table and identified . Next, we recognized that the baseline viral load when is (see Eq. (S1.10) in S1 Text and the parameter estimates in S5 Table), which has the maximum, when . It followed that . We therefore fit Eq (6) to the reported distribution of V/Vmax values [44] and obtained ν and σ.

For any DAA, can be estimated by solving Eqs (1)–(4) for different values of and with corresponding to the effectiveness of the DAA against wild-type and RAV strains, and identifying the maximum value of for which SVR is achieved. For IFN-containing regimens, Eqs (1)–(4) cannot be solved to obtain because the relationship between when is not known a priori. We therefore employed population-level observations of for telaprevir [48] and solved Eq (8) for . This yielded an estimate of for telaprevir. Because the dynamics during treatment is dictated essentially by (see Results), it followed that when , defining the threshold for SVR. Δϕ is therefore a measure of the increase in IFN-responsiveness due to the addition of IFN as part of PR treatment. Further, because synergy between telaprevir and PR appears small (see Results), Δϕ represents the increase in IFN-responsiveness brought about independently by PR.

We validated the resulting estimate of Δϕ as follows. Δϕ would depend on the extent of increase in the IFN concentration above the endogenous level because of treatment. For standard PR dosage, Δϕ may thus be assumed to apply across individuals. (We recognized that this assumption would fail when is small and where the influence of IFN is expected to saturate. A small , however, would amount to an already IFN-sensitive individual and to whom addition of PR is likely to be unnecessary.) Δϕ may differ between individuals with cirrhotic and non-cirrhotic livers, which we address below. Using the above estimate of Δϕ, we solved Eqs (1)–(4) for different values of and and identified ϕnull as the lowest that yielded a null response. With the resulting value of ϕnull, we estimated using Eq (11) and using Eq (13) and compared the estimates with observations [48, 49].

With the distributions and all the threshold values of thus identified, Eqs (1)–(13) presented a model that could predict the outcomes of DAA-based treatments at the individual and the population level.

Solution of model equations

Viral kinetics.

In our model, DAAs are distinguished by their efficacies, , against sensitive and resistant strains as well as the relative fitness of the respective RAVs, defined by γ. To describe the scenario pre-treatment in different individuals, we set and solved Eqs (1)–(4) for steady state to obtain the set point viral load and the frequencies and populations of RAVs as functions of . We also derived analytical approximations of these steady state quantities (S1 Text). Using the above steady state as the initial condition, we solved Eqs (1)–(4) with and to describe viral load changes following the onset of IFN-free DAA-based treatment. For IFN-containing regimens, we followed the same procedure but with .

Parameter estimates and sensitivity.

Model equations were solved using parameter values representative of HCV infection in vivo, listed in S5 Table. Sensitivity of model predictions to parameter values was tested by computing the partial rank correlation coefficients (PRCC) [76].

SVR rates.

For given values of and γ, representing a particular DAA or DAA combination, Eqs (1)–(13) were solved to obtain estimates of SVR rates in treatment-naïve and treatment-experienced patients. The values of and γ have not been characterized for most DAAs. γ and the ratio , however, must lie between 0 and 1 for all DAAs. We therefore varied each of these quantities over the entire range of values from 0 to 1 and computed SVR rates, where each combination of these parameter values would represent a different DAA-based treatment. For each combination, we first estimated by solving Eqs (1)–(4). Next, using Δϕ obtained above, we estimated . All the other model parameters and quantities remained independent of the DAAs. Using Eqs (5)–(13), we estimated SVRs in treatment-naïve and treatment-experienced individuals. Repeating this with other parameter combinations yielded a relationship between SVR rates in the two patient populations, which we compared with clinical data. We also derived an analytical expression for the latter relationship below.

The numerical solutions were implemented in MATLAB.

Relationship between SVR rates in treatment-naïve and treatment-experienced patients

We let SVRnaive and SVRnull be the response to any given DAA-based treatment in a treatment-naïve and a previous null responder population, respectively. We derived an analytical expression linking SVRnaive and SVRnull as follows. From our model above, it followed that (14) and (15) Using the relationship between and (Eq (7)) in Eq (15) yielded (16) where is defined in Eq (11). We next rearranged the integral in Eq (16) as (17) and obtained upon combining with Eq (16) and rearranging, (18)

We fit the expression above to clinical data using the NLINFIT algorithm in MATLAB.

Data from clinical trials

We examined reports of all clinical trials with DAA-based treatments and considered those treatments for which SVR data on both treatment-naïve and treatment-experienced individuals was available. The resulting data is summarized in Table 1 and S1 Table. We also classified the patient populations into categories with and without liver cirrhosis. We performed statistical tests to ascertain the difference in the SVR rates between treatment-naïve and treatment-experienced individuals for specific treatments as well as when data for all the treatments considered were combined. We compared the predictions above of SVR rates with the data from clinical trials.

IFN-responsiveness of cirrhotic and non-cirrhotic patients

Next, we considered SVR data on patients with and without liver cirrhosis separately. Predicting this data using our model was not possible because Δϕ and ϕnull in these populations were not known. We therefore fit Eq (18) to the two data sets separately using as an adjustable parameter. The distribution of baseline viral loads is not hugely different between the two populations, although mean viral loads were somewhat smaller in patients with liver cirrhosis [44]. Using Eq (11) and the best-fit estimates of , we obtained estimates of ϕnull in the two populations. Finally, we solved our model of viral dynamics (Eqs (1)–(4)) with for different values of and identified the highest value of that yielded a null response. The resulting values of provided estimates of the extent of increase in IFN-responsiveness due to standard PR treatment in cirrhotic and non-cirrhotic patients, respectively, which allowed recommendation of strategies to improve treatments in these subpopulations.

Estimation of required treatment duration

Finally, we calculated the required duration of treatment to achieve SVR for different and γt. We chose parameters representative of daclatasvir as follows. The EC50 of daclatasvir against the wild-type [77] and the RAV [78] were 17.28 pM and 32346.26 pM, respectively. (The molecular weight of daclatasvir is 738.89 g/mol.) Using the pharmacokinetic parameters of daclatasvir [79], the peak and trough plasma concentrations, Cmax = 1726.4 ng/ml and Cmin = 254.6 ng/ml, the dosing interval of 1 d, and the time to reach peak plasma concentration of 1 h, we calculated the average efficacy of daclatasvir against the wild-type and the RAV, following the procedure outlined earlier [77], to be 0.99998 and 0.709, respectively. With these values, we solved our model of viral dynamics (Eqs (1)–(4)) for different values of and the intrinsic fitness of the RAV, γ, and estimated the duration of treatment required to achieve SVR. For the common RAV Y93H, γ = 0.5751 [77]. Using this value of γ and the distribution of in treatment naïve individuals (Eq (6)), we estimated the fraction of individuals treated who would achieve SVR within a defined treatment duration.

Supporting information

S1 Fig. Sensitivity analysis of the viral kinetic model.

Partial rank correlation coefficients (PRCCs) indicating the sensitivity of our model predictions (Eqs (1)–(4) and (S2.1)-(S2.4)) of (A) single mutant population pre-treatment, (B) single mutant population during DAA treatment, (C) double mutant population pre-treatment, and (D) double mutant population during DAA treatment to variations in model parameter values. The model is considered sensitive to parameters with PRCCs significantly different from the dummy. Thus, the model is sensitive to and δ pre-treatment, in agreement with the parameters defining the mutant population in the analytical approximation in Eq. (S1.11), and additionally to the drug efficacies, and , during treatment. For these calculations, we adapted the MATLAB codes available on Dr. Denise Kirschner’s website (http://malthus.micro.med.umich.edu/lab/usadata).

https://doi.org/10.1371/journal.pcbi.1006335.s001

(TIF)

S2 Fig. Phase diagrams indicating response to IFN-free DAA treatments.

The level of IFN-refractoriness, , and the relative fitness of the RAV during treatment, γt, that lead to SVR (dark blue) or treatment failure due to virological breakthrough by the RAV (light blue), wild-type (green), or both (brown) when (A) , (B) , (C) , (D) . Here, γ = 0.5. The other parameters are the same as in Fig 3.

https://doi.org/10.1371/journal.pcbi.1006335.s002

(TIF)

S3 Fig. Phase diagrams indicating response to PR+DAA treatments.

IFN-refractoriness pre- and during treatment, and , leading to SVR (dark blue), or virological breakthrough by RAV (light blue), wild-type (green), or both (brown) when (A) ; (B) ; (C) ; (D) ; (E) and (F) . Here, γ = 0.1. The other parameters are the same as in Fig 4.

https://doi.org/10.1371/journal.pcbi.1006335.s003

(TIF)

S1 Table. Response to DAA-based treatments.

SVR rates elicited by various IFN-free and IFN-containing DAA combinations in treatment-naïve and prior null responders to PR from recent clinical trials. The treated population size is indicated in brackets. The significance of the difference in the SVR rates in the two populations is computed using the χ2 and the Fisher’s exact tests. The HCV genotype and whether the patients had liver cirrhosis is indicated. Data from all trials involving a particular treatment regimen are combined for the statistical analysis.

https://doi.org/10.1371/journal.pcbi.1006335.s004

(DOCX)

S2 Table. Response to DAA-based treatments in patients with liver cirrhosis.

The datasets in S1 Table that consider patients with liver cirrhosis alone are summarized.

https://doi.org/10.1371/journal.pcbi.1006335.s005

(DOCX)

S3 Table. Response to DAA-based treatments in patients without liver cirrhosis.

The datasets in S1 Table that consider patients without liver cirrhosis alone are summarized.

https://doi.org/10.1371/journal.pcbi.1006335.s006

(DOCX)

S4 Table. Response to DAA-based treatments from studies that do not distinguish between patients with and without cirrhosis.

The datasets in S1 Table that consider patients without distinction in cirrhosis are summarized.

https://doi.org/10.1371/journal.pcbi.1006335.s007

(DOCX)

S5 Table. Model parameters.

Definitions of model parameters and their typical values employed. Variations are mentioned in the text.

https://doi.org/10.1371/journal.pcbi.1006335.s008

(DOCX)

S1 Text. Analytical approximation of the pre-treatment steady state with a single resistance locus.

https://doi.org/10.1371/journal.pcbi.1006335.s009

(DOCX)

S2 Text. Model formulation with multiple resistance loci.

https://doi.org/10.1371/journal.pcbi.1006335.s010

(DOCX)

S3 Text. Analytical approximation of the pre-treatment steady state with two or more resistance loci.

https://doi.org/10.1371/journal.pcbi.1006335.s011

(DOCX)

References

  1. 1. Horner SM, Naggie S. Successes and challenges on the road to cure hepatitis C. PLoS Pathog. 2015;11:e1004854. pmid:26087286
  2. 2. WHO. Guidelines for the screening care and treatment of persons with chronic hepatitis C infection. Geneva: World Health Organization; 2016.
  3. 3. EASL recommendations on treatment of hepatitis C 2016. J Hepatol. 2017;66:153–194. pmid:27667367
  4. 4. Heim MH. Innate immunity and HCV. J Hepatol. 2013;58:564–574. pmid:23063572
  5. 5. Dixit NM, Layden-Almer JE, Layden TJ, Perelson AS. Modelling how ribavirin improves interferon response rates in hepatitis C virus infection. Nature. 2004;432:922–924. pmid:15602565
  6. 6. Rotman Y, Noureddin M, Feld JJ, Guedj J, Witthaus M, Han H, et al. Effect of ribavirin on viral kinetics and liver gene expression in chronic hepatitis C. Gut. 2014;63:161–169. pmid:23396509
  7. 7. Gotte M, Feld JJ. Direct-acting antiviral agents for hepatitis C: structural and mechanistic insights. Nat Rev Gastroenterol Hepatol. 2016;13:338–351. pmid:27147491
  8. 8. Lontok E, Harrington P, Howe A, Kieffer T, Lennerstrand J, Lenz O, et al. Hepatitis C virus drug resistance–associated substitutions: State of the art summary. Hepatology. 2015;62:1623–1632. pmid:26095927
  9. 9. Ahmed A, Felmlee D. Mechanisms of hepatitis c viral resistance to direct acting antivirals. Viruses. 2015;7:2968.
  10. 10. Neumann AU, Lam NP, Dahari H, Gretch DR, Wiley TE, Layden TJ, et al. Hepatitis C viral dynamics in vivo and the antiviral efficacy of interferon-alpha therapy. Science. 1998;282:103–107. pmid:9756471
  11. 11. Ribeiro RM, Li H, Wang S, Stoddard MB, Learn GH, Korber BT, et al. Quantifying the diversification of hepatitis C virus (HCV) during primary infection: estimates of the in vivo mutation rate. PLoS Pathog. 2012;8:e1002881. pmid:22927817
  12. 12. Rong L, Dahari H, Ribeiro RM, Perelson AS. Rapid emergence of protease inhibitor resistance in hepatitis C virus. Sci Transl Med. 2010;2:30ra32. pmid:20445200
  13. 13. Murakami E, Imamura M, Hayes CN, Abe H, Hiraga N, Honda Y, et al. Ultradeep sequencing study of chronic hepatitis C virus genotype 1 infection in patients treated with daclatasvir, peginterferon, and ribavirin. Antimicrob Ag Chem. 2014;58:2105–2112.
  14. 14. Sarrazin C, Dvory-Sobol H, Svarovskaia ES, Doehle BP, Pang PS, Chuang S-M, et al. Prevalence of resistance-associated substitutions in HCV NS5A, NS5B, or NS3 and outcomes of treatment with ledipasvir and sofosbuvir. Gastroenterology. 2016;151:501–512.e501. pmid:27296509
  15. 15. Haller O, Kochs G, Weber F. The interferon response circuit: Induction and suppression by pathogenic viruses. Virology. 2006;344:119–130. pmid:16364743
  16. 16. Perelson AS, Guedj J. Modelling hepatitis C therapy-predicting effects of treatment. Nat Rev Gastroenterol Hepatol. 2015;12:437–445. pmid:26122475
  17. 17. Padmanabhan P, Garaigorta U, Dixit NM. Emergent properties of the interferon-signalling network may underlie the success of hepatitis C treatment. Nat Commun. 2014;5:3872. pmid:24834957
  18. 18. Adiwijaya BS, Herrmann E, Hare B, Kieffer T, Lin C, Kwong AD, et al. A multi-variant, viral dynamic model of genotype 1 HCV to assess the in vivo evolution of protease-inhibitor resistant variants. PLoS Comput Biol. 2010;6:e1000745. pmid:20419154
  19. 19. Haseltine EL, De Meyer S, Dierynck I, Bartels DJ, Ghys A, Davis A, et al. Modeling viral evolutionary dynamics after telaprevir-based treatment. PLoS Comput Biol. 2014;10:e1003772. pmid:25101970
  20. 20. Adiwijaya BS, Kieffer TL, Henshaw J, Eisenhauer K, Kimko H, Alam JJ, et al. A Viral dynamic model for treatment regimens with direct-acting antivirals for chronic hepatitis C infection. PLoS Comput Biol. 2012;8:e1002339. pmid:22241977
  21. 21. Powdrill MH, Tchesnokov EP, Kozak RA, Russell RS, Martin R, Svarovskaia ES, et al. Contribution of a mutational bias in hepatitis C virus replication to the genetic barrier in the development of drug resistance. Proc Natl Acad Sci USA. 2011;108:20509–20513. pmid:22135458
  22. 22. Rong L, Ribeiro RM, Perelson AS. Modeling Quasispecies and drug resistance in hepatitis C patients treated with a protease inhibitor. Bull Math Biol. 2012;74:1789–1817. pmid:22639338
  23. 23. Guedj J, Dahari H, Rong L, Sansone ND, Nettles RE, Cotler SJ, et al. Modeling shows that the NS5A inhibitor daclatasvir has two modes of action and yields a shorter estimate of the hepatitis C virus half-life. Proc Natl Acad Sci USA. 2014;110:3991–3996.
  24. 24. Binder M, Sulaimanov N, Clausznitzer D, Schulze M, Hüber CM, Lenz SM, et al. Replication vesicles are load- and choke-points in the hepatitis C virus lifecycle. PLoS Pathog. 2013;9:e1003561. pmid:23990783
  25. 25. Rand U, Rinas M, Schwerk J, Nohren G, Linnes M, Kroger A, et al. Multi-layered stochasticity and paracrine signal propagation shape the type-I interferon response. Mol Sys Biol. 2012;8:584.
  26. 26. Herrmann E, Zeuzem S, Sarrazin C, Hinrichsen H, Benhamou Y, Manns MP, et al. Viral kinetics in patients with chronic hepatitis C treated with the serine protease inhibitor BILN 2061. Antivir Ther. 2006;11:371. pmid:16759054
  27. 27. Dahari H, Canini L, Graw F, Uprichard SL, Araujo ESA, Penaranda G, et al. HCV kinetic and modeling analyses indicate similar time to cure among sofosbuvir combination regimens with daclatasvir, simeprevir or ledipasvir. J Hepatol. 2016;64:1232–1239. pmid:26907973
  28. 28. Schoggins JW, Wilson SJ, Panis M, Murphy MY, Jones CT, Bieniasz P, et al. A diverse range of gene products are effectors of the type I interferon antiviral response. Nature. 2011;472:481–485. pmid:21478870
  29. 29. Metz P, Dazert E, Ruggieri A, Mazur J, Kaderali L, Kaul A, et al. Identification of type I and type II interferon-induced effectors controlling hepatitis C virus replication. Hepatology. 2012;56:2082–2093. pmid:22711689
  30. 30. Garaigorta U, Chisari FV. Hepatitis C virus blocks interferon effector function by inducing protein kinase R phosphorylation. Cell Host Microbe. 2009;6:513–522. pmid:20006840
  31. 31. Jarret A, McFarland AP, Horner SM, Kell A, Schwerk J, Hong M, et al. Hepatitis-C-virus-induced microRNAs dampen interferon-mediated antiviral signaling. Nat Med. 2016;22:1475–1481. pmid:27841874
  32. 32. Liu WL, Yang HC, Hsu CS, Wang CC, Wang TS, Kao JH, et al. Pegylated IFN-alpha suppresses hepatitis C virus by promoting the DAPK-mTOR pathway. Proc Natl Acad Sci U S A. 2016;113:14799–14804. pmid:27930338
  33. 33. Qi H, Chu V, Wu NC, Chen Z, Truong S, Brar G, et al. Systematic identification of anti-interferon function on hepatitis C virus genome reveals p7 as an immune evasion protein. Proc Natl Acad Sci U S A. 2017;114:2018–2023. pmid:28159892
  34. 34. Kandathil AJ, Graw F, Quinn J, Hwang HS, Torbenson M, Perelson AS, et al. Use of laser capture microdissection to map hepatitis C virus-positive hepatocytes in human liver. Gastroenterology. 2013;145:1404–1413.e1410. pmid:23973767
  35. 35. Kurbanov F, Kim Y, Latanich R, Chaudhari P, El-Diwany R, Knabel M, et al. IFNL3 genotype is associated with differential induction of IFNL3 in primary human hepatocytes. Antivir Ther. 2015;20:805–814. pmid:26109548
  36. 36. Cribier B, Schmitt C, Rey D, Lang JM, Kirn A, Stoll-Keller F. Role of endogenous interferon in hepatitis C virus (HCV) infection and in coinfection by HIV and HCV. Res Virol. 1996;147:263–266. pmid:8880995
  37. 37. Hayes CN, Imamura M, Aikata H, Chayama K. Genetics of IL28B and HCV-response to infection and treatment. Nat Rev Gastroenterol Hepatol. 2012;9:406–417. pmid:22641049
  38. 38. Rosenbloom DIS, Hill AL, Rabi SA, Siliciano RF, Nowak MA. Antiretroviral dynamics determines HIV evolution and predicts therapy outcome. Nat Med. 2012;18:1378–1385. pmid:22941277
  39. 39. Hare BJ, Haseltine E, Fleming M, Chelsky D, McIntosh L, Allard R, et al. A signature for immune response correlates with HCV treatment outcome in Caucasian subjects. J Proteomics. 2015;116:59–67. pmid:25576854
  40. 40. Snoeck E, Chanu P, Lavielle M, Jacqmin P, Jonsson EN, Jorga K, et al. A comprehensive hepatitis C viral kinetic model explaining cure. Clin Pharmacol Ther. 2010;87:706–713. pmid:20463660
  41. 41. Thimme R, Binder M, Bartenschlager R. Failure of innate and adaptive immune responses in controlling hepatitis C virus infection. FEMS Microbiol Rev. 2012;36:663–683. pmid:22142141
  42. 42. Perales C, Beach NM, Gallego I, Soria ME, Quer J, Esteban JI, et al. Response of hepatitis C virus to long-term passage in the presence of interferon-alpha. Multiple mutations and a common phenotype. J Virol. 2013;87:7593–7607. pmid:23637397
  43. 43. Wieland S, Makowska Z, Campana B, Calabrese D, Dill MT, Chung J, et al. Simultaneous detection of hepatitis C virus and interferon stimulated gene expression in infected human liver. Hepatology. 2013;59:2121–2130.
  44. 44. Nainan OV, Alter MJ, Kruszon-Moran D, Gao F-X, Xia G, McQuillan G, et al. Hepatitis C virus genotypes and viral concentrations in participants of a general population survey in the United States. Gastroenterology. 2006;131:478–484. pmid:16890602
  45. 45. Micallef JM, Kaldor JM, Dore GJ. Spontaneous viral clearance following acute hepatitis C infection: a systematic review of longitudinal studies. J Viral Hep. 2006;13:34–41.
  46. 46. Sarrazin C, Kieffer TL, Bartels D, Hanzelka B, Muh U, Welker M, et al. Dynamic hepatitis C virus genotypic and phenotypic changes in patients treated with the protease inhibitor telaprevir. Gastroenterology. 2007;132:1767–1777. pmid:17484874
  47. 47. Suzuki F, Suzuki Y, Akuta N, Sezaki H, Yatsuji H, Arase Y, et al. Sustained virological response in a patient with chronic hepatitis C treated by monotherapy with the NS3-4A protease inhibitor telaprevir. J Clin Virol. 2010;47:76–78. pmid:19857995
  48. 48. Vertex. Incivek highlights of prescribing information. http://pivrtxcom/files/uspi_telaprevirpdf. 2013.
  49. 49. Ferenci P, Fried MW, Shiffman ML, Smith CI, Marinos G, Goncales FL Jr., et al. Predicting sustained virological responses in chronic hepatitis C patients treated with peginterferon alfa-2a /ribavirin. J Hepatol. 2005;43:425–433. pmid:15990196
  50. 50. Xiao F, Fofana I, Thumann C, Mailly L, Alles R, Robinet E, et al. Synergy of entry inhibitors with direct-acting antivirals uncovers novel combinations for prevention and treatment of hepatitis C. Gut. 2014;64:483. pmid:24848265
  51. 51. Padmanabhan P, Dixit NM. Modeling suggests a mechanism of synergy between hepatitis C virus entry inhibitors and drugs of other classes. CPT: Pharm Sys Pharm. 2015;4:445–453.
  52. 52. Alton G. Submission to the United Nations Secretary-General’s high-level panel on access to medicines. Gilead Sciences; 2016 (http://www.unsgaccessmeds.org/inbox/2016/2/29/gilead-sciences-inc). 2016.
  53. 53. UNITAID. Hepatitis C medicines: technology and market landscape–update. http://wwwunitaideu/images/marketdynamics/publications/Hepatitis_C_Medicines_Technology_and_Market_Landscape__Updatepdf. 2015.
  54. 54. Koizumi Y, Ohashi H, Nakajima S, Tanaka Y, Wakita T, Perelson AS, et al. Quantifying antiviral activity optimizes drug combinations against hepatitis C virus infection. Proc Natl Acad Sci USA. 2017;114:1922–1927. pmid:28174263
  55. 55. Ohashi H, Koizumi Y, Fukano K, Wakita T, Perelson AS, Iwami S, et al. Reply to Padmanabhan and Dixit: Hepatitis C virus entry inhibitors for optimally boosting direct-acting antiviral-based treatments. Proc Natl Acad Sci U S A. 2017;114:E4527–E4529. pmid:28512226
  56. 56. Padmanabhan P, Dixit NM. Inhibitors of hepatitis C virus entry may be potent ingredients of optimal drug combinations. Proc Natl Acad Sci USA. 2017;114:E4524–E4526. pmid:28512229
  57. 57. Lau G, Benhamou Y, Chen G, Li J, Shao Q, Ji D, et al. Efficacy and safety of 3-week response-guided triple direct-acting antiviral therapy for chronic hepatitis C infection: a phase 2, open-label, proof-of-concept study. Lancet Gastroenterol Hepatol. 2016;1:97–104. pmid:27917405
  58. 58. Aghemo A, Colombo M. Response-guided duration of direct acting antiviral therapy for chronic hepatitis C: Back to the future? Gastroenterology. 2017;152:1238–1239. pmid:28253477
  59. 59. Kohli A, Osinusi A, Sims Z, Nelson A, Meissner EG, Barrett LL, et al. Virological response after 6 week triple-drug regimens for hepatitis C: a proof-of-concept phase 2A cohort study. Lancet. 2015;385:1107–1113. pmid:25591505
  60. 60. Maasoumy B, Vermehren J, Welker M-W, Bremer B, Perner D, Honer zu Siederdissen C, et al. Clinical value of on-treatment HCV RNA levels during different sofosbuvir-based antiviral regimens. J Hepatol. 2016;65:473–482. pmid:27085252
  61. 61. El Sherif O, Afhdal N, Curry M. No one size fits all—shortening duration of therapy with direct acting antivirals for hepatitis C genotype 1 infection. J Viral Hepatitis. 2017;24:808–813.
  62. 62. Tsubota A, Arase Y, Someya T, Suzuki Y, Suzuki F, Saitoh S, et al. Early viral kinetics and treatment outcome in combination of high-dose interferon induction vs. pegylated interferon plus ribavirin for naïve patients infected with hepatitis C virus of genotype 1b and high viral load. J Med Virol. 2005;75:27–34. pmid:15543591
  63. 63. Makiyama A, Itoh Y, Yasui K, Mori K, Okita M, Nakayama M, et al. First phase viral kinetic parameters and prediction of response to interferon alpha-2b/ribavirin combination therapy in patients with chronic hepatitis C. Hepatol Res. 2006;36:94–99. pmid:16950651
  64. 64. Rong L, Guedj J, Dahari H, Perelson AS. Treatment of hepatitis C with an interferon-based lead-in phase: a perspective from mathematical modelling. Antivir Ther. 2014;19:469–477. pmid:24434478
  65. 65. Hezode C, Chevaliez S, Scoazec G, Bouvier-Alias M, Ruiz I, Francois M, et al. On-treatment viral kinetics do not predict SVR in patients with advanced liver disease receiving sofosbuvir in combination with daclatasvir or simeprevir for 12 weeks. J Hepatol. 2015;62:S654–S655.
  66. 66. Fourati S, Guedj J, Chevaliez S, Nguyen T H T, Roudot-Thoraval F, Ruiz I, et al. Viral kinetics analysis and virological characterization of treatment failures in patients with chronic hepatitis C treated with sofosbuvir and an NS5A inhibitor. Aliment Pharm Ther. 2018;47:665–673.
  67. 67. Howe JA, Long J, Black S, Chase R, McMonagle P, Curry S, et al. Clinical implications of detectable baseline hepatitis C virus-genotype 1 NS3/4A-protease variants on the efficacy of boceprevir combined with peginterferon/ribavirin. Open Forum Inf Dis. 2014;1:ofu078.
  68. 68. De Meyer S, Dierynck I, Ghys A, Beumont M, Daems B, Van Baelen B, et al. Characterization of telaprevir treatment outcomes and resistance in patients with prior treatment failure: Results from the REALIZE trial. Hepatology. 2012;56:2106–2115. pmid:22806681
  69. 69. Sun J-H, O'Boyle II DR, Fridell RA, Langley DR, Wang C, Roberts SB, et al. Resensitizing daclatasvir-resistant hepatitis C variants by allosteric modulation of NS5A. Nature. 2015;527:245–248. pmid:26536115
  70. 70. Malespin M, Benyashvili T, Uprichard SL, Perelson AS, Dahari H, Cotler SJ. Prevalence of end of treatment RNA-positive/sustained viral response in HCV patients treated with sofosbuvir combination therapies. Therap Adv Gastroenterol. 2017;10:68–73. pmid:28286560
  71. 71. Nguyen THT, Guedj J, Uprichard SL, Kohli A, Kottilil S, Perelson AS. The paradox of highly effective sofosbuvir-based combination therapy despite slow viral decline: can we still rely on viral kinetics? Sci Rep. 2017;7:10233. pmid:28860456
  72. 72. Goyal A, Lurie Y, Meissner EG, Major M, Sansone N, Uprichard SL, et al. Modeling HCV cure after an ultra-short duration of therapy with direct acting agents. Antiviral Res. 2017;144:281–285. pmid:28673800
  73. 73. Baral S, Roy R, Dixit NM. Modelling how reversal of immune exhaustion elicits cure of chronic hepatitis C after the end of treatment with direct‐acting antiviral agents. Immunol Cell Biol. 2018; https://doi.org/10.1111/imcb.12161
  74. 74. Padmanabhan P, Dixit NM. Mathematical model of viral kinetics in vitro estimates the number of E2-CD81 complexes necessary for hepatitis C virus entry. PLoS Comput Biol. 2011;7:e1002307. pmid:22174670
  75. 75. Ribeiro RM, Bonhoeffer S, Nowak MA. The frequency of resistant mutant virus before antiviral therapy. AIDS. 1998;12:461–465. pmid:9543443
  76. 76. Marino S, Hogue IB, Ray CJ, Kirschner DE. A methodology for performing global uncertainty and sensitivity analysis in systems biology. J Theor Biol. 2008;254:178–196. pmid:18572196
  77. 77. Qi H, Olson CA, Wu NC, Ke R, Loverdo C, Chu V, et al. A quantitative high-resolution genetic profile rapidly identifies sequence determinants of hepatitis C viral fitness and drug sensitivity. PLoS Pathog. 2014;10:e1004064. pmid:24722365
  78. 78. Fridell RA, Wang C, Sun J-H, O'Boyle DR, Nower P, Valera L, et al. Genotypic and phenotypic analysis of variants resistant to hepatitis C virus nonstructural protein 5A replication complex inhibitor BMS-790052 in humans: in vitro and in vivo correlations. Hepatology. 2011;54:1924–1935. pmid:21809362
  79. 79. Nettles RE, Gao M, Bifano M, Chung E, Persson A, Marbury TC, et al. Multiple ascending dose study of BMS-790052, a nonstructural protein 5A replication complex inhibitor, in patients infected with hepatitis C virus genotype 1. Hepatology. 2011;54:1956–1965. pmid:21837752