Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Combination interventions for Hepatitis C and Cirrhosis reduction among people who inject drugs: An agent-based, networked population simulation experiment

  • Bilal Khan,

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Software, Validation, Writing – original draft, Writing – review & editing

    Affiliation Department of Sociology, University of Nebraska, Lincoln NE, United States of America

  • Ian Duncan,

    Roles Data curation, Formal analysis, Writing – original draft, Writing – review & editing

    Affiliation Department of Sociology, University of Nebraska, Lincoln NE, United States of America

  • Mohamad Saad,

    Roles Software, Validation, Writing – review & editing

    Affiliation Department of Sociology, University of Nebraska, Lincoln NE, United States of America

  • Daniel Schaefer,

    Roles Investigation, Software, Writing – review & editing

    Affiliation Department of Sociology, University of Nebraska, Lincoln NE, United States of America

  • Ashly Jordan,

    Roles Data curation, Investigation, Project administration, Writing – review & editing

    Affiliations Rory Meyers College of Nursing, New York University, New York, NY, United States of America, Center for Drug Use and HIV Research, New York University, New York, NY, United States of America

  • Daniel Smith,

    Roles Data curation, Formal analysis, Investigation

    Affiliation Rory Meyers College of Nursing, New York University, New York, NY, United States of America

  • Alan Neaigus,

    Roles Data curation, Investigation, Resources, Writing – review & editing

    Affiliation Department of Epidemiology, Mailman School of Public Health, Columbia University, New York, NY, United States of America

  • Don Des Jarlais,

    Roles Conceptualization, Supervision, Writing – review & editing

    Affiliation Icahn School of Medicine at Mount Sinai, New York, NY, United States of America

  • Holly Hagan,

    Roles Conceptualization, Funding acquisition, Project administration, Supervision, Writing – original draft, Writing – review & editing

    Affiliations Rory Meyers College of Nursing, New York University, New York, NY, United States of America, Center for Drug Use and HIV Research, New York University, New York, NY, United States of America

  • Kirk Dombrowski

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Project administration, Supervision, Validation, Writing – original draft, Writing – review & editing

    kdombrowski2@unl.edu

    Affiliation Department of Sociology, University of Nebraska, Lincoln NE, United States of America

Abstract

Hepatitis C virus (HCV) infection is endemic in people who inject drugs (PWID), with prevalence estimates above 60% for PWID in the United States. Previous modeling studies suggest that direct acting antiviral (DAA) treatment can lower overall prevalence in this population, but treatment is often delayed until the onset of advanced liver disease (fibrosis stage 3 or later) due to cost. Lower cost interventions featuring syringe access (SA) and medically assisted treatment (MAT) have shown mixed results in lowering HCV rates below current levels. However. little is known about the potential cumulative effects of combining DAA and MAT treatment. While simulation experiments can reveal likely long-term effects, most prior simulations have been performed on closed populations of model agents—a scenario quite different from the open, mobile populations known to most health agencies. This paper uses data from the Centers for Disease Control’s National HIV Behavioral Surveillance project, IDU round 3, collected in New York City in 2012 to parameterize simulations of open populations. To test the effect of combining DAA treatment with SA/MAT participation, multiple, scaled implementations of the two intervention strategies were simulated. Our results show that, in an open population, SA/MAT by itself has only small effects on HCV prevalence, while DAA treatment by itself can lower both HCV and HCV-related advanced liver disease prevalence. More importantly, the simulation experiments suggest that combinations of the two strategies can, when implemented together and at sufficient levels, dramatically reduce HCV incidence. We conclude that adopting SA/MAT implementations alongside DAA interventions can play a critical role in reducing the long-term consequences of ongoing HCV infection.

Introduction

In the United States, hepatitis C virus (HCV) infection is endemic in people who inject drugs (PWID), with approximately 60% having chronic infection, and incidence of infection among new injectors varying between 15-35 per 100 person-years of observation [1]. Beginning in 2007, HCV-related deaths in the US exceeded deaths related to HIV, and currently surpass deaths from all other notifiable infections [2]. In high-income countries, HCV is the underlying causal factor for more than half of cases of hepatocellular carcinoma (HCC), and HCC incidence will continue to climb in the coming years due to advancing infections in the PWID (and formerly PWID) population. There are highly effective and tolerable treatments for chronic HCV infection, but the costs of these direct-acting antiviral medications (DAAs) are high and currently fewer than 5-10%—the estimate is imprecise—of PWID are have been treated [3].

Although mathematical modeling has shown that HCV treatment using the DAAs can be cost-effective [4, 5], currently 23 U.S. states require that patients have advanced HCV diagnosis (Metavir fibrosis stage F3 or cirrhosis) in order to approve publicly funded medical treatment [6]. In contrast, “treatment as prevention” has been proposed as a strategy to reduce prevalence among PWID—and in turn, lower transmission [7], though questions remain about the actual efficacy of this approach [8]. A systematic review and meta-analysis showed that PWID who receive medically assisted substance use treatment (SA/MAT) and participate in high-coverage syringe access programs may reduce their risk of HCV infection by 70% [9]. This raises the possibility that such strategies could be employed alongside DAA treatment to lower downstream cases of HCV-related severe liver diseases. Previous modeling studies have reported that scaling up MAT, high-coverage syringe access programs, and HCV treatment over time can reduce new infections and disease burden, and advance toward HCV elimination [10]. This paper extends that work by exploring the impact of treating chronically infected PWID at all HCV stages, and describing the anticipated benefits of combining DAA treatment with intensive SA/MAT.

Large-scale studies of combined interventions trials among PWID for either HIV or HCV are rare [11], in large part due to cost and difficulties associated with controlling recruitment and cohort retention over long time scales (as required given the slow impacts of both diseases on health). As a result, the long-term efficacy of combination intervention strategies for HCV is largely unknown. Given the recent rapid rise in opiate abuse, data-driven intervention design is critical to altering the trajectory of HCV infection among PWID. Computer simulation offers the possibility of predicting the long-term dynamics of HCV infection among PWID, and the opportunity to “test” in silico, the effect of different combinations of intervention strategies [3]. Where lower-cost SA/MAT interventions can be demonstrated to enhance the impact of DAA treatments, public health officials may be availed of new, more effective strategies to lower HCV prevalence among PWID.

Over the last two decades, researchers have used modeling and simulation to study HIV infection, uncovering important social and behavioral factors related to its prevalence among PWID [1214]. This prior work has incorporated stochastic population models [1519] for sexual [2023] and injection drug co-use networks [2426], and combinations of both [27, 28]. More recently, analogous approaches have been brought to bear in the context of HCV [29, 30], employing simulations based on both agent-based [31, 32] and networked population perspectives [7, 33]. This ongoing effort emphasizes computational modeling of the projected impact of interventions, considered both singly [7, 34] and in combination [8, 35]. In this paper, we adopt a network-structured, agent-based approach that combines actors with diverse behavioral profiles within the social environment of a dynamic, networked population. Our approach differs from both cohort-based Markov simulations [36] commonly used in cost-effectiveness studies of HCV treatment [37, 38] and the closed population network models found in stochastic actor simulations [29]. The simulations described here model open populations, where agents leave and join the risk population over time, and thus implement more realistic models of the dynamic and mobile PWID communities in which municipalities’ health departments seek to intervene. In addition, we include HIV infection in our models, as serosorting based on HIV status (and HCV status) is known to bias risk partner selection [39], and can be expected to influence the in-network epidemiological dynamics of HCV. Simulation-based research involving open, networked populations is rare, and thus the results presented here represent a significant advance over current HCV and HIV cohort modeling frameworks.

Methods

Models

System model.

At its core, the system is modeled as a dynamic network consisting of nodes (the agents) that are interconnected by a set of edges (their risk-bearing relationships). Nodes are dynamic because they enter and leave the population, and while within the population, they change their relationships, and potentially change with respect to HIV and HCV disease status. The dynamism is regulated and driven by 6 interlinked but autonomous processes that operate within each agent. Collectively, these processes define a dynamic socially networked population in which risk-bearing acts occur and (as a consequence) HIV and HCV propagates. Each individual enters and leaves the population in a manner that is governed by the Initialization and Longevity processes, respectively. Bracketed between these, the node is said to be participating in the risk network, and engages both its Churn and Risk processes. The former (Churn) process alters the local structure of the individual’s risk relationships, while the latter (Risk) process engages current relationships to carry out risk-bearing activity related to drug equipment sharing. Of course, such risk-bearing activity has the potential to cause disease propagation. Each relationship, upon creation, is stochastically assigned an expiration time. Each individual, upon creation, is stochastically assigned both a participation interval, and an ideal risk degree (number of risk partners). The process by which each individual ensures that it always has its ideal number of risk partners (despite disruptions due to Churn and Edge Expiry) is referred to as the Ideal-degree Enforcement process. Further details on interplay of the 6 processes are given in Table 1; an explanation of the parameter values appearing in this Table can be found in the Model Parameters section.

HCV model.

As the main focus of the paper is HCV, the simulation continuously updates the disease status and liver function status of HCV+ agents in a manner consistent with the natural history of HCV disease progression (see Fig 1; an explanation of the parameter values appearing in the figure can be found in the Model Parameters section). All uninfected agents who contract HCV through a risk act with an infected alter enter into an acute state. Over the next 6 months of simulation time, they are HCV infected and can transmit the disease to their network alters via risk acts. However, at the end of a six month acute phase, the agent’s status is checked against a probability of spontaneously clearing the infection. The probability of clearance is 0.243. If the agent has not cleared the infection, they enter a chronic HCV state and begin a Metavir fibrosis progression. Here each agent’s fibrosis level is incremented by 0.117 annually. Agents whose cumulative fibrosis level is greater than 1.0 are said to be in Metavir fibrosis level 1; greater than 2 are said to be in Metavir fibrosis 2.0, etc. Agents in Metavir fibrosis level 4 are said to be in cirrhosis. Chronically infected agents also have a fixed chance, evaluated annually, of entering into one of three states of severe liver disease: cirrhosis (0.0081), decompensated cirrhosis (0.0015) or hepatocellular carcinoma (0.0004). Once in an advanced liver disease state, an agent faces increasing risk of death each year. HCV pathogen properties of spontaneous clearance were drawn from Smith et al [40], while HCV fibrosis and liver stage transition probabilities (e.g. Metavir fibrosis stage advancement rates and the development of decompensated cirrhosis, and hepatocellular carcinoma) were drawn from published meta-analyses of HCV infection dynamics among PWID [41]. During all HCV infection states, transmission probabilities are set uniformly at 0.009 per risk act.

thumbnail
Fig 1. Finite state diagram of the HCV model used in the experiments.

Once infected, agents face a series of stochastic and enforced progressions through a series of ever worsening liver function. Throughout the simulation, infected agents who have reached a chronic state (non-acute HCV infected agents) face a small but regular chance of moving directly to cirrhosis, decompensated cirrhosis, or hepatocellular carcinoma. In addition, their Metavir fibrosis level is incremented yearly, moving them gradually from early stage fibrosis to cirrhosis. Once in any of the three severe liver stages, agents face an increasing probability of death due to HCV infection, incremented on a five year basis.

https://doi.org/10.1371/journal.pone.0206356.g001

HIV model.

In addition, because HIV infection is possible in the simulation (and HIV serosorting behaviors condition network connections) a model of HIV infection was included in the simulation based on prior work by the research team [24, 25]. Fig 2 describes the natural history of HIV; an explanation of the parameter values appearing in the figure can be found in the Model Parameters section. HIV infection has two stages, and initial acute phase of high infectiousness (probability 4 ⋅ 10−3 per risk act), and a chronic phase of low infectiousness (probability 4 ⋅ 10−5 per risk act). All infected agents pass through a 90 day acute phase before moving to chronic HIV infection. Chronically infected agents remain in this state until they leave the simulation (at the end of their individual simulation longevity), or die from either HIV or HCV infection. The probability of dying of HIV in the simulation is constant in the chronic state, and is assessed yearly by a stochastic evaluation. As with HCV, these parameters were determined experimentally such that the results stabilized at current levels during simulation burn-in.

thumbnail
Fig 2. HIV finite state model.

Once infected, agents spend 90 days in an acute state with a relatively high probability of transmitting HIV, then pass into a chronic state and lower probability of transmitting an HIV infection. All chronic HIV-infected agents face a yearly stochastic possibility of dying from the infection.

https://doi.org/10.1371/journal.pone.0206356.g002

Implementation

Our simulation platform has been described in detail previously [42], and has been used to establish the importance of self-organizing behavioral factors in explaining the non-spreading of HIV among PWID in New York City during the early stages of HIV epidemic [24, 25].

In the experiments described here, the simulation engine begins by creating a population of agents who are assigned individual behavioral and demographic states, disease statuses, risk propensities, and risk network connection tendencies as specified by univariate distributions derived from Centers for Disease Control’s National HIV Behavioral Surveillance (NHBS) project [43], IDU round 3, collected in New York City in 2012 by the New York City Department of Health and Mental Hygiene [44, 45]; see Table 2. Once established as a population, a set of risk relationships are created for each agent—links to network alters across which diseases can be transmitted via singular risk acts. The biases in link formation tendencies are expressed via bivariate distributions (also derived from NHBS data, see Table 3). In the current experiments, these links represent drug co-use relationships with network alters who are regular co-injectors and with whom risk event are most likely to happen. As the simulation begins, agents act independently to perform risk acts with network alters based on their individual risk propensities. They also change network alters through a churn process that periodically removes one of their incident links and replaces it with a new one.

thumbnail
Table 2. Per agent univariate parameters in the Baseline settings.

https://doi.org/10.1371/journal.pone.0206356.t002

A master scheduler conducts agent actions one at a time in a discrete event framework, such that an action requested by one agent in the population is concluded before the next action of any other agent in the population is begun. To manage this, all actions take place under a single continuous time progression known as the simulation clock. The result of each event—such as a change of disease status for one agent that results for a risk act that they are involved in—becomes the starting condition for the next scheduled event by the next agent on the schedule. Throughout the simulation, the outcomes of network churn events, disease transmission events, transitions from chronic to severe liver disorders, and overall agent longevity are determined stochastically, meaning that a random number generated by the simulation is compared with a previously calculated probability distribution to produce an event result. In this way, simulations with identical initial starting points can have different trajectories due different stochastic outcomes. During the simulation, an observer module tracks the current set of network connections and individual disease statuses of every agent, while performing updating functions such as aging the agents according to the progression of the simulation clock, updating HCV disease status as it moves through stages of Metavir fibrosis and on to advanced liver disease, removing agents from the simulation when their participation longevity is reached or when they die as a result of either HIV or HCV disease progression, and creating and introducing new agents into the simulation population to replace those that leave or die. The data sources for both the population and their behavioral tendencies are described below.

A central feature of the simulation approach used here is the inclusion of porous population boundaries. Each agent in the simulation is given a participation longevity—the length of time for which they will remain in the population and be subject to risk events, infection, disease progression and so on. This feature is meant to mimic real world PWID networks where location and co-use relationships are fluid, and which contrasts strongly with population—based study cohorts where retention is assumed. Agent participation longevity is parameterized according to CDC NHBS data (see Table 2), and agents schedule their departure event with the master scheduler when they enter the simulation population. As with real world PWID, this departure can be caused by any number of factors that enforce an end to local participation including entering treatment, incarceration, long-term relocation to a different drug-use network, or death. When an agent leaves the network, the observer module notes the event and creates a new agent whose characteristics are drawn from the original population specifications. In this way the population stays (on average) the same through time, but population turnover takes place in ongoing fashion. As a result, simulations with a consistent population of roughly 10,000 agents over 15 years actually involved the participation of more than 25,000 distinct agent actors. As mentioned above, this approach is meant to lend real-world credibility to intervention scenarios which tend to be local in their implementation and subject to participant mobility/dynamism that necessarily involves a fluid population. We note that the incoming, replacement population remains consistent with the original population parameters which include a mix of new and long-term PWID with infected and uninfected statuses across a range of HCV disease states.

In the current analysis, simulations track long-term HCV infection rates under a range of conditions: 1) Baseline—where no new prevention or treatment activities are involved beyond those already in place in New York City when the baseline data were collected, and where both HCV and HIV percolate through the network based on the results of infections that take place during risk events across agent networks; 2) prevention, which includes scaled implementation of MAT and intensified syringe access to reduce pair-wise risk of infection (operationalized as changes in the likelihood of infection taking place in the risk events of those taking part in the intervention); 3) treatment, which includes implementation of DAA to chronically infected agents (operationalized as a probabilistic cure of randomly chosen agents in any chronic stage of HCV, i.e. post-acute Metavir fibrosis level zero or above); and 4) combinations of the aforementioned prevention and treatment strategies at a range of implementation scales. Throughout, intervention results are tracked over 15 years from an initial starting point that is based on parameters drawn from PWID surveillance research in New York City in 2012 [45, 46].

The logic of this approach rests on the idea that Baseline simulations represent the likely future of HCV prevalence and incidence over the next 15 years if no new actions are taken to prevent infection, and drug use trends and availability remain relatively steady. As such, baseline rates are meant to include current levels of syringe exchange (but not intensive syringe exchange coupled with MAT), anti-retroviral treatment, medically assisted opioid treatment (but not in combination with intensive syringe exchange), and HCV treatment (though not DAAs, which were not available when the data used for the baseline settings were collected). The Intervention scenarios represent possible changes in those Baseline trajectories based on changes brought about through new efforts in prevention or treatment, above and beyond those in place in 2012 when the baseline data were collected. Though a future in which drug use patterns and current intervention and prevention levels remain the same may seem overly idealistic, such an assumption is necessary to isolate the potential impact of simulated prevention and treatment changes.

In the experiments described below, 5 random artificial injection networked populations of 10,000 injectors were created for each of 4 scenarios (Baseline, DAA intervention, SA/MAT intervention, and simultaneous DAA and SA/MAT interventions). For each of the populations, 3 independent simulations were undertaken from the same initial starting point, projecting the population out 15 years into the future after an initial 5 year burn-in (see Fig 3). In the Baseline simulations, the same initial settings guided the entire simulation as actors followed their behavioral characteristics for risk and network churn, and HCV and HIV percolated throughout the population. In the Intervention settings, key agent parameters were altered to mimic the effects of an intervention. This took place immediately following the burn-in period, and were repeated each year according to the intervention descriptions below.

thumbnail
Fig 3. Experiment protocol.

For each Baseline or Intervention scenario, 5 artificial PWID populations are created and given initial edge sets. A 5 year simulation burn-in creates independence from the initial population/network starting point and then Baseline or Intervention scenarios are followed. The burn-in and scenario are repeated 3 times.

https://doi.org/10.1371/journal.pone.0206356.g003

The overall population levels for the simulation (i.e. 10,000 agents) is meant to reflect a single, open region within a larger urban zone. Such geographical concentrations are well known in most urban areas and represent permeable spatial and social foci where individual PWID are associated for varying lengths of time [47]. The burn-in period for the simulation is meant to produce a simulation environment that is free from initial starting conditions. Generally, HCV prevalence during the burn in period rises as HCV is transmitted across the risk edges to uninfected agents. In the Baseline scenarios, HCV (and HIV) prevalence and incidence remain relatively static throughout the next 15 years, despite the fact that agents come and go from the network and new infections continue to take place. In the Intervention scenarios, changes to agent behaviors (prevention) or disease states (treatment) alter the incidence and prevalence trajectories away from the Baseline settings.

Over the course of each scenario, agents commit risk acts across their existing network relationships, and form new relationships whenever their existing connections dissolve. Agents also leave the simulation population when their participation longevity elapses. Whenever an agent leaves the simulation, his/her network connections are dissolved and his/her HCV infection status is removed from future measurements. To replace departing agents, new agents are created and given their own risk partnerships with current members of the population. Arriving agents continue to have a 50% chance of being HCV infected at inception (as per initial conditions—simulating a situation where a mixture of new injectors and those who have been injecting for some time enter the population from the surrounding area). At each step of the simulation, population-wide prevalence is measured by considering the status of only those agents who are still in the simulation. This modeling paradigm reflects real-world conditions where community boundary conditions are fluid and populations are mobile: PWID change locations, enter addiction treatment, become incarcerated, and so on, all of which removes them from their risk networks, while other, previously unknown PWID take their place in an evolving network milieu (54). One result of this is that incarceration rates, cessation rates, death rates due to non-HIV or HCV causes, and relocation out of the imagined study area are not treated as separate parameters. Instead, they are subsumed under the single longevity variable that simply assigns a participation duration to every agent—leaving the specific cause of their exit undetermined. Individual infections of both HIV and HCV also age as the simulation progresses. Metavir stages are incremented for those infected with HCV, and stochastic opportunities for sever liver disease progression are made each year (with probabilities set to match known population level outcomes). Among the possible outcomes is death via liver-related disease [48].

Model parameters

Data for simulation populations are drawn from the Centers for Disease Control’s National HIV Behavioral Surveillance project [43], IDU round 3, collected in New York City in 2012 by the New York City Department of Health and Mental Hygiene [44, 45]. Table 2 provides the univariate distributions drawn from participants who were verified to have injected any drug in the past year at the time of their interview. These data were used to create each individual agent’s age, gender, average network degree, race, and longevity of participation within the simulation population. All variables are treated as categorical to enable discrete mixing probabilities. Where ranges are present within a category (i.e. “age” or “average degree”), agents are assigned a random value within the range.

Mixing patterns between agents were determined by aggregating the agent x agent bivariate probabilities across all categories to create a relatively likelihood of connection from one agent to another. Stochastic throws against relative likelihoods were used to determine actual agent connections both initially and in dynamic fashion as the simulation progresses. Table 3 quantifies the homophily biases on population mixing (by age, average degree—binned, gender, HCV status, HIV status, and race). To remain true to the original recruitment data, these distributions often reflect asymmetrical mixing tendencies common to PWID—meaning that the tendency of individuals in group A to seek partners from group B may not be the same as the tendencies of B’s to seek partners from A. The parameters in these tables were drawn from both the NHBS interview data and the respondent driven sampling recruitment data, analyzed and weighted via RDSAT [49]. Tendencies toward serosorting behaviors for both HIV and HCV infection are drawn from published sources [39, 50, 51]. Prior research has shown that serosorting condition the likelihood of pairwise risk relationships [52], and the use of serosorting data has yielded conclusions which are consistent with what is known about the long-term behaviors of the PWID population [25] in New York City. Distributions quantifying the duration of risk relationships were drawn from consultation with ethnographers working in the area and prior research with PWID in New York City [25].

Risk acts are simulation events where an agent, according to their own risk tendencies, decides to engage in an act with a current network alter that can potentially transmit HCV or HIV. These can be thought of needle or equipment sharing events between two people already in a drug co-use relationship. The frequencies were drawn from the interview portion of the CDC’s NHBS survey that deal with injection risk: NHBS researchers asked the frequency with with respondents inject drugs (injavr), and the rate at which the respondent had used injection related paraphernalia after someone else had used it in the preceding 12 months, including needles (sharndle); cookers (sharcookr); cotton (sharcottr); water (sharwatrr); works (sharworkr); used a previously used syringe to divide drugs, i.e. “backloading” (samessyrr). Because these measures were collected along a qualitative scale, they were recoded as numbers that reflected ranked intervals (0 = never, 1 = rarely, 2 = half time, 3 = most time, 4 = always). The individual values were summed for each respondent, and then divided by the reported injection frequency. This created a distribution of relative risk rates across the NHBS population that, while lacking an absolute scale, differentiate population according to their frequency of engaging in risky injection practices with their network alters. Preliminary simulation experiments were used to scale this relative parameter to an absolute number of days such that risk rates converged on the HCV and HIV prevalence levels obtained by the CDC NHBS study over the burn-in period, and remained near these levels during Baseline simulations (see “Validation” below). At their creation, agents are randomly assigned an absolute risk rate within this “pegged” distribution. The result is that the average agent engages in one risk act capable of transmitting HIV or HCV every 23.6 days.

As above, per-risk-act infection probabilities for HCV were also treated as a tuning parameter, and were fitted to the NHBS data along side the absolute risk rates discussed above. The final setting (0.009 chance of infection per risk act across HCV discordant pairs in an active risk relationship) produced prevalence levels (60-70%) that match current HCV levels in the NHBS New York PWID population (and among US PWID more generally [1, 45]—see Boelen et al [53] for a discussion of defining transmission probability via equipment sharing).

Validation

To validate the Baseline settings, 15 year simulations were performed using the cross-section data from the NYC NHBS as coded in settings shown in Tables 2 and 3 and the HIV/HCV models described above (i.e. the “Baseline scenario”), and the results compared to historical trend data from NYC [45, 46]. The goal of the validation experiments was to show that the Baseline settings would cause the simulation to converge at a relatively steady state that matched the known population incidence and prevalence levels of the PWID population in New York City. Where simulations converge and maintain current levels of HCV and HIV risk in dyanamic fashion, this indicates that ongoing risk acts, network churn, and population turn over result in a dynamic equilibrium in line with what is know about historical HCV and HIV trends from the same area. As such, these results show that the simulation produces known macro-level results as emergent phenomena based only on the actions of the agents themselves. Given such a dynamic equilibrium, comparisons can be made between the relatively steady state Baseline and later Intervention scenarios in which one or more Baseline parameter is changed [54]. In addition, the low level of variation seen in the simulation trajectories show that despite the stochastic nature of the system, 15 simulations were sufficient to capture the overall effects (see standard deviations across 15 trials in Table 4).

thumbnail
Table 4. Average incidence and prevalence of HCV states in Baseline simulations.

https://doi.org/10.1371/journal.pone.0206356.t004

For these validation runs (and for all subsequent experiments) the population-wide initial prevalence of HCV infection prior to the burn-in period was set at 50%, meaning that during the population creation process, each agent is given a 50% chance of being assigned an HCV infection state (according to a distribution of liver disease statuses drawn from published sources, see Table 2). During 5 years of simulation “burn in” (used in both the baseline and intervention scenarios) HCV prevalence stabilizes at 60-65%, and HIV prevalence stabilizes at 12-15%. Such conditions are meant to approximate current conditions in New York City [45], and generally reflect PWID HCV prevalence rates in urban areas through the US at the current time.

The long-term results of the validation simulations are shown as averages across 15 years of simulation after the 5 year burn-in period at the Baseline settings, across 15 independent simulations (for a total of 225 data points). Robustness and sensitivity tests for these results are discussed in the Limitations section below. Validation of the Baseline model can be seen in the incidence (per 100 person years) and prevalence of the main outcome variables: acute HCV infection, overall HCV infection rate, rates of cirrhosis (CC), decompensated cirrhosis (DC), and hepatocellular carcinoma (HCC) (see Table 4). These results can be compared to those of recent meta-analyses [41] and NYC incidence and prevalence estimates [45, 46]. The only major difference noted in the validation outcomes is in the rate of decompensated cirrhosis (0.088 simulation average versus reported rates of 0.182 [46]). For consistency, the disease state transition probabilities were drawn from a meta-analysis by members of our team using data from 1990-2013 [41], while the comparison statistic cites rates from 2006 to 2013 [46]. As such, the discrepancy may reflect changes in the nature of the HCV epidemic over time. For comparison, we note that one of the only prospective studies of HCV progression among PWID [55] found high variance in progression rates to severe liver disease, including jumps to Fibrosis stage 5 or 6 from much lower prior Fibrosis levels (including levels 1 and 2). Because all final rates in the simulation are emergent phenomena that are dependent on the number of agents in a given state of Fibrosis, exact fitting of every state turned out to be problematic. Where the rates are comparable, we proceed with the progression figures suggested by Smith et al [41], but note that the final simulation results for decompensated cirrhosis are likely lower than suggested by current data.

Interventions

In the experiments described here, we test the effect of a range of intervention scenarios:

  • A Baseline scenario where neither of the interventions described below take place. In the Baseline scenario there is no direct acting antiviral HCV treatment (such treatments were unavailable at the time, though 34% of NHBS NYC respondents reported having received some medication for HCV infection ever in their lifetime, and 29 of 526 reported having been cured of HCV in the past). Syringe exchange services were active in the NHBS sample (88% of NHBS respondents indicated that they had receive at least one syringe for a such a service in the last year), but coupled intensive syringe exchange where all needles are received from an exchange and simultaneous medically assisted opiate addiction treatment were not available (see [3] for a similar distinction). Specific data on ongoing medically assisted opioid treatment is not available for the the 2012 NHBS NYC data, though 63% of those interviewed reported some participation in drug treatment in the last 12 months. Because the intervention scenarios discussed here go well beyond simple syringe access or prior non-DAA HCV treatments, for the purposes of the current experiments, the level DAA (and corresponding “sustained virological response” (SVR) and combined intensive SA/MAT in the Baseline scenarios are set to zero. We note, however, that evidence of a willingness to engage treatment and the potential for syringe services to reach large proportions of the population are clear from these data.
  • A DAA intervention implemented on the first day of year 6 (following the 5-year burn in period) and on the first day of each subsequent year. Here a fixed percentage of the current, post—acute, chronically infected HCV population is randomly selected for participation in the intervention, and their intervention start date is randomly assigned to occur in the next 365 days. Selection is made across all Metavir fibrosis states F0 through cirrhosis (F4). During the intervention, participants undergo DAA treatment while continuing to practice drug use and incurring risk of HIV infection, but the odds of contracting HCV during this period is zero. Reflecting research findings, 90% of those agents adhere to HCV DAA treatment for the entire duration (168 days/24 weeks), and 95% of those who complete it are cured [56]. At the end of treatment adherence period agents are placed back into the simulation population and continue to operate in a manner specified by their individual agent parameters. During the post-treatment period, reinfection with HCV is possible for as long as the agent remains in the simulation. This is determined stochastically via risk acts in the same way that the initial infection was created. In the case of reinfection, Metavir fibrosis levels resume at the level reached prior to treatment and once again begin to progress toward cirrhosis. Other than treatment-based changes in disease status, at the micro-scale, DAA participants operate in a manner consistent with Baseline.
  • Intensive syringe access and opiate substitution treatment (SA/MAT), at various levels of recruitment/participation. Here, in year 6 and in each year following, a fixed percentage of the total population in the simulation is recruited for participation regardless of HCV status. During the year that follows, each participating agent’s number of risk acts with their network neighbors is decreased by 80% from its original pre-intervention level [57]. At the end of the intervention period, participating agents return to their pre-intervention risk act rate. Because the selection of participants is random each year, individuals may be re-recruited in subsequent years (or even two or more years in a row), depending on the luck of the draw; or they may leave the intervention prior to reaching the 365 day intervention duration, depending on their likelihood of completing the program (determined stochastically). The result is a distribution of participation that may last from a few months to several years in the intervention. In cases where a high percentage of the population is enrolled each year, longer periods of continuous reduced risk becomes more likely. Other than intervention-based changes in risk behavior, at the micro-scale, SA/MAT participants operate in a manner consistent with Baseline.
  • To test the effect of combination strategies, additional scenarios were considered where both the DAA treatment and SA/MAT participation were engaged concurrently (and independently) in the same simulation population. The rationale for this set of scenarios was to determine whether and to what extent each of these approaches—direct-acting antivirals and opiate substitution/syringe access—might, in combination, further reduce levels of HCV in the population compared against approaches relying on each strategy taken alone, and against a Baseline matching conditions akin to those in 2012.

Results

The final prevalence rates for the 15 years after burn in for Baseline and Intervention implementation (for a range of DAA and SA/MAT interventions scales) are found in Table 5. The long-term effects of combined interventions at various scales are considered next, including measurements of chronic prevalence (Table 6), prevalence of HCV-related advanced liver disease (CC+DC+HCC; see Table 7), HCV incidence (Table 8), and incidence of cirrhosis (Table 9).

thumbnail
Table 5. Population proportion by HCV disease state after 15 years of intervention: Mean (std).

https://doi.org/10.1371/journal.pone.0206356.t005

thumbnail
Table 6. Population proportion of Chronic (F0-F3) after 15 years of combined interventions.

https://doi.org/10.1371/journal.pone.0206356.t006

thumbnail
Table 7. Population proportion of HCV-related advanced liver disease (CC, DC, HCC) after 15 years of combined interventions.

https://doi.org/10.1371/journal.pone.0206356.t007

thumbnail
Table 8. Incidence rate of HCV among uninfected agents (in 100 person years).

https://doi.org/10.1371/journal.pone.0206356.t008

thumbnail
Table 9. Incidence rate of Cirrhosis among all infected HCV agents (in 100 person years).

https://doi.org/10.1371/journal.pone.0206356.t009

The tabulated results show that the effects of SA/MAT treatment marginally enhance the effectiveness of DAA treatment in lowering chronic HCV prevalence in an open population (decline of 7%), but have little effect on HCV-related advance liver disease (decline of 1%), with roughly linear effects due to scale for HCV prevalence. However, a different pattern emerges when we turn our attention to incidence rates. Here we see that SA/MAT interventions have significant impacts. As seen in Table 8, high levels of SA/MAT recruitment (at 80% treatment level) have the effect of lowering overall HCV incidence by more than 60%, while scaled DAA treatment at even the highest levels tested here produces a less significant effect (a decrease of 28%). Even at low intervention levels (20%), SA/MAT treatment lowers HCV incidence by 21-39% when combined with DAA treatments of 5% to 20%, with the impact increasing as DAA intervention levels rise. SA/MAT interventions have less of an impact on cirrhosis incidence associated with HCV infection, but still serve to lower cirrhosis incidence by 6-39% when combined with DAA treatments from 5% to 20%. As seen in Table 9, these impacts continue to grow as SA/MAT increases in scale of coverage.

The heatmaps shown in Figs 4 through 7 demonstrate both continuous and thresholding behaviors in the combined interventions. Chronic HCV prevalence (Fig 4) and the prevalence of advanced liver diseases (Fig 5) show continuous declines as DAA levels increase, with relatively fewer (but still continuous) declines provided by increased levels of SA/MAT.

thumbnail
Fig 4. Chronic HCV (F0-3) prevalence at a range of combined intervention scales after 15 years of simulated intervention.

Thresholds can be seen at the DAA 20% scale for all levels of SA/MAT.

https://doi.org/10.1371/journal.pone.0206356.g004

thumbnail
Fig 5. Advanced HCV-related liver disease prevalence at a range of combined intervention scales after 15 years of simulated intervention.

Strong thresholds can be seen at the DAA 20% scale for all levels of SA/MAT.

https://doi.org/10.1371/journal.pone.0206356.g005

thumbnail
Fig 6. HCV incidence (in 100 person years) at a range of combined intervention scales after 15 years of simulated intervention.

Strong thresholds can be seen at the SA/MAT 80% scale for all levels of DAA treatment, and for SA/MAT 60% at DAA treatments of 10% or higher.

https://doi.org/10.1371/journal.pone.0206356.g006

thumbnail
Fig 7. Cirrhosis incidence at a range of combined intervention scales after 15 years of simulated intervention.

A notable threshold can be seen at the DAA 20% and SA/MAT 20% scale. There the inclusion of even low levels of SA/MAT can combine with higher levels of DAA to produce considerable effects on cirrhosis incidence in later years.

https://doi.org/10.1371/journal.pone.0206356.g007

Discussion

This simulation experiment represents an attempt to model open populations of PWID over relatively long time periods, and to test the effectiveness of single and combined interventions under such conditions. The scenario we envision is quite common to municipalities and public health departments facing rising HCV rates associated with increases in injection drug use: what are the best strategies for reducing HCV incidence and prevalence and subsequent severe liver related disorders? Given the high mobility of PWID and the long time periods needed for intervention impacts to manifest, intervention planners need to know what can be expected of new disease containment strategies based on the administration of direct acting antivirals, the deployment of medically-assisted addiction treatment and high-coverage syringe access programs, and combinations thereof.

The open nature of the simulations added considerable dynamism to a model that already included regular network “churn”—the effect of agents leaving some risk relationships and entering into relationships with new alters. Despite the fact that the simulation population was held steady at a level of 10,000 agents, in the combined 5 years of burn-in and 15 years of simulation more than 28,000 agents participated in the simulation (on average); more than 330 thousand risk relationships were made and unmade; more than 131,000 intervention events took place; and approximately 26,000 total new infections (HIV and HCV) occurred. The effects of overall HCV incidence and prevalence we report here were thus consistent even amid considerable network change and population turnover.

The final prevalence rates shown in Table 5 show similarities to previous results from Europe [3]. In particular, SA/MAT shows limited ability to lower overall HCV prevalence (declines of 2-7%) across all HCV states—and very little detectable effect (roughly 1%) on advanced liver disease after 15 years [58]. This is not surprising, given that SA/MAT does not cure infection—and thus can not affect prevalence rates directly. However, as reflected in the declining prevalence of acutely infected agents (which show a 42% decrease from baseline levels of roughly 5% to under 3%), SA/MAT can be expected to result in a steady decline in overall HCV incidence that is not captured in the timescale investigated here.

Scaled DAA treatment shows the ability to lower HCV rates directly, resulting in a more than 30% decline when 20% of those with chronic HCV infection are treated each year. In contrast to SA/MAT intervention, there is very little effect on incidence of acute infection. The simulations also show a large drop in the prevalence of advanced liver disease associated with DAA treatment over the 15-year intervention period (reduction of more than 40%). These results were obtained despite the unbounded nature of the population and the fact that many of those who undergo DAA treatment subsequently leave the simulation in the future and are replaced by others who did not undergo treatment, and occurs despite the fact that reinfection after treatment remains a possibility for agents throughout their time in the simulation.

The results of the simulations also verify previous research findings that SA/MAT interventions, acting alone, do little to reduce overall prevalence of HCV infection or the related advanced liver diseases [59]. However, our result show that SA/MAT does have an important effect on HCV incidence (including a decline of of 60% when 80% of the agents are enrolled)—an effect that, when coupled with even low levels of DAA treatment, can magnify the much smaller declines in HCV incidence under DAA treatment alone (a decline of 28% at the highest intervention level tested here, where DAA treatment was carried out for 20% of the infected agents each year). In the real world, the long term effects of this are shrouded by the very long time scales associated with advancing HCV, and by the open boundaries on the simulation community—whereby the effects of treatment on the current agents are lost when those treated leave the population. Despite this, even low rates of DAA (5% annually) can be coupled with moderate SA/MAT (40%) to produce a 32% drop in HCV incidence and a 8% drop in cirrhosis incidence over 15 years. In contrast, the same DAA treatment that takes place without accompanying SA/MAT shows smaller declines in HCV incidence (4%), ensuring that treatment needs remain high in the future. High levels of DAA (20%) and SA/MAT (80%) in combination show an ability to lower both HCV (resp. cirrhosis) incidence by more than 73% (resp. 39%), when compared to baseline levels. Importantly, these effects can be anticipated despite high population turnover, and take place amid a steep drop in the overall prevalence of chronic HCV (decline of 21%).

What is apparent from these simulations is that deployment level influences the impact of interventions in a non-linear manner. 5% increments in the number of agents enrolled in DAA treatment per year reduce HCV prevalence on average by 5.2, 4.8, 3.7, and 3.8% respectively, as DAA treatment rates go from 5 to 20% of chronically HCV infected agents (Table 6). As above, SA/MAT show little impact on prevalence, such that increases or decreases in marginal utility are not found. On the other hand, when looking at HCV incidence, accelerating marginal gains can be seen in SA/MAT increments of 20% result which result in relative declines in HCV incidence of 14, 18, 22 and 27%. The impact of increasing DAA coverage is mixed: decreases in HCV incidence of 5.5, 9.9, 5.7 and 10.7% can be seen as DAA coverage is increased by 5 to 20% in 5% increments. Increasing both of these interventions simultaneously results in similar non-linear gains of 21, 27, 30, and 35% relative to each prior increment. However, these results show that combining of DAA and SA/MAT interventions is linear mechanism the total gain is the sum of the impacts of each in isolation.

One can see in the heatmaps limited but important threshold behaviors in the combined DAA and SA/MAT results (see Figs 4 through 7). For example, for HCV incidence (Fig 6), increasing DAA coverage from zero coverage to 5% coverage while holding SA/MAT rates at 40% results in a relative decrease of HCV incidence of 14.9% (where the average gain for increasing DAA by one step across all SA/MAT levels is an 8.6% decrease in HCV incidence). Similarly, when holding DAA treatment rates steady at 5%, increasing SA/MAT enrollment from 40 to 60% results in a 25% relative decrease in HCV incidence. For cirrhosis incidence (Fig 7, a jump from 40 to 60% SA/MAT coverage results in an 8.7% decrease (average gain for SA/MAT increase of 5% is 3.1%), while an increase of DAA treatment from 10 to 15% of the infected population while holding SA/MAT rates steady at 40% resulted in a 14.1% decrease in cirrhosis incidence after 15 years. The largest incremental decrease in cirrhosis incidence resulted from adding 5% DAA coverage to 60% SA/MAT coverage (a drop of 14.3%, compared to an average marginal gain of 8.6% for each 5% increase in DAA coverage). Such discontinuous gains offer health agencies opportunities to assess how best to increase their overall effectiveness where financial or other means prevent them from capitalizing on the accelerating marginal gains seen in increasing both interventions simultaneously.

Limitations

The most significant limitation on these results is the obvious fact that these findings were obtained via simulation, and thus ignore a range of possible influences external to the simulation environment—such as future changes in drug markets and drug availability, the impact of possible historical events (such as the long term implications of the unfolding opioid epidemic in the US), changes in PWID routes of administration [60], or new local efforts aimed at changing risk behaviors. Though our framework attempts to engage more realistic intervention conditions through the simulation of an open, networked population, possible errors in these data and their basis in New York City also limit their possible extension to other locations.

To test the robustness of our results against possible sensitivity issues unanticipated in the modeling framework, we conducted sensitivity tests that examined significant changes in input parameters closely connected to HCV spreading in the population. Using “one-factor-at-a-time” strategies [61], we perturbed 5 key parameters by ±15% from initial levels: (i) the network churn rate, (ii) the risk rate, (iii) the HCV transmission probabilities, and initial prevalence levels of both (iv) HIV and (v) HCV (see Table 10). We note that, following Best Practice VI-6 of the ISPOR guideline [62], this table is intended to present data on experiment sensitivity (the effect on outputs of varying inputs) and is not intended to speak to questions of uncertainty. The latter type of analysis would require formal determination of parameter uncertainty—a task which is beyond the scope of this paper, given the present state of the literature. Here we take an “even if” approach (see [62], pp. 838) that identifies a range of parameter values that do not change our conclusions.

thumbnail
Table 10. Sensitivity test showing the effects of parameter changes of 15% on HCV prevalence under both baseline and intervention conditions.

https://doi.org/10.1371/journal.pone.0206356.t010

Comparing intervention and baseline scenarios, the data in Table 10 shows that parameter perturbations had minimal impact on the reduction in HCV prevalence after 15 years. More precisely, DAA10/MAT40 intervention reduces HCV prevalence to between 75-77% of its initial value over 15 years, regardless of perturbations of ±15% in parameters (i)-(iv); a fluctuation of 30% in one of the parameter values (i)-(iv) is thus seen to produce < 2% fluctuation in the intervention’s impact on HCV prevalence after 15 years. Sensitivity to initial HCV prevalence is greater; here we found that perturbations of ±15% in parameter (v) produced ∼ 6% fluctuation in the reduction HCV prevalence (73-79% of the initial value). The heightened sensitivity of final HCV prevalence to initial prevalence levels is not surprising given the open population model and the fact that new agents entering the simulation take their HCV status probabilistically from the initial settings. In effect, the overall impact of changes in simulation parameters is dampened by the simulation process itself. From these tests, we surmise that our results are robust against errors of ∼ 15% in initial settings, and that the results are unlikely to reflect hidden sensitivity effects.

Further limitations include recognized elements of HCV progression that were not included in the simulation such as HIV co-infection impacts on HCV progression (which can increase Metavir progression rates by as much as 50% [63], though this impact is lessened considerably by HIV patients receiving ARV treatments [64]). In the simulation, all HCV infected agents advance at the same Metavir fibrosis rate. We also note that new DAA treatments have shortened the treatment period from 168 days (24 weeks) for roughly half that time [65]. Preliminary tests indicated that this does not significantly impact the results presented here, but future work will include a range of DAA treatment times.

Conclusion

These results suggest significant and immediate steps for health officials and harm reduction programs. Combined interventions that match lower-cost syringe access and medicine assisted addiction treatments with direct acting antiviral treatments can have a large effect on HCV incidence, cirrhosis incidence, and overall HCV prevalence, even among highly mobile PWID populations. Simulations suggest that lower cost syringe exchange and medically assisted opioid treatment can be combined with less available direct acting antiviral treatments to radically lower HCV incidence among people who inject drugs, even when that population is highly mobile and where treatment is at times short term and only temporarily successful. These outcomes are contingent on opening up participation in direct acting antiviral treatment to drug users prior to their entry into later stage fibrosis, and on the ability of health agencies to sustain intervention efforts for more than a decade.

Acknowledgments

The HCV Synthesis Project is supported by a grant from the National Institutes of Health (RO1DA034637). Support was also received from the New York University Center for Drug Use and HIV Research, NIH P30 Center (P30DA011041). The modeling research presented here is supported by NIH/NIDA (R01DA037117). The original simulation platform was developed under RC1DA028476. Data were obtained from the New York City Department of Health and Mental Hygiene, HIV Epidemiology and Field Services through a cooperative agreement. Special thanks to Sarah Braunstein, Director of HIV Epidemiology at NYC DOHMH for this collaboration. Funding for the data collection was provided via a cooperative agreement between the Centers for Disease Control and Prevention, National HIV Behavioral Surveillance program and the New York City Department of Health and Mental Hygiene, Grant U62/CCU223595-03-1. For the 2012 NHBS IDU Round 3 data collection, Alan Neaigus, MCRP, PhD, served as Principal Investigator and Kathleen H. Reilly, PhD, MPH, served as Project Director. Their work, and those of the NHBS NYC IDU Round 3 field team—Holly Hagan, Travis Wendel, David Marshall III, Roberto Abadie, and Carmen Anna Davila—is acknowledged and appreciated.

References

  1. 1. Nelson P, Mathers B, Cowie B, Hagan H, Des Jarlais D, Horyniak D, et al. The epidemiology of viral hepatitis among people who inject drugs: results of global systematic reviews. Lancet. 2011;378(9791):571.
  2. 2. Ly KN, Xing J, Klevens RM, Jiles RB, Ward JW, Holmberg SD. The increasing burden of mortality from viral hepatitis in the United States between 1999 and 2007. Annals of internal medicine. 2012;156(4):271–278. pmid:22351712
  3. 3. Martin NK, Foster G, Vilar J, Ryder S, E Cramp M, Gordon F, et al. HCV treatment rates and sustained viral response among people who inject drugs in seven UK sites: real world results and modelling of treatment impact. Journal of viral hepatitis. 2015;22(4):399–408. pmid:25288193
  4. 4. Iversen J, Grebely J, Catlett B, Cunningham P, Dore GJ, Maher L. Estimating the cascade of hepatitis C testing, care and treatment among people who inject drugs in Australia. International Journal of Drug Policy. 2017;.
  5. 5. Leidner AJ, Chesson HW, Xu F, Ward JW, Spradling PR, Holmberg SD. Cost-effectiveness of hepatitis C treatment for patients in early stages of liver disease. Hepatology. 2015;61(6):1860–1869. pmid:25677072
  6. 6. Chhatwal J, Wang X, Ayer T, Kabiri M, Chung RT, Hur C, et al. Hepatitis C disease burden in the United States in the era of oral direct-acting antivirals. Hepatology. 2016;64(5):1442–1450. pmid:27015107
  7. 7. Hellard M, McBryde E, Davis RS, Rolls DA, Higgs P, Aitken C, et al. Hepatitis C transmission and treatment as prevention—The role of the injecting network. International Journal of Drug Policy. 2015;26(10):958–962. pmid:26072105
  8. 8. Hickman M, De Angelis D, Vickerman P, Hutchinson S, Martin N. HCV treatment as prevention in people who inject drugs—testing the evidence. Current opinion in infectious diseases. 2015;28(6):576. pmid:26524330
  9. 9. Platt L, Reed J, Minozzi S, Vickerman P, Hagan H, French C, et al. Effectiveness of needle/syringe programmes and opiate substitution therapy in preventing HCV transmission among people who inject drugs. The Cochrane Library. 2016;.
  10. 10. Martin N, Skaathun B, Vickerman P, Stuart D. Modeling Combination HCV Prevention among HIV-infected Men Who Have Sex With Men and People Who Inject Drugs. AIDS reviews. 2017;19(2). pmid:28534885
  11. 11. Des Jarlais DC, Arasteh K, McKnight C, Hagan H, Perlman DC, Torian LV, et al. HIV infection during limited versus combined HIV prevention programs for IDUs in New York City: the importance of transmission behaviors. Drug and alcohol dependence. 2010;109(1):154–160. pmid:20163922
  12. 12. Morris M, Kretzschmar M. A microsimulation study of the effect of concurrent partnerships on the spread of HIV in Uganda. Mathematical Population Studies. 2000;8(2):109–133.
  13. 13. Peterson D, Willard K, Altmann M, Gatewood L, Davidson G. Monte Carlo simulation of HIV infection in an intravenous drug user community. JAIDS Journal of Acquired Immune Deficiency Syndromes. 1990;3(11):1086–1095.
  14. 14. Hewitt C, Peverley JR. The Spread of HIV into the General Population of the USA: A Simulation. Population Research and Policy Review. 1996;15(4):311–325.
  15. 15. Eaton JW, Menzies NA, Stover J, Cambiano V, Chindelevitch L, Cori A, et al. Health benefits, costs, and cost-effectiveness of earlier eligibility for adult antiretroviral therapy and expanded treatment coverage: a combined analysis of 12 mathematical models. The Lancet Global Health. 2014;2(1):e23–e34. pmid:25104632
  16. 16. Gray RH, Li X, Kigozi G, Serwadda D, Nalugoda F, Watya S, et al. The impact of male circumcision on HIV incidence and cost per infection prevented: a stochastic simulation model from Rakai, Uganda. Aids. 2007;21(7):845–850. pmid:17415039
  17. 17. Liang Y, Greenhalgh D, Mao X. A stochastic differential equation model for the spread of HIV amongst people who inject drugs. Computational and mathematical methods in medicine. 2016;2016.
  18. 18. Nakagawa F, Van Sighem A, Thiebaut R, Smith C, Ratmann O, Cambiano V, et al. A method to estimate the size and characteristics of HIV-positive populations using an individual-based stochastic simulation model. Epidemiology (Cambridge, Mass). 2016;27(2):247.
  19. 19. Sloot PM, Ivanov SV, Boukhanovsky AV, van de Vijver DA, Boucher CA. Stochastic simulation of HIV population dynamics through complex network modelling. International Journal of Computer Mathematics. 2008;85(8):1175–1187.
  20. 20. Beck EC, Birkett M, Armbruster B, Mustanski B. A data-driven simulation of HIV spread among young men who have sex with men: the role of age and race mixing, and STIs. Journal of acquired immune deficiency syndromes (1999). 2015;70(2):186.
  21. 21. Mei S, Sloot PM, Quax R, Zhu Y, Wang W. Complex agent networks explaining the HIV epidemic among homosexual men in Amsterdam. Mathematics and Computers in Simulation. 2010;80(5):1018–1030.
  22. 22. Merli MG, Moody J, Mendelsohn J, Gauthier R. Sexual mixing in Shanghai: Are heterosexual contact patterns compatible with an HIV/AIDS epidemic? Demography. 2015;52(3):919–942. pmid:25904346
  23. 23. Reniers G, Armbruster B, Lucas A. Sexual networks, partnership mixing, and the female-to-male ratio of HIV infections in generalized epidemics: An agent-based simulation study. Demographic Research. 2015;33:425.
  24. 24. Dombrowski K, Khan B, Habecker P, Hagan H, Friedman SR, Saad M. The Interaction of Risk Network Structures and Virus Natural History in the Non-spreading of HIV Among People Who Inject Drugs in the Early Stages of the Epidemic. AIDS and Behavior. 2017;21(4):1004–1015. pmid:27699596
  25. 25. Khan B, Dombrowski K, Saad M, McLean K, Friedman S. Network firewall dynamics and the subsaturation stabilization of HIV. Discrete dynamics in nature and society. 2013;2013. pmid:25083120
  26. 26. Marshall BD, Friedman SR, Monteiro JF, Paczkowski M, Tempalski B, Pouget ER, et al. Prevention and treatment produced large decreases in HIV incidence in a model of people who inject drugs. Health Affairs. 2014;33(3):401–409. pmid:24590937
  27. 27. Escudero DJ, Lurie MN, Mayer KH, King M, Galea S, Friedman SR, et al. The risk of HIV transmission at each step of the HIV care continuum among people who inject drugs: a modeling study. BMC public health. 2017;17(1):614. pmid:28738861
  28. 28. Monteiro J, Escudero D, Weinreb C, Flanigan T, Galea S, Friedman S, et al. Understanding the effects of different HIV transmission models in individual-based microsimulation of HIV epidemic dynamics in people who inject drugs. Epidemiology & Infection. 2016;144(8):1683–1700.
  29. 29. Rolls D, Daraganova G, Sacks-Davis R, Hellard M, Jenkinson R, McBryde E, et al. Modelling hepatitis C transmission over a social network of injecting drug users. Journal of theoretical biology. 2012;297:73–87. pmid:22185979
  30. 30. Rolls DA, Sacks-Davis R, Jenkinson R, McBryde E, Pattison P, Robins G, et al. Hepatitis C transmission and treatment in contact networks of people who inject drugs. PloS one. 2013;8(11):e78286. pmid:24223787
  31. 31. Gutfraind A, Boodram B, Prachand N, Hailegiorgis A, Dahari H, Major ME. Agent-based model forecasts aging of the population of people who inject drugs in metropolitan Chicago and changing prevalence of hepatitis C infections. PloS one. 2015;10(9):e0137993. pmid:26421722
  32. 32. Wong WW, Feng ZZ, Thein HH. A parallel sliding region algorithm to make agent-based modeling possible for a large-scale simulation: modeling hepatitis C epidemics in Canada. IEEE journal of biomedical and health informatics. 2016;20(6):1538–1544. pmid:26302524
  33. 33. MacGregor L, Martin NK, Mukandavire C, Hickson F, Weatherburn P, Hickman M, et al. Behavioural, not biological, factors drive the HCV epidemic among HIV-positive MSM: HCV and HIV modelling analysis including HCV treatment-as-prevention impact. International Journal of Epidemiology. 2017;.
  34. 34. Scott N, McBryde E, Vickerman P, Martin NK, Stone J, Drummer H, et al. The role of a hepatitis C virus vaccine: modelling the benefits alongside direct-acting antiviral treatments. BMC medicine. 2015;13(1):198. pmid:26289050
  35. 35. Martin NK, Hickman M, Hutchinson SJ, Goldberg DJ, Vickerman P. Combination interventions to prevent HCV transmission among people who inject drugs: modeling the impact of antiviral treatment, needle and syringe programs, and opiate substitution therapy. Clinical Infectious Diseases. 2013;57(suppl_2):S39–S45. pmid:23884064
  36. 36. Sacks-Davis R, McBryde E, Grebely J, Hellard M, Vickerman P. Many hepatitis C reinfections that spontaneously clear may be undetected: Markov-chain Monte Carlo analysis of observational study data. Journal of The Royal Society Interface. 2015;12(104):20141197.
  37. 37. Liu S, Cipriano LE, Goldhaber-Fiebert JD. Combining Statistical Analysis and Markov Models with Public Health Data to Infer Age-Specific Background Mortality Rates for Hepatitis C Infection in the US. In: International Conference on Smart Health. Springer; 2014. p. 148–149.
  38. 38. Combellick J, Smith DJ, Jordan AE, Hagan H. Hepatitis C virus disease progression in people who inject drugs: protocol for a systematic review and meta-analysis. JMIR research protocols. 2015;4(2). pmid:26054636
  39. 39. Smith BD, Jewett A, Burt RD, Zibbell JE, Yartel AK, DiNenno E. “To share or not to share?” Serosorting by hepatitis C status in the sharing of drug injection equipment among NHBS-IDU2 participants. The Journal of infectious diseases. 2013;208(12):1934–1942. pmid:24136794
  40. 40. Smith DJ, Jordan AE, Frank M, Hagan H. Spontaneous viral clearance of hepatitis C virus (HCV) infection among people who inject drugs (PWID) and HIV-positive men who have sex with men (HIV+ MSM): a systematic review and meta-analysis. BMC infectious diseases. 2016;16(1):471. pmid:27595855
  41. 41. Smith DJ, Combellick J, Jordan AE, Hagan H. Hepatitis C virus (HCV) disease progression in people who inject drugs (PWID): A systematic review and meta-analysis. International Journal of Drug Policy. 2015;26(10):911–921. pmid:26298331
  42. 42. Khan B, Dombrowski K, Saad M. A stochastic agent-based model of pathogen propagation in dynamic multi-relational social networks. Simulation. 2014;90(4):460–484. pmid:25859056
  43. 43. Wejnert C, Raymond HF, Robbins T, Prejean J, Hall HI, McCray E, et al. Achieving Greater HIV Prevention Impact Through CDC’s National HIV Behavioral Surveillance System. JAIDS Journal of Acquired Immune Deficiency Syndromes. 2017;75:S249–S252. pmid:28604424
  44. 44. CDC. HIV infection, risk, prevention, and testing behaviors among persons who inject drugs—National HIV Behavioral Surveillance: injection drug use, 20 US cities, 2012. HIV Surveillance Special Report 2015c. 2016;11.
  45. 45. Neaigus A, Reilly KH, Jenness SM, Hagan H, Wendel T, Gelpi-Acosta C, et al. Trends in HIV and HCV Risk Behaviors and Prevalent Infection Among People Who Inject Drugs in New York City, 2005–2012. JAIDS Journal of Acquired Immune Deficiency Syndromes. 2017;75:S325–S332. pmid:28604434
  46. 46. Jordan AE, Des Jarlais DC, Arasteh K, McKnight C, Nash D, Perlman DC. Incidence and prevalence of hepatitis c virus infection among persons who inject drugs in New York City: 2006–2013. Drug and alcohol dependence. 2015;152:194–200. pmid:25891230
  47. 47. Curtis R, Friedman SR, Neaigus A, Jose B, Goldstein M, Ildefonso G. Street-level drug markets: Network structure and HIV risk. Social networks. 1995;17(3-4):229–249.
  48. 48. Smit C, van den Berg C, Geskus R, Berkhout B, Coutinho R, Prins M. Risk of hepatitis-related mortality increased among hepatitis C virus/HIV-coinfected drug users compared with drug users infected only with hepatitis C virus: a 20-year prospective study. JAIDS Journal of Acquired Immune Deficiency Syndromes. 2008;47(2):221–225. pmid:18223361
  49. 49. Spiller M, Cameron C, Heckathorn D. RDS analysis tool 7.1 user manual. Cornell University. 2012;.
  50. 50. Burt RD, Thiede H, Hagan H. Serosorting for hepatitis C status in the sharing of injection equipment among Seattle area injection drug users. Drug and alcohol dependence. 2009;105(3):215–220. pmid:19720473
  51. 51. Duncan I, Curtis R, Reyes JC, Abadie R, Khan B, Dombrowski K. Hepatitis C serosorting among people who inject drugs in rural Puerto Rico. Preventive Medicine Reports. 2017;6:38–43. pmid:28271018
  52. 52. Dombrowski K, Khan B, McLean K, Curtis R, Wendel T, Misshula E, et al. A reexamination of connectivity trends via exponential random graph modeling in two IDU risk networks. Substance use & misuse. 2013;48(14):1485–1497.
  53. 53. Boelen L, Teutsch S, Wilson DP, Dolan K, Dore GJ, Lloyd AR, et al. Per-event probability of hepatitis C infection during sharing of injecting equipment. PloS one. 2014;9(7):e100749. pmid:25000496
  54. 54. Guizani M, Rayes A, Khan B, Al-Fuqaha A. Network modeling and simulation: a practical perspective. John Wiley & Sons; 2010.
  55. 55. Wilson LE, Torbenson M, Astemborski J, Faruki H, Spoler C, Rai R, et al. Progression of liver fibrosis among injection drug users with chronic hepatitis C. Hepatology. 2006;43(4):788–795. pmid:16557548
  56. 56. Lawitz E, Mangia A, Wyles D, Rodriguez-Torres M, Hassanein T, Gordon SC, et al. Sofosbuvir for previously untreated chronic hepatitis C infection. New England Journal of Medicine. 2013;368(20):1878–1887. pmid:23607594
  57. 57. Turner KM, Hutchinson S, Vickerman P, Hope V, Craine N, Palmateer N, et al. The impact of needle and syringe provision and opiate substitution therapy on the incidence of hepatitis C virus in injecting drug users: pooling of UK evidence. Addiction. 2011;106(11):1978–1988. pmid:21615585
  58. 58. Holtzman D, Barry V, Ouellet LJ, Des Jarlais DC, Vlahov D, Golub ET, et al. The influence of needle exchange programs on injection risk behaviors and infection with hepatitis C virus among young injection drug users in select cities in the United States, 1994–2004. Preventive medicine. 2009;49(1):68–73. pmid:19410600
  59. 59. Tsui JI, Evans JL, Lum PJ, Hahn JA, Page K. Association of opioid agonist therapy with lower incidence of hepatitis C virus infection in young adult injection drug users. JAMA internal medicine. 2014;174(12):1974–1981. pmid:25347412
  60. 60. Neaigus A, Gyarmathy VA, Miller M, Frajzyngier VM, Friedman SR, Des Jarlais DC. Transitions to injecting drug use among noninjecting heroin users: social network influence and individual susceptibility. JAIDS Journal of Acquired Immune Deficiency Syndromes. 2006;41(4):493–503. pmid:16652059
  61. 61. Czitrom V. One-factor-at-a-time versus designed experiments. The American Statistician. 1999;53(2):126–131.
  62. 62. Briggs AH, Weinstein MC, Fenwick EAL, Karnon J, Sculpher MJ, Paltiel AD. Model Parameter Estimation and Uncertainty Analysis: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force Working Group–6. Medical Decision Making. 2012;32(5):722–732. pmid:22990087
  63. 63. Benhamou Y, Bochet M, Di Martino V, Charlotte F, Azria F, Coutellier A, et al. Liver fibrosis progression in human immunodeficiency virus and hepatitis C virus coinfected patients. Hepatology. 1999;30(4):1054–1058. pmid:10498659
  64. 64. Bräu N, Salvatore M, Ríos-Bedoya CF, Fernández-Carbia A, Paronetto F, Rodríguez-Orengo JF, et al. Slower fibrosis progression in HIV/HCV-coinfected patients with successful HIV suppression using antiretroviral therapy. Journal of hepatology. 2006;44(1):47–55. pmid:16182404
  65. 65. Hu KQ, Cui W. Undetectable Serum HCV Antigens After 12 Weeks of HCV DAA Treatment Predicts Sustained Virologic Response. Gastroenterology. 2017;152(5):S1092.