Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Modeling inpatient and outpatient antibiotic stewardship interventions to reduce the burden of Clostridioides difficile infection in a regional healthcare network

  • Sarah Rhea ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

    srhea@rti.org

    Affiliation RTI International, Research Triangle Park, North Carolina

  • Kasey Jones,

    Roles Conceptualization, Formal analysis, Methodology, Writing – original draft

    Affiliation RTI International, Research Triangle Park, North Carolina

  • Stacy Endres-Dighe,

    Roles Project administration, Writing – original draft

    Affiliation RTI International, Research Triangle Park, North Carolina

  • Breda Munoz,

    Roles Conceptualization, Data curation, Formal analysis, Writing – original draft

    Affiliation RTI International, Research Triangle Park, North Carolina

  • David J. Weber,

    Roles Conceptualization, Data curation, Funding acquisition, Methodology, Writing – review & editing

    Affiliation UNC Health Care, Chapel Hill, North Carolina

  • Rainer Hilscher,

    Roles Conceptualization, Funding acquisition, Supervision, Writing – original draft, Writing – review & editing

    Affiliation RTI International, Research Triangle Park, North Carolina

  • Jennifer MacFarquhar,

    Roles Conceptualization, Data curation, Funding acquisition, Methodology, Writing – review & editing

    Affiliations North Carolina Department of Health and Human Services, Raleigh, North Carolina, Career Epidemiology Field Officer Program, Division of State and Local Readiness, Center for Preparedness and Response, Centers for Disease Control and Prevention, Atlanta, Georgia

  • Emily Sickbert-Bennett,

    Roles Conceptualization, Data curation, Funding acquisition, Methodology, Writing – review & editing

    Affiliation UNC Health Care, Chapel Hill, North Carolina

  • Lauren DiBiase,

    Roles Conceptualization, Data curation, Funding acquisition, Methodology, Writing – review & editing

    Affiliation UNC Health Care, Chapel Hill, North Carolina

  • Ashley Marx,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliations UNC Health Care, Chapel Hill, North Carolina, UNC Eshelman School of Pharmacy, Chapel Hill, North Carolina

  • James Rineer,

    Roles Conceptualization, Data curation, Funding acquisition, Methodology, Writing – review & editing

    Affiliation RTI International, Research Triangle Park, North Carolina

  • James Lewis,

    Roles Methodology, Writing – review & editing

    Affiliation North Carolina Department of Health and Human Services, Raleigh, North Carolina

  • Georgiy Bobashev,

    Roles Conceptualization, Data curation, Funding acquisition, Methodology, Writing – review & editing

    Affiliation RTI International, Research Triangle Park, North Carolina

  • for the CDC MInD-Healthcare Network

    Human subjects’ statement: This study was approved by the Institutional Review Boards at the University of North Carolina at Chapel Hill and RTI International.

Abstract

Antibiotic exposure can lead to unintended outcomes, including drug-drug interactions, adverse drug events, and healthcare-associated infections like Clostridioides difficile infection (CDI). Improving antibiotic use is critical to reduce an individual’s CDI risk. Antibiotic stewardship initiatives can reduce inappropriate antibiotic prescribing (e.g., unnecessary antibiotic prescribing, inappropriate antibiotic selection), impacting both hospital (healthcare)-onset (HO)-CDI and community-associated (CA)-CDI. Previous computational and mathematical modeling studies have demonstrated a reduction in CDI incidence associated with antibiotic stewardship initiatives in hospital settings. Although the impact of antibiotic stewardship initiatives in long-term care facilities (LTCFs), including nursing homes, and in outpatient settings have been documented, the effects of specific interventions on CDI incidence are not well understood. We examined the relative effectiveness of antibiotic stewardship interventions on CDI incidence using a geospatially explicit agent-based model of a regional healthcare network in North Carolina. We simulated reductions in unnecessary antibiotic prescribing and inappropriate antibiotic selection with intervention scenarios at individual and network healthcare facilities, including short-term acute care hospitals (STACHs), nursing homes, and outpatient locations. Modeled antibiotic prescription rates were calculated using patient-level data on antibiotic length of therapy for the 10 modeled network STACHs. By simulating a 30% reduction in antibiotics prescribed across all inpatient and outpatient locations, we found the greatest reductions on network CDI incidence among tested scenarios, namely a 17% decrease in HO-CDI incidence and 7% decrease in CA-CDI. Among intervention scenarios of reducing inappropriate antibiotic selection, we found a greater impact on network CDI incidence when modeling this reduction in nursing homes alone compared to the same intervention in STACHs alone. These results support the potential importance of LTCF and outpatient antibiotic stewardship efforts on network CDI burden and add to the evidence that a coordinated approach to antibiotic stewardship across multiple facilities, including inpatient and outpatient settings, within a regional healthcare network could be an effective strategy to reduce network CDI burden.

1. Introduction

Since 1978 when Clostridioides difficile (C. difficile) was first recognized as a cause of antibiotic-associated diarrhea and pseudomembranous colitis, C. difficile infection (CDI) has become the most common healthcare-associated infection (HAI) in the United States and is costly to the healthcare system [1]. Nonmodifiable CDI risk factors, like patient age and comorbidities (e.g., organ transplant, chronic renal disease, inflammatory bowel disease) have been described elsewhere [2]. However, a focus of prevention is to address established, modifiable CDI risk factors, specifically, exposure to antibiotics [2].

Exposure to antibiotics is associated with an increased risk of CDI [3]. Different antibiotics are associated with different levels of CDI risk. A meta-analysis quantified the risk of developing CDI in hospitalized patients receiving particular classes of antibiotics compared to those receiving no antibiotics [3]. Results from this meta-analysis support classification of clindamycin (associated CDI odds ratio (OR) = 16.8, 95% confidence interval (CI) 7.5 to 37.8), carbapenems and any cephalosporin (OR = 5.7, 95% CI 2.1 to 15.2), and fluroquinolones (OR = 5.5, 95% CI 4.3 to 7.1) as “high risk” CDI antibiotics, while penicillin combinations (OR = 2.7, 95% CI 1.8 to 4.2)  and trimethoprim/sulfonamides (OR = 1.8, 95% CI 1.3 to 2.4) can be classified as “moderate risk” CDI antibiotics [3]. Other antibiotics are considered lower risk for CDI [4]. The types of antibiotics prescribed and, therefore, the relative proportions of high-risk, moderate-risk, and low-risk antibiotics prescribed, can vary across healthcare settings (i.e., inpatient settings versus outpatient settings).

Improving antibiotic use is critical, not only to reduce an individual patient’s CDI risk, but also to mitigate emerging antibiotic resistance [5]. In U.S. acute care hospitals, 30%–50% of all prescribed antibiotics are considered inappropriate [611]. Inappropriate antibiotic prescribing can be defined as (1) unnecessary antibiotic prescribing (e.g., prescribing an antibiotic for a viral infection); (2) inappropriate antibiotic selection (e.g., prescribing an antibiotic associated with a higher risk of CDI when a lower risk antibiotic would be as or more effective); (3) inappropriate dose or duration of therapy; or (4) inappropriate antibiotic route of administration [12].

Efforts to reduce inappropriate antibiotic prescribing include antibiotic stewardship initiatives [13]. Antibiotic stewardship refers to a set of coordinated strategies designed to enhance patient health outcomes, reduce resistance to antibiotics, and decrease unnecessary costs [14]. Historically, antibiotic stewardship initiatives have focused on inpatient settings, especially within short-term acute care hospitals (STACHs). However, these efforts are expanding to long-term care facilities (LTCFs) (i.e., nursing homes and long-term acute care hospitals (LTACHs)) and outpatient settings in the community [13]. Antibiotic stewardship initiatives aimed at reducing inappropriate antibiotic selection, and restricting exposure to CDI high-risk antibiotics when lower risk antibiotics are appropriate, have proven effective in preventing CDI within STACHs [15]. Although emerging evidence documents the impact of antibiotic stewardship initiatives in LTCFs and in outpatient settings, the effects of specific interventions in these settings on CDI incidence are not well understood [16, 17].

The overall burden and transmission dynamics of C. difficile may be influenced by community sources and person movement among healthcare facilities [1820]. Given this interconnectedness, a coordinated approach to antibiotic stewardship (i.e., implementation of interventions at multiple facilities, rather than at individual facilities) across a regional healthcare network may be most effective in reducing the overall burden of CDI in a region.

Agent-based models (ABMs) can capture the complexities of person movement among healthcare facilities and the communities they serve. Increasingly, ABMs are used to assess HAI prevention interventions, including antibiotic stewardship, which can inform decision making in public health and healthcare settings. Previous ABMs have demonstrated the reduction of CDI incidence associated with antibiotic stewardship initiatives in inpatient settings [21] and the benefits of a coordinated approach to interventions across inpatient settings in reducing incidence of CDI and other HAIs [22]. However, ABMs can also be used to estimate the impact of antibiotic stewardship efforts in LTCFs and outpatient settings and the effect of a coordinated antibiotic stewardship approach across regional healthcare networks.

We developed a geospatially explicit ABM of a regional healthcare network in North Carolina (NC) capable of examining the relative effectiveness of antibiotic stewardship interventions on CDI incidence [23]. We simulated reductions in unnecessary antibiotic prescribing and inappropriate antibiotic selection with intervention scenarios at individual and network healthcare facilities, including STACHs, LTCFs, and outpatient settings. Antibiotic exposure assigned to agents located in the community was conceptualized as the agent being “prescribed” the antibiotic at an outpatient healthcare facility. We estimated the effect of these interventions on hospital (healthcare) onset (HO)- and community acquired (CA)-CDI incidence trends across multiple simulations and discuss how this information could be used to inform antibiotic stewardship efforts across a regional healthcare network.

2. Methods

This study was approved by the Institutional Review Boards at the University of North Carolina at Chapel Hill and RTI International.

2.1 Regional healthcare network ABM with a CDI disease model

We previously developed a geospatially explicit ABM to simulate patient movement within a major regional healthcare network in NC, UNC Health Care [23]. UNC Health Care provides care for over 975,000 patients annually and is one of the largest healthcare systems in NC, with a catchment area of 5.9 million people across 41 counties [24, 25]. The ABM includes an academic medical center (UNC Hospitals [929 total beds]) and 9 affiliate hospitals (ranging from 81 to 665 total beds) [26]. We used a baseline synthetic population of NC, constructed using documented methods and code, which serve as agents for the ABM (S1 File) [23]. With a synthetic population approach, our ABM is effectively tied to actual geographies and populations and extends beyond single hospitals to include entire systems of communities and their associated healthcare networks [23]. Healthcare networks are groupings of related hospitals and other healthcare facilities that may be based on geopolitical boundaries (e.g., states), catchment areas (i.e., communities from which patients are drawn), and organizational structures (e.g., academic-affiliated medical campuses) [23].

Agents in the ABM represent >10.2 million NC residents [24]. Each agent can move among STACHs, LTACHs, nursing homes, and the community. Agents located in the community node can be conceptualized to be anywhere in the community other than an STACH, LTACH, or nursing home (e.g., home, outpatient healthcare facility). The ABM has a 1-day timestep and 1-year time horizon.

We updated the published ABM [23] by explicitly implementing 544 locations (i.e., location nodes), as follows: 10 regional network UNC STACH nodes (i.e., UNC Hospitals and 9 affiliate hospitals) [26]; 102 non-UNC STACH nodes (i.e., all 102 licensed STACHs in NC not affiliated with UNC Health Care) [27]; 421 nursing home nodes (representing the 421 NC licensed nursing homes) [28]; 10 LTACH nodes (representing the 10 NC licensed LTACHs) [27]; and 1 community node. We parameterized agent movement among the 544 location nodes using (1) de-identified patient-level data (UNC Health Care admissions during July 1, 2016─June 30, 2017), including length of stay (LOS); [23]; (2) publicly-available aggregate hospital discharge data for NC [25, 29]; (3) published demographic characteristics of nursing home residents and LTACH patients [30, 31]; (4) LOS distributions for nursing home patients according to Centers for Medicare & Medicaid Services (CMS) 2016 national patient-level fee-for-service claims data for CMS beneficiaries (subsequently referred to as CMS 2016 data); and (5) publicly-available NC licensed healthcare facility characteristics (i.e., geographic location, capacity, occupancy) [27, 3033], as described in S1 File (see v. Process overview and scheduling). We calibrated agent movement according to the CMS 2016 data using methods described previously [34] and in S1 File (see viv. Model verification, validation, and calibration).

We implemented a CDI disease model for each agent, with daily transition probabilities between disease states [23]. In the CDI disease model, agents exist in one of the following four disease states: susceptible, colonized, CDI, or dead (Fig 1). C. difficile asymptomatic colonization was a necessary step to develop CDI [35]. Transitions between disease states were dependent on an agent’s current location and other risk factors, including age, presence of comorbidities, and antibiotic exposure [23, 3638] (Table 1). Transition to colonization was also dependent on the burden of colonization and CDI at the agent’s location (S1 File) [23, 38].

thumbnail
Fig 1. Clostridioides difficile natural history states (CDI: Clostridioides difficile infection).

https://doi.org/10.1371/journal.pone.0234031.g001

thumbnail
Table 1. Select1 Clostridioides difficile disease state and antibiotic parameter values.

https://doi.org/10.1371/journal.pone.0234031.t001

2.2 Modeling antibiotic exposure

Each agent in the ABM existed in a dynamic, binary state of antibiotic exposure (i.e., with antibiotic exposure [during the antibiotic course and for 90 days following the completion of the course] or without antibiotic exposure). Daily probabilities of antibiotic exposure were informed by agent location and age [38]. Antibiotic exposure assigned to agents located in STACH, LTACH, or nursing home nodes was conceptualized as the agent being “prescribed” the antibiotic at that healthcare facility. Antibiotic exposure assigned to agents located in the community node was conceptualized as the agent being “prescribed” the antibiotic at an outpatient healthcare facility.

We used patient-level data to calculate antibiotic prescribing rates and length of therapy (LOT) per 1,000 patient-days in each of the seven network STACHs for which patient-level data were available from UNC Health Care [39, 40]. LOT was selected as the antibiotic consumption metric for this study, as it represents days of antibiotic exposure without regard to the number of antibiotics used. Specifically, we defined LOT as the number of days that a patient received systemic antibiotics during their admission (i.e., duration of antibiotic use), regardless of the number of antibiotics received. For each of the three network STACHs for which patient-level data were not available, we assigned the mean LOT value of the network STACH(s) in the same intensive care unit bed category [41, 42]. We selected categorization by intensive care unit bed size, as it is commonly employed for HAI public health surveillance activities [41, 42].

When an agent was assigned to antibiotic exposure, this assignment included (1) an antibiotic course duration and (2) an antibiotic risk level (i.e., low-, moderate-, or high-risk antibiotic) (Table 1). Agents with antibiotic exposure were at increased risk of CDI according to static risk ratios (RRs) associated with each antibiotic risk level, selected to simulate varied risk corresponding to different antibiotic classes, during the antibiotic course and for 90 days following the completion of the course [3, 4, 43, 44]. We used patient-level data from UNC Health Care to inform the relative antibiotic risk level proportions applied to each location; each location’s proportion of low-, moderate-, and high-risk antibiotics prescribed summed to one [38, 45]. Each agent’s antibiotic-associated risk of CDI exponentially decreased during day 30 to day 90. No antibiotic-associated CDI risk was modeled by day 91 following completion of antibiotic course (S1 File).

An agent could only be assigned a new course of antibiotics once it completed an existing course. However, a new course could be initiated at any other time, including during the 90-day residual risk period. If an agent received a subsequent antibiotic assignment during the residual risk period of a previously completed antibiotic course, the agent was assigned the higher of the two possible antibiotic risk levels for the antibiotic course duration.

We calibrated the ABM to reproduce both colonization prevalence rates and antibiotic exposure rates by location [23, 38, 46] (S1 File). Subsequently, we calibrated the ABM to reproduce the following CDI incidence targets: (1) HO-CDI according to NC-specific National Healthcare Surveillance Network C. difficile lab event data by hospital; (2) published community onset (CO)-CDI incidence [4749]; (3) published CA-CDI incidence [5053]; and (4) published healthcare associated (HA)-CDI incidence [5053]. We assigned a small number of agents to transition CDI within their first 3 days of admission to a healthcare facility to meet CO-CDI incidence calibration targets (S1 File). We used established CDI case definitions, adapted to the context of this ABM, with each CDI case defined (1) as either CO-CDI or HO-CDI and (2) as either CA-CDI or HA-CDI (S1 File). Specifically, we defined a CDI case as CO-CDI if the agent transitioned to the CDI disease state fewer than 3 days after admission to a healthcare facility (STACH, LTACH, nursing home), and HO-CDI if the agent transitioned to the CDI disease state at least 3 days after admission to a healthcare facility (STACH, LTACH, nursing home) [47]. Additionally, we defined a CDI case as CA-CDI if the agent transitioned to the CDI disease state while in the community node or within 3 days after admission to a healthcare facility (STACH, LTACH, nursing home) and the agent had not been admitted to a healthcare facility in the preceding 12 weeks; all CDI cases that did not meet these CA-CDI criteria were classified as HA-CDI [51, 52]. We considered CDI cases that transitioned to the CDI disease state between 2 and 8 weeks of the last CDI disease state transition to be recurrent episodes and CDI cases that transitioned to the CDI disease state less than 2 weeks since the last CDI disease state transition to be duplicate episodes; all others were considered incident cases [51, 52].

2.3 Antibiotic stewardship interventions

We modeled two antibiotic stewardship interventions, each representing a decrease in inappropriate antibiotic use, as follows: (1) reduction in total antibiotics prescribed at individual facility types alone and across all network facilities (i.e., coordinated stewardship approach) (five scenarios total); (2) reduction in CDI high-risk antibiotics, in favor of CDI moderate-risk antibiotics, prescribed at individual facility types (two scenarios total).

2.3.1. Reduction in total antibiotics prescribed.

We developed five scenarios exploring the impact of a reduction in antibiotics prescribed at individual healthcare facility types and across healthcare facility types, representing a coordinated stewardship approach, as follows: (1) network STACHs only; (2) nursing homes only; (3) outpatient facilities only; (4) all network STACHs and nursing homes; and (5) all network inpatient and outpatient facilities (i.e., STACHs, nursing homes, LTACHs, and outpatient locations). For each scenario, the total antibiotics prescribed were reduced by 10%, 20%, and 30%. Of note, across the network the absolute decrease in the number of antibiotics prescribed differed with each of these scenarios. For example, a 10% decrease in total antibiotics prescribed in STACHs and a 10% decrease in total antibiotics prescribed in nursing homes are not equal in terms of the number of antibiotic doses averted. We selected a 30% reduction as the maximum reduction possible in our simulated interventions, as at least 30% of antibiotics prescribed in outpatient setting in the United States are reportedly inappropriate [54].

2.3.2 Reduction in high-risk antibiotics prescribed.

We developed two scenarios exploring the impact of a reduction in high-risk antibiotics prescribed at individual facility types: (1) network STACHs, and (2) nursing homes. For each scenario, the relative proportion of CDI high-risk antibiotics was reduced by 0.1, with a concordant 0.1 increase in moderate-risk antibiotics prescribed, and by 0.2, with a concordant 0.2 increase in moderate-risk antibiotics prescribed.

We conducted 40 runs for each scenario using the entire NC synthetic population (>10.2 million agents) as microdata input to the ABM to account for the complex movement of agents throughout the state. We defined the following model outcomes for the 41-county catchment area of the network [23] to assess the relative effectiveness of each intervention, as follows: HO-CDI incidence per 10,000 patient-days in network STACHs (i.e., the 10 STACHs of UNC Health Care), HO-CDI incidence per 10,000 patient-days in nursing homes, HO-CDI incidence per 10,000 patient-days in network inpatient healthcare facilities (i.e., 10 STACHs of UNC Health Care, nursing homes, and LTACHs), and CA-CDI incidence per 100,000 population. Incidence measures are presented as a mean, with range based on standard deviation and 95% CIs, of the multiple model runs. We calculated percent change in CDI incidence to compare each intervention to baseline (i.e., no intervention), which corresponds to the data that were used to design the ABM and reflects established antibiotic prescribing.

3. Results

3.1 Antibiotic prescribing rates in network STACHs

Antibiotic prescribing rates among admissions to the seven UNC STACHs for which data existed (i.e., Hospitals 1–7) ranged from 251 LOT per 1,000 patient-days to 450 LOT per 1,000 patient-days (Table 2).

thumbnail
Table 2. Antibiotic prescribing rates and length of therapy (LOT) per 1,000 patient-days among admissions to network short-term acute care hospitals (STACHs).

https://doi.org/10.1371/journal.pone.0234031.t002

3.2 Reduction in total number of antibiotics prescribed

As the total number of antibiotics prescribed within network STACHs and nursing homes decreased by 10%, 20%, and 30%, the HO-CDI incidence in the ABM also decreased within that location category (Fig 2A and 2B). Specifically, as antibiotics prescribed in STACHs decreased by 30%, the STACH HO-CDI incidence decreased by 10%, from 7.0 cases per 10,000 patient-days (95% CI 6.3–7.7 cases per 10,000 patient-days) to 6.3 cases per 10,000 patient-days (95% CI 5.6–7.0 cases per 10,000 patient-days) (Fig 2A). As the antibiotics prescribed in nursing homes decreased by 30%, the nursing home HO-CDI incidence decreased by 17%, from 8.4 cases per 10,000 patient-days (95% CI 7.1–9.8 cases per 10,000 patient-days) to 7.0 cases per 10,000 patient-days (95% CI 5.9–8.2 cases per 10,000 patient-days) (Fig 2B).

thumbnail
Fig 2. Clostridioides difficile infection (CDI) incidence and reductions in total number of antibiotics prescribed.

Scenarios for reduction in total number of antibiotics prescribed are as follows: (A) at network STACHs only; (B) at nursing homes only; (C) at outpatient facilities only; (D) at all network STACHs and nursing homes; and (E) at all network inpatient (i.e., STACHs, nursing homes, LTACHs) and outpatient facilities. For each scenario, the total antibiotics prescribed were reduced by 10%, 20%, and 30%. Results are based on 40 runs for each scenario. Error bars indicate 95% confidence intervals on the percent change. (STACH: short-term acute care hospital; LTACH: long-term acute care hospital; HO-CDI: hospital (healthcare) onset-CDI; CA-CDI: community associated-CDI).

https://doi.org/10.1371/journal.pone.0234031.g002

As the total number of antibiotics prescribed in STACHs decreased by 30%, the network HO-CDI incidence decreased by 2%, from 8.6 cases per 10,000 patient-days (95% CI 7.3–9.8 cases per 10,000 patient-days) to 8.4 cases per 10,000 patient-days (95% CI 7.2–9.6 cases per 10,000 patient-days) (Fig 2A). Similarly, as the antibiotics prescribed in nursing homes decreased by 30%, network HO-CDI incidence decreased by 14%, to 7.4 cases per 10,000 patient-days (95% CI 6.3–8.4 cases per 10,000 patient-days) (Fig 2B). With a reduction in outpatient antibiotics only, we observed a minimal reduction (1%) in CDI incidence at other network locations (Fig 2C).

With a coordinated stewardship approach across all network STACHs and nursing homes in the ABM, a 30% reduction in antibiotics prescribed resulted in a 17% decrease in network HO-CDI incidence, to 7.1 cases per 10,000 patient-days (95% CI 6.1–8.1 cases per 10,000 patient-days) and a 3% decrease in CA-CDI incidence, from 122.8 cases per 100,000 person-years (95% CI 108.8–136.8 per 100,000 person-years) to 119.6 cases per 100,000 person-years (95% CI 105.9–133.2 per 100,000 person-years) (Fig 2D). With a coordinated stewardship approach across all network inpatient and outpatient locations, reducing the antibiotics prescribed by 30%, there was a 17% decrease in network HO-CDI incidence, to 7.1 cases per 10,000 patient-days (95% CI 6.1–8.1 cases per 10,000 patient-days) and a 7% decrease in CA-CDI incidence, to 114.2 cases per 100,000 person-years (95% CI 101.0–127.3 cases per 100,000 person-years) in the ABM (Fig 2E).

With this intervention scenario, we observed occasional increases in CDI incidence. Specifically, we observed a 0.1% increase in nursing home HO-CDI incidence with a 10% reduction in total antibiotics prescribed in network STACHs (Fig 2A). With 10% and 30% reductions in total antibiotics prescribed in nursing homes, we observed 2% increases in STACH HO-CDI incidence (Fig 2B). We observed a 1% increase in STACH HO-CDI incidence with a 20% reduction in total antibiotics prescribed in outpatient facilities (Fig 2C).

3.3 Reduction in antibiotic risk

As the relative proportion of high-risk antibiotics prescribed in STACHs decreased by 0.2 (in favor of moderate-risk antibiotics), the STACH HO-CDI incidence decreased by 14%, to 6.1 cases per 10,000 patient-days (95% CI 5.4–6.6 cases per 10,000 patient-days), and the network HO-CDI incidence decreased by 2%, to 8.4 cases per 10,000 patient-days (95% CI 7.2–9.6 cases per 10,000 patient-days) (Fig 3A). Similarly, as the relative proportion of high-risk antibiotics prescribed in nursing homes decreased by 0.2 (in favor of moderate-risk antibiotics), the nursing home HO-CDI incidence decreased by 8%, to 7.7 cases per 10,000 patient-days (95% CI 6.5–8.9 cases per 10,000 patient-days), and the network HO-CDI incidence decreased by 7%, to 7.9 cases per 10,000 patient-days (95% CI 6.8–9.1 cases per 10,000 patient-days) (Fig 3B). With a reduction in high-risk antibiotics prescribed in nursing homes, we observed a 1% increase in STACH HO-CDI incidence and a 0.3% increase in CA-CDI incidence (Fig 3B).

thumbnail
Fig 3. Clostridioides difficile infection (CDI) incidence and reductions in high-risk antibiotics prescribed.

Scenarios as follows: (A) at network STACHs only; and (B) at nursing homes only. For each scenario, the relative proportion of CDI high-risk antibiotics was reduced by 0.1, in favor of a 0.1 increase in moderate-risk antibiotics prescribed, and by 0.2, in favor of a 0.2 increase in moderate-risk antibiotics prescribed. Results are based on 40 runs for each scenario. Error bars indicate 95% confidence intervals on the percent change. (STACH: short-term acute care hospital; HO-CDI: hospital (healthcare) onset-CDI; CA-CDI: community associated-CDI).

https://doi.org/10.1371/journal.pone.0234031.g003

4. Discussion

We implemented antibiotic stewardship interventions in a geospatially explicit ABM of a regional healthcare network and examined the relative effectiveness of these interventions on CDI incidence compared to baseline. Our ABM demonstrated relative changes in CDI incidence based on simulated antibiotic stewardship initiatives to (1) reduce unnecessary antibiotics at individual facility types compared to a coordinated approach across network locations; and (2) reduce inappropriate antibiotic selection in STACHs and in nursing homes. Although modest, the general trends in CDI incidence reduction and the relationships between implementation at individual facility types and other network locations are apparent.

We observed a greater impact on network HO-CDI by simulating a reduction in antibiotic prescribing in nursing homes alone (14% HO-CDI reduction) compared to the same intervention in STACHs alone (2% HO-CDI reduction). This finding is notable considering that the absolute number of antibiotic courses prescribed in our ABM varies by healthcare facility type. During a typical run of the ABM, the number of antibiotic courses initiated in STACHs is approximately seven-times greater than the number of antibiotic courses initiated in nursing homes. Therefore, a 30% reduction in total antibiotics administered in network STACHs is a larger reduction in the absolute number of antibiotic doses than a 30% reduction in total antibiotics administered in nursing homes. However, the nursing home LOS (mean: 95 days) is longer than the STACH LOS (range of means: 4.3–6.6 days) in the ABM (S1 File) [23]. Agents in nursing homes are, therefore, at increased CDI risk for a longer time period compared to agents at STACHs. Additionally, these agents who are prescribed antibiotics will likely remain in a nursing home for most their antibiotic exposure time, increasing their CDI risk because of facility-based transmission rates (S1 File) compared to agents discharged to their homes. Finally, agents in nursing homes are inherently at increased risk of CDI due to their age (≥65 years of age).

By simulating a reduction in inappropriate antibiotic selection, we estimated a relative reduction in CDI high-risk antibiotics prescribed, in favor of moderate-risk antibiotics, in STACHs and nursing homes. In these simulations, the interventions focused at nursing homes alone resulted in a larger impact on CDI incidence, compared to similar interventions at network STACHs alone. Again, this finding can largely be explained by the longer LOS for agents in nursing homes, compared to STACHs, in the ABM and their inherent increased risk of CDI due to age.

With each of the two antibiotic stewardship interventions modeled, we observed occasional simulation results of increased CDI incidence. For the intervention scenario of reducing total antibiotics prescribed, these observations were inconsistent across percent reductions (Fig 2A, 2B and 2C). For example, 10%, 20%, and 30% reductions in total antibiotics prescribed in nursing homes resulted in a 2% increase, a 2% decrease, and a 2% increase, respectively, in STACH HO-CDI incidence (Fig 2B). Similarly, the greater the reduction in high-risk antibiotics prescribed in nursing homes, the smaller the increase in STACH HO-CDI incidence (Fig 3B). This may be related to random variation during simulations. In the future, we will consider conducting additional simulation runs, beyond the 40 simulation runs presented here, to further investigate this variation.

Among our interventions for reduced antibiotic prescribing, we found a maximum impact on CDI incidence when modeling the intervention across all network inpatient and outpatient locations, with a 17% reduction in network HO-CDI incidence and a 7% reduction in CA-CDI incidence. These results support a coordinated approach to antibiotic stewardship across multiple facilities and facility types as an effective strategy to reduce the burden of CDI in regional healthcare networks [55, 56].

This modeling study is unique in considering outpatient prescribing, conceptualized as agents located in the community node being “prescribed” the antibiotic at an outpatient location. Healthcare facilities within a network are interconnected with each other and their catchment areas through person movement. By including the community in our ABM, this study brings an enhanced understanding of the potential impact of antibiotic stewardship interventions on CDI incidence in the community. This not only provides additional nuance to our interpretations but also makes the ABM more realistic, which could aid in translation of findings to public health and healthcare stakeholders, especially those who are unfamiliar with ABMs.

We calculated daily antibiotic prescribing rates at network STACHs using patient-level data from UNC Health Care, which varied slightly across facility intensive care unit bed categories. Although the impact of this variability is not established, future work could include evaluating the sensitivity of the model output to variable daily prescribing rates across different healthcare facility types (e.g., tertiary care versus critical access STACH). Further, these daily prescribing rates could be informed by data from other healthcare systems in other regions.

There are several limitations to the study. Our results suggest modest relative effects that make some scenario comparisons challenging to interpret. For example, a reduction in antibiotics prescribed at STACHs alone resulted in a 14% reduction in STACH HO-CDI incidence, while a reduction in antibiotics prescribed across all network locations produced only an 11% reduction in STACH HO-CDI incidence. This counterintuitive finding can be explained by the negligible difference between the actual HO-CDI incidence values, which are quite similar over the 40 model simulations (6.0 cases per 10,000 patient-days and 6.2 cases per 10,000 patient-days, respectively). This may also be related to random variation during simulations or to the antibiotic assignment rules that we employed (e.g., an agent could only be assigned a new course of antibiotics once it completed an existing course). In the future, we will consider conducting additional simulation runs, beyond the 40 simulation runs presented here, to further investigate this variation. Although community administration of antibiotics did not increase the likelihood that an agent was transferred to a healthcare facility, this update could be implemented in subsequent iterations of the ABM. Finally, other types of models (e.g., deterministic differential equation model) could arguably be used to evaluate antibiotic stewardship interventions as presented in this manuscript. However, we view these interventions and our results as initial steps in our effort to use this ABM to study a variety of simulated interventions as follow-on studies.

We employed the antibiotic stewardship interventions uniformly across all 10 network STACHs, but this does not impart the maximum possible variation that the ABM can provide across these 10 sites. Similarly, outpatient prescribing was treated uniformly across the community location node. However, variability in outpatient prescribing varies by geography and facility type [46]. We assumed that the interventions were implemented with perfect specificity, only reducing inappropriate antibiotic prescribing and not appropriate antibiotic prescribing.

We evaluated the two antibiotic stewardship interventions independently. Realistically, these interventions would be applied in coordination and to varying degrees across individual facilities and multiple facilities, as stewardship efforts should be directed toward the most relevant factors applicable to that setting [57]. Future simulations will address these limitations by accounting for variability in prescribing practices across locations and by exploring implementation of antibiotic stewardship interventions at single STACHs of different types (e.g., tertiary care, critical access) on incidence of C. difficile and other HAI pathogens. We conceptualized reduction of inappropriate antibiotic use as shifts from higher-risk to moderate-risk CDI antibiotics. The impact of successful antibiotic stewardship efforts at different facility types will lead to greater variation in proportions of low, moderate, and high-risk CDI antibiotics than was modeled in this study.

All antibiotic prescribers and healthcare facilities are responsible for antibiotic stewardship efforts. This responsibility includes a determination if antibiotics are necessary and, if so, the optimal antibiotic selection, dose, duration, and route [12]. Antibiotic stewardship efforts may be maximized if implemented across multiple healthcare facilities serving a population. Our findings build on the established modeling literature that supports the effectiveness of a coordinated approach for antibiotic stewardship across multiple facilities. This study also uniquely demonstrates the added impact of antibiotic stewardship interventions in LTCF and outpatient locations across a regional healthcare network for a reduction in the burden of HAIs.

Supporting information

S1 File. Overview, Design concepts, and Details (ODD).

https://doi.org/10.1371/journal.pone.0234031.s001

(DOCX)

Acknowledgments

We would like to thank Pooja Iyer of RTI International for her assistance with data analysis for this manuscript; Heather Dubendris, formerly of the North Carolina Department of Health and Human Services, for her assistance in developing the original CDI disease state model; and Rachel Slayton, Hannah Wolford, and Prabasaj Paul of CDC for providing support for modeling patient movement.

References

  1. 1. Freeman J, Bauer MP, Baines SD, Corver J, Fawley WN, Goorhuis B, et al. The changing epidemiology of Clostridium difficile infections. Clin Microbiol Rev. 2010 Jul;23(3): 529–549. pmid:20610822
  2. 2. Cohen SH, Gerding DN, Johnson S, Kelly CP, Loo VG, McDonald LC, et al. Clinical practice guidelines for Clostridium difficile infection in adults: 2010 update by the Society for Healthcare Epidemiology of America (SHEA) and the Infectious Diseases Society of America (IDSA). Infect Control Hosp Epidemiol. 2010 May;31(5): 431–455. pmid:20307191
  3. 3. Slimings C, Riley TV. Antibiotics and hospital-acquired Clostridium difficile infection: update of systematic review and meta-analysis. J Antimicrob Chemother. 2014 Apr;69(4): 881–891. pmid:24324224
  4. 4. Vardakas KZ, Trigkidis KK, Boukouvala E, Falagas ME. Clostridium difficile infection following systemic antibiotic administration in randomised controlled trials: a systematic review and meta-analysis. International journal of antimicrobial agents. 2016 Jul;48(1): 1–10. pmid:27216385
  5. 5. Centers for Disease Control and Prevention. Antibiotic resistance threats in the United States, 2013. 2013 [cited July 31 2019]. Atlanta, GA: CDC. Available: https://www.cdc.gov/drugresistance/threat-report-2013/pdf/ar-threats-2013-508.pdf.
  6. 6. Dellinger RP, Levy MM, Rhodes A, Annane D, Gerlach H, Opal SM, et al. Surviving Sepsis Campaign: international guidelines for management of severe sepsis and septic shock, 2012. Intensive Care Med. 2013 Feb;39(2): 165–228. pmid:23361625
  7. 7. Ingram PR, Seet JM, Budgeon CA, Murray R. Point-prevalence study of inappropriate antibiotic use at a tertiary Australian hospital. Internal medicine journal. 2012 Jun;42(6): 719–721. pmid:22697156
  8. 8. Levin PD, Idrees S, Sprung CL, Weissman C, Weiss Y, Moses AE, et al. Antimicrobial use in the ICU: indications and accuracy—an observational trial. Journal of hospital medicine. 2012 Nov-Dec;7(9): 672–678. pmid:22865497
  9. 9. Patel SJ, Oshodi A, Prasad P, Delamora P, Larson E, Zaoutis T, et al. Antibiotic use in neonatal intensive care units and adherence with Centers for Disease Control and Prevention 12 Step Campaign to Prevent Antimicrobial Resistance. The Pediatric infectious disease journal. 2009 Dec;28(12): 1047–1051. pmid:19858773
  10. 10. Dellit TH, Owens RC, McGowan JE Jr., Gerding DN, Weinstein RA, Burke JP, et al. Infectious Diseases Society of America and the Society for Healthcare Epidemiology of America guidelines for developing an institutional program to enhance antimicrobial stewardship. Clin Infect Dis. 2007 Jan 15;44(2): 159–177. pmid:17173212
  11. 11. Fridkin S, Baggs J, Fagan R, Magill S, Pollack LA, Malpiedi P, et al. Vital signs: improving antibiotic use among hospitalized patients. MMWR Morbidity and mortality weekly report. 2014 Mar 7;63(9): 194–200. pmid:24598596
  12. 12. Hersh AL, Kronman MP. Inappropriate antibiotic prescribing: wind at our backs or flapping in the breeze? Pediatrics. 2017 Apr;139(4): pmid:28270547
  13. 13. Centers for Disease Control and Prevention. Antibiotic prescribing and use. 2018 [cited July 31 2019]. Atlanta, GA: CDC. Available: https://www.cdc.gov/antibiotic-use/index.html.
  14. 14. Society for Healthcare Epidemiology of America (SHEA). Antimicrobial stewardship. 2019 [cited July 31 2019]. Arlington, VA: SHEA. Available: https://www.shea-online.org/index.php/practice-resources/priority-topics/antimicrobial-stewardship.
  15. 15. Feazel LM, Malhotra A, Perencevich EN, Kaboli P, Diekema DJ, Schweizer ML. Effect of antibiotic stewardship programmes on Clostridium difficile incidence: a systematic review and meta-analysis. J Antimicrob Chemother. 2014 Jul;69(7): 1748–1754. pmid:24633207
  16. 16. Mushtaq A, Awali RA, Chandramohan S, Krishna A, Biedron C, Jegede O, et al. Implementing an antibiotic stewardship program at a long-term acute care hospital in Detroit, Michigan. Am J Infect Control. 2017 Dec 1;45(12): e157–e160. pmid:29031431
  17. 17. Centers for Disease Control and Prevention. Nursing homes and assisted living (long-term care facilities [LTCFs]). Core elements of antibiotic stewardship. 2017 February 28 [cited July 31 2019]. Atlanta, GA: CDC. Available: https://www.cdc.gov/longtermcare/prevention/antibiotic-stewardship.html.
  18. 18. Simmering JE, Polgreen LA, Campbell DR, Cavanaugh JE, Polgreen PM. Hospital transfer network structure as a risk factor for Clostridium difficile infection. Infect Control Hosp Epidemiol. 2015 Sep;36(9): 1031–1037. pmid:26072907
  19. 19. McLure A, Clements ACA, Kirk M, Glass K. Healthcare-associated Clostridium difficile infections are sustained by disease from the community. Bull Math Biol. 2017 Oct;79(10): 2242–2257. pmid:28776206
  20. 20. Dubberke ER, Carling P, Carrico R, Donskey CJ, Loo VG, McDonald LC, et al. Strategies to prevent Clostridium difficile infections in acute care hospitals: 2014 update. Infect Control Hosp Epidemiol. 2014 Jun;35(6): 628–645. pmid:24799639
  21. 21. Rubin MA, Jones M, Leecaster M, Khader K, Ray W, Huttner A, et al. A simulation-based assessment of strategies to control Clostridium difficile transmission and infection. PLoS One. 2013;8(11): e80671. pmid:24278304
  22. 22. Toth DJA, Khader K, Slayton RB, Kallen AJ, Gundlapalli AV, O'Hagan JJ, et al. The potential for interventions in a long-term acute care hospital to reduce transmission of carbapenem-resistant enterobacteriaceae in affiliated healthcare facilities. Clin Infect Dis. 2017 Aug 15;65(4): 581–587. pmid:28472233
  23. 23. Rhea S, Hilscher R, Rineer J, Munoz B, Jones K, Endres-Dighe S, et al. Creation of a geospatially explicit, agent-based model of a regional healthcare network with application to Clostridium difficile infection. Health Security. In press:
  24. 24. US Census Bureau American FactFinder. “B01001: Total Population.” 2012–2016 American Community Survey. Community facts. n.d. [cited March 14 2018]. Washington, DC: U.S. Census Bureau. Available: http://factfinder2.census.gov.
  25. 25. Cecil G. Sheps Center for Health Services Research, University of North Carolina at Chapel Hill. Patient county of residence by hospital (October 1, 2016 through September 30, 2017). 2017 [cited October `2019]. Chapel Hill, NC: Cecil G. Sheps Center for Health Services Research, University of North Carolina at Chapel Hill. Available: https://www.shepscenter.unc.edu/wp-content/uploads/2019/04/ptorg_pt_res_by_hosp_2017.pdf.
  26. 26. UNC Health Care. Preparing for the future of health care. UNC health care 2017 annual report. 2017 [cited January 21 2019]. Chapel Hill, NC: UNC Health Care. Available: https://www.unchealthcare.org/app/files/public/10436/PDF-MedCtr-Annual-Report-2017.pdf.
  27. 27. NC Department of Health and Human Services, Division of Health Service Regulation. Hospitals by county 2018. 2018 March 5 [cited March 8 2018]. Raleigh, NC: Department of Health and Human Services—Division of Health Service Regulation. Available: https://www2.ncdhhs.gov/dhsr/data/hllistco.pdf.
  28. 28. NC Department of Health and Human Services, Division of Health Service Regulation. Nursing homes by county 2018. 2018 March 5 [cited March 5 2018]. Raleigh, NC: Department of Health and Human Services—Division of Health Service Regulation. Available: https://www2.ncdhhs.gov/dhsr/data/nhlist_co.pdf.
  29. 29. Cecil G. Sheps Center for Health Services Research, University of North Carolina at Chapel Hill. Short term acute care hospital discharge data—patient characteristics. Summary data for all hospitals (October 1, 2016 through September 30, 2017). 2017 [cited October 2019]. Chapel Hill, NC: Cecil G. Sheps Center for Health Services Research, University of North Carolina at Chapel Hill. Available: https://www.shepscenter.unc.edu/wp-content/uploads/2019/04/ptchar_all_and_by_hosp_2017_and.pdf.
  30. 30. Centers for Medicare & Medicaid Services. Nursing home data compendium 2015 edition. Baltimore, MD: Centers for Medicare & Medicaid Services (CMS); 2015.
  31. 31. Kahn JM, Barnato AE, Lave JR, Pike F, Weissfeld LA, Le TQ, et al. A comparison of free-standing versus co-located long-term acute care hospitals. PLoS One. 2015;10(10): e0139742. pmid:26440102
  32. 32. MedPac (2016) Report to the Congress. Medicare Payment Policy. Washington, DC: The Medicare Payment Advisory Commission (MedPAC). pp. 288.
  33. 33. NC Department of Health and Human Services. North Carolina Health Statistics Pocket Guide. 2015 February 28, 2017 [cited January 21 2019]. Raleigh, NC: NC Division of Public Health. Available: https://schs.dph.ncdhhs.gov/data/pocketguide/2015/.
  34. 34. Jones K, Munoz B, Rineer J, Bobashev G, Hilscher R, Rhea S, et al. (2019) On calibrating a microsimulation of patient movement through a healthcare network. In: N. Mustafee, K.-H. G. Bae, S. Lazarova-Molnar, M. Rabe, C. Szabo, P. Haas and Y.-J. Son, editors. Proceedings of the 2019 Winter Simulation Conference. Health Security.
  35. 35. Riggs MM, Sethi AK, Zabarsky TF, Eckstein EC, Jump RL, Donskey CJ. Asymptomatic carriers are a potential source for transmission of epidemic and nonepidemic Clostridium difficile strains among long-term care facility residents. Clin Infect Dis. 2007 Oct 15;45(8): 992–998. pmid:17879913
  36. 36. Dubberke ER, Yan Y, Reske KA, Butler AM, Doherty J, Pham V, et al. Development and validation of a Clostridium difficile infection risk prediction model. Infect Control Hosp Epidemiol. 2011 Apr;32(4): 360–366. pmid:21460487
  37. 37. Loo VG, Poirier L, Miller MA, Oughton M, Libman MD, Michaud S, et al. A predominantly clonal multi-institutional outbreak of Clostridium difficile-associated diarrhea with high morbidity and mortality. N Engl J Med. 2005 Dec 8;353(23): 2442–2449. pmid:16322602
  38. 38. Durham DP, Olsen MA, Dubberke ER, Galvani AP, Townsend JP. Quantifying transmission of Clostridium difficile within and outside healthcare settings. Emerg Infect Dis. 2016 Apr;22(4): 608–616. pmid:26982504
  39. 39. Cohen AL, Calfee D, Fridkin SK, Huang SS, Jernigan JA, Lautenbach E, et al. Recommendations for metrics for multidrug-resistant organisms in healthcare settings: SHEA/HICPAC Position paper. Infect Control Hosp Epidemiol. 2008 Oct;29(10): 901–913. pmid:18808340
  40. 40. Schwartz DN, Evans RS, Camins BC, Khan YM, Lloyd JF, Shehab N, et al. Deriving measures of intensive care unit antimicrobial use from computerized pharmacy data: methods, validation, and overcoming barriers. Infect Control Hosp Epidemiol. 2011 May;32(5): 472–480. pmid:21515978
  41. 41. Centers for Disease Control and Prevention. The NHSN standardized infection ratio (SIR). A guide to the SIR updated march. 2019 March [cited July 31 2019]. Atlanta, GA: CDC. Available: https://www.cdc.gov/nhsn/pdfs/ps-analysis-resources/nhsn-sir-guide.pdf.
  42. 42. NC Communicable Disease Branch. Healthcare-associated infections in North Carolina. Reporting period: January 1 –June 30, 2016. 2016 [cited July 31 2019]. Raleigh, NC: N.C. Surveillance for Healthcare-Associated and Resistant Pathogens Patient Safety (SHARPPS) Program. Available: https://epi.dph.ncdhhs.gov/cd/hai/figures/2016/2016Q2_Hospital_Specific_Quarterly_Report.pdf.
  43. 43. Hensgens MP, Goorhuis A, Dekkers OM, Kuijper EJ. Time interval of increased risk for Clostridium difficile infection after exposure to antibiotics. J Antimicrob Chemother. 2012 Mar;67(3): 742–748. pmid:22146873
  44. 44. Brown KA, Fisman DN, Moineddin R, Daneman N. The magnitude and duration of Clostridium difficile infection risk associated with antibiotic therapy: a hospital cohort study. PLoS One. 2014;9(8): e105454. pmid:25157757
  45. 45. Bintz J, Lenhart S, Lanzas C. Antimicrobial stewardship and environmental decontamination for the control of Clostridium difficile transmission in healthcare settings. Bull Math Biol. 2017 Jan;79(1): 36–62. pmid:27826877
  46. 46. Hicks LA, Bartoces MG, Roberts RM, Suda KJ, Hunkler RJ, Taylor TH Jr., et al. US outpatient antibiotic prescribing variation according to geography, patient population, and provider specialty in 2011. Clin Infect Dis. 2015 May 1;60(9): 1308–1316. pmid:25747410
  47. 47. Centers for Disease Control and Prevention. Multidrug-resistant organism & clostridioides difficile infection (MDRO/CDI) module. 2019 [cited July 31 2019]. Atlanta, GA: CDC. Available: https://www.cdc.gov/nhsn/PDFs/pscManual/12pscMDRO_CDADcurrent.pdf.
  48. 48. American Hospital Association, Health Research & Educational Trust. HRET HIIN measurement matters: NHSN CDI Surveillance Definition Review. 2018 [cited July 31 2019]. Chicago, IL: American Hospital Association and Health Research & Educational Trust. Available: http://www.hret-hiin.org/Resources/cdi/18/measurement-matters-nhsn-cdi-surveillance-definition-review-slides.pd.
  49. 49. Centers for Disease Control and Prevention. National Healthcare Safety Network (NHSN). MDRO & CDI. 2019 March [cited July 31 2019]. Atlanta, GA: CDC. Available: https://www.cdc.gov/nhsn/pdfs/ps-analysis-resources/nhsn-sir-guide.pdf.
  50. 50. Centers for Disease Control and Prevention. Healthcare-associated infections—community interface (HAIC). 2016 annual report. January 2 [cited July 31 2019]. Atlanta, GA: CDC. Available: https://www.cdc.gov/hai/eip/Annual-CDI-Report-2016.html.
  51. 51. Centers for Disease Control and Prevention. Healthcare-associated infections—community interface (HAIC). Clostridioides difficiile infection (CDI) tracking. January 2 [cited July 31 2019]. Atlanta, GA: CDC. Available: https://www.cdc.gov/hai/eip/cdiff-tracking.html?CDC_AA_refVal=https%3A%2F%2Fwww.cdc.gov%2Fhai%2Feip%2Fclostridium-difficile.html.
  52. 52. Lessa FC, Mu Y, Bamberg WM, Beldavs ZG, Dumyati GK, Dunn JR, et al. Burden of Clostridium difficile infection in the United States. N Engl J Med. 2015 Feb 26;372(9): 825–834. pmid:25714160
  53. 53. Kutty PK, Woods CW, Sena AC, Benoit SR, Naggie S, Frederick J, et al. Risk factors for and estimated incidence of community-associated Clostridium difficile infection, North Carolina, USA. Emerg Infect Dis. 2010 Feb;16(2): 197–204. pmid:20113547
  54. 54. Fleming-Dutra KE, Hersh AL, Shapiro DJ, Bartoces M, Enns EA, File TM Jr., et al. Prevalence of inappropriate antibiotic prescriptions among US ambulatory care visits, 2010–2011. JAMA. 2016 May 3;315(17): 1864–1873. pmid:27139059
  55. 55. Slayton RB, Toth D, Lee BY, Tanner W, Bartsch SM, Khader K, et al. Vital signs: estimated effects of a coordinated approach for action to reduce antibiotic-resistant infections in health care facilities—United States. MMWR Morbidity and mortality weekly report. 2015 Aug 7;64(30): 826–831. pmid:26247436
  56. 56. Smith DL, Dushoff J, Perencevich EN, Harris AD, Levin SA. Persistent colonization and the spread of antibiotic resistance in nosocomial pathogens: resistance is a regional problem. Proceedings of the National Academy of Sciences of the United States of America. 2004 Mar 9;101(10): 3709–3714. pmid:14985511
  57. 57. Ashraf MS, Cook PP. Antibiotic misuse in hospital, outpatient, and long-term care settings. N C Med J. 2016 Sep-Oct;77(5): 346–349. pmid:27621347