Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Surgical site infection and costs in low- and middle-income countries: A systematic review of the economic burden

  • Mark Monahan,

    Roles Writing – original draft, Writing – review & editing

    Affiliations NIHR Global Health and Global Surgery Unit, Institute of Translational Medicine, Heritage Building, University of Birmingham, Birmingham, England, United Kingdom, Health Economics Unit, Institute of Applied Health, College of Medical and Dental Sciences, University of Birmingham, Birmingham, England, United Kingdom

  • Susan Jowett,

    Roles Supervision, Writing – review & editing

    Affiliation Health Economics Unit, Institute of Applied Health, College of Medical and Dental Sciences, University of Birmingham, Birmingham, England, United Kingdom

  • Thomas Pinkney,

    Roles Supervision, Writing – review & editing

    Affiliation Birmingham Surgical Trials Consortium, Institute of Applied Health, College of Medical and Dental Sciences, University of Birmingham, Birmingham, England, United Kingdom

  • Peter Brocklehurst,

    Roles Writing – review & editing

    Affiliations NIHR Global Health and Global Surgery Unit, Institute of Translational Medicine, Heritage Building, University of Birmingham, Birmingham, England, United Kingdom, Birmingham Surgical Trials Consortium, Institute of Applied Health, College of Medical and Dental Sciences, University of Birmingham, Birmingham, England, United Kingdom

  • Dion G. Morton,

    Roles Conceptualization, Writing – review & editing

    Affiliations NIHR Global Health and Global Surgery Unit, Institute of Translational Medicine, Heritage Building, University of Birmingham, Birmingham, England, United Kingdom, Birmingham Surgical Trials Consortium, Institute of Applied Health, College of Medical and Dental Sciences, University of Birmingham, Birmingham, England, United Kingdom

  • Zainab Abdali,

    Roles Writing – original draft

    Affiliation Health Economics Unit, Institute of Applied Health, College of Medical and Dental Sciences, University of Birmingham, Birmingham, England, United Kingdom

  • Tracy E. Roberts

    Roles Conceptualization, Supervision, Writing – review & editing

    T.E.Roberts@bham.ac.uk

    Affiliations NIHR Global Health and Global Surgery Unit, Institute of Translational Medicine, Heritage Building, University of Birmingham, Birmingham, England, United Kingdom, Health Economics Unit, Institute of Applied Health, College of Medical and Dental Sciences, University of Birmingham, Birmingham, England, United Kingdom

Abstract

Background

Surgical site infection (SSI) is a worldwide problem which has morbidity, mortality and financial consequences. The incidence rate of SSI is high in Low- and Middle-Income countries (LMICs) compared to high income countries, and the costly surgical complication can raise the potential risk of financial catastrophe.

Objective

The aim of the study is to critically appraise studies on the cost of SSI in a range of LMIC studies and compare these estimates with a reference standard of high income European studies who have explored similar SSI costs.

Methods

A systematic review was undertaken using searches of two electronic databases, EMBASE and MEDLINE In-Process & Other Non-Indexed Citations, up to February 2019. Study characteristics, comparator group, methods and results were extracted by using a standard template.

Results

Studies from 15 LMIC and 16 European countries were identified and reviewed in full. The additional cost of SSI range (presented in 2017 international dollars) was similar in the LMIC ($174—$29,610) and European countries ($21—$34,000). Huge study design heterogeneity was encountered across the two settings.

Discussion

SSIs were revealed to have a significant cost burden in both LMICs and High Income Countries in Europe. The magnitude of the costs depends on the SSI definition used, severity of SSI, patient population, choice of comparator, hospital setting, and cost items included. Differences in study design affected the comparability across studies. There is need for multicentre studies with standardized data collection methods to capture relevant costs and consequences of the infection across income settings.

Introduction

Mortality within 30 days of surgery is the third largest contributor to global deaths [1]. Surgical Site Infection (SSI) is linked to 38% of deaths in patients with SSI [2]. SSI is common, associated with increased patient morbidity and mortality [3, 4], recognised globally as a problem and shown to represent a substantial financial burden [5, 6]. In comparison to the relatively high income countries (HIC) of Western Europe, the incidence rate of SSIs is much greater in Low- and Middle-Income Countries (LMIC) [7, 8] and here the majority of the hospital care cost is borne by the patient [9]. In the LMIC setting, the risk of acquiring an SSI substantially increases the overall risk of financial catastrophe- a situation in which health care spending on this event exceeds 10% of annual household expenditure [10].

Identifying appropriate solutions to combat SSI is of global interest [6, 11, 12]. Recently completed and ongoing research studies to find the most cost-effective prevention strategies for SSI, are having mixed success [13, 14]. The majority of this research is randomised controlled trials (RCTs) with a parallel economic evaluation based in HIC [15, 16]. Plans are in place to carry out similar studies exploring cost-effective strategies to combat SSI in the LMIC setting [17]. Significant challenges hamper clinical trials in LMICs relating to lack of infrastructure and limited human resources [18]. This limits the data that can be feasibly collected in contrast to trials in HICs settings.

A cost of illness (COI) study quantifies how much society is spending on a particular disease and represents the cost burden averted if the disease was eradicated [19]. Understanding the additional cost burden imposed by the complications of surgery such as those caused by an SSI, helps to strengthen the case for identifying interventions to reduce such complications [20]. This in turn provides the justification for undertaking economic evaluations to present relevant evidence to inform the prioritization of resource allocation decisions for interventions to reduce SSI complications.”.

We identified five main challenges in measuring the additional costs associated with an SSI. First, different definitions of an SSI affects which patients are considered to have an SSI [21]. Second, as an SSI can manifest beyond hospital discharge, approaches for post-discharge SSI confirmation will impact SSI detection rate [22, 23]. Follow-up difficulties can be exacerbated for surgical patients in low income settings due to high out-of-pocket transportation costs in accessing healthcare [24].

Third, estimating the additional cost of SSI relies on the choice of the comparator, which is patients without SSI. Studies with a case-control design try to address potential confounding with an adjusted comparison where each of the exposure and control patients have matching confounding variables (e.g. same age, gender, surgical procedure). Yet, the choice of matching variables should be considered carefully in case-control studies because of its impact on the efficiency and validity of the results [25].

Fourth, SSI costs are only as representative as the hospital settings used. Resource use and costs are known to differ across urban and rural settings and different patient population mixes from different surgical procedures can influence the cost of SSI, limiting the generalisability across procedures. Finally, SSIs vary in severity, and those SSIs that are severe can substantially increase costs and inpatient length of stay [26]. However, the distinction between SSI severity levels is open to subjective interpretation by the attending physician [27].

The objective of this study is to critically appraise and assess how the cost of SSI has been estimated in a range of LMIC studies and compare with a selection of high income European studies which explored similar SSI costs. European studies are included in the review to provide a reference standard for the LMIC studies. The aim of the comparison is to examine the costs associated with SSI (presented in international dollars) across the different settings and identify potential data gaps, and methodological considerations in each setting.

This paper is structured so that the review of the selection of European studies is presented in Part 1. An analogous review of the LMIC studies is presented in Part 2. Part 3 presents a comparison between the main finding of the reviews for the HIC and LMIC settings before the main discussion.

Materials and methods

The review followed the UK Centre for Review and Dissemination [28] guidelines and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) [29].

Search strategy

The following electronic databases were searched from inception to 20th February 2019: EMBASE and MEDLINE In-Process & Other Non-Indexed Citations. Additional references were found using hand searching of relevant journal articles and Google scholar searches. Search terms used for each database are detailed in S1S4 Files

Eligibility criteria

Studies were included if they considered the costs associated with SSIs in European Organisation for Economic Co-operation and Development (OECD) countries [30]. For the analogous review of LMIC, studies were included if they considered the economic impact of SSIs in LMICs. For both settings costs could be borne by the healthcare providers, patients, wider community and/or society. Eligible articles included cost analysis, partial or full economic evaluations (trial-based and model-based) and cost of illness studies in a European country or LMIC setting. Multi-country studies were included if at least one eligible country was included and the study’s findings were reported separately for that country. Non-eligible studies were those that were not published in English, conference proceedings, protocols, commentaries, and editorials.

Study selection.

The titles and abstracts of the databases’ search results were screened against the eligibility criteria. A three stage categorisation process was used to determine relevant studies appropriate for inclusion, using methods described elsewhere [31]. Two investigators carried out study screening and data extraction for the LMIC search (MM & ZA). One investigator (MM) carried out all study screening and data extraction for the European literature search, and another investigator (ZA) undertook screening of a random 20% to assess agreement. Disagreements were resolved through discussion, a third independent investigator (TR) was sought where agreement could not be reached.

For each included study, data were extracted on the study characteristics, country setting, costs and resource use included, use of adjusted analyses, and the main results reported. The information was tabulated, and the issues faced by the individual studies in estimating the additional costs of SSI were compared narratively. For consistency across studies, costs were converted to international dollars and inflated to 2017, where appropriate. To improve comparability of cost findings, costs were adjusted by their country’s Purchasing Power Parity (PPP) conversion factor [32]. Where a country did not have a PPP conversion factor, an implied PPP conversion factor from the IMF was used instead [33]. For inflation purposes, studies without a specified cost year were assumed to be the last year of data collection.

All included studies were assessed by a modified reporting Müller checklist (translated into English) for COI studies and scored by their inclusion of relevant items [34]. A study scored one on each aspect they had described or justified out of a possible maximum score of 36. The checklist for each study is available upon request.

Results and discussion

Part 1: European literature search

The electronic database search for the European studies yielded 588 citations. Fig 1 presents a flow diagram of the selection process. Sixteen studies met the inclusion criteria.

General study characteristics.

The sixteen studies were published from 1992 to 2018 and data collection spanned 1987 to 2016. Studies were based in England (n = 6) [3540], Spain (n = 2) [41, 42], Scotland (n = 2) [43, 44], Finland (n = 1) [45], France (n = 1) [46], Switzerland (n = 1) [47], Belgium (n = 1) [48], Denmark (n = 1) [49] and Germany (n = 1) [50]. Table 1 shows general characteristics of each study included in the review.

Definition of SSI.

SSI was defined using the Center of Disease Control (CDC) guidelines in most of the studies [35, 37, 38, 41, 42, 45, 46, 50]. Other strategies for SSI confirmation included using a microbiological test [36, 39] or if a patient required antibiotic treatment for wound problems [40, 49]. Lynch et al [43] defined an SSI based on pus discharge or a wound with a score of greater than ten on ASEPSIS, a scoring mechanism for postoperative SSI [51]. Reilly et al [44] defined an SSI as pus or painful skin inflammation indicative of cellulitis.

Patients were followed-up for the occurrence of SSI for at least 30 days [35, 41, 43, 44] with two studies following up SSI patients until the wound had healed [37, 45]. Approaches to diagnose post-discharge SSI included outpatient clinics or primary care visits [41, 44, 45], surveys/questionnaires, [35, 43] or a home visit [37].

Patient matching.

An imbalance of patient characteristics can bias and confound the cost calculation of SSI patients. This is analogous to an observational non-RCT setting where the difference in outcomes may be partially or wholly explained by factors other than the presence of SSI. Some form of patient matching in the analysis to adjust for confounding variables was used in most studies [35, 36, 38, 39, 41, 42, 4648, 50]. However, justification for the selected matching variables was given in less than half of these studies [36, 38, 39, 41, 48].

Setting & procedure.

Public teaching hospitals [3537, 3943, 46, 47, 50] were the setting for majority of the studies with one hospital setting unclear [44], and another study referring to unspecified referral hospitals [45]. Study settings were mostly restricted to a single site with only four studies involving multiple hospitals [38, 45, 48, 49]. Surgical procedures ranged from general surgery or multiple surgery categories (n = 8), cardiothoracic (n = 1), colorectal (n = 2), gynaecological (n = 1), and orthopaedic (n = 4). The patient population were all adult patients.

Half the studies that assessed SSI across surgical categories reported surgery category-specific costs associated with SSI [35, 43, 44, 47]. All of these studies showed variation of SSI costs across surgical categories. Severity of SSI was always associated with increased costs. A deep SSI was more costly compared to a superficial SSI in all studies that had severity-specific SSI costs [39, 47, 49]. Yet, the stated approaches to classify the superficial versus deep SSI differed. Approaches to define superficial SSI included CDC criteria [49], or a treatment for an infection at the surgical site within 30 days postoperatively [47], or were not defined [39]. Approaches to classify a deep SSI included a microbiological confirmation of tissue from a further surgery [39], or an SSI requiring surgery [47] or using CDC criteria [49] The sample size of SSI patients in the European studies ranged from as low as 17 patients to as high as 513 patients.

Cost components.

The type of costs included and considered in each of the studies is shown in Table 2 and S1 Table. All studies considered at least some form of direct medical costs in their cost calculations. However, there was a considerable variation in the description and the number of direct medical cost items included in each study. In terms of the costs arising from the initial hospitalization of patients, the description of the included cost components ranged from an unspecified cost per bed day to a comprehensive bottom up costing of the hospital length of stay, consumables, diagnostics, overhead, reoperation and staffing costs. Non-hospital costs were also considered in some of the studies including post-discharge costs from general practitioner/ nurse visits [37, 41, 43, 44], and patient/community costs of wound dressings.

To facilitate a cost comparison across studies a specified year for which the costs are applicable allows for the findings to be inflated correctly. The cost year was not stated in six studies [35, 40, 43, 45, 46, 50]. Transparency on the amount that each cost component is contributing to the additional cost of SSI clarifies which aspects of medical care are driving the additional cost burden. However, the additional cost of SSI was not broken down into their cost components in seven studies [36, 38, 42, 45, 47, 49].

All but one study restricted costs to the perspective of the health care payer. Alfonso et al [41] widened the perspective to societal and looked at direct and indirect costs associated with SSI including hospital, primary care, informal care, and productivity loss.

Resource use.

The reporting of resource use of SSI and non-SSI patients was inconsistent across studies. Beyond the main resource item of hospital length of stay, there was little detail on the differential resource use of SSI and non-SSI patients. Alfonso et al [41] (Spain) reported that patients with an SSI had significantly longer durations of use for hospital consumables (catheters, and antibiotics) compared with patients without an SSI. However, resource use details were omitted on general practitioner/ nurse visits and the level of informal care needed. Reilly et al [44] (UK) presented a breakdown of resource use for SSI patients only.

Cost of surgical site infection.

Overall there was a lack of detail in the reporting of costs for SSI and non-SSI patients. Average costs of both the respective SSI and non-SSI patients groups were omitted for the majority of studies [37, 41, 42, 4449].

Lynch et al [43] had the lowest relative magnitude of cost difference with SSI costs being 1.73 times higher than non-SSI costs. The authors had estimated the costs of SSI and non-SSI patients as $3,678 and $2,116 respectively [43].

Pollard et al [36] reported the highest relative magnitude of cost difference with SSI costs being 3.39 times higher than non-SSI costs. For elderly proximal femoral fracture surgery patients, they had estimated the costs of SSI and non-SSI patients to be $44,157 and $13,043 respectively. Their inclusion criteria meant that the SSI patients were those who specifically needed further surgery, representing an upper estimate of the additional costs of an SSI.

While all eligible studies had to present a cost difference between SSI and non-SSI patients, there was a lack of reporting of the average costs for the SSI and non-SSI patient groups used to calculate the difference (Table 2). All studies showed an elevated cost of SSI relative to non-SSI patients. The additional medical costs of SSI, which included costs incurred by the hospital and health system, ranged from $21 to $34,001 per patient.

The lowest additional cost associated of SSI was estimated in a Danish study assessing the cost-effectiveness of incisional negative pressure wound therapy in obese women after caesarean section. In addition to the cost-effectiveness results, the study also provided a per-patient cost of superficial SSI and deep SSI compared with patients who did not suffer an SSI. The superficial SSI was defined as requiring antibiotic treatment for an infection at the surgical site within the first 30 days after the caesarean section and not requiring further surgery. The highest additional health care cost associated with SSI was estimated by Weber et al [47]. While the average additional cost of all SSI patients was $17,060, an organ space SSI approximately doubled the additional cost of an SSI in their case-control designed study.

Alfonso et al [41] (Spain) was the only study to adopt a broader societal perspective and included the cost of productivity loss, informal care and health care costs. They estimated the cost associated with SSI to be an additional $145,366 per patient. This estimate comprised productivity costs (78.7%) with carer costs (10.8%) and health costs (10.5%) making up the remainder. Including only the health care costs made the additional cost of SSI $15,733 per patient.

Checklist.

All studies were compared against a modified reporting Müller COI study checklist (see S1 Table for scores). Alfonso et al [41] achieved the highest number of items (23 points) in the checklist with detailed descriptions of the methods used to estimate the additional costs of SSI. Turtainen et al [45] achieved the lowest score (11 points) in the checklist with little to no description in the study on what was included in the SSI cost estimate and how it was derived. In general, studies scored relatively poorly in the evaluation methods and presentation of results section of the checklist but highly in the discussion and conclusions sections.

Part 2: LMIC literature search

The LMIC studies electronic database search yielded 2,557 citations. Five additional records were identified through hand searching references of included papers. Fig 2 presents a flow diagram of the selection process. Fifteen studies met the inclusion criteria.

General study characteristics.

The fifteen studies were published from 2003 to 2018 and data collection spanned 1999 to 2015. Studies were based in Turkey (n = 3) [5254], China (n = 2) [55, 56], Jordan (n = 2) [57, 58], Thailand (n = 2) [59, 60], Brazil (n = 1) [61], Egypt (n = 1) [62], India (n = 1) [63], Mexico (n = 1) [64],Rwanda (n = 1) [65], and South Africa (n = 1) [66]. According to the World Bank classifications, the studies were part of the following income groups: Low Income Country (n = 1) [65], Lower Middle Income (n = 2) [62, 63] and Upper Middle Income (n = 12) [5261, 64, 66]. Table 3 shows general characteristics of each study included in the review.

Definition of SSI.

The Center of Disease Control guidelines were used in the majority of the studies to define an SSI [5257, 6164, 66]. However, three studies lacked a definition of what constituted a SSI [59, 60, 65]. One study classified a SSI based on the wound discharge culture or other SSI suggestive signs and symptoms but these were not elaborated further [58].

Post-discharge SSIs cannot be detected where there is no follow-up. In this review, patients were not followed up after hospital discharge or it was not indicated in many of the studies [55, 56, 5861, 63, 65, 66]. Where follow-up was specified, it was only recorded if the patient happened to return to the index hospital in two studies [54, 57]. The only specified method of follow-up in the studies was attendance of an outpatient clinic attendance a month after the patient’s operation [52, 54, 62, 64].

Patient matching.

When estimating the additional cost burden of SSI, most of the studies did not make any adjustments in the comparison with non-SSI patients or it was unclear if adjustment had been used (Table 3). Justification on the inclusion of the patient matching variables was only given in one of the six studies where patient matching was utilised [56].

Setting & procedure.

The setting where the findings are derived from were mainly public teaching hospitals [41, 52, 5762, 64, 66] with three based in private hospitals [5355, 63]. All the studies were based in single centres. Surgical procedures ranged from general surgery or multiple surgical categories (n = 5), oncological procedures (n = 4), cardiothoracic (n = 2), orthopaedic (n = 1), gastric (n = 1), general, cardiac and neurosurgery (n = 2). The patient population was broader in the LMIC studies and varied from children (n = 2), adults (n = 12) and pregnant women (n = 1). For the studies with SSI patients taken from multiple surgical categories, none reported costs of SSI by surgical category.

SSI severity increased the additional cost of SSI [54, 56]. A subgroup analysis of one study had low sample sizes for the superficial (n = 13), subcutaneous (n = 6) and deep soft SSIs (n = 1)53. Another study compared the severity of infections in three different types of surgical procedure, however, the reported cost was for all cases [64].

In general, studies tended to have a low number of SSI patients with the sample size of SSI patients in each study ranging from 4 patients [60, 63] to 106 patients [57]. Six studies had twenty or fewer SSI patients [52, 53, 56, 59, 60, 63].

Cost components.

All studies estimated direct medical costs (Table 4). The lack of follow-up of patients beyond discharge limited most of the studies to report only inpatient hospital costs. One study had attempted to measure the direct non-medical costs, however the authors did not report it as a cost of an SSI [65]. Most studies did not report the relevant year for the cost estimation (S2 Table). The majority of studies did not break down the extent to which each cost component makes up the costs of SSI and non-SSI patients. Where cost components were reported in studies, it either included both SSI and non-SSI patients [55, 59, 65] or was limited to only SSI patients [53, 54, 61].

Resource use.

There was no reporting of resource use of SSI and non-SSI patients beyond hospital length of stay in any of the studies. There was partial reporting on the additional procedures or investigations for SSI [54, 61] but no detail on the total resource use by SSI and non-SSI patients.

Cost of surgical site infection.

The additional cost of SSI varied considerably across the studies. All but one study showed an elevated cost of SSI relative to non-SSI patients. The study by Özmen et al [52] (Turkey) study looked at outcomes of patients after elective gastric cancer surgery and found that the unspecified hospital costs were non-significantly lower for superficial SSI patients compared to non-SSI patients. The calculations behind the lower SSI cost was unclear given that overall hospital costs were higher than either of the mean costs of the patient groups (SSI and non-SSI).

The additional cost of SSI ranged from $174 (Thailand) [60] to $29,610 (India) [63]. The lowest additional cost of SSI was from a study by Siribumrungwong et al [60]. Their SSI cost was made up of undefined hospital costs of four SSI patients with no detail of the non-SSI comparator group. The highest additional cost of SSI was from a study by Tiwari et al [63]. For their four patients who suffered an SSI, drug acquisition costs, length of stay and antimicrobial drugs were the main cost drivers.

Clarity on the relative magnitude of difference in cost between SSI and non-SSI patients was mixed. Half of studies did not present average costs of both SSI and non-SSI patients. The lowest relative magnitude of difference in reported costs was in Jordan where SSI costs were 1.4 times higher than non-SSI costs [59]. However, it is unclear what cost items are the major contributors of the additional costs. They had estimated the costs of SSI and non-SSI patients as $31,666 and $22,329, respectively. The highest relative magnitude of difference in costs was in India where Tiwari et al [63] found that SSI costs were 4.8 times higher than non-SSI costs [63]. The authors had estimated the costs of SSI and non-SSI patients as $37,295 and $7,685 respectively.

Checklist.

For the COI checklist, the studies achieved on average a score of 11.07 out a maximum of possible score of 36. The lack of a stated perspective and cost year reduced the scores of many of the LMIC studies. Dramowski et al [66] scored the highest number of items (16) in the discussion and conclusion. The lack of description of pertinent study items meant that Porras-Hernández et al [66] scored the lowest (6).

Part 3: Comparison between HIC European countries and LMICs

The CDC criteria were used for SSI diagnosis by most studies in both settings. The biggest methodological difference between the HIC and LMIC settings was the use of adjusted analyses for comparing SSI and non-SSI patients. Most European studies used patient matching while the opposite was true for LMIC studies. Multicentre study settings were only present in the European studies. Slightly more European studies had follow up beyond discharge but the follow-up methods varied. Sample sizes of SSI patients tended to be higher in the European studies. On the other hand, LMIC studies had marginally better reporting of the average costs of the SSI and non-SSI patient groups.

For the COI reporting checklist, the European studies achieved a higher score on average compared with the LMIC studies. In both settings, studies tended to score highly in the discussion and conclusion checklist but poorly on the evaluation methods and result presentation sections.

Statement of principal findings.

This review assessed the estimated the cost burden of SSIs in the reported literature for both LMICs and a selection of European High Income Countries.

For medical costs, the additional cost of SSI was $21 to $34,000 in European studies while the additional cost attributed to SSI ranged from $174 to $29,610 in LMICs. The huge range of costs in both settings reflects the difficulty associated with accurately estimating the costs attributable to SSI and consequently limited cross-study comparability of findings. Five main challenges to the estimation of the costs are summarised below:

  1. Time horizon for capturing an SSI
  2. Choice of comparator
  3. Over reliance on single centre studies and small number of patients with SSI
  4. Under representation of Low Income and Lower Middle Income Countries in the literature
  5. Inconsistency in consideration of costs and narrow cost perspective.
  1. Time horizon and follow-up: Studies from both settings used the CDC criteria to define SSI, but the lack of follow-up in LMIC studies failed to meet the recommended time needed to detect an SSI. According to the CDC, the specified time horizon for an SSI to occur is up to 30 days post-surgery for non-implant operations and up to 12 months for implant operations. Where no follow-up exists, there is a risk of underestimating the true number of SSI patients and skewing the cost burden information to only patients with an inpatient SSI. The type of follow-up method will affect the detection rate but this was rarely mentioned in studies. Inadequate IT infrastructure in LMIC healthcare systems has been implicated as the cause of poor follow up through health care pathways [67].
  2. The choice of comparator was important in the estimating the additional cost burden of SSI. Most LMIC studies did not use any adjustments for potential confounders which risked producing a false estimation (overestimate or underestimate) of SSI costs due to an imbalance in the characteristics of the comparators. For example, some of the differences in costs between SSI patients and non-SSI patients could be due to greater levels of comorbidity in one group, causing a higher estimated additional cost for SSI than may otherwise be true. In contrast, the majority of the European studies did make adjustments for potential confounders but few gave justification for the included matching variables. Proper consideration of matching variables can help avoid the problem of undermatching or overmatching in case-control studies [25].
  3. Over reliance on single centre studies: Both settings had an overreliance on single centre studies and the lack of multi-centre settings affected the representativeness of the findings. Greater numbers of hospitals participating and more diversity in hospital settings for each study would help strengthen the applicability and robustness of any findings. Some studies with a patient population across multiple surgical categories indicated differential additional SSI costs by procedure. However, this was only reported in the European studies and there was no clear signal on which procedures would be the costliest across these studies. Some studies had low numbers of SSI patients; cost estimation with a small sample size are prone to unreliability and imprecision. This has an impact on the interpretation of the results given that the differences in costs between SSI patients and non-SSI patients could be driven by chance or extreme values. In general, the European studies had more patients, but this could be as a result of better SSI surveillance.
  4. Lack of studies in Low Income and Lower Middle Income countries: The LMIC studies found in the review span across different continents, patient populations, surgical procedures, income levels, health systems and cultures. However, there was an underrepresentation of studies in Low Income countries and Lower Middle Income countries making the generalisability of the overall findings to these settings more difficult.
  5. Inconsistency in consideration of costs and narrow cost perspective: The type of costs included will have a direct impact on the estimation of SSI costs. The cross-country cost comparison of SSI was hindered by the absence of a standardized approach in the basket of cost items included. However, even when a standardized approach is adopted as in a multinational randomised control trial, costs and resource use will differ across countries [68]. Variations in clinical practice and relative prices across countries will affect the transferability of healthcare resource use and costs [69]. Despite an SSI has far-reaching resource use implications for the healthcare system, patient and community, costs from the patient’s perspective were not considered in any LMIC study. The absence of patient and societal costs are concerning given the relatively high out of pocket expenditure faced by patients in LMICs. Lack of consideration of these costs is likely to underestimate the true cost burden of SSI, and one of the European studies found that the addition of informal care alone doubled the costs associated with SSI [41].

Strengths and weaknesses.

The strength of this study is that it is the first systematic review to specifically investigate the economic impact of SSI in LMICs. By including a parallel review of SSI with HICs in Europe, the review offers new insight into the methodological considerations and the potential data gaps in SSI cost studies from the contrasting settings.

A limitation relates to the use of an implied PPP exchange rate for some of the LMIC settings and the English language restriction for the article inclusion criteria. A PPP exchange rate is used to adjust for the cost of living differences between countries. Relying on implied PPP rates for adjusting the comparative cost results is likely to introduce measurement error in the study findings compared to those using official PPP rates [70]. A previous study looking at risk factors for child conduct problems and youth violence in LMICs reported that including only English language studies was likely to have reduced the number of potentially relevant articles by around 15% [71].

Comparison with other studies.

Previous systematic reviews have looked at the costs of a SSI, mainly in high income countries [5, 72, 73]. Similar issues were encountered on the lack of standardized approach, insufficient detail on how costs were derived, and the failure to include societal costs. To better articulate the first two study issues, the present review added the use of a cost of illness reporting checklist to give an indication of the study transparency and comparability. In contrast to the previous systematic reviews, the search criteria of the present study were not limited by date to be as inclusive as possible. A previous systematic review established that many essential surgical interventions are cost-effective in resource poor countries [74]. However, complications such as SSI can impose unforeseen additional costs in these countries, which are overlooked by most of the studies included in the paper.

Implications for practice.

An SSI is the most common hospital acquired infection in LMICs [75]. Preventing SSIs will decrease the financial burden of both the patient and health system. Hospital bed overcrowding is problematic in LMICs [7678] and any reduction in SSIs would help to increase capacity in bed days.

There is need for multicentre studies with large number of SSI patients to capture relevant costs and consequences of the infection across settings. The use of a standardized data collection pathway will help improve cross-study comparability. Future studies should include more detailed information on analytic approaches in the methods along with rationale and discussion of their likely impact on results. Ideally, reporting should include resource use, costs and cost categories of SSI and non-SSI patients to give more context on the key influences for the cost difference between patient groups. The identification, measurement and collection of costs should as far as possible take a societal perspective to appropriately encompass all healthcare, patient and wider society costs that may be affected by an SSI. The costs of inpatient SSI and outpatient SSI need to be differentiated given that the former is plausibly more expensive from increased inpatient bed days. Subgroup analysis would allow the heterogeneity to be examined between these groups instead of being masked in overall figures.

Conclusions

An SSI represents a financial burden in both high income and LMICs settings. The magnitude of the cost difference depends on the SSI definition used, severity of SSI, patient population, choice of comparator, hospital setting, and cost items included. Huge heterogeneity in design and lack of transparency has made it difficult to draw meaningful comparison across studies and countries.

We suggest that future studies endeavour to achieve the most appropriate time horizon to include appropriate complications, focus on a comparator that has a degree of matching of patient characteristics, and researchers should limit their focus on single centre studies to increase generalisability. These three items are typically within the gift of researchers during the design stage. The impact of SSI in low-income countries is likely to be severe and more research in these setting is required with particular care on choosing the right perspective for the collection of cost data, which is key to ensuring the appropriate financial burden captured. Agreement on what would the composition of a standardised basket of items of costs to include would also be extremely helpful.

Supporting information

S1 Table. Cost information included in each European study.

https://doi.org/10.1371/journal.pone.0232960.s001

(DOCX)

S2 Table. Cost information included in each LMIC study.

https://doi.org/10.1371/journal.pone.0232960.s002

(DOCX)

References

  1. 1. Nepogodiev D, Martin J, Biccard B, Makupe A, Bhangu A, Ademuyiwa A, et al. Global burden of postoperative death. The Lancet. 2019;393(10170):401.
  2. 2. Astagneau P, Rioux C, Golliot F, Brücker G. Morbidity and mortality associated withsurgical site infections: results from the 1997–1999 INCISO surveillance. Journal of Hospital Infection. 2001;48(4):267–74. pmid:11461127
  3. 3. Mangram AJ, Horan TC, Pearson ML, Silver LC, Jarvis WR. Guideline for prevention of surgical site infection, 1999. American journal of infection control. 1999;27(2):97–134. pmid:10196487
  4. 4. Gheorghe A, Moran G, Duffy H, Roberts T, Pinkney T, Calvert M. Health Utility Values Associated with Surgical Site Infection: A Systematic Review. Value in Health. 2015;18(8):1126–37. pmid:26686800
  5. 5. Badia J, Casey A, Petrosillo N, Hudson P, Mitchell S, Crosby C. Impact of surgical site infection on healthcare costs and patient outcomes: a systematic review in six European countries. Journal of Hospital Infection. 2017;96(1):1–15. pmid:28410761
  6. 6. Organization WH. Global guidelines for the prevention of surgical site infection: World Health Organization; 2016.
  7. 7. Rosenthal VD, Richtmann R, Singh S, Apisarnthanarak A, Kübler A, Viet-Hung N, et al. Surgical Site Infections, International Nosocomial Infection Control Consortium (INICC) Report, Data Summary of 30 Countries, 2005–2010. Infection Control & Hospital Epidemiology. 2015;34(6):597–604. Epub 01/02. pmid:23651890
  8. 8. Collaborative G. Laparoscopy in management of appendicitis in high-, middle-, and low-income countries: a multicenter, prospective, cohort study. Surgical endoscopy. 2018:1–17.
  9. 9. Mills A. Health care systems in low-and middle-income countries. New England Journal of Medicine. 2014;370(6):552–7. pmid:24499213
  10. 10. Shrime MG, Dare AJ, Alkire BC, O’Neill K, Meara JG. Catastrophic expenditure to pay for surgery worldwide: a modelling study. The Lancet Global health. 2015;3:S38–S44. pmid:25926319
  11. 11. Sawyer RG, Evans HL. Surgical site infection—the next frontier in global surgery. The Lancet Infectious Diseases. 2018;18(5):477–8. pmid:29452939
  12. 12. Bhangu A, Ademuyiwa AO, Aguilera ML, Alexander P, Al-Saqqa SW, Borda-Luque G, et al. Surgical site infection after gastrointestinal surgery in high-income, middle-income, and low-income countries: a prospective, international, multicentre cohort study. The Lancet Infectious Diseases. 2018;18(5):516–25. pmid:29452941
  13. 13. Gheorghe A, Roberts TE, Pinkney TD, Bartlett DC, Morton D, Calvert M, et al. The cost-effectiveness of wound-edge protection devices compared to standard care in reducing surgical site infection after laparotomy: an economic evaluation alongside the ROSSINI trial. PloS one. 2014;9(4):e95595. pmid:24748154
  14. 14. Reeves BC, Andronis L, Blazeby JM, Blencowe NS, Calvert M, Coast J, et al. A mixed-methods feasibility and external pilot study to inform a large pragmatic randomised controlled trial of the effects of surgical wound dressing strategies on surgical site infections (Bluebelle Phase B): study protocol for a randomised controlled trial. Trials. 2017;18(1):401. pmid:28851399
  15. 15. Allen J, David M, Veerman J. Systematic review of the cost‐effectiveness of preoperative antibiotic prophylaxis in reducing surgical‐site infection. BJS Open. 2018;2(3):81–98. pmid:29951632
  16. 16. Pinkney TD, Calvert M, Bartlett DC, Gheorghe A, Redman V, Dowswell G, et al. Impact of wound edge protection devices on surgical site infection after laparotomy: multicentre randomised controlled trial (ROSSINI Trial). Bmj. 2013;347:f4305. pmid:23903454
  17. 17. ClinicalTrials.gov [Internet]. Identifier NCT03700749, FALCON Trial Testing Measures to Reduce Surgical Site Infection; 2008 Oct 9; Bethesda (MD): National Library of Medicine (US); 2000 [cited 2019 1st September]. https://clinicaltrials.gov/ct2/show/NCT03700749.
  18. 18. Grover S, Xu M, Jhingran A, Mahantshetty U, Chuang L, Small W Jr, et al. Clinical trials in low and middle-income countries—successes and challenges. Gynecologic oncology reports. 2017;19:5–9. pmid:28004030
  19. 19. Byford S, Torgerson DJ, Raftery J. Cost of illness studies. Bmj. 2000;320(7245):1335. pmid:10807635
  20. 20. Tarricone R. Cost-of-illness analysis: what room in health economics? Health policy. 2006;77(1):51–63. pmid:16139925
  21. 21. Ashby E, Haddad F, O’Donnell E, Wilson A. How will surgical site infection be measured to ensure “high quality care for all”? The Journal of bone and joint surgery British volume. 2010;92(9):1294–9. pmid:20798451
  22. 22. Leaper D, Tanner J, Kiernan M. Surveillance of surgical site infection: more accurate definitions and intensive recording needed. Journal of Hospital Infection. 2013;83(2):83–6. pmid:23332350
  23. 23. Koek M, Wille J, Isken M, Voss A, Van Benthem B. Post-discharge surveillance (PDS) for surgical site infections: a good method is more important than a long duration. Eurosurveillance. 2015;20(8):21042. pmid:25742435
  24. 24. Young S, Lie SA, Hallan G, Zirkle LG, Engesæter LB, Havelin LI. Low infection rates after 34,361 intramedullary nail operations in 55 low-and middle-income countries: validation of the Surgical Implant Generation Network (SIGN) online surgical database. Acta orthopaedica. 2011;82(6):737–43. pmid:22066554
  25. 25. Rose S, Van der Laan MJ. Why match? Investigating matched case-control study designs with causal effect estimation. The international journal of biostatistics. 2009;5(1).
  26. 26. Kashimura N, Kusachi S, Konishi T, Shimizu J, Kusunoki M, Oka M, et al. Impact of surgical site infection after colorectal surgery on hospital stay and medical expenditure in Japan. Surgery today. 2012;42(7):639–45. pmid:22286573
  27. 27. Leaper D, Fry D, Assadian O. Perspectives in prevention and treatment of surgical site infection-a narrative review of the literature. Wounds: a compendium of clinical research and practice. 2013;25(11):313–23.
  28. 28. Dissemination C. CRD’s Guidance for Undertaking Reviews in Health Care. Layerthorpe: University of York, Centre for Reviews and Dissemination. 2009.
  29. 29. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS medicine. 2009;6(7):e1000100. pmid:19621070
  30. 30. OECD. List of OECD Member countries—Ratification of the Convention on the OECD [cited 2019 18th January]. http://www.oecd.org/about/membersandpartners/list-oecd-member-countries.htm.
  31. 31. Roberts T, Henderson J, Mugford M, Bricker L, Neilson J, Garcia J. Antenatal ultrasound screening for fetal abnormalities: a systematic review of studies of cost and cost effectiveness. BJOG: An International Journal of Obstetrics & Gynaecology. 2002;109(1):44–56.
  32. 32. OECD Data. Purchasing power parities (PPP) 2018 [cited 2018 11th October]. https://data.oecd.org/conversion/purchasing-power-parities-ppp.htm.
  33. 33. International Monetary Fund. Implied PPP conversion rate 2018 [cited 2018 11th October]. https://www.imf.org/external/datamapper/PPPEX@WEO/OEMDC/ADVEC/WEOWORLD.
  34. 34. Müller D, Stock S, Dintsios C-M, Chernyak N, Gerber-Grote A, Gloede TD, et al. Checklist for the Development and Assessment of Cost-of-Illness Studies. Gesundheitswesen (Bundesverband der Arzte des Offentlichen Gesundheitsdienstes (Germany)). 2018;80(8–09):744–53.
  35. 35. Jenks P, Laurent M, McQuarry S, Watkins R. Clinical and economic burden of surgical site infection (SSI) and predicted financial consequences of elimination of SSI from an English hospital. Journal of Hospital Infection. 2014;86(1):24–33. pmid:24268456
  36. 36. Pollard T, Newman J, Barlow N, Price J, Willett K. Deep wound infection after proximal femoral fracture: consequences and costs. Journal of Hospital Infection. 2006;63(2):133–9. pmid:16621145
  37. 37. Tanner J, Khan D, Aplin C, Ball J, Thomas M, Bankart J. Post-discharge surveillance to identify colorectal surgical site infection rates and related costs. Journal of Hospital Infection. 2009;72(3):243–50. pmid:19446918
  38. 38. Parker B, Petrou S, Achana F, Masters JPM, Costa ML. Economic outcomes associated with deep surgical site infection in patients with an open fracture of the lower limb. Bone and Joint Journal. 2018;100B(11):1506–10. http://dx.doi.org/10.1302/0301-620X.100B11.BJJ-2018-0308.R1. pmid:624948856.
  39. 39. Thakar C, Alsousou J, Hamilton TW, Willett K. The cost and consequences of proximal femoral fractures which require further surgery following initial fixation. J Bone Joint Surg Br. 2010;92(12):1669–77. https://dx.doi.org/10.1302/0301-620X.92B12.25021 pmid:21119173.
  40. 40. Edwards C, Counsell A, Boulton C, Moran CG. Early infection after hip fracture surgery: risk factors, costs and outcome. J Bone Joint Surg Br. 2008;90(6):770–7. https://dx.doi.org/10.1302/0301-620X.90B6.20194 pmid:18539671.
  41. 41. Alfonso JL, Pereperez SB, Canoves JM, Martinez MM, Martinez IM, Martin‐Moreno JM. Are we really seeing the total costs of surgical site infections? A Spanish study. Wound repair and regeneration. 2007;15(4):474–81. pmid:17650090
  42. 42. Vegasi AA, Jodra VM, García ML. Nosocomial infection in surgery wards: a controlled study of increased duration of hospital stays and direct cost of hospitalization. European journal of epidemiology. 1993;9(5):504–10. pmid:8307135
  43. 43. Lynch W, Malek M, Davey P, Byrne D, Napier A. Costing wound infection in a Scottish hospital. Pharmacoeconomics. 1992;2(2):163–70. pmid:10146955
  44. 44. Reilly J, Twaddle S, McIntosh J, Kean L. An economic analysis of surgical wound infection. Journal of Hospital Infection. 2001;49(4):245–9. pmid:11740871
  45. 45. Turtiainen J, Saimanen E, Partio T, Kärkkäinen J, Kiviniemi V, Mäkinen K, et al. Surgical wound infections after vascular surgery: prospective multicenter observational study. Scandinavian Journal of Surgery. 2010;99(3):167–72. pmid:21044935
  46. 46. Defez C, Fabbro-Peray P, Cazaban M, Boudemaghe T, Sotto A, Daures JP. Additional direct medical costs of nosocomial infections: an estimation from a cohort of patients in a French university hospital. The Journal of hospital infection. 2008;68(2):130–6. Epub 2008/01/19. pmid:18201796.
  47. 47. Weber WP, Zwahlen M, Reck S, Feder-Mengus C, Misteli H, Rosenthal R, et al. Economic burden of surgical site infections at a European university hospital. Infection Control & Hospital Epidemiology. 2008;29(7):623–9. https://dx.doi.org/10.1086/589331 pmid:18564917.
  48. 48. Vrijens F, Hulstaert F, Devriese S, Van De Sande S. Hospital-acquired infections in Belgian acute-care hospitals: An estimation of their global impact on mortality, length of stay and healthcare costs. Epidemiology and Infection. 2012;140(1):126–36. http://dx.doi.org/10.1017/S0950268811000100. pmid:21320376.
  49. 49. Hyldig N, Joergensen JS, Wu C, Bille C, Vinter CA, Sorensen JA, et al. Cost-effectiveness of incisional negative pressure wound therapy compared with standard care after caesarean section in obese women: a trial-based economic evaluation. BJOG: An International Journal of Obstetrics and Gynaecology. 2018. http://dx.doi.org/10.1111/1471-0528.15573. pmid:625727692.
  50. 50. Graf K, Ott E, Vonberg R-P, Kuehn C, Haverich A, Chaberny IF. Economic aspects of deep sternal wound infections. European Journal of Cardio-Thoracic Surgery. 2010;37(4):893–6. pmid:19896860
  51. 51. Wilson A, Sturridge M, Treasure T, Grüneberg R. A scoring method (ASEPSIS) for postoperative wound infections for use in clinical trials of antibiotic prophylaxis. The Lancet. 1986;327(8476):311–2.
  52. 52. Özmen T, Javadov M, Yeğen CS. Factors affecting surgical site infection rate after elective gastric cancer surgery. Turkish Journal of Surgery/Ulusal cerrahi dergisi. 2016;32(3):178. pmid:27528811
  53. 53. Köşüş A, Köşüş N, Güler A, Çapar M. Rifamycin SV application to subcutaneous tissue for prevention of post-cesarean surgical site infection. European Journal of General Medicine. 2010;7(3).
  54. 54. Coskun D, Aytac J, Aydınlı A, Bayer A. Mortality rate, length of stay and extra cost of sternal surgical site infections following coronary artery bypass grafting in a private medical centre in Turkey. Journal of Hospital Infection. 2005;60(2):176–9. pmid:15866018
  55. 55. Zhou J, Ma X. Cost-benefit analysis of craniocerebral surgical site infection control in tertiary hospitals in China. Journal of Infection in Developing Countries. 2015;9(2):182–9. http://dx.doi.org/10.3855/jidc.4482. pmid:25699493.
  56. 56. Liu Y, Xiao W, Wang S, Chan CWH. Evaluating the direct economic burden of health care-associated infections among patients with colorectal cancer surgery in China. American Journal of Infection Control. 2018;46(1):34–8. http://dx.doi.org/10.1016/j.ajic.2017.08.003 pmid:28967510.
  57. 57. Al‐Zaru IM, AbuAlRub R, Musallam EA. Economical and clinical impact of surgical site infection following coronary artery bypass graft surgery in north Jordan. International Journal of Nursing Practice. 2011;17(2):117–25.
  58. 58. Hweidi IM, Barbarawi MA, Tawalbeh LI, Al-hassan MA, Al-Ibraheem SW. Surgical site infections after craniotomy: a matched health-care cost and length of stay study. Journal of wound care. 2018;27(12):885–90. pmid:30557106
  59. 59. Phothong N, Akaraviputh T, Chinswangwatanakul V, Methasate A, Trakarnsanga A. Cost-effective and potential benefits in three-port hand-assisted laparoscopic sigmoidectomy. Journal of the Medical Association of Thailand. 2015;98(9):864–70. pmid:26591396.
  60. 60. Siribumrungwong B, Noorit P, Wilasrusmee C, Leelahavarong P, Thakkinstian A, Teerawattananon Y. Cost-utility analysis of great saphenous vein ablation with radiofrequency, foam and surgery in the emerging health-care setting of Thailand. Phlebology. 2016;31(8):573–81. http://dx.doi.org/10.1177/0268355515604258. pmid:26341394.
  61. 61. Dal-Paz K, Oliveira PRD, de Paula AP, da Emerick MCS, Pecora JR, Lima ALLM. Economic impact of treatment for surgical site infections in cases of total knee arthroplasty in a tertiary public hospital in Brazil. Brazilian Journal of Infectious Diseases. 2010;14(4):356–9. pmid:20963320.
  62. 62. Galal I, El-Hindawy K. Impact of using triclosan-antibacterial sutures on incidence of surgical site infection. American Journal of Surgery. 2011;202(2):133–8. dhttp://dx.doi.org/10.1016/j.amjsurg.2010.06.011. pmid:21600552.
  63. 63. Tiwari P, Rohit M. Assessment of costs associated with hospital-acquired infections in a private tertiary care hospital in India. Value in Health Regional Issues. 2013;2(1):87–91. http://dx.doi.org/10.1016/j.vhri.2013.03.002. pmid:29702858.
  64. 64. Porras-Hernández JD, Vilar-Compte D, Cashat-Cruz M, Ordorica-Flores RM, Bracho-Blanchet E, Avila-Figueroa C. A prospective study of surgical site infections in a pediatric hospital in Mexico City. American journal of infection control. 2003;31(5):302–8. pmid:12888767
  65. 65. Silverstein A, Costas-Chavarri A, Gakwaya MR, Lule J, Mukhopadhyay S, Meara JG, et al. Laparoscopic Versus Open Cholecystectomy: A Cost–Effectiveness Analysis at Rwanda Military Hospital. World journal of surgery. 2017;41(5):1225–33. pmid:27905020
  66. 66. Dramowski A, Whitelaw A, Cotton MF. Burden, spectrum, and impact of healthcare-associated infection at a South African children’s hospital. Journal of Hospital Infection. 2016;94(4):364–72. http://dx.doi.org/10.1016/j.jhin.2016.08.022. pmid:27717603
  67. 67. Akhlaq A, McKinstry B, Muhammad KB, Sheikh A. Barriers and facilitators to health information exchange in low-and middle-income country settings: a systematic review. Health policy and planning. 2016;31(9):1310–25. pmid:27185528
  68. 68. Oppong R, Jowett S, Roberts TE. Economic evaluation alongside multinational studies: a systematic review of empirical studies. PloS one. 2015;10(6):e0131949. pmid:26121465
  69. 69. Drummond M, Barbieri M, Cook J, Glick HA, Lis J, Malik F, et al. Transferability of economic evaluations across jurisdictions: ISPOR Good Research Practices Task Force report. Value in health. 2009;12(4):409–18. pmid:19900249
  70. 70. Callen T. PPP versus the market: which weight matters? Finance and Development. 2007;44(1):50.
  71. 71. Shenderovich Y, Eisner M, Mikton C, Gardner F, Liu J, Murray J. Methods for conducting systematic reviews of risk factors in low-and middle-income countries. BMC medical research methodology. 2016;16(1):32.
  72. 72. Broex E, Van Asselt A, Bruggeman C, Van Tiel F. Surgical site infections: how high are the costs? Journal of Hospital Infection. 2009;72(3):193–201. pmid:19482375
  73. 73. Yasunaga H, Ide H, Imamura T, Ohe K. Accuracy of economic studies on surgical site infection. Journal of Hospital Infection. 2007;65(2):102–7. pmid:16978732
  74. 74. Chao TE, Sharma K, Mandigo M, Hagander L, Resch SC, Weiser TG, et al. Cost-effectiveness of surgery and its policy implications for global health: a systematic review and analysis. 2014;2(6):e334–e45.
  75. 75. Organization WH. Report on the burden of endemic health care-associated infection worldwide. 2011.
  76. 76. DeWulf A, Otchi EH, Soghoian S. Identifying priorities for quality improvement at an emergency Department in Ghana. BMC emergency medicine. 2017;17(1):28. pmid:28854879
  77. 77. Nwanna-Nzewunwa OC, Ajiko M-M, Kirya F, Epodoi J, Kabagenyi F, Batibwe E, et al. Barriers and facilitators of surgical care in rural Uganda: a mixed methods study. journal of surgical research. 2016;204(1):242–50. pmid:27451893
  78. 78. Shahida S, Islam A, Dey BR, Islam F, Venkatesh K, Goodman A. Hospital acquired infections in low and middle income countries: root cause analysis and the development of infection control practices in Bangladesh. Open Journal of Obstetrics and Gynecology. 2016;6(01):28.