Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Considerations in evaluating equipment-free blood culture bottles: A short protocol for use in low-resource settings

  • Sien Ombelet,

    Roles Conceptualization, Formal analysis, Methodology, Project administration, Visualization, Writing – original draft

    Affiliations Department of Clinical Sciences, Institute of Tropical Medicine, Antwerp, Belgium, Immunology & Microbiology Department, KU Leuven, Leuven, Belgium

  • Alessandra Natale,

    Roles Conceptualization, Funding acquisition, Methodology, Writing – review & editing

    Affiliation Médecins Sans Frontières, Paris, France

  • Jean-Baptiste Ronat,

    Roles Conceptualization, Funding acquisition, Writing – review & editing

    Affiliations Médecins Sans Frontières, Paris, France, Team ReSIST, INSERM U1184, School of Medicine University Paris-Saclay, Paris, France, Bacteriology-Hygiene Unit, Assistance Publique – Hôpitaux de Paris, Bicêtre Hospital, Le Kremlin-Bicêtre, France

  • Olivier Vandenberg,

    Roles Conceptualization, Supervision, Writing – review & editing

    Affiliations Center for Environmental Health and Occupational Health, School of Public Health, Université Libre de Bruxelles (ULB), Brussels, Belgium, Innovation and Business Development Unit, Laboratoire Hospitalier Universitaire de Bruxelles - Universitair Laboratorium Brussel (LHUB-ULB), ULB, Brussels, Belgium, Division of Infection and Immunity, Faculty of Medical Sciences, University College London, London, United Kingdom

  • Jan Jacobs,

    Roles Conceptualization, Methodology, Supervision, Visualization, Writing – review & editing

    Affiliations Department of Clinical Sciences, Institute of Tropical Medicine, Antwerp, Belgium, Immunology & Microbiology Department, KU Leuven, Leuven, Belgium

  • Liselotte Hardy

    Roles Conceptualization, Methodology, Supervision, Visualization, Writing – review & editing

    lhardy@itg.be

    Affiliation Department of Clinical Sciences, Institute of Tropical Medicine, Antwerp, Belgium

Abstract

Use of equipment-free, “manual” blood cultures is still widespread in low-resource settings, as requirements for implementation of automated systems are often not met. Quality of manual blood culture bottles currently on the market, however, is usually unknown. An acceptable quality in terms of yield and speed of growth can be ensured by evaluating the bottles using simulated blood cultures. In these experiments, bottles from different systems are inoculated in parallel with blood and a known quantity of bacteria. Based on literature review and personal experiences, we propose a short and practical protocol for an efficient evaluation of manual blood culture bottles, aimed at research or reference laboratories in low-resource settings. Recommendations include: (1) practical equivalence of horse blood and human blood; (2) a diverse selection of 10 to 20 micro-organisms to be tested (both slow- and fast-growing reference organisms); (3) evaluation of both adult and pediatric bottle formulations and blood volumes; (4) a minimum sample size of 120 bottles per bottle type; (5) a formal assessment of usability. Different testing scenarios for increasing levels of reliability are provided, along with practical tools such as worksheets and surveys that can be used by laboratories wishing to evaluate manual blood culture bottles.

Introduction

Diagnosis of bloodstream infection (BSI) relies mainly on blood culture, i.e. the culture of large volumes of blood in blood culture bottles (BCB). In low-resource settings (LRS), mainly so-called “manual” blood culture systems are used, as opposed to the automated blood culture systems standardly used in high-resource settings. Manual BCBs are incubated in a conventional incubator, detection of growth is done based on visual signs of growth [1]. According to a market forecasting study, manual blood culture systems will make up roughly two-thirds of the global blood culture market by 2025 [2]. It is therefore surprising that almost no research has been done on manual blood culture systems since the 1990’s, when automated systems were introduced. For a district hospital laboratory in LRS, it is difficult to find scientific guidance when looking for the optimal BCB brand. The use of home-made BCB is widespread in LRS but should be discouraged due to lack of quality assurance of production methods and the omission of necessary additives [1, 3]. Import of commercial BCB into LRS countries is often expensive and logistically difficult. To address these problems, some LRS reference laboratories have started local, centralized production of blood culture media–an example is the Centralized Media Making Laboratory in Cambodia (https://dmdp.org/media-making-lab/). To ensure acceptable performance of such BCBs, and of newly marketed commercial manual BCBs, it is necessary to perform a validation study, in which these BCBs are preferably compared to the “gold standard” automated blood culture system.

BCB performance is evaluated using phase III clinical comparative studies, in which new BCBs are compared with the gold standard in patients requiring blood culture. However, randomization between blood culture systems requires hypothetic equivalence of both systems, and automated systems have long shown to be superior to manual blood culture systems in terms of yield and time-to-detection [1]. Another option is to inoculate half of the patient’s blood in each system, but this may also deprive the patient of an essential diagnosis, as larger volumes of blood increase the yield of blood cultures [4]. Sampling more blood from patients to mitigate this risk also raises ethical issues, especially in children or patients with low hemoglobin levels [5]. Another argument against clinical comparison studies is the long duration of this study type and the low yield of blood cultures; 85–95% of sampled blood cultures will not show growth, therefore clinical studies require very high sample sizes (typically 8.000 to 9.000) to detect a sufficient number of rare pathogens [6]. Laboratory studies, in which BCBs are spiked with blood and microorganisms causing BSI, can be a valuable alternative. These in vitro studies have no implications on patient management and are more efficient; the BCBs can be spiked with a variety of organisms, pre-defined by the researchers, guaranteeing sufficient numbers and inclusion of all desired pathogens.

In this manuscript, we list some “best practices” for simulated blood cultures, based on literature review and lessons learned from studies carried out at our research group from 2017 to 2020. We propose a practical protocol for a short and efficient validation of manual BCBs using simulated blood cultures and an automated “reference” system. This validation assures minimal performance of the BCB under evaluation, for settings where large studies are not feasible.

BCB performance evaluation study: Set-up, considerations and recommendations

Preparing a BCB performance evaluation study

Objectives of the BCB evaluation study.

The main objective of the BCB evaluation study is to compare yield of a new manual BCB with an automated reference system. A secondary objective is to compare speed of growth between systems. Other secondary objectives are assessment of inter-lot variability and usability of BCBs. Some definitions used in this protocol are given in Table 1.

thumbnail
Table 1. Definitions of terms used in the protocol proposal.

https://doi.org/10.1371/journal.pone.0267491.t001

Acceptability criteria need to be determined before starting the experiments.

These criteria will depend on practical considerations, such as price and availability of other BCB and expected patient population. We developed our own set of acceptability criteria for a BCB evaluation for the Mini-lab project [7] (Table 2). In addition, Dailey et al. formulated an extensive target product profile for a blood culture system in LRS [3]. The most important acceptability criteria are yield, speed of growth and ease of use of the BCB under evaluation.

thumbnail
Table 2. Criteria for blood culture bottle performance, as defined by the mini-lab project.

https://doi.org/10.1371/journal.pone.0267491.t002

Three testing scenario’s: From minimal to optimal

We propose three “scenarios”, depending on how extensive the validation needs to be (Table 3). For a minimal scenario, 10 different bacterial species are tested (Table 4) with 1 strain per species. Both BCB types (BCB under evaluation and reference system) are inoculated in triplicate with the same blood-bacteria suspension (= one run). This is done once for adult formulations, once for pediatric formulations, with corresponding volumes of blood and representative bacterial concentrations. These runs are then repeated for a second lot of BCBs, to assess inter-lot variability. For the optimal scenario, 20 species are tested in total for three lots, for both adult and pediatric formulations. In the intermediate scenario, 20 species are tested for two lots. Table 3 gives an overview of number of BCBs and volume of blood needed for each of these scenarios. For pathogen species showing suboptimal growth in the BCB under evaluation (yield of less than 75%), we recommend testing additional strains of the same species; the extra number of BCBs and volume of blood needed in this case are also given in Table 3.

thumbnail
Table 3. Logistical and statistical implications of three scenarios of blood culture bottle (BCB) validation.

https://doi.org/10.1371/journal.pone.0267491.t003

thumbnail
Table 4. Proposal for species to be tested in a blood culture bottle performance validation study in low-resource settings.

https://doi.org/10.1371/journal.pone.0267491.t004

We performed basic sample size calculations to estimate the level of differences that can be detected with these testing scenarios (Table 3). For these sample size calculations, we assumed two-sided tests, confidence levels of 95%, power levels of 80%, and a yield of the reference system of 97% (based on unpublished data from our research group and yield of automated systems published in literature) [810]). An online calculator was used for the sample size calculation (https://www.stat.ubc.ca/~rollin/stats/ssize/b2.html) and the VassarStats website for calculation of the confidence interval (http://vassarstats.net/prop1.html). To detect a difference in yield of 10% between the BCB under evaluation and the reference system, corresponding to a relative yield of 90% compared to the reference system, a sample size in each group of at least 115 is needed. This would correspond to a “minimal” testing scenario (Table 3). Such a “minimal” scenario avoids unnecessary extensive validation of a BCB which has a clearly suboptimal performance (< 90% of the reference system). Some of the assumptions of these calculations will influence detectable differences. The higher the yield of the reference system, the higher the power to detect small differences. Stratifying results according to strain, adult versus pediatric formulation or lot number, on the other hand, will decrease power. Appropriate data analysis (taking into account the dependence of the data) may further increase power [11].

A negative control for each BCB type should be added to the test panel per run, to ensure sterility of the blood used and of the procedures. The negative control is a BCB filled with non-spiked blood from the same blood bag or lot of horse blood as used for the experiments.

Performance evaluation

The use of horse blood has logistical and ethical advantages compared to human blood.

Most simulated BCB studies are done with human banked blood [10, 12, 1321], because differences in plasma components and red blood cell enzymes between mammal species may affect bacterial growth. In addition, variations in visible signs of growth are possible due to inter-species differences in aggregation characteristics and fragility of red blood cells [2224]. Despite these advantages, the large volumes of blood needed (> 4 liter, see Table 3) imply ethical and logistic difficulties. The availability of left-over blood in blood banks is limited and variable over time, jeopardizing efficient experiment planning. Left-over blood from multiple volunteers is pooled, compromizing standardization.

An alternative to human blood is defibrinated horse blood [8, 2531]. Altun et al. claimed that using horse blood does not significantly alter the performance of blood culture systems [8]. However, no evaluations of equivalence between human blood and horse blood used for BCB evaluation have been published. Advantages of horse blood over human blood are availability, logistic ease and standardization, at least in those settings where commercial horse blood is available. To demonstrate equivalence of horse blood for use in BCB evaluation studies, we performed a head-to-head comparison of horse and human blood (S1 File). We demonstrated that horse blood can be used for BCB validation studies. Sheep blood is generally more available in LRS [32]. Few BCB validation studies using sheep blood have been published [33]. Before systematically using sheep blood, a validation study is needed. To ensure equivalent visual and growth characteristics, packed cell volume of both commercial horse and sheep blood should be similar to human blood (35–45%).

A diverse selection of clinically relevant micro-organisms should be tested.

To evaluate whether all types of pathogens grow well in the BCB under evaluation, a broad selection of invasive pathogens should be used. Evidently, key BSI pathogens, depending on the setting, should be selected. We propose a list of essential organisms tailored to LRS in Table 4. This list includes all important pathogen “groups” and both fast- and slow-growing microorganisms [17, 3438]. Fast-growing organisms have a median time-to-positivity in automated systems between approximately 9–15 hours, whereas slow-growing organisms have time-to-positivity > 18 hours. We only recommend testing of aerobic bacteria (and BCB), as anaerobic bacteremia is less relevant in LRS [1].

We advise using certified bacterial strains (e.g., American Type Culture Collection (ATCC)) instead of clinical strains, as these are representative members of their species. Reproducibility and standardization of the study results is therefore expected. However, basic growth characteristics of the strains used should be assured: some ATCC strains are known to grow poorly in certain culture media (e.g., Escherichia coli ATCC 8739, https://www.lgcstandards-atcc.org/products/all/8739.aspx?geo_country=be#culturemethod); the use of such strains is best avoided.

Dilution series can be used to achieve low bacterial concentrations.

The concentration of micro-organisms in the blood of adult BSI patients is in the order of <1–10 colony forming units (CFU) per mL [3942]. In clinical blood cultures, a BCB filled with 10 mL of blood contains on average 1–100 CFUs. This range should be respected in in vitro BCB evaluations. Indeed, most studies using simulated blood cultures add between 5 and 125 CFU per BCB [8, 1216, 1921, 29]. A low CFU concentration can be achieved by making serial dilutions from a 0.5 McFarland suspension containing approximately 1.5 x 108 CFU/mL [43], at least for Gram-negative bacteria such as E. coli. This is not true for all microorganisms: e.g. for Candida species, 0.5 McFarland only contains 1–5 x 106 CFU/mL [44]. Dilution series should take this into account [17]. Methods for dilution series are depicted in Fig 1.

thumbnail
Fig 1. Recommended methods for spiking blood culture bottles.

Calibrated pipettes must be used. Strains to be tested undergo two passages on blood or chocolate agar before the suspension is prepared. To confirm the concentration of the final bacterial suspension, 100 μl spread out on a blood agar plate for colony counts the next day (in triplicate). CFU = colony forming units.

https://doi.org/10.1371/journal.pone.0267491.g001

Plate colony counts to check bacterial concentrations are common practice, but have a low precision due to sampling variation, especially at low concentrations [4549]. The mean colony count follows the Poisson distribution, implying that the lower the concentration, the higher the standard deviation relative to the mean, and the less reliable the plate count will turn out to be. The same sampling variation applies to adding colonies to BCBs. Reliably counting (or adding) CFU numbers lower than 25 is challenging; this is considered the “limit of quantification” [45]. To mitigate the effect of the large total error on the estimated bacteria concentration of the suspension, it is generally advised to take the mean of three plate counts of the same suspension [45]. Triplicate plate counts are also advised as a quality check of the dilution series; in case of persistently lower or higher counts than expected, or in case of large variation between the three separate plate counts per dilution, the dilution procedure should be adapted. Plate counts are also useful in the phase of data analysis, as higher initial bacterial inocula could lead to faster growth and must be adjusted for.

Both adult and pediatric formulations should be tested.

Bacterial concentrations in children with bacteremia are believed to be higher than in adults, but blood volumes added to the BCB are lower [50, 51]. Testing of both adult and pediatric blood volumes and bacterial concentrations is advised, as different blood-broth ratios can affect performance of the BCBs [52]. Moreover, many manufacturers have different BCBs for adult and pediatric blood cultures. Blood volume added to pediatric BCBs in simulated blood culture studies is usually 4–5 mL [16, 1921]. This is the upper limit of recommended blood volumes in children, but is not entirely representative for pediatric populations, as sampled blood volumes typically vary between 0.5 mL (for neonates) and 4 mL (for older children) [51]. We therefore recommend using a volume of 2 mL. For adult formulations, a volume between 8 and 10 mL per BCB is often used [8, 12, 13, 16, 1921, 29] and is indeed recommended in clinical practice [4].

Growth in manual BCBs should be visually assessed twice daily.

Before use, each BCB should be checked visually for evident signs of contamination, such as broth turbidity or colonies on agar slant (for biphasic BCBs). After inoculation, the reference BCBs are incubated until the automate detects growth. Manual BCBs are inspected twice daily for visual signs of growth, such as turbidity, hemolysis and gas production [1] (Fig 2). To standardize this visual inspection, it is advisable to use a diffuse light source, such as a lightbox. The cycle of incubation/inspection continues until the broth (or agar slant) shows visual signs of growth, or up to 7 nights of incubation in case of no visible growth. For all manual BCBs, a blind subculture is performed on blood agar on day 1 (20–24 hours after start of incubation). A second subculture is done for manual BCBs with negative day 1 subculture, either upon visual growth (“positivity” subculture) or after 7 nights without visual growth (“terminal” subculture) to exclude growth (Fig 3). Autolysis of bacteria, leading to visual signs of growth but lack of colony growth on subculture, can be detected by performing Gram stain on such BCBs. A daily schedule of activities is presented in Table 5. Worksheet examples to be used during the study can be found in S2 File.

thumbnail
Fig 2. Visual signs of growth in manual blood culture bottles.

(A): pellicle formation on surface; (B) gas production; (C) turbidity (left bottle: no growth; right bottle: turbidity; (D) puff balls. (first published in Frontiers in Medicine (1), reproduced with permission).

https://doi.org/10.1371/journal.pone.0267491.g002

thumbnail
Fig 3. Laboratory processing of spiked manual blood culture bottles.

The bottles are incubated on day 0. Blind subculture is performed on day 1, regardless of signs of growth. If blind subculture is negative, another subculture is done when growth is detected visually (in this example, day 3). If none of the subcultures shows growth, a terminal subculture is done on day 7.

https://doi.org/10.1371/journal.pone.0267491.g003

thumbnail
Table 5. Daily schedule of activities during a week of BCB evaluation.

https://doi.org/10.1371/journal.pone.0267491.t005

Data analysis should take “clustering” on bacterial strain into account.

Statistical methods to compare the yield and speed of growth of the manual BCB under evaluation with the reference system must take dependence of the data into account: the same bacterial suspension is used to inoculate three BCBs of both BCB types. Yield and speed of growth will be more similar among BCBs inoculated with the same suspension. The data is thus essentially “clustered” on the strain tested. Data analysis should take this into account, as this will affect confidence intervals and p-values for hypothesis tests; the direction of this change is dependent on the type of clustered data [11]. Several analysis approaches are possible; we refer to other papers for detailed information and examples [11, 53]. A practical and robust approach, in our opinion, would be to use a random effects logistic regression, as regression models have the ability to incorporate other variables as well [11].

Ease of use assessment of BCB

Ease of use assessment is often overlooked in the evaluation of in vitro diagnostics (IVD), despite its importance in succesfull implementation of diagnostics in remote settings and WHO recommendations for IVD development [54, 55]. Apart from good technical performance, an ideal BCB allows easy sampling, by assuring a strong vacuum, a septum that is not too rigorous and compatibility with adapters for use with butterfly needles. Visual evaluation of growth for manual BCBs is facilitated by transparency of the bottle material, transparent labels and visual aids such as growth indicators. BCBs should allow easy labelling, with sufficient space to provide all necessary information. Lastly, BCB material should be in line with biosafety requirements. This pertains for instance to the possibility to safely autoclave the material before transport for incineration and subsequent disposal, as some types of plastic cannot withstand high temperatures. For more information on ease of use, see S3 File.

Technical assessment of ease of use: A strong vacuum in the BCB facilitates sampling

The BCB vacuum allows for passive blood aspiration into the BCB. This is necessary when using butterfly needles, but will also facilitate sampling with syringe and needle as it obviates the need to put pressure on the syringe, an action that increases risk of needlestick injury and spills. Commonly used BCBs such as BacT/ALERT have a vacuum exceeding 10 mL, which enables easy sampling but entails a risk of overfilling [56]. To exactly measure the vacuum, specialized devices are needed, such as hydrostatic gauges or mercury column manometers [57]. However, this level of detail is not needed to assess ease of blood collection.

We propose a practical vacuum estimation based on passive aspiration of water, using 10 BCBs from at least 2 different lots. For the needle and syringe sampling method, vacuum is tested by connecting a 21-gauge needle to a 10 mL syringe filled with distilled water. When the needle perforates the BCB septum, the water is aspirated into the BCB (without applying pressure!). The volume of water still present in the syringe at the end of the procedure can be used to calculate the volume of water aspirated. For the butterfly needle sampling method, the hub and tube of a 21-gauge butterfly needle are put into a 100 mL measuring glass filled with distilled water. The septum of the BCB is pierced with the butterfly needle while the other end is kept stable in the measuring glass. After filling of the BCB by the vacuum, the difference between start and end volume of water in the measuring glass is measured and calculated. Using these test data, inter-lot and intra-lot coefficients of variation (CV) of BCB vacuum can be calculated, giving an indication of uniformity of production procedures.

Assessing ease of use by the end-user: Survey (S3 File)

In S3 File, we propose a survey for a qualitative assessment of ease of use. More information on essential aspects of ease of use can also be found in this Supporting information.

Limitation of the study design

General limitations of simulated blood cultures apply here; this in vitro approach does not constitute a “real-life” situation. Many important variables that influence growth of bacteria, such as concentration of bacteria and the presence of antibiotics or other microbiocidal factors in the plasma, may substantially differ from clinical conditions. For manual BCB, which are visually inspected daily, there is also an important observer bias related to simulated blood cultures; the laboratory technicians know that BCBs have been inoculated with microorganisms and this can influence their assessment of signs of growth. Blinded assessment is possible but implies inoculating a large number of BCBs with non-spiked blood as well; this would dramatically increase workload and volume of blood needed. Because of these limitations, results from simulated blood culture studies cannot be directly generalized to the field.

Most studies first add a bacterial suspension with a pre-defined number of CFU to the BCB and then add blood. We opted for another approach, adding the micro-organisms to the blood first and inoculating the blood into the BCB after homogenization of the blood-microorganism mixture on a roller-mixer. Introducing the bacterial suspension directly into the BCB requires inoculation of very small volumes (100 μL) with syringe and needle. This is difficult to do reliably, with the risk of considerably increasing variation in CFU between BCBs, especially as relatively low concentrations are used. Moreover, spiking the blood first creates a situation more similar to real-life conditions, as differences in CFU added between BCBs will depend on the sampling variation of the eventual concentration of bacteria in the spiked blood, and less on technical imprecisions during inoculation. However, this approach adds an additional dilution step with its associated additional variation.

Vacuum in BCBs is not static and typically decreases over time. When comparing the vacuum in BCBs from different lot numbers, it is therefore important to take the date of production into account and to compare only BCBs of approximately the same age (inferred from the expiration and production date). Moreover, many BCBs have a vacuum that aspirates more than 10 mL of water. The proposed method is only appropriate to assess whether vacuum is sufficient to easily aspirate blood, not to give reliable means for vacuums exceeding passive aspiration of 10 mL. Lastly, viscosity of water is lower than that of blood; therefore, the volume of water passively aspirated may be higher than the volume of blood passively aspirated.

Conclusion and future research possibilities

This report aims to give practical guidance to laboratories or research facilities that wish to evaluate the performance of (manual) BCB. We hope to encourage researchers and reference laboratories from LRS to validate BCB in their settings, to ensure acceptable quality of the BCBs and to add research on new manual BCB to the existing literature. There are no recent publications on performance of manual BCB, despite favorable market forecasts for these products [2]. To encourage clinical bacteriology at district laboratory level, quality assurance for consumables is of utmost importance [58]. Evaluation of ease of use of BCB and compatibility with common waste disposal practices such as autoclavation is seldom done, if at all. Nonetheless, these characteristics play an important role in successful implementation of blood cultures in LRS.

For many of the recommendations given above, empirical evidence from published studies was scarce. For example, we found no studies that compared horse blood with human blood for validation studies. Another knowledge gap is the effectiveness of dilution series to assure appropriate bacterial concentrations; we found plate colony counts resulting from dilution series to be widely divergent across bacterial species. Studies quantifying differences in bacterial concentrations between species would be welcomed to obtain more precise estimates of number of CFU added to the BCB, as would improvements in the methods for quantification of bacterial concentrations. More research on best practices for performing standardized and efficient validation studies is needed.

Supporting information

S1 File. Report on head-to-head comparison of horse blood with human blood for blood culture bottle validation studies.

https://doi.org/10.1371/journal.pone.0267491.s001

(DOCX)

S2 File. Examples of worksheets to be used in blood culture bottle validation study.

https://doi.org/10.1371/journal.pone.0267491.s002

(DOCX)

Acknowledgments

We would like to thank Thierry Naas, Kaat Eggermont, Tine Vermoesen and Ellen Corsmit for their valued input and support in optimizing our blood culture validation protocol.

References

  1. 1. Ombelet S. et al., “Best Practices of Blood Cultures in Low- and Middle-Income Countries,” Front. Med., vol. 6, no. June, 2019, pmid:31275940
  2. 2. Grand View Research, Blood culture tests: Market analysis & Segment forecast from 2014–2025. San Fransisco, CA, USA: Grand View Research, 2018.
  3. 3. Dailey P. et al., “Defining System Requirements for Simplified Blood Culture to Enable Widespread Use in Resource-Limited Settings,” Diagnostics, vol. 9, no. 1, p. 10, 2019, pmid:30641976
  4. 4. Cockerill F. R. et al., “Optimal testing parameters for blood cultures,” Clin Infect Dis, vol. 38, no. 12, pp. 1724–1730, 2004, pmid:15227618
  5. 5. Kuijpers L. M. F. et al., “Severe anaemia associated with Plasmodium falciparum infection in children: consequences for additional blood sampling for research,” Malar. J., pp. 1–6, 2016, pmid:26729363
  6. 6. Wilson M. L. and Mirrett S., “Recovery of select rare and fastidious microorganisms from blood cultures,” Clin. Lab. Med., vol. 14, no. 1, pp. 119–131, 1994. pmid:8181226
  7. 7. Natale A. et al., “The Mini-Lab: accessible clinical bacteriology for low-resource settings,” Lancet Microbe, vol. 1, no. June, pp. 56–58, 2020,
  8. 8. Altun O., Almuhayawi M., and Taha R., “Controlled Evaluation of the New BacT / Alert Virtuo Blood Culture,” J Clin Microbiol., vol. 54, no. 4, pp. 1148–1151, 2016, pmid:26842707
  9. 9. Miller N., Brassinne L., Allemeersch D., Miller N., Brassinne L., and Allemeersch D., “Implementation of the new VIRTUO blood culture system: evaluation and comparison to the 3D system using simulated blood cultures,” Acta Clin. Belg., vol. 3286, no. August, pp. 1–4, 2017, pmid:28583022
  10. 10. Viganò E. F., Vasconi E., Agrappi C., and Clerici P., “Use of simulated blood cultures for time to detection comparison between BacT/ALERT and BACTEC 9240 blood culture systems,” Diagn. Microbiol. Infect. Dis., vol. 44, pp. 235–240, 2002. pmid:12493169
  11. 11. Galbraith S., Daniel J. A., and Vissel B., “A study of clustered data and approaches to its analysis,” J. Neurosci., vol. 30, no. 32, pp. 10601–10608, 2010, pmid:20702692
  12. 12. Kikuchi K. et al., “Potential Impact of Rapid Blood Culture Testing for Gram-Positive Bacteremia in Japan with the Verigene Gram-Positive Blood Culture Test,” Can. J. Infect. Dis. Med. Microbiol., vol. 2017, 2017, pmid:28316631
  13. 13. Miller N. S., Rogan D., Orr B. L., and Whitney D., “Comparison of BD bactec plus blood culture media to versaTREK redox blood culture media for detection of bacterial pathogens in simulated adult blood cultures containing therapeutic concentrations of antibiotics,” J. Clin. Microbiol., vol. 49, no. 4, pp. 1624–1627, 2011, pmid:21307220
  14. 14. Park J., Han S., and Shin S., “Comparison of Growth Performance of the BacT/ALERT VIRTUO and BACTEC FX Blood Culture Systems Under Simulated Bloodstream Infection Conditions,” Clin Lab, vol. 63, no. 1, pp. 39–46, 2017, pmid:28164485
  15. 15. Rozdzinski E., Kirchner S., and Kern W., “Removal of the Antibacterial Activity of TrimethoprimSulfamethoxazole, Ofloxacin and Zidovudine by BACTEC Resin-Containing Blood Culture Medium,” Zentralblatt fur Bakteriol., vol. 275, no. 3, pp. 320–326, 1991,
  16. 16. Samuel L. P., Pimentel J. D., Tibbetts R. J., Martin R., Hensley R., and Meier F. A., “Comparison of time to positivity of the VersaTREK® REDOX 80-mL and the REDOX EZ draw 40-mL blood culture bottles for common bacterial bloodstream pathogens,” Diagn. Microbiol. Infect. Dis., vol. 71, no. 2, pp. 101–105, 2011, pmid:21795003
  17. 17. Somily A. M. et al., “Time-to-detection of bacteria and yeast with the BACTEC FX versus BacT/Alert Virtuo blood culture systems,” Ann. Saudi Med., vol. 38, no. 3, pp. 194–199, 2018, pmid:29848937
  18. 18. Viganò E. F., Vasconi E., Agrappi C., Clerici P., and Melloni P., “Use of simulated blood cultures for antibiotic effect on time to detection of the two blood culture systems BacT/ALERT and BACTECTM 9240,” New Microbiol., vol. 27, p. 235/248, 2004.
  19. 19. Marlowe E. M., Gibson L., Hogan J., Kaplan S., and Bruckner D. A., “Conventional and Molecular Methods for Verification of Results Obtained with BacT / Alert Nonvent Blood Culture Bottles,” J Clin Microbiol., vol. 41, no. 3, pp. 1266–1269, 2003, pmid:12624064
  20. 20. Totty H. et al., “A controlled comparison of the BacT/ALERT® 3D and VIRTUO microbial detection systems,” Eur. J. Clin. Microbiol. Infect. Dis., vol. 36, no. 10, pp. 1795–1800, 2017, pmid:28500506
  21. 21. Menchinelli G. et al., “In vitro Evaluation of BACT / ALERT ® VIRTUO ®, BACT / ALERT 3D ®, and BACTEC FX Automated Blood Culture Systems for Detection of Microbial Pathogens Using Simulated Human Blood Samples,” Front. Microbiol., vol. 10, no. February, 2019, pmid:30837964
  22. 22. Weng X., Cloutier G., Pibarot P., and Durand L., “Comparison and simulation of different levels of erythrocyte aggregation with pig, horse, sheep, calf, and normal human blood [published correction appears in Biorheology 1996 Nov-Dec;33(6):509],” Biorheology, vol. 33, no. 4–5, pp. 365–377, 1996.
  23. 23. Baskurt O. K., Farley R. A., and Meiselman H. J., “Erythrocyte aggregation tendency and cellular properties in horse, human, and rat: A comparative study,” Am. J. Physiol.—Hear. Circ. Physiol., vol. 273, no. 6, pp. 42–46, 1997, pmid:9435593
  24. 24. Chan C. H. H., Pieper I. L., Robinson C. R., Friedmann Y., Kanamarlapudi V., and Thornton C. A., “Shear Stress-Induced Total Blood Trauma in Multiple Species,” Artif. Organs, vol. 41, no. 10, pp. 934–947, 2017, pmid:28744884
  25. 25. Rimmer K., Cabot M., Microbiology M., and Liverpool R., “Comparison of Bactec NR-660 and Signal systems,” J Clin Pathol, vol. 41, no. 660, pp. 676–678, 1988. pmid:3133401
  26. 26. Miller N., Brassinne L., and Allemeersch D., “Implementation of the new VIRTUO blood culture system: evaluation and comparison to the 3D system using simulated blood cultures,” Acta Clin. Belg., vol. 73, no. 1, pp. 16–20, 2018, pmid:28583022
  27. 27. Rogers M. S. and Oppenheim B. A., “The use of continuous monitoring blood culture systems in the diagnosis of catheter related sepsis,” J Clin Pathol, vol. 51, no. April, pp. 635–637, 1998.
  28. 28. Elliott T. S. et al., “Improved recovery of antibiotic-stressed microorganisms on inclusion of saponin in aerobic blood culture media.,” Eur. J. Clin. Microbiol. Infect. Dis., vol. 17, no. 8, pp. 566–9, 1998. pmid:9796655
  29. 29. Stevens C. M. et al., “Development of o.a.s.i.s., a new automated blood culture system in which detection is based on measurement of bottle headspace pressure changes,” J. Clin. Microbiol., vol. 32, no. 7, pp. 1750–1756, 1994, pmid:7929769
  30. 30. Almuhayawi M., Altun O., Abdulmajeed A. D., Ullberg M., and Özenci V., “The performance of the four anaerobic blood culture bottles BacT/ALERT-FN,-FN Plus, bactec-plus and-lytic in detection of anaerobic bacteria and identification by direct MALDI-TOF MS,” PLoS One, vol. 10, no. 11, pp. 1–11, 2015, pmid:26554930
  31. 31. Weinbren M. J. and Borthwick M. A., “Rapid detection of extended-spectrum β-lactamase (ESBL)-producing organisms in blood culture,” J. Antimicrob. Chemother., vol. 55, no. 1, pp. 131–132, 2005, pmid:15574477
  32. 32. Russell F. M. et al., “As a bacterial culture medium, citrated sheep blood agar is a practical alternative to citrated human blood agar in laboratories of developing countries,” J. Clin. Microbiol., vol. 44, no. 9, pp. 3346–3351, 2006, pmid:16954271
  33. 33. Nawrot U. et al., “Evaluation of blood culture media for the detection of fungi,” Eur. J. Clin. Microbiol. Infect. Dis., vol. 34, no. 1, pp. 161–167, 2015, pmid:25098681
  34. 34. Ruiz-Giardín J. M., Martin-Díaz R. M., Jaqueti-Aroca J., Garcia-Arata I., San Martín-López J. V., and Sáiz-Sánchez Buitrago M., “Diagnosis of bacteraemia and growth times,” Int. J. Infect. Dis., vol. 41, pp. 6–10, 2015, pmid:26482387
  35. 35. Martínez J. A. et al., “Microbial and clinical determinants of time-to-positivity in patients with bacteraemia,” Clin. Microbiol. Infect., vol. 13, no. 7, pp. 709–716, 2007, pmid:17484763
  36. 36. Lambregts M. M. C., Bernards A. T., Van Der Beek M. T., Visser G., and De Boer M. G., “Time to positivity of blood cultures supports early re-evaluation of empiric broad-spectrum antimicrobial therapy,” PLoS One, vol. 14, no. 1, p. e0208819, 2019. pmid:30601829
  37. 37. Biondi E. A. et al., “Blood culture time to positivity in febrile infants with bacteremia,” JAMA Pediatr., vol. 168, no. 9, pp. 844–849, 2014, pmid:25048522
  38. 38. Lambregts M. M. C. et al., “Distribution and Clinical Determinants of Time-To-Positivity of Blood Cultures in Patients with Neutropenia,” Eur. J. Haematol., vol. 100, pp. 206–214, 2018, pmid:29171916
  39. 39. Yagupsky P. and Nolte F. S., “Quantitative aspects of septicemia,” Clin. Microbiol. Rev., vol. 3, no. 3, pp. 269–279, 1990, pmid:2200606
  40. 40. Wang S. K., Chu C. J., Shan D. S., Sun P. S., and Wu Q., “Yields from blood cultures of patients with suspected paratyphoid fever A,” Brazilian J. Microbiol., vol. 41, pp. 283–285, 2010. pmid:24031492
  41. 41. Wain J. et al., “Quantitation of Bacteria in Bone Marrow from Patients with Typhoid Fever: Relationship between Counts and Clinical Features Quantitation of Bacteria in Bone Marrow from Patients with Typhoid Fever: Relationship between Counts and Clinical Features,” J. Clin. Microbiol., vol. 39, no. 4, pp. 1571–1576, 2001, pmid:11283089
  42. 42. Zhou L. et al., “Development and evaluation of a blood culture PCR assay for rapid detection of salmonella paratyphi A in clinical samples,” PLoS One, vol. 11, no. 3, pp. 1–14, 2016, pmid:26930553
  43. 43. Chandrasekaran S. et al., “Direct-from-blood-culture disk diffusion to determine antimicrobial susceptibility of gram-negative bacteria: Preliminary report from the clinical and Laboratory Standards Institute Methods Development and Standardization Working Group,” J. Clin. Microbiol., vol. 56, no. 3, pp. 1–10, 2018, pmid:29305540
  44. 44. EUCAST, “EUCAST Definitive Document EDef 7.1: Method for the determination of broth dilution MICs of antifungal agents for fermentative yeasts,” Clin Microbiol Infect, vol. 14, no. 4, pp. 398–405, 2008, pmid:18190574
  45. 45. Sutton S., “Microbiology Topics. Accuracy of Plate Counts,” J. Valid. Technol., vol. 17, no. 3, pp. 42–46, 2011.
  46. 46. Jennison M. and Wadsworth G., “Evaluation of the errors involved in estimating bacterial numbers by the plating method,” J Bacteriol, vol. 39, no. 4, pp. 389–397, 1940. pmid:16560300
  47. 47. Weenk G., “Microbiological assessment of culture media: comparison and statistical evaluation of methods.,” Int J Food Microbiol, vol. 17, no. 2, pp. 159–81, 1992. pmid:1486024
  48. 48. Tomasiewicz D., Hotchkiss D., Reinbold G., Read R., and Hartman P., “The Most Suitable Number of Colonies on Plates for Counting,” J. Food Prot., vol. 43, no. 4, pp. 282–286, 1980, pmid:30822862
  49. 49. Ben-David A. and Davidson C. E., “Estimation method for serial dilution experiments,” J. Microbiol. Methods, vol. 107, pp. 214–221, 2014, pmid:25205541
  50. 50. Kellogg J. A, Manzella J. P., and Bankert D. A, “Frequency of Low-Level Bacteremia in Children from Birth to Fifteen Years of Age,” J. Clin. Microbiol., vol. 38, no. 6, pp. 2181–2185, 2000, pmid:10834973
  51. 51. Bard J. D. and Tekippe M., “Diagnosis of Bloodstream Infections in Children,” J. Clin. Microbiol., vol. 54, no. 6, pp. 1418–1424, 2016,
  52. 52. Auckenthaler R., Ilstrup D. M., and Washington J. A., “Comparison of recovery of organisms from blood cultures diluted 10% (volume/volume) and 20% (volume/volume),” J. Clin. Microbiol., vol. 15, no. 5, pp. 860–864, 1982.
  53. 53. Durkalski V. L., Palesch Y. Y., Lipsitz S. R., and Rust P. F., “Analysis of clustered matched-pair data,” Stat. Med., vol. 22, no. 15, pp. 2417–2428, 2003, pmid:12872299
  54. 54. World Health Organization (WHO), “Technical Specification series,” 2020. https://www.who.int/diagnostics_laboratory/guidance/technical-specifications-series/en/
  55. 55. IMDRF (International Medical Device Regulators Forum), “Essential Principles of Safety and Performance of Medical Devices and IVD Medical Devices (IMDRF GRRP WG(PD1)/N47),” 2018.
  56. 56. Alfa M., Sanche S., Roman S., Fiola Y., and Lenton P., “Continuous Quality Improvement for Introduction of Automated Blood Culture Instrument,” J. Clin. Microbiol., vol. 33, no. 5, pp. 1185–1191, 1995. pmid:7615727
  57. 57. Beckwith T. G., Marangoni R. D., and Lienhard J. H., “Measurement of Low Pressures,” in Mechanical Measurements, Fifth., Reading, Massachusetts: Addison-Wesley, 1993, pp. 591–595.
  58. 58. Jacobs J. et al., “Diagnostic Bacteriology in District Hospitals in Sub-Saharan Africa: At the Forefront of the Containment of Antimicrobial Resistance,” Front. Med., vol. 6, no. September, 2019, pmid:31608280