http://orcid.org/0000-0003-4887-5124
Figures
Abstract
There has been an increasing incidence of Lyme disease (LD) in Canada and the United States corresponding to the expanding range of the Ixodes tick vector and Lyme disease agent (Borrelia burgdorferi sensu stricto). There are many diagnostic tests for LD available in North America, all of which have some performance issues, and physicians are concerned about the appropriate use and interpretation of these tests. The objective of this systematic review is to summarize the North American evidence on the accuracy of diagnostic tests and test regimes at various stages of LD. Included in the review are 48 studies on diagnostic tests used in North America published since 1995. Thirteen studies examined a two-tier serological test protocol vs. clinical diagnosis, 24 studies examined single assays vs. clinical diagnosis, 9 studies examined single immunoblot vs. clinical diagnosis, 7 studies compared culture or PCR direct detection methods vs. clinical diagnosis, 22 studies compared two or more tests with each other and 8 studies compared a two-tiered serological test protocol to another test. Recent studies examining the sensitivity and specificity of various test protocols noted that the Immunetics® C6 B. burgdorferi ELISA™ and the two tier approach have superior specificity compared to proposed replacements, and the CDC recommended western blot algorithm has equivalent or superior specificity over other proposed test algorithms. There is a dramatic increase in test sensitivity with progression of B. burgdorferi infection from early to late LD. Direct detection methods, culture and PCR of tissue or blood samples were not as sensitive or timely compared to serological testing. It was also noted that there are a large number of both commercial (n = 42) and in-house developed tests used by private laboratories which have not been evaluated in the primary literature.
Citation: Waddell LA, Greig J, Mascarenhas M, Harding S, Lindsay R, Ogden N (2016) The Accuracy of Diagnostic Tests for Lyme Disease in Humans, A Systematic Review and Meta-Analysis of North American Research. PLoS ONE 11(12): e0168613. https://doi.org/10.1371/journal.pone.0168613
Editor: Brian Stevenson, University of Kentucky College of Medicine, UNITED STATES
Received: August 25, 2016; Accepted: December 2, 2016; Published: December 21, 2016
Copyright: © 2016 Waddell et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files and S3 contains the datasets for each table.
Funding: The authors received no funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Lyme disease (LD) is the most common tick-borne infection in North America [1,2]. It was first publically recognized in the United States in 1975 in the towns of Lyme and Old Lyme Connecticut as a result of an investigation into 51 cases (39 children) with a similar form of arthritis, although the first case was describe five years earlier by a dermatologist in Wisconsin [3,4]. In North America early signs of infection may include erythema migrans (EM, a characteristic skin rash that often has a bulls eye appearance) and fever and non-specific symptoms like headache and lethargy [5,6]. If untreated, the disease can progress to disseminated LD with neurological, cardiac and arthritic manifestations [7]. Lyme disease in North America is caused by Borrelia burgdorferi sensu stricto (hereafter called B. burgdorferi) and recently Borrelia mayonii was identified and may be responsible for a proportion of cases, however the performance of LD diagnostic tests to identify B. mayonii infection is not available [8]. In Europe B. afzelii, B. garinii, B. burgdorferi, B. spielmanii, B. bissettii and B. bavariensis cause disease with a wider variety of symptoms than reported in North America; a number of genospecies including B garinii occur in Asia.
Ticks of the genus Ixodes transmit the spirochete when they feed. Ixodes scapularis, the blacklegged tick, is the main vector in northeastern and upper midwestern United States and Canada while I. pacificus is the major vector in western United States and western Canada [9,10]. The primary vectors of LD in Europe and Asia are I. ricinus and I. persulcatus respectively [6,11]. The principal natural hosts of immature stages of the ticks and B. burgdorferi include rodents, other small and medium sized mammals, reptiles and birds, while adult female ticks feed mainly on deer [12].
Lyme disease incidence has increased since 1975 as the tick vectors have expanded their geographic range across the north eastern and upper mid-western states in the US and more recently into Canada [2,13]. Range and spread of ticks and B. burgdorferi is facilitated by migratory birds and terrestrial hosts [14]. There is increasing evidence that climate change will result in further northward expansion of the tick vector’s range in Canada, resulting in increased future risk of LD among Canadians [15,16].
The diagnostic tests available for confirmation of human LD have variable sensitivity and specificity depending on the stage of infection, thus it is important to monitor the literature on available tests for LD to promote those tests that perform the most effectively and address concerns about the performance of non-validated tests and test protocols using evidence-informed strategies for decision making [17,18]. Currently in Canada and the United States, a two-tiered serology protocol is the only validated diagnostic approach for LD diagnosis recommended by United States CDC and the Public Health Agency of Canada [17,18]. This two-tiered test is typically an enzyme immunoassay (EIA) to detect IgM or IgG antibodies to B. burgdoferi in serum and if the sample is positive or equivocal on the screening assay, then a western blot is used to detect serum IgM or IgG antibodies to B. burgdorferi. Use of IgM testing is recommended during the first 30 days of infection, after which only IgG tests should be used. Currently, only serology tests have been licensed for use by the FDA and the Health Canada Medical Devices Branch (HC) for LD testing [19,20]. Other direct detection tests such as PCR may be commercially available, but they have not been licensed for use by a governing body. There are a number of commercial EIA kits that are licensed by the FDA and/or HC and use either whole cell preparation of B. burgdorferi and/or purified recombinant or chimeric antigens (see S2 Text). Other EIAs reported in the literature have been developed within the reporting laboratory and have not been commercialized or under-gone licensing and will be referred to as in-house developed tests [21,22]. The EIA’s have good sensitivity after 30 days of infection, but typically suffer from lower specificity [22]. In 1995, the Centers for Disease Control and Prevention (CDC) adopted criteria for interpreting the results of the western blot for LD and most commercialized tests follow these guidelines [23].
The objective of this systematic review is to summarize the North American evidence on the accuracy of diagnostic tests and test regimes used to diagnose LD in patients presenting with clinical symptoms in North America at various stages of disease and to address the question of whether there is evidence of superior, equivalent or poor performance by the commercial (approved by the FDA and/or HC) and in house laboratory tests captured in this review. To the best of our knowledge this systematic review is a significant update to Dumler (2001) [24] and is complementary to a recent systematic review on European Lyme disease diagnostic tests [25].
Methods
Scoping review
This systematic review was preceded by a scoping review conducted by Greig et al (2016) to identify, classify and characterise what is the current state of scientific knowledge on surveillance methods, prevention and control strategies, diagnostic tests, risk factors, and societal attitudes and perceptions towards LD in humans and B. burgdorferi in tick vectors and vertebrate reservoirs [26]. Briefly, the scoping review methodology was designed to characterise the primary literature on LD in humans or B. burgdorferi tick vectors or reservoirs, thus studies not on LD or B. burgdorferi were excluded from the scoping review. Additionally, the primary research had to address one of the following topics: surveillance/monitoring, prevalence, incidence, societal attitudes and perceptions in North America and global prevention and control strategies, diagnosis and risk factors. Research on clinical LD and treatment were considered outside the scope of this review. Each relevant paper was classified by purpose, study design, location of the study, B. burgdorferi, host species investigated, vector species investigated, sampling dates, diagnostic tests used, and whether the paper contained extractable data.
The scoping review search strategy was developed and pretested by three individuals with extensive experience in knowledge synthesis, zoonotic diseases and library science. The following search algorithm was implemented in eight bibliographic databases: BIOSIS (via web of knowledge), CAB abstracts, Scopus, PubMed, PsycINFO, APA PsycNet, Sociological Abstracts, and EconLit with no limitation on the search, this was followed by a comprehensive search for grey literature [26]: (lyme OR borrelia) AND ("host" OR sentinel OR landscaping OR "vector" OR "vectors" OR "monitor" OR "monitoring" OR surveillance OR reservoir OR reservoirs OR prevalence OR educate OR education OR barrier OR barriers OR intervene OR intervention OR incidence OR rate OR prevent OR prevention OR control OR risk OR risks OR attitude OR attitudes OR perception OR perceptions OR diagnostic). The search was conducted September 13th-14th, 2013 and no update of the search has been performed as analysis indicated the findings would not change with the addition of new papers, thus the resources required to conduct the update were not prioritized. The protocol for the scoping review is available upon request.
Systematic review methods
Studies identified in the scoping review that evaluated diagnostic tests for humans were fully evaluated in this systematic review. The systematic review tools include a confirmation of relevance, location of study, availability of extractable data and a quality assessment form based on the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool [27–29]. This tool assesses the risk of bias and other methodological quality domains to evaluate the extent to which the results of each study or group of studies could be biased. The QUADAS-2 tool assessed the four quality domains (Table 1) with respect to patient selection, the diagnostic tests used, the reference standard and flow and timing of the study [28]. An additional section was added to evaluate comparison tests and capture the presence of funding bias [30,31].
The data extraction form captured all pertinent study details and results. The systematic review was managed in DistillerSR (Evidence Partners, Ottawa, ON, Canada) a web-based systematic review management software. Each form was completed by two reviewers working independently and conflicts were resolved by consensus. Data were exported to Microsoft Excel 2010 (Microsoft Corp., USA), prepared for summarization and analysed in STATA v. 13 (StataCorp., USA). The study protocol and PRISMA evaluation can be found in the supplementary material (S1 Text, S3 Text).
Included papers examined the accuracy of diagnostic tests for LD in North America after 1995, and included studies that compared results of one test using a validated test panel, results of clinical diagnosis, or a gold standard test result or investigated inter-test agreement. The recommendations for two-tier testing occurred in 1995, so we limited the review to studies conducted after 1994. Studies that screened an asymptomatic population for LD were excluded from this study. No inclusion or exclusion criteria were implemented on the type of control group; instead it was evaluated as a source of variation between study results (heterogeneity). The control group was usually a mix of one or more categories of healthy volunteers from non-LD endemic or LD endemic regions, or asymptomatic blood donors. In some studies, patients with diseases that have similar signs and symptoms to LD or have humoral responses that overlap with LD and are known to cross-react (e.g. rheumatoid arthritis, systemic lupus erythematosus, syphilis, autoimmune disorders, leptospirosis, periodontitis, relapsing fever, tularemia, Southern Tick-associated Rash Illness (STARI), multiple sclerosis, and Epstein-Barr virus infection) were included as controls to more precisely define test specificity. Studies often used well-defined samples from serum repositories or panels, like those developed by CDC [32], a research institute [33,34] or a commercial company [35]. These results were included in this systematic review and the impact of patient-based or panel samples on the outcome was investigated.
For this review the stages of LD are as follows: Early / acute LD (stage 1) is defined as those patients presenting with EM and/or associated manifestations that have experienced signs and symptoms of LD for less than 30 days [7]. Stage 2 illness is early disseminated LD, which includes manifestations of early neurological LD, cardiac LD and multiple EMs [36]. Stage 3 is late LD, typically with manifestations of Lyme arthritis and late neurological LD [36]. Those patients tested after antibiotic therapy are described as convalescent with the stage of LD assigned prior to treatment. Post treatment Lyme syndrome is defined as a condition where despite treatment the patient continues to experience illness [37]. “Chronic LD” is a condition that is not recognised as being caused by B. burgdorferi by most infectious disease experts, occurs in patients exhibiting non-specific illness who do not test positive on Food and Drug Administration (FDA) approved serological tests, so these have been excluded from this review [38].
Meta-Analytic Methods
The dataset was managed in MS excel; each line of data represents a single test accuracy outcome and one study may have several comparisons, thus several lines of data. Each comparison was extracted, grouped and coded according to tests and type of outcome reported. When there were four or more lines of data for a category, meta-analysis was conducted using hierarchical logistic regression and bivariate models in Stata 13 using Metandi and Midas command packages. These models have been designed to account for the correlation between sensitivity and specificity [39] and they overcome the often violated assumptions of a linear regression model [40,41]. These hierarchical models use 2x2 cell counts to compute log transformations of proportions for the analysis [39]. Without covariates, the hierarchical summary receiver operating characteristic (HSROC) and bivariate models are equivalent although their assumptions are different: HSROC assumes there is an underlying Receiver-Operating Characteristic (ROC) for each study and the bivariate model directly models the log-odds transformed sensitivity and specificity assuming a bivariate normal distribution between studies [42].
Meta-analytic statistical summaries of sensitivity, specificity, likelihood ratios and diagnostic odds ratio have been summarized where possible in the tables. Model diagnostics including goodness of fit, normality, influential and outlying points, publication bias and heterogeneity were examined where possible. Publication bias was not evaluated when heterogeneity was >60% or there were less than 10 lines of data. Meta-regression using the bivariate model was used to examine whether predetermined covariates explain some of the between-study variation given there was sufficient data to fit the model (>10 data lines per covariate).
Results
In the scoping review, 485 articles focused on diagnosis of LD in humans globally and were further evaluated for inclusion in this systematic-review meta-analysis. The decision tree for selection of articles and reasons for exclusion of potentially relevant studies in this systematic review is shown in Fig 1. Forty-eight relevant diagnostic test evaluations conducted in North America between 1995 and 2013 were included in this systematic review (see S2 Text and S1 Dataset).
The QUADAS-2 tool results, Table 1, indicated that there was an unclear risk of bias in 84% of studies, meaning the study received an unclear or high risk of bias score on one or more domains (see S1 Dataset). No studies were excluded from the analysis based on their QUADAS assessment. In two studies it was apparent that the sample population was not appropriately enrolled in the study as the case population and control population were enrolled at different times and places, which could lead to biased (exaggerated) results for test accuracy [43,44]. Appropriate blinding was often not addressed in many papers and unexplained exclusion of observations from the analysis was another common reporting issue. Many of the studies (28.6%) had authors employed by or funded by commercial companies that supplied one or more of the tests evaluated. In four of these studies the risk of funding bias was identified to be very high [43,45–47].
The diagnostic accuracy of tests compared to clinical diagnosis
Two-tier serological test vs. clinical diagnosis.
Thirteen studies evaluated the two-tier serological test protocol for diagnosis of LD at different stages of disease and after antibiotic therapy. Table 2 provides the meta-analytic summaries demonstrating low sensitivity, 46.3% (95%CI 39.1–53.7), for early (stage 1) LD patients and increasing sensitivity with stage 2, 89.7% (78.3–95.4), and stage 3, 99.4%H (95.7–99.9) LD. There was relatively high specificity (98.3%–99.9%) across control groups. Most false positives within the control groups were patients with diseases known to produce antibodies that cross-react in serological tests for B. burgdorferi. Nine studies (14 lines of data) presented results for two-tier serological testing where at least one of the tests was not FDA licensed (designed in house by the reporting laboratory), Table 2. Heterogeneity analysis of sensitivity and specificity on the impact of using non-commercial tests was not significant. At the early stage of LD the two-tier testing method was good for ruling in LD if the patient tested positive, but had very poor predictive value for ruling out LD, which is why it is recommended to retest after 30 days [21]. However, for convalescent patients treated at stage 1 LD sensitivity remained low even after 30 days.
EIA vs. clinical diagnosis.
First tier serological tests including enzyme-linked immunosorbent assays (ELISA) and other serological assays were evaluated in 23 studies (119 lines of data) with well-defined and whole cell targets, Table 3. There were a mix of FDA-licensed tests and in house tests. Similar to the two-tiered tests, test performance for patients with stage 1 LD was highly variable and had poor sensitivity. In later stages of LD, the sensitivity improved. The overall specificity varied by test and between studies more than was reported for the two-tier tests.
ELISA performance on early stage 1 LD was investigated in 53 lines of data (16 studies), Table 3. These were further grouped by type of ELISA to understand where variation between studies was occurring. ELISAs targeting C6 included 4 lines (3 studies) on the Immunetics® C6 B. burgdorferi ELISA™ kit and seven lines (four studies) on unlicensed C6 ELISAs (Table 3). Accounting for whether the C6 ELISA was licensed explained 27% of the heterogeneity between studies and indicated the commercial ELISAs had an insignificant higher sensitivity 91(81–100) vs. 64(47–80) and similar specificity 97(94–100) vs. 97(95–99) over all stages of LD.
Whole cell sonicate (WCS) ELISAs for early LD included 10 lines from 6 studies Table 3. Three commercial test kits were included; Lyme Stat Test Kit, VIDAS Lyme Screen II and Wampole Bb ELISA test system (see S2 Text) across six lines and three studies. These performed differently than the four in house WCS ELISAs and the authors did not offer an explanation for the divergent results.
Recombinant proteins and/or chimeric proteins from Osp A-F (mainly A and C) targets were used to develop assays and tested on early LD patients. All studies were based on in house ELISAs with small sample sizes and the reported sensitivities varied from target to target ranging from 0–86%. Other assays included the use of Poly-ethylene Glycol (PEG)-peptide conjugates in an ELISA that reported 100% sensitivity and specificity on a small sample [49]. An indirect hemagglutination antibody (IHA) test using B. burgdorferi strains B31 and B126 had a low sensitivity 46–48% and a specificity of 98–99% which is comparable to other tests for early LD [50].
For assays used in cases of late LD, the sensitivity and specificity were higher and more consistent compared early LD results. A meta-regression controlling for test in the late LD category showed the Immunetics® C6 B. burgdorferi ELISA™ significantly out-performed (sensitivity and specificity p≤0.001) in house C6 ELISAs, the commercial WCS ELISAs (VIDAS Lyme Screen II and Wampole Bb (IgG/IgM) ELISA test system) and the in house ELISAs using various recombinant/ chimeric Osp targets, Table 3.
Not included in the meta-analyses in Table 3 was an evaluation of the reactivity of individuals previously vaccinated with the Osp A vaccine (removed from use in 2002); the results showed a 95% false positive rate with a WCS ELISA and a 5% false positive rate with a recombinant Osp A ELISA [51].
Immunoblots vs. clinical diagnosis.
Across nine studies several commercial western blots were evaluated against clinical diagnosis of a range of LD. These included the Marblot test strip system by MarDx®, the Boston Biomedica Inc.(BBI) B. burgdorferi western blot test kit®, Immuno Dot Borrelia Dot Blot Test® and Viramed Biotech B. burgdorferi B31 Virablot®. Only one in house immunoblot was evaluated investigating the diagnostic sensitivity of a few recombinant targets.
The MarDx ® Lyme Disease Marblot Strip test system was evaluated in four studies (7 lines of data) on select LD groups and across early to late LD groups [52–55]. A meta-regression controlling for group indicated that the test performed significantly better on late LD patients, but whether the investigator evaluated results for IgM, IgG or both in parallel did not significantly affect the sensitivity or specificity.
The BBI western blot was evaluated in two separate studies using the same CDC test panel, but slightly different classification criteria; one used the BBI criteria (IgG required 3+ bands of 20,23,31,34,35,39 and 83 kDa and IgM 2+ bands 23,39,41, and 83 kDa) which has a different formulation for positive samples compared to the CDC criteria (IgG required 5+ bands 18, 23, 28, 30, 39, 41, 45, 58, 66, and 83 to 93 kDa and IgM 2+ bands 23, 39, and 41kDa) [35,46]. The results of the two criteria differed in sensitivity, which was 77% and 93% using CDC criteria respectively for IgM and IgG blots, compared to 93% and 100% using the BBI criteria for IgM and IgG, however the difference was not significant and specificity ranged from 77–99% with a gain in sensitivity resulting in slight losses to specificity, Table 4.
The Immunodot Borrelia Dot Blot IgG/IgM test by General Biometric Inc. was examined in one study; the results are shown in Table 4. An insignificant increasing trend in sensitivity with disease progression was noted (stage 1 50% (95%CI 19, 87), stage 2 70% (35, 93) and stage 3 100% (63, 100) [52]. Viramed Biotech Borrellia burgdorferi B31 IgG/IgM Virablot demonstrated a comparable sensitivity and specificity in one small study to the other immunoblots evaluated [35]. One in house recombinant immunoblot (data not shown) did not perform well in the published study with sensitivities ranging from 7 to 60 percent for different targets [56].
Tests for direct detection of Borrelia burgdorferi by bacterial isolation or PCR vs. clinical diagnosis.
There are six studies, (13 lines of data) that examined bacterial isolation by culture and PCR detection of B. burgdorferi in a variety of human samples from cases of early and disseminated LD [57–62]. Meta-analysis was not possible within this group of studies because there were not enough lines of data within each detection method. The most commonly used medium is Barbour-Stoener-Kelly (BSK) medium, which has been modified by some authors to improve its sensitivity [63]. Three studies attempted to isolate B. burgdorferi from blood (serum/plasma) of patients with early LD (stage 1) and the sensitivity of this approach was 27%, 71% and 94% [57–59]. With respect to the latter sensitivity, it has been suggested that laboratory contamination may account for the very high sensitivity reported [64]. Two studies reported sensitivities of 62–81% from biopsy samples of EM during early LD [59,60], although both sample sizes were very small. Phillips et al. evaluated an “MPM” medium for detection of B. burgdorferi in the blood of LD patients that had been previously treated, but then relapsed [65]. They reported a sensitivity of 91.5% in these patients, however two studies were unable to reproduce these results and both demonstrated that the BSK-H culture was superior [66,67].
Three studies (eight lines of data) were captured with information on the use of PCR to identify B. burgdorferi in early LD [59,61,62]. Samples included blood and tissue biopsies and each PCR targeted different primers. Eshoo et al (2012) used blood samples and multi-loci PCR targeting eight different loci to both detect and genotype B. burgdorferi, the sensitivity was 62% (40–79) and the specificity was 100% [61]. Liveris et al (2012) used a nested PCR on serum samples and biopsy samples with a sensitivity of 40.6 and 42.6% respectively [59]. They also implemented a qPCR on plasma samples demonstrating a sensitivity of 33.8%. Two nested PCR primer sets targeting the Osp A gene were investigated in neurological LD, both acute and late cases using cerebral spinal fluid samples; they reported a sensitivity of 37.5–50% in acute cases and 12.5–25% in late cases [62]. Across the direct detection studies sensitivity was low and in most cases lower than the two-tier test regime, assays or immunoblots reported for early LD.
Inter-test comparisons.
The results of inter-test comparisons are summarised in Tables 5–7. Note that in these tables we have positive agreement and negative agreement that indicate how well the two tests agreed to classify samples as positive or negative respectively. Thus, positive agreement is the probability that test 2 is positive if test 1 is positive and negative agreement is the probability that test 2 is negative if test 1 is negative. Table 5 has comparisons between the two-tier serological tests compared to other tests and Table 6 includes studies that examined various assays and immunoblots for agreement.
Table 7 contains studies that looked at various samples and culture sensitivity in early LD as well as the use of various PCRs to identify B. burgdorferi infection. In one study there was agreement between culture of serum vs. plasma, however whole blood classified more samples positive compared to serum resulting in little agreement [58,68]. The confirmation of B. burgdorferi presence in culture using qPCR both increased the sensitivity and shortened the length of culture time before a positive result could be obtained [69]. A study examining the sensitivity of direct qPCR targeting flaB or recA genes compared to culture of 2mm EM biopsy samples showed little agreement and qPCR targeting the recA gene was more sensitive compared to the fla B target [70].
Diagnostic Test Performance in Early Lyme disease
Testing for LD in patients exhibiting signs and symptoms of LD for less than 30 days is challenging as the performance of available test protocols is not optimal for making clinical decisions. This is largely due to the time required for the infected individual’s immune system to mount a reaction. This is why researchers have explored the use of a variety of targets including VlsE and C6 expressed after infection, Osp C and Fla B expressed by the feeding tick to detect infection sooner [71,72]. However, cross-reactivity and genetic variability within the targets has limited the diagnostic performance of any single target [73,74]. Thus the results of expected sensitivities and specificities in Table 8 emphasize the importance of physician evaluation and informed judgement when deciding to treat rather than rely entirely on imperfect serological test protocols. Notable findings in the table include the higher specificity associated with the two-tier testing method and the poor and highly variable sensitivity of serological tests in the initial stages of disease when an individual is mounting an immune response to B. burgdorferi.
Discussion
The 48 studies included in this analysis were all conducted in the United States from 1995 onwards. The samples included patients or historical samples where the clinical presentation fit the diagnosis of LD. Within the results we summarized results for all stages of LD, separate stages 1–3 LD and convalescent stages 1–3 LD to facilitate an evaluation of trends, similarities and differences by test, stage of disease and treatment status. There were a few studies that differentiated acute samples <7 days and early Lyme samples 7–30 days, but not enough to analyse predictive values within early LD. Similarly there were studies that used culture positive patients exclusively, however the culture status of the patients did not significantly account for the heterogeneity. Stage 1, 2, and 3 convalescent LD groups were sampled in a number of studies and are summarized separately from samples drawn pre-treatment as it is known that there are differences in the immune response depending on the length of LD prior to treatment [5,6].
In the United States it was recently estimated that less than 12% of Lyme disease tests were for true infections [75]. The LD test results for patients who do not meet the clinical criteria can be used to rule out LD, but a positive test is likely to be a false positive. Thus, the over use of these assays to diagnose LD has been an on-going discussion and challenge for topic-specialists and physicians [76]. The literature summarised in this systematic review was based on research conducted from 1995 when the CDC adopted the recommendations for two-tier testing of LD acquired in North America. Their goal was to improve the specificity of LD testing by recommending the use of a sensitive EIA followed by a more specific western blot for positive and equivocal samples [23]. Most of the research on diagnostic tests in North America were based on serology, mainly antibody based assays detecting an immune response against B. burgdorferi. As of May 2015 there were 42 tests approved by the FDA for use in the United States and 22 approved by Health Canada Medical Devices Branch for use in Canada, however only a few of these tests were evaluated in the primary literature and all the literature published since 1995 was conducted in the United States (see S2 Text).
Recent studies examining inter-laboratory agreement and the sensitivity and specificity of various test protocols noted that the C6 ELISA alone and the two-tier approach has superior specificity compared to proposed replacements and the CDC-recommended western blot algorithm has equivalent or superior specificity over other proposed test algorithms [77]. The findings of this review are in agreement with other authors that sensitivity was highest for ELISAs targeting C6 and these showed less variability in test sensitivity compared to other tests and test protocols [77]. The C6 ELISAs, particularly the commercial assays, had promising sensitivity, specificity and agreement of results with two-tier protocols, which is likely why the Immunetics® C6 B. burgdorferi ELISA™ has become widely used in place of some WCS assays. Although we did not summarize results of inter-laboratory agreement studies in this systematic review, the requirement for technical expertise and subjectivity in result interpretation for many LD tests, particularly western blots, contributes to poor agreement between technicians, tests and/or laboratories [77].
Factors that affect the sensitivity and interpretation of the results include type of sample and stage of disease in addition to possible variations in the type, target and conduct of the diagnostic tests. In this systematic review all relevant studies examining the efficacy of serological tests used serum samples from patients. There were no studies that employed the use of synovial fluid or cerebrospinal fluid for diagnosis of LD with serological assays. However in the last few years a number of studies have emerged from Europe on assays designed for cerebrospinal fluid samples in the diagnosis of neuroborreliosis which is a more common clinical presentation in Europe [78–80].
Throughout our results there was a positive association between duration of infection/ stage of disease and sensitivity of serological LD tests [34,47,60]. Thus, recommendations include re-testing after 30 days if the initial serological test was done during the early (non-disseminated) stages of infection and employing IgM assays as well as IgG assays to detect early immune reactions [21,81]. Other sources of heterogeneity between studies may include whether the case sampling frame included only samples from culture positive LD patients. Similarly, the impact of type of sample, prospective vs. retrospective patients and sample libraries or serum panels for test performance was investigated wherever possible in the analysis. The control group samples in the captured studies ranged from groups of healthy individuals from endemic and non-endemic areas to controls with diseases known to cross-react with LD diagnostic assays. Despite this, most studies reported a consistently high specificity for LD regardless of the composition of the control group and where there were differences (Tables 2–4), these were not statistically significant in most cases.
There was a wide range of assays identified in this systematic review including those assays that employed whole-cell sonicates mainly from B. burgdorferi B31 or other North American isolates to recombinant proteins targeting antigens that are highly expressed in vivo e.g. VlsE. Some of the captured research indicates that the VlsE targets improve test performance [45,82]. Similarly the C6 peptide which is derived from the VlsE lipoprotein has shown equivalent or better sensitivity compared to the WCS ELISAs in this systematic review, improved specificity for patients with often cross-reactive diseases and may also be used to identify some species of Borrelia acquired in Europe [47,73,74,82–84]. Subjectivity and inconsistency of the criteria used to evaluate western blot results has been noted as a source of confusion for patients and physicians in the interpretation of diagnostic results [85,86]. In studies where the CDC western blot interpretation was paired with different criteria, some showed gains in sensitivity with alternate criteria, but this was usually accompanied by a reduced specificity below an acceptable level [46].
Direct detection of B. burgdorferi from LD patient samples continues to be a challenge. B. burgdorferi requires culture in a complex medium for 8 to 12 weeks before the culture is considered negative, which makes this approach unsuitable in a clinical setting. Recent studies have attempted to improve the utility of culture by changing the protocol, for example, use of a 60 ml of BSK in a closed tube, incubated at 32–33°C for 8–12 weeks [58,59]. Another study used 15 ml and 2 ml starter cultures, then at day six seeded a long term culture in a caliper jar with 15 ml of fresh BSK for up to 16 weeks at 34°C [57]. Variations that had positive effects on culture growth included adding serum, a reducing agent and rifampicin [57–59]. The use of PCR to confirm bacterial isolation improves the sensitivity compared to visual confirmation by staining with acridine-orange and using dark-field microscopy or fluorescent microscopy [69]. The specimen, stage of LD and the laboratory technician’s experience has an effect on the likelihood of obtaining a successful B. burgdorferi culture. In early LD a biopsy sample from an EM lesion taken within the first week of symptoms has the highest sensitivity, whereas early disseminated infections have a higher sensitivity if isolation is attempted on large volume plasma samples [59,69].
Bacterial isolation has had limited success with late manifestations of LD and with cerebrospinal fluid and synovial fluid samples [87,88]. Research continues to focus on improving the sensitivity and speed of culture. Recent papers claiming major breakthroughs for B. burgdorferi isolation have failed validation [57] or could not be replicated [65] by others [64,67]. PCR for detection of B. burgdorferi DNA in LD patient samples is affected by many of the same limitations as culture with the exception that results may be obtained faster and PCR may be more sensitive in samples with a low concentration of B. burgdorferi. The variability of methodologies, gene targets and primers from study to study continue to impact the interpretation of the PCR results [59,61,62]. Overall, the sensitivities of PCR studies conducted in North America were lower than those that employed a two-tiered serology diagnostic protocol [59,61,62]. Due to the above limitations, bacterial isolation and PCR are not routinely used as diagnostic tools in clinical practise, although bacterial isolation is considered the gold standard to confirm diagnosis.
From the peer-reviewed literature we identified validation data from only a small proportion of licensed assays and for a number of “in house” tests which are used by several laboratories across North America. The performance of “in house” tests cannot be validated or critiqued as the composition of the test is not always publically available or evaluated in the peer-reviewed literature, thus comparing their performance to licensed tests is less informative. In studies looking at the variable performance of diagnostic testing schemes across laboratories it has been demonstrated that deviations from recommended diagnostic schemes often lead to a decrease in specificity and discordant results with approved testing schemes [89]. Thus, the performance of these “in house” assays and some of the older commercial assays have not been evaluated against well characterised panels of serum from patients with the full spectrum of LD clinical symptoms, with appropriate numbers of healthy controls and patients with look-alike diseases [32].
Future work on diagnostic tests for LD includes continued improvement in the sensitivity of all tests, particularly for early LD samples and the ability to distinguish between active infection and previous infections. On-going work into new immunoassay techniques and combinations of antigen targets that may help inform disease stage will hopefully improve LD diagnostics in the future [60,79,90]. Development of point-of care tests that do not require highly specialized technical skills and subjective interpretation of the results would help address some of the criticisms of immunoblot techniques. This systematic review summarizes research in North America on the accuracy of diagnostic tests for LD conducted since 1995. The performance of the commercially available Immunetics® C6 B. burgdorferi ELISA™ shows the most promise as a possible standalone test or as part of a two-tiered test protocol; however it did not overcome the low sensitivity of LD diagnostic tests in patients with early LD. Addressing this shortcoming is a significant challenge to improving LD diagnostics.
Supporting Information
S1 Text. Protocol for Evaluation of the sensitivity and specificity of diagnostic test regimes for diagnosis of Lyme disease in humans, a systematic review and meta-analysis of the evidence.
https://doi.org/10.1371/journal.pone.0168613.s002
(PDF)
S2 Text. 48 Studies Included in the SR and List of licensed tests for Lyme disease as of May 2015.
https://doi.org/10.1371/journal.pone.0168613.s003
(PDF)
Author Contributions
- Conceptualization: LW JG MM SH RL NO.
- Data curation: LW.
- Formal analysis: LW.
- Investigation: LW JG SH MM.
- Methodology: LW JG SH MM.
- Project administration: LW JG.
- Resources: LW JG MM SH RL NO.
- Software: LW.
- Supervision: JG NO.
- Validation: LW JG MM SH RL NO.
- Visualization: LW.
- Writing – original draft: LW.
- Writing – review & editing: JG MM SH RL NO.
References
- 1. Nelson CA, Saha S, Kugeler KJ, Delorey MJ, Shankar MB, Hinckley AF, et al. Incidence of Clinician-Diagnosed Lyme Disease, United States, 2005–2010. Emerg Infect Dis. 2015;21: 1625–1631. pmid:26291194
- 2. Ogden NH, Lindsay LR, Morshed M, Sockett PN, Artsob H. The emergence of Lyme disease in Canada. CMAJ. 2009;180: 1221–1224. pmid:19506281
- 3. Steere AC, Malawista SE, Snydman DR, Shope RE, Andiman WA, Ross MR, et al. Lyme arthritis: an epidemic of oligoarticular arthritis in children and adults in three connecticut communities. Arthritis Rheum. 1977;20: 7–17. pmid:836338
- 4. Scrimenti RJ. Erythema chronicum migrans. Arch Dermatol. 1970;102: 104–105. pmid:5497158
- 5. Onyett H, Canadian Paediatric Society, Infectious Diseases and Immunization Committee. Lyme disease in Canada: Focus on children. Paediatr Child Health. 2014;19: 379–388. pmid:25332678
- 6. Stanek G, Wormser GP, Gray J, Strle F. Lyme borreliosis. Lancet. 2012;379: 461–473. pmid:21903253
- 7.
Centers for Disease Control and Prevention (CDC). Signs and Symptoms of Untreated Lyme Disease. 2015. Available: http://www.cdc.gov/lyme/signs_symptoms/
- 8. Pritt BS, Mead PS, Johnson DK, Neitzel DF, Respicio-Kingry LB, Davis JP, et al. Identification of a novel pathogenic Borrelia species causing Lyme borreliosis with unusually high spirochaetaemia: a descriptive study. Lancet Infect Dis. 2016.
- 9. Nelder MP, Russell C, Lindsay LR, Dhar B, Patel SN, Johnson S, et al. Population-based passive tick surveillance and detection of expanding foci of blacklegged ticks Ixodes scapularis and the Lyme disease agent Borrelia burgdorferi in Ontario, Canada. PLoS One. 2014;9: e105358. pmid:25171252
- 10. Stone BL, Russart NM, Gaultney RA, Floden AM, Vaughan JA, Brissette CA. The Western progression of lyme disease: infectious and Nonclonal Borrelia burgdorferi Sensu Lato populations in Grand Forks County, North Dakota. Appl Environ Microbiol. 2015;81: 48–58. pmid:25304515
- 11. Stanek G, Fingerle V, Hunfeld KP, Jaulhac B, Kaiser R, Krause A, et al. Lyme borreliosis: clinical case definitions for diagnosis and management in Europe. Clin Microbiol Infect. 2011;17: 69–79. pmid:20132258
- 12. Eisen RJ, Piesman J, Zielinski-Gutierrez E, Eisen L. What do we need to know about disease ecology to prevent Lyme disease in the northeastern United States? J Med Entomol. 2012;49: 11–22. pmid:22308766
- 13. Hamer SA, Tsao JI, Walker ED, Hickling GJ. Invasion of the lyme disease vector Ixodes scapularis: implications for Borrelia burgdorferi endemicity. Ecohealth. 2010;7: 47–63. pmid:20229127
- 14. Koffi JK, Leighton PA, Pelcat Y, Trudel L, Lindsay LR, Milord F, et al. Passive surveillance for I. scapularis ticks: enhanced analysis for early detection of emerging Lyme disease risk. J Med Entomol. 2012;49: 400–409. pmid:22493860
- 15. Brownstein JS, Holford TR, Fish D. Effect of Climate Change on Lyme Disease Risk in North America. Ecohealth. 2005;2: 38–46. pmid:19008966
- 16. Ogden NH, Maarouf A, Barker IK, Bigras-Poulin M, Lindsay LR, Morshed MG, et al. Climate change and the potential for range expansion of the Lyme disease vector Ixodes scapularis in Canada. Int J Parasitol. 2006;36: 63–70. pmid:16229849
- 17. Lindsay LR, Bernat K, Dibernardo A. Laboratory diagnostics for Lyme disease. CCDR. 2014;40.
- 18. Nelson C, Hojvat S, Johnson B, Petersen J, Schriefer M, Beard CB, et al. Concerns regarding a new culture method for Borrelia burgdorferi not approved for the diagnosis of Lyme disease. MMWR Morb Mortal Wkly Rep. 2014;63: 333. pmid:24739342
- 19.
Health Canada Medical Devices Branch. MDALL—Your reference tool for licensed medical devices in Canada. 2015. Available: http://webprod5.hc-sc.gc.ca/mdll-limh/index-eng.jsp
- 20.
US Food and Drug Administration. Devices@FDA. 2015. Available: http://www.accessdata.fda.gov/scripts/cdrh/devicesatfda/index.cfm
- 21.
Centers for Disease Control and Prevention (CDC). Lyme Disease- Two-step Laboratory Testing Process. 2015. Available: http://www.cdc.gov/lyme/diagnosistesting/labtest/twostep/index.html
- 22. Marques AR. Laboratory diagnosis of Lyme disease: advances and challenges. Infect Dis Clin North Am. 2015;29: 295–307. pmid:25999225
- 23. Centers for Disease Control and Prevention (CDC). Recommendations for test performance and interpretation from the Second National Conference on Serologic Diagnosis of Lyme Disease. MMWR Morb Mortal Wkly Rep. 1995;44: 590–591. pmid:7623762
- 24. Dumler JS. Molecular diagnosis of Lyme disease: review and meta-analysis. Mol Diagn. 2001;6: 1–11. pmid:11257206
- 25. Leeflang MM, Ang CW, Berkhout J, Bijlmer HA, Van Bortel W, Brandenburg AH, et al. The diagnostic accuracy of serological tests for Lyme borreliosis in Europe: a systematic review and meta-analysis. BMC Infect Dis. 2016;16: 140-016-1468-4.
- 26.
Greig J, Young I, Harding S, Mascarenhas M, Waddell LA, Michel P. A Scoping Review of Research on Lyme Disease Published up to September 2013. Public Health Agency of Canada. Available upon request.
- 27. Whiting PF, Rutjes AW, Westwood ME, Mallett S, QUADAS-2 Steering Group. A systematic review classifies sources of bias and variation in diagnostic test accuracy studies. J Clin Epidemiol. 2013;66: 1093–1104. pmid:23958378
- 28. Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155: 529–536. pmid:22007046
- 29. Whiting P, Harbord R, de Salis I, Egger M, Sterne J. Evidence-based diagnosis. J Health Serv Res Policy. 2008;13 Suppl 3: 57–63.
- 30.
Viswanathan M, Ansari MT, Berkman ND, Chang S, Hartling L, McPheeters M, et al. Assessing the Risk of Bias of Individual Studies in Systematic Reviews of Health Care Interventions. In: Anonymous Methods Guide for Effectiveness and Comparative Effectiveness Reviews. Rockville (MD); 2008.
- 31. Berkman ND, Lohr KN, Ansari MT, Balk EM, Kane R, McDonagh M, et al. Grading the strength of a body of evidence when assessing health care interventions: an EPC update. J Clin Epidemiol. 2015;68: 1312–1324. pmid:25721570
- 32. Molins CR, Sexton C, Young JW, Ashton LV, Pappert R, Beard CB, et al. Collection and characterization of samples for establishment of a serum repository for lyme disease diagnostic test development and evaluation. J Clin Microbiol. 2014;52: 3755–3762. pmid:25122862
- 33. Yu Z, Carter JM, Sigal LH, Stein S. Multi-well ELISA based on independent peptide antigens for antibody capture. Application to Lyme disease serodiagnosis. J Immunol Methods. 1996;198: 25–33. pmid:8914594
- 34. Liang FT, Steere AC, Marques AR, Johnson BJ, Miller JN, Philipp MT. Sensitive and specific serodiagnosis of Lyme disease by enzyme-linked immunosorbent assay with a peptide based on an immunodominant conserved region of Borrelia burgdorferi vlsE. J Clin Microbiol. 1999;37: 3990–3996. pmid:10565920
- 35. Mogilyansky E, Loa CC, Adelson ME, Mordechai E, Tilton RC. Comparison of Western immunoblotting and the C6 Lyme antibody test for laboratory detection of Lyme disease. Clin Diagn Lab Immunol. 2004;11: 924–929. pmid:15358654
- 36.
Vyas J. Lyme disease. 2014. Available: https://www.nlm.nih.gov/medlineplus/ency/article/001319.htm
- 37.
Centers for Disease Control and Prevention (CDC). Post-Treatment Lyme Disease Syndrome. 2015. Available: http://www.cdc.gov/lyme/postlds/
- 38. Feder HM Jr, Johnson BJ, O'Connell S, Shapiro ED, Steere AC, Wormser GP, et al. A critical appraisal of "chronic Lyme disease". N Engl J Med. 2007;357: 1422–1430. pmid:17914043
- 39. Harbord RM, Whiting PF. metandi: Meta-analysis of diagnostic accuracy using hierarchical logistic regression. SJ. 2009;9: 211–229.
- 40. Rutter CM, Gatsonis CA. A hierarchical regression approach to meta-analysis of diagnostic test accuracy evaluations. Stat Med. 2001;20: 2865–2884. pmid:11568945
- 41. Reitsma JB, Glas AS, Rutjes AW, Scholten RJ, Bossuyt PM, Zwinderman AH. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol. 2005;58: 982–990. pmid:16168343
- 42. Takwoingi Y, Guo B, Riley RD, Deeks JJ. Performance of methods for meta-analysis of diagnostic test accuracy with few studies or sparse data. Stat Methods Med Res. 2015.
- 43. Porwancher RB, Hagerty CG, Fan J, Landsberg L, Johnson BJ, Kopnitsky M, et al. Multiplex immunoassay for Lyme disease using VlsE1-IgG and pepC10-IgM antibodies: improving test performance through bioinformatics. Clin Vaccine Immunol. 2011;18: 851–859. pmid:21367982
- 44. Magnarelli LA, Fikrig E, Padula SJ, Anderson JF, Flavell RA. Use of recombinant antigens of Borrelia burgdorferi in serologic tests for diagnosis of lyme borreliosis. J Clin Microbiol. 1996;34: 237–240. pmid:8788993
- 45. Branda JA, Aguero-Rosenfeld ME, Ferraro MJ, Johnson BJ, Wormser GP, Steere AC. 2-tiered antibody testing for early and late Lyme disease using only an immunoglobulin G blot with the addition of a VlsE band as the second-tier test. Clin Infect Dis. 2010;50: 20–26. pmid:19947857
- 46. Tilton RC, Sand MN, Manak M. The western immunoblot for Lyme disease: determination of sensitivity, specificity, and interpretive criteria with use of commercially available performance panels. Clin Infect Dis. 1997;25 Suppl 1: S31–4.
- 47. Wormser GP, Schriefer M, Aguero-Rosenfeld ME, Levin A, Steere AC, Nadelman RB, et al. Single-tier testing with the C6 peptide ELISA kit compared with two-tier testing for Lyme disease. Diagn Microbiol Infect Dis. 2013;75: 9–15. pmid:23062467
- 48. Zwinderman AH, Bossuyt PM. We should not pool diagnostic likelihood ratios in systematic reviews. Stat Med. 2008;27: 687–697. pmid:17611957
- 49. Qiu B, Brunner M, Zhang G, Sigal L, Stein S. Selection of continuous epitope sequences and their incorporation into poly(ethylene glycol)-peptide conjugates for use in serodiagnostic immunoassays: application to Lyme disease. Biopolymers. 2000;55: 319–333. pmid:11169923
- 50. Pavia CS, Wormser GP, Bittker S, Cooper D. An indirect hemagglutination antibody test to detect antibodies to Borrelia burgdorferi in patients with Lyme disease. J Microbiol Methods. 2000;40: 163–173. pmid:10699672
- 51. Gomes-Solecki MJ, Wormser GP, Schriefer M, Neuman G, Hannafey L, Glass JD, et al. Recombinant assay for serodiagnosis of Lyme disease regardless of OspA vaccination status. J Clin Microbiol. 2002;40: 193–197. pmid:11773115
- 52. Fawcett PT, Rose CD, Gibney KM, Doughty RA. Comparison of immunodot and western blot assays for diagnosing Lyme borreliosis. Clin Diagn Lab Immunol. 1998;5: 503–506. pmid:9665957
- 53. Ledue TB, Collins MF, Young J, Schriefer ME. Evaluation of the recombinant VlsE-based liaison chemiluminescence immunoassay for detection of Borrelia burgdorferi and diagnosis of Lyme disease. Clin Vaccine Immunol. 2008;15: 1796–1804. pmid:18945880
- 54. Jobe DA, Lovrich SD, Asp KE, Mathiason MA, Albrecht SE, Schell RF, et al. Significantly improved accuracy of diagnosis of early Lyme disease by peptide enzyme-linked immunosorbent assay based on the borreliacidal antibody epitope of Borrelia burgdorferi OspC. Clin Vaccine Immunol. 2008;15: 981–985. pmid:18417666
- 55. Trevejo RT, Krause PJ, Sikand VK, Schriefer ME, Ryan R, Lepore T, et al. Evaluation of two-test serodiagnostic method for early Lyme disease in clinical practice. J Infect Dis. 1999;179: 931–938. pmid:10068589
- 56. Brissette CA, Rossmann E, Bowman A, Cooley AE, Riley SP, Hunfeld KP, et al. The borrelial fibronectin-binding protein RevA is an early antigen of human Lyme disease. Clin Vaccine Immunol. 2010;17: 274–280. pmid:20032216
- 57. Sapi E, Pabbati N, Datar A, Davies EM, Rattelle A, Kuo BA. Improved culture conditions for the growth and detection of Borrelia from human serum. Int J Med Sci. 2013;10: 362–376. pmid:23470960
- 58. Wormser GP, Nowakowski J, Nadelman RB, Bittker S, Cooper D, Pavia C. Improving the yield of blood cultures for patients with early Lyme disease. J Clin Microbiol. 1998;36: 296–298. pmid:9431972
- 59. Liveris D, Schwartz I, McKenna D, Nowakowski J, Nadelman R, Demarco J, et al. Comparison of five diagnostic modalities for direct detection of Borrelia burgdorferi in patients with early Lyme disease. Diagn Microbiol Infect Dis. 2012;73: 243–245. pmid:22571973
- 60. Gomes-Solecki MJ, Wormser GP, Persing DH, Berger BW, Glass JD, Yang X, et al. A first-tier rapid assay for the serodiagnosis of Borrelia burgdorferi infection. Arch Intern Med. 2001;161: 2015–2020. pmid:11525704
- 61. Eshoo MW, Crowder CC, Rebman AW, Rounds MA, Matthews HE, Picuri JM, et al. Direct molecular detection and genotyping of Borrelia burgdorferi from whole blood of patients with early Lyme disease. PLoS One. 2012;7: e36825. pmid:22590620
- 62. Nocton JJ, Bloom BJ, Rutledge BJ, Persing DH, Logigian EL, Schmid CH, et al. Detection of Borrelia burgdorferi DNA by polymerase chain reaction in cerebrospinal fluid in Lyme neuroborreliosis. J Infect Dis. 1996;174: 623–627. pmid:8769624
- 63. Wang G, Iyer R, Bittker S, Cooper D, Small J, Wormser GP, et al. Variations in Barbour-Stoenner-Kelly culture medium modulate infectivity and pathogenicity of Borrelia burgdorferi clinical isolates. Infect Immun. 2004;72: 6702–6706. pmid:15501807
- 64. Johnson BJ, Pilgard MA, Russell TM. Assessment of new culture method for detection of Borrelia species from serum of lyme disease patients. J Clin Microbiol. 2014;52: 721–724. pmid:23946519
- 65. Phillips SE, Mattman LH, Hulinska D, Moayad H. A proposal for the reliable culture of Borrelia burgdorferi from patients with chronic Lyme disease, even from those previously aggressively treated. Infection. 1998;26: 364–367. pmid:9861561
- 66. Tilton RC, Barden D, Sand M. Culture Borrelia burgdorferi. J Clin Microbiol. 2001;39: 2747. pmid:11446361
- 67. Marques AR, Stock F, Gill V. Evaluation of a new culture medium for Borrelia burgdorferi. J Clin Microbiol. 2000;38: 4239–4241. pmid:11060098
- 68. Wormser GP, Bittker S, Cooper D, Nowakowski J, Nadelman RB, Pavia C. Comparison of the yields of blood cultures using serum or plasma from patients with early Lyme disease. J Clin Microbiol. 2000;38: 1648–1650. pmid:10747160
- 69. Liveris D, Schwartz I, Bittker S, Cooper D, Iyer R, Cox ME, et al. Improving the yield of blood cultures from patients with early Lyme disease. J Clin Microbiol. 2011;49: 2166–2168. pmid:21490189
- 70. Liveris D, Wang G, Girao G, Byrne DW, Nowakowski J, McKenna D, et al. Quantitative detection of Borrelia burgdorferi in 2-millimeter skin samples of erythema migrans lesions: correlation of results with clinical and laboratory findings. J Clin Microbiol. 2002;40: 1249–1253. pmid:11923340
- 71. Gomes-Solecki MJ, Meirelles L, Glass J, Dattwyler RJ. Epitope length, genospecies dependency, and serum panel effect in the IR6 enzyme-linked immunosorbent assay for detection of antibodies to Borrelia burgdorferi. Clin Vaccine Immunol. 2007;14: 875–879. pmid:17538122
- 72. Burbelo PD, Issa AT, Ching KH, Cohen JI, Iadarola MJ, Marques A. Rapid, simple, quantitative, and highly sensitive antibody detection for lyme disease. Clin Vaccine Immunol. 2010;17: 904–909. pmid:20392886
- 73. Branda JA, Strle F, Strle K, Sikand N, Ferraro MJ, Steere AC. Performance of United States serologic assays in the diagnosis of Lyme borreliosis acquired in Europe. Clin Infect Dis. 2013;57: 333–340. pmid:23592827
- 74. Sillanpaa H, Lahdenne P, Sarvas H, Arnez M, Steere A, Peltomaa M, et al. Immune responses to borrelial VlsE IR6 peptide variants. Int J Med Microbiol. 2007;297: 45–52. pmid:17234451
- 75. Hinckley AF, Connally NP, Meek JI, Johnson BJ, Kemperman MM, Feldman KA, et al. Lyme disease testing by large commercial laboratories in the United States. Clin Infect Dis. 2014;59: 676–681. pmid:24879782
- 76. Maraspin V, Ogrinc K, Ruzic-Sabljic E, Lotric-Furlan S, Strle F. Isolation of Borrelia burgdorferi sensu lato from blood of adult patients with borrelial lymphocytoma, Lyme neuroborreliosis, Lyme arthritis and acrodermatitis chronica atrophicans. Infection. 2011;39: 35–40. pmid:21153429
- 77. Fallon BA, Pavlicova M, Coffino SW, Brenner C. A comparison of lyme disease serologic test results from 4 laboratories in patients with persistent symptoms after antibiotic treatment. Clin Infect Dis. 2014;59: 1705–1710. pmid:25182244
- 78. Stanek G, Lusa L, Ogrinc K, Markowicz M, Strle F. Intrathecally produced IgG and IgM antibodies to recombinant VlsE, VlsE peptide, recombinant OspC and whole cell extracts in the diagnosis of Lyme neuroborreliosis. Med Microbiol Immunol. 2014;203: 125–132. pmid:24363169
- 79. Dessau RB, Moller JK, Kolmos B, Henningsson AJ. Multiplex assay (Mikrogen recomBead) for detection of serum IgG and IgM antibodies to 13 recombinant antigens of Borrelia burgdorferi sensu lato in patients with neuroborreliosis: the more the better? J Med Microbiol. 2015;64: 224–231. pmid:25587083
- 80. Henningsson AJ, Christiansson M, Tjernberg I, Lofgren S, Matussek A. Laboratory diagnosis of Lyme neuroborreliosis: a comparison of three CSF anti-Borrelia antibody assays. Eur J Clin Microbiol Infect Dis. 2014;33: 797–803. pmid:24263552
- 81. Canadian Public Health Laboratory Network. The laboratory diagnosis of Lyme borreliosis: Guidelines from the Canadian Public Health Laboratory Network. Can J Infect Dis Med Microbiol. 2007;18: 145–148. pmid:18923770
- 82. Branda JA, Linskey K, Kim YA, Steere AC, Ferraro MJ. Two-tiered antibody testing for Lyme disease with use of 2 enzyme immunoassays, a whole-cell sonicate enzyme immunoassay followed by a VlsE C6 peptide enzyme immunoassay. Clin Infect Dis. 2011;53: 541–547. pmid:21865190
- 83. Wormser GP, Tang AT, Schimmoeller NR, Bittker S, Cooper D, Visintainer P, et al. Utility of serodiagnostics designed for use in the United States for detection of Lyme borreliosis acquired in Europe and vice versa. Med Microbiol Immunol. 2014;203: 65–71. pmid:24218117
- 84. Bacon RM, Biggerstaff BJ, Schriefer ME, Gilmore RD Jr, Philipp MT, Steere AC, et al. Serodiagnosis of Lyme disease by kinetic enzyme-linked immunosorbent assay using recombinant VlsE1 or peptide antigens of Borrelia burgdorferi compared with 2-tiered testing using whole-cell lysates. J Infect Dis. 2003;187: 1187–1199. pmid:12695997
- 85. Binnicker MJ, Jespersen DJ, Harring JA, Rollins LO, Bryant SC, Beito EM. Evaluation of two commercial systems for automated processing, reading, and interpretation of Lyme borreliosis Western blots. J Clin Microbiol. 2008;46: 2216–2221. pmid:18463211
- 86. Schoen RT. Editorial commentary: better laboratory testing for Lyme disease: no more Western blot. Clin Infect Dis. 2013;57: 341–343. pmid:23592831
- 87. Nowakowski J, McKenna D, Nadelman RB, Bittker S, Cooper D, Pavia C, et al. Blood cultures for patients with extracutaneous manifestations of Lyme disease in the United States. Clin Infect Dis. 2009;49: 1733–1735. pmid:19886794
- 88. Cerar T, Ogrinc K, Cimperman J, Lotric-Furlan S, Strle F, Ruzic-Sabljic E. Validation of cultivation and PCR methods for diagnosis of Lyme neuroborreliosis. J Clin Microbiol. 2008;46: 3375–3379. pmid:18716226
- 89. Fallon BA, Pavlicova M, Coffino SW, Brenner C. A comparison of lyme disease serologic test results from 4 laboratories in patients with persistent symptoms after antibiotic treatment. Clin Infect Dis. 2014;59: 1705–1710. pmid:25182244
- 90. Lahey LJ, Panas MW, Mao R, Delanoy M, Flanagan JJ, Binder SR, et al. Development of a Multiantigen Panel for Improved Detection of Borrelia burgdorferi Infection in Early Lyme Disease. J Clin Microbiol. 2015;53: 3834–3841. pmid:26447113