Skip to main content
Advertisement
  • Loading metrics

Diagnostics to support the control of scabies–Development of two target product profiles

  • Michael Marks ,

    Roles Conceptualization, Investigation, Writing – original draft, Writing – review & editing

    michael.marks@lshtm.ac.uk

    Affiliations Department of Clinical Research, Faculty of Infectious and Tropical Diseases, London School of Hygiene and Tropical Medicine, London, United Kingdom, Hospital for Tropical Diseases, University College London Hospital, London, United Kingdom, Division of Infection and Immunity, University College London, London, United Kingdom

  • Jodie McVernon,

    Roles Methodology, Writing – review & editing

    Affiliations Department of Infectious Diseases, The University of Melbourne at the Peter Doherty Institute for Infection and Immunity, Melbourne, Australia, Victorian Infectious Diseases Laboratory Epidemiology Unit, Royal Melbourne Hospital at The Peter Doherty Institute for Infection and Immunity, Melbourne, Australia, Centre for Epidemiology and Biostatistics, Melbourne School of Population and Global Health, The University of Melbourne, Melbourne, Australia, Infection and Immunity Theme, Murdoch Childrens Research Institute, Melbourne, Australia

  • James S. McCarthy,

    Roles Methodology, Writing – review & editing

    Affiliation Department of Infectious Diseases, The University of Melbourne at the Peter Doherty Institute for Infection and Immunity, Melbourne, Australia

  • Wendemagegn Enbiale,

    Roles Methodology, Writing – review & editing

    Affiliations Bahir Dar University, college of Medicine and Health sciences, Dermatovenerology Department, Bahir Dar, Ethiopia, Amsterdam UMC, University of Amsterdam, Department of Dermatology, Amsterdam Institute for Infection and Immunity (AII), Academic Medical Centre, Amsterdam, Netherlands

  • Christopher Hanna,

    Roles Conceptualization, Methodology, Writing – original draft

    Affiliation Global Project Partners, Oakland, California, United States of America

  • Olivier Chosidow,

    Roles Methodology, Writing – review & editing

    Affiliations AP-HP, Hôpitaux universitaires Henri Mondor, Service de Dermatologie, Créteil, France, Research group Dynamyc, EA7380, Faculté de Santé de Créteil, Ecole nationale vétérinaire d’Alfort, USC ANSES, Université Paris-Est Créteil, Créteil, France, GrIDIST, Groupe Infectiologie Dermatologique–Infections Sexuellement Transmissibles, Société Française de Dermatologie, Paris, France

  • Daniel Engelman,

    Roles Methodology, Writing – review & editing

    Affiliations Tropical Diseases, Murdoch Children’s Research Institute, Melbourne, Australia, Department of Paediatrics, University of Melbourne, Melbourne, Australia, Melbourne Children’s Global Health, Royal Children’s Hospital, Melbourne, Australia

  • Kingsley Asiedu,

    Roles Conceptualization, Writing – review & editing

    Affiliation Department for the Control of Neglected Tropical Diseases, World Health Organization, Geneva, Switzerland

  • Andrew Steer

    Roles Methodology, Writing – review & editing

    Affiliations Tropical Diseases, Murdoch Children’s Research Institute, Melbourne, Australia, Department of Paediatrics, University of Melbourne, Melbourne, Australia, Melbourne Children’s Global Health, Royal Children’s Hospital, Melbourne, Australia

Abstract

Background

Scabies was added to the WHO NTD portfolio in 2017 and targets for the control of scabies were included in the 2021–2030 WHO NTD roadmap. A major component of scabies control efforts a strategy based on mass drug administration (MDA) with ivermectin. Currently diagnosis of scabies relies on clinical examination with a limited role for diagnostic testing. Under the recommendation of the WHO Diagnostic Technical Advisory Group (DTAG) for Neglected Tropical Diseases, a working group was assembled and tasked with agreeing on priority use cases for and developing target product profiles (TPPs) for new diagnostics tools for scabies.

Methodology and principal findings

The working group convened three times and established two use cases: establishing if the 10% threshold for mass drug administration had been reached and if the 2% threshold for stopping mass drug administration has been achieved. One subgroup assessed the current diagnostic landscape for scabies and a second subgroup determined the test requirements for both use cases. Draft TPPs were sent out for input from stakeholders and experts. Both TPPs considered the following parameters: product use, design, performance, configuration, cost, access and equity. The group considered the use of the tests as a single step process or as part of a two step process following initial clinical examination. When used a single step test (the ideal scenario) for starting MDA a new diagnostic required a sensitivity of ≥92% and a specificity of ≥98%. When used a single step test (the ideal scenario) for stopping MDA a new diagnostic required a sensitivity of ≥80% and a specificity of ≥99%.

Conclusions

The TPPs developed will provide test developers with guidance to ensure that novel diagnostic tests meet identified public health needs.

Author summary

Accurate diagnostic tests are needed to aid scabies control efforts. In particular they might aid decisions about when to start and stop treatment of whole communities (mass drug administration). Currently most diagnosis is based on clinical examination only and there is a need to establish what criteria new diagnostic tests should meet for them to be of public health use. To aid with this, we determined the programmatic areas of greatest need (use cases) and then developed a shortlist of product requirements (target product profiles, or TPPs) for each scenario. These TPPs can then be used by product developers to ensure that novel diagnostic tools in development are fit for purpose. There were two programmatic use cases for which scabies TPPs were developed. The first TPP focused on diagnostics to determine if the community prevalence of scabies was above 10%—the threshold at which mass drug administration is recommended. The second TPP focused on diagnostics to determine if the community prevalence of scabies is below 2%—the threshold at which mass drug administration can be stopped.

Introduction

Scabies is caused by infestation with the ectoparasite Sarcoptes scabiei var. hominis [1]. Infestation leads to itch, skin lesions and in some cases more serious complications due to bacterial superinfection. Scabies occurs worldwide but its distribution is not uniform. In high-income settings, most cases are sporadic. A far higher burden of disease is found in low and middle income countries [2]. In some settings the community prevalence of scabies may be as high as 20–30%. In response to the high burden of disease, individual country commitments to control the disease and the emerging evidence that ivermectin-based mass drug administration (MDA) represents an effective control strategy [3,4], scabies was added to the World Health Organization (WHO) list of Neglected Tropical Diseases (NTDs) in 2017. This was followed in 2019 by an informal consultation, convened by WHO in 2019, and which resulted in a provisional framework for scabies control [5,6].

Central to scale-up of control efforts is the need for more accurate data on the distribution of scabies to guide the roll-out of interventions. Historically, scabies control has been hampered by the lack of a standardised approach to diagnosis, with systematic reviews identifying inconsistency in scabies diagnostic criteria across studies. In response to this the International Alliance for the Control of Scabies (IACS) used a Delphi consensus method to develop standardized criteria for scabies diagnosis [7,8]. Initial validation studies of these criteria have been conducted in some settings and evaluations of training programmes based on the clinical aspects of these criteria have found that mid-level health care workers can be trained to a standard that ensures an acceptable level of sensitivity, specificity and reproducibility [911].

In addition to clinical diagnosis a number of novel diagnostic tests for scabies are being developed [1214], but none are currently suitable for adoption. Ensuring that diagnostic tools in development are suitable for programmatic use is a critical issue in supporting the scale up of scabies control efforts in line with the 2021–2030 NTD roadmap. At the request of the WHO Department of Control of Neglected Tropical Diseases (NTDs) a single WHO working group was established to identify and prioritize diagnostic needs for each of the 20 NTDs, and to inform WHO strategies and guidance on the subject [15]. The first meeting of this group, known as the Diagnostic Technical Advisory Group (DTAG), was held in Geneva, Switzerland, on 30th and 31st October 2019. This meeting resulted in the identification of several key priorities for the DTAG. One identified priority was the development of Target Product Profiles (TPPs) for diagnostics to support emerging scabies control programmes.

In this manuscript, we report the process used in developing the TPPs for scabies, the TPP specifications and the assumptions made. The purpose of these TPPs is to support the scabies control strategy in two critical decision areas i) whether the threshold for initiating MDA has been met and ii) whether the threshold for stopping MDA has been met.

Methods

Based on the recommendation of the DTAG, WHO formed a group of skin-related NTDs to address TPPs for each of these NTDs. A scabies sub-group was established including members of this group and external experts. The scabies subgroup met from November 2020 to April 2021 to agree on priority use cases for the TPPs and undertake the process for the developments of the TPPs. The subgroup leveraged the WHO core TPP development process (Fig 1) as the framework and followed well-established quality planning methodologies [16,17]. Two priority use cases for scabies were agreed upon, based on the recommendations from the recently developed framework for scabies control i) establishing if the proposed community prevalence of scabies for initiating MDA (10%) had been met (starting MDA), and ii) establishing if the proposed threshold for ceasing MDA (2%) had been met (stopping MDA). These recommendations assume that survey will be conducted using cluster randomized, whole age household survey designs with decisions about MDA being made at the level of the whole evaluation unit. There is currently no agreed design effect for use in scabies surveys so for the purpose of the TPP development we used a design effect of 2. Within the scabies TPP group two expert subgroups were formed, one to determine the attributes required for each scenario (use case characteristics) and another to review the landscape of currently available diagnostic strategies, in addition to a separate modelling of test performance requirements (i.e., sensitivity and specificity) that must be achieved to meet use case objectives. Ultimately, TPPs are intended to facilitate expeditious development of missing diagnostic assays addressing prioritized public health needs. Using the WHO core TPP development process, the expert subgroups for scabies convened online five times to determine the requirements for each use case.

thumbnail
Fig 1. World Health Organization Target Product Profile Process.

https://doi.org/10.1371/journal.pntd.0010556.g001

TPPs for each use case considered the following parameters: product use, design, performance, product configuration and cost, and access and equity. Initial ‘Draft Zero’ requirements in each TPP were selected based on landscape analyses, use case needs analysis and diagnostics performance modeling developed through a consultative process coordinated by WHO Department of the Control of NTDs. For certain elements in each use case, parameters were defined at the outset, and assumptions were made to move forward with sensitivity and specificity calculations. In the context of scabies, the group considered two implementation scenarios. In the first scenario a two-step diagnostic process was considered. This scenario was taken to reflect the process where initial clinical diagnosis was followed by performance of a diagnostic test. In the second scenario a single-step diagnostic process was considered. This scenario was taken to reflect a process whether either clinical diagnosis or performance of a test alone was used as the diagnostic strategy. The committee considered that prevalence surveys would be conducted in line with recommendations arising from the WHO Informal Consultation on Scabies Control. This included the performance of all age, community based cluster randomized surveys. Modelling was used to evaluate the sensitivity and specificity that would be required in each use-case. For the ‘Start MDA’ use-case sensitivity and specificity were selected such that a true population prevalence of 10% would be detected 80% of the time (false-negative rate 20%) and that a true population prevalence of 8% would only be incorrectly classified as being above the MDA threshold 5% of the time (false-positive rate 5%). For the ‘Stop MDA’ use-case sensitivity and specificity were selected such that if the true population prevalence were 3% it would be incorrectly classified as <2% only 5% of the time (false-positive rate 5%). In the context of a two-step diagnostic process it was assumed that the sensitivity and specificity of clinical diagnosis were both 80%. It was recognized that this is at the upper limit of the performance reported in evaluations of mid-level healthcare worker diagnosis of scabies[9,10,18,19] and that lower levels of accuracy of initial clinical diagnosis would impact any two-step diagnostic process.

Following development of the initial TPP the scabies subgroup critically reviewed and modified the draft zero where warranted. The draft zero TPP was then sent to the main DTAG committee for review and comments.After revising based on the comments from the DTAG, the scabies subgroup finalized the TPP details, and draft 0.1 TPPs were posted on the WHO website for public comment in July 2021. Comments received were shared with the experts, and TPPs were revised accordingly to generate version 1.0 TPPs.

Results

The diagnostic landscape review identified clinical and direct identification methodologies as tests that were currently available and antigen and molecular diagnostic tests as in development (Table 1). Estimates of sensitivity and specificity are based on expert opinion informed by the literature.

thumbnail
Table 1. Diagnostic Landscape of available tests for scabies.

https://doi.org/10.1371/journal.pntd.0010556.t001

Version 1.0 TPPs for the two use cases were published by WHO on 7 November 2021 within the WHO Global Observatory on Health R&D. No changes were made following the period of public consultation. Select TPP features and their associated requirements are presented in Tables 2 and 3. It was considered a minimum requirement for a test to be lab based and only require standard laboratory equipment. It was considered an ideal requirement that the test could be used at the point-of-care.

thumbnail
Table 2. Select characteristics of needed test for Starting MDA.

https://doi.org/10.1371/journal.pntd.0010556.t002

thumbnail
Table 3. Select characteristics of needed test for Stopping MDA.

https://doi.org/10.1371/journal.pntd.0010556.t003

Discussion

Relative to almost all other NTD programmes global scabies control efforts are at an earlier stage of development. The World Scabies Programme, established in Australia in

2019, represents a first step towards scale-up of scabies control efforts globally, but further work is required to support countries in reaching the ambitious goals for scabies control outlined in the 2021–2030 NTD roadmap [20]. Major challenges facing programmes include the absence of a drug donation programme, the need for further data on the effectiveness of MDA at programmatic scale, and the lack of robust epidemiological data to identify regions where MDA should be rolled-out. Ensuring high-quality, reliable diagnosis of scabies is a critical step in addressing the second of these challenges. The TPP process outlined in this paper represents an important step in establishing criteria for future scabies diagnostics to address programmatic needs.

Currently most activities rely on clinical diagnosis performed by different cadres of healthcare workers. The introduction and validation of the 2020 IACS Consensus criteria for scabies has been an important step in standardizing clinical diagnosis of scabies in research studies [7,9,10], but further work is needed in a programmatic context. In the context of TPP development the group considered two scenarios. In the first scenario performance characteristics were developed assuming a test was performed following initial clinical screening. The sensitivity and specificity of this screening was set at 80% for the purpose of this process. This level of accuracy has been reported in some but not all evaluations of mid-level healthcare worker diagnosis of scabies highlighting the need for further work to improve training for the critical cadre of staff. If the sensitivity of initial clinical examination was substantially below 80% the two-stage process becomes less viable as a strategy, in particular for the decision to initiate MDA. For this reason a single-step test is likely to be preferable if it can be achieved. The single-step TPP criteria require higher levels of performance which surpass those seen in all evaluations of mid-level healthcare workers to date. Other programmes such as trachoma have focused less on achieving particular levels of sensitivity and specificity for mid-level healthcare workers and instead on achieving high levels of inter-operator reliability and setting programmatic thresholds in relation to the accuracy of these mid-level healthcare workers. Whether such approaches could be considered for scabies warrants further consideration.

The provisional framework for scabies control recommends treatment of an entire community predominantly with ivermectin-based MDA in settings where the prevalence of scabies 10% or greater, and that this intervention is continued for between three to five rounds before an assessment of disease prevalence is undertaken. If the community prevalence has fallen to below 2% it is recommended that MDA is ceased, whereas if the prevalence of MDA remains above 2%, further extension of the MDA is recommended [6]. These thresholds are based on current best evidence but may change as further implementation, and operational research studies are undertaken and may be further refined based on insights from mathematical modelling studies [21]. For this TPP, the expert subgroup considered the criteria needed to accurately start MDA at least 80% of the time when the prevalence of scabies was at least 10% and to not incorrectly start if the prevalence was 8% or less more than 5% of the time. The requirement to avoid initiation of MDA reflects, in part, the current absence of evidence about the effectiveness and cost-effectiveness of MDA as a strategy at lower prevalences alongside also the lack of a current drug donation to support MDA progammes, rather than an intrinsic biological rationale for the current threshold. Equally thresholds for stopping reflect expert consensus rather than empirically derived thresholds below which rebound of disease is unlikely following cessation of MDA. The TPP characteristics for both use cases should therefore be considered within these current constraints and the specifications may need to evolve as further data and/or a drug donation or reliable, cheap supply of ivermectin and permethrin becomes available.

Conclusion

Two TPPs have been presented in this manuscript. The first lays out the specifications for diagnostic tools to detect when MDA should be started and the second when MDA should be ceased. As well as the technical characteristics outlined in this paper and the published TPPS, diagnostic fulfil developed for use in a NTD control or eradication programmes should also be designed to fulfill the WHO reassured criteria. Ideally these TPPs will help inform evaluations of novel diagnostic tests and provide guidance on the standard of clinical diagnosis that would be required if that were to solve as the primary diagnostic modality.

Acknowledgments

The authors would like to thank all experts and colleagues who provided useful comments through the public consultation.

References

  1. 1. Heukelbach J, Feldmeier H. Scabies. The Lancet. 2006;367: 1767–1774. pmid:16731272
  2. 2. Romani L, Whitfeld MJ, Koroivueta J, Kama M, Wand H, Tikoduadua L, et al. The Epidemiology of Scabies and Impetigo in Relation to Demographic and Residential Characteristics: Baseline Findings from the Skin Health Intervention Fiji Trial. Am J Trop Med Hyg. 2017;97: 845–850. pmid:28722612
  3. 3. Romani L, Marks M, Sokana O, Nasi T, Kamoriki B, Wand H, et al. Feasibility and safety of mass drug coadministration with azithromycin and ivermectin for the control of neglected tropical diseases: a single-arm intervention trial. Lancet Glob Health. 2018;6: e1132–e1138. pmid:30223985
  4. 4. Romani L, Whitfeld MJ, Koroivueta J, Kama M, Wand H, Tikoduadua L, et al. Mass Drug Administration for Scabies Control in a Population with Endemic Disease. N Engl J Med. 2015;373: 2305–2313. pmid:26650152
  5. 5. World Health Organization. WHO informal consultation on a framework for scabies control, meeting report World Health Organization Regional Office for the Western Pacific, Manila, Philippines, 19–21 February 2019. Available: https://www.who.int/publications-detail-redirect/9789240008069
  6. 6. Engelman D, Marks M, Steer AC, Beshah A, Biswas G, Chosidow O, et al. A framework for scabies control. PLoS Negl Trop Dis. 2021;15: e0009661. pmid:34473725
  7. 7. Engelman D, Fuller LC, Steer AC, Panel for the IA for the C of SD. Consensus criteria for the diagnosis of scabies: A Delphi study of international experts. PLoS Negl Trop Dis. 2018;12: e0006549. pmid:29795566
  8. 8. Engelman D, Yoshizumi J, Hay R j., Osti M, Micali G, Norton S, et al. The 2020 International Alliance for the Control of Scabies Consensus Criteria for the Diagnosis of Scabies. Br J Dermatol. 2020;183: 808–820. pmid:32034956
  9. 9. Osti MH, Sokana O, Gorae C, Whitfeld MJ, Steer AC, Engelman D. The diagnosis of scabies by non-expert examiners: A study of diagnostic accuracy. PLoS Negl Trop Dis. 2019;13: e0007635. pmid:31425513
  10. 10. Walker SL, Collinson S, Timothy J, Zayzay SK, Kollie KK, Candy N, et al. A community-based validation of the International Alliance for the Control of Scabies Consensus Criteria by expert and non-expert examiners in Liberia. PLoS Negl Trop Dis. 2020;14: e0008717. pmid:33017426
  11. 11. Enbiale W, Ayalew A. Investigation of a Scabies Outbreak in Drought-Affected Areas in Ethiopia. Trop Med Infect Dis. 2018;3: 114. pmid:30380650
  12. 12. Chng L, Holt DC, Field M, Francis JR, Tilakaratne D, Dekkers MH, et al. Molecular diagnosis of scabies using a novel probe-based polymerase chain reaction assay targeting high-copy number repetitive sequences in the Sarcoptes scabiei genome. PLoS Negl Trop Dis. 2021;15: e0009149. pmid:33626043
  13. 13. Hahm JE, Kim CW, Kim SS. The efficacy of a nested polymerase chain reaction in detecting the cytochrome c oxidase subunit 1 gene of Sarcoptes scabiei var. hominis for diagnosing scabies. Br J Dermatol. 2018;179: 889–895. pmid:29624634
  14. 14. Kim JK, Chun EJ, Yang SY, Kim KS, Kim SS, Kim CW. Development and efficacy of a nested real-time quantitative polymerase chain reaction to identify the cytochrome c oxidase subunit 1 gene of Sarcoptes scabiei var. hominis for diagnosis and monitoring of ordinary scabies. Br J Dermatol. 2020;183: 1116–1117. pmid:32594512
  15. 15. Souza AA, Ducker C, Argaw D, King JD, Solomon AW, Biamonte MA, et al. Diagnostics and the neglected tropical diseases roadmap: setting the agenda for 2030. Trans R Soc Trop Med Hyg. [cited 11 Nov 2020]. pmid:33169166
  16. 16. Ficalora Joseph P., Cohen Louis. Quality Function Deployment and Six Sigma: A QFD Handbook, Second Edition [Book]. Pearson; 2009. Available: https://www.oreilly.com/library/view/quality-function-deployment/9780137035441/
  17. 17. Juran JM. Juran on Quality by Design: The New Steps for Planning Quality into Goods and Services. Revised edition. New York: Toronto: New York: Free Press; 1992.
  18. 18. Armitage EP, Senghore E, Darboe S, Barry M, Camara J, Bah S, et al. High burden and seasonal variation of paediatric scabies and pyoderma prevalence in The Gambia: A cross-sectional study. PLoS Negl Trop Dis. 2019;13: e0007801. pmid:31609963
  19. 19. Steer AC, Tikoduadua LV, Manalac EM, Colquhoun S, Carapetis JR, Maclennan C. Validation of an Integrated Management of Childhood Illness algorithm for managing common skin conditions in Fiji. Bull World Health Organ. 2009;87: 173–179. pmid:19377712
  20. 20. World Health Organization. WHO | Ending the neglect to attain the Sustainable Development Goals: A road map for neglected tropical diseases 2021–2030. World Health Organization; Available: http://www.who.int/neglected_diseases/resources/who-ucn-ntd-2020.01/en/
  21. 21. Marks M, McVernon J, Engelman D, Kaldor J, Steer A. Insights from mathematical modelling on the proposed WHO 2030 goals for scabies. Gates Open Res. 2019;3: 1542. pmid:31656953