Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

To what extent are the antimalarial markets in African countries ready for a transition to triple artemisinin-based combination therapies?

  • Freek de Haan ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Validation, Visualization, Writing – original draft, Writing – review & editing

    F.dehaan@uu.nl

    Affiliation Copernicus Institute of Sustainable Development, Utrecht University, Utrecht, The Netherlands

  • Oladimeji Akeem Bolarinwa,

    Roles Investigation, Resources, Writing – review & editing

    Affiliation College of Health Sciences, University of Ilorin, Ilorin, Nigeria

  • Rosemonde Guissou,

    Roles Investigation, Resources, Writing – review & editing

    Affiliation Institut de Recherche en Sciences de la Sante, Bobo-Dioulasso, Burkina Faso

  • Fatoumata Tou,

    Roles Investigation, Resources, Writing – review & editing

    Affiliation Institut des Sciences et Techniques, Bobo-Dioulasso, Burkina Faso

  • Paulina Tindana,

    Roles Conceptualization, Investigation, Methodology, Resources, Validation, Writing – review & editing

    Affiliation School of Public Health, College of Health Sciences, University of Ghana, Accra, Ghana

  • Wouter P. C. Boon,

    Roles Project administration, Resources, Supervision, Writing – review & editing

    Affiliation Copernicus Institute of Sustainable Development, Utrecht University, Utrecht, The Netherlands

  • Ellen H. M. Moors,

    Roles Project administration, Resources, Supervision, Writing – review & editing

    Affiliation Copernicus Institute of Sustainable Development, Utrecht University, Utrecht, The Netherlands

  • Phaik Yeong Cheah,

    Roles Conceptualization, Investigation, Resources, Writing – review & editing

    Affiliations Mahidol Oxford Tropical Medicine Research Unit, Faculty of Tropical Medicine, Mahidol University, Bangkok, Thailand, Center for Tropical Medicine and Global Health, Nuffield Department of Medicine, University of Oxford, Oxford, United Kingdom

  • Mehul Dhorda,

    Roles Investigation, Project administration, Resources, Supervision, Writing – review & editing

    Affiliations Mahidol Oxford Tropical Medicine Research Unit, Faculty of Tropical Medicine, Mahidol University, Bangkok, Thailand, Center for Tropical Medicine and Global Health, Nuffield Department of Medicine, University of Oxford, Oxford, United Kingdom

  • Arjen M. Dondorp,

    Roles Funding acquisition, Project administration, Resources, Supervision, Writing – review & editing

    Affiliations Mahidol Oxford Tropical Medicine Research Unit, Faculty of Tropical Medicine, Mahidol University, Bangkok, Thailand, Center for Tropical Medicine and Global Health, Nuffield Department of Medicine, University of Oxford, Oxford, United Kingdom

  • Jean Bosco Ouedraogo,

    Roles Investigation, Project administration, Resources, Supervision, Writing – review & editing

    Affiliations Institut de Recherche en Sciences de la Sante, Bobo-Dioulasso, Burkina Faso, Institut des Sciences et Techniques, Bobo-Dioulasso, Burkina Faso

  • Olugbenga A. Mokuolu,

    Roles Investigation, Project administration, Resources, Supervision, Writing – review & editing

    Affiliation College of Health Sciences, University of Ilorin, Ilorin, Nigeria

  • Chanaki Amaratunga

    Roles Conceptualization, Investigation, Project administration, Resources, Supervision, Writing – review & editing

    Affiliations Mahidol Oxford Tropical Medicine Research Unit, Faculty of Tropical Medicine, Mahidol University, Bangkok, Thailand, Center for Tropical Medicine and Global Health, Nuffield Department of Medicine, University of Oxford, Oxford, United Kingdom

Abstract

Introduction

Triple artemisinin-based combination therapies (TACTs) are being developed as a response to artemisinin and partner drug resistance in the treatment of falciparum malaria in Southeast Asia. In African countries, where current artemisinin-based combination therapies (ACTs) are still effective, TACTs have the potential to benefit the larger community and future patients by mitigating the risk of drug resistance. This study explores the extent to which the antimalarial drug markets in African countries are ready for a transition to TACTs.

Methods

A qualitative study was conducted in Nigeria and Burkina Faso and comprised in-depth interviews (n = 68) and focus group discussions (n = 11) with key actor groups in the innovation system of antimalarial therapies.

Results

Evidence of ACT failure in African countries and explicit support for TACTs by the World Health Organization (WHO) and international funders were perceived important determinants for the market prospects of TACTs in Nigeria and Burkina Faso. At the country level, slow regulatory and implementation procedures were identified as potential barriers towards rapid TACTs deployment. Integrating TACTs in public sector distribution channels was considered relatively straightforward. More challenges were expected for integrating TACTs in private sector distribution channels, which are characterized by patient demand and profit motives. Finally, several affordability and acceptability issues were raised for which ACTs were suggested as a benchmark.

Conclusion

The market prospects of TACTs in Nigeria and Burkina Faso will depend on the demonstration of the added value of TACTs over ACTs, their advocacy by the WHO, the inclusion of TACTs in financial and regulatory arrangements, and their alignment with current distribution and deployment practices. Further clinical, health-economic and feasibility studies are required to inform decision makers about the broader implications of a transition to TACTs in African counties. The recent reporting of artemisinin resistance and ACT failure in Africa might change important determinants of the market readiness for TACTs.

Introduction

Artemisinin-based combination therapies (ACTs) are the global first-line antimalarial therapies for the treatment of uncomplicated falciparum malaria [1]. A worrying development is the emergence and spread of Plasmodium falciparum parasites resistant to both artemisinin and partner drugs, compromising ACT efficacy in large areas of Southeast Asia [25]. An even more significant threat is the risk of multidrug resistance spreading further throughout Asia and to the African continent, where most of the malaria burden is clustered [6]. In addition, artemisinin resistance can emerge independently in African countries, as has been increasingly reported in recent years [7]. According to conservative estimates, these scenarios could lead to more than 116.000 excess deaths on an annual base while the economic costs could exceed USD 400 million per year [8].

Innovative solutions are urgently required to restore antimalarial efficacy in areas where ACTs are failing and to protect the rest of the malaria-endemic world from the looming threat of resistance. However, new antimalarial drug compounds are not expected on the market before 2026 [911]. A pragmatic short-term solution that could provide long-term benefits is the introduction of triple artemisinin-based combination therapies (TACTs) [1216]. TACTs combine an artemisinin derivative with two partner drugs, ideally with counteracting resistance mechanisms. This will extend the therapeutic lifetime of the drug combinations, because the parasite will need to develop resistance to three drug compounds instead of two. Previous studies have shown promising results [17] and several TACT combinations are now being developed and tested to translate this potential into end-products [15]. Once they are confirmed to be safe, tolerable, efficacious and non-inferior to ACTs, these TACTs could provide direct clinical relief in Southeast Asia. Moreover, a rapid and sustainable transition to TACTs in Africa could mitigate the risk of spread and de novo emergence of artemisinin and partner drug resistance on the continent.

Despite these promising developments, history has shown that changing first-line malaria therapies is a time and resource intensive process. Previous drug transitions have been slow and challenging, even when new therapies were clinically superior to failing alternatives [1821]. Challenges have, amongst others, been associated with supply-side and demand-side factors and with underperforming healthcare systems in endemic countries [22].

A complicating factor for a transition to TACTs in Sub-Saharan Africa is that current ACTs are still effective for the treatment of falciparum malaria. TACTs would not provide direct additional clinical benefit to individual patients, but rather benefit the larger community and future patients by mitigating the risk of the emergence and spread of drug resistance. Engaging in TACTs thus requires direct investments at the country level, whilst the benefits of TACT deployment would be long-term and transcend national borders. This, in combination with lessons learned from the problematic introduction of previous therapies, warrants an assessment of the readiness of the antimalarial drug markets in African countries for a transition to TACTs [15, 23]. Similar anticipatory studies have not been conducted for innovative antimalarial therapies and findings could support strategic decision making in the battle against drug-resistant malaria. This study aims to explore the extent to which stakeholders perceive the antimalarial drug markets in African countries ready for a transition to TACTs.

Materials and methods

Research design

The study was conducted under the auspices of the UK Government’s Foreign, Commonwealth & Development Office funded Development of Triple Artemisinin Combination Therapies (DeTACT) project and explores the readiness of antimalarial drug markets in African countries for a transition to TACTs [15]. An initial pilot study was conducted in Nigeria and Burkina Faso, two countries that suffer from high malaria endemicity [6], yet have different healthcare systems. Table 1 provides demographic and malaria-related data for Nigeria and Burkina Faso. We used a multiple case design, that allows investigating the country-specific contexts, while enabling the extraction of overarching themes [24]. The study employs a qualitative approach of data collection, involving in-depth interviews and focus group discussions (FGDs) with key stakeholders.

thumbnail
Table 1. Demographic and malaria data on the settings in Nigeria and Burkina Faso.

https://doi.org/10.1371/journal.pone.0256567.t001

Theoretical and thematic approach

The study uses an ‘innovation systems’ approach to explore the readiness of African countries for a transition to TACTs [25]. The innovation systems approach assumes that integrating new technology in society is a collective effort that takes place in a complex social system. To explain or predict the success of an innovative therapy such as TACTs, one should not only consider medical-technological characteristics, but also the dynamics of the surrounding innovation system [22, 26]. An innovation system consists of all actors, networks and institutions involved in the development, distribution and utilization of the therapy.

We identified the key actor groups in the innovation system of antimalarial therapies (Fig 1). Our study focuses on country-level dynamics, and therefore the national borders are demarcated by a dashed line. To prepare for data collection, we conducted a thematic analysis in which we identified the major barriers and enablers of previous antimalarial drug transitions from literature review [27]. These barriers and enablers were grouped and assigned to the key actors in the innovation system. Finally, we constructed semi-structured interview guides per key actor group to facilitate data collection [28].

thumbnail
Fig 1. Key actor groups in the innovation system of antimalarial therapies.

https://doi.org/10.1371/journal.pone.0256567.g001

Respondent selection

Respondents at different levels of the innovation system of antimalarial therapies (Fig 1) in Nigeria and Burkina Faso were identified and invited to participate in interviews and FGDs. We divided the key actor groups into three overarching categories to facilitate data analysis: Policy makers, Suppliers, and End-users. The rationale for this categorization was that they combine an overview of the innovation system with knowledge on specific parts of the system. Policy makers are best positioned to reflect on policy procedures and the regulatory trajectory. Suppliers are most knowledgeable about distribution, retail and prescription issues, while End-users have the most relevant insights on the actual utilization of new therapies. Sampling of respondents in each country continued until data saturation was reached. The full list of respondents is provided in Table 2.

Data collection

Preparatory meetings were held among members of the research team prior to data collection to discuss the study aims and to prepare material for data collection. Pilot interviews were conducted to further improve mutual understanding and to reduce ambiguity. Using the semi-structured interview guides enabled flexibility to new topics while still covering the same topics between the settings and respondent groups.

Each interview and FGD was conducted by at least two interviewers; one asking questions and the other taking notes. Interviews and FGDs were conducted in prearranged venues where there were no distractions and respondents were able to express themselves freely. On average 8 people participated per FGD. Each interview and FGD lasted between 30 and 120 minutes and were recorded with the consent of the respondent(s).

Data analysis

The tape recordings were transcribed and all non-English transcripts were translated to English. The transcripts were uploaded to NVivo12 Pro software and subjected to a process of coding. The coding process comprised both deductive and inductive techniques. A codebook was constructed based on the prior thematic analysis (deductive). New themes were developed for data that did not match the existing codes but were considered relevant for the study (inductive). The interview transcripts were coded independently by two researchers who analyzed all transcripts and discussed emerging themes. In a second round of coding, all themes were merged into overarching categories, the reflections were extracted per respondent group, and storylines were written.

Ethical approval

In Nigeria, ethical approval from the Institutional Review Board was obtained from the University of Ilorin Teaching Hospital (approval number ERC/PAN/2019/07/1916). In Burkina Faso, ethical approval was obtained from the Institutional Ethics Committee for Health Research (CEIRES). The Oxford Tropical Research Ethics Committee (OxTREC) approved the overall research project (approval number 552–19). Written participant consent was obtained prior to each interview and FGD. Respondents were informed about the objectives of the study and they were asked to sign a consent form. Permission to mention the affiliation of the respondent and to audio record the conversation was asked verbally.

Results

This study explored market readiness for a transition to TACTs by probing stakeholders’ perceptions in two African countries–Nigeria (NG) and Burkina Faso (BF). The findings from interviews and FGDs are categorized by the eight themes that emerged during data analysis.

Market approval, regulation and domestic production

Policy makers in Nigeria and Burkina Faso did not foresee major challenges in the regulatory trajectory for TACTs. Obtaining market approval for TACTs would be relatively straightforward under the assumption of supportive safety and efficacy data from clinical trials. It was, however, acknowledged that the trajectory towards market approval can be a lengthy one, while in the context of rapidly increasing drug resistance shorter timelines may be needed. [“I think generally we are trying to streamline the process of registering medicines in Nigeria, we are not where we want to be but it is a lot shorter than it used to be”—Policy maker 7, regulatory official, NG]. Internal capacity issues at the regulatory authority and submission of incomplete dossiers were cited as common causes of delays in the regulatory trajectory. Early submission of dossiers was suggested to be the most feasible way for obtaining rapid market approval for TACTs.

Respondents mentioned several challenges they encounter in the performance of the antimalarial drug market in their countries. It was acknowledged that antimalarials are often still being prescribed over-the-counter and beyond the official channels. As a result, substandard and outdated medicines such as chloroquine are still commonly deployed in both countries. Several policy makers and suppliers mentioned that market surveillance systems remain weak and that this could be a barrier to the uptake of TACTs. [“A threat can be that there are too many medicines on the market and lack of supervision. Then there may be no incentive to choose for TACT instead of another option”–Supplier 4, public sector clinician, NG]. The limited market surveillance and the low levels of regulatory compliance imply that patients can purchase the medicines they favor rather than those that are recommended in treatment guidelines. Challenges were particularly associated with the (informal) private sectors and respondents admitted that introducing TACTs under these circumstances is difficult. General health system reforms and increased investments in market regulation were cited as potential solutions.

Policy makers and suppliers in Nigeria emphasized that the domestic pharmaceutical industry is an important source of antimalarial drugs. Engaging domestic manufacturers in producing TACTs was therefore considered crucial to stimulate its uptake in Nigeria. A repeatedly cited challenge in this regard is that Nigerian manufacturers have not yet been able to produce according to global quality standards, including Good Manufacturing Practice standards. [“The local manufacturers produce all the ACTs, but the barrier is that none of them is WHO pre-qualified”–Policy maker 2, national malaria policy official, NG]. This implies that domestic manufacturers cannot become eligible to international donor subsidies. Respondents in Burkina Faso indicated that there is no domestic industry for the production of antimalarial therapies. Adopting TACTs as first-line therapy would therefore require adaptations in import and procurement procedures. Some suppliers perceived a potential transition to TACTs as an opportunity to start domestic production of antimalarials in Burkina Faso. [“If we have local production, I’m not saying that there won’t be a shortage, but there is a certain guarantee. We will always be able to put pressure for more drugs.–Supplier 13, private sector clinician, BF].

Inclusion in treatment guidelines and subsidy arrangements

All respondent groups agreed that including TACTs in national treatment guidelines would be critical for its future uptake in Nigeria and Burkina Faso. Several policy makers emphasized that WHO endorsement would be a major enabler for inclusion in these national treatment guidelines. [“WHO is a benchmark in management, it is a guide, it is a reference, all documents and national guidelines take reference from the WHO”–Supplier 22, private sector clinician, BF]. Most policy makers and suppliers were skeptical about a transition towards TACTs as long as ACTs are not failing within their borders. [“I’m not too much in favor of changing as long as ACTs are still effective. So we should continue to use them until they become resistant. If it doesn’t work, then we can change!”- Supplier 21, private sector clinician, BF].

Changing policy now to avoid resistance in the future was considered an insufficient argument to enact. This position was, however, contested by some other respondents who preferred pro-active anticipation by the government instead of passively waiting until artemisinin and partner drug resistance has been detected. [“We should not be waiting for the emergence of resistance to happen, before steps are taken”–Supplier 9, village health worker, NG]. Some respondents argued that the introduction of TACTs should be guided by actual data that confirms the presence of antimalarial drug resistance. [“So, countries like Nigeria want to document local evidence. You know, they want local evidence of the resistance before they could accept it.”–Policy maker 4, national malaria policy official, NG]. A transition to TACTs would then require a strategic plan which would contain specific policy actions at pre-defined resistance thresholds.

Policy makers, suppliers and end-users emphasized the importance of subsidy arrangements for deploying TACTs. [“You just have to integrate it into your program and subsidize it and make it available.”–Supplier 12, public sector clinician, BF]. Since price dictates consumer preferences, they expected TACTs to be unaffordable for large proportions of the population without external financial support. This was especially considered relevant for private sector deployment because of the limited availability of subsidy arrangements. For public sector deployment, willingness of the Global Fund to Fight Aids, Tuberculosis and Malaria (GFATM) to purchase TACTs was considered critical by policy makers and suppliers. In Nigeria, inclusion of TACTs in national insurance arrangements such as the National Health Insurance Scheme (NHIS) was suggested as another tool to promote uptake.

Implementation programs

Implementation refers to the process of translating policy decisions into practice. Respondents in Nigeria and Burkina Faso agreed that deliberate implementation programs would be required for TACTs if it becomes the first-line therapy for the treatment of malaria. The National Malaria Elimination Program (NMEP) in Nigeria and the Programme National de Lutte contre le Paludisme (PNPL) in Burkina Faso would be responsible for coordinating a prospective implementation program. Respondents acknowledged that the implementation of ACTs had been slow and that outdated medicines persistently remain available on the market. According to them, lessons learned should be used to inform prospective implementation strategies for TACTs.

Implementation programs should first of all inform retailers (e.g. pharmacists, shop owners, drug sellers) and prescribers (e.g. clinicians, nurses) about the implications of switching to TACTs. [“The professionals must be involved: the nurses, doctors, pharmacists.”–Policy maker 6, regulatory official, BF]. Not only do these retailers and prescribers deliver the drugs to patients, they are also responsible for information dissemination to patients. [“Who deploy the ACTs? The healthcare providers. So, you don’t neglect them.–Policy maker 2, national malaria policy official, NG]. Implementation programs should be transparent about the added benefits of TACTs in terms of delaying drug resistance and they should cover an extended period of time. [“The strategies to be used is what I’ve just said: advocacy, communication, mobilization, sensitization and you don’t limit it to just saying you’ve done it […]. It has to be continuous for a certain period of time.–Policy maker 5, national malaria policy official, NG].

Another component of an implementation strategy would be information campaigns to inform the general population. Several tools to convey the message were proposed, including radio, television, billboards, and social media channels. Posters in pharmacies were suggested as another, more targeted, way to notify malaria patients. [“The population must not be left behind, they are the target, they must be informed. They must be informed through the different channels: radio, TV, billboards.”–Supplier 20, private sector wholesaler, BF]. Involving religious organizations and community leaders was suggested to convey the message to hard-to-reach populations. Moreover, it was deemed important to adapt information campaigns in order to reach illiterate populations. Implementation strategies should aim for early stage sensitizing and informing the population about the appropriate use of TACTs.

Public sector distribution

Policy makers and suppliers in Nigeria and Burkina Faso did not predict significant challenges for integrating TACTs in public sector distribution chains. Adoption of TACTs by global and national policy-, and donor organizations was considered a decisive factor to the public sector uptake of TACTs. [“The commodities in the public sector is mainly determined by the support from donors. And the donors procure this drug and supply it to the country. So the focus will need to be paid towards the donor.”–Policy maker 2, national malaria policy official, NG]. Respondents acknowledged that a transition to TACTs would require adaptations in importing, procurement and distribution practices, which would be relatively straightforward because public sector forecasting and stock-taking procedures for antimalarial therapies have been well-established.

Respondents expressed that there are no financial incentives for public-sector actors to deviate from guidelines, in contrast to the private sector. Some respondents mentioned that introducing TACTs in the public sector may even be an effective strategy to promote TACTs uptake in the private sectors. [“The acceptance in the public setting is what dictates the acceptance in the private.–Supplier 14, public sector wholesaler, NG]. In Burkina Faso, several suppliers emphasized the role of the Centre d’Achat des Médicaments Essentiels Génériques (CAMEG) for public sector introduction of TACTs. The CAMEG is a public organization that dictates the public sector procurement and distribution of medicines in Burkina Faso. The CAMEG exclusively focuses on the deployment of generic therapies and therefore it was suggested that TACTs should be introduced under the conditions of generic drugs rather than as a branded proprietary drug. [“The antimalarial drugs in the public sector are essentially generics, unlike the private sector where we have the specialized drugs.”–Supplier 12, public sector clinician, BF].

Private sector distribution

In comparison to the public sector equivalent, more challenges were anticipated for integrating TACTs in private sector distribution channels in Nigeria and Burkina Faso. Private sector stocking decisions are usually based on patient demand and profit motives rather than treatment guidelines. [“Firms go for customer satisfaction. They probe to see how the patient can be satisfied.”–Policy maker 6, regulatory official, BF]. Policy makers and suppliers stressed that, once introduced, TACTs will have to compete with alternative therapies in the private sector markets. They were skeptical whether mitigating the risk of resistance would be a sufficient reason for the private sector to engage in TACTs as long as further market regulation remains absent. [“Why would a profit maker go and procure what is unlikely to sell?–Policy maker 2, national malaria policy official, NG]. Enhancing market regulation practices, financial rewards for prescribers, and artificial stimulation of demand were proposed as strategies to engage private sector actors into a transition to TACTs. An example of artificial demand stimulation would be subsidies in the early stages of deploying TACTs.

Policy makers and suppliers considered an instant transition to TACTs in the private sector unrealistic in terms of adapting importation, procurement and supply procedures. [“We just need some time to sell off the old stock.–Supplier 1, private sector wholesaler, BF]. Many wholesalers and retailers in Nigeria and Burkina Faso have invested in contracts with providers higher up in the supply chain. They advocated for a transition period in which TACTs are gradually implemented while ACTs are simultaneously phased out. This was considered a more viable strategy because it would allow them to clear their existing stocks and pending orders. Since most antimalarial drugs have a shelf-life of three years, a three-year period was proposed as an appropriate transition period by one supplier. Other suppliers disagreed with the necessity of a transition period stating that people will not be interested in TACTs as long as ACTs are still available on the market and therefore they preferred a direct removal of ACTs. [“If the other one stays, there is a chance that there will be resistance. In order to protect the TACTs, the ACTs must first be removed.”–Supplier 13, private sector clinician, BF].

Retail and prescription

Several respondents anticipated challenges in engaging retailers and prescribers as long as TACTs are not clinically superior to ACTs and as long as alternative antimalarials remain available on the market. Some suppliers expressed that retailers and prescribers had been overlooked in the transition from monotherapies to ACT and this had contributed to limited compliance at the time. The continuing availability of chloroquine in both countries was given as an example of the ongoing challenges.

Several policy makers and suppliers mentioned that retailers and prescribers are not always aware of the risks and implications of drug resistance, which could affect negatively their preparedness to switch to TACTs. Hence, training programs were considered essential in the early stages of deploying TACTs. These training programs should be clear and transparent about the risks of resistance and the potential benefits of TACTs. [“Prescribers must be trained and informed about the added value and the reasons for the change.”–Supplier 6, public sector wholesaler, BF]. Conferences and educational programs were also considered suitable platforms to inform and engage prescribers and retailers. Positive experiences from other settings such as Southeast Asia could be a boost to the perceived credibility of TACTs. It was also suggested that prescribers and retailers should be given elaborate information about dosing and side-effects of TACTs, because they are responsible for further dissemination of such information to patients and caregivers. Some suppliers and end-users were concerned that private sector retailers will adjust their prices once demand for TACTs would increase.

Affordability

Cost-issues were considered important for a successful transition to TACTs by all respondent groups in Nigeria and Burkina Faso. [“If you come with prices like 15000 f a box, people will leave you and your drug.—Policy maker 1, principal malaria researcher, BF]. Several policy makers and suppliers argued that TACTs should be introduced for subsidized prices because production prices would probably be too high for many patients. Subsidies were also considered a requirement to effectively compete with ACTs and chloroquine. One policy maker stated that, once affordability for TACTs is ensured, all other acceptance issues will follow. Others argued that price is not the most important determinant for effective medication of a life-threatening disease. [“If the drug is really effective according to them, if it is really effective, whatever the price, they pay to be liberated. Health is priceless.”–Policy maker 8, regional malaria policy official, BF].

Respondents agreed that prices of TACTs should not exceed those of present ACTs, indicating patients will tend to go for the cheapest option. [“If the price is slightly ahead of the current ACT, sir, it is dead on arrival.–Policy maker 10, regional malaria policy official, NG]. One supplier contrasted this view, claiming that low prices of TACTs may be perceived as an indicator of limited quality and may therefore foster distrust. End-users did not consider costs as the main determinant for their willingness to adopt TACTs, and are prepared to pay more if the drug has a reputation of high efficacy and limited side-effects. [“Money is not the most important thing because what we are really interested in is the well-being of our children and ourselves.–End-user FGD 2, community member, NG].

Acceptance

In addition to clinical efficacy and affordability, all respondent groups highlighted that side-effects can be a potential barrier to TACTs uptake. In particular nausea and vomiting were mentioned as undesirable side-effects that could negatively affect acceptability. These side-effects are especially associated with amodiaquine and therefore some suppliers voiced their preferences for TACTs without this drug compound. [“I take an example: artesunate-amodiaquine, these are combination therapies that were used at one time but very quickly it was realized that people were not tolerating the side effects and then we switched to artemether-lumefantrine.”–Supplier 7, public sector wholesaler BF]. Other suppliers and most end-users claimed that side effects are an integral aspect of antimalarial therapies. Mild nausea would not prevent end-users from engaging in TACTs and they argued that medication exists for mitigating most side-effects. Respondents emphasized that side-effects are acceptable as long as TACTs are effective and affordable. [“If I am going to be taking that, it is my own best interest. When it works fast then there is no problem about that at all.–End-user FGD 1, community member, NG].

Other acceptance issues raised were: tablet size and shape, taste, and the number of pills. For all these acceptance issues, the current ACT treatment regime was given as a benchmark: new drugs should not be more expensive, should not cause more side-effects, should not contain more pills and should not have a more bitter taste than ACTs. [“As far as taste is concerned, it shouldn’t be too bitter and the size should be the same as what it is present.”–End-user FGD 2, community member BF]. Finally, respondents suggested that branding and attractive packaging could positively affect community attitudes towards TACTs.

Discussion and conclusions

The goal of the study was to explore market readiness for a transition to TACTs in African countries by exploring stakeholders’ perceptions. A qualitative study was conducted in Nigeria and Burkina Faso and comprised in-depth interviews and FGDs with key actor groups at different levels of the antimalarial innovation system. A number of barriers and enablers towards deploying TACTs emerged from the data. The study revealed that the market prospects of TACTs in Nigeria and Burkina Faso will depend on the demonstration of the added value of TACT over ACTs. National decision makers are unlikely to initiate a transition to TACTs in order to mitigate the risk of drug resistance. Instead, they will await endorsement by global institutes, in particular the World Health Organization (WHO), and funding decisions by international donors such as the Global Fund to fight Aids, Tuberculosis and Malaria (GFATM). This implies that these global-level institutes have a major responsibility in navigating the global fight against drug-resistant malaria. They should consider proactive changes to treatment policies to prevent similar delays in global coordination as those encountered during the transition to ACTs in the early 2000s [29]. This is all the more relevant now that genetic markers of artemisinin resistance have been observed in Rwanda, Uganda and Tanzania [20, 3035] while inadequate efficacy of artemether-lumefantrine, the most commonly used antimalarial in Africa and elsewhere, was recently reported in Angola and Burkina Faso [3638]. These findings imply an urgent need to identify and develop alternative treatment options.

At the national levels, several barriers were raised that would affect the market prospects for TACTs in Nigeria and Burkina Faso. Respondents referred to lengthy regulatory and implementation procedures [18, 19, 39] and the ongoing challenges with regards to the private sector markets for antimalarial therapies [4042]. In particular the persistent demand for chloroquine and over the counter prescription of antimalarial therapies were repeatedly mentioned. The limited (private sector) compliance to first-line therapies and the widespread availability of substandard, outdated or even counterfeit drugs has been reported in several African settings by the ACTwatch group [40, 4345]. In this context of suboptimal treatment practices, it is warranted to question whether scarce resources should be dedicated to a transition to TACTs [15, 16] or rather be invested in improving current malaria management practices [46, 47]. From a health-economic perspective, investing in mitigating the risk of resistance seems justified, as the costs of a drug transition is unlikely to exceed the costs that would be provoked by artemisinin and partner drug resistance [8, 20, 48]. Further mathematical modeling and feasibility studies are required to determine if TACTs in Africa are indeed the optimal way forward to address the threat of artemisinin and partner drug resistance.

Relatively few challenges towards implementing TACTs in public sector distribution channels were identified, under the assumption of support by policy makers and donor funders. This aligns with other studies that have demonstrated that public distribution channels are relatively adaptive for new generations of antimalarial therapies [43, 49]. More challenges were expected for engaging private sector stakeholders in a transition to TACTs. In these private sector channels, TACTs will have to compete with alternative treatments on the market and switching to TACTs can be perceived as misaligned with profit motives of distributors, retailers and prescribers. Similar private sector challenges have previously been reported for innovative therapies for malaria [50] and other poverty-related diseases [5153] under the pressure of drug resistance. Proposed solutions from the literature include intensified market regulation [49, 52] and increased investments in private sector subsidy arrangements [41, 42, 48].

Several affordability and acceptance issues for TACTs were raised, for which current ACTs were suggested as a benchmark. Respondents advised that TACTs should not be more expensive, cause more side-effects, contain more pills and have a more bitter taste than ACTs. Furthermore, information campaigns should be transparent on the motives and the rationale of a prospective switch to TACTs. In previous studies, adoption decisions by malaria patients have been associated mostly with the availability of a particular therapy [54, 55]. Our study adds to the limited knowledge on factors that affect the actual acceptance of innovative antimalarial therapies [56].

The innovation systems approach was applied to study the feasibility of a transition to TACTs in Nigeria and Burkina Faso. This approach has become a well-established analytical tool in transition studies for generating insight into innovation barriers and defining policy implications accordingly [57]. Similar systemic perspectives have increasingly been applied in addressing (global) health challenges and have been valued for their integral perspective and their explanatory power [26, 5860]. The innovation systems approach has particularly been applied for understanding sustainability transitions where complex trade-offs need to be made between short-term investment and long-term benefits. This is exactly the case for TACTs in Africa, where investments (national governments, individual patients) and benefits (entire malaria world, future patients) are not well-aligned [23]. The systemic approach demonstrated a complex set of links, relations and interdependencies between actors, networks and institutions. For example, engagement by global and national decision makers is required for a transition to TACTs but it is not sufficient if prescribers and patients reject the use of TACTs. Similarly, positive attitudes from end-users will not be relevant unless well-functioning distribution channels are established.

The innovation systems approach indicates that a transition to TACTs would demand collective actions at all levels of the anti-malarial innovation system (e.g. at the level of development, diffusion and actual deployment) [22]. Moreover, the introduction of TACTs would require alignment with the financial, regulatory and other institutional frameworks that are prevalent for innovative antimalarial therapies. Addressing these multi-faceted issues is complex and requires strong policy coordination and systemic tools and roadmaps [6164].

Way forward

We presented a pilot study to assess the feasibility of a transition to TACTs in two African countries. Several barriers and enablers towards deploying TACTs were found in Nigeria and Burkina Faso, which can be used to inform strategic decision-making in the battle against drug-resistant malaria. Although some of these insights may be applicable to other settings, the generalizability of this study is limited. African countries are heterogeneous in nature and they are characterized by different healthcare systems. Therefore, similar bottom-up studies on the feasibility of deploying TACTs are required in other African settings. Such studies should be prioritized in countries reporting artemisinin resistance and/or ACT failure and countries with increased risk of resistance due to their geographic location or epidemiological situation. Moreover, the situation of drug resistance is evolving and ACT failure was not yet confirmed in Africa by the time of data collection. The recent increased reporting of artemisinin resistance and ACT failure in Africa might change important determinants of the market readiness for TACTs.

Although this study focused on country-level dynamics, the actual prospects of deploying TACTs are to a large extent determined by global decision makers such as the WHO, international funders like GFATM and support from the Medicines for Malaria Venture (MMV) in coordinating drug development. In addition, the pharmaceutical industry plays a central role, and will be required to translate the concept of TACTs into end-products and to ensure its production in sufficient quantities. Encouraging are the successes that have been achieved in the past: a supportive global landscape for the development and deployment of new antimalarial therapies is now well-established [22]. We can draw from these experiences in terms of product-development partnerships, funding mechanisms, regulatory arrangements and intellectual property management. This will, however, require early sensitizing and engagement with global-level policy makers, pharmaceutical industry, and other stakeholders.

Finally, although the study provides insight into factors that are likely to affect the introduction of TACTs in two African countries, it does not provide final answers on whether TACTs should be introduced in Africa. A further rapid increase in artemisinin resistance in African countries would change many of the scenarios described in this study, and would render TACTs one of the last remaining treatment options for multidrug-resistant falciparum malaria. Also, further clinical, health-economic and feasibility studies are required to build an evidence base to inform decision makers on the implications of deploying TACTs to delay or prevent artemisinin resistance and/or ACT failure. Such studies are now underway within the Development of Triple Artemisinin Combination Therapies (DeTACT) project [15] which combines clinical, mathematical modeling, ethical and market positioning research.

Supporting information

S1 File. Interview guides in English and French.

https://doi.org/10.1371/journal.pone.0256567.s001

(ZIP)

Acknowledgments

We thank the interviewees for their valuable input.

References

  1. 1. WHO. WHO briefing on Malaria Treatment Guidelines and artemisinin monotherapies. Geneva; 2006. http://apps.who.int/malaria/docs/Meeting_briefing19April.pdf
  2. 2. Amaratunga C, Lim P, Suon S, Sreng S, Mao S, Sopha C, et al. Dihydroartemisinin-piperaquine resistance in plasmodium falciparum malaria in Cambodia: a multisite prospective cohort study. Lancet Infect Dis. 2016;16: 139–148. pmid:26559481
  3. 3. Phyo AP, Ashley EA, Anderson TJC, Bozdech Z, Carrara VI, Sriprawat K, et al. Declining Efficacy of Artemisinin Combination Therapy Against P. Falciparum Malaria on the Thai-Myanmar Border (2003–2013): The Role of Parasite Genetic Factors. Clin Infect Dis. 2016;63: 784–791. pmid:27313266
  4. 4. van der Pluijm RW, Imwong M, Chau NH, Hoa NT, Thuy-nhien NT, Thanh NV, et al. Articles Determinants of dihydroartemisinin-piperaquine treatment failure in Plasmodium falciparum malaria in Cambodia, Thailand, and Vietnam: a prospective clinical, pharmacological, and genetic study. Lancet. 2019;3099. pmid:31345710
  5. 5. Mairet-Khedim M, Leang R, Marmai C, Khim N, Kim S, Ke S, et al. Clinical and In Vitro Resistance of Plasmodium falciparum to Artesunate-Amodiaquine in Cambodia. Clin Infect Dis. 2020; 1–8. pmid:32459308
  6. 6. WHO. World malaria report 2019. WHO Reg Off Africa. Geneva; 2019.
  7. 7. WHO. Report on antimalarial drug efficacy, resistance and response 10 years of surveillance (2010–2019). Geneva; 2020.
  8. 8. Lubell Y, Dondorp A, Guerin PJ, Drake T, Meek S, Ashley E, et al. Artemisinin resistance-modelling the potential human and economic costs. Malar J. 2014;13. pmid:24401153
  9. 9. Wells TNC, Van Huijsduijnen RH, Van Voorhis WC. Malaria medicines: A glass half full? Nat Rev Drug Discov. 2015;14: 424–442. pmid:26000721
  10. 10. Burrows JN, Duparc S, Gutteridge WE, Hooft Van Huijsduijnen R, Kaszubska W, Macintyre F, et al. New developments in anti-malarial target candidate and product profiles. Malar J. 2017;16: 1–29. pmid:28049519
  11. 11. Ashley EA, Phyo AP. Drugs in Development for Malaria. Drugs. 2018;78: 861–879. pmid:29802605
  12. 12. Boni MF, White NJ, Baird JK. The Community As the Patient in Malaria-Endemic Areas: Preempting Drug Resistance with Multiple First-Line Therapies. PLoS Med. 2016;13: 1–7. pmid:27022739
  13. 13. Dondorp AM, Smithuis FM, Woodrow C, Seidlein L von. How to Contain Artemisinin- and Multidrug-Resistant Falciparum Malaria. Trends Parasitol. 2017;33: 353–363. pmid:28187990
  14. 14. Phyo AP, Von Seidlein L. Challenges to replace ACT as first-line drug. Malar J. 2017;16: 1–5. pmid:28049519
  15. 15. van der Pluijm RW, Amaratunga C, Dhorda M, Dondorp AM. Triple Artemisinin-Based Combination Therapies for Malaria–A New Paradigm? Trends Parasitol. 2021;37: 15–24. pmid:33060063
  16. 16. White N. Triple ACT should be implemented now to delay the emergence of resistance. Malar J. 2019;18. https://doi.org/10.1186/s12936-019-2955-z pmid:30670020
  17. 17. van der Pluijm RW, Tripura R, Hoglund RM, Pyae Phyo A, Lek D, ul Islam A, et al. Triple artemisinin-based combination therapies versus artemisinin-based combination therapies for uncomplicated Plasmodium falciparum malaria: a multicentre, open-label, randomised clinical trial. Lancet. 2020;395: 1345–1360. pmid:32171078
  18. 18. Amin AA, Zurovac D, Kangwana BB, Greenfield J, Otieno DN, Akhwale WS, et al. The challenges of changing national malaria drug policy to artemisinin-based combinations in Kenya. Malar J. 2007;6: 1–11. pmid:17204149
  19. 19. Bosman A, Mendis KN. A major transition in malaria treatment: The adoption and deployment of artemisinin-based combination therapies. Am J Trop Med Hyg. 2007;77: 193–197. pmid:18165492
  20. 20. Mulligan JA, Mandike R, Palmer N, Williams H, Abdulla S, Bloland P, et al. The costs of changing national policy: Lessons from malaria treatment policy guidelines in Tanzania. Trop Med Int Heal. 2006;11: 452–461. pmid:16553928
  21. 21. Yadav P. Countering Drug Resistance in the Developing World: An Assessment of Incentives across the Value Chain and Recommendations for Policy Interventions. CGD Work Pap. 2009;183.
  22. 22. de Haan F, Moors EHM, Dondorp AM, Boon WPC. Market Formation in a Global Health Transition. Environ Innov Soc Transitions. 2021;40: 40–59.
  23. 23. Tindana P, de Haan F, Amaratunga C, Dhorda M, van der Pluijm RW, Dondorp AM, et al. Deploying triple artemisinin ‑ based combination therapy (TACT) for malaria treatment in Africa: ethical and practical considerations. Malar J. 2021; 1–7. pmid:33386070
  24. 24. Yin RK. Case Study Research, Design and Methods. 5th ed. SAGE publications; 2003.
  25. 25. Edquist C. Systems of innovation: Technologies, institutions and organizations. de la Mothe J, editor. Long Range Planning. Abington: Routledge Taylor & Francin Group; 1997. https://doi.org/10.1016/s0024-6301(98)90244-8
  26. 26. Moors EHM, Kukk Fischer P, Boon WPC, Schellen F, Negro SO. Institutionalisation of markets: The case of personalised cancer medicine in the Netherlands. Technol Forecast Soc Change. 2018;128: 133–143.
  27. 27. Fereday J, Muir-Cochrane E. Demonstrating Rigor Using Thematic Analysis: A Hybrid Approach of Inductive and Deductive Coding and Theme Development. Int J Qual Methods. 2006;5: 80–92.
  28. 28. Tindana P, Haan F De, Mokuolu OA, Guissou R, Bolarinwa OA, Ouedraogo JB, et al. Ethical, Regulatory and Market related aspects of Deploying Triple Artemisinin-Based Combination Therapies for Malaria treatment in Africa: A study protocol. Wellcome Open Res. 2021;6:75: 1–8. pmid:33954265
  29. 29. Attaran A, Barnes KI, Curtis C, D’Alessandro U, Fanello CI, Galinski MR, et al. WHO, the global fund and medical malpractice in malaria treatment. Lancet. 2004;363: 273–40.
  30. 30. Uwimana A, Legrand E, Stokes BH, Ndikumana JLM, Warsame M, Umulisa N, et al. Emergence and clonal expansion of in vitro artemisinin-resistant Plasmodium falciparum kelch13 R561H mutant parasites in Rwanda. Nat Med. 2020;26: 1602–1608. pmid:32747827
  31. 31. Bwire GM, Ngasala B, Mikomangwa WP, Kilonzi M, Kamuhabwa AAR. Detection of mutations associated with artemisinin resistance at k13-propeller gene and a near complete return of chloroquine susceptible falciparum malaria in Southeast of Tanzania. Nat Res. 2020;10: 1–7. pmid:32103124
  32. 32. Uwimana A, Umulisa N, Venkatesan M, Svigel SS, Zhou Z, Munyaneza T, et al. Association of Plasmodium falciparum kelch13 R561H genotypes with delayed parasite clearance in Rwanda: an open-label, single-arm, multicentre, therapeutic efficacy study. Lancet Infect Dis. 2021. pmid:33864801
  33. 33. Kayiba NK, Yobi DM, Tshibangu-Kabamba E, Tuan VP, Yamaoka Y, Devleesschauwer B, et al. Spatial and molecular mapping of Pfkelch13 gene polymorphism in Africa in the era of emerging Plasmodium falciparum resistance to artemisinin: a systematic review. Lancet Infect Dis. 2021;21: 82–92. pmid:33125913
  34. 34. Asua V, Conrad MD, Aydemir O, Duvalsaint M, Legac J, Duarte E, et al. Changing Prevalence of Potential Mediators of Aminoquinoline, Antifolate, and Artemisinin Resistance across Uganda. J Infect Dis. 2021;223: 985–994. pmid:33146722
  35. 35. Bergmann C, Loon W Van, Habarugira F, Tacoli C, Jäger JC, Savelsberg D, et al. Increase in Kelch 13 Polymorphisms in Plasmodium. Emerg Infect Dis. 2021;27: 5–7. pmid:33350925
  36. 36. Dimbu PR, Horth R, Cândido ALM, Ferreira CM, Caquece F, Garcia LEA, et al. Continued low efficacy of artemether-lumefantrine in Angola in 2019. Antimicrob Agents Chemother. 2021;65: 1–7. pmid:33168604
  37. 37. Gansané A, Moriarty LF, Ménard D, Yerbanga I, Ouedraogo E, Sondo P, et al. Anti-malarial efficacy and resistance monitoring of artemether-lumefantrine and dihydroartemisinin-piperaquine shows inadequate efficacy in children in Burkina Faso, 2017–2018. Malar J. 2021;20: 1–12. pmid:33386070
  38. 38. Rasmussen C, Ringwald P. Is there evidence of anti ‑ malarial multidrug resistance in Burkina Faso? Malar J. 2021; 1–5. pmid:33386070
  39. 39. Williams HA, Durrheim D, Shretta R. The process of changing national malaria treatment policy: Lessons from country-level studies. Health Policy Plan. 2004;19: 356–370. pmid:15459161
  40. 40. Newton PN, Hanson K, Goodman C. Do anti-malarials in Africa meet quality standards? The market penetration of non quality-assured artemisinin combination therapy in eight African countries. Malar J. 2017;16: 204. pmid:28539125
  41. 41. Palafox B, Patouillard E, Tougher S, Goodman C, Hanson K, Kleinschmidt I, et al. Prices and mark-ups on antimalarials: Evidence from nationally representative studies in six malaria-endemic countries. Health Policy Plan. 2016;31: 148–160. pmid:25944705
  42. 42. Tougher S, Hanson K, Goodman C. What happened to anti-malarial markets after the Affordable Medicines Facility-malaria pilot? Trends in ACT availability, price and market share from five African countries under continuation of the private sector co-payment mechanism. Malar J. 2017;16. pmid:28056979
  43. 43. O’Connell KA, Gatakaa H, Poyer S, Njogu J, Evance I, Munroe E, et al. Got ACTs? Availability, price, market share and provider knowledge of anti-malarial medicines in public and private sector outlets in six malaria-endemic countries. Malar J. 2011;10: 326. pmid:22039838
  44. 44. Palafox B, Patouillard E, Tougher S, Goodman C, Hanson K, Kleinschmidt I, et al. Understanding private sector antimalarial distribution chains: A cross-sectional mixed methods study in six malaria-endemic countries. PLoS One. 2014;9. pmid:24699934
  45. 45. Shewchuk T, O’Connell KA, Goodman C, Hanson K, Chapman S, Chavasse D. The ACTwatch project: Methods to describe anti-malarial markets in seven countries. Malar J. 2011;10: 1–9. pmid:21214892
  46. 46. Krishna S. Triple artemisinin-containing combination anti-malarial treatments should be implemented now to delay the emergence of resistance: the case against. Malar J. 2019;18. pmid:30670020
  47. 47. Wang J, Xu C, Wong YK, Ma N, Liao FL, Jiang T, et al. Triple artemisinin-based combination therapies for malaria: proceed with caution. Lancet. 2020;396: 1976.
  48. 48. Arrow KJ, Panosian CB, Gelband H, Health G. Saving Lives, Buying Time: Economics of Malaria Drugs in an Age of Resistance. Washington DC: National Academies Press; 2004. https://doi.org/10.17226/11017 pmid:25009879
  49. 49. Novotny J, Singh A, Dysoley L, Sovannaroth S, Rekol H. Evidence of successful malaria case management policy implementation in Cambodia: results from national ACTwatch outlet surveys. Malar J. 2016;15. pmid:26743539
  50. 50. Littrell M, H. G, I. E, S. P, J. N, T. SS, et al. Monitoring fever treatment behaviour and equitable access to effective medicines in the context of initiatives to improve ACT access: Baseline results and implications for programming in six African countries. Malar J. 2011;10: no pagination. pmid:21235783
  51. 51. Sullivan T, Ben Amor Y. Global Introduction of New Multidrug-Resistant Tuberculosis Drugs-Balancing Regulation with Urgent Patient Needs. Emerg Infect Dis. 2016;22. pmid:26889711
  52. 52. Sheikh K, Uplekar M. What Can we Learn About the Processes of Regulation of Tuberculosis Medicines From the Experiences of Health Policy and System Actors in India, Tanzania, and Zambia? Int J Heal Policy Manag. 2016;5: 403–415. pmid:27694668
  53. 53. Sunyoto T, Potet J, Den Boer M, Ritmeijer K, Postigo JAR, Ravinetto R, et al. Exploring global and country-level barriers to an effective supply of leishmaniasis medicines and diagnostics in eastern Africa: A qualitative study. BMJ Open. 2019;9: 1–14. pmid:31273011
  54. 54. Alba S, Hetzel MW, Goodman C, Dillip A, Liana J, Mshinda H, et al. Improvements in access to malaria treatment in Tanzania after switch to artemisinin combination therapy and the introduction of accredited drug dispensing outlets—A provider perspective. Malar J. 2010;9: 1–15. pmid:20043863
  55. 55. Ajayi IO, Falade CO, Olley BO, Yusuf B, Gbotosho S, Iyiola T, et al. A qualitative study of the feasibility and community perception on the effectiveness of artemether-lumefantrine use in the context of home management of malaria in south-west Nigeria. BMC Health Serv Res. 2008;8: 1–13. pmid:18173837
  56. 56. Smith LA, Jones C, Meek S, Webster J. Review: Provider practice and user behavior interventions to improve prompt and effective treatment of malaria: Do we know what works? Am J Trop Med Hyg. 2009;80: 326–335. pmid:19270276
  57. 57. Hekkert MP, Suurs RAA, Negro SO, Kuhlmann S, Smits REHM. Functions of innovation systems: A new approach for analysing technological change. Technol Forecast Soc Change. 2007;74: 413–432.
  58. 58. Atun R. Health systems, systems thinking and innovation. Health Policy Plan. 2012;27: 4–8. pmid:23014152
  59. 59. Adam T, De Savigny D. Systems thinking for strengthening health systems in LMICs: Need for a paradigm shift. Health Policy Plan. 2012;27: 2006–2008. pmid:23014149
  60. 60. Peters DH. The application of systems thinking in health: Why use systems thinking? Health Qual Life Outcomes. 2014;12: 1–6. pmid:24382363
  61. 61. Boon WPC, Edler J, Robinson DKR. Market formation in the context of transitions: A comment on the transitions agenda. Environ Innov Soc Transitions. 2020;34: 346–347.
  62. 62. Loorbach D, Frantzeskaki N, Avelino F. Sustainability Transitions Research: Transforming Science and Practice for Societal Change. Annu Rev Environ Resour. 2017;42: 599–626.
  63. 63. Hekkert M, Negro S, Heimeriks G, Harmsen R. Technological Innovation System Analysis—a manual for analysts. Technol Innov Syst Anal. 2011.
  64. 64. Moors EHM, Cohen AF, Schellekens H. Towards a sustainable system of drug development. Drug Discov Today. 2014;19: 1711–1720. pmid:24657626