Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

What are the impacts of increasing cost-effectiveness Threshold? a protocol on an empirical study based on economic evaluations conducted in Thailand

  • Wanrudee Isaranuwatchai ,

    Roles Conceptualization, Funding acquisition, Methodology, Writing – original draft, Writing – review & editing

    wanrudee.i@hitap.net

    Affiliations Health Intervention and Technology Assessment Program (HITAP), Ministry of Public Health, Nonthaburi, Thailand, Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Canada

  • Ryota Nakamura,

    Roles Methodology, Writing – original draft, Writing – review & editing

    Affiliation Hitotsubashi Institute for Advanced Study and Graduate School of Economics, Hitotsubashi University, Tokyo, Japan

  • Hwee Lin Wee,

    Roles Methodology, Writing – review & editing

    Affiliation Saw Swee Hock School of Public Health, National University of Singapore, Singapore, Singapore

  • Myka Harun Sarajan,

    Roles Data curation, Writing – original draft

    Affiliation Health Intervention and Technology Assessment Program (HITAP), Ministry of Public Health, Nonthaburi, Thailand

  • Yi Wang,

    Roles Methodology, Writing – original draft, Writing – review & editing

    Affiliation Saw Swee Hock School of Public Health, National University of Singapore, Singapore, Singapore

  • Budsadee Soboon,

    Roles Data curation, Project administration, Writing – review & editing

    Affiliation Health Intervention and Technology Assessment Program (HITAP), Ministry of Public Health, Nonthaburi, Thailand

  • Jing Lou,

    Roles Data curation, Writing – review & editing

    Affiliation Saw Swee Hock School of Public Health, National University of Singapore, Singapore, Singapore

  • Jia Hui Chai,

    Roles Data curation, Writing – review & editing

    Affiliation Saw Swee Hock School of Public Health, National University of Singapore, Singapore, Singapore

  • Wannisa Theantawee,

    Roles Data curation, Writing – review & editing

    Affiliations Food and Drug Administration (FDA), Ministry of Public Health, Nonthaburi, Thailand, Subcommittee for Development of the National List of Essential Medicines (NLEM), Bangkok, Thailand

  • Jutatip Laoharuangchaiyot,

    Roles Data curation, Writing – review & editing

    Affiliations Food and Drug Administration (FDA), Ministry of Public Health, Nonthaburi, Thailand, Subcommittee for Development of the National List of Essential Medicines (NLEM), Bangkok, Thailand

  • Thanakrit Mongkolchaipak,

    Roles Data curation, Writing – review & editing

    Affiliations Food and Drug Administration (FDA), Ministry of Public Health, Nonthaburi, Thailand, Subcommittee for Development of the National List of Essential Medicines (NLEM), Bangkok, Thailand

  • Thanisa Thathong,

    Roles Data curation, Project administration, Writing – review & editing

    Affiliations Food and Drug Administration (FDA), Ministry of Public Health, Nonthaburi, Thailand, Subcommittee for Development of the National List of Essential Medicines (NLEM), Bangkok, Thailand

  • Pritaporn Kingkaew,

    Roles Writing – review & editing

    Affiliation Health Intervention and Technology Assessment Program (HITAP), Ministry of Public Health, Nonthaburi, Thailand

  • Kriang Tungsanga,

    Roles Conceptualization, Funding acquisition, Methodology, Supervision, Writing – original draft, Writing – review & editing

    Affiliations Subcommittee for Development of the National List of Essential Medicines (NLEM), Bangkok, Thailand, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand

  • Yot Teerawattananon

    Roles Conceptualization, Funding acquisition, Methodology, Supervision, Writing – original draft, Writing – review & editing

    Affiliations Health Intervention and Technology Assessment Program (HITAP), Ministry of Public Health, Nonthaburi, Thailand, Saw Swee Hock School of Public Health, National University of Singapore, Singapore, Singapore

Abstract

Background

Economic evaluations have been widely used to inform and guide policy-making process in healthcare resources allocation as a part of an evidence package. An intervention is considered cost-effective if an ICER is less than a cost-effectiveness threshold (CET), where a CET represents the acceptable price for a unit of additional health gain which a decision-maker is willing to pay. There has been discussion to increase a CET in many settings such as the United Kingdom and Thailand. To the best of our knowledge, Thailand is the only country that has an explicit CET and has revised their CET, not once but twice. Hence, the situation in Thailand provides a unique opportunity for evaluating the impact of changing CET on healthcare expenditure and manufacturers’ behaviours in the real-world setting. Before we decide whether a CET should be increased, information on what happened after the CET was increased in the past could be informative and helpful.

Objectives

This study protocol describes a proposed plan to investigate the impact of increased cost-effectiveness threshold using Thailand as a case study. Specifically, we will examine the impact of increasing CET on the drug prices submitted by pharmaceutical companies to the National List of Essential Medicine (NLEM), the decision to include or exclude medications in the NLEM, and the overall budget impact.

Materials and designs

Retrospective data analysis of the impact of increased CET on national drug committee decisions in Thailand (an upper middle-income country) will be conducted and included data from various sources such as literature, local organizations (e.g. Thai Food and Drug Administration), and inputs from stakeholder consultation meetings. The outcomes include: (1) drug price submitted by the manufacturers and final drug price included in the NLEM if available; (2) decisions about whether the drug was included in the NLEM for reimbursement; and (3) budget impact. The independent variables include a CET, the variable of interest, which can take values of THB100,000, THB120,000, or THB160,000, and potential confounders such as whether this drug was for a chronic disease, market size, and primary endpoint. We will conduct separate multivariable regression analysis for each outcome specified above.

Discussion

Understanding the impact of increasing the CET would be helpful in assisting the decision to use and develop an appropriate threshold for one’s own setting. Due to the nature of the study design, the findings will be prone to confounding effect and biases; therefore, the analyses will be adjusted for potential confounders and statistical methods will be explored to minimize biases. Knowledge gained from the study will be conveyed to the public through various disseminations such as reports, policy briefs, academic journals, and presentations.

Introduction

Economic evaluations have been widely used in high- and upper-middle income countries (LMICs) to inform and guide policy-making process in healthcare resources allocation as a part of an evidence package which includes other factors such as equity of access as well as technical and financial feasibility [1]. Economic evaluations compute the incremental cost and benefit of new health interventions compared to the standard of care, in the form of incremental cost-effectiveness ratio (ICER), frequently expressed as incremental cost per quality-adjusted life year (QALY) or incremental cost per disability-adjusted life year (DALY) averted [24]. An intervention is considered cost-effective if an ICER is less than a cost-effectiveness threshold (CET), where a CET represents the acceptable price for a unit of additional health gain for which decision-makers, on behalf of the society, are willing to pay [2]. In other words, a CET aims to enable separating interventions that offer good value-for-money from those that do not. This approach allows the same decision making rule applied across different types of health interventions and disease areas [5]. Although there has been a debate around an optimal CET and methodological choices for CET estimation [2,4,69], economic evaluation together with either implicit or explicit CETs have commonly been used in price negotiation or value-based pricing around the world [6,1014].

The use of a CET was first mentioned by United Kingdom’s (UK’s) National Institute for Health and Care Excellence (NICE) in 1999 [15]. In 2002, the Commission on Macroeconomics and Health launched by the World Health Organization (WHO) presented the concept of linking CET to 1–3 times of gross domestic product (GDP) per capita [16]. Since then, many published cost-effectiveness analyses (CEA) of health interventions in LMICs have explicitly referred to these WHO criteria as the standards by which each intervention is considered cost-effective [1720]. However, the use of GDP-guided CETs has been criticised and, recently, WHO recommendations were made not to use it in decision making [21]. Schwarzer et al. [11] conducted a global review and reported in 2015 that only England and Thailand are with explicitly defined CETs whereas Australia, Brazil, Canada, Sweden and the United States of America adopted implicit CETs. Furthermore, a few countries (e.g., Bhutan and Kenya) are working to identify the appropriate CET for their own country context [22].

During the past decades, although there are arguments that the CET is already too high in the UK [23,24], arguments have been made to increase CETs set by NICE [2427]. The same pressure to increase the CET has also been raised among clinical experts and manufacturers to policymakers in Thailand. For the UK, NICE employs a range of CETs set between £20,000 to £30,000 per QALY, and the CETs have not been changed since the NICE’s formation [15]. However, Thailand has revised their CET twice in the past, starting with THB100,000 per QALY in 2008, then increased to THB120,000 per QALY in 2010, and increased again in 2013 to THB160,000 (approximately USD5,000) per QALY. The first CET was set because the policymakers recognized the importance of CET and worked and deliberated with relevant stakeholders to define in 2008. The implementation of the CET led to the discussion that the CET may be too low (which was lower than 1 GDP per capita), and led to further discussion including finally a decision to increase to THB120,000. There was a research study to explore this topic [28], and used to partially to support the increase of CET to THB160,000 in 2013. Since then, there was constant pressure from stakeholders (e.g. industry and professional groups) to increase the threshold again including the recent request in 2019 which led to this study. These Thai CETs have been used to determine if a drug should be listed in the National List of Essential Medicine (NLEM) which is the only pharmaceutical reimbursement list in the country referred by all public health insurance schemes in Thailand NLEM [29]. The same CETs have also been used as benchmarks for listing non-pharmaceutical interventions in the Universal Healthcare Coverage Benefits Package (UCBP) [30]. Increasing CET would theoretically allow more drugs to be included, and subsequently increasing the overall budget impact including potentially influencing access to medicines in the country.

To the best of our knowledge, Thailand is the only country that has explicit CETs and has revised their CET, not once but twice. Further, no empirical study was conducted when the CET was revised in the past. Therefore, the situation in Thailand provides a unique opportunity with empirical dataset for evaluating the impact of changing CET. This information will be vital before deciding whether a CET should be altered in Thailand as well as other setting using CEA information to inform policy decisions. This study protocol describes a proposed plan to investigate the impact of increased CETs using Thailand as a case study. Specifically, we will examine the consequences of increasing CETs on the new medicine prices submitted by pharmaceutical companies to the NLEM, the decision to include or exclude new medications in the NLEM, and the reimbursed medicine budget of the Thai government. Understanding the impact of increasing the threshold would be helpful in assisting the decision to use and develop an appropriate threshold for one’s own setting.

Conceptual framework

The following framework aims to help situate possible scenarios of what could happen if a CET were to be increased. In general, a higher CET may affect the drug prices submitted, the opportunity that drugs will be included in a national list of essential medicine, and budget impact of the reimbursable medicines (Fig 1). There may also be an impact on access to medications and overall population health. Although the long-term impact is outside the scope of this study, these ultimate outcomes (access to medications and overall population health) were added to share a comprehensive view of the framework and were not explored in this study.

thumbnail
Fig 1. Framework of possible scenarios when a cost-effectiveness threshold increases.

https://doi.org/10.1371/journal.pone.0274944.g001

Specifically, we considered two extreme scenarios with many possible situations in between. On one end is an extreme scenario with desirable outcomes (ideal scenario) which would imply that everyone acted appropriately and did not take unfair advantage when a CET increases. The other extreme scenario is with undesirable outcomes (problematic scenario) which would happen if relevant stakeholders were to take advantage unfairly when a CET is increased. The real-world outcomes of changing CET could be somewhere between the ideal and the problematic scenarios. Certainly, there are many possible scenarios. The framework is meant to be an overall guide and indicates that the actual scenario will be somewhere in the middle between the two extreme (problematic and ideal) scenarios.

In the ideal scenario with desirable outcomes, a higher CET would not affect the new drug prices submitted by manufacturers because the drug prices will be set based on, for example, the production cost regardless of the national CET. A higher CET may increase both the probability that drugs will be included in the NLEM along with the overall budget impact as more drugs will be considered cost-effective. With these three influences, accessibility to necessary medicines by the needed patients would increase and ultimately improve overall population health.

On the other hand, in the problematic scenario, a higher CET could encourage manufacturers to submit higher new drug prices to NLEM in order to maximise their profits. The probability that drugs will be included in the country’s list of essential medicines could increase, remain the same or decrease, depending on the response (prices submitted) from the manufacturers. Nevertheless, the medicine budget would be higher as the CET is higher. Ultimately, the access to medications and overall population health will be negatively affected due to inappropriate use of limited resources.

Materials and methods

Study design and setting

Retrospective data analysis of the impact of increased CET on the national drug committee’s decisions in Thailand (an upper middle-income country) will be conducted and will include data from various sources as described below.

Variables

Fig 2 shows the relationship among dependent variables and independent variable, including variable of interest and confounders, to be used in the analysis.

Dependent variables.

There are three dependent variables which we will explore: (1) drug price (i.e., we will consider drug price submitted to NLEM by the manufacturers and, if available, final (negotiated) drug price included in the NLEM); (2) decisions (i.e. whether the drug was included in or rejected from the NLEM); and (3) the total (i.e. estimated and actual) budget for each reimbursable drug under the UHC scheme. The variable for drug price will be treated as a continuous variable, and we will conduct two separated models, one for submitted price by the manufacturer, and the other for negotiated price. Decision variable is a categorical variable capturing whether this drug was included in the NLEM. The estimated and actual budget variables are continuous where the estimated budget was the amount of budget impact reported in the study, whereas the actual budget impact was reported from the Price Negotiation Working Group (after negotiation process).

Independent variable: Variable of interest.

The independent variable is a CET (categorical variable) which can take the value of THB100,000 (for drug submissions in year 2008–2010), THB120,000 (for submissions in year 2010–2013), or THB160,000 (for drug submissions from 2013 to 2021). As described above, a CET represents the acceptable price for a unit of additional health gain for which decision-makers, on behalf of the society, are willing to pay. From an initial review, there were 48 drug submission over the study period with a total of 267 studies (where one submission may have more than one indication and subsequently more than one study). In 3 periods for CET of THB100,000, THB120,000, and THB160,000, there were 60 studies, 56 studies, and 151 studies, respectively.

Independent variables: Confounders.

Potential confounders can be categorized into the following 6 groups: (1) general information; (2) clinical value; (3) indication details; (4) disease information; (5) economic evidence; and (6) others. General information consists of the generic name of the drug submitted to the NLEM, the comparator of the drug in the study, the indication of use of the drug, as well as the year and title of the study. Clinical value includes the following factors: primary endpoint, efficacy profile, safety profile and ICD-10 diagnosis code. Indication details consist of therapy type, treatment line, chronic use, competition, whether the drug is the only option, whether the drug is the only treatment option, and treatment plan (see details in Table 1). Disease information comprises of orphan indication, whether the drug is for children, adults or for all ages, the age of the patient, burden of disease, whether the drug is for a rare disease and if the drug targets a specific sex. ICER, project budget, incremental cost at the governmental and societal perspective, incremental QALYs, estimated budget impact reported in the study and actual budget after price negotiation, actual budget impact, and type of reimbursement are included in economic evidence while others involve type of compound, type of study, manufacturer size, year of submission, submission date, resubmission, number of years after submission, patient assistance program, drug patent, publication, and GDP.

thumbnail
Table 1. Summary of confounders which may associate with price, decision, and budget.

https://doi.org/10.1371/journal.pone.0274944.t001

Table 1 summarises the potential confounders identified in literature to be associated with price, reimbursement decision, and budget including their references. These factors will be used in a regression model (e.g., different types of multivariable regression models depending on the outcome). We will apply similar methods to study the impact of an increased CET (as another factor in a regression model) adjusting for these potential confounders on different outcomes of interest (price, reimbursement decision, and budget) based on the objectives.

Data sources

Literature review.

To obtain background information and identify potential factors affecting drug price, reimbursement decisions, and drug budget, we conducted a literature review related to the concept of CET from PubMed and various health technology assessment agency websites such as NICE, the Pharmaceutical Benefits Advisory Committee (PBAC) of Australia, and the Canadian Agency for Drugs and Technologies in Health (CADTH). The following key terms were used: (1) cost-effectiveness threshold; (2) threshold; and (3) willingness-to-pay threshold. We included research articles, academic articles, research reports, and gray literature such as papers presented at academic conferences and articles published on official websites. We restricted the inclusion to English and Thai language studies which were published until September 2021. Studies on the concept of cost-effectiveness threshold or on the effect of setting a cost-effectiveness threshold were included, whereas studies on methodologies used to determine the cost-effectiveness threshold were excluded. Data collected from the literature review included the following: (1) title and first author of the study; (2) year of publication; (3) document characteristics; (4) country of the study; (5) importance of a cost-effectiveness threshold; and (6) other relevant details (if any). Findings from the literature review were used to inform potential confounders to include in the analyses, as detailed in Table 1.

Data sources from local organizations.

Additional information, listed in Table 2, will be requested from various local organizations such as the Thai Food and Drug Administration (FDA), which is a secretary of the national drug committee, as well as the National Health Security Office, which manages the Thai Universal Healthcare Coverage Scheme (UCS), the Social Security Office which manages the Social Security Scheme (SSS) and the Comptroller General’s Department which manage the Civil Servant Medical Benefit Scheme (CSMBS). These three public health insurance schemes cover approximately 70 million population of the Thai population and overseas workers in Thailand.

Stakeholder consultation meetings.

Upon further review of the data obtained from literature review and local organizations, issues caused by lack of evidence will be resolved through consultations with relevant stakeholders and experts in the field such as representatives from the NLEM subcommittee, Health Economic Working Group, and the Universal Coverage Benefit Package (UCBP). We have presented the research protocol at a stakeholder consultation meeting to obtain general feedback on the proposed plan and to initiate collaborations for data access with relevant stakeholders. Once preliminary findings from the project are available, we will present to the stakeholders again for final input. Stakeholders include, but not limited to, representatives from the NLEM subcommittee, pharmaceutical companies, the Development of Rare Disease Care Service, Health Economics Working Groups, the three national health insurance schemes (UCS, SSS, and CSMBS), research communities, and public funding agencies.

Statistical analysis plan

Objective 1: Analysis plan for impact of increased CET on drug price.

In Objective 1 (i.e., impact of increased CET on drug prices), we aim to examine the impact of a change in CET on drug prices by using multivariable linear regression models [38,39]. The dependent variable (Y) will be drug price (included in the submission). The variable of interest (X) will be the threshold used (which could be one of the three options: THB100,000, THB120,000, or THB160,000). The regression models will also adjust for potential confounders (Z) as highlighted in the Methods’ Variables section. Depending on the final sample size, we may also consider subgroup analysis or interaction terms. For instance, the impact of CET could be different between drugs for rare diseases and drug not for rare diseases. However, such analysis may not be feasible if the sample size is small. The model will also use a cluster robust option to consider the fact that same drugs may be used for different indications and thus have difference prices. The model can be represented by the following function:

Eq 1 (primary model for Objective 1)

  1. (Priceijt), the first outcome, will be the submitted drug price of a drug i submitted at year t by pharmaceutical company j
  2. αi = constant term
  3. δj measures the impact of company j
  4. β measures the impact of change in CET on submitted drug prices
  5. CETt = Cost effectiveness threshold (THB100,000, THB120,000, or THB160,000 depending on the submission year)
  6. γ measures the impact of potential confounders (Z) on submitted drug prices
  7. Zijt = potential confounders associated with a drug i submitted at year t by pharmaceutical company j (each confounder will be analysed as individual confounder)
  8. t = time

In addition to Eq 1, we will conduct a secondary model where drug price will be the final drug price in the NLEM (after negotiation) if data are available.

Objective 2: Analysis plan for impact of increased CET on probability of being included in NLEM.

In Objective 2, we aim to examine the impact of a change in CET on reimbursement decisions by using multivariable logistic regression models [40]. The dependent variable (Y) will be the decision of the drug being included in the NLEM (yes/no). The variable of interest (X) and other potential predictors (Z) would be similar to those reported in Objective 1. The model can be represented by the following function:

Eq 2 (primary model for Objective 2)

  1. include_drugijt = 1 if drugijt, drug i submitted at year t by pharmaceutical company j, was included in the NLEM; otherwise, include_drugijt = 0.
  2. αi = constant term
  3. β measures the impact of change in CET on the included drug
  4. CETt = Cost effectiveness threshold (THB100,000, THB120,000, or THB160,000 depending on the submission year)
  5. γ measures the impact of ICER on the included drug
  6. ICERit = Incremental cost-effectiveness ratio of a drug i at year t
  7. Zit = potential confounders associated with a drug i at year t
  8. δ measures the impact potential confounders (Z) associated on the included drug
  9. t = time
  10. p is probability
  11. logit is the logit function

Objective 3: Analysis plan for impact of increased CET on budget impact.

Objective 3 will examine the impact of a change in CET on the estimated and actual budget impact. We will employ the findings from regression models to simulate the change of total budget for all NLEM drugs.

Regression diagnostic tests will be conducted. The above models will be checked for collinearity and homoscedasticity, and robust standard errors will be used. Data will be analysed using STATA, version 16.0 (STATA Corp, College Station, TX, USA) with a statistical significance of p < 0.05.

Discussion

Potential policy implications

The situation in Thailand where the CET has been increased twice represents a unique case to empirically examine impacts of increasing the CET. Recognising that economic evidence is only part of evidence package in policy making, we believe that better understanding the impact of increased CET on the three different outcomes (i.e., submitted drug prices, decision to include/exclude drugs in the public reimbursement list, and the government budget) could be vital for supporting meaningful deliberation between stakeholders and policymakers on whether the current CET should be revisited in Thailand and other settings in using health economic evaluation to inform policy decisions. While this study will use data from Thailand, the results on the pharmaceutical companies’ behavioural responses to a changing CET could be generalizable to other countries. In other words, other countries may expect similar behavioural response from the pharmaceutical companies in response to a changing CET. However, additional consideration on the local healthcare financing setting and healthcare system should be considered.

Potential limitations and mitigation strategies

This is a study in a single upper-middle income country. Our results may not reflect outcomes that may be found in other settings with different political economy. However, our results on the behavioral responses to the changing CET of the pharmaceutical companies, given their commonalities such as profit driven, can be generalized to other countries, with careful consideration of local healthcare system, local healthcare financing mode, and the existence of other competing pharmaceutical companies.

In Thailand, health economic evaluation is required for only high-cost medicines submitted to NLEM [29]. Also, there are about 50 health economic evaluation studies commissioned for NLEM policy making in the past. These studies reported ICERs of around 80–100 medicines. As such, it needs to be seen whether there are enough data points to make meaningful conclusion of the changing impacts.

Moreover, due to the nature of the study design, the findings are at risk of confounding effect and various types of biases, including misspecification. To account for the confounding effect, relevant confounders were identified by conducting literature review and consulting stakeholders. In hoping to minimize biases, we will conduct applicable regression diagnostics to test for model assumptions (e.g., independence and homoscedasticity) and ensure the model’s goodness-of-fit from likelihood ratio test including the Wald test of exogeneity. For endogeneity, multivariable regression analysis can be performed, as well as exploring instrumental variable (IV) methods [41,42]. Since we have developed this study as a policy evaluation of the changes of the CETs, in our models (like many policy evaluations), we treat CET as exogenous treatment variable. We are however aware that one may be concerned if CET is endogenous since the changes in CET were indeed driven partially by political pressure. Currently, we do not have a list of instrumental variables to address such a policy endogeneity. The use of an IV approach is hence still suggestive and is yet fully committed. However, we would like to retain the possibility of extending our method to address the issue by using an instrumental variable approach.

Furthermore, we will perform a robust regression which can help minimize the mild violation of model assumptions, and robust standard errors will be calculated. The proposed regression analysis is an appropriate way to evaluate the policy change. Other potential approaches could include an interrupted time series analysis (ITS) or regression discontinuity design (RDD), but they were excluded for a combination of reasons. As with ITS, we did not want to aggregate the individual drug level data into a simple time series data. Also, for RDD, with relatively short time period being available in our data, the results of RDD will be very close to event study. Furthermore, RDD is data consuming and usually requires high number of observations. Another example of other study design is to do experts opinion elicitation which is beyond the scope of the current quantitative study.

Report completion and dissemination of research results

Knowledge gained from the study will be conveyed to the public through various disseminations such as reports, policy briefs, academic journals, and presentations. The research team will share the findings with all relevant stakeholders in both practice and research communities nationally and internationally.

Acknowledgments

The Health Intervention and Technology Assessment Program (HITAP) is a semi-autonomous research unit in the Ministry of Public Health, Thailand, and supports evidence-informed priority-setting and decision-making for healthcare. We also would like to acknowledge the support from Juthamas Prawjaeng and Phorntida Hadnorntun for the literature review during the early phase of this study.

References

  1. 1. Glassman A, Chalkidou K, Giedion U, Teerawattananon Y, Tunis S, Bump JB, et al. Priority-setting institutions in health: recommendations from a center for global development working group. Glob Heart. 2012;7(1):13–34. pmid:25691165
  2. 2. Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes: Oxford university press; 2015.
  3. 3. Medical Association of Thailand. Journal of the Medical Association of Thailand. 2014;97(5).
  4. 4. Canadian Agency for Drugs and Technologies in Health. Guidelines for the Economic Evaluation of Health Technologies: Canada. 2017.
  5. 5. Thokala P, Ochalek J, Leech AA, Tong T. Cost-Effectiveness Thresholds: the Past, the Present and the Future. Pharmacoeconomics. 2018;36(5):509–22. pmid:29427072
  6. 6. Claxton K, Briggs A, Buxton MJ, Culyer AJ, McCabe C, Walker S, et al. Value based pricing for NHS drugs: an opportunity not to be missed? BMJ. 2008;336(7638):251–4. pmid:18244997
  7. 7. Woods B, Revill P, Sculpher M, Claxton K. Country-Level Cost-Effectiveness Thresholds: Initial Estimates and the Need for Further Research. Value Health. 2016;19(8):929–35. pmid:27987642
  8. 8. Robinson LA, Hammitt JK, Chang AY, Resch S. Understanding and improving the one and three times GDP per capita cost-effectiveness thresholds. Health Policy Plan. 2017;32(1):141–5. pmid:27452949
  9. 9. Chi YL, Blecher M, Chalkidou K, Culyer A, Claxton K, Edoka I, et al. What next after GDP-based cost-effectiveness thresholds? Gates Open Res. 2020;4:176. pmid:33575544
  10. 10. Newall AT, Jit M, Hutubessy R. Are current cost-effectiveness thresholds for low- and middle-income countries useful? Examples from the world of vaccines. Pharmacoeconomics. 2014;32(6):525–31. pmid:24791735
  11. 11. Schwarzer R, Rochau U, Saverno K, Jahn B, Bornschein B, Muehlberger N, et al. Systematic overview of cost–effectiveness thresholds in ten countries across four continents. Journal of comparative effectiveness research. 2015;4(5):485–504. pmid:26490020
  12. 12. Bilinski A, Neumann P, Cohen J, Thorat T, McDaniel K, Salomon JA. When cost-effective interventions are unaffordable: Integrating cost-effectiveness and budget impact in priority setting for global health programs. PLoS Med. 2017;14(10):e1002397. pmid:28968399
  13. 13. Bertram MY, Lauer JA, De Joncheere K, Edejer T, Hutubessy R, Kieny M-P, et al. Cost–effectiveness thresholds: pros and cons. Bulletin of the World Health Organization. 2016;94(12):925. pmid:27994285
  14. 14. Morton A, Barlow E. EVORA (Evaluating the Value of a Real-world HTA agency) simulation spreadsheet. EVORADelivA_v2_2_(.xlsm) ed. University of Strathclyde2020.
  15. 15. Earnshaw J, Lewis G. NICE guide to the methods of technology appraisal. Springer; 2008.
  16. 16. World Health Organization. The world health report 2002: reducing risks, promoting healthy life: World Health Organization; 2002.
  17. 17. Marseille E, Larson B, Kazi DS, Kahn JG, Rosen S. Thresholds for the cost–effectiveness of interventions: alternative approaches. Bulletin of the World Health Organization. 2014;93:118–24. pmid:25883405
  18. 18. Luyten J, Denier Y. Explicit cost-effectiveness thresholds in health care: a kaleidoscope. Social Justice Research. 2019;32(2):155–71.
  19. 19. Canadian Agency for Drugs and Technologies in Health. CADTH Methods and Guidelines-Guidelines for the Economic Evaluation of Health Technologies. Ottawa: CADTH. 2017:1–76.
  20. 20. Thavorncharoensap M, Chaikledkaew U, Youngkong S, Thakkinstian A, Culyer AJ. A Systematic Review of Demand-Side Methods of Estimating the Societal Monetary Value of Health Gain. Value in Health. 2021;24(10):1423–34. pmid:34593165
  21. 21. Bertram MY, Lauer JA, Stenberg K, Edejer TTT. Methods for the Economic Evaluation of Health Care Interventions for Priority Setting in the Health System: An Update From WHO CHOICE. Int J Health Policy Manag. 2021. pmid:33619929
  22. 22. Health Intervention and Technology Assessment Program. Personal communications with the health economics teams in Bhutan and Kenya. 2021.
  23. 23. Dillon SA. National Institute for Health and Care Excellence2015. Available from: https://www.nice.org.uk/news/blog/carrying-nice-over-the-threshold.
  24. 24. Towse A. Should NICE’s threshold range for cost per QALY be raised? Yes. Bmj. 2009;338. pmid:19171561
  25. 25. Gandjour A. Willingness to pay for new medicines: a step towards narrowing the gap between NICE and IQWiG. BMC Health Serv Res. 2020;20(1):343. pmid:32321496
  26. 26. Paulden M. Recent amendments to NICE’s value-based assessment of health technologies: implicitly inequitable? Expert review of pharmacoeconomics & outcomes research. 2017;17(3):239–42. pmid:28490259
  27. 27. Low V, Macaulay R. Accounting for inflation within NICE cost-effectiveness thresholds. Expert Rev Pharmacoecon Outcomes Res. 2021:1–7. pmid:33980118
  28. 28. Thavorncharoensap M, Teerawattananon Y, Natanant S, Kulpeng W, Yothasamut J, Werayingyong P. Estimating the willingness to pay for a quality-adjusted life year in Thailand: does the context of health gain matter? ClinicoEconomics and outcomes research: CEOR. 2013;5:29. pmid:23345984
  29. 29. Teerawattananon Y, Tritasavit N, Suchonwanich N, Kingkaew P. The use of economic evaluation for guiding the pharmaceutical reimbursement list in Thailand. Z Evid Fortbild Qual Gesundhwes. 2014;108(7):397–404. pmid:25444298
  30. 30. Mohara A, Youngkong S, Velasco RP, Werayingyong P, Pachanee K, Prakongsai P, et al. Using health technology assessment for informing coverage decisions in Thailand. J Comp Eff Res. 2012;1(2):137–46. pmid:24237374
  31. 31. Charokopou M, Majer IM, Raad J, Broekhuizen S, Postma M, Heeg B. Which factors enhance positive drug reimbursement recommendation in Scotland? A retrospective analysis 2006–2013. Value Health. 2015;18(2):284–91. pmid:25773564
  32. 32. Iskrov G, Stefanov R. Criteria for Drug Reimbursement Decision-Making: An Emerging Public Health Challenge in Bulgaria. Balkan Med J. 2016;33(1):27–35. pmid:26966615
  33. 33. Dakin HA, Devlin NJ, Odeyemi IA. "Yes", "No" or "Yes, but"? Multinomial modelling of NICE decision-making. Health Policy. 2006;77(3):352–67. pmid:16213624
  34. 34. George B, Harris A, Mitchell A. Cost-effectiveness analysis and the consistency of decision making: evidence from pharmaceutical reimbursement in australia (1991 to 1996). Pharmacoeconomics. 2001;19(11):1103–9. pmid:11735677
  35. 35. Linley WG, Hughes DA. Reimbursement decisions of the All Wales Medicines Strategy Group: influence of policy and clinical and economic factors. Pharmacoeconomics. 2012;30(9):779–94. pmid:22676385
  36. 36. Schey C, Milanova T, Hutchings A. Estimating the budget impact of orphan medicines in Europe: 2010–2020. Orphanet J Rare Dis. 2011;6:62. pmid:21951518
  37. 37. Devlin N, Parkin D. Does NICE have a cost-effectiveness threshold and what other factors influence its decisions? A binary choice analysis. Health Econ. 2004;13(5):437–52. pmid:15127424
  38. 38. Montgomery DC, Peck EA, Vining GG. Introduction to linear regression analysis: John Wiley & Sons; 2021.
  39. 39. Weisberg S. Applied linear regression: John Wiley & Sons; 2005.
  40. 40. Hosmer DW Jr, Lemeshow S, Sturdivant RX. Applied logistic regression: John Wiley & Sons; 2013.
  41. 41. Arellano M, Bover O. Another look at the instrumental variable estimation of error-components models. Journal of econometrics. 1995;68(1):29–51.
  42. 42. Newey WK, Powell JL. Instrumental variable estimation of nonparametric models. Econometrica. 2003;71(5):1565–78.