Figures
Abstract
Background
New evidence on the clinical effectiveness of acupuncture plus usual care (acupuncture) and counselling plus usual care (counselling) for patients with depression suggests the need to investigate the health-related quality of life and costs of these treatments to understand whether they should be considered a good use of limited health resources.
Methods and Findings
The cost-effectiveness analyses are based on the Acupuncture, Counselling or Usual care for Depression (ACUDep) trial results. Statistical analyses demonstrate a difference in mean quality adjusted life years (QALYs) and suggest differences in mean costs which are mainly due to the price of the interventions. Probabilistic sensitivity analysis is used to express decision uncertainty. Acupuncture and counselling are found to have higher mean QALYs and costs than usual care. In the base case analysis acupuncture has an incremental cost-effectiveness ratio (ICER) of £4,560 per additional QALY and is cost-effective with a probability of 0.62 at a cost-effectiveness threshold of £20,000 per QALY. Counselling compared with acupuncture is more effective and more costly with an ICER of £71,757 and a probability of being cost-effective of 0.36. A scenario analysis of counselling versus usual care, excluding acupuncture as a comparator, results in an ICER of £7,935 and a probability of 0.91.
Conclusions
Acupuncture is cost-effective compared with counselling or usual care alone, although the ranking of counselling and acupuncture depends on the relative cost of delivering these interventions. For patients in whom acupuncture is unavailable or perhaps inappropriate, counselling has an ICER less than most cost-effectiveness thresholds. However, further research is needed to determine the most cost-effective treatment pathways for depressed patients when the full range of available interventions is considered.
Citation: Spackman E, Richmond S, Sculpher M, Bland M, Brealey S, Gabe R, et al. (2014) Cost-Effectiveness Analysis of Acupuncture, Counselling and Usual Care in Treating Patients with Depression: The Results of the ACUDep Trial. PLoS ONE 9(11): e113726. https://doi.org/10.1371/journal.pone.0113726
Editor: David W. Dowdy, Johns Hopkins Bloomberg School of Public Health, United States of America
Received: April 15, 2014; Accepted: October 28, 2014; Published: November 26, 2014
Copyright: © 2014 Spackman et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The authors confirm that all data underlying the findings are fully available without restriction. Relevant data are available at Figshare: http://figshare.com/authors/Eldon_Spackman/652259.
Funding: This article presents independent research funded by the National Institute for Health Research (NIHR) under its Programme Grants for Applied Research Programme (RP-PG-0707-10186). The views expressed are those of the author(s) and not necessarily those of the National Health Service, the NIHR or the Department of Health. The funders, and the University of York in its role as sponsor for the study, had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Depression has the fourth highest burden of disease, and is expected to have the highest in high-income countries by 2030 [1]. In England an estimated 2.6 million cases of depression are reported with an economic burden estimated to exceed £9 billion per annum, with approximately £370 million covering direct costs of treatment [2]. However, up to 33% of patients do not show an adequate response to pharmacological antidepressant treatment,[3] and 30% do not adhere to their medication regime [4].
A number of non-pharmacological high-intensity psychological interventions are available for the treatment of moderate to severe depression, or mild depression with inadequate response. The United Kingdom’s (UK) National Institute for Health and Care Excellence (NICE) clinical guidelines recommend cognitive behavioural therapies (CBT), interpersonal therapy (IPT), behavioural activation (ACT) and behavioural couples therapy [5]. Overall, NICE found the evidence for counselling to be limited, however, counselling is recommended by NICE for patients who have declined antidepressants, CBT, IPT, ACT and behavioural couples therapy. For a person whose depression has not responded to either pharmacological or psychological interventions, the clinical guidelines recommend combining antidepressant medication with CBT, for which evidence suggests that combined CBT/medication is more effective and cost-effective than either treatment alone [5]–[7]. However, a more recent meta-analysis found that all seven psychotherapeutic interventions examined were more effective than usual care. The only significant difference between interventions was that IPT achieved an improved effect compared with supportive counselling. [8] Counselling is widely used for patients with depression, with 9000 primary care practices in England offering referrals [9] despite its limited recommendation [5].
Acupuncture is provided as a treatment most commonly for chronic pain[10], for which there is evidence of a beneficial effect [11]. Until recently the evidence on the effectiveness of acupuncture for depression has been found to be inconclusive [12], although new evidence of clinical benefits have been recently reported in the ACUDep trial, in which acupuncture and counselling were compared with usual care for patients with on-going depression. [13] Acupuncture is rarely provided within the UK’s mental health service or primary care, but private provision of acupuncture for depression is not uncommon [10].
This study explored the cost-effectiveness of acupuncture plus usual care (acupuncture), counselling plus usual care (counselling) and usual care alone using the health economic findings of the trial: Acupuncture, Counselling or Usual care for Depression (ACUDep) (ISRCTN63787732). The clinical findings have been reported previously [13]. In the clinical report of the ACUDep trial, patients in both the acupuncture and counselling arms showed improved depression scores on the primary outcome, the Patient Health Questionnaire (PHQ-9) scale[14], compared with usual care alone at 3 and 6 months as well as in an area-under-curve analysis over 12 months. There were no statistically significant differences between the counselling and acupuncture arms.
Given the positive clinical results in the ACUDep trial, the primary aim of this study was to assess the health-related quality of life and resource use reported in the trial to determine the cost-effectiveness of short courses of acupuncture or counselling compared with usual care alone for patients with moderate to severe depression.
Methods
Trial
ACUDep was an open parallel-arm randomised controlled trial with patients randomised to one of three arms using the allocation ratio of 2∶2∶1, respectively: 12 weekly sessions of acupuncture; 12 weekly sessions of counselling; and usual care alone. The pragmatic design meant patients were not restricted from receiving interventions associated with the trial groups in which they were not randomised or other types of psychological interventions. Patients were eligible if they were 18 or over, had consulted with depression in primary care within the past 5 years and who were continuing to experience moderate to severe depression based on a score of at least 20 on the Beck Depression Inventory (BDI-II) [15]. Further eligibility criteria have been described elsewhere [13], [16].
Health Outcomes
The measure of health benefit used in the economic analysis was the quality adjusted life year (QALY), which takes into account the treatment differences in health-related quality of life (HRQoL) and mortality. HRQoL was measured using the EuroQol (EQ-5D) instrument, at baseline, and at months 3, 6, 9 and 12 in ACUDep. The EQ-5D measures health-related quality of life on five dimensions (mobility, self-care, usual activities, pain/discomfort and anxiety and depression). Each dimension is subdivided into three levels which corresponded to whether a respondent has no problems, moderate problems or extreme problems (Table S1: EQ-5D Level Descriptions). The value of each of the 243 unique health states is preference weighted using valuations from a UK population [17]. The EQ-5D is preferred by NICE for assessing cost-effectiveness [18].
Costs
A National Health Service (NHS) cost perspective was used, although out-of-pocket expenses were also reported.
Resource use data were collected at 3, 6, 9 and 12 months using patient questionnaires in the trial. Patients were asked how many times they visited different health care providers over the last 3 months for “any reason” (i.e. the total number of visits to a provider) and “about your depression only” (i.e. depression related visits). Total annual resource use was calculated as the sum of the resource use collected at each 3-month period. The total annual cost was calculated by multiplying the total annual resource use by publicly available 2012 national unit costs (Table S2: Unit Costs). As the cost of acupuncture is not currently financed by the NHS, we used the costs of acupuncture as estimated previously and the average of the ranges reported by NHS Choices, £47.50, for an initial session and £37.50 for subsequent sessions [19], [20]. The costs of counselling are those currently used in the NHS, £65 per hour of client contact [21]. Total annual costs were missing for many patients, due to missing resource use data at one or more follow-up periods.
Statistical Analysis
Multiple imputation methods were used to manage the uncertainty caused by the missing data. Chained imputation using predictive mean matching was undertaken using resource use data, PHQ-9 and BDI scores, QALYs, and patient characteristics such as age, sex and education.
EQ-5D data were analysed using ordered logit models on each of the five dimensions of the instrument. Analysis at 3 months controlled for the baseline response and analysis over 12 months used random effects models and controlled for the baseline response and the timing of each response (i.e. the day from randomization).
HRQoL weights were calculated using an independent predefined algorithm obtained by the elicitation of societal preferences for EQ-5D health states in a random population sample through a time trade-off technique. The UK valuation of the EQ-5D results in a scale from −0.594 to 1, where negative numbers represent states worse than death, 0 represents death and 1 represents perfect health [17]. QALYs were calculated by applying an individual’s HRQoL weights and the time between EQ-5D measures using the area under the curve approach [22], [23]. For all cost-effectiveness analyses seemingly unrelated regressions were used to account for the correlation between costs and QALYs [24]. QALYs were regressed on the base line HRQoL and treatment arm, and costs were regressed on the treatment arm only.
Incremental cost-effectiveness ratios (ICERs) were estimated using fully incremental analysis. We did not consider pairwise comparisons appropriate given the economic requirement to include all relevant comparators and because pairwise comparisons may lead to misleading conclusions, for example, if ICERs are calculated between treatments when one of the treatments is dominated by a third treatment not included in the calculation.
Sensitivity Analysis
Base case results were calculated using total costs and taking into account the uncertainty from the multiple imputation and the seemingly unrelated regression. Probabilistic sensitivity analysis was used to reflect uncertainty in mean total costs and QALYs and we estimated the probability of cost-effectiveness conditional on alternative cost effectiveness thresholds. Further exploratory scenario analyses were undertaken to understand the influence on cost-effectiveness of (i) the differential cost of the acupuncture and counselling interventions, (ii) depression related resource use (i.e. those visits determined by the patient to be related only to depression), (iii) complete case and (iv) a population for which acupuncture is not appropriate or unavailable (e.g. those with needle phobia).
Cost-effectiveness thresholds
All analyses considered the published NICE cost-effectiveness thresholds of £20,000 and £30,000 per QALY gained [18]. Additionally, we considered a recent empirically estimated NICE threshold of £13,000 per QALY [25]. These thresholds are meant to represent the opportunity costs of the NHS. Thus, ICERs below the threshold suggest that the intervention is a good use of NHS resources, while ICERs above the threshold provide less health than they displace.
Results
Health Outcomes
At 3 months patients treated with acupuncture or counselling were less likely than patients treated with usual care to report that they were moderately or extremely anxious or depressed rather than not anxious or depressed (Table 1). The 3-month improvement in anxiety and depression was sustained over the trial period to 12 months (Figure S1: Responses to the anxiety and depression dimension of the EQ-5D over 12 months and by treatment). At 3 months the direction of effect for the other EQ-5D dimensions is mixed; however, over the 12 months, the odds of being in the worse health states for all dimensions was lower for the acupuncture and counselling arms compared with usual care (Table 1).
Combining the EQ-5D dimension results with the UK population health state preferences resulted in the HRQoL scores over time and by treatment presented in Figure 1. For all treatment arms the HRQoL increased between baseline and 3 months with acupuncture and counselling arms being higher than usual care and remaining higher at 12 months.
QALYs for usual care, acupuncture and counselling were estimated to be 0.604, 0.663 and 0.666, respectively, using imputed data and seemingly unrelated regression controlling for the baseline HRQoL.
Costs
Mean NHS resource use was highest for patients in the usual care group (Table 2). The sample of patients reporting resource use was small, but complete case results were similar to the imputed results. Total costs and depression related costs were reported in Table 3. As expected depression related costs were lower than the total costs. The higher resource use in the usual care group was offset by the additional costs of acupuncture and counselling sessions. Costs were lowest for patients in the usual care group and highest for patients in the counselling group. Differences between treatment arms were similar whether total or depression costs were used.
Patients reported the amount spent on out-of-pocket acupuncture, counselling or therapy. Table 4 displays the means and standard deviations (SD) of out-of-pocket expenditures and days off work. Patients in the acupuncture arm reported spending the most on acupuncture while patients in the counselling arm reported spending the most on counselling and psychotherapy. The reported means for the number of days off work were similar across arms.
Cost-effectiveness
When comparing acupuncture, counselling and usual care, acupuncture was found to be the cost-effective alternative with an incremental cost-effectiveness ratio of £4,560 per additional QALY compared with usual care alone with probabilities of being cost-effective of 0.68, 0.62 and 0.56 at thresholds of £13,000, £20,000 and £30,000 per QALY, respectively (Table 5). Counselling results in higher costs and benefits than acupuncture with an ICER of £71,757 per additional QALY compared with acupuncture.
A scenario analysis assuming each session of acupuncture is the same price as counselling (£65) resulted in counselling having higher QALYs and lower costs than acupuncture i.e. acupuncture was dominated (Table 6). Cost-effectiveness results were similar between the base case result using total costs and the scenario analysis using depression related costs only. Restricting the analysis to the complete case data resulted in an ICER for acupuncture of £10,979 per QALY and counselling having higher costs and lower QALYs than acupuncture. For patients in whom acupuncture is inappropriate or unavailable the incremental cost-effectiveness of counselling versus usual care was £7,935 per additional QALY.
Discussion
The clinical results of the ACUDep trial demonstrated that acupuncture and counselling significantly reduced depression measures at 3 and 6 months when compared with usual care, as well as in an area-under-curve analysis over the 12-month period [13]. No statistically significant differences in clinical outcome between acupuncture and counselling were detected. This economic analysis demonstrated that the HRQoL results are consistent with the previously reported clinical results. NHS resource use was highest in the usual care group, but costs were highest in the counselling group followed by the acupuncture group because of the cost of the interventions.
The trial was powered based on the primary outcome of PHQ-9 and not the outcomes used in this analysis, EQ-5D and resource use. It is not surprising that the differences were not statistically significant at the standard p-values. Furthermore, inferential statistics are not helpful in making decisions about allocation of resources [26]. This study used probabilistic sensitivity analysis to incorporate the consequences of the variation in the trial results rather than using an arbitrary cut-off.
The cost-effectiveness results, taking into account the uncertainty in the estimates, suggest that acupuncture is the cost-effective option. Currently acupuncture for depression is not provided by the NHS. It is possible that the regulation of acupuncture may increase the per session costs. A sensitivity analysis was undertaken assuming that each acupuncture session costs £65, the same as counselling. In this scenario counselling is preferred to acupuncture because not only are the expected benefits higher but the expected costs are lower. This demonstrates that the cost-effectiveness of acupuncture in this study is reliant on having a lower price than counselling.
An analysis was undertaken comparing counselling to usual care alone to estimate the cost-effectiveness in patients for whom acupuncture is inappropriate. The trial was undertaken in a patient population able to undertake acupuncture thus this analysis assumes that costs and outcomes for counselling and the usual care alone arms in the trial will be the same for patients for whom acupuncture is not appropriate.
A cost-effectiveness analysis should consider the life-time horizon. In this trial patients were treated for up to 12 weekly sessions, although one patient in the counselling arm received 15 sessions, and patients outcomes were followed up for 12 months. The cost-effectiveness analysis considered a 12-month timeframe. This assumes that there are no differences in treatment arms past 12 months. This is expected to be a conservative assumption as there are expected to be no further intervention costs, but trial results suggest continued treatment differences at 12 months, although these treatment differences seem to be converging (Figure 1). Extrapolating these differences beyond 12 months would result in a lower ICER of acupuncture and no change to the conclusion.
When considering the possibility of incorporating further evidence into the analyses, only one previous trial of 59 patients with depression has been undertaken in the UK [27]. Patients received 12 sessions of acupuncture or sham acupuncture and outcomes were measured on the Beck Depression Index (BDI). The results of this trial were not included in this analysis due to the difference in the outcome used, the difference in comparator, the absence of health economic related data and the small number of patients included. Regarding counselling we found no trial based in primary care that evaluated counselling for moderate to severe depression.
Not all possible treatments for moderate to severe depression have been included in this analysis. Recent cost-effectiveness analyses on online cognitive behavioural therapy (CBT) report its cost-effectiveness versus usual care [5]–[7]. These analyses were based on the BDI rather than EQ-5D or PHQ-9, making comparisons with the current analysis difficult. It is also expected that some patients in the ACUDep trial may have received CBT as a part of usual care making the control group in this analysis different from previous trials. This study demonstrates that acupuncture is cost-effective compared with usual care alone given current levels and mixes of usual care but does not consider the alternative of improving usual care. Further analyses are needed to determine the cost-effectiveness of acupuncture and counselling when compared with other physical and psychological interventions as well as changing levels of usual care to understand how to best allocate scarce health care resources.
Conclusion
The results of this analysis suggest acupuncture is cost-effective compared with counselling or usual care alone. This result is strongly influenced by the cost of acupuncture which only remains cost-effective when the cost of providing the intervention is lower than that of counselling. For patients in whom acupuncture is unavailable and perhaps inappropriate, counselling has an ICER less than a range of estimates of NICE’s cost-effective threshold. However, further research is needed to determine the most cost-effective treatment pathways for depressed patients when the full range of available interventions is considered.
Supporting Information
Figure S1.
Responses to the anxiety and depression dimension of the EQ-5D over 12 months and by treatment.
https://doi.org/10.1371/journal.pone.0113726.s001
(TIF)
Acknowledgments
We acknowledge the contribution of the patients, counsellors, acupuncturists, general medical practitioners and all the staff who supported the administration of the trial.
Author Contributions
Conceived and designed the experiments: HM SR MB MS DT IW. Analyzed the data: ES MB RG AK. Wrote the paper: ES SR MS MB SB RG AH AK HL SP DT IW HM.
References
- 1. Mathers C, Loncar D (2006) Projections of global mortality and burden of disease from 2002 to 2030. PLoS Med. 3:e442.
- 2. Thomas CM, Morris S (2003) Cost of depression among adults in England in 2000. Br J. Psychiatry. 183:514–519.
- 3. Fava M (2003) Diagnosis and definition of treatment-resistant depression. Biol Psychiatry. 53:649–659.
- 4.
Gilbody S, Whitty P (2002) Improving the recognition and management of depression in primary care.: University of York: NHS Centre for Reviews and Dissemination.
- 5.
NICE (2010) Depression: The treatment and management of depression in adults (updated edition). London, England: National Institute for Health & Clinical Excellence. p.707.
- 6. Bower P, Byford S, Sibbald B, Ward E, King M, et al. (2000) Randomised controlled trial of non-directive counselling, cognitive-behaviour therapy, and usual general practitioner care for patients with depression. II: cost effectiveness. BMJ. 321:1389–1392.
- 7. Churchill R, Hunot V, Corney R, Knapp M, McGuire H, et al. (2001) A systematic review of controlled trials of the effectiveness and cost-effectiveness of brief psychological treatments for depression. HTA 5:183.
- 8. Barth J, Munder T, Gerger H, Nüesch E, Trelle S, et al. (2013) Comparative Efficacy of Seven Psychotherapeutic Interventions for Patients with Depression: A Network Meta-Analysis. PLoS Med. 10:e1001454.
- 9.
Mellor-Clark J, Simms-Ellis R, Burton M (2001) National survey of counsellors working in primary care: evidence for growing professionalisation? Occas Pap R Coll Gen Pract: vi-7.
- 10. Hopton AK, Curnoe S, Kanaan M, Macpherson H (2012) Acupuncture in practice: mapping the providers, the patients and the settings in a national cross-sectional survey. BMJ Open. 2:e000456.
- 11. Vickers AJ, Cronin AM, Maschino AC, Lewith G, MacPherson H, et al. (2012) Acupuncture for chronic pain: individual patient data meta-analysis. Arch Intern Med. 172:1444–1453.
- 12.
Smith CA, Hay PP, Macpherson H (2010) Acupuncture for depression. Cochrane Database Syst Rev: CD004046.
- 13. MacPherson H, Richmond S, Bland M, Brealey S, Gabe R, et al. (2013) Acupuncture and counselling for depression in primary care: a randomised controlled trial. PLoS Med. 10:e1001518.
- 14. Kroenke K, Spitzer RL, Williams JB (2001) The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 16:606–613.
- 15. Seggar L, Lambert M, Hansen N (2002) Assessing clinical significance: Application to the Beck depression inventory. Behavior Therapy. 33:17.
- 16. MacPherson H, Richmond S, Bland JM, Lansdown H, Hopton A, et al. (2012) Acupuncture, Counseling, and Usual care for Depression (ACUDep): study protocol for a randomized controlled trial. Trials. 13:209.
- 17. Dolan P, Gudex C (1995) Time preference, duration and health state valuations. Health Econ. 4:289–299.
- 18.
NICE (2013) Guide to the methods of technology appraisal 2013. London, England: National Institute of Health and Care Excellence.
- 19.
MacPherson H, Tilbrook H, Bland JM, Bloor K, Brabyn S, et al.. (2012) Acupuncture for irritable bowel syndrome: primary care based pragmatic randomised controlled trial. BMC Gastroenterology 12.
- 20.
NHS Choices (2014) Acupuncture. Available: http://www.nhs.uk/Conditions/acupuncture/Pages/Introduction.aspx. Accessed 2014 February 7.
- 21.
Curtis L (2012) Unit Costs of Health & Social Care 2012. Personal Social Services Research Unit.
- 22. Manca A, Hawkins N, Sculpher MJ (2005) Estimating mean QALYs in trial-based cost-effectiveness analysis: the importance of controlling for baseline utility. Health Econ. 14:487–496.
- 23. Matthews JN, Altman DG, Campbell MJ, Royston P (1990) Analysis of serial measurements in medical research. BMJ. 300:230–235.
- 24. Willan AR, Lin DY, Manca A (2005) Regression methods for cost-effectiveness analysis with censored data. Stat Med. 24:131–145.
- 25.
Claxton K, Martin S, Soares M, Rice N, Spackman E, et al.. (2013) Methods for the Estimation of the NICE Cost Effectiveness Threshold. York: CHE Research Paper.
- 26. Claxton K (1999) The irrelevance of inference: a decision-making approach to the stochastic evaluation of health care technologies. J Health Econ. 18:341–364.
- 27. Whiting M, Leavey G, Scammell A, Au S, King M (2008) Using acupuncture to treat depression: a feasibility study. Complement Ther Med. 16:87–91.