http://orcid.org/0000-0001-9978-6311
Figures
Abstract
Background
Accurately assessing changes in the quality of life of older people living permanently in nursing homes is important. The multi-attribute utility instrument most commonly used and recommended to assess health-related quality of life in the nursing home population is the three-level EuroQol EQ-5D-3L. To date, there have been no studies using the Health Utilities Index Mark III (HUI3). The purpose of this study was to compare the level of agreement and sensitivity to change of the EQ-5D-3L and HUI3 in a nursing home population.
Methods
EQ-5D-3L and HUI3 scores were measured as part of a cluster randomised controlled trial of nurse led care coordination in a nursing home population in Perth, Western Australia at baseline and 6-month follow up.
Results
Both measures were completed for 199 residents at baseline and 177 at 6-month follow-up. Mean baseline utility scores for EQ-5D-3L (0.45; 95% CI 0.41–0.49) and HUI3 (0.15; 95% CI 0.10–0.20) were significantly different (Wilcoxon signed rank test, p<0.01) and agreement was poor to moderate between absolute scores from each instrument (intra-class correlation coefficient = 0.63). The EQ-5D-3L appeared more sensitive to change over the 6-month period.
Conclusion
Our findings show that the EQ-5D-3L and HUI3 estimate different utility scores among nursing home residents. These differences should be taken into account, particularly when considering the implications of the cost-effectiveness of particular interventions and we conclude that the HUI3 is no better suited to measuring health-related quality of life in a nursing home population when compared to the EQ-5D-3L.
Citation: Lung T, Howard K, Etherton-Beer C, Sim M, Lewin G, Arendts G (2017) Comparison of the HUI3 and the EQ-5D-3L in a nursing home setting. PLoS ONE 12(2): e0172796. https://doi.org/10.1371/journal.pone.0172796
Editor: Nan Luo, National University of Singapore, SINGAPORE
Received: November 11, 2016; Accepted: February 9, 2017; Published: February 24, 2017
Copyright: © 2017 Lung et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Due to ethical restrictions, the data used for this study is only available upon request. Currently, ethics approval with the University of Western Australia Human Research Ethics Committee (RA/4/1/5123) does not allow any form of data as part of this study to be released into the public domain. Data are available from the University of Western Australia Human Research Ethics Committee (RA/4/1/5123) for researchers who meet the criteria for access to confidential data. Readers with questions about these restrictions or who wish to access the data may contact Mr. Peter Carl Miller (Human Ethics Officer) Email: peter.miller@uwa.edu.a.
Funding: This work was funded by the JO and JR Wicking Trust to GA. TL receives salary support as the HCF Research Foundation Postdoctoral Research Fellow. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The growth in the proportion of older people [1] and those who live permanently in a nursing home requiring complex care has implications both for health service delivery and the increase in demand of expenditure in order to meet this need [2]. Health-related quality-of-life (HRQoL), measured using a multi-attribute utility instrument (MAUI), provides a summary score that estimates quality of life (QoL). These scores, in combination with survival estimates, are typically used in health economic evaluations of different interventions to estimate quality adjusted life years (QALYs) [3].
Two widely used and accepted MAUIs in economic evaluations are the Health Utilities Index Mark 3 (HUI3) and the EuroQol EQ-5D-3L [4, 5], both of which describe health states in terms of health attributes or health dimensions. A recent systematic review of instruments for measuring outcomes in economic evaluation identified a limited number of studies using MAUIs in an aged care setting [6]. All 7 studies identified used the self-reported EQ-5D-3L instrument and no studies used the HUI3 questionnaire. Four further studies used three measures which encapsulated dimensions outside of health (The Adult Social Care Outcome Toolkit (ASCOT); the ICEpop CAPability measure for Older people (ICECAP-O); and the World Health Organization Quality of Life old (WHOQOL-Old)).
Currently, the EQ-5D-3L is the recommended MAUI to use when conducting economic evaluations for health technology assessments in the UK [7] whilst for older people, in addition to the EQ-5D-3L the use of either the ICECAP-O or ASCOT is recommended in order to facilitate the measurement and valuation of both QALYs and broader quality of life dimensions of importance to the specific population [6, 8, 9]. However, there is no strong rationale for choosing the EQ-5D-3L over other MAUIs; indeed there has been concern about the EQ-5D-3L having significant limitations in older people whereby small differences in health status can result in very large changes in QOL scores [10]. Differences between the EQ-5D-3L and the HUI3 have been noted in other settings [11–13], but not in a nursing home setting.
To appropriately interpret summary HRQoL scores based on the HUI3 or EQ-5D-3L in a nursing home population, a comparison between the values and properties of these instruments is needed. In this study, we use a nursing home population from a cluster controlled clinical trial in Australian nursing homes to assess HRQOL and compare agreement and sensitivity to change between the HUI3 and EQ-5D-3L.
Materials and methods
Health-related quality of life measures
The EQ-5D-3L questionnaire consists of a Visual Analog Scale (VAS) and five dimensions of health: mobility, self-care, daily activities, pain/discomfort and anxiety/depression [4, 5]. Each dimension has three response levels, yielding a possible 243 unique health states. These preferences are summarised into a utility score that ranges from -0.59 to 1.0 using the time trade-off method and we use Australian derived EQ-5D-3L weights in this study [14].
The HUI3 has eight dimensions of health (vision, hearing, speech, ambulation, dexterity, emotion, cognition, and pain/complaints) and each dimension has five or six response levels, resulting in 972,000 possible unique health states. Preference-based scoring algorithms converted the descriptive health classifications into values for each health dimension [15, 16]. The health dimensions are designed to be structurally independent, and a multi-attribute model using the standard gamble method derives a utility score that ranges from -0.36 to 1.0 [16].
Study population and data collection
Nursing home residents were recruited to a multicentre open label cluster controlled trial of nurse led care coordination in Perth, Western Australia (Australian and New Zealand Clinical Trials Registry number 12611000933954). In brief, individuals were eligible for the study if they were 65 year or older, eligible for Medicare and a permanent high level care resident in an accredited facility [17]. The EQ-5D-3L and HUI3 questionnaires were administered at baseline and 6-month follow-up, and co-morbidities were measured using the Charlson co-morbidity index [18]. Ethics approval was obtained from the University of Western Australia Human Research Ethics Committee (RA/4/1/5123). Written informed consent was obtained from all individual participants and for cognitively impaired individuals incapable of providing informed consent, provision for a written waiver of consent was granted with next of kin acknowledgement. This was directed by the supervising ethics committee and the national statement on Ethical Conduct in Human Research (‘‘National Statement on Ethical Conduct in Human Research”, 2007).
Cognitive status and disability of the resident (assessed as part of the study) determined whether they were able to self-populate the questionnaires. For individuals cognitively capable but unable (due to disability) to populate the questionnaires, a recruiter recorded resident responses at the bedside. Cognitively unable residents had a nominated proxy medical decision maker complete an informant questionnaire. Questionnaires were administered at enrolment (baseline) and at six and twelve-month follow-up. This study analyses only fully completed questionnaires at baseline and after 6 months.
For the purposes of this study, we combined both intervention and control groups in the analysis to conduct a cohort analysis of the utility scores. All analysis was conducted using Stata SE version 14.0 (StataCorp LP, College Station, TX, USA).
Agreement between instruments
Comparisons were made at baseline between mean HUI3 and EQ-5D-3L scores by sex, number of co-morbidities, age, treatment group and method of completing the questionnaires (self-completed versus informant-completed) using the Mann-Whitney U test. The distributions of the absolute values of the two instruments were tested individually for normality (Shapiro-Wilk test) and whether the two distributions were equal using the two-sample Kolmogorov-Smirnov test. To assess agreement between the utility values from the two instruments, a Wilcoxon signed rank test was used for all sub-groups.
Kendall’s tau was computed to determine whether there was correlation between the dimensions of the EQ-5D-3L and HUI3: mobility (EQ-5D-3L) and ambulation (HUI3); pain/complaints (EQ-5D-3L) and pain (HUI3); and anxiety/depression (EQ-5D-3L) and emotion (HUI3). Correlation scores were classified into three groups: 0.1–0.3 was considered small, 0.3–0.5 as medium and >0.5 interpreted as a large correlation [19].
Intra-class correlation (ICC) estimates the proportion of variance from both instruments’ scores attributable to differences between individuals, as opposed to differences between the two instruments [20, 21]. A two-way fixed mixed effect model was computed, where the instrument effect was fixed and the individual effect was random. ICC values close to 1 suggests that the instruments are similar in terms of agreement [22].
We used Bland-Altman [23, 24] plots to graph the difference between an individual’s EQ-5D-3L and HUI3 value against the mean of the two scores, which summarises the level of agreement between the two methods.
Sensitivity to change
The sensitivity of an instrument to changes in health was examined by calculating effect sizes. Effect size is classified as the difference between mean scores at baseline and 6-month follow-up divided by the standard deviation of baseline values. Effect sizes were defined as: small (0.20), moderate (0.50) and large (>0.80) [19]. Paired t-tests were conducted for baseline and 6-month follow-up utility values for EQ-5D-3L and HUI3, respectively to determine whether utility values changed over the observation period.
Results
For the 200 residents in the study, 199 EQ-5D-3L and HUI3 questionnaires were completed at baseline. Residents had a mean age of 85 years and 25% were men. By six months’ follow-up, 22 residents had died and were excluded from the analysis as they did not complete a MAUI questionnaire, leaving 177. Characteristics of the study population at baseline and 6-month follow-up are reported in Table 1.
Agreement between instruments
The mean utility scores from both instruments measured at both baseline and 6-month follow-up are reported in Table 2. Overall, at baseline the mean scores for EQ-5D-3L and HUI3 were estimated at 0.45 (range -0.24 to 1) and 0.15 (range -0.37 to 1), respectively. Significant differences in mean utility scores were found between individuals who self-completed and those who required an informant to complete their questionnaire for both EQ-5D-3L and HUI3 scores at baseline (p<0.01) and 6 months (p<0.01). At both baseline (p<0.03) and 6-month follow-up (p<0.05), significant differences were found between the intervention and control groups for the HUI3 but not EQ-5D-3L scores.
At baseline, the EQ-5D-3L distribution shows positive skewness whereas the HUI3 distribution shows negative skewness (S1 Fig). The assumption of normality for both utility scores (Shapiro-Wilk test) and equality of the two distributions (Two-sample Kolmogorov-Smirnov test) was strongly rejected (p<0.01). The distribution of scores at 6 months are similar to those at baseline (S2 Fig). Wilcoxon signed rank tests strongly rejected the null hypothesis of equality between individual’s EQ-5D-3L and HUI3 utility scores at both baseline and 6 months’ follow-up in all sub-groups listed in Table 1. At baseline, the majority of HUI3 scores (87%) were lower than the corresponding EQ-5D-3L score.
Large positive correlations (S1 Table) were found between the dimensions Pain/Complaints (EQ-5D-3L) and Pain (HUI3) (Kendall’s tau = 0.51), moderately positive correlation between mobility (EQ-5D-3L) and ambulation (HUI3) (Kendall’s tau = 0.40) and a small positive correlation was found between anxiety/depression (EQ-5D-3L) and Emotion (HUI3). All correlations were strongly statistically significant (p<0.01).
The ICC coefficient was 0.63 (95% CI 0.54–0.71), implying a poor to moderate level of agreement between the two instruments (S2 Table). Fig 1 depicts a Bland-Altman plot at baseline, showing a mean difference of 0.3 between EQ-5D-3L and HUI3 scores. The scatterplot shows that as mean utility values increase, the difference of values between the two instruments decreases.
Sensitivity to change
Effect sizes between baseline and 6-month follow-up for EQ-5D-3L (0.19) and HUI3 (0.02) suggested that the EQ-5D-3L was more sensitive than HUI3 to changes over a 6-month follow-up. Paired t-tests between baseline and 6 months’ follow-up strongly rejected the null hypothesis that the mean difference between EQ-5D-3L scores was greater than zero (p<0.02), suggesting a deterioration of EQ-5D-3L utility values over the observation period. No statistically significant differences were found between baseline and 6-month follow-up HUI3 values.
Discussion
This is the first study that has compared two commonly used MAUIs, the EQ-5D-3L and HUI3, in a nursing home setting. We investigated agreement and sensitivity to change for utility scores based on the EQ-5D-3L and HUI3, providing insight into the differences between these two instruments for people living in a nursing home.
At the individual level, the intra-class correlation coefficients and the Bland-Altman plot reveals a poor to moderate level of agreement between the two instruments, however moderate and small positive correlations exist between some health dimensions. EQ-5D-3L utility scores were considerably higher than corresponding HUI3 scores, which corroborates with non-nursing home population literature [11–13]. The multiplicative scoring function of the HUI3 assumes that all dimensions are dependent on one another, a possible explanation of the lower utility values estimated by the HUI3 in this nursing home cohort where polymorbidity is common.
Only EQ-5D-3L scores showed a statistically significant difference between baseline and follow-up. One reason for the larger deterioration in utility values when using the EQ-5D-3L is the smaller number of health states available, so a slight change in one health dimension from no or moderate impairment at baseline to severe impairment at follow-up could result in a relatively large decrement in health utility values.
The nursing home population poses considerable challenges for researchers using MAUIs. The two main areas of difficulty are a necessity to use proxy/informant measures of QoL in a large proportion of the population and the applicability of instruments for a population that, by definition, has lost the capacity to live independently in the community. When compared to self-completed scores, informant ratings of QoL are consistently lower in nursing home [25] and elderly community dwellings [26, 27], findings replicated in this study for both MAUIs. It is important to stress that broader elements of QoL (i.e. privacy, dignity, autonomy, etc.) [28, 29] as defined by elderly nursing home residents should be measured and valued alongside a MAUI in order to capture all potential benefits of an intervention. Compared to the seven studies that used EQ-5D-3L scores in an aged care setting [6], we found a similar baseline mean EQ-5D-3L score of 0.45 (SD = 0.32) and within the 95% confidence interval of all but one of the reported studies [30–33]. As this is the first study that used the HUI3 in a nursing home setting, future comparison and validation must be conducted to determine whether similar utility values are estimated.
A strength of this study was the 100% completion rate for those alive at 6-month follow-up for both MAUIs, which enabled an unbiased examination of change in HRQoL scores and their change over time. A limitation of the present study was our inability to examine whether there were differences in utility values according to the order in which instruments were administered. In all subjects, the EQ-5D-3L was administered first, followed by the HUI3. Changes over time in questionnaire administration mode (i.e. self-completion at baseline to proxy/informant at 6-month follow-up or vice versa) were not captured, which may have influenced the variation in mean scores between baseline and 6-month follow-up. We did not measure cognitive burden of the two questionnaires, which can be an important consideration in MAUI assessment in older people. The HUI3 contains up to 41 questions, which is substantially longer than the EQ-5D-3L (5 questions). One study comparing the Assessment of Quality of Life (AQoL) (15 questions) to the EQ-5D-3L in an aged population found that participants were more burdened by the AQoL and consequently found it more difficult to complete [10]. Unlike the EQ-5D-3L, the HUI3 is not based upon preferences of the Australian general population, which could account for some differences seen between the instruments in our results. However, the HUI3 has been widely applied in Australian contexts and appears to behave consistently with other multi-attribute utility instruments, despite the non-Australian based scoring system [34–37].
Overall, this study has demonstrated that the EQ-5D-3L appears to be more sensitive to changes over a 6-month period compared to the HUI3, yet there appears to be a low level of agreement between the two. Due to the potential cognitive burden of the HUI3, we conclude that the HUI3 appears no better suited to measuring HRQoL in a nursing home setting than the EQ-5D-3L. Given the increasing use of the EQ-5D-5L (with 5 response levels instead of three level in each QOL domain), additional confirmatory studies may be needed.
Conclusions
In conclusion, there were significant differences when comparing EQ-5D-3L and HUI3 scores in a nursing home population. Over a 6-month period the EQ-5D-3L appears to be more sensitive to changes in health status. Overall, the HUI3 appears no better suited than the EQ-5D-3L in this context. Further studies are required to determine the appropriateness of the HUI3 in this population, particularly given the cognitive burden when compared to the EQ-5D-3L.
Supporting information
S1 Fig. Distribution of EQ-5D-3L and HUI3 scores at baseline.
https://doi.org/10.1371/journal.pone.0172796.s001
(TIF)
S2 Fig. Distribution of EQ-5D-3L and HUI3 scores at 6-month follow-up.
https://doi.org/10.1371/journal.pone.0172796.s002
(TIF)
S3 Fig. Bland-Altman plot of mean EQ-5D-3L versus HUI3 utility values and the difference between the two utility values at 6-month follow-up (n = 177).
https://doi.org/10.1371/journal.pone.0172796.s003
(TIF)
S1 Table. Kendall’s tau to determine the agreement between the health state descriptions.
https://doi.org/10.1371/journal.pone.0172796.s004
(DOCX)
S2 Table. Intra-class coefficient two-way fixed effects model estimating the level of consistency between the two instruments.
https://doi.org/10.1371/journal.pone.0172796.s005
(DOCX)
Acknowledgments
The authors acknowledge the assistance of the Amana Living and Juniper groups where the research was conducted.
Author Contributions
- Conceptualization: TL CEB MS GL GA KH.
- Data curation: TL KH.
- Formal analysis: TL.
- Funding acquisition: KH CEB MS GL GA.
- Investigation: TL GA KH.
- Methodology: TL GA KH.
- Project administration: CEB MS GL GA.
- Software: CEB MS GL GA.
- Supervision: GA KH.
- Validation: TL GA KH.
- Visualization: TL GA KH.
- Writing – original draft: TL.
- Writing – review & editing: TL KH CEB MS GL GA.
References
- 1. Christensen K, Doblhammer G, Rau R, Vaupel JW. Ageing populations: the challenges ahead. The Lancet. 2009;374(9696):1196–208.
- 2.
Commission AGP. Economic implications of an ageing Australia. Canberra: Productivity Commission Research Report. 2005.
- 3.
Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes: Oxford university press; 2015.
- 4. Dolan P. Modeling valuations for EuroQol health states. Medical care. 1997;35(11):1095–108. Epub 1997/11/21. pmid:9366889
- 5. Feeny D, Furlong W, Boyle M, Torrance GW. Multi-attribute health status classification systems. Health Utilities Index. PharmacoEconomics. 1995;7(6):490–502. Epub 1995/05/08. pmid:10155335
- 6. Bulamu NB, Kaambwa B, Ratcliffe J. A systematic review of instruments for measuring outcomes in economic evaluation within aged care. Health and quality of life outcomes. 2015;13:179. Epub 2015/11/11. pmid:26553129
- 7.
Brockis E, Marsden G, Cole A, Devlin N. A Review of NICE Methods Across Health Technology Assessment Programmes: Differences, Justifications and Implications. 2016.
- 8. Makai P, Brouwer WB, Koopmanschap MA, Stolk EA, Nieboer AP. Quality of life instruments for economic evaluations in health and social care for older people: a systematic review. Social science & medicine (1982). 2014;102:83–93. Epub 2014/02/26.
- 9. van Leeuwen KM, Bosmans JE, Jansen AP, Hoogendijk EO, van Tulder MW, van der Horst HE, et al. Comparing measurement properties of the EQ-5D-3L, ICECAP-O, and ASCOT in frail older adults. Value in health: the journal of the International Society for Pharmacoeconomics and Outcomes Research. 2015;18(1):35–43. Epub 2015/01/18.
- 10. Holland R, Smith RD, Harvey I, Swift L, Lenaghan E. Assessing quality of life in the elderly: a direct comparison of the EQ-5D and AQoL. Health economics. 2004;13(8):793–805. Epub 2004/08/24. pmid:15322991
- 11. Grutters JP, Joore MA, van der Horst F, Verschuure H, Dreschler WA, Anteunis LJ. Choosing between measures: comparison of EQ-5D, HUI2 and HUI3 in persons with hearing complaints. Quality of life research: an international journal of quality of life aspects of treatment, care and rehabilitation. 2007;16(8):1439–49. Epub 2007/07/25.
- 12. Luo N, Johnson JA, Shaw JW, Feeny D, Coons SJ. Self-reported health status of the general adult U.S. population as assessed by the EQ-5D and Health Utilities Index. Medical care. 2005;43(11):1078–86. Epub 2005/10/15. pmid:16224300
- 13. Maes IH, Joore MA, Cima RF, Vlaeyen JW, Anteunis LJ. Assessment of health state in patients with tinnitus: a comparison of the EQ-5D and HUI mark III. Ear and hearing. 2011;32(4):428–35. Epub 2011/01/12. pmid:21221004
- 14. Viney R, Norman R, King MT, Cronin P, Street DJ, Knox S, et al. Time trade-off derived EQ-5D weights for Australia. Value in health: the journal of the International Society for Pharmacoeconomics and Outcomes Research. 2011;14(6):928–36. Epub 2011/09/15.
- 15. Horsman J, Furlong W, Feeny D, Torrance G. The Health Utilities Index (HUI): concepts, measurement properties and applications. Health and quality of life outcomes. 2003;1:54. Epub 2003/11/14. pmid:14613568
- 16. Feeny D, Furlong W, Torrance GW, Goldsmith CH, Zhu Z, DePauw S, et al. Multiattribute and single-attribute utility functions for the health utilities index mark 3 system. Medical care. 2002;40(2):113–28. Epub 2002/01/22. pmid:11802084
- 17. Arendts G, Etherton-Beer C, Howard K, Lewin G, Sim M, Pickstock S, et al. Nurse led care coordination: trial protocol and development of a best practice resource guide for a cluster controlled clinical trial in Australian aged care facilities. Archives of gerontology and geriatrics. 2014;58(1):15–9. Epub 2013/08/27. pmid:23972906
- 18. Charlson M, Szatrowski TP, Peterson J, Gold J. Validation of a combined comorbidity index. Journal of clinical epidemiology. 1994;47(11):1245–51. pmid:7722560
- 19.
Cohen J. Statistical power analysis for the behavioral sciences. Vol. 2. Lawrence Earlbaum Associates, Hillsdale, NJ. 1988.
- 20. Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychological bulletin. 1979;86(2):420–8. Epub 1979/03/01. pmid:18839484
- 21. McGraw KO, Wong SP. Forming inferences about some intraclass correlation coefficients. Psychological methods. 1996;1(1):30.
- 22.
Portney LG, Watkins MP. Foundations of clinical research: applications to practice: Prentice Hall Upper Saddle River, NJ; 2000.
- 23. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet (London, England). 1986;1(8476):307–10. Epub 1986/02/08.
- 24. Bland JM, Altman DG. Measuring agreement in method comparison studies. Statistical methods in medical research. 1999;8(2):135–60. pmid:10501650
- 25. Beer C, Flicker L, Horner B, Bretland N, Scherer S, Lautenschlager NT, et al. Factors associated with self and informant ratings of the quality of life of people with dementia living in care facilities: a cross sectional study. PloS one. 2010;5(12):e15621. Epub 2010/12/24. pmid:21179448
- 26. Kunz S. Psychometric properties of the EQ-5D in a study of people with mild to moderate dementia. Quality of life research: an international journal of quality of life aspects of treatment, care and rehabilitation. 2010;19(3):425–34. Epub 2010/02/11.
- 27. Tamim H, McCusker J, Dendukuri N. Proxy reporting of quality of life using the EQ-5D. Medical care. 2002;40(12):1186–95. Epub 2002/11/30. pmid:12458301
- 28. Kane RA, Kling KC, Bershadsky B, Kane RL, Giles K, Degenholtz HB, et al. Quality of life measures for nursing home residents. The Journals of Gerontology Series A: Biological Sciences and Medical Sciences. 2003;58(3):M240–M8.
- 29. Abrahamson K, Clark D, Perkins A, Arling G. Does cognitive impairment influence quality of life among nursing home residents? The Gerontologist. 2012;52(5):632–40. pmid:22230491
- 30. Comans TA, Peel NM, Gray LC, Scuffham PA. Quality of life of older frail persons receiving a post-discharge program. Health and quality of life outcomes. 2013;11:58. Epub 2013/04/17. pmid:23587460
- 31. Devine A, Taylor SJ, Spencer A, Diaz-Ordaz K, Eldridge S, Underwood M. The agreement between proxy and self-completed EQ-5D for care home residents was better for index scores than individual domains. Journal of clinical epidemiology. 2014;67(9):1035–43. Epub 2014/05/20. pmid:24837298
- 32. Wolfs CA, Dirksen CD, Kessels A, Willems DC, Verhey FR, Severens JL. Performance of the EQ-5D and the EQ-5D+C in elderly patients with cognitive impairments. Health and quality of life outcomes. 2007;5:33. Epub 2007/06/16. pmid:17570832
- 33. Makai P, Brouwer WB, Koopmanschap MA, Nieboer AP. Capabilities and quality of life in Dutch psycho-geriatric nursing homes: an exploratory study using a proxy version of the ICECAP-O. Quality of life research: an international journal of quality of life aspects of treatment, care and rehabilitation. 2012;21(5):801–12. Epub 2011/09/07.
- 34. Richardson J, Iezzi A, Khan MA, Maxwell A. Validity and reliability of the Assessment of Quality of Life (AQoL)-8D multi-attribute utility instrument. The Patient-Patient-Centered Outcomes Research. 2014;7(1):85–96. pmid:24271592
- 35. Richardson J, Khan MA, Iezzi A, Maxwell A. Comparing and explaining differences in the magnitude, content, and sensitivity of utilities predicted by the EQ-5D, SF-6D, HUI 3, 15D, QWB, and AQoL-8D multiattribute utility instruments. Medical decision making: an international journal of the Society for Medical Decision Making. 2015;35(3):276–91. Epub 2014/08/28.
- 36. Chen G, Iezzi A, McKie J, Khan MA, Richardson J. Diabetes and quality of life: comparing results from utility instruments and Diabetes-39. Diabetes research and clinical practice. 2015;109(2):326–33. pmid:26013567
- 37. Tong A, Wong G, McTaggart S, Henning P, Mackie F, Carroll RP, et al. Quality of life of young adults and adolescents with chronic kidney disease. The Journal of pediatrics. 2013;163(4):1179–85. e5. pmid:23800404