Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Mapping expanded prostate cancer index composite to EQ5D utilities to inform economic evaluations in prostate cancer: Secondary analysis of NRG/RTOG 0415

  • Rahul Khairnar ,

    Contributed equally to this work with: Rahul Khairnar, Stephanie L. Pugh, Ester Villalonga Olives, C. Daniel Mullins, Francis B. Palumbo, Fadia T. Shaya, Soren M. Bentzen, Mark V. Mishra

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Current address: Evidence for Access, US Medical Affairs, Genentech Inc., South San Francisco, CA, United States of America

    Affiliation Department of Pharmaceutical Health Services Research, University of Maryland School of Pharmacy, Baltimore, MD, United States of America

  • Stephanie L. Pugh ,

    Contributed equally to this work with: Rahul Khairnar, Stephanie L. Pugh, Ester Villalonga Olives, C. Daniel Mullins, Francis B. Palumbo, Fadia T. Shaya, Soren M. Bentzen, Mark V. Mishra

    Roles Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – review & editing

    Affiliation NRG Oncology Statistics and Data Management Center, Philadelphia, PA, United States of America

  • Howard M. Sandler ,

    Roles Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – review & editing

    ‡ These authors also contributed equally to this work.

    Affiliation Department of Radiation Oncology, Cedars-Sinai Medical Center, Los Angeles, CA, United States of America

  • W. Robert Lee ,

    Roles Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – review & editing

    ‡ These authors also contributed equally to this work.

    Affiliation Department of Radiation Oncology, Duke University, Durham, NC, United States of America

  • Ester Villalonga Olives ,

    Contributed equally to this work with: Rahul Khairnar, Stephanie L. Pugh, Ester Villalonga Olives, C. Daniel Mullins, Francis B. Palumbo, Fadia T. Shaya, Soren M. Bentzen, Mark V. Mishra

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Visualization, Writing – review & editing

    Affiliation Department of Pharmaceutical Health Services Research, University of Maryland School of Pharmacy, Baltimore, MD, United States of America

  • C. Daniel Mullins ,

    Contributed equally to this work with: Rahul Khairnar, Stephanie L. Pugh, Ester Villalonga Olives, C. Daniel Mullins, Francis B. Palumbo, Fadia T. Shaya, Soren M. Bentzen, Mark V. Mishra

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing – review & editing

    Affiliation Department of Pharmaceutical Health Services Research, University of Maryland School of Pharmacy, Baltimore, MD, United States of America

  • Francis B. Palumbo ,

    Contributed equally to this work with: Rahul Khairnar, Stephanie L. Pugh, Ester Villalonga Olives, C. Daniel Mullins, Francis B. Palumbo, Fadia T. Shaya, Soren M. Bentzen, Mark V. Mishra

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – review & editing

    Affiliation Department of Pharmaceutical Health Services Research, University of Maryland School of Pharmacy, Baltimore, MD, United States of America

  • Deborah W. Bruner ,

    Roles Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Visualization, Writing – review & editing

    ‡ These authors also contributed equally to this work.

    Affiliation Department of Radiation Oncology, Emory University, Atlanta, GA, United States of America

  • Fadia T. Shaya ,

    Contributed equally to this work with: Rahul Khairnar, Stephanie L. Pugh, Ester Villalonga Olives, C. Daniel Mullins, Francis B. Palumbo, Fadia T. Shaya, Soren M. Bentzen, Mark V. Mishra

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing – review & editing

    Affiliation Department of Pharmaceutical Health Services Research, University of Maryland School of Pharmacy, Baltimore, MD, United States of America

  • Soren M. Bentzen ,

    Contributed equally to this work with: Rahul Khairnar, Stephanie L. Pugh, Ester Villalonga Olives, C. Daniel Mullins, Francis B. Palumbo, Fadia T. Shaya, Soren M. Bentzen, Mark V. Mishra

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – review & editing

    Affiliation Department of Epidemiology and Public Health, University of Maryland School of Medicine, Baltimore, MD, United States of America

  • Amit B. Shah ,

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Visualization, Writing – review & editing

    ‡ These authors also contributed equally to this work.

    Affiliation WellSpan Health-York Cancer Center, York, PA, United States of America

  • Shawn C. Malone ,

    Roles Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Visualization, Writing – review & editing

    ‡ These authors also contributed equally to this work.

    Affiliation Ottawa Hospital and Cancer Center, Ottawa, ON, Canada

  • Jeff M. Michalski ,

    Roles Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – review & editing

    ‡ These authors also contributed equally to this work.

    Affiliation Department of Radiation Oncology, Washington University, St. Louis, MO, United States of America

  • Ian S. Dayes ,

    Roles Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – review & editing

    ‡ These authors also contributed equally to this work.

    Affiliation Juravinski Cancer Center at Hamilton Health Sciences, Hamilton, ON, Canada

  • Samantha A. Seaward ,

    Roles Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – review & editing

    ‡ These authors also contributed equally to this work.

    Affiliation Kaiser Permanente Northern California, Oakland, CA, United States of America

  • Michele Albert ,

    Roles Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – review & editing

    ‡ These authors also contributed equally to this work.

    Affiliation Saint Anne’s Hospital, Fall River, MA, United States of America

  • Adam D. Currey ,

    Roles Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – review & editing

    ‡ These authors also contributed equally to this work.

    Affiliation Zablocki VAMC and the Medical College of Wisconsin, Milwaukee, WI, United States of America

  • Thomas M. Pisansky ,

    Roles Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – review & editing

    ‡ These authors also contributed equally to this work.

    Affiliation Department of Radiation Oncology, Mayo Clinic Rochester, Rochester, MN, United States of America

  • Yuhchyau Chen ,

    Roles Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – review & editing

    ‡ These authors also contributed equally to this work.

    Affiliation Department of Radiation Oncology, University of Rochester, Rochester, NY, United States of America

  • Eric M. Horwitz ,

    Roles Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – review & editing

    ‡ These authors also contributed equally to this work.

    Affiliation Department of Radiation Oncology, Fox Chase Cancer Center, Philadelphia, PA, United States of America

  • Albert S. DeNittis ,

    Roles Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – review & editing

    ‡ These authors also contributed equally to this work.

    Affiliation Department of Radiation Oncology, Main Line Health, Philadelphia, PA, United States of America

  • Felix Y. Feng ,

    Roles Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – review & editing

    ‡ These authors also contributed equally to this work.

    Affiliation Department of Radiation Oncology, University of California San Francisco, San Francisco, CA, United States of America

  •  [ ... ],
  • Mark V. Mishra

    Contributed equally to this work with: Rahul Khairnar, Stephanie L. Pugh, Ester Villalonga Olives, C. Daniel Mullins, Francis B. Palumbo, Fadia T. Shaya, Soren M. Bentzen, Mark V. Mishra

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    mmishra@umm.edu

    Affiliation Department of Radiation Oncology, University of Maryland School of Medicine, Baltimore, MD, United States of America

  • [ view all ]
  • [ view less ]

Abstract

Purpose

The Expanded Prostate Cancer Index Composite (EPIC) is the most commonly used patient reported outcome (PRO) tool in prostate cancer (PC) clinical trials, but health utilities associated with the different health states assessed with this tool are unknown, limiting our ability to perform cost-utility analyses. This study aimed to map EPIC tool to EuroQoL-5D-3L (EQ5D) to generate EQ5D health utilities.

Methods and materials

This is a secondary analysis of a prospective, randomized non-inferiority clinical trial, conducted between 04/2006 and 12/2009 at cancer centers across the United States, Canada, and Switzerland. Eligible patients included men >18 years with a known diagnosis of low-risk PC. Patient HRQoL data were collected using EPIC and health utilities were obtained using EQ5D. Data were divided into an estimation sample (n = 765, 70%) and a validation sample (n = 327, 30%). The mapping algorithms that capture the relationship between the instruments were estimated using ordinary least squares (OLS), Tobit, and two-part models. Five-fold cross-validation (in-sample) was used to compare the predictive performance of the estimated models. Final models were selected based on root mean square error (RMSE).

Results

A total of 565 patients in the estimation sample had complete information on both EPIC and EQ5D questionnaires at baseline. Mean observed EQ5D utility was 0.90±0.13 (range: 0.28–1) with 55% of patients in full health. OLS models outperformed their counterpart Tobit and two-part models for all pre-determined model specifications. The best model fit was: “EQ5D utility = 0.248541 + 0.000748*(Urinary Function) + 0.001134*(Urinary Bother) + 0.000968*(Hormonal Function) + 0.004404*(Hormonal Bother)– 0.376487*(Zubrod) + 0.003562*(Urinary Function*Zubrod)”; RMSE was 0.10462.

Conclusions

This is the first study to identify a comprehensive set of mapping algorithms to generate EQ5D utilities from EPIC domain/ sub-domain scores. The study results will help estimate quality-adjusted life-years in PC economic evaluations.

Introduction

Treatment of localized prostate cancer (PC) continues to be a major focus of public health policy debate. Patients can choose from a wide range of management options, ranging from radical prostatectomy, radiation therapy, or active surveillance [1, 2]. Survival rates do not differ significantly between the different approaches, making treatment decision-making a complex and individualized process [3, 4].

Given the high global burden of PC, there have been calls for cost-effectiveness evaluations to better understand the economic implications of PC management. Cost-effectiveness analyses (CEAs) allow for the comparison of alternative treatment options in terms of incremental costs relative to quality-adjusted life-years (QALY) gained following treatment [5]. However, such evaluations are highly dependent on our ability to not only accurately model probabilities of experiencing cancer recurrence, overall survival, and treatment side effects over time, but also our ability to accurately calculate ‘utility’ values associated with the range of health states that can be experienced by a patient following PC treatment. Utility values are a measure of how patients view the overall quality of their life, with ‘0’ (corresponding to death) to ‘1’ (corresponding to perfect health) [6]. The results of previous PC CEAs have been sensitive to the utility values attached to health states captured in the trials informing them, underscoring the need for reliable and valid utilities [7, 8].

Utilities necessary for economic evaluations can be directly elicited in trials through use of a preference-based measure (PBM) [5, 9]. However, many trials do not collect a PBM, and instead include one or more patient-reported outcome measures (PROMs), which do not have established utility values. For example, the Expanded Prostate Cancer Index Composite (EPIC), one of the most commonly used PRO tools in prostate cancer clinical trials (including a pivotal trial comparing surgery to radiation and active surveillance [10, 11], as well as an ongoing study comparing protons to photons [12]) does not have associated utility values.

Utility mapping involves development and use of a statistical model or algorithm that links the outcomes from a PROM and a PBM to generate health utility values [5, 1315]. Although clinical trials now often incorporate health utility estimation in their design, studies conducted in the past remain part of the evidence base as comparators for the evaluation of new technologies and have not always included a PBM [1618]. Therefore, when utility information is not collected in a study, mapping has been proposed as an alternative solution and recommended as the second-best option after direct utility estimation for economic evaluations of interventions. The objective of this study is to map EPIC to health utilities that can be applied to future PC CEAs.

Methods

This mapping study followed methodological guidance issued by National Institute for Health and Care Excellence (NICE), and reporting standards guidance outlined in the 2015 MAPS (MApping onto Preference-based measures reporting Standards) statement and 2017 International Society for Pharmacoeconomics and Outcomes Research (ISPOR) Task Force Report [1315, 19]. A battery of regression model specifications were tested to identify a set of mapping algorithms with and without demographic and clinical covariates.

Data source

The data for this study came from a previously published international multicenter, open-label randomized clinical trial (RCT) of patients with low-risk PC. This trial used a non-inferiority design to determine whether the efficacy of a hypo-fractionated treatment schedule was not worse than a conventional schedule in men with low-risk PC. The results of this trial showed no significant differences in outcomes between the two treatment modalities. Bruner et al examined the HRQoL outcomes in this trial and reported no clinically significant between-arm differences in EPIC domain scores and EQ-5D index and VAS scores through 5 years following the completion of radiation [20]. This data source was chosen for our mapping study as it collects data on both HRQoL measures of interest in PC patients undergoing treatment.

The Institutional Review Board approval was sought and received from the University Of Maryland School Of Medicine and NRG Oncology.

Sample selection

The study sample consisted of patients who had complete information on both EPIC and EQ5D at baseline. A 70% random sample was extracted from the 1,092 analyzable patients from the trial to create the estimation cohort and the remainder 30% sample was used as a validation cohort, to predict the performance of the estimated mapping algorithms. In addition to the HRQoL data, demographic characteristics and clinical covariates were also extracted.

Outcome measures

EuroQol-5D-3L.

The EQ5D questionnaire is a generic PBM, recommended by NICE for use in economic evaluations and asks respondents to describe their health in five dimensions (mobility, self-care, usual activities, pain/ discomfort, and anxiety/ depression), each of which can be at one of three severity levels (1: no problems/ 2: some or moderate problems/ 3: extreme problems) [14, 15]. Two hundred forty-three combinations can be described in this way (35 combinations). Additionally, health states corresponding to unconsciousness and immediate death are also included in the valuation process [21]. The EQ-5D tariffs for our study were obtained using the US valuation of EQ-5D health states performed by Shaw et al. in a sample of 4,048 civilian noninstitutionalized English- and Spanish-speaking adults, aged 18 and older, who resided in the United States (50 states plus the District of Columbia) in 2002 [22].

Expanded Prostate Cancer Index Composite (EPIC).

EPIC is a comprehensive instrument designed to evaluate patient function and bother after PC treatment [3]. EPIC has been validated in men with localized PC who underwent surgery, external beam radiation, or brachytherapy with or without hormonal adjuvants. EPIC is sensitive to specific HRQoL effects of these therapies and to HRQoL effects of cancer progression [3, 23]. EPIC assesses the disease-specific aspects of PC and its therapies and is comprised of four summary domains (Urinary, Bowel, Sexual and Hormonal). In addition, each Domain Summary Score has measurable Function Subscale and Bother Subscale components. Response options for each EPIC item form a Likert scale and multi-item scale scores are transformed linearly to a 0–100 scale, with higher scores representing better HRQoL [3].

Conceptual overlap

Pearson’s correlation coefficients were used to determine the degree of conceptual overlap between EPIC domain and sub-domain scores and EQ5D index score [24, 25].

Model development

Linear regression is the most common approach to derive mapping function [1315]. To account for the anticipated bimodal distribution of EQ5D for our study population, other functional forms were also explored [26]. Specifically, Tobit and two-part models were estimated to account for a significant proportion of patients in full health. The Tobit model assumes that the EQ5D utility data is censored at 1 and that the true value has a normal distribution whose mean is given by a linear combination of the covariates. Two-part models model the probability of being in full health using a logistic regression, and then model the remainder of the distribution using a OLS regression model [27].

For each of the functional forms, multiple model specifications were estimated (S1 Table). Separate sets of models with EPIC domains (group 1), EPIC sub-domains (group 2), EPIC domains with demographic characteristics (group 3), EPIC sub-domains with demographic characteristics (group 4), EPIC domains with demographic characteristics and clinical covariates (group 5), and finally, EPIC sub-domains with demographic characteristics and clinical covariates (group 6) were chosen to accommodate different possible combinations of variables in EPIC datasets available to researchers. Higher second and third order polynomials for domain scores, subdomain scores, and age were explored to examine non-linear relationships; interaction terms for race and Zubrod performance status were also explored. No further covariates were explored in an effort to be able to use the mapping algorithms in a wide range of datasets. Along with the full models specified in S1 Table, reduced models were also estimated using stepwise selection (forward selection; significance level of 0.25 required for entry and to remain in the model) in order to identify parsimonious models with high predictive ability.

Assessing model performance

The 70% random sample (n = 765) was used for estimation and internal validation of the mapping algorithms. Five-fold cross-validation was employed for estimation and internal validation [28, 29]. In 5-fold cross-validation, the data are split into 5 equal parts and the model is fitted on 4 parts with the 5th being held out for validation. The fitted model of the 4 selected parts is used to compute the predicted residual sum of squares on the 5th omitted part, and this process is repeated for each of the 5 parts. The sum of the 5 predicted residual sums of squares is obtained for each fitted model and is the estimate of the prediction error. Indices such as the absolute mean of the residuals or errors (MAE), and square root of the mean of the residual sum of squares (RMSE) are used to determine model performance. RMSE, a measure of individual prediction error, attaches relatively higher weights to large errors, making it an ideal metric when large errors are undesirable. This study used RMSE for identifying the candidate algorithms from each of the six groups of model specifications in S1 Table. Models with lower RMSE values represent higher predictive ability. A prediction model usually performs better with the data that were used in its development. Therefore, it is critical to evaluate how well the model works in other datasets. In absence of an external dataset, validation was performed by scoring the remaining 30% random sample (n = 327) using the candidate algorithms identified using the 5-fold cross validation in the 70% estimation sample.

Results

Descriptive statistics

The study cohort comprised of patients who consented to QOL collection and had complete baseline data on EPIC domains/subdomains as well as EQ5D dimensions. For models with EPIC domains as the primary independent variables, 565 patients in the 70% estimation sample and 232 patients in the 30% validation sample consented and had complete baseline data on EPIC domains and EQ5D. For models with EPIC sub-domains as the primary independent variables, 507 patients in the 70% estimation sample and 213 patients in the 30% validation sample consented and had complete baseline EPIC sub-domain data and EQ5D. Patient characteristics for each of these cohorts are summarized in Table 1. EQ5D distribution was highly skewed with >50% patients in full health in each cohort; distribution plots revealed a bimodal distribution peaking at full health and at health utility value of 0.8 (S1 Fig). Table 2 summarizes the mean EPIC domain/ sub-domain scores in the estimation cohort and validation cohort.

thumbnail
Table 1. Baseline characteristics of patients with complete EPIC domain and subdomain data.

https://doi.org/10.1371/journal.pone.0249123.t001

thumbnail
Table 2. EPIC domain and sub-domain scores and EQ5D scores at all study time-points.

https://doi.org/10.1371/journal.pone.0249123.t002

Conceptual overlap

Pearson’s correlations between EQ5D and EPIC domains/ sub-domains showed evidence of conceptual overlap between the two measures. In the estimation cohort for models with EPIC domains, moderate correlations were found between EQ5D utility and urinary (r = 0.38), bowel (r = 0.34) and hormonal (r = 0.55) domains of EPIC; sexual domain was weakly correlated (r = 0.18) with EQ5D utility. In the estimation cohort for models with EPIC sub-domains, low to moderate correlations were found between EQ5D and urinary function (r = 0.31), urinary bother (r = 0.36), urinary irritation (r = 0.36), urinary incontinence (r = 0.27), bowel function (r = 0.30), bowel bother (r = 0.32), hormonal function (r = 0.43), hormonal bother (r = 0.53), sexual function (r = 0.17), and sexual bother (r = 0.16).

Mapping EPIC to EQ5D utilities

OLS, Tobit, and two-part models were estimated for all the model specifications in S1 Table, resulting in 144 unique full regression models. The best performing models for each of these regression types across the six groups of independent variables are presented in Table 3.

thumbnail
Table 3. Performance of full models in internal (5-fold cross-validation) and validation sets.

https://doi.org/10.1371/journal.pone.0249123.t003

The OLS models outperformed the other model types in all six model specification groups. The best performing full model was an OLS model with EPIC sub-domains, age, race, Zubrod performance status, and baseline PSA levels (model 6i) with an RMSE of 0.10429:

Predicted EQ5D = 2.922434 + 0.003627*Urinary Function + 0.004125*Urinary Bother – 0.003625*Urinary irritation – 0.002242*Urinary Incontinence – 0.0000058476*Bowel Function – 0.000690*Bowel Bother + 0.000589*Sexual Function – 0.000244*Sexual Bother + 0.000721*Hormonal Function + 0.004691*Hormonal Bother – 0.126445*Age + 0.001997*(Age)2 – 0.000010336*(Age)3 + 0.009922*Race(other) – 0.456669*Zubrod + 0.016593*Urinary Function*Zubrod + 0.008613*Urinary Bother*Zubrod – 0.011*Urinary Irritation*Zubrod – 0.011342*Urinary Incontinence*Zubrod + 0.000711*Bowel Function*Zubrod + 0.003675*Bowel Bother*Zubrod – 0.001631*Sexual Function*Zubrod + 0.00008517*Sexual Bother*Zubrod – 0.000201*Hormonal Function*Zubrod – 0.002221*Hormonal Bother*Zubrod + 0.000332*PSA(≥4)

Reduced models for all six model specification groups were estimated to identify parsimonious models with high predictive ability (Table 4). For the reduced models, only OLS functional form was tested as OLS full models outperformed other model types. The best performing reduced model had an RMSE of 0.10462:

Predicted EQ5D = 0.248541 + 0.000748*Urinary Function + 0.001134*Urinary Bother + 0.000968*Hormonal Function + 0.004404*Hormonal Bother – 0.376487 *Zubrod + 0.003562*Urinary Function*Zubrod

The candidate full and reduced models for the remaining specifications are presented in S2 Table. Validation using these candidate models resulted in slightly higher RMSE values compared to 5-fold cross-validation, but the results remained consistent with the 5-fold cross-validation (Tables 3 and 4). S2 Fig presents the plot of predicted vs. observed EQ5D utilities for the best performing models in each group. The EQ5D utilities appear to be under-predicted at higher health states and over-predicted for lower health states. However, the mean predicted EQ5D utilities were very similar to the observed EQ5D utilities.

thumbnail
Table 4. Performance of reduced models in internal (5-fold cross-validation) and validation sets.

https://doi.org/10.1371/journal.pone.0249123.t004

Discussion

This study identified a set of algorithms that map EPIC, a disease-specific HRQoL instrument in PC, to EQ5D, a generic preference-based instrument, using data from a randomized clinical trial. While there is considerable variation in the methodologies of mapping studies, a majority have employed some form of direct mapping strategy [16]. This mapping study followed the guidance from NICE and ISPOR task force and explored several functional forms and specifications to find the most straightforward model with highest predictive performance [1315].

Tobit and two-part models were tested as their assumptions were compatible with the bimodal distribution of EQ5D utilities. However, they were outperformed by their counterpart OLS models for every model specification tested. Previous mapping studies have reported similar findings, where OLS regression provided better predictive ability than theoretically more robust regression procedures [16, 30, 31]. Separate algorithms were estimated using EPIC domains or subdomains data alone, and in combination with demographic covariates only or both demographic and clinical covariates, resulting in six unique sets of model specifications. Best-performing models for each of these sets were identified, so that researchers can use a model depending on the level of data at their disposal, thus, increasing the generalizability of this mapping exercise. In addition to the full models, reduced models were also estimated to identify parsimonious models with high predictive ability. Addition of demographic variables did not improve the predictive ability of the models; however, clinical covariates, specifically Zubrod performance status, improved the predictive performance. This was observed in both full and reduced models, where addition of clinical covariates resulted in lower RMSE values. Generally, models with EPIC sub-domains exhibited better predictive performance compared to their counterpart models with EPIC domains.

There are several strengths of this study that are worth mentioning. To the best of our knowledge, this is the first study to map EPIC to obtain health utilities for patients with PC. Bremner at al. mapped Prostate Cancer Index (PCI) to Patient-Oriented Prostate Utility Scale (PORPUS-U) utilities to incorporate historically collected HRQoL data in longitudinal datasets such as CaPSURE in economic evaluations [7]. EPIC is a more comprehensive instrument that evolved from PCI and is the most widely used PC specific HRQoL instrument in trials and clinical practice [23]. The algorithms identified in this study will allow incorporation of a vast body of evidence on comparative effectiveness of PC treatments in future economic evaluations. EQ5D is the recommended PBM by HTA bodies such as NICE, and considerable differences exist, even between utilities derived from different generic PBMs. Inconsistencies in the choice of PBMs in mapping studies would make comparisons across treatments and disease areas difficult. Unlike Bremnen et al., EQ5D, a generic PBM, was chosen in order to make comparisons across disease areas possible.

Mapping algorithms perform best when the target population has characteristics similar to the source population. While the trial sample does not represent every PC patient, a large proportion of patients with PC fall in this category. Patients with low-risk PC, as in this sample, tend to have high performance status and high EQ5D scores with minimal variability which may differ substantially from high-risk patients. Thus, caution should be exercised in extrapolating these algorithms to patients with high-risk PC. Future analyses could build on this work and identify best performing models for patients with high-risk PC.

As with any mapping study, this study has some limitations that merit discussion. Validation of candidate models in the 30% sample resulted in slightly higher RMSE values than those observed in the estimation cohort. This was expected as prediction models usually perform better with the data that were used in its development. However, models with lower RMSE values in the 5-fold cross-validation also had lower RMSE values in the validation set, supporting the robust predictive performance of the candidate algorithms in external datasets. While the health utilities for milder health states were under-predicted and worse health states were over-predicted, the mean predicted utilities at the population level were very similar to the observed mean utilities. These mapping algorithms are best suited to predict mean utilities and may not predict individual level EQ5D utilities with high degree of accuracy. Finally, inclusion in the estimation sample required complete data on EPIC domains/sub-domains along with EQ5D utilities. While differences may exist between patients who completed the questionnaires versus those who did not, the objective of our regression models was prediction and not estimation, therefore, risk of bias is minimal with using this subset of patients. There is considerable heterogeneity in the data sources that have been used in mapping studies; future studies should compare the impact of these differences on the resulting algorithms.

In conclusion, HRQoL measures can be descriptive (generic, or condition-specific) or preference-based (health utility measures) [32, 33]. It is often not feasible to include all these types of instruments in a given study, as this can be a costly and time-consuming endeavor. These studies however, form an important part of the evidence base for the effectiveness of an intervention. Mapping EPIC to EQ5D utilities bridges an important outcomes gap, allowing incorporation of a vast body of literature measuring descriptive HRQoL data in PC patients in the healthcare decision-making process.

Supporting information

S1 Fig. Distribution plot of EQ5D in the estimation cohorts.

A. Patients with Complete Epic Domain Data (N = 565). B. Patients with Complete Epic Sub-Domain Data (N = 507).

https://doi.org/10.1371/journal.pone.0249123.s001

(ZIP)

S2 Fig. Plot of observed vs. predicted EQ5D utilities for candidate full models.

https://doi.org/10.1371/journal.pone.0249123.s002

(ZIP)

S3 Fig. Bland-Altman plot for full candidate model using EPIC sub-domain data.

https://doi.org/10.1371/journal.pone.0249123.s003

(TIF)

S2 Table. Candidate mapping algorithms and external validation results in the 30% sample.

https://doi.org/10.1371/journal.pone.0249123.s005

(DOCX)

S3 Table. Baseline characteristics of patients with complete EPIC domain data.

https://doi.org/10.1371/journal.pone.0249123.s006

(DOCX)

S4 Table. EQ5D and EPIC domain scores for patients with complete EPIC domain data.

https://doi.org/10.1371/journal.pone.0249123.s007

(DOCX)

S5 Table. EPIC sub-domain scores for patients with complete EPIC sub-domain data.

https://doi.org/10.1371/journal.pone.0249123.s008

(DOCX)

S6 Table. Baseline characteristics of patients included vs not included in complete EPIC sub-domain analysis.

https://doi.org/10.1371/journal.pone.0249123.s009

(DOCX)

Acknowledgments

We acknowledge Lyudmila DeMora, MS, for her statistical support with validation.

References

  1. 1. Sanda Martin G., Cadeddu Jeffrey A., Kirkby Erin, Chen Ronald C., Crispino Tony, Fontanarosa Joann, et al. Clinically Localized Prostate Cancer: AUA/ASTRO/SUO Guideline. Part I: Risk Stratification, Shared Decision Making, and Care Options. J Urol. 2018 Mar 1;199(3):683–90. pmid:29203269
  2. 2. Sanda Martin G., Cadeddu Jeffrey A., Kirkby Erin, Chen Ronald C., Crispino Tony, Fontanarosa Joann, et al. Clinically Localized Prostate Cancer: AUA/ASTRO/SUO Guideline. Part II: Recommended Approaches and Details of Specific Care Options. J Urol. 2018 Apr 1;199(4):990–7. pmid:29331546
  3. 3. Wei JT, Dunn RL, Litwin MS, Sandler HM, Sanda MG. Development and validation of the expanded prostate cancer index composite (EPIC) for comprehensive assessment of health-related quality of life in men with prostate cancer. Urology. 2000 Dec 1;56(6):899–905. pmid:11113727
  4. 4. Szymanski KM, Wei JT, Dunn RL, Sanda MG. Development and Validation of an Abbreviated Version of the Expanded Prostate Cancer Index Composite Instrument for Measuring Health-related Quality of Life Among Prostate Cancer Survivors. Urology. 2010 Nov 1;76(5):1245–50. pmid:20350762
  5. 5. Hernández Alava M, Wailoo A, Wolfe F, Michaud K. A Comparison of Direct and Indirect Methods for the Estimation of Health Utilities from Clinical Outcomes. Med Decis Making. 2014 Oct 1;34(7):919–30. pmid:24025662
  6. 6. Thursz M, Forrest E, Roderick P, Day C, Austin A, O’Grady J, et al. Health economic evaluation [Internet]. The clinical effectiveness and cost-effectiveness of STeroids Or Pentoxifylline for Alcoholic Hepatitis (STOPAH): a 2 × 2 factorial randomised controlled trial. NIHR Journals Library; 2015 [cited 2020 Sep 13]. Available from: https://www.ncbi.nlm.nih.gov/books/NBK333624/ pmid:26691209
  7. 7. Bremner KE, Mitsakakis N, Wilson L, Krahn MD. Predicting utility scores for prostate cancer: mapping the Prostate Cancer Index to the Patient-Oriented Prostate Utility Scale (PORPUS). Prostate Cancer Prostatic Dis. 2014 Mar;17(1):47–56. pmid:24126796
  8. 8. Levy JF, Khairnar R, Louie AV, Showalter TN, Mullins CD, Mishra MV. Evaluating the Cost-Effectiveness of Hydrogel Rectal Spacer in Prostate Cancer Radiation Therapy. Pract Radiat Oncol. 2019 Mar 1;9(2):e172–9. pmid:30342180
  9. 9. Brazier JE, Yang Y, Tsuchiya A, Rowen DL. A review of studies mapping (or cross walking) non-preference based measures of health to generic preference-based measures. Eur J Health Econ. 2010 Apr;11(2):215–25. pmid:19585162
  10. 10. Hamdy FC, Donovan JL, Lane JA, Mason M, Metcalfe C, Holding P, et al. 10-Year Outcomes after Monitoring, Surgery, or Radiotherapy for Localized Prostate Cancer. N Engl J Med. 2016 Oct 13;375(15):1415–24. pmid:27626136
  11. 11. Donovan JL, Hamdy FC, Lane JA, Mason M, Metcalfe C, Walsh E, et al. Patient-Reported Outcomes after Monitoring, Surgery, or Radiotherapy for Prostate Cancer. N Engl J Med. 2016 Oct 13;375(15):1425–37. pmid:27626365
  12. 12. Mishra MV, Aggarwal S, Bentzen SM, Knight N, Mehta MP, Regine WF. Establishing Evidence-Based Indications for Proton Therapy: An Overview of Current Clinical Trials. Int J Radiat Oncol Biol Phys. 2017 01;97(2):228–35. pmid:28068231
  13. 13. Wailoo AJ, Hernandez-Alava M, Manca A, Mejia A, Ray J, Crawford B, et al. Mapping to Estimate Health-State Utility from Non–Preference-Based Outcome Measures: An ISPOR Good Practices for Outcomes Research Task Force Report. Value Health. 2017 Jan 1;20(1):18–27. pmid:28212961
  14. 14. Longworth L, Rowen D. Mapping to Obtain EQ-5D Utility Values for Use in NICE Health Technology Assessments. Value Health. 2013 Jan 1;16(1):202–10. pmid:23337232
  15. 15. Longworth L, Rowen D. DSU Technical Support Document 10: The Use of Mapping Methods to Estimate Health State Utility Values.:31.
  16. 16. Dakin H. Review of studies mapping from quality of life or clinical measures to EQ-5D: an online database. Health Qual Life Outcomes. 2013 Sep 5;11(1):151.
  17. 17. Wolowacz SE, Briggs A, Belozeroff V, Clarke P, Doward L, Goeree R, et al. Estimating Health-State Utility for Economic Models in Clinical Studies: An ISPOR Good Research Practices Task Force Report. Value Health. 2016 Sep 1;19(6):704–19. pmid:27712695
  18. 18. Petrou S, Gray A. Economic evaluation alongside randomised controlled trials: design, conduct, analysis, and reporting. BMJ [Internet]. 2011 Apr 7 [cited 2019 Dec 1];342. Available from: https://www.bmj.com/content/342/bmj.d1548
  19. 19. Petrou S, Rivero-Arias O, Dakin H, Longworth L, Oppe M, Froud R, et al. Preferred reporting items for studies mapping onto preference-based outcome measures: The MAPS statement. Health Qual Life Outcomes. 2015 Aug 1;13(1):106.
  20. 20. Bruner DW, Pugh SL, Lee WR, Hall WA, Dignam JJ, Low D, et al. Quality of Life in Patients With Low-Risk Prostate Cancer Treated With Hypofractionated vs Conventional Radiotherapy: A Phase 3 Randomized Clinical Trial. JAMA Oncol. 2019 May 1;5(5):664. pmid:30763425
  21. 21. Hua A-Y, Westin O, Senorski EH, Svantesson E, Grassi A, Zaffagnini S, et al. Mapping functions in health-related quality of life: mapping from the Achilles Tendon Rupture Score to the EQ-5D. Knee Surg Sports Traumatol Arthrosc. 2018 Oct 1;26(10):3083–8. pmid:29691617
  22. 22. Shaw JW, Johnson JA, Coons SJ. US Valuation of the EQ-5D Health States: Development and Testing of the D1 Valuation Model. Med Care. 2005;43(3):203–20. pmid:15725977
  23. 23. Chipman Jonathan J., Sanda Martin G., Dunn Rodney L., Wei John T., Litwin Mark S., Crociani Catrina M., et al. Measuring and Predicting Prostate Cancer Related Quality of Life Changes Using EPIC for Clinical Practice. J Urol. 2014 Mar 1;191(3):638–45. pmid:24076307
  24. 24. Davison NJ, Thompson AJ, Turner AJ, Longworth L, McElhone K, Griffiths CEM, et al. Generating EQ-5D-3L Utility Scores from the Dermatology Life Quality Index: A Mapping Study in Patients with Psoriasis. Value Health. 2018 Aug 1;21(8):1010–8. pmid:30098665
  25. 25. Pickard AS, Wilke CT, Lin H-W, Lloyd A. Health Utilities Using the EQ-5D in Studies of Cancer. PharmacoEconomics. 2007 May 1;25(5):365–84. pmid:17488136
  26. 26. Hernández Alava M, Wailoo AJ, Ara R. Tails from the Peak District: Adjusted Limited Dependent Variable Mixture Models of EQ-5D Questionnaire Health State Utility Values. Value Health. 2012 May 1;15(3):550–61. pmid:22583466
  27. 27. Pullenayegum EM, Tarride J-E, Xie F, Goeree R, Gerstein HC, O’Reilly D. Analysis of Health Utility Data When Some Subjects Attain the Upper Bound of 1: Are Tobit and CLAD Models Appropriate? Value Health. 2010 Jun 1;13(4):487–94. pmid:20230549
  28. 28. Proskorovsky I, Lewis P, Williams CD, Jordan K, Kyriakou C, Ishak J, et al. Mapping EORTC QLQ-C30 and QLQ-MY20 to EQ-5D in patients with multiple myeloma. Health Qual Life Outcomes. 2014 Mar 11;12(1):35. pmid:24618388
  29. 29. Kohavi R. A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection. In ljcai. 14(2):1137–45.
  30. 30. Askew RL, Swartz RJ, Xing Y, Cantor SB, Ross MI, Gershenwald JE, et al. Mapping FACT-Melanoma Quality-of-Life Scores to EQ-5D Health Utility Weights. Value Health. 2011 Sep 1;14(6):900–6. pmid:21914512
  31. 31. Chuang L-H, Kind P. Converting the SF-12 into the EQ-5D. PharmacoEconomics. 2009 Jun 1;27(6):491–505. pmid:19640012
  32. 32. Bremner KE, Chong CAKY, Tomlinson G, Alibhai SMH, Krahn MD. A Review and Meta-Analysis of Prostate Cancer Utilities. Med Decis Making. 2007 May 1;27(3):288–98. pmid:17502448
  33. 33. Karimi M, Brazier J. Health, Health-Related Quality of Life, and Quality of Life: What is the Difference? PharmacoEconomics. 2016 Jul 1;34(7):645–9. pmid:26892973