Figures
Abstract
Background
Geriatric Assessment is an appropriate method for identifying older cancer patients at risk of life-threatening events during therapy. Yet, it is underused in practice, mainly because it is time- and resource-consuming. This study aims to identify the best screening tool to identify older cancer patients requiring geriatric assessment by comparing the performance of two short assessment tools the G8 and the Vulnerable Elders Survey (VES-13).
Patients and Methods
The diagnostic accuracy of the G8 and the (VES-13) were evaluated in a prospective cohort study of 1674 cancer patients accrued before treatment in 23 health care facilities. 1435 were eligible and evaluable. Outcome measures were multidimensional geriatric assessment (MGA), sensitivity (primary), specificity, negative and positive predictive values and likelihood ratios of the G8 and VES-13, and predictive factors of 1-year survival rate.
Results
Patient median age was 78.2 years (70-98) with a majority of females (69.8%), various types of cancer including 53.9% breast, and 75.8% Performance Status 0-1. Impaired MGA, G8, and VES-13 were 80.2%, 68.4%, and 60.2%, respectively. Mean time to complete G8 or VES-13 was about five minutes. Reproducibility of the two questionnaires was good. G8 appeared more sensitive (76.5% versus 68.7%, P = 0.0046) whereas VES-13 was more specific (74.3% versus 64.4%, P<0.0001). Abnormal G8 score (HR = 2.72), advanced stage (HR = 3.30), male sex (HR = 2.69) and poor Performance Status (HR = 3.28) were independent prognostic factors of 1-year survival.
Conclusion
With good sensitivity and independent prognostic value on 1-year survival, the G8 questionnaire is currently one of the best screening tools available to identify older cancer patients requiring geriatric assessment, and we believe it should be implemented broadly in daily practice. Continuous research efforts should be pursued to refine the selection process of older cancer patients before potentially life-threatening therapy.
Citation: Soubeyran P, Bellera C, Goyard J, Heitz D, Curé H, Rousselot H, et al. (2014) Screening for Vulnerability in Older Cancer Patients: The ONCODAGE Prospective Multicenter Cohort Study. PLoS ONE 9(12): e115060. https://doi.org/10.1371/journal.pone.0115060
Editor: Bart O. Williams, Van Andel Institute, United States of America
Received: June 20, 2014; Accepted: November 12, 2014; Published: December 11, 2014
Copyright: © 2014 Soubeyran et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The authors confirm that, for approved reasons, some access restrictions apply to the data underlying the findings. This manuscript adheres to the appropriate reporting guidelines and community standards for data availability; Any related manuscripts currently in press or under consideration elsewhere are mentioned in the cover letter and will be uploaded as part of your submission as a related manuscript; Any persons named in the Acknowledgments section of the manuscript, or referred to as the source of a personal communication, have agreed to being so named; All authors have read, and confirm that they meet, ICMJE criteria for authorship; All contributing authors are aware of and agree to the submission of this manuscript.
Funding: The ONCODAGE project was funded by the French National Cancer Institute (Institute National du Cancer; http://www.e-cancer.fr/) and SIRIC BRIO (Site de Recherche Intégrée sur le Cancer – Bordeaux Recherche Intégrée Oncologie; grant INCa-DGOS-Inserm 6046). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Cancer occurs predominantly in the older population, yet patients over 60 years are significantly under-represented in clinical trials in oncology [1], [2]. Consequently, oncologists are confronted with the paucity of clear therapeutic directives, and older patients are often offered reduced treatments and face worse outcomes [3], including an increased risk of toxicity or even early death [4]. With growing numbers of older cancer patients, and considerable heterogeneity among them, effective tools are required for oncologists to better define the trade-off between treatment benefits and toxicity risk.
Several recent reports have strongly suggested that different components of comprehensive (CGA) or multidimensional geriatric assessment (MGA) can be useful in oncology to predict early death [4], functional decline [5], toxicity [6], [7] and ultimately survival [8]–[10], and to adapt cancer treatment [11]. However, despite recommendations from the International Society of Geriatric Oncology (SIOG) [12], CGA is still underused in practice. The likely reason is that it is time- and resource-consuming, which makes it unaffordable for community and small cancer hospitals. Furthermore, true CGA (in contrast to MGA which involves the administration of a range of assessments) is conducted by an experienced geriatrician who interprets and can act upon the MGA results, and geriatricians are rarely available in most cancer treatment structures. This has made the development of shortened instruments essential [13], [14]. To be acceptable for the whole community, such instruments should be performed quickly (less than 10 min) by a nurse or physician trained for the tool completion, but not necessarily trained in geriatrics.
In response to a French National Cancer Institute (INCa) call for proposal, and following escalating appeals for validated geriatric screening tools [15]–[17], we developed the G8 screening tool to identify older cancer patients requiring geriatric assessment. The G8 tool originated from a regional multicenter prospective cohort of 364 cancer patients treated by first-line chemotherapy [18], [19]. The reference test (or “gold-standard”) was defined as at least one abnormal geriatric assessment test among seven. Preliminary results indicated 85% sensitivity and 65% specificity, which was promising given the priority of a screening test for maximum sensitivity to minimize the number of patients not detected.
We subsequently launched the national ONCODAGE multicenter study to validate the G8 tool prospectively. The primary objective was to validate the G8 instrument as a screening tool to identify older cancer patients (>70 years) requiring geriatric assessment by comparing with a reference test of MGA. Secondary objectives included assessing the diagnostic accuracy of G8 in specific sub-populations, the diagnostic accuracy of VES-13 and comparing it to that of G8, the within-patient reproducibility of both tests, and the prognostic value of both tests in terms of 1-year survival. Additional exploratory analyses included the assessment of the diagnostic accuracy of G8 and VES-13 using a modified reference test (at least two MGA tests with abnormal scores), and sensitivity analyses to assess the impact of missing questionnaires in the definition of the reference test.
Methods
Patients
We recruited patients from 23 health care facilities, including the 15 INCa-accredited Regional Coordination Units for Geriatric Oncology. Patients eligible were older than 70 years and were included either before any first-line treatment, or between any two steps of a pre-defined first-line treatment sequence (chemotherapy, endocrine therapy, targeted treatment, surgery or radiotherapy) for various types of histologically-confirmed cancer (colon, lung, upper aero digestive tract (UAT)/head and neck, breast, prostate, and non-Hodgkin's lymphomas (NHL)). Patients with known central nervous system metastases were excluded. Patients were informed of the study and provided their signed informed consent prior to enrollment and G8/MGA assessment. The protocol was approved by the regional ethics committee (Comité de Protection des Personnes Sud-Ouest et Outre Mer III), and was conducted in accordance with the Declaration of Helsinki, Good Clinical Practices (Trial registration: NCT00963911).
Test methods
The G8 index test.
At the first visit after enrollment, patients received a full clinical examination and completed the G8 test with a nurse, a clinical research assistant (CRA), or a physician. The G8 consists of eight items: patient age (>85, 80-85, <80), and seven items from the original 18-item MNA (appetite changes, weight loss, mobility, neuropsychological problems, body mass index, medication, and self-rated health). The total score ranges from 0 to 17, with lower scores indicating a higher risk of impairments.[18] The cut-off value for an ‘impaired’ reference test score was ≤14 and the time taken to complete the test was recorded. The G8 questionnaire is provided in S1 Appendix.
The VES-13 questionnaire.
VES-13 is a self-administered questionnaire that was completed during the first visit after enrollment. For three pre-identified centers, patients also filled in the questionnaire at the following geriatric visit. VES-13 consisted of four groups of questions: age, self-perceived health, difficulties to perform six specific activities, and difficulties to perform daily living tasks due to health concerns. The score ranged from 0 to 10 and a score ≥3 was considered to show impairment.
Multidimensional geriatric assessment (MGA) reference test.
Patients underwent a geriatric evaluation in the month following the completion of G8 and VES-13 (+/- seven days) before treatment began. The nurse completed six of the seven instruments of the MGA as already described [18] (MNA, Timed Get up and Go (TUG), Activities of Daily Living (ADL), Instrumental ADL (IADL), Mini Mental State Examination (MMSE), and Geriatric Depression Scale (GDS-15)), and the geriatrician rated comorbidity on the Cumulative Illness Rating Scale (CIRS-G), recorded the time required for the consultation, identified patients who needed personalized geriatric interventions, and, if necessary, proposed further geriatric evaluation (outside of the scope of this study). G8 results were blinded to both the geriatrician and the nurse.
Abnormal scores for each instrument were established according to the following published cut-offs [18]: at least one Grade ≥3 comorbidity on the CIRS-G [20] (excluding the cancer being treated); ADL≤5, IADL≤7 across genders, MNA≤23.5, MMSE≤23/30, GDS15≥6, and TUG>20 seconds. Based on preliminary analyses [18], we considered the reference test to be ‘impaired’ if scores on the seven instruments were available and one or more of them was abnormal, or if the score on one or more instruments could not be calculated due to one or more missing item or unavailable instrument.
The reference test was defined as normal if scores for the seven instruments were available and normal. In a subsequent exploratory analysis, the reference test was modified and we considered the reference test to be ‘impaired’ if the seven instruments were available with two or more abnormal scores, or if the score for two or more instruments could not be calculated due to one or more missing items or unavailable instruments.
Statistical methods
We defined the following populations: the included population, the eligible population, and the eligible and evaluable population. The included population corresponded to all patients included, regardless of eligibility and availability of G8 and MGA results. The eligible population included all patients who did not violate any eligibility criteria. The eligible and evaluable population for diagnostic accuracy assessment was defined as all eligible patients, for whom G8 as well as at least one instrument of MGA were available and were administered less than one month apart (± one week).
Diagnostic accuracy was measured by the classification probabilities (sensitivity and specificity), positive and negative predictive values (PPV and NPV), and positive and negative diagnostic likelihood ratios (+/-DLR). The McNemar test was applied to compare the sensitivity of G8 and VES-13, as well as their specificity.
The required sample size was estimated based on our preliminary work [18]. Assuming 90% sensitivity for the G8 tool [18], we calculated that the enrollment of 750 patients with at least one abnormal MGA instrument would allow us to estimate sensitivity with sufficient precision (2.4%) and to obtain 95%CIs between 87.6% and 92.4%. Based on an estimated 50% of patients with at least one abnormal MGA instrument [21], 1500 eligible and evaluable patients were required. Assuming 10% ineligibility, this involved recruitment of 1650 patients.
The study population was described in terms of clinical and demographic characteristics with counts and percentages for qualitative variables and summary statistics (mean and variance where appropriate; percentiles otherwise) for quantitative variables. Sensitivity, specificity, PPV, NPV, +/-DLR and area under the ROC curve were estimated with their (two-sided) 95%CI.
Reproducibility analysis was based on estimation of the Kappa agreement statistics for dichotomous data (normal v abnormal score) [22].
Reproducibility of G8 was assessed by comparing the score on the actual G8 with the scores extracted from the corresponding seven questions of MNA completed during the MGA for all patients. Reproducibility of VES-13 was assessed based on a subgroup of patients included in three pre-identified centers who completed the questionnaire on two occasions. A priori sample size estimation suggested that enrollment of at least 180 subjects would ensure sufficient precision to estimate the reproducibility of VES-13 in this subgroup.
The prognostic value of the screening tools was assessed by analyzing one-year overall survivals using a Cox proportional hazards model. Candidate prognostic factors included age, sex, ECOG PS (Eastern Cooperative Oncology Group performance status), stage (metastatic v non-metastatic), and the G8 score. Significant factors at the univariate stage (p<5%) were subsequently included in a multivariate model. The final model was based on a manual stepwise backward selection approach with statistical significance set at 5%. An exploratory model was also calculated examining the prognostic value of the reference test MGA score. Hazard ratios (HR) are reported with 95%CIs.
Results are presented according to the STARD guidelines [23] for reporting of studies of diagnostic accuracy, and the study protocol is available in S2 Appendix.
Results
Enrollments
Between August 2008 and March 2010, 1674 patients were included in the ONCODAGE study. Initial exclusion of 77 ineligible patients left 1597 patients (eligible population). A further 162 patients were excluded from analyses due to protocol violations, participation withdrawals, missing G8 or MGA (Fig. 1). Delay between G8 and MGA exceeded 37 days in 15 cases, and G8 was inadequately completed by three patients. The final eligible and evaluable population for the principal analyses consisted of 1435 patients with a median age of 78 years and of whom 69.5% were females (Table 1). Patients were mostly seen in first consultations by a medical oncologist (45.6%), surgeons (21.7%), radiotherapists (13.5%), or other cancer specialists (19.0%).
Footnote: *In total, ten G8 were incomplete, but six ‘abnormal’ scores were able to be imputed from the incomplete assessments.
After the first 779 enrollments, we convened an international independent data monitoring committee to examine recruitment across different tumor sites and discuss initial statistical hypotheses. No modification was proposed by the committee of experts.
The multidimensional geriatric assessment reference standard results
On average, it took one hour to complete the MGA overall (67.5 minutes, +/-24.6; range 10 minutes to 3 hours) and it was completed in less than one and a half hours for 75% of patients. Almost all (91.6%) patients completed the seven instruments entirely. Rates of completion varied across instruments from 97.0% for the GDS15 to 99.8% for the ADL and MNA. The proportion of patients with abnormal scores varied from 15.3% for the ADL to 47.8% for the IADL (Table 2). Similar results were found for the eligible population (n = 1597).
Overall, 1151 (80.2%) eligible and evaluable patients were considered to have an impaired reference test. This was determined for the large majority of patients (1031, 89.6%) who had an abnormal score on one or more of any of the seven available instruments. For the remaining 120 patients (10.4%), the score from at least one instrument was missing and could not be determined. For 85 of these patients, although at least one score was missing, the score on one of the remaining instruments was abnormal so their reference test was considered impaired. For the remaining 35 patients with only five or six available scores, all available scores were normal. Their reference test was considered to be impaired for the purposes of the main analyses (see further discussion and analyses in results).
Of the 1031 patients overall with altered scores, 306 (29.7%) had an altered score on one instrument, 236 (22.9%) on two, 173 (16.8%) on three, 132 (12.8%) on four, 94 (9.1%) on five, 73 (7.1%) on six and 17 (1.6%) on seven.
Proportions of subjects with at least one impaired score varied across disease stage (93.0% for metastatic patients (M1) v 75.1% for non-metastatic (M0)) and across tumor site (73.0% prostate, 74.2% breast, 86.6% NHL, and 91 to 92% for colon rectum, lung and UAT/head and neck). At least one geriatric intervention was proposed by the geriatrician at the end of MGA in 72.2% of the cases and between one and four per patient in 64.3% of the population. The most frequently proposed interventions were nutritional support (524 patients, 37.0%), home assistance (499 patients, 35.2%), standard treatment adaptation (345 patients, 24.3%), psychological support (258 patients, 18.3%) and physiotherapy (231 patients, 16.3%).
Validation of the G8 test
In the eligible and evaluable population (n = 1435), G8 was mostly administered by a nurse or CRA (87%) and less frequently by a physician (12.9%). It took an average of 4.4 minutes to complete (+/−2.8, range: 1–60 minutes) with 98.7% completed in ten minutes or less. The final G8 scores ranged from 1.5 to 17, with 68.4% of patients showing impaired scores (≤14). The proportions of patients with impaired G8 scores varied according to disease stage (85.6% for M1 and 63.0% for M0) and tumor site (36.9% prostate, 62.9% breast, 70.5% NHL, and 85–88% for colon-rectum, lung and UAT/head and neck).
The diagnostic accuracy of G8 is outlined in Table 3. G8 sensitivity was 76.5% and specificity 64.4%. The AUC compared to the reference standard MGA was 0.804, 95%CI 0.78 to 0.83 (Fig. 2).
Footnote: * For each point on the curve the G8 threshold (above line) and the sensitivity and specificity (below line) are indicated, e.g. score of 14, sensitivity: 76.4%, specificity: 64.4%. Abbreviations: ROC = Receiver Operating Characteristics; MGA = Multidimensional Geriatric Assessment.
G8 was abnormal in 94.4% abnormal MNA (592/627), 93.6% abnormal ADL (205/219), 91.3% abnormal TGUG (293/321), 84.8% abnormal GDS15 (391/461), 84.5% abnormal IADL (580/686), 80.5% abnormal MMSE (235/292) and 77.4% abnormal CIRS-G (466/602). Overall, 136 patients with Grade 3-4 comorbidities had normal G8 scores; this included mainly patients with one severe comorbidity (58.1%) the most prevalent being vascular (49.3%), cardiac (15.4%), respiratory (14%) and metabolic (11.8%).
Among false negative results, 53.1% had only one abnormal MGA questionnaire (median 1; range 1 to 6) as compared to 18.4% in the true positive group (median 3; range 1 to 7).
Secondary analyses
G8 diagnostic accuracy by subgroups.
In terms of disease stage, sensitivity and PPV were superior for M1 patients than for M0 patients, whereas the specificity and NPV were better for M0 patients (Sensitivity = 87.6% (M1) v 71.3% (M0); Specificity = 43.8% (M1) v 65.7% (M0); PPV = 95.8% (M1) v 86.3% (M0); NPV = 19.4% (M1) v 43.0% (M0)) (Table 4). Sensitivity and specificity varied significantly according to tumor site: the sensitivity for prostate cancer patients was 46.1%, 72.3% for breast cancer patients and 94.1% for UAT/head and neck patients; and specificity ranged from 33.3% for lung cancer patients to 87.9% for prostate cancer patients (Table 4).
A subgroup analysis explored the influence of the presence or absence of at least one treatment in the last three months. G8 sensitivity or specificity did not appear to be particularly affected by this factor.
Diagnostic accuracy of VES-13.
In the eligible and evaluable population (n = 1435), VES-13 was mainly administered with the assistance of a nurse or CRA (78.7%), with 12.1% being completed by the patient alone, and 8.8% with the assistance of the physician. On average, it took 5.7 minutes to complete (+/−3.2, range1–30 minutes), with 98% completed in less than 10 minutes.
VES-13 showed impaired scores in 60.2% of patients. Sensitivity and specificity were 68.7% and 74.3%, respectively (Table 3). The AUC for VES-13 compared to MGA was 0.79, 95%CI 0.77 to 0.82. Sensitivity and PPV were higher for M1 rather than for M0 patients (Sensitivity = 75.1% (M1) v 65.4% (M0); Specificity = 43.8% (M1) v 75.6% (M0); PPV = 95.1% (M1) v 89.0% (M0); NPV = 10.8% (M1) v 41.9% (M0)).
VES-13 was abnormal in 94.1% abnormal ADL (206/219), 87.5% abnormal TGUG (281/321), 81.5% abnormal IADL (559/686), 80.9% abnormal GDS15 (373/461), 77.5% abnormal MNA (486/627), 75.3% abnormal MMSE (220/292) and 72.4% abnormal CIRS-G (436/602). Overall, VES-13 was normal in 166 patients with Grade 3–4 comorbidities, which included mainly patients with one severe comorbidity (51.2%), the most prevalent being vascular (45.2%), cardiac (21.7%), respiratory (14.5%) and psychiatric (12.7%) comorbidities.
Among false negative results, 45.3% had only one abnormal MGA questionnaire (median 1; range 1 to 6) as compared to 18.1% in the true positive group (median 3; range 1 to 7).
Comparison of the G8 and VES-13 diagnostic accuracy.
The G8 test had a better sensitivity than VES-13 (McNemar test, p = 0.005) at the expense of a lower specificity (McNemar test, p<0.0001).
G8 and VES-13 reproducibility.
Reproducibility for both G8 (n = 1429) and VES-13 (n = 251) was good: Kappa = 0.65, (95%CI 0.61 to 0.70), and Kappa = 0.64, (95%CI 0.54 to 0.73), respectively. When investigating the items of each instrument, the Kappa coefficient varied from excellent for objective criteria such as age (G8: Kappa = 0.96, 95%CI 0.95 to 0.98; VES-13: Kappa = 0.98, 95%CI 0.94 to 1.0) to poor for subjective criteria such as self-rated health (G8: Kappa = 0.38; VES-13: Kappa = 0.42).
One-year survival of G8 and VES-13.
Among the 1435 patients eligible and evaluable, information on vital status was available for 1365 patients with a median follow-up of 377 days (95%CI 373 to 381). At the univariate level, all candidate prognostic factors were statistically significant (Table 5). In the final model, factors independently associated with poorer survival included male sex (HR 2.69, p<0.0001), 2–4 ECOG status (HR 3.28, p<0.0001), metastatic disease (HR 3.30, p<0.0001), and abnormal G8 score (HR 2.72, p<0.0001) (Table 5).
In a model including all significant candidate prognostic factors and MGA result, abnormal MGA was found to be significantly associated with poorer survival at one year (HR 2.96, 95%CI 1.50–5.85, p = 0.0018).
Exploratory analyses
Diagnostic accuracy of G8 and VES-13 with the modified standard (two abnormal MGA tests).
Using a modified definition of the reference test (two abnormal MGA tests), 56.7% of patients (813 cases) were considered abnormal. G8 sensitivity was 86.5% and specificity 55.3% (Table 3). The AUC was 0.82, 95%CI 0.80 to 0.84. Sensitivity and specificity of VES-13 with this modified reference test were 78.5% and 63.7%, respectively (Table 3).
Sensitivity analysis to assess the impact of missing questionnaires of MGA.
For 35 out of 1435 patients, scores for at least five instruments were available and normal. However, MGA was considered abnormal due to the one or two not fully completed questionnaires despite normality on all other available instruments. To specifically account for these patients with missing questionnaires, we investigated two modified definitions of the reference test. First, if two or less questionnaires were missing but all other MGA instruments had normal scores, then the reference test was considered normal, otherwise the definition of our primary reference test prevailed. Second, the reference test was considered normal as long as all completed questionnaires had a normal score (regardless of the number of missing questionnaires).
Using these new definitions of the reference test did not cause changes in the diagnostic performances of G8 (similar values for sensitivity, specificity, PPV, NPV and likelihood ratios, data not shown), so the primary definition with these 35 patients considered as abnormal reference tests was maintained.
Discussion
This is the first study designed to determine the diagnostic accuracy of the G8 questionnaire and, by far, the largest prospective cohort available to validate a screening tool in geriatric oncology with previously published studies including 41–419 patients [24]–[32]. The G8 test proved to be convenient, easy and quick to administer. It was generally completed in less than five minutes and was mostly administered by a nurse with no specific expertise in geriatrics. So far, the G8 tool exists only in French, but can easily be applied in other languages using the official English MNA translation (Appendix S1), or one of the 22 other official translations.
The proportion of G8 impaired scores was 68.4%. In the validation against the reference test (0 v ≥1 abnormal MGA tests − 80% of the population), sensitivity, of foremost importance for a screening tool, was good at 76.5% and specificity was satisfactory at 64.4%. With the modified reference test (<2 v ≥2 abnormal MGA tests − 56.7% of the population), sensitivity of G8 was improved to 86.5% while specificity was reduced to 55.3%.
The population of the study was homogeneously defined including only first-line cancer treatment patients. As it has been developed in a large number of investigating centers in France, including community hospitals, and as it can be equally administered by a nurse or a physician, the G8 questionnaire can be smoothly implemented in daily practice. However, the large representation of breast cancer patients included in our study (over 50%) needs to be considered when generalizing the results. Consequently, we provide diagnostic accuracy estimations per tumor location in the subgroup analyses. There was a significant proportion of patients (9.1%) with missing metastatic status for whom physicians decided not to perform usual pre-treatment work-up because of low risk of metastasis and age.
Our target population is clearly identified with simple, quantitative criteria: at least one or two abnormal questionnaires among seven consensus geriatric tools. However, while MGA appears the best available and most reproducible instrument to identify it, this target population (reference test) has no unbiased definition. Two different thresholds considering one [18], [24], [27], [29] or two [18], [26], [30]–[33] abnormal questionnaires have been proposed in the literature with different sets of questionnaires that more or less cover geriatric domains [34]. So far, no objective arguments have been raised that enable us to choose the best threshold [35]. Selecting patients with at least one abnormal questionnaire (80% of patients in our series, 66% to 94% in other published studies) [18], [24], [27], [29] reduces the risk of missing unfit patients but also limits the validity of the screening procedure. With two abnormal tests as the threshold, the target population is smaller (56.7% in our series vs. 43% to 76% in the literature) [18], [26], [30]–[33], which may enable us to concentrate our efforts on the most vulnerable patients.
While considering sensitivity as the most important criteria (to limit false negative case occurrences), we believe G8 to be the best available tool, although VES-13 remains a good alternative with lower sensitivity but higher specificity. In this study we assessed the performance of VES-13, which is currently the most widely-used screening tool for older cancer patients, although it was originally designed to predict functional decline or death over a two-year period in community-dwelling elders. The higher sensitivity of the G8 screening tool has been reported in the literature. A previous independent report of 113 patients found greater sensitivity for G8 (85.7% v 57.1% for VES-13), although the AUC was not statistically different [33]. A recent systematic review [36] compared all available screening methods to CGA and reported a median sensitivity for VES-13 of 68% (range 39 to 88%), and median specificity of 78% (range 62 to 100%). The median sensitivity for G8 was higher at 87% (range 77 to 92%) with a median specificity of 61% (range 39 to 75%) [36].
VES-13 has been studied as a screening tool in oncology in a number of previous reports [26], [30], [31], [33], [37] and two of them concluded that VES-13 could be a useful preliminary screening tool with a sensitivity of 73% and 87% [28], [30]. However, similar analyses reported lower sensitivities ranging from 55 to 68.7% [26], [31], [33], [37]. These variations may result from differences in administration. In Luciani et al's study, VES-13 was administered by a physician and thus possibly over a longer time and in more detail [38] than in the present study or others, where VES-13 was administered predominantly by a nurse or CRA.
Additional tools, such as the Barber Questionnaire that was developed as a screening procedure for older adults in general practice [39] are available but results reported for older adults with breast cancer are disappointing [31]. Further geriatric tools have been proposed for screening purposes such as cancer specific geriatric assessment [40], the abbreviated (a)CGA [41], and the Groningen Frailty Index (GFI) [42]. However, overall, most of these instruments have only been presented in feasibility or pilot studies [25], and initial results suggest that they miss too many cases of vulnerable patients [26].
The false negative rate, undetected unfit patients, was lower with G8 than with VES-13: 23.5% v 31.3% patients respectively with MGA, and 13.5% v 21.5% with the modified MGA. The survival analyses demonstrated the strong prognostic role of the G8 score (HR = 2.72, p<0.0001) along with male sex (HR 2.69, p<0.0001), poor ECOG status (HR 3.28, p<0.0001) and metastatic disease (HR 3.30, p<0.0001). The definition of the reference test was supported by the association observed between impaired MGA and poorer survival at one year in the exploratory survival analyses (HR 2.96, p = 0.0018). With specificity of 64.4% and NPV of 40.3%, the G8 tool still needs improvement. The somewhat low reproducibility observed for questions such as neuropsychological problems may be an issue for improvement, although part of the explanation may be the delay between the two tests that lasted up to one month.
Considering these results, the G8 questionnaire may be proposed to cancer patients over 70 years. Given its simplicity, this approach may allow physicians to discriminate fit from unfit patients. In this way, fit patients can benefit from standard treatment without extensive evaluation and efforts can be centered on unfit patients who need careful medical attention. For the latter, if resources are available, management should be multidisciplinary and based on appropriate geriatric assessment. If not, they should be offered at least cautious medical attention and case management when advanced practice nurses can be involved.
In summary, no current consensus exists to define target elderly population who may benefit from further medical attention before cancer treatment. Our definition which uses a threshold of one or two abnormal geriatric assessment questionnaires is probably the most reliable up to now and our exploratory survival analyses demonstrated the prognostic value of impaired MGA, but search for a refined reference test remains an issue
This study responds to a critical need for easy and quick-to-use screening tools to identify older patients requiring more detailed assessment and possible geriatric interventions. Screening has been recently encouraged for all patients that may benefit from full CGA in a recent SIOG/EUSOMA publication [43]. First and foremost, this study documents the high rate of older patients with geriatric impairments for whom oncologists lack clear directives and skills for practice and care. The G8 screening method recognizes the heterogeneity of the older patient population and provides oncologists with a useful, efficient tool to improve care.
Supporting Information
S2 Appendix.
ONCODAGE abridged protocol (in English).
https://doi.org/10.1371/journal.pone.0115060.s002
(DOC)
Acknowledgments
The authors would like to thank
- The data management team of Marie Augis, Caroline Roy, Marina Pulido, Jean Mendiboure and Hugo Caillou.
- The members of the Independent Data Monitoring Committee: Ricardo Audisio, Martine Extermann, Xavier Paoletti and Gilbert Zulian.
- Pippa McKelvie-Sebileau and Jone Iriondo-Alberdi for medical writing assistance in English.
- List of investigators referred to as the ‘Oncodage investigators’: Dr Gaelle Jeannin; Dr. Merle Patrick; Dr Hélène Nehme; Dr Virginie Leroy; Dr Erwan De Mones Del Pujol; Pr Alain Ravaud; Dr Brigitte Maget; Dr. Nicolas Jovenin; Pr. Pierre Feugier; Dr. Serge Bologna; Dr Brigitte Comte; Dr Claire Falandry; Dr. Audrey Mailliez; Pr. Arnauld Villers; Pr. Christian Rose; Dr. Jean-Louis Bonnal; Dr Aurélien Minard; Dr Mathilde Gisselbrecht; Dr. Sylvain Ladoire; Dr Valérie Quipourt; Dr Sandrine Lavau – Denes; Dr. Valérie Le Brun-Ly; Pr Luc Thiberville; Dr Olivier Rigal; Pr Jean Léon Lagrange; Dr Philippe Caillet; Dr Frédérique Rousseau; Dr Laure De Decker; Dr Emmanuelle Bourbouloux; Dr Elisabeth Carola; Dr Florence Woerth; Dr Etienne Brain; Dr Ludmilla Ribiere; Dr Laeticia Stefani; Dr Matthieu Debray; Pr Catherine Thieblemont; Pr Christian Gisselbrecht; Dr Laurent Balardy; Dr Loic Mourey; Dr Pascal Chaibi.
Pierre Soubeyran had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
Author Contributions
Conceived and designed the experiments: PS CB MR SMP. Performed the experiments: JG DH HC HR GA VS OSJ IVP JEK SP JLV CT CD VG CM. Analyzed the data: CB. Wrote the paper: PS CB MR SMP.
References
- 1. Mitka M (2003) Too few older patients in cancer trials: experts say disparity affects research results and care. JAMA 290:27–28.
- 2. Dale W, Mohile SG, Eldadah BA, Trimble EL, Schilsky RL, et al. (2012) Biological, Clinical, and Psychosocial Correlates at the Interface of Cancer and Aging Research. J Natl Cancer Inst 104:581–589.
- 3. Muss HB, Woolf S, Berry D, Cirrincione C, Weiss RB, et al. (2005) Adjuvant chemotherapy in older and younger women with lymph node-positive breast cancer. JAMA 293:1073–1081.
- 4. Soubeyran P, Fonck M, Blanc-Bisson C, Blanc JF, Ceccaldi J, et al. (2012) Predictors of early death risk in older patients treated by first-line chemotherapy for cancer. J Clin Oncol 30:1829–1834.
- 5. Hoppe S, Rainfray M, Fonck M, Hoppenreys L, Blanc JF, et al. (2013) Functional Decline in Older Patients With Cancer Receiving First-Line Chemotherapy. Journal of Clinical Oncology 31:3877–3882.
- 6. Extermann M, Boler I, Reich RR, Lyman GH, Brown RH, et al. (2012) Predicting the risk of chemotherapy toxicity in older patients: the Chemotherapy Risk Assessment Scale for High-Age Patients (CRASH) score. Cancer 118:3377–3386.
- 7. Hurria A, Togawa K, Mohile SG, Owusu C, Klepin HD, et al. (2011) Predicting Chemotherapy Toxicity in Older Adults With Cancer: A Prospective Multicenter Study. J Clin Oncol 29:3457–3465.
- 8. Maione P, Perrone F, Gallo C, Manzione L, Piantedosi F, et al. (2005) Pretreatment quality of life and functional status assessment significantly predict survival of elderly patients with advanced non-small-cell lung cancer receiving chemotherapy: a prognostic analysis of the multicenter Italian lung cancer in the elderly study. J Clin Oncol 23:6865–6872.
- 9. Aaldriks AA, Maartense E, le Cessie S, Giltay EJ, Verlaan HA, et al. (2011) Predictive value of geriatric assessment for patients older than 70 years, treated with chemotherapy. Crit Rev Oncol Hematol 79:205–212.
- 10. Kanesvaran R, Li H, Koo KN, Poon D (2011) Analysis of prognostic factors of comprehensive geriatric assessment and development of a clinical scoring system in elderly Asian patients with cancer. J Clin Oncol 29:3620–3627.
- 11. Caillet P, Canoui-Poitrine F, Vouriot J, Berle M, Reinald N, et al. (2011) Comprehensive Geriatric Assessment in the Decision-Making Process in Elderly Patients With Cancer: ELCAPA Study. J Clin Oncol 29:3636–3642.
- 12. Extermann M, Aapro M, Bernabei R, Cohen HJ, Droz JP, et al. (2005) Use of comprehensive geriatric assessment in older cancer patients: recommendations from the task force on CGA of the International Society of Geriatric Oncology (SIOG). Crit Rev Oncol Hematol 55:241–252.
- 13.
Extermann M, Aapro M, Audisio R, Balducci L, Droz JP, et al. (2011) SIOG 10 priorities.
- 14. McNeil C (2013) Geriatric oncology clinics on the rise. J Natl Cancer Inst 105:585–586.
- 15. Gosney MA (2005) Clinical assessment of elderly people with cancer. Lancet Oncol 6:790–797.
- 16. Rodin MB, Mohile SG (2007) A practical approach to geriatric assessment in oncology. J Clin Oncol 25:1936–1944.
- 17. Extermann M, Hurria A (2007) Comprehensive geriatric assessment for older patients with cancer. J Clin Oncol 25:1824–1831.
- 18. Bellera CA, Rainfray M, Mathoulin-Pelissier S, Mertens C, Delva F, et al. (2012) Screening older cancer patients: first evaluation of the G-8 geriatric screening tool. Ann Oncol 23:2166–2172.
- 19. Mathoulin-Pélissier S, Bellera CA, Rainfray M, Soubeyran P (2013) Screening methods for geriatric frailty. Lancet Oncol 14:e1–e2.
- 20. Wedding U, Rohrig B, Klippstein A, Pientka L, Hoffken K (2007) Age, severe comorbidity and functional impairment independently contribute to poor survival in cancer patients. J Cancer Res Clin Oncol 133:945–950.
- 21. Cigolle CT, Langa KM, Kabeto MU, Tian Z, Blaum CS (2007) Geriatric conditions and disability: the Health and Retirement Study. Ann Intern Med 147:156–164.
- 22. Cohen J (1960) A coefficient of agreement for nominal scales. Education and Psychological Measurements 20:37–46.
- 23. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, et al. (2003) Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD Initiative. Ann Intern Med 138:40–44.
- 24. Biganzoli L, Boni L, Becheri D, Zafarana E, Biagioni C, et al. (2013) Evaluation of the cardiovascular health study (CHS) instrument and the Vulnerable Elders Survey-13 (VES-13) in elderly cancer patients. Are we still missing the right screening tool? Ann Oncol 24:494–500.
- 25. Extermann M, Green T, Tiffenberg G, Rich C (2009) Validation of the Senior Adult Oncology Program (SAOP) 2 screening questionnaire. Crit Rev Oncol Hematol 69:183–185.
- 26. Kellen E, Bulens P, Deckx L, Schouten H, Van Dijk M, et al. (2010) Identifying an accurate pre-screening tool in geriatric oncology. Crit Rev Oncol Hematol 75:243–248.
- 27. Luce S, de Breucker S, van Gossum Au, Demols A, Mekinda Z, et al. (2012) How to identify older patients with cancer who should benefit from comprehensive geriatric assessment? J Ger Oncol 3:351–358.
- 28. Luciani A, Ascione G, Bertuzzi C, Marussi D, Codeca C, et al. (2010) Detecting disabilities in older patients with cancer: comparison between comprehensive geriatric assessment and vulnerable elders survey-13. J Clin Oncol 28:2046–2050.
- 29. Luciani A, Dottorini L, Battisti N, Bertuzzi C, Caldiera S, et al. (2013) Screening elderly cancer patients for disabilities: evaluation of study of osteoporotic fractures (SOF) index and comprehensive geriatric assessment (CGA). Ann Oncol 24:469–474.
- 30. Mohile SG, Bylow K, Dale W, Dignam J, Martin K, et al. (2007) A pilot study of the vulnerable elders survey-13 compared with the comprehensive geriatric assessment for identifying disability in older patients with prostate cancer who receive androgen ablation. Cancer 109:802–810.
- 31. Molina-Garrido MJ, Guillen-Ponce C (2011) Comparison of two frailty screening tools in older women with early breast cancer. Crit Rev Oncol Hematol 79:51–64.
- 32. Owusu C, Koroukian SM, Schluchter M, Bakaki P, Berger NA (2011) Screening older cancer patients for a Comprehensive Geriatric Assessment: A comparison of three instruments. J Geriatr Oncol 2:121–129.
- 33. Pottel L, Boterberg T, Pottel H, Goethals L, Van Den Noortgate N, et al. (2012) Determination of an adequate screening tool for identification of vulnerable elderly head and neck cancer patients treated with radio(chemo)therapy. J Ger Oncol 3:24–32.
- 34. Pallis AG, Wedding U, Lacombe D, Soubeyran P, Wildiers H (2010) Questionnaires and instruments for a multidimensional assessment of the older cancer patient: What clinicians need to know? Eur J Cancer 46:1019–1025.
- 35. Inouye SK, Peduzzi PN, Robison JT, Hughes JS, Horwitz RI, et al. (1998) Importance of functional measures in predicting mortality among older hospitalized patients. JAMA 279:1187–1193.
- 36. Hamaker ME, Jonker JM, de Rooij SE, Vos AG, Smorenburg CH, et al. (2012) Frailty screening methods for predicting outcome of a comprehensive geriatric assessment in elderly patients with cancer: a systematic review. Lancet Oncol 13:e437–e444.
- 37. Falci C, Brunello A, Monfardini S (2010) Detecting functional impairment in older patients with cancer: is vulnerable elders survey-13 the right prescreening tool? An open question. J Clin Oncol 28:e665–e666.
- 38. Luciani A, Floriani I, Foa P (2010) Reply to C. Falci et al. J Clin Oncol 28:e667.
- 39. Barber JH, Wallis JB, McKeating E (1980) A postal screening questionnaire in preventive geriatric care. J R Coll Gen Pract 30:49–51.
- 40. Hurria A, Gupta S, Zauderer M, Zuckerman EL, Cohen HJ, et al. (2005) Developing a cancer-specific geriatric assessment: a feasibility study. Cancer 104:1998–2005.
- 41. Overcash JA, Beckstead J, Moody L, Extermann M, Cobb S (2006) The abbreviated comprehensive geriatric assessment (aCGA) for use in the older cancer patient as a prescreen: scoring and interpretation. Crit Rev Oncol Hematol 59:205–210.
- 42. Slaets JP (2006) Vulnerability in the elderly: frailty. Med Clin North Am 90:593–601.
- 43. Biganzoli L, Wildiers H, Oakman C, Marotti L, Loibl S, et al. (2012) Management of elderly patients with breast cancer: updated recommendations of the International Society of Geriatric Oncology (SIOG) and European Society of Breast Cancer Specialists (EUSOMA). Lancet Oncol 13:e148–e160.
- 44. Saliba D, Elliott M, Rubenstein LZ, Solomon DH, Young RT, et al. (2001) The Vulnerable Elders Survey: a tool for identifying vulnerable older people in the community. J Am Geriatr Soc 49:1691–1699.