Figures
Abstract
Purpose
The CONSORT extension for patient reported outcomes (PROs) aims to improve reporting, but guidance on the optimal integration with clinical data is lacking. This study examines in detail the reporting of PROs and clinical data from randomized controlled trials (RCTs) in gastro-intestinal cancer to inform design and reporting of combined PRO and clinical data from trials to improve the ‘take home’ message for clinicians to use in practice.
Materials and Methods
The case study was undertaken in gastro-intestinal cancer trials. Well-conducted RCTs reporting PROs with validated instruments were identified and categorized into those combining PRO and clinical data in a single paper, or those separating data into linked primary and supplemental papers. Qualitative methods were developed to examine reporting of the critical interpretation of the trial results (trial exegesis) in the papers in relation of the PRO and clinical outcomes and applied to each publication category. Results were used to inform recommendations for practice.
Results
From 1917 screened abstracts, 49 high quality RCTs were identified reported in 36 combined and 15 linked primary and supplemental papers. In-depth analysis of manuscript text identified three categories for understanding trial exegesis: where authors reported a “detailed”, “general”, or absent PRO rationale and integrated interpretation of clinical and PRO results. A total of 11 (30%) and 6 (16%) combined papers reported “detailed” PRO rationale and integrated interpretation of results although only 2 (14%) and 1 (7%) primary papers achieved the same standard respectively. Supplemental papers provide better information with 11 (73%) and 3 (20%) achieving “detailed” rationale and integrated interpretation of results. Supplemental papers, however, were published a median of 20 months after the primary RCT data in lower impact factor journals (median 16.8 versus 5.2).
Citation: McNair AGK, Macefield RC, Blencowe NS, Brookes ST, Blazeby JM (2016) ‘Trial Exegesis’: Methods for Synthesizing Clinical and Patient Reported Outcome (PRO) Data in Trials to Inform Clinical Practice. A Systematic Review. PLoS ONE 11(8): e0160998. https://doi.org/10.1371/journal.pone.0160998
Editor: Robert K. Hills, Cardiff University, UNITED KINGDOM
Received: April 18, 2016; Accepted: July 28, 2016; Published: August 29, 2016
Copyright: © 2016 McNair et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: Support was provided by United Kingdom Medical Research Council Collaboration and innovation for Difficult and Complex randomised controlled Trials In Invasive procedures Hub grant code MR/K025643/1 director (to JMB). The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The updated Consolidated Standards of Reporting Trials (CONSORT) extension for patient reported outcomes (PROs) aims to facilitate the use of PRO data in health policy and practice through the transparent reporting of PROs in randomized controlled trials (RCTs)[1]. It makes recommendations for reporting of PRO instrument validity, presentation and handling of missing data and reporting of PRO sample size calculations, data analyses and results within the main text and abstract. The statement endorses reporting the rationale/hypotheses for PRO assessment and it highlights the need for integrated reporting of the PROs with the clinical findings of the paper (extensions and elaborations 2a, 2b and P20/21 and 22). These latter recommendations are particularly essential for critical interpretation of the trial, so called exegesis or a “take-home message”, for clinicians to understand and use results in clinical practice.
The CONSORT extension provides illustrations of how to report these issues. For example, elaboration 2a and extension P2b state that authors should “briefly establish the rationale for including PROs and why specific outcomes were selected”, and “report the rationale for the selection of specific patient-reported outcomes”. Furthermore, the guidelines state (in items P20/21 and elaboration 22) that “the clinical significance of PRO results is often not discussed in RCT reports but should be interpreted in relation to other important clinical outcomes such as survival”. Whilst this is helpful, the level of detail required for reporting the PRO data is unclear and this may have a detrimental impact on the overall clinically relevant trial conclusions.
This problem is further compounded by the way that PRO data are published. Some trials publish results in a single paper combined with clinical findings, which may limit full explanation of PRO results in the context of finite manuscript word limits. Publication of clinical and PROs separately is therefore attractive, however, practicing oncologists may be less likely to read the supplemental paper and thus not use PRO data in decision-making. The PRO CONSORT statement does not provide guidance for PRO reporting within these different scenarios. Whether PRO data are published together with clinical outcomes or separately in two articles, there is a need for optimal reporting of clinical and PROs so that they can be used in clinical practice. The aim of this paper, therefore, is to explore current standards and make recommendations for reporting a combined PRO and clinical ‘take home’ message to use in reporting RCTs in oncology.
Materials and Methods
This study was conducted in two parts. Part 1: systematic identification of well-designed and conducted RCTs reporting PROs with validated instruments, categorisation of papers into combined PRO and clinical reports or linked primary and supplemental reports, and assessment of PRO reporting within each RCT (PRO CONSORT extension). Part 2: development of novel methods to examine the ‘take home/trial exegesis’ message of the RCT and application to the papers identified in Part 1.
Part 1(a) Identification of well-designed and conducted RCTs reporting PROs with validated instruments
Systematic review methodology was used to identify RCTs at a low risk of bias reporting PROs with validated instruments in radical treatments of gastro intestinal oncology. Full-text articles were obtained. Gastro-intestinal oncology trials of radical treatment were chosen because the research team were familiar with the clinical and PRO data in this area, and trials at a low risk of bias are examples of best practice.
Electronic searches were performed in MEDLINE, Embase and Cochrane databases using the OVID SP gateway and Cochrane library. Search terms for esophageal, gastric and colorectal cancer were combined, as were terms for chemotherapy, radiotherapy, surgery or combined treatment. Results were restricted with the application of terms for “randomized clinical trials” and “patient reported outcomes”, and limited to articles published between January 2000 and October 2012 (see full search in S1 Appendix). The search output was imported into Reference Manager software and duplicate records removed. References for relevant studies before the year 2000 were obtained from a previous systematic review [2]. Titles and abstracts were screened by two researchers (AGKM and RM). Serial publications for the same trial (e.g. articles reporting short and long term PROs) were included. Excluded were phase II studies, RCTs of endoscopic and non-biomedical interventions, or trials limited to palliative treatment, screening or premalignant conditions. Only English-language publications were considered. Articles were assessed for risk of bias in the trials by three researchers (AGKM, RM, NB) using the Cochrane tool [3]. Studies classified with potential high or unascertainable risk of bias were excluded. Independent data extraction was conducted by at least two reviewers (AGKM, NB, RM, JMB) using a pre-designed and piloted form. Details of the trial were recorded including disease site, treatment intervention, primary and secondary outcomes, number of participants, and main trial results. The systematic review PRISMA checklist is presented in S2 Appendix.
(b) Categorisation of papers into combined PRO and clinical reports or linked primary and supplemental reports
Where included papers indicated the presence of previously published results from the same trial, these additional papers were sought and included in the analysis. These linked papers are hereafter considered in the order by which they were published, with those published first and second defined as “primary” and “supplemental” respectively. Thus, trials were categorized into those reporting PROs and clinical outcomes in a single, combined paper and those reporting results in linked primary and supplemental papers. The journal impact factor (Thomson Reuters, 2012) and the date of publication for each paper were recorded. Descriptive statistics compared journal impact factor for combined and linked primary and supplementary papers and median times between publications were summarized.
(c) Assessment of PRO reporting using the new CONSORT extension
The PRO CONSORT extension was applied to all trials to establish standards of PRO reporting, with the exception of item P6a which was an inclusion criterion (use of a validated PRO measure). Reporting of item 7a (PRO sample size) was recorded as present if a sample size calculation was completed in trials with patient reported primary outcomes, or if it were not applicable (for example, if there were no PROs as primary outcomes). Descriptive statistics are presented to consider PRO CONSORT standards within trials reporting in a single, combined publication or in linked primary and supplementary papers.
Part 2 (a) Development of methods to present the ‘take home/trial exegesis’ message of PRO with clinical data in trials
Methods to report the ‘take home’ messages of clinical and PROs in trials were developed through an in-depth analysis of items 2a and P2b (rationale/hypotheses for PRO measurement), and P20/21 and 22 (limitations and implications for clinical practice, and interpretation of PROs in relation to clinical outcomes) to identify good practice and produce methods to inform a PRO take home message from trials. All papers were read and re-read independently by at least two (AM, RM and JMB) researchers to become immersed in the data and relevant text was independently coded, copied verbatim into an electronic database and analysed for consistency between researchers. Discrepancies in coding were discussed within the study team (AM, RM and JMB). Methods for reporting trial ‘take home’ message were developed and applied iteratively to relevant text. Deviant examples were sought to challenge theories. Primary quotations are provided in accordance to methods of qualitative rigor. It was also noted whether primary papers indicated the future publication of a supplemental PRO paper (defined as “signposting”).
Results
Part 1(a) Identification of well-designed and conducted RCTs reporting PROs with validated instruments
OVID (MEDLINE and Embase) and Cochrane database search yields were 1815 and 939 records. After de-duplication, 1917 abstracts were screened, 1716 excluded, and 201 full text articles further assessed for eligibility, and these were supplemented with 13 studies from a previous systematic review [2]. Sixty-seven articles met the inclusion criteria describing trials at low risk of bias (Fig 1). The 66 included articles reported PROs from 49 RCTs, the majority of which were chemotherapy interventions (22/49, 44.9%) in colorectal disease (36/49, 73.5%, Table 1).
(b) Categorisation of papers into combined PRO and clinical reports or linked primary and supplemental reports
Some 36 (71%) single papers reported combined PRO and clinical results and the remaining 30 were linked primary and supplemental papers. The median journal impact factor for both combined and primary papers was the same (16.8), but supplemental PRO papers were reported in journals with a lower median impact factor (5.2). The mean time between publication of linked primary and supplementary papers was 20 months (range 5 to 51).
(c) Assessment of PRO reporting using the new CONSORT extension
Overall, the reporting of most papers did not meet the new PRO CONSORT standards (S1 Table). There were six (2 combined; 0 primary and 4 supplemental) papers reporting all PRO CONSORT items (Table 2). Primary papers reported the fewest items (median 3, range 2 to 7), typically lower than combined papers (median 6, range 2 to 12) and supplemental papers (median 10, range 4 to 12). The least frequently reported items related to “results” (13a, 15, 16, 17a and 18), and were reported in less than one third of papers. The least frequently reported items related to “results” (13a, 15, 16, 17a and 18), and were reported in less than one third of papers.
Part 2 (a) Development of novel methods to examine the take home message of PRO with clinical data in trials
The new method for understanding and improving combined reporting practice was developed based upon the in-depth analyses, emergent data and iterative discussions with AM and JMB. Sections of verbatim text were coded to items 2a and P2b were classified as providing a 1) detailed rationale/hypothesis—when authors included a specific PRO domain and/or hypothesized effect, 2) general rationale/hypothesis—when authors included non-specific rationale (i.e. “to examine quality of life”) or 3) no rationale provided. Verbatim quotes of PRO rationales are presented in Tables 3 and 4. An example of a detailed rationale included: “…we hypothesized a priori that [intervention] would result in a decrease in the magnitude and rate of decline in HRQL, particularly in physical function and overall well-being”[4], and an illustration of a general rationale included “…to compare…quality of life…between [intervention] and [control]”[5].
Extracted text was abridged where appropriate, as indicated by a series of periods (…), but otherwise presented verbatim.
Extracted text was abridged where appropriate, as indicated by a series of periods (…), but otherwise presented verbatim.
Likewise, sections of text coded to the items P20/21 and 22 were developed as 1) detailed interpretations—where authors discussed the hypothesized effect of a specific PRO in relation to the hypothesized effect of a clinical outcome, 2) general interpretations–when authors include non-specific interpretation of PROs in relation to clinical outcomes, or 3) no integrated PRO and clinical interpretation of results in the paper. An example of detailed interpretation of findings includes “… [Intervention] resulted in significantly improved TTP [time to progression] (primary end point), OS [overall survival], and overall response rate (secondary end points), with global health status (quality of life)… preserved for a longer time.”[6]
Part 2, b) Application of the methods to included trials
Of the 36 trials reporting combined papers, there were 11 (30%) papers that provided a PRO rationale/hypothesis, 10 (30%) providing general information and 15 (40%) not providing a PRO rationale (Table 5). The interpretation of PRO data in the context of clinical outcomes were detailed in six (16%), general in 24 (65%) and absent in 7 (17%) papers (Items P20/21 and 22, Table 3). There were seven papers that described both detailed PRO rationale/hypotheses and detailed interpretations of PROs in relation to clinical outcomes [5, 6, 13, 26, 30, 68, 70].
Where PRO and clinical results were published separately (n = 15), most primary papers did not provide any PRO rationale (n = 10, 66%) or text interpreting PROs in relation to clinical findings (n = 10, 66%). One primary paper provided detailed descriptions of both these issues. In comparison, all supplemental papers described PRO rationales and most (14, 93%) contained detailed interpretation of PROs in relation to clinical findings, although only two had detailed descriptions of both of these. Of the 15 primary papers, 66% signposted the presence of the supplemental PRO report.
Conclusions
Reporting PRO rationale linked to clinical hypotheses, and clear reporting of PRO results interpreted appropriately in the context of the clinical outcomes are critical to ensure that oncologists gather a “take-home” message to communicate to patients which encompasses clinical and PROs. This review explored this issue in detail. Patient reported outcome reporting standards were at lowest levels in primary clinical papers (where clinical trial data was reported separately to the supplementary PROs). Whilst supplemental papers provided more detail there was a 5 to 51 month delay in publication in less well cited journals, thus diminishing their impact. Most (71%) trials did report combined results, demonstrating that it is possible to do so. New methods to examine reporting of trial “take home” messages recommend that detailed information about domain specific PRO rational and interpretation with clinical data are supplied within a main trial paper to arm clinicians with relevant outcomes to use in decision-making. Authors need to be allowed space to report these details alongside clinical outcomes to inform the take home message from papers to help clinicians in practice. Where this is not appropriate for scientific reasons, for example, if primary outcome data are available before secondary PROs, then this could be explicitly stated.
Other systematic reviews have shown that PRO reporting standards are poor [71–77] which contributed to the need for the development of the PRO CONSORT extension. Similarly, other papers have recommended clear PRO hypotheses and integration with clinical findings, however, there is no empirical data presented on how to best achieve this [78]. Reviews also have examined how PROs in RCTs influence decision-making and confirm that PRO information is not used in practice [77, 79, 80]. Previous work, however, has not provided solutions to these problems or considered the conceptual reasons why PRO data are not used in practice. Theoretically, failure of PRO data to have an impact on clinical practice may stem from problems that start with the trial design and conduct, compounded by poor reporting and separate PRO and clinical publications. Further research is now needed to investigate whether improved reporting will have the desired effect of informing patient-centred care, clinical decision making and health policy decisions. For example, work could include a study directly exploring oncologists’ views of trial reports following the introduction of new reporting guidelines would be informative. Additionally in-depth research of clinical decision-making in multi-disciplinary teams or of oncology consultations may be undertaken to examine how PRO data are used.
Research needs to be targeted into each of these areas in order to understand how improvements, such as the recently published SPIRIT statement [81] for improving RCT protocols or the CONSORT PRO extension, impact clinical practice. What is clear is that cancer patients want information about PROs and indeed rate such data of similar importance to survival information [82–84]. It is therefore critical that oncologists communicate PRO data in the context of a shared doctor-patient consultation and methods to do so are being established [85–87]. This may have occurred because authors split trial results and deliberately left the PRO methodology and findings to the supplemental report.
This review included a systematic search for studies using PRISMA guidelines [88] and transparent methodology for an in-depth analyses if the textual data, but there were some limitations. Trials of radical treatments of gastrointestinal cancers were selected for analyses because the authors were familiar with the PRO and clinical data in this field. It is conceivable that including trials in other diseases or in the palliative setting may have identified different reporting standards. For example, in the palliative setting, authors may make greater reference to PROs and their integration with clinical outcomes because the main focus of treatment is not to cure disease. Further work is needed to examine this area in detail. In addition, studies with high or unascertainable risk of bias were excluded because lower standards of reporting are associated with bias and likely poor PRO reporting [89], and it is possible that important data were missed. This is considered to be unlikely however, because even the included “high-quality” trials demonstrated significant reporting weaknesses and inclusion of poor quality trials would probably not yield exemplar practice.
In summary, this review presents and evidence based way of implementing the new CONSORT PRO extension items 2a, P2b, P20/21 and 22 based on current literature. It is recommended that RCTs report domain-specific PRO rationale with anticipated treatment effects, and integrate these findings with specific clinical outcomes in a single combined report. It is acknowledged that trials are structured around their primary (often clinical) endpoints, and it is appropriate to prioritise these data at the expense of other outcomes. It seems unnecessary, however, to relegate evaluation of patient experience to reports that may be less likely to influence practice. The adoption of better standards for PRO reporting could facilitate the use of PRO data by oncologists and patients for informed decision making.
Supporting Information
S1 Table. Reporting of CONSORT PRO extension by individual publication, including total number of appropriately reported items.
https://doi.org/10.1371/journal.pone.0160998.s003
(DOCX)
Author Contributions
- Conceived and designed the experiments: AGKM RCM NSB STB JMB.
- Performed the experiments: AGKM RCM NSB STB JMB.
- Analyzed the data: AGKM RCM NSB STB JMB.
- Contributed reagents/materials/analysis tools: AGKM RCM NSB STB JMB.
- Wrote the paper: AGKM RCM NSB STB JMB.
References
- 1. Calvert M, Brundage M, Jacobsen PB, Schunemann HJ, Efficace F. The CONSORT Patient-Reported Outcome (PRO) extension: implications for clinical trials and practice. Health and quality of life outcomes. 2013;11:184. pmid:24168680; PubMed Central PMCID: PMC3842645.
- 2. Blazeby JM, Avery K, Sprangers M, Pikhart H, Fayers P, Donovan J. Health-related quality of life measurement in randomized clinical trials in surgical oncology. Journal of Clinical Oncology. 2006;24(19):3178–86. pmid:16809741
- 3.
The Cochrane C. Cochrane handbook for systematic reviews of interventions2009.
- 4. Au HJ, Karapetis CS, O'Callaghan CJ, Tu D, Moore MJ, Zalcberg JR, et al. Health-related quality of life in patients with advanced colorectal cancer treated with cetuximab: overall and KRAS-specific results of the NCIC CTG and AGITG CO.17 Trial. Journal of Clinical Oncology. 2009;27(11):1822–8. pmid:19273701
- 5. King PM, Blazeby JM, Ewings P, Franks PJ, Longman RJ, Kendrick AH, et al. Randomized clinical trial comparing laparoscopic and open surgery for colorectal cancer within an enhanced recovery programme. British Journal of Surgery. 2006;93(3):300–8. pmid:16363014
- 6. Ajani JA, Moiseyenko VM, Tjulandin S, Majlis A, Constenla M, Boni C, et al. Quality of life with docetaxel plus cisplatin and fluorouracil compared with cisplatin and fluorouracil from a phase III trial for advanced gastric or gastroesophageal adenocarcinoma: the V-325 Study Group. Journal of Clinical Oncology. 2007;25(22):3210–6. pmid:17664468
- 7. Van Cutsem E, Moiseyenko VM, Tjulandin S, Majlis A, Constenla M, Boni C, et al. Phase III study of docetaxel and cisplatin plus fluorouracil compared with cisplatin and fluorouracil as first-line therapy for advanced gastric cancer: a report of the V325 Study Group. Journal of Clinical Oncology. 2006;24(31):4991–7. pmid:17075117
- 8. Jonker DJ, O'Callaghan CJ, Karapetis CS, Zalcberg JR, Tu D, Au HJ, et al. Cetuximab for the treatment of colorectal cancer. New England Journal of Medicine. 2007;357(20):2040–8. pmid:18003960
- 9. de Boer AGEM, van Lanschot JJB, van Sandick JW, Hulscher JBF, Stalmeier PFM, De Haes JCJM, et al. Quality of life after transhiatal compared with extended transthoracic resection for adenocarcinoma of the esophagus. Journal of Clinical Oncology. 2004;22(20):4202–8. pmid:15483031
- 10. Hulscher JBF, van Sandick JW, De Boer AGEM, Wijnhoven BPL, Tijssen JGP, Fockens P, et al. Extended transthoracic resection compared with limited transhiatal resection for adenocarcinoma of the esophagus. New England Journal of Medicine. 2002;347(21):1662–9. pmid:12444180
- 11. Braga M, Frasson M, Zuliani W, Vignali A, Pecorelli N, Di Carlo V. Randomized clinical trial of laparoscopic versus open left colonic resection. British Journal of Surgery. 2010;97(8):1180–6. pmid:20602506
- 12. Braga M, Vignali A, Gianotti L, Zuliani W, Radaelli G, Gruarin P, et al. Laparoscopic versus open colorectal surgery—A randomized trial on short-term outcome. Annals of Surgery. 2002;236(6):759–66. pmid:WOS:000179739700014.
- 13. Chau I, Norman AR, Cunningham D, Iveson T, Hill M, Hickish T, et al. Longitudinal quality of life and quality adjusted survival in a randomised controlled trial comparing six months of bolus fluorouracil/leucovorin vs. twelve weeks of protracted venous infusion fluorouracil as adjuvant chemotherapy for colorectal cancer. European Journal of Cancer. 2005;41(11):1551–9. pmid:16026692
- 14. Chau I, Norman AR, Cunningham D, Tait D, Ross PJ, Iveson T, et al. A randomised comparison between 6 months of bolus fluorouracil/leucovorin and 12 weeks of protracted venous infusion fluorouracil as adjuvant treatment in colorectal cancer. Annals of Oncology. 2005;16(4):549–57. pmid:15695501
- 15. Hallbook O, Hass U, Wanstrom A, Sjodahl R. Quality of life measurement after rectal excision for cancer. Comparison between straight and colonic J-pouch anastomosis. ScandJ Gastroenterol. 1997;32(5):490–3.
- 16. Hallbook O, Pahlman L, Krog M, Wexner SD, Sjodahl R. Randomized comparison of straight and colonic J pouch anastomosis after low anterior resection. Annals of Surgery. 1996;224(1):58–65. pmid:8678619
- 17. Janson M, Lindholm E, Anderberg B, Haglind E. Randomized trial of health-related quality of life after open and laparoscopic surgery for colon cancer. Surgical Endoscopy. 2007;21(5):747–53. pmid:17342556
- 18. Veldkamp R, Kuhry E, Hop WC, Jeekel J, Kazemier G, Bonjer HJ, et al. Laparoscopic surgery versus open surgery for colon cancer: short-term outcomes of a randomised trial. The lancet oncology. 2005;6:477–84. pmid:15992696
- 19. Kabbinavar FF, Wallace JF, Holmgren E, Yi J, Cella D, Yost KJ, et al. Health-related quality of life impact of bevacizumab when combined with irinotecan, 5-fluorouracil, and leucovorin or 5-fluorouracil and leucovorin for metastatic colorectal cancer. Oncologist. 2008;13(9):1021–9. pmid:18776057
- 20. Hurwitz H, Fehrenbacher L, Novotny W, Cartwright T, Hainsworth J, Heim W, et al. Bevacizumab plus irinotecan, fluorouracil, and leucovorin for metastatic colorectal cancer.[see comment]. New England Journal of Medicine. 2004;350(23):2335–42. pmid:15175435
- 21. King PM, Blazeby JM, Ewings P, Kennedy RH. Detailed evaluation of functional recovery following laparoscopic or open surgery for colorectal cancer within an enhanced recovery programme. International Journal of Colorectal Disease. 2008;23(8):795–800. pmid:18465136
- 22. Kopec JA, Yothers G, Ganz PA, Land SR, Cecchini RS, Wieand HS, et al. Quality of life in operable colon cancer patients receiving oral compared with intravenous chemotherapy: results from National Surgical Adjuvant Breast and Bowel Project Trial C-06. Journal of Clinical Oncology. 2007;25(4):424–30. pmid:17264338
- 23. Lembersky BC, Wieand HS, Petrelli NJ, O'Connell MJ, Colangelo LH, Smith RE, et al. Oral uracil and tegafur plus leucovorin compared with intravenous fluorouracil and leucovorin in stage II and III carcinoma of the colon: results from National Surgical Adjuvant Breast and Bowel Project Protocol C-06. Journal of Clinical Oncology. 2006;24(13):2059–64. pmid:16648506
- 24. Marijnen CA, van de Velde CJ, Putter H, van den Brink M, Maas CP, Martijn H, et al. Impact of short-term preoperative radiotherapy on health-related quality of life and sexual functioning in primary rectal cancer: report of a multicenter randomized trial. Journal of Clinical Oncology. 2005;23(9):1847–58. pmid:15774778
- 25. Kapiteijn E, Marijnen CAM, Nagtegaal ID, Putter H, Steup WH, Wiggers T, et al. Preoperative radiotherapy combined with total mesorectal excision for resectable rectal cancer. New England Journal of Medicine. 2001;345(9):638–46. pmid:11547717
- 26. Siena S, Peeters M, Van CE, Humblet Y, Conte P, Bajetta E, et al. Association of progression-free survival with patient-reported outcomes and survival: results from a randomised phase 3 trial of panitumumab. British Journal of Cancer. 2007;97(11):1469–74. pmid:18040272
- 27. Van Cutsem E, Peeters M, Siena S, Humblet Y, Hendlisz A, Neyns B, et al. Open-label phase III trial of panitumumab plus best supportive care compared with best supportive care alone in patients with chemotherapy-refractory metastatic colorectal cancer. Journal of Clinical Oncology. 2007;25(13):1658–64. pmid:17470858
- 28. Stephens RJ, Thompson LC, Quirke P, Steele R, Grieve R, Couture J, et al. Impact of short-course preoperative radiotherapy for rectal cancer on patients' quality of life: data from the Medical Research Council CR07/National Cancer Institute of Canada Clinical Trials Group C016 randomized clinical trial. Journal of Clinical Oncology. 2010;28(27):4233–9. pmid:20585099
- 29. Sebag-Montefiore D, Stephens RJ, Steele R, Monson J, Grieve R, Khanna S, et al. Preoperative radiotherapy versus selective postoperative chemoradiotherapy in patients with rectal cancer (MRC CR07 and NCIC-CTG C016): a multicentre, randomised trial.[see comment]. Lancet. 2009;373(9666):811–20. pmid:19269519
- 30. Weeks JC, Nelson H, Gelber S, Sargent D, Schroeder G. Short-term quality-of-life outcomes following laparoscopic-assisted colectomy vs open colectomy for colon cancer: a randomized trial. JAMA. 2002;287(3):321–8. pmid:11790211
- 31. Nelson H, Sargent D, Wieand HS, Fleshman J, Anvari M, Stryker SJ, et al. A comparison of laparoscopically assisted and open colectomy for colon cancer. New England Journal of Medicine. 2004;350(20):2050–9. pmid:15141043
- 32. Wu CW, Chiou JM, Ko FS, Lo SS, Chen JH, Lui WY, et al. Quality of life after curative gastrectomy for gastric cancer in a randomised controlled trial. British Journal of Cancer. 2008;98(1):54–9. pmid:18182977
- 33. Wu CW, Hsiung CA, Lo SS, Hsieh MC, Chen JH, Li AF, et al. Nodal dissection for patients with gastric cancer: a randomised controlled trial. The lancet oncology. 2006;7:309–15. pmid:16574546
- 34. Biere SS, van Berge Henegouwen MI, Maas KW, Bonavina L, Rosman C, Garcia JR, et al. Minimally invasive versus open oesophagectomy for patients with oesophageal cancer: a multicentre, open-label, randomised controlled trial. Lancet. 2012;379(9829):1887–92. pmid:22552194
- 35. Bramhall SR, Hallissey MT, Whiting J, Scholefield J, Tierney G, Stuart RC, et al. Marimastat as maintenance therapy for patients with advanced gastric cancer: a randomised trial. British Journal of Cancer. 2002;86(12):1864–70. pmid:12085177
- 36. Carmichael J, Popiela T, Radstone D, Falk S, Borner M, Oza A, et al. Randomized comparative study of tegafur/uracil and oral leucovorin versus parenteral fluorouracil and leucovorin in patients with previously untreated metastatic colorectal cancer. Journal of Clinical Oncology. 2002;20(17):3617–27. pmid:12202662
- 37. Cunningham D, Starling N, Rao S, Iveson T, Nicolson M, Coxon F, et al. Capecitabine and oxaliplatin for advanced esophagogastric cancer. New England Journal of Medicine. 2008;358(1):36–46. pmid:18172173
- 38. de Gramont A, Figer A, Seymour M, Homerin M, Hmissi A, Cassidy J, et al. Leucovorin and fluorouracil with or without oxaliplatin as first-line treatment in advanced colorectal cancer. Journal of Clinical Oncology. 2000;18(16):2938–47. pmid:10944126
- 39. Doeksen A, Bakx R, Vincent A, van Tets WF, Sprangers MA, Gerhards MF, et al. J-pouch vs side-to-end coloanal anastomosis after preoperative radiotherapy and total mesorectal excision for rectal cancer: a multicentre randomized trial. Colorectal Disease. 2012;14(6):705–13. doi: https://doi.org/http://dx.doi.org/10.1111/j.1463-1318.2011.02725.x. pmid:21831100
- 40. Douillard JY, Cunningham D, Roth AD, Navarro M, James RD, Karasek P, et al. Irinotecan combined with fluorouracil compared with fluorouracil alone as first-line treatment for metastatic colorectal cancer: a multicentre randomised trial. Lancet. 2000;355(9209):1041–7. pmid:10744089
- 41. Douillard JY, Hoff PM, Skillings JR, Eisenberg P, Davidson N, Harper P, et al. Multicenter phase III study of uracil/tegafur and oral leucovorin versus fluorouracil and leucovorin in patients with previously untreated metastatic colorectal cancer. Journal of Clinical Oncology. 2002;20(17):3605–16. pmid:12202661
- 42. Fein M, Fuchs KH, Thalheimer A, Freys SM, Heimbucher J, Thiede A. Long-term benefits of Roux-en-Y pouch reconstruction after total gastrectomy: a randomized trial. Annals of Surgery. 2008;247(5):759–65. pmid:18438112
- 43. Fields AL, Keller A, Schwartzberg L, Bernard S, Kardinal C, Cohen A, et al. Adjuvant therapy with the monoclonal antibody Edrecolomab plus fluorouracil-based therapy does not improve overall survival of patients with stage III colon cancer. Journal of Clinical Oncology. 2009;27(12):1941–7. pmid:19273708
- 44. Fuchs CS, Moore MR, Harker G, Villa L, Rinaldi D, Hecht JR. Phase III comparison of two irinotecan dosing regimens in second-line therapy of metastatic colorectal cancer. Journal of Clinical Oncology. 2003;21(5):807–14. pmid:12610178
- 45. Furst A, Burghofer K, Hutzel L, Jauch KW. Neorectal reservoir is not the functional principle of the colonic J- pouch: the volume of a short colonic J-pouch does not differ from a straight coloanal anastomosis. DisColon Rectum. 2002;45(5):660–7.
- 46. Gray B, Van HG, Hope M, Burton M, Moroz P, Anderson J, et al. Randomised trial of SIR-Spheres plus chemotherapy vs. chemotherapy alone for treating patients with liver metastases from primary large bowel cancer. Annals of Oncology. 2001;12(12):1711–20. pmid:11843249
- 47. Guillou PJ, Quirke P, Thorpe H, Walker J, Jayne DG, Smith AM, et al. Short-term endpoints of conventional versus laparoscopic-assisted surgery in patients with colorectal cancer (MRC CLASICC trial): multicentre, randomised controlled trial. Lancet. 2005;365(9472):1718–26. pmid:15894098
- 48. Hoksch B, Ablassmaier B, Zieren J, Muller JM. Quality of life after gastrectomy: Longmire's reconstruction alone compared with additional pouch reconstruction. World J Surg. 2002;26(3):335–41. pmid:11865371
- 49. Jayne DG, Guillou PJ, Thorpe H, Quirke P, Copeland J, Smith AM, et al. Randomized trial of laparoscopic-assisted resection of colorectal carcinoma: 3-year results of the UK MRC CLASICC Trial Group. Journal of Clinical Oncology. 2007;25(21):3061–8. pmid:17634484
- 50. Kang SB, Park JW, Jeong SY, Nam BH, Choi HS, Kim DW, et al. Open versus laparoscopic surgery for mid or low rectal cancer after neoadjuvant chemoradiotherapy (COREAN trial): short-term outcomes of an open-label randomised controlled trial. Lancet Oncology. 2010;11(7):637–45. pmid:20610322
- 51. Kataria K, Verma GR, Malhotra A, Yadav R. Comparison of quality of life in patients undergoing transhiatal esophagectomy with or without chemotherapy. Saudi Journal of Gastroenterology. 2012;18(3):195–200. doi: https://doi.org/http://dx.doi.org/10.4103/1319-3767.96454. pmid:22626799
- 52. Kemeny NE, Niedzwiecki D, Hollis DR, Lenz HJ, Warren RS, Naughton MJ, et al. Hepatic arterial infusion versus systemic therapy for hepatic metastases from colorectal cancer: a randomized trial of efficacy, quality of life, and molecular markers (CALGB 9481). Journal of Clinical Oncology. 2006;24(9):1395–403. pmid:16505413
- 53. Kohne CH, Wils J, Lorenz M, Schoffski P, Voigtmann R, Bokemeyer C, et al. Randomized phase III study of high-dose fluorouracil given as a weekly 24-hour infusion with or without leucovorin versus bolus fluorouracil plus leucovorin in advanced colorectal cancer: European organization of Research and Treatment of Cancer Gastrointestinal Group Study 40952. Journal of Clinical Oncology. 2003;21(20):3721–8. pmid:12963704
- 54. Lal R, Dickson J, Cunningham D, Chau I, Norman AR, Ross PJ, et al. A randomized trial comparing defined-duration with continuous irinotecan until disease progression in fluoropyrimidine and thymidylate synthase inhibitor-resistant advanced colorectal cancer. Journal of Clinical Oncology. 2004;22(15):3023–31. pmid:15284252
- 55. Maughan TS, James RD, Kerr DJ, Ledermann JA, McArdle C, Seymour MT, et al. Comparison of survival, palliation, and quality of life with three chemotherapy regimens in metastatic colorectal cancer: a multicentre randomised trial. Lancet. 2002;359(9317):1555–63. pmid:12047964
- 56. Punt CJ, Nagy A, Douillard JY, Figer A, Skovsgaard T, Monson J, et al. Edrecolomab alone or in combination with fluorouracil and folinic acid in the adjuvant treatment of stage III colon cancer: a randomised study. Lancet. 2002;360:671–7. pmid:12241873
- 57. Punt CJ, Keizer HJ, Douma J, Skovsgaard T, Schuller J, Muller EW, et al. Trimetrexate as biochemical modulator of 5-fluorouracil/leucovorin in advanced colorectal cancer: final results of a randomised European study. Annals of Oncology. 2002;13(1):81–6. pmid:11865814
- 58. Rao S, Cunningham D, de Gramont A, Scheithauer W, Smakal M, Humblet Y, et al. Phase III double-blind placebo-controlled study of farnesyl transferase inhibitor R115777 in patients with refractory advanced colorectal cancer. Journal of Clinical Oncology. 2004;22(19):3950–7. pmid:15459217
- 59. Ross P, Nicolson M, Cunningham D, Valle J, Seymour M, Harper P, et al. Prospective randomized trial comparing mitomycin, cisplatin, and protracted venous-infusion fluorouracil (PVI 5-FU) with epirubicin, cisplatin, and PVI 5-FU in advanced esophagogastric cancer. Journal of Clinical Oncology. 2002;20(8):1996–2004. pmid:11956258
- 60. Sailer M, Fuchs KH, Fein M, Thiede A. Randomized clinical trial comparing quality of life after straight and pouch coloanal reconstruction. BrJ Surg. 2002;89(9):1108–17.
- 61. Saini A, Norman AR, Cunningham D, Chau I, Hill M, Tait D, et al. Twelve weeks of protracted venous infusion of fluorouracil (5-FU) is as effective as 6 months of bolus 5-FU and folinic acid as adjuvant treatment in colorectal cancer. British Journal of Cancer. 2003;88(12):1859–65. pmid:12799627
- 62. Saltz LB, Cox JV, Blanke C, Rosen LS, Fehrenbacher L, Moore MJ, et al. Irinotecan plus fluorouracil and leucovorin for metastatic colorectal cancer. New England Journal of Medicine. 2000;343:905–14. pmid:11006366
- 63. Sobrero A, Zaniboni A, Frassineti GL, Aschele C, Guglielmi A, Giuliani R, et al. Schedule specific biochemical modulation of 5-fluorouracil in advanced colorectal cancer: a randomized study. GISCAD, IOR and collaborating centers. Annals of Oncology. 2000;11(11):1413–20. pmid:11142481
- 64. Sobrero AF, Maurel J, Fehrenbacher L, Scheithauer W, Abubakr YA, Lutz MP, et al. EPIC: phase III trial of cetuximab plus irinotecan after fluoropyrimidine and oxaliplatin failure in patients with metastatic colorectal cancer. Journal of Clinical Oncology. 2008;26(14):2311–9. pmid:18390971
- 65. Tebbutt NC, Norman A, Cunningham D, Iveson T, Seymour M, Hickish T, et al. A multicentre, randomised phase III trial comparing protracted venous infusion (PVI) 5-fluorouracil (5-FU) with PVI 5-FU plus mitomycin C in patients with inoperable oesophago-gastric cancer. Annals of Oncology. 2002;13(10):1568–75. pmid:12377644
- 66. Tol J, Koopman M, Cats A, Rodenburg CJ, Creemers GJ, Schrama JG, et al. Chemotherapy, bevacizumab, and cetuximab in metastatic colorectal cancer. New England Journal of Medicine. 2009;360(6):563–72. pmid:19196673
- 67. van Hooft JE, Bemelman WA, Oldenburg B, Marinelli AW, Holzik MF, Grubben MJ, et al. Colonic stenting versus emergency surgery for acute left-sided malignant colonic obstruction: a multicentre randomised trial.[Erratum appears in Lancet Oncol. 2011 May;12(5):418]. Lancet Oncology. 2011;12(4):344–52. pmid:21398178
- 68. Vlug MS, Wind J, Hollmann MW, Ubbink DT, Cense HA, Engel AF, et al. Laparoscopy in combination with fast track multimodal management is the best perioperative strategy in patients undergoing colonic surgery: a randomized clinical trial (LAFA-study). Annals of Surgery. 2011;254(6):868–75. pmid:21597360
- 69. Zachariah B, Gwede CK, James J, Ajani J, Chin LJ, Donath D, et al. Octreotide acetate in prevention of chemoradiation-induced diarrhea in anorectal cancer: randomized RTOG trial 0315. Journal of the National Cancer Institute. 2010;102(8):547–56. pmid:20339140
- 70. Kemeny NE, Niedzwiecki D, Hollis DR, Lenz HJ, Warren RS, Naughton MJ, et al. Hepatic arterial infusion versus systemic therapy for hepatic metastases from colorectal cancer: a randomized trial of efficacy, quality of life, and molecular markers (CALGB 9481).[see comment]. Journal of Clinical Oncology. 2006;24(9):1395–403. pmid:16505413
- 71. Efficace F, Bottomley A, Osoba D, Gotay C, Flechtner H, D'Haese S, et al. Beyond the development of health-related quality-of-life (HRQOL) measures: A checklist for evaluating HRQOL outcomes in cancer clinical trials—Does HRQOL evaluation in prostate cancer research inform clinical decision making? Journal of Clinical Oncology. 2003;21(18):3502–11. pmid:12972527
- 72. Lee CW, Chi KN. The standard of reporting of health-related quality of life in clinical cancer trials. Journal of Clinical Epidemiology. 2000;53(5):451–8. pmid:10812316
- 73. Efficace F, Bottomley A, van Andel G. Health related quality of life in prostate carcinoma patients—A systematic review of randomized controlled trials. Cancer. 2003;97(2):377–88. pmid:12518362
- 74. Efficace F, Horneber M, Lejeune S, Van Dam F, Leering S, Rottmann M, et al. Methodological quality of patient-reported outcome research was low in complementary and alternative medicine in oncology. Journal of Clinical Epidemiology. 2006;59(12):1257–65. pmid:17098568
- 75. Kong SX, Gandhi SK. Methodologic assessments of quality of life measures in clinical trials. Annals of Pharmacotherapy. 1997;31(7–8):830–6. pmid:9220039
- 76. Cocks K, King MT, Velikova G, Fayers PM, Brown JM. Quality, interpretation and presentation of European Organisation for Research and Treatment of Cancer quality of life questionnaire core 30 data in randomised controlled trials. European Journal of Cancer. 2008;44(13):1793–8. pmid:18599286
- 77. Efficace F, Kemmler G, Vignetti M, Mandelli F, Molica S, Holzner B. Health-related quality of life assessment and reported outcomes in leukaemia randomised controlled trials—A systematic review to evaluate the added value in supporting clinical decision making. European Journal of Cancer. 2008;44(11):1497–506. pmid:18555682
- 78. Lipscomb J, Reeve BB, Clauser SB, Abrams JS, Bruner DW, Burke LB, et al. Patient-reported outcomes assessment in cancer trials: taking stock, moving forward. J Clin Oncol. 2007;25(32):5133–40. pmid:17991933.
- 79. Lemieux J, Goodwin PJ, Bordeleau LJ, Lauzier S, Theberge V. Quality-of-life measurement in randomized clinical trials in breast cancer: an updated systematic review (2001–2009). Journal of the National Cancer Institute. 2011;103:178–231. pmid:21217081
- 80. Ganz PA. Assessing the Quality and Value of Quality-of-Life Measurement in Breast Cancer Clinical Trials. Journal of the National Cancer Institute. 2011;103(3).
- 81. Chan A- W, Tetzlaff JM, Altman DG, Dickersin K, Moher D. SPIRIT 2013: new guidance for content of clinical trial protocols. Lancet. 2013;381(9861):91–2. pmid:WOS:000313420900004.
- 82. Davidson JR, Brundage MD, Feldman-Stewart D. Lung cancer treatment decisions: Patients' desires for participation and information. Psycho-Oncology. 1999;8(6):511–20. pmid:10607984
- 83. Brundage M, Feldman-Stewart D, Leis A, Bezjak A. The importance of quality of life information to a lung cancer (NSCLC) chemotherapy treatment decision—Results of a randomized evaluation. Psycho-Oncology. 2007;16(9):S7-S.
- 84. Feldman-Stewart D, Brundage MD, Hayter C, Groome P, Nickel JC, Downes H, et al. What questions do patients with curable prostate cancer want answered? Medical Decision Making. 2000;20(1):7–19. pmid:10638532
- 85. McNair AGK, Brookes ST, Davis CR, Argyropoulos M, Blazeby JM. Communicating the Results of Randomized Clinical Trials: Do Patients Understand Multidimensional Patient-Reported Outcomes? Journal of Clinical Oncology. 2010;28(5):738–43. pmid:20065187
- 86. Brundage M, Feldman-Stewart D, Leis A, Bezjak A, Degner L, Velji K, et al. Communicating quality of life information to cancer patients: A study of six presentation formats. Journal of Clinical Oncology. 2005;23(28):6949–56. pmid:16192583
- 87. Brundage M, Bass B, Jolie R, Foley K. A knowledge translation challenge: clinical use of quality of life data from cancer clinical trials. Quality of Life Research. 2011;20(7):979–85. pmid:21279446
- 88. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration. Plos Medicine. 2009;6(7).
- 89. Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, et al. CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials. British Medical Journal. 2010;340.