Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Validity and feasibility of the Arabic version of distress thermometer for Saudi cancer patients

  • Fahad D. Alosaimi ,

    Roles Conceptualization, Formal analysis, Methodology, Project administration, Resources, Supervision, Validation, Writing – original draft, Writing – review & editing

    dr.fahad.alosaimi@gmail.com

    Affiliation Psychiatry Department, King Saud University, Riyadh, Saudi Arabia

  • Nashwa Abdel-Aziz,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Software, Validation, Writing – original draft

    Affiliations Hematology Oncology center, King Saud University, Riyadh, Saudi Arabia, Department of Medical Oncology, South Egypt Cancer Institute, Assiut University, Assiut, Egypt

  • Khalid Alsaleh,

    Roles Conceptualization, Resources, Supervision, Writing – review & editing

    Affiliation Hematology Oncology center, King Saud University, Riyadh, Saudi Arabia

  • Rawan AlSheikh,

    Roles Data curation, Investigation, Methodology, Validation, Writing – review & editing

    Affiliation Department of Pediatrics, King Saud University, Riyadh, Saudi Arabia

  • Rana AlSheikh,

    Roles Data curation, Investigation, Methodology, Validation, Writing – review & editing

    Affiliation Department of Pediatrics, King Saud University, Riyadh, Saudi Arabia

  • Ahmed Abdel-Warith

    Roles Conceptualization, Resources, Supervision, Writing – review & editing

    Affiliation Hematology Oncology center, King Saud University, Riyadh, Saudi Arabia

Abstract

Background

The distress thermometer (DT) has been studied and validated as an effective screening instrument for identifying distress among cancer patients worldwide. This study aims to evaluate the validity of the Arabic version of the DT in Saudi cancer patients, to define the optimal cutoff point of the Arabic DT for detecting clinically significant distress and to determine whether there is any correlation between clinically significant distress and other demographic and Problem List variables.

Methods

The original form of the DT was translated to Arabic using a forward and backward translation method. Then, a group of 247 cancer patients who were followed up at the Outpatient Oncology Clinic at King Saud Medical City in Riyadh, Saudi Arabia, completed a socio-demographic and clinical status questionnaire, the DT and the Problem List scale, and the Hospital Anxiety and Depression Scale (HADS).

Results

Receiver operating characteristic (ROC) curve analyses picked out an area under the curve of 0.76 when compared with a HADS cutoff score of 15. The DT had the best sensitivity (0.70) and specificity (0.63) with cutoff score of 4. A DT score of 4 or more was found to have a statistically significant correlation with female gender, advanced cancer stages and most of the Problem List items, including child care, work or school, treatment decision, dealing with children and partners, depression, fears, nervousness, sadness, loss of interest in usual activity, religious concerns, appearance, bathing/dressing, breathing, diarrhea, fatigue, feeling swollen, fever, getting around, indigestion, memory and concentration, nausea, dry nose, pain, and sexual problems. In contrast, a multivariate regression analysis confirmed only advanced cancer stages, treatment decision, depression, fear, sadness, worry, breathing, feeling swollen, fever, indigestion, memory and concentration, dry nose and congestion, pain and sleep as independent factors associated with distress in cancer patients.

Conclusions

We found the Arabic version of the DT to be a valid instrument for screening distress in Saudi patients with cancer. Our study proposes using a cutoff score of 4 as an indicator of clinically significant distress in this population.

Background

Cancer is a leading cause of morbidity and mortality worldwide, with nearly 14 million new cases diagnosed in 2012 and an expected increase of approximately 70% in the next two decades [1]. In Saudi Arabia, more than 15,000 new cancer cases are diagnosed per year [2]. Psychosocial distress in cancer populations is defined as “a multi-determined unpleasant emotional experience of a psychological, social and/or spiritual nature that may negatively affect the ability to cope with cancer” [3]. It is common among cancer patients due to the diagnosis of a life-threatening and distressing disease, aggressive medical treatments, shifts in lifestyle and most importantly the direct morbidities of malignancy, which have a significant impact on the patient's' physical, psychological, social and spiritual functions [4,5]. Several studies have shown that patients with cancer show high levels of psychological distress, including sub-syndromal symptoms of depression and anxiety, while fewer cancer patients develop chronic emotional and psychological problems such as major depressive disorder (MDD) or anxiety disorders [6,7]. The overall level of clinically significant distress was reported to be between 20–47% among cancer patients during the course of the disease [3,8].

Psychosocial care is increasingly being acknowledged as an essential element of the clinical management of patients with cancer as it benefits the patients, their families/caregiver and the treating staff [3]. A significant number of patients could benefit from having their distress identified and treated, which may positively affect different aspects, including quality of life, participation in treatment and satisfaction with disease management [7]. A lack of experience with evaluating distress and using psychometric instruments among health professionals can lead to a failure to identify distress in patients [9]. Mitchell et al. reported that less than 10% of cancer health care professionals used a validated questionnaire to assess distress during consultations [9]. In addition, busy health care professionals often miss the assessment of distress symptoms in their patients, and most patients are reluctant to describe their distress, which significantly reduces the diagnosis of distress symptoms in cancer patients [10].

Since a great number of distressed cancer patients remained unrecognized by medical staff, only the systematic screening of patients allows timely support for those who are most in need [8]. Therefore, many international regulatory organizations and professional societies (e.g., International Psycho-Oncology Society (IPOS), National Institute for Health and Care Excellence (NICE) and National Comprehensive Cancer Network (NCCN)) have recommended the routine screening and management of distress as an integral aspect of whole-person cancer care in the same way that health-care teams monitor and respond to other vital signs [3,5,7]. The effectiveness of screening programs starts with the selection of a screening tool that is suitable in terms of briefness, precision, and acceptability [5].

Several instruments have been used to screen for distress in the cancer setting [7]. The Distress Thermometer (DT) is one of the best-known instruments because it is a quick and effective screening tool to recognize, diagnose and provide prompt management of distress in cancer patients and has the ability to address barriers. Therefore, it has been recommended by the NCCN in its Clinical Practice Guidelines in Cancer Distress Management [3]. DT is a single-item, self-report measure of distress that provides a brief, visual analogue, non-invasive, valid and acceptable alternative to longer and more burdensome psychometric instruments. In addition, the Problem List (PL) can be used with the DT to provide words for psychological problems with non-stigmatizing connotations to identify possible contributing factors [3]. The PL offers the advantage of being brief enough to be easy for health professionals to use in daily practice. DT is suitable for oncology staff based on the finding that approximately three quarters of them would prefer an ultra-short or single-item screening tool for easy application [3,9,11].

The DT has been investigated and validated as an effective screening tool for detecting distress among patients with various types of cancer, such as prostate carcinoma [12], bone marrow transplantation [13], lung cancer[14], breast cancer [15]and mixed-site cancer[16]. The DT has been successfully translated from English into several languages, including Indonesian [17], Dutch [18], Japanese [19], Korean [20], Turkish [21], Italian, Spanish and Portuguese [22]. Therefore, in our study, we aimed to assess the validity of the Arabic version of the DT in Saudi cancer patients, to address the optimal cutoff point of the DT in these cohorts and to determine whether there is any correlation between clinically significant distress and other demographic and clinical variables.

Methods

First, we got an ethical approval from the institutional review board at the Faculty of Medicine at King Saud University in Riyadh, Saudi Arabia (reference no. E-14-1181), and written permission from the NCCN to conduct the study. It included two phases: Phase 1, the validation phase of the DT, and Phase II, the evaluation of the validated DT in different types of cancer to identify the types of distress and their correlations with other demographic and clinical variables.

Phase I: Validation of the DT

The forward- and back-translation method was used to translate the DT [23]. The original English version of the DT V.2.2013 [3] was translated to Arabic by a bilingual linguistic specialist and then back to English by another bilingual linguistic specialist. During each phase, experts in oncology and psychiatry compared both translated versions with the original scale, and any dissimilarities were fixed to get one final version. The final version in Arabic was tested on 20 individuals and then repeated one week later to ensure its reliability. Subsequently, the phrasing of some questions was reformed according to the feedback. Finally, the Arabic version of the DT was confirmed and applied.

Phase II: Feasibility and evaluation of the validated DT in different types of cancer

Between May and August 2015, we recruited 247 patients with different types of cancer from the outpatient and in-patient units of the Hematology/Oncology center at King Saud University Medical City, Riyadh, Saudi Arabia.

Inclusion criteria included age >18 years, Saudi nationality, diagnosis of cancer, adequate command of spoken and written Arabic language, and informed consent. Patients who had been treated for psychiatric illness were excluded from the study. After eligible patients were identified, the study objectives and procedure were fully explained to them. A total of 15 undergraduate medical students were trained as research assistants. The research assistants were responsible for the chart review for clinical data and were present when participants filled-in the questionnaires in case of any difficulties.

Measures

Socio-demographic and clinical status.

A socio-demographic and clinical status form was used. The patients’ clinical status was acquired mainly from their medical charts.

Distress Thermometer (DT).

The DT is a one-item, self-report instrument that uses an 11-point visual analog scale ranging from 0 (no distress) to 10 (extreme distress) on which participants rate their level of distress over the past week [3,24]. The patients were also asked to complete the PL that comes along with the visual image of the DT to convey whether they had any of the problems on the list during the same period. The PL helps to delineate the nature of the problems that may have caused the reported distress[3]. The PL consists of 36 problems that are clustered into five categories: practical, family, emotional, spiritual/religious and physical problems.

Hospital Anxiety and Depression Scale (HADS).

A previously validated Arabic version of the Hospital Anxiety and Depression Scale (HADS) was used [25]. The HADS is a 14-item self-report scale that has been used extensively to examine psychological distress in medical populations. It has been used widely to validate the DT [12,18,22,24,26]. Participants were requested to specify which of 4 options (rated 3–0) best defines their distress during the previous week on 7 items that measure anxiety and 7 items that measure depressive symptoms. The maximum score of HADS is 21 on each subscale and a total score of 42 [27]. In our study, we used the common HADS cutoff score of 15, which identify best between people with clinically significant emotional distress [24,2830].

Data analysis

Statistical Package for Social Science (SPSS 17.0) was used for data analysis. Chi-square tests or Fisher’s exact tests (as appropriate) were used for categorical data, and Student’s t-tests were used for continuous data. All P-values were two-tailed. A P-value < 0.05 was considered statistically significant.

We used Receiver operating characteristic (ROC) analysis to ascertain the optimal DT cutoff score for identifying patients with clinically significant distress. The area under the curve (AUC) was used to assess the general discriminative accuracy of the DT cutoff score. To interpret the AUC values, we used the Hosmer and Lemeshow guidelines [31], namely, an AUC = 0.50 as an suggestion that the test has no discrimination, an AUC ≤ 0.70 as acceptable discrimination, AUC ≤ 0.80 as good discrimination and an AUC ≤ 0.90 as excellent discrimination [17]. Chi-square analyses were conducted to explore the association between the DT cutoff scores and the demographic and clinical variables and the individual items in the PL.

Results

Demographic and clinical characteristics

A total of 247 cancer patients participated in this study. The response rate was 92.8%. Nineteen out of the 266 patients approached declined to participate in the study. The mean age of the participants was 49.4 (18–77) years. The majority of the participants were female (172, 70%), and most of them were married (177, 72%). The participants had variable education levels. One hundred seventy-nine patients (73%) scored 2 or less on the Eastern Cooperative Oncology Group (ECOG) performance status, which means they were at least ambulatory and capable of self-care.

The patients’ average DT score was 4.07 (SD = 2.5). The most frequent problems reported on the practical domain of the PL were, in descending order, sleep (44.1%), nervousness (42.5), loss of interest in usual activity (37.2%), pain (34%), constipation (32.4%), eating (33.6%), tingling sensation in hand and feet (31.7%), itching and dry skin (31.6%), indigestion (28.3%), sadness (29.6%), worry (29.5%), getting around (29.1%), depression (27.5%), nausea (26.7%), fear (25.1%), appearance (23.5%), feeling swollen (23.5%), memory and concentration, etc.

The correlation between the DT score and the HADS total score was 0.501 (p < 0.000); between DT and HADS-Anxiety was 0.47 (p < 0.000); and between DT and HADS-Depression was 0.42 (p < 0.01). When using HADS cutoff score of 15 as the standard, the ROC analysis establish an AUC of 0.76 (95% CI = 0.73–0.88; p < 0.001; Fig 1). This AUC value indicates good discrimination.

thumbnail
Fig 1. Receiving operating characteristics (ROC) curve of the Distress Thermometer (DT) score versus Hospital Anxiety and Depression Scale cutoff scores of 247 cancer patients.

https://doi.org/10.1371/journal.pone.0207364.g001

Table 1 shows the sensitivity, specificity, positive predictive values and negative predictive values for each DT cut-off point. A cutoff score of 3.5 on the DT optimally identified 62% of the HADS cases (sensitivity) and 74.3% of the HADS non-cases (specificity) with positive and negative predictive values of 54.1% and 80.1%, respectively; a cutoff score of 4.5 on the DT optimally identified 70.3% of the HADS cases (sensitivity) and 62.5% of the HADS non-cases (specificity) with positive and negative predictive values of 47.1% and 80.1%, respectively. Therefore, a cutoff score of 4 on the DT had the best sensitivity (0.70) and specificity (0.63).

thumbnail
Table 1. Sensitivity, specificity, positive and negative predictive values for each of the distress thermometer cutoff points among 247 cancer patients.

https://doi.org/10.1371/journal.pone.0207364.t001

In the univariate analysis, a DT score of 4 or more was found to have a statistically significant correlation with female gender, advanced cancer stages and most of the PL items, including child care, work or school, treatment decision, dealing with children and partners, depression, fears, nervousness, sadness, loss of religious interest, appearance—bathing, dressing, breathing, diarrhea, fatigue, feeling swollen, fever, getting around, indigestion, memory and concentration, nausea, dry nose, pain, and sexual problems. The multivariate analysis confirmed only advanced cancer stages, treatment decision, depression, fear, sadness, worry, breathing, feeling swollen, fever, indigestion, memory and concentration, dry nose and congestion, pain and sleep as independent factors associated with significant distress in cancer patients; Tables 2 and 3.

thumbnail
Table 2. Univariate and multivariate regression analyses of the association between the Distress Thermometer (DT) score ≥ 4 and the sociodemographic and clinical characteristics of 247 cancer patients.

https://doi.org/10.1371/journal.pone.0207364.t002

thumbnail
Table 3. Univariate and multivariate regression analyses of the association between the Distress Thermometer (DT) score ≥ 4 and the Problems List items of 247 cancer patients.

https://doi.org/10.1371/journal.pone.0207364.t003

Discussion

We found the DT to be a valid instrument for screening distress in Saudi cancer patients. To the best of our knowledge, this is the first study in Saudi Arabia to assess the validity of the Arabic version of the DT in a relatively large sample of native Arabic patients with different types of cancer. The DT was translated into Arabic and used but not validated among 100 cancer patients in Jordan [32]. The results showed that as many as 70% of the patients suffered from significant distress, indicated by scores > 5 on the DT. The major components of this distress were anxiety, fear, pain, sadness and fatigue [32].

Our results confirm that the Arabic form of the DT has concurrent validity with the HADS, a well-established screening tool for distress[24,2830]. The ROC analysis matching the DT scores with the firmly established HADS cutoff score of 15 obtained an AUC of 0.76, which indicates a good discrimination. This result indicates that Arabic DT is efficacious for screening for distress in Saudi cancer patients. A DT cutoff score of 4 correctly identified 62% of patients as distressed and correctly identified 73% as not distressed. We propose using a cutoff score of 4, which bring in an optimal combination of sensitivity and specificity, in order to avoid over-misdiagnoses due to false positive results. High false positive screening results may burden both non-distressed patients with unnecessary interventions and the health care system with excess utility and costs. The NCCN recommends using a score of 4 or higher on the DT as a sign for a clinically significant distress level [3]. However, other studies have validated the score of 5 as an optimal cutoff point [12,13,19]. There are no conclusive data regarding the optimal cutoff point because a single cutoff score that clearly maximizes the accuracy of the DT has not yet been found [16].

In the present study, a DT score of 4 or more was found to be independently associated only with advanced stage of cancer and not with other sociodemographic or clinical characteristics. This finding is in concordance with former studies that were also incapable to find significant links between the DT and socio-demographic and clinical characteristics [3,13,16,19].

Participants who scored 4 or more on the DT described extra problems in the practical, family, emotional, spiritual/religious and physical areas (25 out of 36 problems) than patients who scored below the cutoff score. Although degrees vary, this finding suggests that a wide range of problems contributes to distress in cancer patients [20]. This is consistent with many similar studies performed worldwide among various cancer populations [13,14,17,20,26,28].

In our study, sleep scored top among the most frequent problems encountered over the last week by the study participants (44%). Additionally, even after the multivariate regression analysis, sleep continued to be an independent factor associated with significant distress in cancer patients. Although sleep disturbance rates in cancer range from 25 to 59%, it is rarely identified or addressed in cancer practice [33]. Moreover, it has a multifactorial etiology and may contribute to poor quality of life, tolerance of treatment and the development of depression [34]. Additionally, our study found that making decisions about cancer treatment was among the most frequent (34%) independent factors associated with significant distress in cancer patients. The relationship between experienced distress and dissatisfaction with the treatment decision is probably bidirectional[35]. To alleviate treatment decision-related distress, it might be helpful to provide with patients with prognostic information, elicit decision-making preferences, appreciate their fears and goals, and explore their wishes for family involvement [36].

One quarter of our patients complained of decreased memory and concentration, a variable that was independently associated with significant distress. The same finding was observed in similar studies[3,17]. Although cancer-related cognitive impairment is very prevalent during chemotherapy (up to 75%), it can also be detected in approximately one third of cancer patients prior to chemotherapy and even many years after the end of treatment [37]. Therefore, screening instruments like the DT may help to identify this highly distressing problem. Further research is needed to better understand the mechanism underlying the development of cancer-related cognitive impairment and may help to find effective treatments for this troubling problem [37].

The patients in our study who had spiritual/religious concerns were significant distressed, although this association disappeared after adjusting for demographic and clinical characteristics. This is probably closer to the results of some Eastern studies [13,17]. In contrast, Western studies failed to find such a significant association [12,16,19,38]. The significant association between high distress and spiritual/religious concerns could be attributed to the important role of religion in all facets of behavior in a conservative country such as Saudi Arabia [39]. Although most cancer patients seem to be able to preserve their previous relationships with God, they still have other difficulties, such as anger, loneliness and symptom distress, that are linked with their relationships with God and that deserve attention from an interdisciplinary team that includes spiritual care workers [40].

It is well known that screening programs improve patient outcomes only when linked to an effective system of assessment and treatment. Therefore, cancer centers should implement DT screening only after developing a plan for the timely evaluation of distress, reviewing its results and managing patients whose scores suggest clinically significant distress, including making appropriate referrals based on the problem areas specified on the PL [5].

Although our study is the first study in Saudi Arabia to evaluate the validity of the Arabic version of the DT in a relatively large sample of native Arabic patients with different types of cancer, it is limited by being conducted at one referral hospital. Moreover, both the convenience sampling and the overrepresentation of female participants in the sample may affect the generalizability of the study findings to all cancer patients in Saudi Arabia.

Conclusion

Our study has established the validity of the Arabic version of the DT as screening tool for distress in Saudi cancer patients. We propose using a cutoff score of 4 as an indicator of clinically significant distress in this population. We have found the distress level to correlate with the advancement of cancer. Patients who scored 4 or more on the DT described extra problems in the practical, family, emotional, spiritual/religious and physical areas than patients who scored below the cutoff score. Multi-center studies in Saudi Arabia with a larger sample of cancer patients to test the implementation of the DT in cancer centers are mandatory.

Acknowledgments

The authors would like to acknowledge the support they received from the College of Medicine Research Center, Deanship of Scientific Research, King Saud University. Moreover, the authors would like to thank the National Comprehensive Cancer Network (NCCN) for their permission to translate and use the distress thermometer.

References

  1. 1. World Health Organization. WHO | Cancer [Internet]. World Health Organization; 2017 [cited 28 Aug 2017]. Available: http://www.who.int/mediacentre/factsheets/fs297/en/
  2. 2. Saudi Health Council SCR. Cancer Incidence Report Saudi Arabia 2013 [Internet]. 2016. Available: http://www.chs.gov.sa/Ar/HealthCenters/NCC/CancerRegistry/CancerRegistryReports/2013.pdf
  3. 3. Holland JC, Anderson B, Breibart WS, Buchmann LO, Compas B, Deshields TL, et al. Distress management: Clinical practice guidelines in oncology. J Natl Compr Cancer Netw NCCN. Harborside Press, LLC; 2013;11: 190–209.
  4. 4. Bultz B. Patient Care and Outcomes: Why Cancer Care Should Screen for Distress, the 6th Vital Sign. Asia-Pacific J Oncol Nurs. 2016;3: 21. pmid:27981130
  5. 5. Pirl WF, Fann JR, Greer JA, Braun I, Deshields T, Fulcher C, et al. Recommendations for the implementation of distress screening programs in cancer centers: Report from the American Psychosocial Oncology Society (APOS), Association of Oncology Social Work (AOSW), and Oncology Nursing Society (ONS) joint task force [Internet]. Cancer. 2014. pp. 2946–2954. pmid:24798107
  6. 6. Bultz BD, Carlson LE. Emotional Distress: The Sixth Vital Sign in Cancer Care. J Clin Oncol. 2005;23: 6440–6441. pmid:16155033
  7. 7. Carlson LE, Waller A, Mitchell AJ. Screening for distress and unmet needs in patients with cancer: Review and recommendations [Internet]. Journal of Clinical Oncology. 2012. pp. 1160–1177. pmid:22412146
  8. 8. Keller M, Sommerfeldt S, Fischer C, Knight L, Riesbeck M, Löwe B, et al. Recognition of distress and psychiatric morbidity in cancer patients: a multi-method approach. Ann Oncol. 2004;15: 1243–1249. pmid:15277265
  9. 9. Mitchell AJ, Kaar S, Coggan C, Herdman J. Acceptability of common screening methods used to detect distress and related mood disorders?preferences of cancer specialists and non-specialists. Psychooncology. 2008;17: 226–236. pmid:17575565
  10. 10. Söllner W, DeVries A, Steixner E, Lukas P, Sprinzl G, Rumpold G, et al. How successful are oncologists in identifying patient distress, perceived social support, and need for psychosocial counselling? Br J Cancer. Nature Publishing Group; 2001;84: 179–85. pmid:11161373
  11. 11. Ellis J, Lin J, Walsh A, Lo C, Shepherd FA, Moore M, et al. Predictors of referral for specialized psychosocial oncology care in patients with metastatic cancer: The contributions of age, distress, and marital status. J Clin Oncol. 2009;27: 699–705. pmid:19114706
  12. 12. Roth AJ, Kornblith AB, Batel-Copel L, Peabody E, Scher HI, Holland JC. Rapid screening for psychologic distress in men with prostate carcinoma: a pilot study. Cancer. 1998;82: 1904–8. Available: http://www.ncbi.nlm.nih.gov/pubmed/9587123 pmid:9587123
  13. 13. Ransom S, Jacobsen PB, Booth-Jones M. Validation of the Distress Thermometer with bone marrow transplant patients. Psychooncology. 2006;15: 604–612. pmid:16208733
  14. 14. Graves KD, Arnold SM, Love CL, Kirsh KL, Moore PG, Passik SD. Distress screening in a multidisciplinary lung cancer clinic: Prevalence and predictors of clinically significant distress. Lung Cancer. 2007;55: 215–224. pmid:17084483
  15. 15. Hegel MT, Moore CP, Collins ED, Kearing S, Gillock KL, Riggs RL, et al. Distress, psychiatric syndromes, and impairment of function in women with newly diagnosed breast cancer. Cancer. 2006;107: 2924–2931. pmid:17103381
  16. 16. Hoffman BM, Zevon MA, D’Arrigo MC, Cecchini TB. Screening for distress in cancer patients: The NCCN rapid-screening measure. Psychooncology. 2004;13: 792–799. pmid:15386639
  17. 17. Iskandarsyah A, de Klerk C, Suardi DR, Soemitro MP, Sadarjoen SS, Passchier J. The Distress Thermometer and Its Validity: A First Psychometric Study in Indonesian Women with Breast Cancer. Lam WWT, editor. PLoS One. 2013;8: e56353. pmid:23418561
  18. 18. van Dooren S, Duivenvoorden HJ, Passchier J, Bannink M, Tan MBM, Oldenmenger WH, et al. The Distress Thermometer assessed in women at risk of developing hereditary breast cancer. Psychooncology. 2009;18: 1080–1087. pmid:19189274
  19. 19. Akizuki N, Akechi T, Nakanishi T, Yoshikawa E, Okamura M, Nakano T, et al. Development of a brief screening interview for adjustment disorders and major depression in patients with cancer. Cancer. 2003;97: 2605–2613. pmid:12733160
  20. 20. Shim E-J, Shin Y-W, Jeon HJ, Hahm B-J. Distress and its correlates in Korean cancer patients: pilot use of the distress thermometer and the problem list. Psychooncology. 2008;17: 548–555. pmid:17957764
  21. 21. Özalp E, Cankurtaran ES, Soygür H, Özdemir Geyik P, Jacobsen PB. Screening for psychological distress in Turkish cancer patients. Psychooncology. 2007;16: 304–311. pmid:16909427
  22. 22. Gil F, Grassi L, Travado L, Tomamichel M, Gonzalez JRR, Southern European Psycho-Oncology Study Group. Use of distress and depression thermometers to measure psychosocial morbidity among southern European cancer patients. Support Care Cancer. 2005;13: 600–606. pmid:15761700
  23. 23. Peters M, Passchier J. Translating Instruments for Cross-Cultural Studies in Headache Research. Headache J Head Face Pain. Blackwell Science Inc; 2006;46: 82–91. pmid:16412155
  24. 24. Patrick-Miller LJ, Broccoli TL, Much JK, Levine E. Validation of the Distress Thermometer: A single item screen to detect clinically significant psychological distress in ambulatory oncology patients. J Clin Oncol. American Society of Clinical Oncology; 2004;22: 6024–6024.
  25. 25. Malasi TH, Mirza IA, el-Islam MF. Validation of the Hospital Anxiety and Depression Scale in Arab patients. Acta Psychiatr Scand. 1991/10/01. 1991;84: 323–326. Available: http://www.ncbi.nlm.nih.gov/pubmed/1746281 pmid:1746281
  26. 26. Jacobsen PB, Donovan KA, Trask PC, Fleishman SB, Zabora J, Baker F, et al. Screening for psychologic distress in ambulatory cancer patients. Cancer. 2005;103: 1494–1502. pmid:15726544
  27. 27. Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983;67: 361–70. Available: http://www.ncbi.nlm.nih.gov/pubmed/6880820 pmid:6880820
  28. 28. Tuinman MA, Gazendam-Donofrio SM, Hoekstra-Weebers JE. Screening and referral for psychosocial distress in oncologic practice. Cancer. 2008;113: 870–878. pmid:18618581
  29. 29. Ibbotson T, Maguire P, Selby P, Priestman T, Wallace L. Screening for anxiety and depression in cancer patients: the effects of disease and treatment. Eur J Cancer. 1994;30A: 37–40. Available: http://www.ncbi.nlm.nih.gov/pubmed/8142161 pmid:8142161
  30. 30. Herrmann C. International experiences with the Hospital Anxiety and Depression Scale—a review of validation data and clinical results. J Psychosom Res. 1997;42: 17–41. Available: http://www.ncbi.nlm.nih.gov/pubmed/9055211 pmid:9055211
  31. 31. Hosmer D, Lemeshow S, Sturdivant RX. Applied Logistic Regression. New York, NY: A Wiley-Interscience Publication. John Wiley & Sons Inc; 2000.
  32. 32. Khatib J., R.Salhi G. A, Khatib J, Salhi R, Awad G. Distress in cancer in-patients in King Hussein Cancer Center (KHCC): A study using the Arabic-modified version of the Distress Thermometer. Psycho-Oncology. JOHN WILEY & SONS LTD THE ATRIUM, SOUTHERN GATE, CHICHESTER PO19 8SQ, W SUSSEX, ENGLAND; 2004. pp. S42–S42.
  33. 33. Howell D, Oliver TK, Keller-Olaman S, Davidson JR, Garland S, Samuels C, et al. Sleep disturbance in adults with cancer: a systematic review of evidence for best practices in assessment and management for clinical practice. Ann Oncol. Oxford University Press; 2014;25: 791–800. pmid:24287882
  34. 34. Ancoli-Israel S. Sleep Disturbances in Cancer: A Review. Sleep Med Res. 2015;6: 45–49.
  35. 35. Budden LM, Hayes BA, Buettner PG. Women’s decision satisfaction and psychological distress following early breast cancer treatment: A treatment decision support role for nurses. Int J Nurs Pract. 2014;20: 8–16. pmid:24580970
  36. 36. Bernacki RE, Block SD. Communication About Serious Illness Care Goals. JAMA Intern Med. American Medical Association; 2014;174: 1994. pmid:25330167
  37. 37. Janelsins MC, Kesler SR, Ahles TA, Morrow GR. Prevalence, mechanisms, and management of cancer-related cognitive impairment. Int Rev Psychiatry. Taylor & Francis; 2014;26: 102–113. pmid:24716504
  38. 38. Mitchell AJ. Pooled Results From 38 Analyses of the Accuracy of Distress Thermometer and Other Ultra-Short Methods of Detecting Cancer-Related Mood Disorders. J Clin Oncol. 2007;25: 4670–4681. pmid:17846453
  39. 39. Shaheen Al Ahwal M, Al Zaben F, Sehlo MG, Khalifa DA, Koenig HG. Religious beliefs, practices, and health in colorectal cancer patients in Saudi Arabia. Psychooncology. 2016;25: 292–299. pmid:25990540
  40. 40. Olson Scott L, Law M. J, Brodeur P. D, Salerno A. C, Thomas A, McMillan C. S, et al. Relationship With God, Loneliness, Anger, and Symptom Distress in Patients With Cancer Who Are Near the End of Life. J Hosp Palliat Nurs. NIH Public Access; 2014;16: 482–488. pmid:25530722