Figures
Abstract
Objective
The 15D is a self-administered questionnaire for assessment of health-related quality of life, which contains 15 questions with 5 response options each. This study was conducted to evaluate the reliability and validity of the Japanese 15D.
Methods
The subjects were 430 community-dwelling elderly people. Each item of the 15D was scored on a 5-point Likert scale, with level 1 being the best, score 1. Reliability was assessed by determination of the internal consistency and test-retest reliability. Criterion-based validity was assessed using the Japanese version of the Nottingham Health Profile (NHP) and Tokyo Metropolitan Institute of Gerontology Index of Competence (TMIG index). Acceptability was assessed by inquiring about the time required to complete the questionnaire and the burden felt in responding to it.
Results
The answers of 423 individuals who responded to all items were analyzed. The median time required to complete the questionnaire was 5.0 minutes, and the proportion of subjects who indicated that the questionnaire was easy to complete was 98.3%. The Cronbach’s alpha coefficients for all 15 items in the 2 surveys were 0.793 and 0.792, respectively. The intraclass correlation coefficients for the 15 items ranged from 0.44 to 0.72. In the relationship between the 15D and the NHP, the correlation coefficients between the corresponding domains were higher than those between non-corresponding domains. The prevalence of disability in higher-level functional capacity was higher in the “level 2 to 5” group than in the “level 1” group.
Conclusions
The Japanese version of the 15D showed sufficient internal consistency and moderate repeatability. Because of the short time required to complete the Japanese 15D and the significant relationships between the scores on the 15D and the NHP, and between the 15D and higher-level functional capacity, the acceptability and validity of the Japanese 15D were considered to be sufficient.
Citation: Okamoto N, Hisashige A, Tanaka Y, Kurumatani N (2013) Development of the Japanese 15D Instrument of Health-Related Quality of Life: Verification of Reliability and Validity among Elderly People. PLoS ONE 8(4): e61721. https://doi.org/10.1371/journal.pone.0061721
Editor: Heiner K. Berthold, Charité University Medicine Berlin, Germany
Received: September 5, 2012; Accepted: March 17, 2013; Published: April 16, 2013
Copyright: © 2013 Okamoto et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported by a Grant-in-Aid for Young Scientists (No. 22790566∶2010–2011) from the Japanese Ministry of Education, Culture, Sports, Science and Technology. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
In the last 3 decades, a number of questionnaires have been designed for quantitative assessment of the physical, mental and social aspects of health. Among the comprehensive health-related quality of life (HRQoL) questionnaires, the Medical Outcome Study 36-item short-form (SF-36) [1] and Nottingham Health Profile (NHP) [2]are representative profile index score measures, and EuroQol (EQ-5D) [3]is a representative single index score measure. The Japanese versions of these questionnaires, the originals of which are in English, have already been developed [4]–[6].
The original version of the 15D instrument used for assessment of the HRQoL, developed by Sintonen et al in Finland, is also in English [7]. It is a comprehensive, 15-dimensional, self-administered measure that can be used as both a profile and single index score measure for the adult population (aged over 15 years) [8]. The key dimensions include mobility, vision, hearing, breathing, sleeping, eating, speech, elimination, usual activities, mental function, discomfort and symptoms, depression, distress, vitality, and sexual activity. The response to each dimension is divided into 5 hierarchically structured levels. The best possible condition of an individual’s health is represented by level 1, the worst by level 5, and the rest describe intermediate health conditions between these 2 levels. The questionnaire is brief, and takes an average of 5 to 10 minutes to complete. The 15D has been utilized for surveys of general and patient populations [9]–[11] as a scale to compare different health conditions [12], [13], and also to measure the physical and mental effects of health-related interventions [14], [15].
The 15D may also be applicable in Japan as a rating scale for health status and as a predictor of health outcomes. We produced the Japanese version of the 15D after obtaining translation permission. The objective of this study was to evaluate the reliability and validity of the Japanese 15D. This process is needed before the development of a set of Japanese 15D preference weights, by which the responses to the dimensions are converted into a single-index score on a 0 to 1 scale (1 corresponds to full HRQoL, whereas 0 corresponds to death). More individuals with lower physical well-being or emotional well-being are included among elderly people or patients than among younger ages and healthy people. The subjects were drawn from the community-dwelling elderly.
Methods
Translation of the 15D into Japanese
The Japanese 15D Development Committee consisted of 3 Japanese men and 1 Japanese woman, who specialized in public health, epidemiology, and health economics. Two Japanese forward translations were independently undertaken by the experienced translators (H.A. and N.K.) among the committee members. At the committee meeting, the 2 translations were compared phrase-by phrase with the original English version, and a consensus on the best translation was arrived at. Back translations performed by 2 bilingual persons with English as their native language were confirmed a high level of agreement with the original version. The second consensus version was developed by slightly modifying the first consensus version.
We selected 8 respondents who were native speakers of Japanese (aged 44 to 75 years old, consisting of 4 males and 4 females, not involved in the health profession) for the respondent testing. The questionnaire was self-administered in the presence of a member of the committee (N.O.) and another collaborator. The respondents’ comments and queries about the second consensus version of the Japanese 15D were recorded. All 4 members of the committee then met to develop the third consensus version, taking into consideration the comments and queries of the respondents. We submitted reports of the forward and back translations and the respondent testing to the original author, Sintonen in Finland. The original author checked and approved the third consensus version. The reconciled version was then forwarded to a survey for determining its reliability and validity.
Subjects
The subjects were 430 volunteer men and women aged 65 to 89 years old who belonged to the Senior Citizens Club Association in a local city of Nara prefecture, Japan. The participants were part of the cohort of the Fujiwara-kyo study, a larger prospective cohort study. Details of the Fujiwara-kyo study have been described elsewhere [16], [17].
This study was conducted with the approval of the Medical Ethics Committee of Nara Medical University. Written informed consent was obtained from each of the subjects prior to their participation in the study.
Study Design
The Japanese version of the 15D was sent by mail to the subjects twice at a 4-week interval, and returned by mail (Survey 1 and Survey 2). To assess the acceptability of the Japanese 15D, the subjects were asked about the time that it took for them to complete the questionnaire and the burden with which they could answer the questions (extremely easy, very easy, relatively easy, relatively difficult, very difficult, or extremely difficult). Reliability was assessed by the internal consistency and test-retest methods. Criterion-based validity was assessed by examining the relationship of the 15D scores with the scores on the NHP and with the scores on the Tokyo Metropolitan Institute of Gerontology Index of Competence (TMIG index) [18]. The NHP and TMIG indexes and the self-reported disease history were included in the Survey 1 questionnaire.
The NHP contains 38 items grouped into 6 dimensions, namely, energy (3 items), pain (8 items), emotional reactions (9 items), sleep (5 items), social isolation (5 items), and physical mobility (8 items). All of the questions have a yes/no answer format (yes = 1, no = 0). To obtain the final score in each dimension, the sum in each dimension was multiplied by 100 and divided by the number of items in the dimension [19]. Possible scores ranged from 0 (denoting absence of distress) to 100 (denoting maximal distress).
The TMIG index is a scale developed in Japan consisting of 3 dimensions, namely, instrumental self-maintenance (5 items: using public transportation, shopping, preparing meals, paying bills, managing deposits), intellectual activity (4 items: filling out forms of pension, reading newspaper, reading books or magazines, being interested in stories or programs dealing with health), and social role (4 items: visiting the homes of friends, being called on for advise, visiting sick friends, initiating conversations with young people). The subjects were requested to choose the response option of “yes/can” (one point) or “no/cannot” (zero point) for each question. Lower scores indicated reduced higher-level functional capacity and a high mortality [20]. Disability was defined as a failure to achieve full scores in the respective dimensions [21].
Statistical Analysis
Each item of the 15D was scored on a 5-point Likert scale (possible score range: 1 to 5, level 1 = score 1). Internal consistency was assessed by calculation of the Cronbach’s alpha coefficients, both overall and with the item deleted from the scale. Repeatability was assessed by the Bland-Altman method [22] and the 1-way random-effect model for single measures intraclass correlation coefficients (ICCs) [23].
Spearmen’s rank correlation coefficients between the 15D and NHP scores were calculated. Next, the subjects were divided into 2 groups, namely, “level 1” and “level 2 to 5” groups, for each answer of the 15D items. The difference in the prevalence of disability in higher-level functional capacity between the 2 groups was tested using the chi-square test.
Statistical analysis was performed using SPSS (version 17.0; SPSS Japan Inc., Tokyo, Japan). We calculated two-tailed P values in all of the analyses. The α level of significance was set at 0.05.
Results
Demographics of the Subjects
Of the 430 persons who agreed to cooperate in both surveys conducted 4-weeks apart, the answers of 423 (210 males and 213 females) who responded to all items were analyzed (98.4%). Table 1 shows the demographic characteristics of the subjects. The median age (25th percentile, 75th percentile) was 74.0 (71.0, 78.0) years. The proportions of subjects with a history of cancer, cerebrovascular disease, myocardial infarction, diabetes and hypertension were 11.6%, 5.0%, 1.9%, 9.5% and 37.8%, respectively.
Assessment for Acceptability
The median value (25th percentile, 75th percentile) of the time required to complete the 15D was 5.0 (3.0, 7.0) minutes. As to the subjective burden felt in answering the 15D, the highest proportion (49.6%) of subjects selected “extremely easy”, followed by “very easy” (32.9%), “relatively easy” (15.8%), and “relatively difficult” (1.7%). Both “very difficult” and “extremely difficult” were selected by 0.0% of the subjects.
Descriptive Statistics and Internal Consistency
Table 2 summarizes results of the 15D-dimension descriptive statistics and internal consistency. Both in Survey 1 and Survey 2, the proportion of subjects who selected level 1 or level 2 exceeded 90%, excluding the sexual activity dimension. In addition, more than 80% of the subjects selected level 1 in hearing, eating, speech, elimination, and usual activities, showing a ceiling effect. The Cronbach’s alpha coefficients for all 15 items were 0.793 and 0.792 in Survey 1 and Survey 2, respectively. The alpha coefficients were reduced when 1 dimension was deleted from the scale. Only the exclusion of the eating and sexual activity dimensions resulted in an improved Cronbach’s alpha, implying that their presence decreased overall reliability.
Repeatability
Table 3 shows item-scale repeatability analyses. The lower limit of agreement and the upper limit of agreement were approximately −1 and +1, respectively, in the 14 items excluding the sexual activity dimension. Those in sexual activity dimension were approximately −2 and +2, respectively. The range of ICCs for the 15 items was between 0.44 and 0.72, and moderate repeatability was observed in all dimensions.
Criterion-based Validity
Table 4 shows the correlation between the 15D and NHP scores. Significant correlations were observed between mobility in the 15D and physical mobility in the NHP (Spearman’s rank correlation coefficient: 0.62), between sleeping and sleep (0.58), between usual activities and energy (0.40), between mental function and social isolation (0.42), between discomfort-and-symptoms and pain (0.47), between depression and emotional reactions (0.49), between distress and emotional reactions (0.49), and between vitality and energy (0.50). The correlation coefficients between these corresponding domains were higher than those between non-corresponding domains.
In Table 5, higher-level functional capacity is compared between the “level 1” and “level 2 to 5” groups in the 15D. Level 1 and level 2 were separated, because the responses were distributed mainly in level 1 and 2. The prevalence of disability in instrumental self-maintenance was significantly higher in the “level 2 to 5” group than in the “level 1” group for 8 dimensions of the 15D, the prevalence of disability in intellectual activity for 6 dimensions, and the prevalence of disability in social role for 9 dimensions.
Discussion
The results of the present study show that the development of the Japanese 15D has been successful. We found the Japanese version of 15D easy to administer and acceptable for community-dwelling elderly people.
The Turkish and Greek versions of 15D have been developed [24], [25] in hospital-based surveys of patients with type 2 diabetes and coronary artery disease, respectively. The Cronbach’s alpha coefficients for all items were 0.99 and 0.84 in the Turkish and Greek versions, respectively. The alpha values for all items were 0.793 and 0.792 in the 2 surveys of this study (Table 2). These values were lower than those reported from previous studies. However, sufficient internal consistency was confirmed because the 0.70 criterion was exceeded. Eating and sexual activity dimensions decreased the overall internal consistency. The decreases were small, and there was no problem in including the 2 items in the Japanese version of 15D.
In a report of the Greek version of the 15D [25], the proportion of subjects who selected level 3 to level 5 (poor health conditions) was approximately 10 to 60% for each of the 15 items. The full range of possible responses was used. On the other hand, in the present study, almost no subject selected level 3 to level 5. The proportion of subjects who selected level 1 or level 2 exceeded 90% for 14 items, excluding the sexual activity dimension; thus, the responses were unevenly distributed (Table 2). Individual differences were small. We speculate that this is because the subjects in this study were volunteers and community-dwelling independent people in relatively good health. The errors of repeated measurements showed by the limit of agreement (Table 3) would be relatively large compared to individual differences. This would result in the lower ICC values. The repeatability was not considered to be poor, although the ICC values were not more than 0.72 (Table 3).
The 15D shows greater discriminatory power in terms of the “ceiling” and “floor” effects than the EQ-5D and NHP [26]–[28]. In the results of this study, a ceiling effect was observed in 5 items, namely, hearing, eating, speech, elimination, and usual activities dimensions (Table 2). A ceiling effect has been also observed for the items of SF-36, namely, “walking one hundred meters” and “bathing or dressing” [29]. It is considered that items related to the basic activities of daily living tend to show a ceiling effect in community-based surveys.
In the relationship between the Japanese 15D and the NHP, the correlation coefficients between the corresponding domains were higher than those between non-corresponding domains (Table 4). The prevalence of disability in higher-level functional capacity was higher in the “level 2 to 5” group than in the “level 1” group (Table 5). The criterion-based validity was confirmed between the 15D and the NHP, and between the 15D and the TMIG-index.
Three limitations of the present study merit consideration. First, longitudinal construct validity and responsiveness were not addressed. It is necessary to investigate whether the instrument can detect changes in the health status over time. Second, the subjects in the present study were limited to the community-dwelling elderly aged 65 years or older. This limits the conclusions that can be drawn about the validity of the measure for use in other groups. Third, distribution of item selection was skewed. It is necessary to verify the validity in subjects over a wider age range, including middle-aged and young people, but, if so, distribution of item selection will be more skewed toward healthy responses. It may be proper that we conducted the survey on elderly people.
Conclusions
Within the limitations of the study design mentioned above, the results of this study indicate that the Japanese 15D has sufficient internal consistency and moderate repeatability. Because of the short time required to complete the Japanese 15D, the significant correlation between the corresponding domains of the 15D and the NHP, and the significant relationship between the 15D and higher-level functional capacity, the levels of acceptability and validity of the Japanese 15D for the community-dwelling elderly are considered sufficient. Further studies for the development of the scoring algorithm and a single-index score for the Japanese version of the 15D instrument are needed.
Supporting Information
Appendix S1.
The Japanese version of the 15D.
https://doi.org/10.1371/journal.pone.0061721.s001
(PDF)
Acknowledgments
The authors express their sincere gratitude to all participants for their cooperation in this study. In carrying out the respondent testing, we received substantial help from Professor Tomoko Morimoto in Gifu University of Medical Science. We sincerely appreciate her kind help.
Requests for the Japanese version of the 15D should be addressed to the members of the Japanese 15D Development Committee (Nozomi Okamoto, Akinori Hisashige, Yuu Tanaka, and Norio Kurumatani).
Author Contributions
Acquisition of subjects: NO NK. Manuscript preparation: NO AH YT NK. Conceived and designed the experiments: NO. Performed the experiments: NO. Analyzed the data: NO. Wrote the paper: NO AH YT NK.
References
- 1. Ware JE, Sherbourne CD (1992) The MOS 36-item Short-Form Health Survey (SF-36): conceptual framework and item selection. Med Care 30: 473–483.
- 2.
Wiklund I (1990) The Nottingham Health Profile: a measure of health-related quality of life. Scand J Prim Health Care Suppl 1: 15–18.
- 3. The EuroQol Group (1990) EuroQol: a new facility for the measurement of health-related quality of life. Health Policy 16: 199–208.
- 4. Fukuhara S, Ware JE, Kosinski M, Wada S, Gandek B (1998) Psychometric and clinical tests of validity of the Japanese SF-36 health survey. J Clin Epidemiol 51: 1045–1053.
- 5. Nishimura K, Hajiro T, Mckenna SP, Tsukino M, Oga T, et al. (2004) Development and psychometric analysis of the Japanese version of the Nottingham Health Profile: cross-cultural adaptation. Intern Med 43: 35–41.
- 6. Japanese EuroQol Translation Team (1998) The development of the Japanese EuroQol Instrument. Iryo-To-Shakai 8: 109–117.
- 7.
Sintonen H (1995) The 15-D measure of health related quality of life: II Feasibility, reliability and validity of its valuation system. Working paper 42. Melbourne, National Centre for Health Program Evaluation.
- 8.
Sintonen H, Pekurinen M (1993) A fifteen-dimensional measure of health-related quality of life (15D) and its applications. In: Walker SR, Rosser RM, editors. Quality of life assessment: key issues in the 1990s. Dordrecht, the Netherlands: Kluwer. 185–195.
- 9. Salo J, Niemelä A, Joukamaa M, Koivukangas J (2002) Effect of brain tumor laterality on patients’ perceived quality of life. J Neurol Neurosurg Psychiatry 72: 373–377.
- 10. Haapaniemi TH, Sotaniemi KA, Sintonen H (2004) Taimela E for the EcoPD Study Group (2004) The generic 15D instrument is valid and feasible for measuring health related quality of life in Parkinson’s disease. J Nerurol Neurosurg Psychiatry 75: 976–983.
- 11. Saarni S, Joutsenniemi K, Koskinen S, Suvisaari J, Sintonen H, et al. (2008) Alcohol consumption, abstaining, health utility and quality of life: a general population survey in Finland. Alcohol Alcohol 43: 376–386.
- 12. Kannisto M, Merikanto J, Alaranta H, Hokkanen H, Sintonen H (1998) Comparison of health-related quality of life in three subgroups of spinal cord injury patients. Spinal Cord 36: 193–199.
- 13. Hahl J, Hämäläinen H, Sintonen H, Simell T, Arinen S, et al. (2002) Health-related quality of life in type 1 diabetes without or with symptoms of long-term complications. Qual Life Res 11: 427–436.
- 14. Rissanen P, Aro S, Slätis P, Sintonen H, Paavolainen P (1995) Health and quality of life before and after hip or knee arthroplasty. J Arthroplasty 10: 169–175.
- 15. Stach-L B, Sintnen H, Kujansuu E (2004) The relationship between clinical parameters and health-related quality of life as measured by the 15D in incontinent women before and after treatment. Acta obstet Gynecol Scand 83: 983–988.
- 16. Okamoto N, Morikawa M, Okamoto K, Habu N, Hazaki K, et al. (2010) Tooth loss is associated with mild memory impairment in the elderly: the Fujiwara-kyo study. Brain Res 1349: 68–75.
- 17. Okamoto N, Tomioka K, Saeki K, Iwamoto J, Morikawa M, et al. (2012) Relationship between swallowing problems and tooth loss in community-dwelling independent elderly adults: the Fujiwara-kyo study. J Am Geriatr Soc 60: 849–853.
- 18. Ishizaki T, Watanabe S, Suzuki T, Shibata H, Haga H (2000) Predictors for functional decline among nondisabled older Japanese living in a community during a 3-year follow-up. J Am Geriatr Soc 48: 1424–1429.
- 19. Alonso J, Anto JM, Moreno C (1990) Spanish version of the Nottingham Health profile: translation and preliminary validity. Am J Public Health 80: 704–708.
- 20. Koyano W, Shibata H, Nakazato K, Haga H, Suyama Y (1991) Measurement of competence: reliability and validity of the TMIG Index of Competence. Arch Gerontol Geriatr 13: 103–116.
- 21. Fujiwara Y, Shinkai S, Kumagai S, Amano H, Yoshida Y, et al. (2003) Longitudinal changes in higher-level functional capacity of an older population living in a Japanese urban community. Arch Gerontol Geriatr 36: 141–153.
- 22. Bland JM, Altman DG (1986) Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1(8476): 307–310.
- 23. Shrout PE, Fleiss JL (1979) Intraclass correlation: uses in assessing rater reliability. Psychol Bull 86: 420–428.
- 24. Akinci F, Yildirim A, Ogutman B, Ates M, Gozu H, et al. (2005) Translation, cultural adaptation, initial reliability, and validation of Turkish 15D’s version. Eval Health Prof 28: 53–66.
- 25. Aletras VH, Kontodimopoulos N, Niakas DA, Vagia MG, Pelteki HJ, et al. (2009) Valuation and preliminary validation of the Greek 15D in a sample of patients with coronary artery disease. Value Health 12: 574–579.
- 26. Sintonen H (2001) The 15D instrument of health-related quality of life: properties and applications. Ann Med 33: 328–336.
- 27. Sintonen H (2001) Comparing properties of the 15D and the EQ-5D in measuring health-related quality of life. Archives of Hellenic Medicine18: 156–160.
- 28.
Sintonen H (1994) The 15-D measure of health related quality of life: Reliability, validity and sensitivity of its health state descriptive system. Working paper 41. Melbourne, National Centre for Health Program Evaluation.
- 29. Fukuhara S, Bito S, Green J, Hsiao A, Kurokawa K (1998) Translation, adaptation, and validation of the SF-36 health survey for use in Japan. J Clin Epidemiol 51: 1037–1044.