Figures
Abstract
Background
The Center for Epidemiologic Studies Depression Scale (CES-D) is a commonly used instrument to measure depressive symptomatology. Despite this, the evidence for its psychometric properties remains poorly established in Chinese populations. The aim of this study was to validate the use of the CES-D in Chinese primary care patients by examining factor structure, construct validity, reliability, sensitivity and responsiveness.
Methods and Results
The psychometric properties were assessed amongst a sample of 3686 Chinese adult primary care patients in Hong Kong. Three competing factor structure models were examined using confirmatory factor analysis. The original CES-D four-structure model had adequate fit, however the data was better fit into a bi-factor model. For the internal construct validity, corrected item-total correlations were 0.4 for most items. The convergent validity was assessed by examining the correlations between the CES-D, the Patient Health Questionnaire 9 (PHQ-9) and the Short Form-12 Health Survey (version 2) Mental Component Summary (SF-12 v2 MCS). The CES-D had a strong correlation with the PHQ-9 (coefficient: 0.78) and SF-12 v2 MCS (coefficient: -0.75). Internal consistency was assessed by McDonald’s omega hierarchical (ωH). The ωH value for the general depression factor was 0.855. The ωH values for “somatic”, “depressed affect”, “positive affect” and “interpersonal problems” were 0.434, 0.038, 0.738 and 0.730, respectively. For the two-week test-retest reliability, the intraclass correlation coefficient was 0.91. The CES-D was sensitive in detecting differences between known groups, with the AUC >0.7. Internal responsiveness of the CES-D to detect positive and negative changes was satisfactory (with p value <0.01 and all effect size statistics >0.2). The CES-D was externally responsive, with the AUC>0.7.
Conclusions
The CES-D appears to be a valid, reliable, sensitive and responsive instrument for screening and monitoring depressive symptoms in adult Chinese primary care patients. In its original four-factor and bi-factor structure, the CES-D is supported for cross-cultural comparisons of depression in multi-center studies.
Citation: Chin WY, Choi EPH, Chan KTY, Wong CKH (2015) The Psychometric Properties of the Center for Epidemiologic Studies Depression Scale in Chinese Primary Care Patients: Factor Structure, Construct Validity, Reliability, Sensitivity and Responsiveness. PLoS ONE 10(8): e0135131. https://doi.org/10.1371/journal.pone.0135131
Editor: Joseph Chilcot, Kings College, UNITED KINGDOM
Received: April 8, 2015; Accepted: July 17, 2015; Published: August 7, 2015
Copyright: © 2015 Chin et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: The data cannot be made available in the manuscript, the supplemental files, or a public repository due to ethical restrictions. The data set contains patients’ personal information and clinical data. To request the data, please contact the corresponding author Dr. Weng Yee Chin (e-mail: chinwy@hku.hk).
Funding: This work was supported by the Food and Health Bureau; Hong Kong SAR Commissioned Research on Mental Health Policy and Service Ref SMH-27.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Depressive disorders are disabling impairing people’s functioning and health-related quality of life (HRQOL) [1]. At its worst, depressive symptoms can lead to suicide. Thus, the detection of depressive symptoms and provision of treatments are of paramount importance to diminish the negative impacts of depressive disorders on individuals and society as a whole.
The Center for Epidemiologic Studies Depression Scale (CES-D) is one of the more frequently used screening instruments for depressive symptoms. According to Shafer, the CES-D is a balanced and comprehensive instrument [2] and is the only instrument which assesses interpersonal aspects. The CES-D, which was developed by Radloff [3], has been widely used in different age groups including adolescents [4], adults [5], and the elderly [6]; and patient populations such as cancer patients [7] and patients with heart disease [8]. The CES-D has also been used in a variety of Chinese populations including Chinese in America [9], Chinese in Hong Kong [10], Chinese in Mainland China [11] and Chinese in Taiwan [12]. Despite its widespread use, the psychometric properties of the CES-D have only been tested in selective Chinese samples [13]. In the Hong Kong setting, previous studies examining the psychometric properties of the CES-D have used methods which limit its applicability and generalizability. One study incorporated a selected sample of married couples with sample size insufficient for the statistical methods applied [14]. A more recent study sampled school-aged Chinese adolescents [15] who may possess unique conceptualizations of depressive symptomatology due to the complexities of adolescence. In terms of translation, various locally developed versions of the CES-D exist, however those that have been published and used in adult samples have had weak conceptual equivalence to the original English version for modern Hong Kong Chinese [14, 16]. This has been further affected by the modification of response choices for the CES-D items when adapted for administration in Chinese. The original CES-D adopts a four-point scale, whilst many Chinese versions use a five-point scale and a different scoring rubric [14]. Discrepancies in translation and response option can threaten the validity and affect cross-cultural interpretability of findings [17, 18]. There is thus a need to validate a well-translated instrument, with good translational, conceptual and structural equivalence to the original CES-D in a wide sampling population.
The CES-D is widely used in longitudinal studies [19, 20]. Despite this, there is little published evidence for the instrument’s responsiveness (ability to detect change over time). An instrument that is not responsive can lead to false negative results [21, 22]. Establishing the responsiveness of the CES-D can strengthen the rationale for using it in longitudinal studies.
Methods
This study was conducted as part of an epidemiological study to examine the natural history of depressive disorders in Hong Kong's primary care. The study protocol is published [23].
Design
A 12-month longitudinal observational study was conducted on patients recruited through a primary care practice-based research network.
Sampling and participant
Fifty nine primary care doctors working in public and private sector clinics territory wide across Hong Kong were recruited using the mailing list of the Hong Kong College of Family Physicians. All eligible patients presenting to the study doctor on one randomly selected day each month between were invited to join the study. All patients consulting the study doctor (for any reason) were consecutively approached by field workers in the waiting room to join the study. Exclusion criteria were (1) aged < 18 years, (2) had cognitive or communication difficulties (3) had already been recruited to the study and (4) not having a face-to-face consultation with the doctor. Subjects were asked to self-complete a baseline questionnaire containing items on socio-demography, the PHQ-9, the CES-D and the Short Form-12 Health Survey version 2 (SF-12 v2). If subjects had difficulty completing the questionnaire due to visual impairment or poor literacy, the field worker helped to administer the questionnaire. All subjects completing the baseline survey were invited to participate in the longitudinal study. Those who consented by providing their name and contact number were followed by telephone interview at 2 weeks (for evaluating test-retest reliability, only administered to those who screened PHQ-9 positive) and 12 weeks (for evaluating responsiveness). Follow-up questionnaires contained of the CES-D, the PHQ-9 and the SF-12 v2. Data was collected between November 2012 and January 2014.
Ethics approval
This study was approved by the Institutional Review Board of the University of Hong Kong/Hospital Authority Hong Kong West Cluster, the Research Committee of Hong Kong Sanatorium and Hospital, the Research Ethics Committee for Hong Kong Hospital Authority Kowloon East and Kowloon Central Clusters, the Joint Chinese University of Hong Kong—New Territories East Cluster Clinical Research Ethics Committee, the Ethics Committee of the Matilda International Hospital, and the Research Committee of the Evangel Hospital.
Study instruments
The Centre for Epidemiologic Studies Depression Scale (CES-D).
The CES-D consists of twenty questions which measures depressive symptomatology during the past week. Respondents rate the frequency of occurrence of each symptom on a 4-point Likert scale (0: less than 1 day; 1: last for 1–2 days; 2: last for 3–4 days; and 3: last for 5–7 days). The scores for each item can be summed to give a total score ranging from 0 to 60 with higher scores indicating more severe depression. Based on the total score, patients can be categorized as having mild depression (score 16 to 26) or major depression (score 27 to 60). The Chinese version of the CES-D used in this study was adopted from the translation used in the Central and Western District Adolescent Health Survey in Hong Kong [15, 24]. In the earlier study the authors used 5-point response scale, which differed from Radloff’s original questionnaire [3]. For this current study, a 4-point response option was used in line with original CES-D. The final Chinese CES-D used for this current study had the translational and conceptual equivalence confirmed by a bilingual family medicine specialist and a bilingual registered nurse. The instrument version used is available in S1 Instrument.
The Patient Health Questionnaire 9 (PHQ-9).
The PHQ-9 consists of nine questions, based on the criteria for the diagnosis of major depressive disorder in the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV) [25]. Subjects were asked to indicate the frequency of occurrence for each symptom over the past two weeks on a 4-point Likert scale (0: not at all; 1: several days; 2: more than half the days; and 3: nearly every day) [25]. The scores of the nine questions are summed to give a total score ranging from 0 to 27, with higher scores indicating more severe depressive symptoms. Based on the total score, patients can be categorized as having minimal depression (score 1–4), mild depression (score 5–9), moderate depression (score 10–14), moderately severe depression (score 15–19) or severe depression (score 20–27). The PHQ-9 is responsive [26] and has been translated and validated in Hong Kong primary care patients [27] and in the Hong Kong general population [28]. In this study, the PHQ-9 was used to assess the convergent validity of the CES-D as they are both depression instruments, measuring a similar construct; and to capture the change in depression severity at the 2-week and 12-week follow-up interviews.
The SF-12 Health Survey Version 2.0 (SF-12 v2).
The SF-12 v2 is a generic HRQOL measure, which generates two summary scores, namely physical and mental component summary scores (PCS and MCS) with higher scores indicating better HRQOL [29]. The SF-12 v2 has been translated and validated for use in the Hong Kong’s primary care setting [30]. It has been proposed that the SF-12 v2 MCS can be used as a depression screening tool in the general population [31]. Therefore, in this study, the SF-12 v2 MCS was also used to assess the convergent validity of the CES-D.
Statistical analysis
Floor and ceiling effect.
Descriptive statistics (mean and standard deviation) and the percentages of floor and ceiling of the CES-D, the PHQ-9 and the SF-12 v2 MCS scores were calculated. 15% was used as the threshold for a significant floor or ceiling effect [32].
Factor structure.
A comparison of three different CES-D factor structure models was conducted: a four-factor model (as proposed by Radloff [3]), a second-order factor model [33], and a bi-factor model [33]. For a four-factor model, it is proposed that the CES-D has four factors, namely depressed affect, positive affect, somatic and retarded activity and interpersonal problems. For a second-order factor model, there is a single second-order general depression factor to explain the covariance among the four first-order factors. In a bi-factor model, the general depression factor has no correlation with the four specific factors. In other words, the general depression factor explains the covariance among all scale items of the CES-D, while the specific factors explains the variance of the items within the specific factors [33].
Confirmatory factor analysis (CFA) models for ordinal data were performed using a polychoric correlation matrix to confirm the proposed models and to compare the goodness of fit between different models. Standard maximum likelihood extraction on polychoric correlation matrix was used. The goodness-of-fit statistics of the model were assessed using standardized root mean square residual (SRMR), root mean square error of approximation (RMSEA), comparative fit index (CFI) and Tucker-Lewis index (TLI) as recommended by Hu and Bentler [34]. Model fit was considered as good if the value of the SRMR was close to or below 0.08 [34], the value of the RMSEA was close to or below 0.06 [34, 35], and the values of the CFI and the TLI were greater than 0.9 (>0.90 acceptable, >0.95 excellent) [34, 36]. For model comparison, a significant chi-square difference (∆χ2) and the change in CFI (ΔCFI) >0.01 indicated that two models were significantly different.
Construct validity.
Internal construct validity was assessed by examining the item-total correlation corrected for overlap using a correlation coefficient ≥0.4 as the cut-off for adequate correlation [37]. Convergent validity was assessed by computing Person’s correlations between the CES-D, the PHQ-9 and the SF-12 v2 MCS. It was hypothesized that the CES-D score would have a stronger correlation with the PHQ-9 score than with the SF-12 MCS score because both CES-D and PHQ-9 specifically measure depressive symptoms whilst the SF-12 MCS was designed to measure mental health-related quality of life.
Reliability.
The internal consistency of the CES-D was assessed by McDonald’s omega hierarchical (ωH). This method is recommended for a scale that has a hierarchical factor structure. Test-retest reliability was assessed by examining the intra-class correlation coefficient (ICC) in subjects who had no change in PHQ-9 score between the baseline and 2-week testing. An ICC ≥ 0.7 was used to indicate good test-retest reliability [32].
Sensitivity.
The sensitivity of the CES-D to discriminate between subjects with doctor-diagnosed depression and subjects without doctor-diagnosed depression was assessed by known-group comparison and by calculating the area under a receiver operating characteristic (ROC) curve [38]. Study doctors who were blinded to the PHQ-9 and CES-D screening scores were asked to document on a case record form whether they felt the patient had a clinically significant depressive symptoms based on their clinical judgment, without using any depression screening tools. Independent t-test was used to compare the mean CES-D scores between groups. Cohen’s d effect size was also calculated. It was hypothesized that subjects with doctor-detected depression would have a higher CES-D score than those without. The area under a ROC curve (AUC) can show the probability that an instrument correctly classifies patients according to an external criterion. For this study, the external criterion for assessing sensitivity was based on the doctor’s clinical judgment on whether the subject had clinically significant depressive symptoms or not. The value of AUC is typically between 0.5 and 1.0, with 1.0 representing perfect discriminatory power whilst 0.5 representing no discriminatory power. A sensitive instrument should have AUC value ≥ 0.7 [32]. The AUC of the CES-D and the PHQ-9 and their 95% confidence intervals were calculated. It was hypothesized both CES-D and PHQ-9 would be able to discriminate between patients with doctor-diagnosed depression and those without, with an AUC >0.7.
Responsiveness.
Two different approaches can be used to evaluate the responsiveness of an instrument. Internal responsiveness is the ability of an instrument to detect change over a pre-specified time frame. External responsiveness is the ability of an instrument to detect a clinically important change relating to the corresponding change in a reference measure of health status [21, 22, 39, 40].
To assess the internal responsiveness of the CES-D, subjects were divided into three groups according to their change in PHQ-9 scores between baseline and 12-weeks, namely (1) improved depressive symptoms (i.e. reduced PHQ-9 score), (2) stable depressive symptoms (i.e. same PHQ-9 score) or (3) worsened depressive symptoms (i.e. increased PHQ-9 score). For each group, changes in the mean scores of both the CES-D and the SF-12 MCS between baseline and 12-week interviews were examined by paired t-test. The differences in CES-D scores between baseline and 12-weeks were evaluated by the standardized effect size (SES) [41], the Cohen’s d effect size (ES) [42] and the standardized response mean (SRM) [43]. Since the most appropriate effect size for calculating responsiveness statistics remains controversial, three effect sizes were used [44]. The effect size statistics can provide a clear interpretation of the magnitude of the change of the PHQ-9 score in each group. The values of SES, ES and SRM were interpreted as trivial (<0.2), small (≥0.2 and <0.5), moderate (≥0.5 and <0.8) and large (≥0.8), according to Cohen [42] and Liang [43]. Internal responsiveness was supported if the difference was ≥0.2. It was hypothesized that 1) the CES-D score would be decreased with effect size ≥0.2 in the improved group; 2) there would be no statistically significant changes in the CES-D scores in the stable group; and 3) the CES-D score would be increased in the worsened group with effect size ≥0.2. It was also hypothesized that the CES-D would be more responsive than the SF-12 v2 MCS.
For assessing external responsiveness, subjects were divided into two groups according to the change of the PHQ-9 score between baseline and 12-weeks, namely improved depressive symptoms (i.e. decreased PHQ-9 score) and stable/worsened depressive symptoms (i.e. same/increased PHQ-9 score). External responsiveness was determined by comparing the change in CES-D mean scores between groups by independent t-test and by the ROC curve analysis [44]. The AUC of the CES-D and SF-12 MCS and the 95% confidence intervals were calculated. The ROC curve provides an overview of the relationship between a measure and an external criterion of change. Conceptually, AUC represents the probability of a random patient with improved depressive symptoms to have a larger improvement in score than a random patient with stable/worsened depressive symptom, with a value = 0.5 representing no discriminatory power, and a value = 1 representing perfect discriminatory power. A value ≥0.7 was used as the threshold of good discriminatory power [45]. It was hypothesized that the AUC of the CES-D would be >0.7; and the CES-D would be more externally responsive than the SF-12 v2 MCS.
Data analyses were conducted using LISREL (version 8.80 for Windows) for factor analysis and SPSS (version 20.0 for Windows) for other statistical tests.
Results
Baseline characteristics of the subjects are shown in Table 1. After excluding subjects with missing values in the PHQ-9, CES-D or the SF-12, a total of 3686 subjects were included for the evaluation of the psychometric properties of the CES-D. Subjects mean age was 49.4 years and 58.1% were female. All respondents were of Chinese ethnicity. The subject recruitment flow chart is shown in S1 Fig.
Floor and ceiling effect
The descriptive statistics of the CES-D, PHQ-9 and SF-12 v2 MCS scores at baseline interview are shown in Table 1. 12.9% and 18.8% of subjects achieved minimum CES-D and PHQ-9 scores, respectively whilst no subject achieved the maximum CES-D or PHQ-9 score.
Factor structure
Results of the CFA are shown in Table 2, Table 3 and S2 Fig. For all three models, the values of the SRMR were well below 0.08 whilst the values of the RMSEA were below 0.06. The values of CFI and TLI were greater than 0.90. Among the three models tested, although Radloff’s original proposed four-factor structure was acceptable, the bi-factor model had a better fit, with a smaller value of SRMR and RMSEA, and a larger value of CFI and TLI. In the bi-factor model, with the exception of the four “positive affect” items and two “interpersonal problem” items, all other items had a higher factor loading on “general factors” than on the corresponding specific factors.
Construct validity
The results of the analyses to evaluate internal construct validity are shown in Table 2. The item-total correlations corrected for overlap were >0.4 for all items, except for item 4 (0.25) and item 11 (0.33). The Pearson’s correlation coefficients are shown in Table 4. The CES-D total score had a strong correlation with the PHQ-9 total score (r = 0.78) and the SF-12 v2 MCS score (r = -0.75). The construct validity of the CES-D was supported.
Reliability
The results of the analyses to evaluate internal consistency and test-retest reliability are shown in Table 4. The ωH value for the general depression factor was 0.855. The ωH valus for “somatic”, “depressed affect”, “positive affect” and “interpersonal problems” were 0.434, 0.038, 0.738 and 0.730, respectively.
383 subjects were successfully contacted 2-weeks after the baseline interview. Test-retest reliability was assessed in 58 subjects (15.1%) who had no change in their PHQ-9 score over the 2-week period. The ICC of the CES-D was 0.91. The reliability of the CES-D was supported.
Sensitivity
The results of the analyses to examine sensitivity to differentiate between subjects with depression and those without depression are shown in Table 4. The prevalence of doctor diagnosed depression was 7.50%. Statistically significant differences were detected between the two groups by the CES-D (effect size 0.97), the PHQ-9 (effect size 0.94) and the SF-12 v2 MCS (effect size 0.88). Furthermore, the CES-D, PHQ-9 and SF-12 v2 MCS were sensitive enough to detect differences between subjects, with an AUC >0.7 for all instruments. Among these three instruments, the CES-D had the largest AUC (0.75) confirming the sensitivity of the CES-D. The ROC curve for the sensitivity analysis shows in S2 Fig.
Responsiveness
The results of the analyses to evaluate internal responsiveness are shown in Table 5. The groupings were based on the PHQ-9 scores. The CES-D total score reduced significantly (i.e. symptom improvement) in subjects with reduced depressive symptoms, with Cohen’s d effect size and SRM >0.8. The SF-12 v2 MCS also detected a statistically significant improvement in those subjects but the effect size statistics of the SF-12 v2 MCS were smaller than those of the CES-D. Moreover, both CES-D and SF-12 v2 MCS had statistically significant improvements in subjects whose PHQ-9 score had no change. Compared with patients with improved depressive symptoms, the effect size statistics of the CES-D and SF-12 v2 MCS were smaller in patients with stable depressive symptoms. The CES-D detected a statistically significant deterioration in subjects with worsened PHQ-9 score with all effect size statistics >0.2. On the contrary, the SF-12 v2 MCS could not detect any statistically significant differences in patients with worsened PHQ-9 scores.
The results of the analyses assessing the external responsiveness are shown in Table 5. The differences in the mean change between the improved and stable/ worsened groups were statistically significant for the CES-D and the SF-12 v2 MCS. With a cut-off AUC>0.7, the CES-D (AUC = 0.75) but not the PHQ-9 (AUC = 0.64) was adequate to differentiate subjects who improved and those with stable or worsened depressive symptoms. The ROC curve for external responsiveness is shown in S2 Fig.
Discussion
Our analyses confirmed that the CES-D is valid for use amongst Chinese adult primary care patients in Hong Kong. Although the best fitting factor model was the bi-factor model, Radolff’s four-factor model was also satisfactory. Our findings help to strengthen the rationale for using the CES-D to screen for depressive symptoms, to monitor disease progression, and that the instrument is valid for use in cross-cultural comparative studies.
Factor structure
Our comparison of three competing factor structure models found that although the original four factor model was adequate, the data set fit better into a bi-factor model. The general depression factor was more dominant than other specific factors, particularly for “somatic complaints” and “depressed affects”. It has been suggested that the “positive affect” items are not part of the general depression factor and that a total CES-D score should be summed without the positive affect items. The positive affect items should instead be added together to generate a subscale score [14]. Despite a satisfactory model fit, both the “positive affect” and “interpersonal problems” items may not be part of the “general depression” factor as the items of these two domains had higher factor loading on the corresponding factors. Based on this, we suggest that if a bi-factor model is to be used, that the item scores for “somatic complaints” and “depressed affect” can be added together to generate a summary score, whilst two individual summary scores for “positive affect” and “interpersonal problems” can be generated respectively
Construct validity
In the analysis of the item-total correlation, two question items (item 4: ‘Feeling as good as others’ and item 11: ‘Restless sleep’) did not reach the recommended cut-off point of 0.4, suggesting that the responses to these items may be less related to the other indicators of depressive symptoms. Furthermore, the mean scores of these items were much higher than the mean scores of most other CES-D items, which might lead to poorer correlations. Other studies have also reported low item-total correlations for these two items [46, 47]. In the Hong Kong context, item 4 could easily be interpreted as a comparison of general living standards, while item 11 could potentially be misinterpreted as sleep deprivation due to the engagement of bed-time social activities, work-related stress, ageing, etc.
The hypothesized correlations between the CES-D and other depression instruments were generally observed confirming its convergent validity. The CES-D total score correlated strongly with both the PHQ-9 total score and the SF-12 v2 MCS score, however it appears that the SF-12 v2 MCS had a stronger correlation than the PHQ-9. Our findings were similar to the results of a previous study which found that both CES-D (r = -0.76) and PHQ-9 (r = -0.68) had a strong correction with the SF-36 MCS, and when compared with the PHQ-9, the CES-D had a stronger correlation with the SF-36 MCS [48]. It is possible that the CES-D contains more items, which might lead to a higher correlation with the SF-12 v2 MCS.
Reliability
The internal consistency for “general depression”, “positive affect” and “interpersonal problems” were supported, suggesting the use of subscale scores for these domains may be possible. However, the values for “somatic” and “depressed affect” were relatively low. Our findings were similar to those found by Gomez and McLaren, which found the acceptable internal consistency of the general factor and the “positive affect” domain [33]. The test-retest reliability of the CES-D in our population was reassuring and performed better than in other populations [49, 50].
Sensitivity
The CES-D was sufficiently sensitive to differentiate patients with depressive symptoms from those without, and comparable to that of the PHQ-9 and the SF-12 v2 MCS.
Responsiveness
The CES-D was responsive to both positive changes and negative changes in depressive symptoms as measured by the PHQ-9. However, it should be interpreted with caution because a positive change (improvement) was also detected within the stable group. The CES-D might be too responsive picking up “noises” [51, 52] which may not be clinically meaningful. Our findings suggest that the CES-D is a better instrument for longitudinal monitoring of depressive symptoms than the SF-12 v2 MCS.
Clinical and research implications
Clinicians in primary care such as family doctors and nurse practitioners might not have specialized knowledge in diagnosing depression. Using the CES-D can help them to identify patients with depression in order to provide interventions or a prompt referral. Furthermore, the CES-D can be used for longitudinal monitoring and to evaluate the impact of treatment. In research, the CES-D can be used to estimate the prevalence, remission and relapse, to measure the severity of depressive symptoms, to screen for eligible patients for subject recruitment, and to evaluate effectiveness in intervention studies. Knowledge of the psychometric properties and evidence for the validity of the instrument in this setting assists in data interpretation and strengthens the rationale for its use in cross-cultural comparative studies.
Limitations
As in other practice-based research studies, limitations existed for practical reasons. The baseline data was collected either through self-completion or face-to-face interview. In the case of the latter, items were not necessarily administered verbatim in all subjects, and the pre-set order was not always strictly followed. Such adjustments albeit deviated from the instruction of the original questionnaire were deemed essential during data collection as most of the study practices had fairly high caseload (20–40 patients per half-day session) and hence a challenge to administer 20 items in a short period of time. Also many patients were elderly and of relatively low educational status and hence the questionnaire was on occasion administered in a less structured manner, to allow better comprehension and completion of the survey. This lack of standardized instrument administration can potentially result in variations of item scores, and affect the reliability results and the factor structure obtained.
In this study, depression identification was not based on a structured clinical interview or made by psychiatrists, but by our study doctors in the setting of a general medical primary care consultation. Most of the study doctors were trained Family Medicine physicians, and all were familiar with the diagnostic criteria for depression, however, variations in the identification rate for depression by doctors can potentially affect the sensitivity analysis.
As we only included local primary care patients as our study subjects, this may preclude the generalizability of the validation results to secondary care patients who may have a more severe spectrum of depressive symptoms.
Conclusions
This study found that the CES-D is a valid and reliable instrument to assess and monitor depressive symptoms in adult Chinese primary care patients. The original four-factor structure of the CED-S was applicable in our study population; however a bi-factor model appears to have a better fit. The CES-D was sensitive enough to screen for depression and was internally and externally responsive. It outperformed the SF-12 v2 MCS in capturing change overtime. We hope the instrument can be applied for Chinese in the worldwide diaspora.
Supporting Information
S1 Appendix. The bi-factor structure of the CES-D by confirmatory factor analysis.
https://doi.org/10.1371/journal.pone.0135131.s001
(PDF)
S2 Fig. The sensitivity of the CES-D and the PHQ-9 to differentiate subjects with depression and those without depression.
The CES-D and PHQ-9 were sensitive enough to detect difference between the subject, with an AUC >0.7 for all instruments.
https://doi.org/10.1371/journal.pone.0135131.s003
(PDF)
S3 Fig. The external responsiveness of the CES-D and the SF-12 v2 MCS.
With the standard of the AUC>0.7, the CES-D (AUC = 0.75) but not the PHQ-9 (AUC = 0.64) was adequate to differentiate subjects who improved and those with stable or worsened depressive symptoms.
https://doi.org/10.1371/journal.pone.0135131.s004
(PDF)
S1 Instrument. The Center for Epidemiologic Studies Depression Scale (CES-D)-Chinese Version with English Translation.
https://doi.org/10.1371/journal.pone.0135131.s005
(PDF)
Author Contributions
Conceived and designed the experiments: WYC EPHC KTYC. Performed the experiments: WYC EPHC KTYC. Analyzed the data: WYC EPHC KTYC CKHW. Contributed reagents/materials/analysis tools: WYC EPHC KTYC. Wrote the paper: WYC EPHC KTYC CKHW.
References
- 1. Gaynes BN, Burns BJ, Tweed DL, Erickson P. Depression and health-related quality of life. The Journal of nervous and mental disease. 2002;190(12):799–806. pmid:12486367
- 2. Shafer AB. Meta-analysis of the factor structures of four depression questionnaires: Beck, CES-D, Hamilton, and Zung. Journal of clinical psychology. 2006;62(1):123–46. pmid:16287149.
- 3. Radloff LS. The CES-D scale a self-report depression scale for research in the general population. Applied psychological measurement. 1977;1(3):385–401.
- 4. Radloff LS. The use of the Center for Epidemiologic Studies Depression Scale in adolescents and young adults. Journal of youth and adolescence. 1991;20(2):149–66. pmid:24265004.
- 5. Rowan PJ, Haas D, Campbell JA, Maclean DR, Davidson KW. Depressive symptoms have an independent, gradient risk for coronary heart disease incidence in a random, population-based sample. Annals of epidemiology. 2005;15(4):316–20. pmid:15780780.
- 6. Callahan CM, Hui SL, Nienaber NA, Musick BS. Longitudinal study of depression and health services use among elderly primary care patients. Journal of the American Geriatrics Society. 1994.
- 7. Katz MR, Kopek N, Waldron J, Devins GM, Tomlinson G. Screening for depression in head and neck cancer. Psycho-oncology. 2004;13(4):269–80. pmid:15054731.
- 8. Pirraglia PA, Peterson JC, Williams Russo P, Gorkin L, Charlson ME. Depressive symptomatology in coronary artery bypass graft surgery patients. International journal of geriatric psychiatry. 1999;14(8):668–80. pmid:10489658
- 9. Ying YW. Depressive symptomatology among Chinese-Americans as measured by the CES-D. Journal of clinical psychology. 1988;44(5):739–46. pmid:3192712.
- 10. Chou K-L, Lee PW, Yu EC, Macfarlane D, Cheng Y-H, Chan SS, et al. Effect of Tai Chi on depressive symptoms amongst Chinese older patients with depressive disorders: a randomized clinical trial. International journal of geriatric psychiatry. 2004;19(11):1105–7. pmid:15497192
- 11. Lai G. Work and family roles and psychological well-being in urban China. Journal of health and social behavior. 1995;36(1):11–37. pmid:7738326.
- 12. Lin HC, Tang TC, Yen JY, Ko CH, Huang CF, Liu SC, et al. Depression and its association with self‐esteem, family, peer and school factors in a population of 9586 adolescents in southern Taiwan. Psychiatry and Clinical neurosciences. 2008;62(4):412–20. pmid:18778438
- 13. Zhang J, Sun W, Kong Y, Wang C. Reliability and validity of the Center for Epidemiological Studies Depression Scale in 2 special adult samples from rural China. Comprehensive psychiatry. 2012;53(8):1243–51. pmid:22520090; PubMed Central PMCID: PMC3404200.
- 14. Cheung CK, Bagley C. Validating an American scale in Hong Kong: the center for epidemiological stuides depression scale (CES-D). The Journal of Psychology. 1998;132(2):169–86. pmid:9529665
- 15. Lee SW, Stewart SM, Byrne BM, Wong JP, Ho SY, Lee PW, et al. Factor structure of the Center for Epidemiological Studies Depression Scale in Hong Kong adolescents. Journal of personality assessment. 2008;90(2):175–84. pmid:18444112.
- 16. Chi I, Boey K. Hong Kong validation of measuring instruments of mental health status of the elderly. Clinical Gerontologist. 1993;13(4):35–51.
- 17. Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of Good Practice for the Translation and Cultural Adaptation Process for Patient-Reported Outcomes (PRO) Measures: report of the ISPOR Task Force for Translation and Cultural Adaptation. Value in health: the journal of the International Society for Pharmacoeconomics and Outcomes Research. 2005;8(2):94–104. pmid:15804318.
- 18. Choi EP, Lam CL, Chin WY. Validation of the International Prostate Symptom Score in Chinese males and females with lower urinary tract symptoms. Health and quality of life outcomes. 2014;12:1. pmid:24382363; PubMed Central PMCID: PMC3883473.
- 19. Gitlin LN, Belle SH, Burgio LD, Czaja SJ, Mahoney D, Gallagher-Thompson D, et al. Effect of multicomponent interventions on caregiver burden and depression: the REACH multisite initiative at 6-month follow-up. Psychol Aging. 2003;18(3):361–74. pmid:14518800; PubMed Central PMCID: PMC2583061.
- 20. Bakitas M, Lyons KD, Hegel MT, Balan S, Brokaw FC, Seville J, et al. Effects of a palliative care intervention on clinical outcomes in patients with advanced cancer: the Project ENABLE II randomized controlled trial. JAMA. 2009;302(7):741–9. pmid:19690306; PubMed Central PMCID: PMC3657724.
- 21. Revicki DA, Cella D, Hays RD, Sloan JA, Lenderking WR, Aaronson NK. Responsiveness and minimal important differences for patient reported outcomes. Health and quality of life outcomes. 2006;4:70. pmid:17005038; PubMed Central PMCID: PMC1586195.
- 22. Husted JA, Cook RJ, Farewell VT, Gladman DD. Methods for assessing responsiveness: a critical review and recommendations. Journal of clinical epidemiology. 2000;53(5):459–68. pmid:10812317.
- 23. Chin WY, Lam CL, Wong SY, Lo YY, Fong DY, Lam TP, et al. The epidemiology and natural history of depressive disorders in Hong Kong's primary care. BMC family practice. 2011;12(1):129.
- 24.
Wong J, Ho S, Lam T. Central and Western District Adolescent Health Survey 2002–03 full report. Department of Community Medicine, University of Hong Kong. 2004.
- 25. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. Journal of general internal medicine. 2001;16(9):606–13. pmid:11556941; PubMed Central PMCID: PMC1495268.
- 26. Lowe B, Schenkel I, Carney-Doebbeling C, Gobel C. Responsiveness of the PHQ-9 to Psychopharmacological Depression Treatment. Psychosomatics. 2006;47(1):62–7. pmid:16384809.
- 27. Cheng C, Cheng M. To validate the Chinese version of the 2Q and PHQ-9 questionnaires in Hong Kong Chinese patients. The Hong Kong Practitioner. 2007;29(10):381.
- 28. Yu X, Tam WW, Wong PT, Lam TH, Stewart SM. The Patient Health Questionnaire-9 for measuring depressive symptoms among the general population in Hong Kong. Comprehensive psychiatry. 2012;53(1):95–102. pmid:21193179.
- 29. Ware J Jr., Kosinski M, Keller SD. A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity. Medical care. 1996;34(3):220–33. pmid:8628042.
- 30. Lam ET, Lam CL, Fong DY, Huang WW. Is the SF-12 version 2 Health Survey a valid and equivalent substitute for the SF-36 version 2 Health Survey for the Chinese? Journal of evaluation in clinical practice. 2013;19(1):200–8. pmid:22128754.
- 31. Vilagut G, Forero CG, Pinto-Meza A, Haro JM, de Graaf R, Bruffaerts R, et al. The mental component of the short-form 12 health survey (SF-12) as a measure of depressive disorders in the general population: results with three alternative scoring methods. Value in health: the journal of the International Society for Pharmacoeconomics and Outcomes Research. 2013;16(4):564–73. pmid:23796290.
- 32. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. Journal of clinical epidemiology. 2007;60(1):34–42. Epub 2006/12/13. pmid:17161752.
- 33. Gomez R, McLaren S. The Center for Epidemiologic Studies Depression Scale Support for a Bifactor Model With a Dominant General Factor and a Specific Factor for Positive Affect. Assessment. 2014:1073191114545357.
- 34. Hu Lt, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural equation modeling: a multidisciplinary journal. 1999;6(1):1–55.
- 35.
Thompson B. Exploratory and confirmatory factor analysis: Understanding concepts and applications: American Psychological Association; 2004.
- 36. Hooper D, Coughlan J, Mullen M. Structural equation modelling: Guidelines for determining model fit. Electronic Journal of Business Research Methods. 2008;6(1):53–60.
- 37. Ware JE Jr., Gandek B. Methods for testing data quality, scaling assumptions, and reliability: the IQOLA Project approach. International Quality of Life Assessment. Journal of clinical epidemiology. 1998;51(11):945–52. Epub 1998/11/17. pmid:9817111.
- 38. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143(1):29–36. pmid:7063747.
- 39. Revicki D, Hays RD, Cella D, Sloan J. Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. Journal of clinical epidemiology. 2008;61(2):102–9. Epub 2008/01/08. pmid:18177782.
- 40. Guyatt G, Walter S, Norman G. Measuring change over time: assessing the usefulness of evaluative instruments. Journal of chronic diseases. 1987;40(2):171–8. pmid:3818871.
- 41. Guyatt G, Walter S, Norman G. Measuring change over time: Assessing the usefulness of evaluative instruments. Journal of Chronic Diseases. 1987;40(2):171–8. http://dx.doi.org/10.1016/0021-9681(87)90069-5. pmid:3818871
- 42.
Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum Associates; 1988.
- 43. Liang MH, Fossel AH, Larson MG. Comparisons of five health status instruments for orthopedic evaluation. Medical care. 1990;28(7):632–42. pmid:2366602
- 44. Husted JA, Cook RJ, Farewell VT, Gladman DD. Methods for assessing responsiveness: a critical review and recommendations. Journal of clinical epidemiology. 2000;53(5):459–68. pmid:10812317
- 45. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. Journal of clinical epidemiology. 2007;60(1):34–42. Epub 2006/12/13. pmid:17161752.
- 46. Canady RB, Stommel M, Holzman C. Measurement properties of the centers for epidemiological studies depression scale (CES-D) in a sample of African American and non-Hispanic White pregnant women. Journal of nursing measurement. 2009;17(2):91–104. pmid:19711708; PubMed Central PMCID: PMC2997619.
- 47. Ruiz-Grosso P, de Mola CL, Vega-Dienstmaier JM, Arevalo JM, Chavez K, Vilela A, et al. Validation of the spanish center for epidemiological studies depression and zung self-rating depression scales: a comparative validation study. PloS one. 2012;7(10):e45413. pmid:23056202
- 48. Milette K, Hudson M, Baron M, Thombs BD, Canadian Scleroderma Research G. Comparison of the PHQ-9 and CES-D depression scales in systemic sclerosis: internal consistency reliability, convergent validity and clinical correlates. Rheumatology. 2010;49(4):789–96. pmid:20100794.
- 49. Ghubash R, Daradkeh TK, Al Naseri KS, Al Bloushi NB, Al Daheri AM. The performance of the Center for Epidemiologic Study Depression Scale (CES-D) in an Arab female community. The International journal of social psychiatry. 2000;46(4):241–9. pmid:11201346.
- 50. Miller WC, Anton HA, Townson AF. Measurement properties of the CESD scale among individuals with spinal cord injury. Spinal cord. 2008;46(4):287–92. pmid:17909558.
- 51. Wong CK, Lam CL, Law WL, Poon JT, Kwong DL, Tsang J, et al. Condition-specific measure was more responsive than generic measure in colorectal cancer: all but social domains. Journal of clinical epidemiology. 2013;66(5):557–65. pmid:23548135.
- 52. Choi EP, Chin WY, Lam CL, Wan EY. The responsiveness of the International Prostate Symptom Score, Incontinence Impact Questionnaire-7 and Depression, Anxiety and Stress Scale-21 in patients with lower urinary tract symptoms. J Adv Nurs. 2015;71(8):1857–70. pmid:25871549.