Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Validation and factor structure of the Japanese version of the inventory to diagnose depression, lifetime version for pregnant women

  • Chika Kubota,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Validation, Visualization, Writing – original draft

    Affiliations National Center of Neurology and Psychiatry, Kodaira, Tokyo, Japan, Department of Psychiatry, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan

  • Toshiya Inada ,

    Roles Supervision, Writing – original draft, Writing – review & editing

    inada@med.nagoya-u.ac.jp, toshiya.inada@gmail.com

    Affiliation Department of Psychiatry and Psychobiology, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan

  • Yukako Nakamura,

    Roles Data curation

    Affiliation Department of Psychiatry, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan

  • Tomoko Shiino,

    Roles Data curation, Investigation

    Affiliations Department of Psychiatry, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan, Division of Developmental Emotional Intelligence Research Center for Child Mental Development, University of Fukui, Fukui, Japan

  • Masahiko Ando,

    Roles Formal analysis, Supervision

    Affiliation Center for Advanced Medicine and Clinical Research, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan

  • Branko Aleksic,

    Roles Writing – review & editing

    Affiliation Department of Psychiatry, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan

  • Aya Yamauchi,

    Roles Data curation, Validation

    Affiliation Department of Psychiatry, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan

  • Mako Morikawa,

    Roles Data curation

    Affiliation Department of Psychiatry, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan

  • Takashi Okada,

    Roles Data curation

    Affiliation Department of Psychiatry, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan

  • Masako Ohara,

    Roles Data curation

    Affiliation Department of Psychiatry, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan

  • Maya Sato,

    Roles Data curation

    Affiliation Department of Psychiatry, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan

  • Satomi Murase,

    Roles Conceptualization, Project administration

    Affiliation Liaison Medical Marunouchi, Nagoya, Aichi, Japan

  • Setsuko Goto,

    Roles Conceptualization

    Affiliation Goto Setsuko Ladies Clinic, Nagoya, Aichi, Japan

  • Atsuko Kanai,

    Roles Conceptualization, Resources

    Affiliation Graduate School of Education and Human Development, Nagoya University, Nagoya, Aichi, Japan

  • Norio Ozaki

    Roles Conceptualization, Funding acquisition, Methodology, Project administration, Resources, Software, Supervision

    Affiliation Department of Psychiatry, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan

Abstract

Introduction

A history of major depressive disorder before pregnancy is one risk factor for peripartum depression. Therefore, the purpose of the present study was to examine the validation and factor structure of the Japanese version of the Inventory to Diagnose Depression, Lifetime version (IDDL) for pregnant women.

Methods

The study participants were 556 pregnant women. Factor analysis was performed to identify the factor structure, construct validity was examined based on the results of the factor analysis, and reliability was examined using Cronbach’s α coefficient.

Results

Based on the results of the factor analysis of the IDDL, a bifactor model composed of a single general dimension along with the following five factors was extracted: (1) depression, anxiety, and irritability (items 1, 2, 8–10, and 19–21); (2) retardation, decreased concentration, indecisiveness, and insomnia (items 4, 11, 12, and 17); (3) decrease in appetite/significant weight loss (items 13 and 14); (4) increase in appetite/significant weight gain (items 15 and 16); and (5) diminished interest, pleasure, and libido (items 5–7). Cronbach’s α coefficients for these five factors were as follows: 0.910, 0.815, 0.780, 0.683, and 0.803, respectively.

Conclusions

The reliability, construct validity, and factor structure of the Japanese version of the IDDL were confirmed in pregnant women.

Introduction

Mental health care in the perinatal period is important. A multicenter prospective study estimated that the prevalence of perinatal depression in Japan was 5.6% during pregnancy and 5.0% during the postnatal period [1]. In 2017, it was reported that suicide is the most frequent cause of maternal death in Tokyo, Japan [2]. The existence of perinatal depression has been pointed out with this background. Hence, the prevention of perinatal depression is urgently needed. Therefore, preventive activities such as screening in maternal health examinations and home visits by public health nurses are being promoted for the early detection of and intervention for perinatal depression.

A meta-analysis reported that a history of major depressive disorder (MDD) is a major risk factor for perinatal depression [3, 4]. Confirming the history of previous depressive episodes is considered to be useful in the prevention of perinatal depression; however, currently, this is not sufficiently performed in primary care in Japan, such as in maternal health examinations.

The Inventory to Diagnose Depression, Lifetime version (IDDL) is a self-administered questionnaire developed by Zimmerman et al. in 1987 to assess lifetime history of MDD based on the Diagnostic and Statistical Manual of Mental Disorders (DSM)-III [5]. The diagnostic interviews usually require sufficient rater training for stable and reliable evaluations, and a limited number of subjects who can be evaluated within the given time. Therefore, self-administered questionnaires are more useful than diagnostic interviews for medical examinations.

Although both the original English and the Japanese version of the IDDL have been validated [5, 6], reports examining the reliability and validity of the IDDL are quite limited and have had relatively small sample sizes. Moreover, the factor structure of the IDDL has scarcely been studied. Since August 2004, we have been conducting a prospective cohort study in Nagoya involving women from pregnancy to 1 month postpartum. In the present study, using these data, the validity and factor structure of the Japanese version of the IDDL were examined using a relatively large sample of pregnant women. The symptomatologic features of depression were also discussed based on the results of the obtained factor structure.

Methods

Study design

In the present study, which started in August 2004 in Nagoya, cross-sectional data on perinatal depression were extracted from the prospective cohort. In this prospective cohort study, a three-factor structure of depression, anxiety, and anhedonia was revealed based on the Edinburgh Postnatal Depression Scale (EPDS) [7].

Participants

The IDDL has been used at four hospitals in Nagoya—one general hospital (Nagoya Teishin Hospital), two obstetrics and gynecology hospitals (Kaseki Hospital and Royal Bell Clinic), and one university hospital (Nagoya University Hospital)—since May 2011. The eligibility criteria were: pregnant female aged 20 years or older, ability to read and write Japanese, and attended a gynecological checkup at one of the four hospitals mentioned above.

Ethical considerations

The study protocol was approved by the ethics committee of Nagoya University Hospital. All study procedures were conducted in accordance with the Declaration of Helsinki and other relevant ethical guidelines, and written informed consent was obtained from all participants.

Measurements

The following demographic and socioeconomic data were collected: age, years of education, number of births, economic status, and employment status. All participants were assessed using self-administered questionnaires (the Japanese versions of the EPDS and IDDL).

Edinburgh Postnatal Depression Scale (EPDS)

The EPDS is a self-administered questionnaire designed by Cox et al. in 1987 [8] to screen for postpartum depression. It is composed of 10 items scored on a 4-point Likert scale, with scores ranging from 0–3. The Japanese version of the EPDS was translated from its original English version, and validated by Okano et al. in 1996 [9]. During pregnancy, the sensitivity, specificity, and positive predictive value of the EPDS with a cutoff point of 12/13 were 90%, 92%, and 55%, respectively [10]. The Japanese version of the EPDS has been shown to have a stable factor structure (depression [items 7 and 9], anxiety [items 4 and 5], and anhedonia [items 1 and 2]) from pregnancy to the postpartum period [7].

Inventory to Diagnose Depression, Lifetime version (IDDL)

The IDDL is a self-administered questionnaire developed by Zimmerman et al. to assess lifetime history of MDD in accordance with the DSM-III [5]. It is composed of 22 symptom items scored on a 5-point Likert scale, with scores ranging from 0–4. When the score of an individual symptom item was 1 or higher, the participants was asked whether the symptom lasted longer than 2 weeks.

The following evaluation method was used in the adopted Japanese version of the IDDL, the same as that used in the original English version. First, if a symptom continues for more than 2 weeks, the respondent is considered as having that symptom. Second, a score of 2–4 indicates the presence of a specific symptom for each item, except items 5 and 6, for which a score of 3–4 is used. Third, all 22 items on the IDDL are classified into nine depressive symptoms as defined by the DSM-III. The two major symptoms of four items are: (1) depressive mood (items 1 and 20) and (2) diminished interest or pleasure (items 5 and 6). The remaining seven depressive symptoms are: (3) decrease or increase in appetite/significant weight loss or weight gain (items 13–16), (4) insomnia or hypersomnia (items 17 and 18), (5) psychomotor agitation or retardation (items 3 and 4), (6) fatigue or loss of energy (items 2 and 7), (7) feelings of worthlessness or excessive inappropriate guilt (items 8 and 9), (8) diminished ability to think or concentrate, or indecisiveness (items 11 and 12), and (9) recurrent suicidal thoughts (item 10). In children and adolescents, item 21 is used in place of item 20. Items 19 and 22 are not applied for the DSM-III diagnosis. Whether symptoms have continued for 2 weeks is checked to diagnose MDD as defined by the DSM-III for each item. Finally, the conditions regarding a history of MDD were as follows: for items that last 2 weeks or more, (1) out of 22 items, five or more have the cutoff score or higher, and (2) these five or more items contain one or more items of the two major symptoms.

The original English version of the IDDL was validated by Zimmerman et al. as follows [5]. For 164 participants, concurrent validity was examined using the Diagnostic Interview Schedule (DIS) [11], and reliability was evaluated using Cronbach’s α and Spearman–Brown coefficients. As a result, it was confirmed to have good internal consistency (α = 0.92) and split-half reliability (Spearman–Brown coefficient = 0.90). The lifetime prevalence of MDD was not significantly higher in the IDDL than in the DIS, and the sensitivity and specificity were 74% and 93%, respectively (kappa between the IDDL and DIS = 0.60).

In Japan, Uehara et al. translated the original English version into Japanese. It was confirmed through a back-translation process and validated as follows [6]. Thirty normal participants, 30 participants with a history of MDD, and 29 with a history of anxiety disorders diagnosed using the Structured Clinical Interview for DSM-III-R (SCID) [12] were enrolled as participants. Regarding reliability, internal consistency as evaluated using Cronbach’s α was 0.86, and split-half reliability as evaluated by the Spearman–Brown coefficient was 0.76. Concurrent validity was examined using the SCID. For the 30 patients with a history of MDD and the 30 normal participants, the sensitivity and specificity were 83% and 97%, respectively. For the 30 patients with a history of MDD and the 29 with a history of anxiety disorders, the sensitivity and specificity were 83% and 60%, respectively.

However, the factor structure of the IDDL for both the original English and the Japanese version remains unclear.

Statistical analysis

The rate of missing data for all items was calculated, and Little’s missing completely at random (MCAR) test was performed to decide how to deal with the missing data [13].

To examine construct validity, a factor analysis was conducted after a measure of specimen validity using the Kaiser–Meyer–Olkin (KMO) Test and Bartlett’s test of sphericity [14]. A KMO value above 0.6 and a value below 0.05 on Bartlett’s test of sphericity are appropriate for conducting a factor analysis. The participants were randomly divided into two sample sets. The first was used for exploratory factor analysis (EFA), and the second for confirmatory factor analysis (CFA). For the EFA, a screen test was used to determine the number of factors, and maximum likelihood estimation with promax rotation was performed. EFA was conducted for the items for which the communalities were over 0.4 [15]. The items of the IDDL with a factor coefficient level above 0.30 were defined as being included in the same factor. If there were items with a coefficient level more than 0.30 in multiple factors, that item was included as a factor of a higher coefficient level. CFA was carried out based on the models obtained by EFA, and the best-fit model was determined among the six models, including the 1-, 2-, 3-, 4-, and 5-factor models and the bifactor model. The following fit indices were used to assess model fit: chi-square (χ2)/degrees of freedom (df), comparative fit index (CFI) [16], root mean square error of approximation (RMSEA) [17], and Akaike’s information criterion (AIC) [18]. A CFI value above 0.97 is considered good, and above 0.95 acceptable; 0.90 or more is required for the adoption of the model [16]. An RMSEA value below 0.05 is considered good, and below 0.08 acceptable; less than 0.1 is required for the adoption of the model [17]. Lower χ2/df and AIC values are considered to indicate a better fit [18]. Whether the goodness of fit was sufficiently improved by increasing the number of factors was evaluated based on the Δχ2 value, using the table of χ2 distribution.

To examine internal reliability, after the best-fit factor structure had been clarified, the Cronbach’s α coefficients of individual factors were calculated. Cronbach’s α coefficients above 0.7 are acceptable [19].

To clarify how a history of MDD affects depression during pregnancy, based on the method by Zimmerman et al. [5, 6], pregnant women with a history of MDD were extracted using the IDDL. Then, the pregnant women with a cutoff score of 13 or more on the EPDS, as proposed by Usuda et al. [10], were identified.

The data were analyzed using SPSS Statistics version 26.0 and SPSS Amos version 26.0 (IBM Tokyo, Japan).

Results

Characteristics of the participants

Little’s MCAR test indicated that the data were not randomly missing (p < 0.001); therefore, the multiple imputation method was used to handle missing data in the demographic analysis. Two participants were excluded because more than half of the IDDL items were missing. Multiple imputation was used to create and analyze 10 multiply imputed data sets.

As a result, 556 of 558 women were analyzed in this study (mean [M]: 22.6 weeks gestation, standard deviation [SD]: 6.1 weeks). The mean age of the participants was 32.9 (SD: 4.8) years, and that of their partners was 35.1 (SD: 5.8) years. The mean years of education was 15.0 (SD: 1.9). The ratios of nulliparas, primiparas, and those who had given birth two or three times were 81.8%, 14.9%, 2.7%, and 0.5%, respectively. The annual mean household income was 56,000 (SD: 25,600) USD, and the mean personal income was 19,300 (SD: 19,600) USD. Regarding employment status, 37.6% of the participants were homemakers, 48.6% were full-time workers, and 13.8% were part-time workers. The types of hospitals were as follows: one general hospital (n = 165, 29.7%), two obstetrics and gynecology hospitals (n = 161, 29.0%), and one university hospital (n = 230, 41.3%).

Exploratory factor analysis

Half (n = 278, 50.0%) of the participants were randomly chosen. The KMO value was 0.931, and the χ2 value by Bartlett’s test of sphericity was 3596.483 (F = 231, p < 0.000), indicating a reasonable value for the factor analysis. The screen test showed that the number of factors was recommended to be between one and five. For the EFA, the multiple imputation method was used to handle missing data. The following variables and the rate of missing data for the individual IDDL items are shown in Table 1. The following three items for which the communality was less than 0.4 were excluded from the EFA: item 3 = 0.283, item 18 = 0.223, and item 22 = 0.053. The results of the EFA are shown in Table 2. The rate of women who had an EPDS total score of 13 or more was 9.2% (n = 51). The rate of women having a history of MDD based on the IDDL was 166 (29.9%). The medians and interquartile ranges of the EPDS scores were as follows: anxiety (2, 0–3), depression (0, 0–1), anhedonia (0, 0–0), total score (4, 1–8).

thumbnail
Table 2. EFA of the Japanese version of the IDDL (n = 278, maximum-likelihood estimation with promax rotation).

https://doi.org/10.1371/journal.pone.0234240.t002

Confirmatory factor analysis (CFA)

The other sample set (n = 276, 50.0%) was then used. For the CFA, full information maximum-likelihood estimation was used to handle missing data. Each of the factor structure models obtained by the EFA was examined. The results of the model fit by the CFA are shown in Table 3. The critical values of the χ2 distribution at the significance level of p < 0.001 corresponding to df values of 1, 2, 3, and 4 were 10.83, 13.82, 16.27, and 18.47, respectively. As shown in Table 3, Since these critical values were all lower than the Δχ2/df values corresponding to the individual factor models, goodness of fit was shown to be improved by increasing the number of factors. The best-fit model of the CFA was the bifactor model, which consisted of a single general dimension along with the following five factors: (1) depression, anxiety, and irritability (items 1, 2, 8–10, and 19–21); (2) retardation, decreased concentration, indecisiveness, and insomnia (items 4, 11, 12, and 17); (3) decrease in appetite/significant weight loss (items 13 and 14); (4) increase in appetite/significant weight gain (items 15 and 16); and (5) diminished interest, pleasure, and libido (items 5–7). Cronbach’s α coefficients for these five factors were as follows: 0.910, 0.815, 0.780, 0.683, and 0.803, respectively. The correlations between these five factors are also shown in Fig 1. Each correlation was significant except for that between factors 3 and 4.

thumbnail
Fig 1. Best-fit model of the confirmatory factor analysis.

https://doi.org/10.1371/journal.pone.0234240.g001

Discussion

In the present study, we demonstrated the reliability and construct validity of the Japanese version of the IDDL for 556 pregnant women and revealed its factor structure. As a result, first, a bifactor model composed of a single general dimension along with the following five factors was extracted: (1) depression, anxiety, and irritability (items 1, 2, 8–10, and 19–21); (2) retardation, decreased concentration, indecisiveness, and insomnia (items 4, 11, 12, and 17); (3) decrease in appetite/significant weight loss (items 13 and 14); (4) increase in appetite/significant weight gain (items 15 and 16); and (5) diminished interest, pleasure, and libido (items 5–7). Second, the construct validity was confirmed. Third, according to the IDDL, the prevalence of pregnant women with a history of MDD was estimated to be 29.9%.

The original English and the Japanese version of the IDDL were validated for a small sample size [5, 6]. In the present study, reliability based on Cronbach’s α coefficient was shown to be sufficiently high using a large sample size of 556 pregnant women. However, since no clinical diagnostic interviews were conducted, its sensitivity and specificity could not be evaluated.

The present five factor structure was shown to have a sufficiently high Cronbach’s α value. However, higher values, such as those over 0.90, may reflect unnecessary duplication of content across items and point more to redundancy than to homogeneity [20]. Further research needs to consider the short version of the IDDL with similar items reduced.

As shown in Table 1, the items for which the factor loading value for a single general dimension was larger than that for five factors were all eight F1 items (depression, anxiety, and irritability), all four F2 items (retardation, decreased concentration, indecisiveness, and insomnia), and two F5 items (diminished interest and pleasure). By contrast, the items for which the factor loading value for a single general dimension was smaller than that for five factors were: all two F3 items (increase in appetite/significant weight gain), all two F4 items (increase in appetite/significant weight gain), and one F5 item (libido). These results may provide new evidence that mental symptoms are important factors contributing to depression, and that appetite and libido are physical symptoms secondary to mental symptoms.

The factor loading values of the F4 items (increase in appetite/significant weight gain) for a single general dimension were lower than those of the other 19 items, as shown in Fig 1. This finding was consistent with a previous study reporting that the prevalence of increased appetite was lower than that of decreased appetite in patients with MDD [21]; however, changes in appetite and weight are difficult to compare in MDD because the situation often varies depending on one’s physical health (e.g., obese individuals with physical disorders such as diabetes and comorbid diseases such as anorexia nervosa are at high risk for MDD).

Regarding the ratio of participants with a history of MDD using the IDDL, Zimmerman et al. [5] reported a prevalence of 15% among normal control probands, Uehara [22] reported a prevalence of 15% (14 of 93) among female Japanese workers, and Sakado [23] reported a prevalence of 12.7% (16 of 126) among employed Japanese adults; however, 29.9% of the pregnant women in the present study had a history of MDD, which is at least twice as high as previous reports. One of the reasons for the relatively high prevalence observed in our study may be a selection bias: 1) pregnant women who were in good mental health may not have had any interest in this study, and therefore, could have decided not to participate; and 2) in total, 41.3% of the participants were recruited from university hospitals, where large numbers of pregnant women who suffer from severe mental or physical comorbid illnesses are usually introduced from community hospitals.

The IDDL may estimate the rate of the prenatal women having a history of MDD significantly higher than the actual value; however, the false-positive rate could not be evaluated because no clinical interviews were conducted in this study. Clinical interviews should be performed to diagnose MDD in a future study.

Participants who were suspected of having a history of MDD based on the IDDL had significantly higher total EPDS scores than those who were not. The results of this study support previous findings that a history of MDD increases vulnerability to stress; therefore, confirming one’s history of MDD was useful for extracting those at high risk for perinatal depression. However, the IDDL could not confirm at what point the person concerned developed depression or experienced multiple depressive episodes. Therefore, it is considered preferable to make inquiries to the person concerned and confirm the times and instances of depressive episodes when evaluating the history of MDD in maternal health examinations using the IDDL.

This study did have a notable limitation. The sample size of 556 may have been insufficient to perform factor analyses. Further research on factor analyses using larger samples is needed to identify a more robust factor structure than that observed in the present study. A concurrent validity study using clinical diagnoses by the DSM-5 and cross-cultural research may also be needed.

In conclusion, the internal reliability, construct validity, and factor structure of the Japanese version of the IDDL for pregnant women was demonstrated. A bifactor model composed of a single general dimension along with the following five factors was extracted: (1) depression, anxiety, and irritability; (2) retardation, decreased concentration, indecisiveness and insomnia; (3) decrease in appetite/significant weight loss; (4) increase in appetite/significant weight gain; and (5) diminished interest, pleasure, and libido.

Acknowledgments

We would like to express our gratitude to the staff at Nagoya Teishin Hospital, Kaseki Hospital, Royal Bell Clinic, and Nagoya University Hospital.

References

  1. 1. Kitamura T, Yoshida K, Okano T, Kinoshita K, Hayashi M, Toyoda N, et al. Multicentre prospective study of perinatal depression in Japan: incidence and correlates of antenatal and postnatal depression. Archives of women's mental health. 2006;9(3):121–30. Epub 2006/03/21. pmid:16547826.
  2. 2. Takeda S, Takeda J, Murakami K, Kubo T, Hamada H, Murakami M, et al. Annual Report of the Perinatology Committee, Japan Society of Obstetrics and Gynecology, 2015: Proposal of urgent measures to reduce maternal deaths. The journal of obstetrics and gynaecology research. 2017;43(1):5–7. Epub 2017/01/12. pmid:28074548.
  3. 3. Beck CT. Predictors of Postpartum Depression: An Update. Nursing Research. 2001;50(5):275–85. 00006199-200109000-00004. pmid:11570712
  4. 4. Robertson E, Grace S, Wallington T, Stewart DE. Antenatal risk factors for postpartum depression: a synthesis of recent literature. General Hospital Psychiatry. 2004;26(4):289–95. pmid:15234824
  5. 5. Zimmerman M, Coryell W. The inventory to diagnose depression, lifetime version. Acta Psychiatrica Scandinavica. 1987;75(5):495–9. pmid:3604734
  6. 6. Uehara T, Sakado K, Sato T, Sato S. The reliability and validity of the Japanese version of the inventory to diagnose depression lifetime version. Japanese Journal of Psychiatric Treatment. 1995;10(2):181–8. pmid:1995199062.
  7. 7. Kubota C, Inada T, Nakamura Y, Shiino T, Ando M, Aleksic B, et al. Stable factor structure of the Edinburgh Postnatal Depression Scale during the whole peripartum period: Results from a Japanese prospective cohort study. Scientific Reports. 2018;8(1):17659. pmid:30518774
  8. 8. Cox JL, Holden JM, Sagovsky R. Detection of postnatal depression. Development of the 10-item Edinburgh Postnatal Depression Scale. The British journal of psychiatry: the journal of mental science. 1987;150:782–6.
  9. 9. Okano S, Murata M, Masuji S, al. e. Reliability and validity of the Edinburgh postpartum depression scale (EPDS) in Japan. Archives of Psychiatric Diagnostics and Clinical Evaluation. 1996;7(4):525–33. pmid:1997169221.
  10. 10. Usuda K, Nishi D, Okazaki E, Makino M, Sano Y. Optimal cut-off score of the Edinburgh Postnatal Depression Scale for major depressive episode during pregnancy in Japan. Psychiatry and clinical neurosciences. 2017;71(12):836–42. Epub 2017/08/03. pmid:28767198.
  11. 11. Robins LN, Helzer JE, Croughan J, Ratcliff KS. National Institute of Mental Health Diagnostic Interview Schedule: Its History, Characteristics, and Validity. Archives of General Psychiatry. 1981;38(4):381–9. pmid:6260053
  12. 12. Spitzer RL, Williams JB, Gibbon M, First MB. The Structured Clinical Interview for DSM-III-R (SCID). I: History, rationale, and description. Archives of general psychiatry. 1992;49(8):624–9. Epub 1992/08/01. pmid:1637252.
  13. 13. Little RJA. A Test of Missing Completely at Random for Multivariate Data with Missing Values. Journal of the American Statistical Association. 1988;83(404):1198–202.
  14. 14. Dziuban CD, Shirkey EC. When is a correlation matrix appropriate for factor analysis? Some decision rules. Psychological Bulletin. 1974;81(6):358–61.
  15. 15. Osborne JW, Fitzpatrick DC. Replication Analysis in Exploratory Factor Analysis: What it is and why it makes your analysis better. Practical Assessment, Research, and Evaluation. 2012;17(15).
  16. 16. Bentler PM. Comparative fit indexes in structural models. Psychol Bull. 1990;107(2):238–46. Epub 1990/03/01. pmid:2320703.
  17. 17. Browne MW, Cudeck R. Alternative Ways of Assessing Model Fit. Sociological Methods & Research. 1992;21(2):230–58.
  18. 18. Akaike H. Factor analysis and AIC. Psychometrika. 1987;52(3):317–32.
  19. 19. Peterson RA. A Meta-Analysis of Cronbach's Coefficient Alpha. Journal of Consumer Research. 1994;21(2):381–91.
  20. 20. Streiner DL. Starting at the beginning: an introduction to coefficient alpha and internal consistency. Journal of personality assessment. 2003;80(1):99–103. Epub 2003/02/14. pmid:12584072.
  21. 21. Parker G, Roy K, Mitchell P, Wilhelm K, Malhi G, Hadzi-Pavlovic D. Atypical Depression: A Reappraisal. American Journal of Psychiatry. 2002;159(9):1470–9. pmid:12202264
  22. 22. Sato T, Uehara T, Sakado K, Nishioka K, Ozaki N, Nakamura M, et al. Dysfunctional parenting and a lifetime history of depression in a volunteer sample of Japanese workers. Acta Psychiatr Scand. 1997;96(4):306–10. Epub 1997/11/14. pmid:9350961.
  23. 23. Sakado K, Kuwabara H, Sato T, Uehara T, Sakado M, Someya T. The relationship between personality, dysfunctional parenting in childhood, and lifetime depression in a sample of employed Japanese adults. Journal of affective disorders. 2000;60(1):47–51. Epub 2000/08/15. pmid:10940447.