Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Cognitive Reactivity, Implicit Associations, and the Incidence of Depression: A Two-Year Prospective Study

  • Anne-Wil Kruijt ,

    KruijtJ@fsw.leidenuniv.nl

    Affiliation Institute of Psychology, Leiden University, Leiden, The Netherlands

  • Niki Antypa,

    Affiliation Institute of Psychology, Leiden University, Leiden, The Netherlands

  • Linda Booij,

    Affiliations Department of Psychiatry, University of Montreal, Montreal, Canada, Sainte-Justine Hospital Research Center, Montreal, Canada, Department of Psychiatry, McGill University, Montreal, Canada

  • Peter J. de Jong,

    Affiliation Department of Clinical Psychology, University of Groningen, Groningen, The Netherlands

  • Klaske Glashouwer,

    Affiliation Department of Clinical Psychology, University of Groningen, Groningen, The Netherlands

  • Brenda W. J. H. Penninx,

    Affiliations Institute of Psychology, Leiden University, Leiden, The Netherlands, Department of Psychiatry, University Medical Center Groningen, Groningen, The Netherlands, Department of Psychiatry, Vrije Universiteit Medical Center, Amsterdam, The Netherlands

  • Willem Van der Does

    Affiliations Institute of Psychology, Leiden University, Leiden, The Netherlands, Department of Psychiatry, Leiden University Medical Center, Leiden, The Netherlands, Leiden Institute for Brain and Cognition, Leiden, The Netherlands

Abstract

Background

Cognitive reactivity to sad mood is a vulnerability marker of depression. Implicit self-depressed associations are related to depression status and reduced remission probability. It is unknown whether these cognitive vulnerabilities precede the first onset of depression.

Aim

To test the predictive value of cognitive reactivity and implicit self-depressed associations for the incidence of depressive disorders.

Methods

Prospective cohort study of 834 never-depressed individuals, followed over a two-year period. The predictive value of cognitive reactivity and implicit self-depressed associations for the onset of depressive disorders was assessed using binomial logistic regression. The multivariate model corrected for baseline levels of subclinical depressive symptoms, neuroticism, for the presence of a history of anxiety disorders, for family history of depressive or anxiety disorders, and for the incidence of negative life events.

Results

As single predictors, both cognitive reactivity and implicit self-depressed associations were significantly associated with depression incidence. In the multivariate model, cognitive reactivity was significantly associated with depression incidence, together with baseline depressive symptoms and the number of negative life events, whereas implicit self-depressed associations were not.

Conclusion

Cognitive reactivity to sad mood is associated with the incidence of depressive disorders, also when various other depression-related variables are controlled for. Implicit self-depressed associations predicted depression incidence in a bivariate test, but not when controlling for other predictors.

Introduction

The central thesis of cognitive theory of depression is that dysfunctional cognitions render an individual vulnerable to developing depressive episodes [1]. Dysfunctional cognitions are thought to arise from negative belief systems that develop during childhood. These systems can remain relatively inactive until later in life, for instance when an individual encounters a situation (e.g., a demanding boss) that resembles the circumstances that led to the belief system (e.g., demanding parents) [1]. Psychotherapy directed at modifying dysfunctional belief systems, cognitive behavioral therapy (CBT), is more effective at preventing relapse than pharmacotherapy [2], [3], [4], [5], providing indirect evidence for the causal relation between dysfunctional cognitions and depression risk. However, dysfunctional cognitions, prominent during depressed states, tend to normalize during remission [6], [7], [8], [9], [10], and research yielded mixed results regarding the question whether negative cognitions are antecedents, consequences or by-products of depression [10], [11], [12], [13].

Findings became more consistent when it was realized that negative cognitions might go undetected unless primed or activated by stress or a dysphoric mood state [14], [15], [16]. Cognitive reactivity to sad mood is the extent to which dysfunctional cognitions become activated when an individual experiences mild sadness. Several lines of evidence support the position that cognitive reactivity is a vulnerability marker of depression. Cognitive reactivity is higher in remitted depressed than never-depressed individuals [17], [18], [19], [20], [21], and it is associated with biological indices of depression vulnerability such as response to tryptophan depletion [22] and the polymorphism in the promotor region of the serotonin transporter gene SLC6A4 [23]. Moreover, cognitive reactivity may have prognostic value: high cognitive reactivity following treatment predicts shorter time to relapse or recurrence [21], [24]. It is unknown however, whether cognitive reactivity is also a risk factor for depression incidence, i.e. whether higher cognitive reactivity precedes first onset of depression.

Another strategy to make dysfunctional cognitions measurable is to rely on laboratory tests instead of self-report. One of these is the Implicit Associations Test (IAT) [25], [26], a reaction time test developed in social psychology. In this test, the relative speed with which an individual is able to generate the same motor responses to stimuli representing two different concepts, is used as an index of the strength of the individual’s association between these concepts [25]. Implicit associations between the concepts ‘self’ and ‘depressed’ are stronger in currently depressed patients and remain elevated when depression is in remission [27]. Implicit self-depressed associations mediate the relationship between childhood emotional abuse and depression symptom severity [28], and are associated with suicidal ideation [29]. In currently depressed individuals, the strength of implicit self-depressed associations was inversely associated with the chance of achieving remission within a two-year period [30]. It has not yet been tested whether the strength of implicit self-depressed associations predicts depression incidence.

In the current study, we tested the hypotheses that cognitive reactivity and the strength of implicit self-depressed associations precede and predict the first onset of depressive disorders. A sample of never-depressed individuals was followed over a period of two years. Using multivariate binary logistic regression analysis, the prognostic values of cognitive reactivity and implicit self-depressed associations were assessed and tested against the contributions of a number of background variables and established risk factors of depression.

Methods

Participants

All data were collected within the Netherlands Study of Depression and Anxiety (NESDA). This is a large longitudinal cohort study investigating a range of factors implicated in the onset and course of depression and anxiety disorders [31]. The cohort of 2,981 participants consists of individuals with a current or lifetime diagnosis of depression or anxiety, and a number of never-depressed and/or never-anxious participants who were included as healthy controls at baseline. Participants were between 18 and 65 years old, and recruited through mental health organizations, primary care practices and in the general population. Detailed information on in-exclusion criteria, participant flow, and sample characteristics is provided by Penninx et al. [32]. For the current study, all individuals who had never experienced major depression or dysthymia at baseline were selected.

Measures

Depression incidence.

The main outcome measure, was determined using the Composite International Diagnostic Interview (CIDI; World Health Organization (WHO) Version 2.1) at the two years follow-up assessment. Incidence of a major depressive episode or a diagnosis of dysthymia was coded for as 1, versus 0 for no incidence. The CIDI is a standardized interview that assesses the, current and past, presence of psychiatric diagnoses as described in the DSM-IV [33]. Trained interviewers administered the CIDI [32].

Cognitive reactivity to sad mood.

Was assessed with the Leiden Index of Depression Sensitivity – revised (LEIDS-r). The LEIDS-r has 34 items that assess the extent to which dysfunctional cognitions are activated when an individual experiences mild dysphoria [34], [35]. Two example items are: ‘When in a sad mood, I more often think about how my life could have been different’ (rumination subscale) or ‘When I feel sad I feel more like breaking things’ (aggression subscale). Items are scored on a 5-point Likert scale ranging from ‘not at all’ (0) to ‘very strongly’ (4). The LEIDS-r has a total score, and six subscales assessing cognitive reactivity related to Aggression, Hopelessness/Suicidality, Acceptance/Coping, Control/Perfectionism, Risk Aversion, and Rumination on Sadness. LEIDS-r scores were found to be associated with depression history over and above rumination [36], to be associated with genetic markers of depression [23], [37], [38], and with response to tryptophan depletion, reflecting biological vulnerability to depression [22]. Moreover, treatment and other longitudinal studies support the validity of the LEIDS-r as a measure of depression vulnerability [39], [40], [41], [42].

Implicit self-depressed associations (ISDA).

Were measured using the Implicit Association Test (IAT) [25], [43]. In this test participants have to respond to words presented on a display by pressing one of two response buttons. Each word belongs to either one of two concept-pairs. In this particular IAT, one set of stimulus words represented either elated (e.g., valuable, optimistic) or depressed (e.g., useless, pessimistic) concepts, whereas another set represented either the self (e.g., me, myself) or others (e.g., you, they)1. Within each test block, two concepts share the same button. The combination of concepts sharing a button was varied over blocks, i.e. within one block ‘elation’ and ‘self’ shared a button while in another block ‘depression’ and ‘self’ shared a button. The difference in reaction times between these two blocks indicates the strength of the implicit association between the concepts ‘self’ and ‘depression’. Raw IAT response times were transformed into the D600-measure recommended by Greenwald et al. [44] and others [45]. The D600-algorithm prescribes that: (i) data from two practice blocks (20 trials each) and two test blocks (60 trials each) are used; (ii) trials with reaction times above 10,000 ms are discarded; (iii) error trials are replaced with the mean reaction times of the correct responses in the block in which the error occurred, plus a penalty of 600 ms; (iv) response times for the self - elated blocks are subtracted from the response times for the self - depressed blocks (separately for practice and test blocks); (v) these difference scores are divided by their pooled standard deviation, and then averaged [44]. Lower values represent stronger implicit self-depressed associations.

Demographic information.

Including gender, age, and years of education was obtained in an interview.

The presence of a lifetime anxiety diagnosis.

Was determined with the lifetime version 2.1 of the Composite International Diagnostic Interview (CIDI; World Health Organization (WHO)).

Family history of anxiety and/or depression.

Was assessed using the self report family tree method [46]. A positive family history was defined as reporting having at least one sibling or parent diagnosed with a depressive disorder, an anxiety disorder, or both.

Negative life events.

That occurred during baseline and the two years follow-up session were indexed using the Brugha questionnaire [47]. This questionnaire assessed the occurrence of twelve negative life events such as illness or injuries to the self or close friends and relatives, loss of friends, relatives or partners, loss of job or housing, and being victimized by theft or assault.

Depressive symptoms.

Were assessed with the 30-item Inventory of Depression Symptomatology – Self Report (IDS-SR) [48]. Each item is presented as four statements regarding the severity of a symptom, which are associated with scores ranging from 0 to 3.

Neuroticism.

Was assessed with the NEO-FFI [49]. The neuroticism scale consists of twelve items that index the tendency to experience negative emotional states. Items were scores on a 5-point Likert scale ranging from ‘strongly disagree’ (0) to ‘strongly agree’ (4).

Procedure

Baseline measures were assessed within a single 3 to 5 hours session. The follow-up measures (CIDI and Brugha) were again assessed within a single session, two years following baseline [32].

Ethics Statement

The protocol for the NESDA study was approved by the Ethical Review Board of the Vrije Universiteit Medical Centre in Amsterdam (VUMC), as well as by the review boards of the participating medical centers (Leiden University Medical Center (LUMC) and University Medical Center Groningen (UMCG)). All participants received full verbal and written information about the study, and written informed consent was obtained at the start of baseline assessment. Participants received a 15-euro gift certificate and compensation of travel costs [32].

Statistical Analyses

Binary logistic regression.

Was used to assess predictive values for the incidence of depressive disorders over the course of the two-years. Following bivariate analyses for each of the predictor variables, multivariate binary logistic regression was used to assess the combined prognostic value of the variables. Age, sex, years of education, history of anxiety disorders, family history of anxiety and/or depression, number of negative life events between baseline and outcome measurement (NLE), baseline depressive symptom level (IDS-SR), and neuroticism (NEO-FFI subscale) were entered in a first block. Implicit self-depressed associations and cognitive reactivity were added in respectively blocks 2a and 2b. The third and final block contained all variables. Regression outcomes are presented as odds ratios and their associated 95% confidence intervals. Odds ratios represent the change in probability of the outcome event to occur, associated with a single unit increase on the predictor’s scale.

Predictor probability plots.

Were drawn to provide an additional impression of the possible clinical usefulness for all continuous predictors that were found to be significantly associated with depression incidence in the bivariate analyses. These were based on the regression formula:

Using values for β derived from bivariate binary logistic regression analyses, the values x on the instrument’s scale associated with.00,.25,.50,.75, and 1.00 predicted probability of depression incidence are represented on the x-axis.

Results

Participant Flow

The NESDA cohort (n = 2,981) contained 1,008 individuals who had never experienced a depressive disorder at baseline. Of these, 174 persons had missing data on one or more measures and were excluded from the sample: LEIDS-r scores were missing for 85 participants, IAT for 24, and baseline severity or personality measures for 12 participants. Ninety participants dropped out following baseline, thus for these no information on the outcome measure of depression incidence was available.

Consequently, 834 participants were included in the present analyses: 596 were recruited from primary care, 76 from specialized mental health care, and 162 from the general population.

Analyses of Drop-outs

In- and excluded participants were compared on all variables used in the analysis, plus recruitment origin (general population, primary, or mental health care). The excluded group differed significantly from the included group on variables years of education (t(1006) = −2.405, p = .016), IDS-SR (t(1000) = 3.132, p = .002), neuroticism (t(1002) = 2.296, p = .022), and the presence of a lifetime anxiety diagnosis (χ2(1) = 11.619, p = .001). A previous paper, reporting analyses of attrition over this period in detail, indicated that within the entire NESDA sample lower education and higher baseline symptoms were associated with attrition [50]. Importantly, the in- and excluded participants did not differ significantly with respect to the main variables of interest, cognitive reactivity (t(921) = −1.42, p = .155), and implicit self depressed associations (t(981) = −.189, p = .850). A trend towards a difference was found on depression incidence (χ2(1) = 3.48, p = .061), in line with an association between higher baseline symptom levels and attrition. See supplementary table S1 for all comparisons between in- and excluded participants.

Main Analyses

Demographic and clinical characteristics at baseline for groups with and without depressive disorder at follow-up are presented in table 1.

The correlations between depression incidence and all predictor variables were calculated (see table S2). The largest correlation (rs = .73) was found between neuroticism (NEO-FFI) and baseline depressive symptom levels (IDS-SR). Most other correlations were significant but small to moderate in size (rs = .04 – rs = .57). Therefore multicollinearity was unlikely, which was confirmed by inspection of the variance inflation factor values, which ranged from 1.03 to 2.66.

Bivariate binary regression analyses showed that, as single predictors, most variables, including cognitive reactivity and implicit self-depressed associations, were significantly associated with first-onset of depressive disorder, see table 2.

thumbnail
Table 2. Bivariate binary logistic regression for depression incidence.

https://doi.org/10.1371/journal.pone.0070245.t002

Predictor probability plots are presented in the supplementary materials (figure S1) for the bivariately associated continuous measures. From these probability plots it can be assessed that baseline symptom levels (IDS-SR), cognitive reactivity (LEIDS-R), and to a lesser extent the number of negative life events, perform relatively well in predicting depression incidence.

The third and final block of the multivariate binary logistic regression analysis is presented in table 3 (for the entire multivariate analysis see table S3). Within this model, baseline depressive symptom levels (IDS), cognitive reactivity (CR), and the number of negative life events during the study period (NLE) were significant predictors of depressive disorder incidence over the course of two years. Implicit self-depressed associations were not found to be predictive of first onset of depressive disorders when other predictors were controlled for.

thumbnail
Table 3. Multivariate binary logistic regression for depression incidence – final block.

https://doi.org/10.1371/journal.pone.0070245.t003

Additional Analyses

Previous papers assessing the predictive validity of self-depressed associations also assessed explicit self-depressed associations [30]. Adding a block 2c, containing the baseline predictors plus explicit self-depressed associations, did not yield a significant outcome for explicit self-depressed associations (OR = 0.90 [0.66–1.22] n.s., block 2c χ2 = .45, n.s.), nor did adding this predictor to block 3. Other studies hypothesized and found effects pertaining to specific subscales of the LEIDS-R [40]. We assessed our model with LEIDS-R total score replaced by each of the six subscales. The control/perfectionism, risk avoidance, and the rumination subscales were significant predictors within the model. The models containing the risk avoidance or rumination subscale may explain slightly more variance than the model containing the LEIDS-R total scale (model χ2 were 120.99 (risk avoidance), and 120.42 (rumination), versus 117.90 (LEIDS-R total)). These differences are small and it is not possible to formally test whether the fit of two non-nested models differ significantly.

Discussion

The current study assessed the two-year prognostic value for depression incidence of two, prospectively assessed, cognitive risk factors in a large population-based sample. As single predictors, cognitive reactivity and implicit self-depressed associations were significantly associated with depression incidence. When other predictors were taken into account, cognitive reactivity remained associated with depression incidence. Contrary to our hypothesis, implicit self-depressed associations did not. In the multivariate model, baseline depressive symptoms and the number of negative life events between baseline and follow-up were also significantly associated. These measures predicted depression onset over predictors such as neuroticism and the lifetime presence of an anxiety disorder.

The LEIDS-R does not assess the current activation of negative cognitions, but rather an individual’s assessment of the extent to which these become more activated during sad mood. This is a crucial difference if one wants to test the assumption that latent negative cognitions predict depression incidence [14]. The current findings support cognitive models stating that certain depression-related cognitions precede first onset of depression. Contrary to our hypothesis, implicit self-depressed associations did not contribute to the prediction in the multivariate analysis. Previous NESDA studies reported stronger self-depressed associations in remitted depressed individuals [27], and a positive relationship between the number of prior episodes and the strength of individuals’ self-depressed associations [51]. Combined with the current result, this suggests that implicit self-depressed associations may not precede first-onset depression, but rather represent a cognitive scar that emerges in response to a depressive episode, rendering remitted patients more vulnerable for new depressive episodes.

Both baseline depressive symptoms and cognitive reactivity significantly add to the multivariate model, despite their moderate correlation of.52. This indicates that these two measures assess distinctive constructs, at least to a certain degree. Neuroticism, an established predictor of depression risk, did not significantly add to the prediction, probably due to shared variance with baseline symptom levels. The correlation between these two measures was.73. Shared variance between implicit self-depressed associations and baseline depressive symptoms may also account for the finding that implicit self-depressed associations do not add to the prediction of depressive incidence in the multivariate model, even though the (highly significant) correlation was only −.28.

To get an impression of the possible prognostic usability of the assessed instruments, graphical displays of the predictions derived from the bivariate regression analysis were provided in the supplementary material (figure S1). These were based on bivariate analyses, as we were interested to assess predictions derived from single instruments. Visual inspection makes it clear that cognitive reactivity (LEIDS-R) is relatively well suited to discern amongst levels of incidence probability.

A main limitation of these findings is limited generalizability. It should be noted that the NESDA sample is a ‘risk enriched’ sample, recruited in a large part among depressive and anxious patients [32]. This may explain the relatively high incidence of 10%, considering that the 12-month incidence of MDD in the Netherlands has been estimated at 2.7% [52]. This may also explain why a family history of anxiety and/or depression was reported by as many as 72% of our sample.

The current study tested the hypothesis that two cognitive measures predict depression incidence over a two-year period. From a theoretical perspective it would be interesting to assess the prognostic value of cognitive measures over a longer period. The currently presented two-year prediction may, however, be more interesting from a practical clinical perspective.

In conclusion, cognitive reactivity to sad mood was associated with the incidence of depressive disorders. This association remained when various other risk factors of depression are controlled for. Implicit self-depressed associations were also significant predictors of depression incidence, but only when bivariately tested.

Supporting Information

Figure S1.

Predicted probability plots. Derived from bivariate regression analyses. Grey areas represent 95% confidence intervals. For questionnaires, the x-axis extends the possible range. For the measures education and implicit self-depressed associations, the observed range is represented on the x-axis. Note that a history of anxiety diagnoses was also found to be significantly associated with depression incidence, yet, being a dichotomous variable, not represented here.

https://doi.org/10.1371/journal.pone.0070245.s001

(DOC)

Table S1.

Comparison of in- and excluded participants on demographic and clinical variables. * several participants had missing data on more than one measure, hence the numbers do not add up to the total of 174 participants excluded. DD = depressive disorder, MDD = major depressive disorder, family history = family history of anxiety and/or depressive disorders, NLE = negative life events, IDS-SR = Inventory of Depressive Symptomatology – Self Report; Neuroticism = neuroticism subscale of the NEO-FFI; ISDA = implicit self-depressed associations (IAT); CR = Cognitive Reactivity (LEIDS-R).

https://doi.org/10.1371/journal.pone.0070245.s002

(DOCX)

Table S2.

Correlation matrix. * = p≤.05; ** = p≤.01; *** = p≤.001. DD incidence = incidence of depressive disorders, family history = family history of anxiety and/or depression, NLE = Negative Life Events; IDS-SR = Inventory of Depressive Symptomatology – Self Report; Neuroticism = neuroticism subscale of the NEO-FFI; ISDA = Implicit Self-Depressed Associations (IAT); CR = Cognitive Reactivity (LEIDS-R).

https://doi.org/10.1371/journal.pone.0070245.s003

(DOCX)

Table S3.

Multivariate binary logistic regression for depression incidence. OR = Odds Ratio; 95% CI = 95% confidence interval. NLE = Negative Life Events; IDS-SR = Inventory of Depressive Symptomatology – Self Report; Neuroticism = neuroticism subscale of the NEO-FFI; ISDA = Implicit Self-Depressed Associations (IAT); CR = Cognitive Reactivity (LEIDS-R).

https://doi.org/10.1371/journal.pone.0070245.s004

(DOCX)

Acknowledgments

The authors thank Gjalt-Jorn Peters for his help writing the R syntax for the predictor probability plots. The infrastructure for the NESDA study (www.nesda.nl) is funded through the Geestkracht program of the Netherlands Organisation for Health Research and Development (Zon-Mw, grant number 10-000-1002) and is supported by participating universities and mental health care organizations (VU University Medical Center, GGZ inGeest, Arkin, Leiden University Medical Center, GGZ Rivierduinen, University Medical Center Groningen, Lentis, GGZ Friesland, GGZ Drenthe, Scientific Institute for Quality of Healthcare (IQ healthcare), Netherlands Institute for Health Services Research (NIVEL) and Netherlands Institute of Mental Health and Addiction (Trimbos Institute).

1 Depressed: useless, pessimistic, inadequate, negative, meaningless (Dutch: nutteloos, pessimistisch, ongeschikt, negatief, zinloos). Elated: positive, optimistic, active, valuable, cheerful (Dutch: positief, optimistisch, actief, waardevol, opgewekt). Me: I, myself, self, my, own (Dutch: ik, mezelf, zelf, mijn, eigen). Others: other, you, them, their, themselves (Dutch: ander, jullie, zij, hun, zijzelf).

Author Contributions

Conceived and designed the experiments: LB BP PdJ WVdD. Performed the experiments: BP PdJ KG WVdD. Analyzed the data: AWK. Contributed reagents/materials/analysis tools: BP PdJ KG WVdD. Wrote the paper: AWK. Critically reviewed the manuscript: WVdD NA LB PdJ KG BP.

References

  1. 1. Beck AT (1967) Depression: Causes and treatment. Philadelphia: University of Pennsylvania Press.
  2. 2. Evans MD, Hollon SD, Derubeis RJ, Piasecki JM, Grove WM, et al. (1992) Differential Relapse Following Cognitive Therapy and Pharmacotherapy for Depression. Arch Gen Psychiatry 49: 802–808.
  3. 3. Fava GA, Rafanelli C, Grandi S, Canestrari R, Morphy MA (1998) Six-year outcome for cognitive behavioral treatment of residual symptoms in major depression. Am J Psychiat 155: 1443–1445.
  4. 4. Friedman MA, Detweiler-Bedell JB, Leventhal HE, Home R, Keitner GI, et al. (2004) Combined Psychotherapy and Pharmacotherapy for the Treatment of Major Depressive Disorder. Clin Psychol 11: 47–68.
  5. 5. Paykel ES (2007) Cognitive therapy in relapse prevention in depression. Int J Neuropsychopharmacol 10: 131–136.
  6. 6. Just N, Abramson LY, Alloy LB (2001) Remitted depression studies as tests of the cognitive vulnerability hypotheses of depression onset: A critique and conceptual analysis. Clin Psychol Rev 21: 63–83.
  7. 7. Hamilton EW, Abramson LY (1983) Cognitive patterns and major depressive disorder: A longitudinal study in a hospital setting. J Abnorm Psychol 92: 173–184.
  8. 8. Silverman J, Silverman J, Eardley DA (1984) Do maladaptive attitudes cause depression? Arch Gen Psychiatry 41: 28–30.
  9. 9. Simons AD, Garfield SL, Murphy GE (1984) The process of change in cognitive therapy and pharmacotherapy for depression: Changes in mood and cognition. Arch Gen Psychiatry 41: 45–51.
  10. 10. Lewinsohn PM, Steinmetz JL, Larson DW, Franklin J (1981) Depression-related cognitions: Antecedent or consequence? J Abnorm Psychol 90: 213–219.
  11. 11. LaGrange B, Cole DA, Jacquez F, Ciesla J, Dallaire D, et al. (2011) Disentangling the prospective relations between maladaptive cognitions and depressive symptoms. J Abnorm Psychol 120: 511–527.
  12. 12. Alloy LB, Abramson LY, Whitehouse WG, Hogan ME, Panzarella C, et al. (2006) Prospective incidence of first onsets and recurrences of depression in individuals at high and low cognitive risk for depression. J Abnorm Psychol 115: 145–156.
  13. 13. Evans J, Heron J, Lewis G, Araya R, Wolke D (2005) Negative self-schemas and the onset of depression in women: longitudinal study. Br J Psychiatry 186: 302–307.
  14. 14. Scher CD, Ingram RE, Segal ZV (2005) Cognitive reactivity and vulnerability: Empirical evaluation of construct activation and cognitive diatheses in unipolar depression. Clin Psychol Rev 25: 487–510.
  15. 15. Persons JB, Miranda J (1992) Cognitive theories of vulnerability to depression: Reconciling negative evidence. Cognit Ther Res 16: 485–502.
  16. 16. Teasdale JD (1988) Cognitive Vulnerability to Persistent Depression. Cogn Emot 2: 247–274.
  17. 17. Merens W, Booij L, Van Der Does AJW (2008) Residual cognitive impairments in remitted depressed patients. Depression and Anxiety 25: 27–36.
  18. 18. Miranda J, Gross JJ, Persons JB, Hahn J (1998) Mood Matters: Negative Mood Induction Activates Dysfunctional Attitudes in Women Vulnerable to Depression. Cognit Ther Res 22: 363–376.
  19. 19. Van der Does AJW (2005) Thought suppression and cognitive vulnerability to depression. Br J Clin Psychol 44: 1–14.
  20. 20. Miranda J, Persons JB (1988) Dysfunctional attitudes are mood-state dependent. J Abnorm Psychol 97: 76–79.
  21. 21. Segal ZV, Gemar M, Williams S (1999) Differential cognitive response to a mood challenge following successful cognitive therapy or pharmacotherapy for unipolar depression. J Abnorm Psychol 108: 3–10.
  22. 22. Booij L, Van der Does AJW (2007) Cognitive and serotonergic vulnerability to depression: Convergent findings. J Abnorm Psychol 116: 86–94.
  23. 23. Antypa N, Van der Does AJW (2010) Serotonin transporter gene, childhood emotional abuse and cognitive vulnerability to depression. Genes Brain Behav 9: 615–620.
  24. 24. Segal ZV, Kennedy S, Gemar M, Hood K, Pedersen R, et al. (2006) Cognitive Reactivity to Sad Mood Provocation and the Prediction of Depressive Relapse. Arch Gen Psychiatry 63: 749–755.
  25. 25. Greenwald AG (1998) Measuring individual differences in implicit cognition: the implicit association test. J Pers Soc Psychol 74: 1464.
  26. 26. Greenwald AG, Farnham SD (2000) Using the Implicit Association Test to measure self-esteem and self-concept. J Pers Soc Psychol 79: 1022.
  27. 27. Glashouwer KA, de Jong PJ (2009) Disorder-specific automatic self-associations in depression and anxiety: results of The Netherlands Study of Depression and Anxiety. Psychol Med 40: 1101–1111.
  28. 28. van Harmelen A-L, de Jong PJ, Glashouwer KA, Spinhoven P, Penninx BWJH, et al. (2010) Child abuse and negative explicit and automatic self-associations: The cognitive scars of emotional maltreatment. Behav Res Ther 48: 486–494.
  29. 29. Glashouwer KA, de Jong PJ, Penninx BWJH, Kerkhof AJFM, van Dyck R, et al. (2010) Do Automatic Self-Associations Relate to Suicidal Ideation? J Psychopathol Behav Assess 32: 428–437.
  30. 30. Glashouwer KA, de Jong PJ, Penninx BWJH (2012) Prognostic value of implicit and explicit self-associations for the course of depressive and anxiety disorders. Behav Res Ther 50: 479–486.
  31. 31. Spinhoven P, Elzinga BM, Hovens JGFM, Roelofs K, Zitman FG, et al. (2010) The specificity of childhood adversities and negative life events across the life span to anxiety and depressive disorders. J Affect Disord 126: 103–112.
  32. 32. Penninx BWJH, Beekman ATF, Smit JH, Zitman FG, Nolen WA, et al. (2008) The Netherlands Study of Depression and Anxiety (NESDA): rationale, objectives and methods. Int J Methods Psychiatr Res 17: 121–140.
  33. 33. American Psychiatric Association (2000) Diagnostic and statistical manual of mental disorders (4th ed., text rev.).
  34. 34. Van der Does AJW, Williams JMG (2003) Leiden Index of Depression Sensitivity - Revised (LEIDS-R). Leiden University.
  35. 35. Van der Does AJW (2002) Cognitive reactivity to sad mood: structure and validity of a new measure. Behav Res Ther 40: 105–120.
  36. 36. Moulds ML, Kandris E, Williams AD, Lang T, Yap C, et al. (2008) An Investigation of the Relationship between Cognitive Reactivity and Rumination. Behav Ther 39: 65–71.
  37. 37. Klok MD, Giltay EJ, Van der Does AJW, Geleijnse JM, Antypa N, et al. (2011) A common and functional mineralocorticoid receptor haplotype enhances optimism and protects against depression in females. Transl Psychiatry 1: e62.
  38. 38. Verhoeven FEA, Booij L, Kruijt AW, Cerit H, Antypa N, et al. (2012) The effects of MAOA genotype, childhood trauma, and sex on trait and state-dependent aggression. Brain and Behavior 2: 806–813.
  39. 39. Raes F, Dewulf D, Van Heeringen C, Williams JMG (2009) Mindfulness and reduced cognitive reactivity to sad mood: Evidence from a correlational study and a non-randomized waiting list controlled study. Behav Res Ther 47: 623–627.
  40. 40. Antypa N, Van der Does AJW, Penninx BWJH (2010) Cognitive reactivity: Investigation of a potentially treatable marker of suicide risk in depression. J Affect Disord 122: 46–52.
  41. 41. Williams JMG, Van der Does AJW, Barnhofer T, Crane C, Segal ZV (2008) Cognitive reactivity, suicidal ideation and future fluency: preliminary investigation of a differential activation theory of hopelessness/suicidality. Cognit Ther Res 32: 83–104.
  42. 42. Giesbrecht T, Abidi K, Smeets T, Merckelbach H, Oorsouw K, et al. (2009) Adversity does not always lead to psychopathology:cognitive reactivity is related to longitudinal changes in resilience. Netherlands Journal of Psychology 65: 62–68.
  43. 43. Greenwald AG, Farnham SD (2000) Using the Implicit Association Test to measure self-esteem and self-concept. J Pers Soc Psychol 79: 1022–1038.
  44. 44. Greenwald AG, Nosek BA, Banaji MR (2003) Understanding and using the Implicit Association Test: I. An improved scoring algorithm. J Pers Soc Psychol 85: 197–216.
  45. 45. Glashouwer KA, Smulders FTY, de Jong PJ, Roefs A, Wiers RWHJ (2013) Measuring automatic associations: Validation of algorithms for the Implicit Association Test (IAT) in a laboratory setting. J Behav Ther Exp Psychiatry 44: 105–113.
  46. 46. Fyer AJ, Weissman MM (1999) Genetic linkage study of panic: clinical methodology and description of pedigrees. Am J Med Genet 88: 173–181.
  47. 47. Brugha TS, Bebbington P, Tennant C, Hurry J (1985) The List of Threatening Experiences: a subset of 12 life event categories with considerable long-term contextual threat. Psychol Med 15: 189–194.
  48. 48. Rush AJ, Gullion CM, Basco MR, Jarrett RB, Trivedi MH (1996) The inventory of depressive symptomatology (IDS): psychometric properties. Psychol Med 26: 477–486.
  49. 49. Costa PT, McCrae RR, Psychological Assessment Resources I (1992) Revised neo personality inventory (neo pi-r) and neo five-factor inventory (neo-ffi): Psychological Assessment Resources Odessa, FL.
  50. 50. Lamers F, Hoogendoorn AW, Smit JH, van Dyck R, Zitman FG, et al. (2012) Sociodemographic and psychiatric determinants of attrition in the Netherlands Study of Depression and Anxiety (NESDA). Compr Psychiatry 53: 63–70.
  51. 51. Elgersma HJ, Glashouwer KA, Bockting CLH, Penninx BW, De Jong PJ (submitted for publication) Hidden Scars in Depression: Implicit and Explicit Self-Associations in Recurrence of Depression.
  52. 52. Bijl RV, De Graaf R, Ravelli A, Smit F, Vollebergh WA (2002) Gender and age-specific first incidence of DSM-III-R psychiatric disorders in the general population Results from the Netherlands Mental Health Survey and Incidence Study (NEMESIS). Soc Psychiatry Psychiatr Epidemiol 37: 372–379.