Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Indicators of patients with major depressive disorder in need of highly specialized care: A systematic review

Abstract

Objectives

Early identification of patients with major depressive disorder (MDD) that cannot be managed by secondary mental health services and who require highly specialized mental healthcare could enhance need-based patient stratification. This, in turn, may reduce the number of treatment steps needed to achieve and sustain an adequate treatment response. The development of a valid tool to identify patients with MDD in need of highly specialized care is hampered by the lack of a comprehensive understanding of indicators that distinguish patients with and without a need for highly specialized MDD care. The aim of this study, therefore, was to systematically review studies on indicators of patients with MDD likely in need of highly specialized care.

Methods

A structured literature search was performed on the PubMed and PsycINFO databases following PRISMA guidelines. Two reviewers independently assessed study eligibility and determined the quality of the identified studies. Three reviewers independently executed data extraction by using a pre-piloted, standardized extraction form. The resulting indicators were grouped by topical similarity, creating a concise summary of the findings.

Results

The systematic search of all databases yielded a total of 7,360 references, of which sixteen were eligible for inclusion. The sixteen papers yielded a total of 48 unique indicators. Overall, a more pronounced depression severity, a younger age of onset, a history of prior poor treatment response, psychiatric comorbidity, somatic comorbidity, childhood trauma, psychosocial impairment, older age, and a socioeconomically disadvantaged status were found to be associated with proxies of need for highly specialized MDD care.

Conclusions

Several indicators are associated with the need for highly specialized MDD care. These indicators provide easily measurable factors that may serve as a starting point for the development of a valid tool to identify patients with MDD in need of highly specialized care.

Introduction

Major depressive disorder (MDD) is one of the most prevalent psychiatric disorders [1,2] and is projected to be the leading cause of disease burden in high-income countries by 2030 [3]. MDD presents many treatment challenges, not the least of which is the subset of patients with depression that is refractory to secondary mental health services. Often, these patients receive inadequate, too low-intensity treatment in secondary mental health services [47], which is associated with a longer treatment course [8], an increased risk of suicide [911] and substantial societal costs [12,13].

Early identification of patients with MDD who cannot be managed by secondary services and require highly specialized care could enhance need-based patient stratification. This, in turn, may reduce the number of treatment steps needed to achieve and sustain an adequate treatment response, and may subsequently benefit the quality of life of patients. To date, validated tools to facilitate need-based patient stratification are rarely used in psychiatric practice. This is in marked contrast to other areas of medicine such as oncology [1418], in which patient stratification on the basis of clinical presentation plays an important role in treatment planning from the time of diagnosis.

The development of a validated tool to identify patients with MDD in need of highly specialized care during the diagnostic phase after referral is hampered by the lack of a comprehensive understanding of the indicators that distinguish patients with and without a need for highly specialized MDD care. There are several reviews available which summarize the studies on factors associated with a recurrent or persistent clinical course [1922] for which more intensive treatment is indicated [23]. However, to date none have focused on the factors associated with a broad range of unfavourable clinical outcomes, thereby preventing the construction of an overall picture of the indicators of patients with MDD in need of highly specialized care. Therefore, the aim of this study is to systematically review studies on indicators of patients with MDD likely in need of highly specialized care.

Methods

Definition of terms

For the purpose of this study, primary mental healthcare is defined as the care provided to people with mental health problems within the primary care setting. Secondary mental healthcare is delivered primarily through community mental health services and psychiatric services in general hospitals, and refers to the more specialized support provided to patients with mental health needs that cannot be supported by primary care services [24]. Highly specialized mental healthcare, also commonly referred to as tertiary mental healthcare, is defined as specialized intervention delivered by highly-trained staff with specific expertise in a given field to individuals with problems that cannot be treated with sufficient result by either primary or secondary mental health services [25,26]. Finally, the term indicators is used to refer to clinical characteristics and risk factors that may aid clinicians in the identification of the subgroup of patients with MDD likely in need of highly specialized care.

Expert input and proxy indicators of need for highly specialized MDD care

Prior to performing the structured literature search, the Decision Tool Unipolar Depression Consortium was formed comprising thirteen leading MDD experts from six independent psychiatric specialized and highly specialized mental healthcare clinics across the Netherlands. The consortium of experts assisted with refining the research question and provided guidance for the conduct of the literature search. In the absence of studies directly examining clinical and sociodemographic factors associated with a need for highly specialized MDD care, proxy indicators had to be identified. In a digital survey, consortium members and a number of other qualified domain experts were asked to define terms by which (the clinical course of) patients with MDD in need of highly specialized care can be described (hereafter named proxy indicators of need for highly specialized MDD care). All domain experts were required to have specialist expertise regarding the research question, as evidenced by the fact that they were either active as a clinician or researcher in the field of depression. Ultimately, via existing national depression networks, 134 experts were approached, 67 of whom participated in the study. After an analysis of the concepts submitted by the experts, four high-frequency proxy indicators of need for highly specialized MDD care were selected. The proxy indicators of need for highly specialized MDD care that were selected for the purpose of this review include: "Treatment-Resistant", "Chronic", "Recurrent", and "Persistence of Severity".

Eligibility criteria

Studies were selected for review if they met the following inclusion criteria:

  1. Published in English or Dutch, related to humans and full-text was available
  2. Published between January 2000 and January 2015
  3. The study design was either a randomized controlled trial, case-control study, cross-sectional study or cohort study
  4. The study was an investigation of (a group of) adult psychiatric patients (aged 18 and over) with MDD as their primary diagnosis according to the Diagnostic and Statistical Manual of Mental Disorders (DSM)-III [27], DSM-III-R [28], DSM-IV [29], DSM-IV-TR [30], DSM-5 [31], International Classification of Diseases (ICD)-9 [32], ICD-10 [33] or Research Diagnostic Criteria (RDC) [34]
  5. The main outcome variable used was one of the four following proxy indicators of need for highly specialized MDD care: "Treatment-Resistant", "Chronic", "Recurrent", and "Persistence of Severity"
  6. One of the aims of the study was to identify clinical and/or sociodemographic factors that discriminate MDD patients with a proxy of need for highly specialized care (i.e. "cases") from those without a proxy indicator of need for highly specialized care (i.e. "non-cases")

This study is restricted to indicators of patients with MDD in need of highly specialized care, which can be assessed during the diagnostic phase after referral. Hence, no papers that solely reported on physiological, neurobiological, or genetic factors were eligible for inclusion. Furthermore, since the aim was to identify indicators of patients with an unfavourable treatment course treated in secondary mental health services who may benefit from highly specialized care, we excluded studies focusing exclusively on participants from primary care populations or the general population.

Data sources and search strategy

To identify studies reporting indicators of patients with MDD in need of highly specialized care, a structured literature search was performed on the PubMed (National Library of Medicine) and PsycINFO (Ovid) databases following PRISMA guidelines [17]. The search for published primary articles was conducted on January 15, 2015 and was restricted to articles written in English or Dutch, published between January 1, 2000 and January 15, 2015, related to humans and of which the full text was available. Search terms were chosen based on the proxy indicators of need for highly specialized MDD care as defined by domain experts. The Medical Subject Headings (MeSH) of relevance to this review included the following search terms: "depressive disorder", "depression" and "depressive disorder, treatment-resistant". In addition, keywords were searched within the title or full-text. Keywords included: "chronic", "chronic depression", "chronicity", "recurrent", "recurrent depression", "recurring", "severe", "severe depression" and "severity". A complete list of search strategies can be found in the S1 Tables. We did not register a systematic review protocol.

Study selection

Prior to examining all articles identified through the primary search, two reviewers independently screened a random sample of 66 titles and abstracts whilst blinded to authors and journal titles, and reached strong agreement (Cohen's κ = 0.85) using an Excel workbook designed for this purpose [35]. They then independently screened all records whilst still blinded to authors and journal titles. Full papers were retrieved for all references that had been judged as potentially eligible and were examined independently by two researchers. Disagreements were resolved by discussion or through third party adjudication.

Data abstraction

Three reviewers independently executed data extraction by using an Excel-based, pre-piloted, standardized extraction form. Disagreements were resolved by discussion between the three reviewers. The following characteristics of the studies were coded: (1) general study characteristics (author, year of publication, country); (2) characteristics of the study population (sample size, age of inclusion, mean age, number of MDD patients with and without a proxy of need for highly specialized care); (3) design of the study (case-control, cross-sectional or longitudinal); (4) depression measure and proxy of need for highly specialized MDD care (e.g. treatment-resistant, recurrence); (5) clinical and/or sociodemographic factors on which MDD patients with and without a proxy of need for highly specialized care significantly differed. If results from a multivariable regression analysis were available, then those findings were included rather than bivariate results. If results from several regression models were presented, only results from the model with the largest number of predictors were used. The purpose of this review was to identify, rather than quantify, the factors associated with proxies of need for highly specialized care. Thus, a meta-analysis was not performed and data were synthesized in a narrative review. In a consensus-building process, the experts categorized the abstracted indicators by topical similarity, creating a concise summary of the findings. The resulting categories were identified as the overarching indicators of patients with MDD in need of highly specialized care, provided that the direction of association between the indicators grouped within the category and proxies of need for highly specialized care was consistent. Within the categories grouping indicators with opposite directions (e.g. low and high educational level), subcategories of indicators with a consistent direction of association were identified as the indicators of patients with MDD in need of highly specialized care.

Quality assessment

Two reviewers independently evaluated the methodological quality of the included studies using the 14-item National Heart, Blood and Lung Institute (NHBLI) Quality Assessment Tool for Observational Cohort and Cross-Sectional Studies [36] or the 12-item NHBLI Quality Assessment Tool for Case-Control Studies [37]. Each of the items was scored as "yes", "no", "not reported" or "not applicable" on the basis of the information provided in the article. Disagreements were resolved by discussion or through third party adjudication. A quality score, expressed as a percentage of the maximum possible score, was calculated for each study.

Results

Study selection

The systematic search of all databases yielded a total of 7,360 references. Duplicates were checked and excluded (n = 1,388). Title and abstract screening resulted in the exclusion of a further 5,917 papers. Main reasons for exclusion were that papers: had a design other than a randomized controlled trial, case-control study, cross-sectional study or cohort study; had an initial population or control group other than subjects with MDD as their primary diagnosis; had an aim other than the identification of clinical and/or sociodemographic factors that discriminate patients on the basis of a proxy of need for highly specialized care. Full texts of the remaining 55 papers were obtained for detailed review. Thirty-nine papers were excluded following full text screening. Sixteen papers fulfilled the eligibility criteria and were incorporated into this review. Details of the study selection process are provided in Fig 1.

thumbnail
Fig 1. Flow chart of study selection process.

RCT, Randomized controlled trial; MDD, major depressive disorder; DSM, Diagnostic and Statistical Manual of Mental Disorders; ICD, International Classification of Diseases.

https://doi.org/10.1371/journal.pone.0171659.g001

Study characteristics

The general characteristics of the included papers are presented in Table 1. Six papers focused on treatment-resistant depression [3843], four on chronic depression [4447], five on recurrence in depression [4852], and one on persistence of severity [53]. The vast majority of included papers utilized cross-sectional data. Most of the included studies were conducted in the United States (n = 5) and Europe (n = 8) with the remainder in Asia (n = 3).

thumbnail
Table 1. General characteristics of the included studies.

https://doi.org/10.1371/journal.pone.0171659.t001

Methodological quality of the included studies

The overall quality scores are presented in Table 1; quality scores for the separate NHBLI criteria are shown in the S2 Tables. The overall quality scores ranged from 36% ([4143]) to 86% ([48]). The main issues with included articles were the lack of sample size justification and the lack of repeated exposure assessment. The research question and study population were clearly defined in the majority of the included studies.

Indicators of need of highly specialized care

Table 2 lists the indicators of patients with a depression in need of highly specialized care. The sixteen papers yielded a total of 48 unique clinical and sociodemographic factors on which MDD patients with and without a proxy of need for highly specialized care significantly differed. In general, the abstracted clinical and sociodemographic factors could be grouped into the following seven categories: depression severity, onset and (treatment) course, comorbid psychopathology, somatic comorbidity, childhood trauma, psychosocial functioning, and sociodemographics. Each of the abstracted indicators will be discussed in the following sections.

thumbnail
Table 2. Indicators of patients with a depression in need of highly specialized care.

https://doi.org/10.1371/journal.pone.0171659.t002

Depression severity.

A more pronounced depression severity, whether operationalized by the number or type of symptoms, has consistently been shown to be associated with proxies of need for highly specialized MDD care. Three studies reported a correlation between higher levels of (baseline [53]) depressive symptomatology and proxies of need for highly specialized MDD care [46,48]. In addition, the presence of certain symptoms such as current suicidal risk [39], an increased likelihood of melancholic features [39], and higher levels of rumination [47] were found to be associated with proxies of need for highly specialized MDD care.

Onset and (treatment) course.

Patients with a proxy of need for highly specialized care were found to have an earlier age of onset of the first major depressive episode [41,51], and subsequently reported a longer time since first onset of MDD [51]. In addition, factors denoting a history of poor treatment response such as nonresponse to first antidepressant received [39], and lack of remission or partial remission after the previous depressive episode [41] were found to be associated with proxies of need for highly specialized care. Inconsistent results were found for the number of prior episodes of depression [41,45].

Comorbid psychopathology.

There have been several studies that examined the association between comorbid psychopathology and proxies of need for highly specialized care. Melartin et al. [48] found that the presence of a higher number of comorbid psychiatric disorders in general increases the risk of recurrence. In addition, the following specific comorbid psychiatric disorders were found to be associated with proxies of need for highly specialized care: chronic PTSD [38], (generalized [45]) anxiety disorder [38,39,46], and more symptoms of bipolarity [41]. Furthermore, relations between psychopathological dimensional personality traits and proxies of need for highly specialized care have been found repeatedly. In two closely related articles, Takahashi et al. [42,43] reported that high scores for harm avoidance, low scores for reward dependence, low scores for self-directedness, and low scores for extraversion are personality dimensions in patients with treatment-resistant depression. In addition, Kaplan and Klinetob [38] reported that patients with treatment-resistant depression had clinically significant elevations on the Minnesota Multiphasic Personality Inventory-2 (MMPI-2, [54]) subscales hypochondriasis, depression, hysteria, psychopathic deviate, paranoia, psychasthenia, schizophrenia and social introversion. Further, higher levels of impaired autonomy [44], higher levels of disconnection and rejection [44], higher levels of overvigilance [44], higher levels of external locus of control [47], and higher levels of neuroticism [53] have been linked to proxy indicators of need for highly specialized care.

Somatic comorbidity.

Increased general medical comorbidity [45], severe neck, chest and abdominal pain [52], a higher number of pain locations [52] and higher pain severity of pain [52] were found to be associated with proxies of need for highly specialized care. Subsequently, lower levels of physical health function [45] and a lower physical quality of life [45] have been linked to proxy indicators of need for highly specialized care.

Childhood trauma.

Two studies [38,46] examined the relationship between childhood trauma and a proxy indicator of need for highly specialized care. In a sample of 1,230 individuals, Wiersma et al. [46] examined the relationship between retrospective reports of childhood life events and childhood trauma and the risk of chronicity of MDD in adulthood. They found that a reported history of multiple childhood traumas, such as emotional neglect, psychological abuse, physical abuse, and sexual abuse, was associated with chronicity of depression. Kaplan and Klinetob [38] similarly found that patients with treatment-resistant depression reported more emotional abuse and experienced current-day trauma sequelae when compared to treatment responders.

Psychosocial functioning.

Two of the included studies [45,49] reported that patients with a proxy of need for highly specialized care were more likely to exhibit impaired functioning in areas such as work, relationships and leisure. Moreover, a poorer quality of life, as operationalized by the Quality of Life Enjoyment and Satisfaction Questionnaire (QLESQ, [55]), was found to be associated with a proxy of need for highly specialized care [45].

Sociodemographics.

Many studies examined the associations between sociodemographic factors and proxies of need for highly specialized care. Three papers [45,50,51] reported an association between older age and a proxy of need for highly specialized care. In addition, individuals with a proxy of need for highly specialized care were found to be socioeconomically disadvantaged when compared to individuals without a proxy of need for highly specialized care [45]. Contrasting findings were found for educational level. One study [45] reported that patients with a lower level of education exhibited greater chronicity than patients with a higher level of education. By contrast, the study by Bos et al. [50] found the reverse: patients with a history of recurrent depression were more highly educated compared to individuals with a single episode.

Discussion

The aim of this systematic review was to identify indicators of patients with MDD in need of highly specialized care. Overall, a more pronounced depression severity, a younger age of onset, a history of prior poor treatment response, psychiatric comorbidity, somatic comorbidity, childhood trauma, psychosocial impairment, older age, and a socioeconomically disadvantaged status were found to be associated with proxies of need for highly specialized MDD care.

To our knowledge, this is the first systematic literature search that comprehensively covers the factors associated with a broad range of unfavourable clinical outcomes in patients with MDD for which more intensive treatment is indicated [23]. To date, reviews solely summarized factors associated with one of the proxy indicators of need for highly specialized care [1922], thereby preventing the construction of an overall picture of the indicators of patients with MDD in need of highly specialized care. Our systematic and comprehensive review allows the delineation of this subgroup of patients, makes them identifiable, and thus adds to the process of further professionalizing and improving quality in the mental healthcare sector.

This study has several limitations. First, this study does not shed light on the efficacy of highly specialized care in meeting patients' treatment needs. Although highly specialized care has been demonstrated to improve clinical outcomes in patients with complex and severe conditions in other areas of medicine [56], the net benefit of highly specialized care in patients with MDD has not yet been studied. However, the evaluation of the impact of highly specialized care on patient outcomes in this population is of utmost importance and should therefore be addressed in future studies. Second, the focus of this systematic review was to identify indicators that could be easily assessed in routine clinical practice, specifically during the diagnostic phase after referral. This resulted in the exclusion of papers solely reporting on physiological, neurobiological, and genetic patient factors, making it possible that other indicators with strong evidence for a need for highly specialized MDD care have been missed. Third, due to considerable heterogeneity of populations, sample sizes, range of predictors, outcomes and statistical analyses no quantitative synthesis of the results in a meta-analysis could be performed. Fourth, since the aim of this study was to assess the current state of research on indicators of patients with an unfavourable treatment course treated in secondary mental health services who may benefit from highly specialized care, we also included studies with a heterogeneous mixture of patients from the community and from primary and psychiatric care sites, as they contained a subgroup of psychiatric patients. This may have influenced the results, as recent studies suggest that the determinants and nature of the long-term course of depression of subjects from the community and primary sites differentiates from that of patients from psychiatric care sites [5759]. However, an additional qualitative synthesis of the results in the subset of studies exclusively reporting on patients with MDD treated in psychiatric care sites did not alter the results, suggesting that the associations between indicators of need for highly specialized care are similar for psychiatric and non-psychiatric patients.

On the basis of this review, we posit the primary importance of the following nine indicators of patients with MDD in need of highly specialized care: a more pronounced depression severity, a younger age of onset, a history of prior poor treatment response, psychiatric comorbidity, somatic comorbidity, childhood trauma, psychosocial impairment, older age, and a socioeconomically disadvantaged status. It should be noted, however, that these indicators alone are not likely to justify referral to highly specialized mental healthcare programs. Rather, in combination with one another they may provide healthcare practitioners with a guideline for determining the need for highly specialized care. Future research should explore how the identified set of indicators can facilitate the early identification of patients with MDD in need of highly specialized care. In addition, we believe that advances in the development of a valid tool to identify patients with MDD in need of highly specialized care during the diagnostic phase after referral will need to be based on more refined, better operationalized indicators. Furthermore, while the identified indicators have received the strongest support in the literature, this may partly be due to the fact that they have received more research attention. It is therefore possible that other characteristics of patients in need of highly specialized care may theoretically be very important, but have not yet been sufficiently researched. Hence, in accordance with evidence-based medicine [60], this set of characteristics should be critically appraised, refined, and, if necessary, complemented by clinical expertise before applying review findings to clinical practice. The identified set of indicators may therefore serve as a starting point for the development of a valid tool to identify patients with MDD in need of highly specialized care during the diagnostic phase after referral. This may ultimately facilitate early detection and assist clinicians in selecting the most appropriate treatment option in a given clinical situation, thereby reducing the functional impact and socioeconomic burden of MDD.

Acknowledgments

The authors sincerely thank Laura Agterberg, research assistant, for appraising and extracting details of selected articles and checking data.

Members of Decision Tool Unipolar Depression (DTUD) Consortium: A.J.L.M. van Balkom, C.L.H. Bockting, T.M. van den Boogaard, W.J. Broekema, A.E. Thijs van't Hoog, P.A.J.M. Huijs, M.A.J.M. Loo, P. van Oppen, F.P.M.L. Peeters, H.G. Ruhé, D.J.F. van Schaik, J. Spijker, H.L. Van.

Author Contributions

  1. Conceptualization: FK MG AB CB FP LH.
  2. Funding acquisition: LH AB.
  3. Investigation: FK MK MG.
  4. Methodology: FK MG LH.
  5. Project administration: FK MG LH.
  6. Supervision: LH.
  7. Writing – original draft: FK.
  8. Writing – review & editing: MK MG AB CB FP LH.

References

  1. 1. Kessler RC, Angermeyer M, Anthony JC, DE Graaf R, Demyttenaere K, Gasquet I, et al. Lifetime prevalence and age-of-onset distributions of mental disorders in the World Health Organization's World Mental Health Survey Initiative. World Psychiatry. 2007;6: 168–176. pmid:18188442
  2. 2. Kessler RC, Aguilar-Gaxiola S, Alonso J, Chatterji S, Lee S, Ormel J, et al. The global burden of mental disorders: an update from the WHO World Mental Health (WMH) surveys. Epidemiol Psichiatr Soc. 2009;18: 23–33. pmid:19378696
  3. 3. Mathers CD, Loncar D. Projections of Global Mortality and Burden of Disease from 2002 to 2030. PLoS Med. 2006;3.
  4. 4. Boenisch S, Kocalevent RD, Matschinger H, Mergl R, Wimmer-Brunauer C, Tauscher M, et al. Who receives depression-specific treatment? A secondary data-based analysis of outpatient care received by over 780,000 statutory health-insured individuals diagnosed with depression. Soc Psychiatry Psychiatr Epidemiol. 2012;47: 475–486. pmid:21350809
  5. 5. Oquendo MA, Kamali M, Ellis SP, Grunebaum MF, Malone KM, Brodsky BS, et al. Adequacy of antidepressant treatment after discharge and the occurrence of suicidal acts in major depression: a prospective study. Am J Psychiatry. 2002;159: 1746–1751. pmid:12359682
  6. 6. Wang PS, Aguilar-Gaxiola S, Alonso J, Angermeyer MC, Borges G, Bromet EJ, et al. Use of mental health services for anxiety, mood, and substance disorders in 17 countries in the WHO world mental health surveys. 2007;370: 841–850. pmid:17826169
  7. 7. Kocsis JH, Gelenberg AJ, Rothbaum B, Klein DN, Trivedi MH, Manber R, et al. Chronic forms of major depression are still undertreated in the 21st century: Systematic assessment of 801 patients presenting for treatment. J Affect Disord. 2008;110: 55–61. pmid:18272232
  8. 8. Meyers BS, Sirey JA, Bruce M, Hamilton M, Raue P, Friedman SJ, et al. Predictors of early recovery from major depression among persons admitted to community-based clinics: an observational study. Arch Gen Psychiatry. 2002;59: 729–735. pmid:12150649
  9. 9. Isacsson G, Boethius G, Bergman U. Low level of antidepressant prescription for people who later commit suicide: 15 years of experience from a population-based drug database in Sweden. Acta Psychiatr Scand. 1992;85: 444–448. pmid:1642127
  10. 10. Isometsa ET, Henriksson MM, Aro HM, Heikkinen ME, Kuoppasalmi KI, Lonnqvist JK. Suicide in major depression. Am J Psychiatry. 1994;151: 530–536. pmid:8147450
  11. 11. Suominen KH, Isometsa ET, Henriksson MM, Ostamo AI, Lonnqvist JK. Inadequate treatment for major depression both before and after attempted suicide. Am J Psychiatry. 1998;155: 1778–1780. pmid:9842794
  12. 12. Wang PS, Simon G, Kessler RC. The economic burden of depression and the cost-effectiveness of treatment. Int J Methods Psychiatr Res. 2003;12: 22–33. pmid:12830307
  13. 13. Hirschfeld RM, Keller MB, Panico S, Arons BS, Barlow D, Davidoff F, et al. The National Depressive and Manic-Depressive Association consensus statement on the undertreatment of depression. JAMA. 1997;277: 333–340. pmid:9002497
  14. 14. Meldon SW, Mion LC, Palmer RM, Drew BL, Connor JT, Lewicki LJ, et al. A Brief Risk-stratification Tool to Predict Repeat Emergency Department Visits and Hospitalizationsin Older Patients Discharged from the Emergency Department. Acad Emerg Med. 2003;10: 224–232. pmid:12615588
  15. 15. Lip GY, Nieuwlaat R, Pisters R, Lane DA, Crijns HJ. Refining clinical risk stratification for predicting stroke and thromboembolism in atrial fibrillation using a novel risk factor-based approach: the euro heart survey on atrial fibrillation. Chest. 2010;137: 263–272. pmid:19762550
  16. 16. Cooperberg MR, Broering JM, Carroll PR. Risk assessment for prostate cancer metastasis and mortality at the time of diagnosis. J Natl Cancer Inst. 2009;101: 878–887. pmid:19509351
  17. 17. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009;339: b2700. pmid:19622552
  18. 18. Garg S, Sarno G, Garcia-Garcia HM, Girasis C, Wykrzykowska J, Dawkins KD, et al. A new tool for the risk stratification of patients with complex coronary artery disease: the Clinical SYNTAX Score. Circ Cardiovasc Interv. 2010;3: 317–326. pmid:20647561
  19. 19. Holzel L, Harter M, Reese C, Kriston L. Risk factors for chronic depression—a systematic review. J Affect Disord. 2011;129: 1–13. pmid:20488546
  20. 20. Burcusa SL, Iacono WG. Risk for recurrence in depression. Clin Psychol Rev. 2007;27: 959–985. pmid:17448579
  21. 21. Riso LP, Miyatake RK, Thase ME. The search for determinants of chronic depression: a review of six factors. J Affect Disord. 2002;70: 103–115. pmid:12117622
  22. 22. Bennabi D, Aouizerate B, El-Hage W, Doumy O, Moliere F, Courtet P, et al. Risk factors for treatment resistance in unipolar depression: A systematic review. J Affect Disord. 2015;171: 137–141. pmid:25305428
  23. 23. Lee AS. Better outcomes for depressive disorders? Psychol Med. 2003;33: 769–774. pmid:12877391
  24. 24. World Health Organization. Improving health systems and services for mental health. 2009. Available: http://apps.who.int/iris/handle/10665/44219.
  25. 25. Wasylenki D, Goering P, Cochrane J, Durbin J, Rogers J, Prendergast P. Tertiary mental health services: I. Key concepts. Can J Psychiatry. 2000;45: 179–184. pmid:10742878
  26. 26. Cochrane J, Goering P, Durbin J, Butterill D, Dumas J, Wasylenki D. Tertiary mental health services: II. Subpopulations and best practices for service delivery. Can J Psychiatry. 2000;45: 185–190. pmid:10742879
  27. 27. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (DSM-III). 3rd Edition. Arlington, VA: American Psychiatric Publishing; 1980.
  28. 28. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (DSM III-R). 3rd Edition. Arlington, VA: American Psychiatric Publishing; 1987.
  29. 29. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (DSM-IV). 4th Edition. Arlington, VA: American Psychiatric Publishing; 1994.
  30. 30. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders: Text revision (DSM-IV-TR). 4th Edition. Arlington, VA: American Psychiatric Publishing; 2000.
  31. 31. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (DSM-5). 5th Edition. Arlington, VA: American Psychiatric Publishing; 2013.
  32. 32. World Health Organization. International Classification of Diseases, Ninth Revision: Geneva: World Health Organization; 1977.
  33. 33. World Health Organization. The ICD-10 classification of mental and behavioural disorders: clinical descriptions and diagnostic guidelines: Geneva: World Health Organization; 1992.
  34. 34. Spitzer RL, Endicott J, Robins E. Research diagnostic criteria: rationale and reliability. Arch Gen Psychiatry. 1978;35: 773–782. pmid:655775
  35. 35. VonVille HM. Organizing Search Data for Methods Reporting. 2014. Available: http://libguides.sph.uth.tmc.edu/excel_workbook_home/excel_SR_workbook.
  36. 36. National Heart, Blood and Lung Institute. Quality assessment tool for observational cohort and cross-sectional studies. 2014. Available: http://www.nhlbi.nih.gov/health-pro/guidelines/in-develop/cardiovascular-risk-reduction/tools/cohort.
  37. 37. National Heart, Blood and Lung Institute. Quality Assessment Tool for Case-Control Studies. 2014. Available: http://www.nhlbi.nih.gov/health-pro/guidelines/in-develop/cardiovascular-risk-reduction/tools/case-control.
  38. 38. Kaplan MJ, Klinetob NA. Childhood emotional trauma and chronic posttraumatic stress disorder in adult outpatients with treatment-resistant depression. J Nerv Ment Dis. 2000;188: 596–601. pmid:11009333
  39. 39. Souery D, Oswald P, Massat I, Bailer U, Bollen J, Demyttenaere K, et al. Clinical factors associated with treatment resistance in major depressive disorder: results from a European multicenter study. J Clin Psychiatry. 2007;68: 1062–1070. pmid:17685743
  40. 40. Amital D, Fostick L, Silberman A, Beckman M, Spivak B. Serious life events among resistant and non-resistant MDD patients. J Affect Disord. 2008;110: 260–264. pmid:18262654
  41. 41. Dudek D, Rybakowski JK, Siwek M, Pawlowski T, Lojko D, Roczen R, et al. Risk factors of treatment resistance in major depression: Association with bipolarity. J Affect Disord. 2010;126: 268–271. pmid:20381154
  42. 42. Takahashi M, Shirayama Y, Muneoka K, Suzuki M, Sato K, Hashimoto K. Low openness on the Revised NEO Personality Inventory as a risk factor for treatment-resistant depression. PLoS One. 2013;8: e71964–7. pmid:24019864
  43. 43. Takahashi M, Shirayama Y, Muneoka K, Suzuki M, Sato K, Hashimoto K. Personality traits as risk factors for treatment-resistant depression. PLoS One. 2013;8: e63756. pmid:23717477
  44. 44. Riso LP, du Toit PL, Blandino JA, Penna S, Dacey S, Duin JS, et al. Cognitive aspects of chronic depression. J Abnorm Psychol. 2003;112: 72–80. pmid:12653415
  45. 45. Gilmer WS, Trivedi MH, Rush AJ, Wisniewski SR, Luther J, Howland RH, et al. Factors associated with chronic depressive episodes: a preliminary report from the STAR-D project. Acta Psychiatr Scand. 2005;112: 425–433. pmid:16279871
  46. 46. Wiersma JE, Hovens JG, van Oppen P, Giltay EJ, van Schaik DJ, Beekman AT, et al. The importance of childhood trauma and childhood life events for chronicity of depression in adults. J Clin Psychiatry. 2009;70: 983–989. pmid:19653975
  47. 47. Wiersma JE, van Oppen P, van Schaik DJ, van der Does AJ, Beekman AT, Penninx BW. Psychological characteristics of chronic depression: a longitudinal cohort study. J Clin Psychiatry. 2011;72: 288–294. pmid:21450151
  48. 48. Melartin TK, Rytsala HJ, Leskela US, Lestela-Mielonen PS, Sokero TP, Isometsa ET. Severity and comorbidity predict episode duration and recurrence of DSM-IV major depressive disorder. J Clin Psychiatry. 2004;65: 810–819. pmid:15291658
  49. 49. Solomon DA, Leon AC, Endicott J, Mueller TI, Coryell W, Shea MT, et al. Psychosocial Impairment and Recurrence of Major Depression. Compr Psychiatry. 2004;45: 423–430. pmid:15526252
  50. 50. Bos EH, Bouhuys AL, Geerts E, Van Os TW, Van der Spoel ID, Brouwer WH, et al. Cognitive, physiological, and personality correlates of recurrence of depression. J Affect Disord. 2005;87: 221–229. pmid:15979155
  51. 51. Hollon SD, Shelton RC, Wisniewski S, Warden D, Biggs MM, Friedman ES, et al. Presenting characteristics of depressed outpatients as a function of recurrence: preliminary findings from the STAR*D clinical trial. J Psychiatr Res. 2006;40: 59–69. pmid:16243357
  52. 52. Gerrits MM, van Oppen P, Leone SS, van Marwijk HW, van der Horst HE, Penninx BW. Pain, not chronic disease, is associated with the recurrence of depressive and anxiety disorders. BMC Psychiatry. 2014;14: 187–244. pmid:24965597
  53. 53. Lamers F, Beekman AT, de Jonge P, Smit JH, Nolen WA, Penninx BW. One-year severity of depressive symptoms: results from the NESDA study. Psychiatry Res. 2011;190: 226–231. pmid:21802149
  54. 54. Butcher JN, Dahlstrom WG, Graham JR, Tellegen A, Kaemmer B. Minnesota Multiphasic Personality Inventory-2 (MMPI-2): Manual for administration and scoring. Minneapolis, MN: University of Minnesota Press; 1989.
  55. 55. Endicott J, Nee J, Harrison W, Blumenthal R. Quality of Life Enjoyment and Satisfaction Questionnaire: a new measure. Psychopharmacol Bull. 1993;29: 321–326. pmid:8290681
  56. 56. Pollack MM, Alexander SR, Clarke N, Ruttimann UE, Tesselaar HM, Bachulis AC. Improved outcomes from tertiary center pediatric intensive care: a statewide comparison of tertiary and nontertiary care facilities. Crit Care Med. 1991;19: 150–159. pmid:1796932
  57. 57. Ryabchenko KA, Pepper CM, Jeglic EL, Griffith JW, Miller AB. Differences in course and comorbidity of recurrent depression in primary care and psychiatric populations. Depress Anxiety. 2004;20: 153–154. pmid:15487015
  58. 58. Hardeveld F, Spijker J, De Graaf R, Nolen W, Beekman A. Prevalence and predictors of recurrence of major depressive disorder in the adult population. Acta Psychiatr Scand. 2010;122: 184–191. pmid:20003092
  59. 59. van Weel-Baumgarten EM, Schers H, Van den Bosch W, Van den Hoogen H, Zitman F. Long-term follow-up of depression among patients in the community and in family practice settings: a systematic review. J Fam Pract. 2000;49: 1113–1113. pmid:11132061
  60. 60. Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn't. BMJ. 1996;312: 71–72. pmid:8555924