Figures
Abstract
Objective
The diagnosis of schizoaffective disorder has long maintained an uncertain status in psychiatric nosology. Studies comparing clinical and biological features of patients with schizoaffective disorder to patients with related disorders [e.g., schizophrenia and bipolar disorder] can provide an evidence base for judging the validity of the diagnostic category. However, because most prior studies of schizoaffective disorder have only evaluated differences between groups at a static timepoint, it is unclear how these disorders may be related when the entire illness course is taken into consideration.
Methods
We ascertained a large cohort [N = 993] of psychiatric patients with a range of psychotic diagnoses including schizophrenia with no history of major affective episodes [SZ−; N = 371], schizophrenia with a superimposed mood syndrome [SZ+; N = 224], schizoaffective disorder [SAD; N = 129] and bipolar I disorder with psychotic features [BPD+; N = 269]. Using cross-sectional data we designed key clinical and neurocognitive dependent measures that allowed us to test longitudinal hypotheses about the differences between these diagnostic entities.
Results
Large differences between diagnostic groups on several demographic and clinical variables were observed. Most notably, groups differed on a putative measure of cognitive decline. Specifically, the SAD group demonstrated significantly greater post-onset cognitive decline compared to the BP+ group, with the SZ− and SZ+ group both exhibiting levels of decline intermediate to BPD+ and SAD.
Citation: DeRosse P, Burdick KE, Lencz T, Siris SG, Malhotra AK (2013) Empirical Support for DSM-IV Schizoaffective Disorder: Clinical and Cognitive Validators from a Large Patient Sample. PLoS ONE 8(5): e63734. https://doi.org/10.1371/journal.pone.0063734
Editor: Kenji Hashimoto, Chiba University Center for Forensic Mental Health, Japan
Received: January 11, 2013; Accepted: April 4, 2013; Published: May 30, 2013
Copyright: © 2013 DeRosse et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported by grants MH086756 to PD, MH077807 to KEB, and MH079800 to AKM. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have the following interests: Drs. DeRosse and Burdick report no competing interests. Dr. Lencz has served as consultant to GoldenHelix, Inc., Clinical Data, Inc., and InforMed Insights. Dr. Malhotra has served as consultant or speaker for Bristol-Myers Squibb, Astra Zeneca, Vanda Pharmaceuticals and Clinical Data, Inc, and has received research support from Pfizer, Janssen Pharmaceuticals, Bristol-Myers Squibb, and Eli Lilly. There are no patents, products in development or marketed products to declare. This does not alter the authors' adherence to all the PLOS ONE policies on sharing data and materials.
Introduction
Since its initial description by Kasanin [1] the diagnosis of schizoaffective disorder [SAD] has been at the center of controversy regarding the relation between psychotic and affective disorders. Originally described as a disorder in which patients presented with concomitant and equally severe affective and psychotic symptoms, SAD was conceptualized as a “good outcome” sub-type of schizophrenia (SZ) [2], [3]. It was not until the publication of the 3rd edition of the Diagnostic and Statistical Manual (DSM-III) of the American Psychiatric Association that SAD became a separate and more refined diagnostic entity and strict operational criteria for the diagnosis of SAD were not described until the publication of the DSM-IIIR [4]. Unfortunately, these diagnostic criteria are not without ambiguities.
For example, according to current diagnostic criteria (DSM-IV-TR) [5], a patient with symptoms meeting the diagnostic criteria for both SZ and a manic episode may receive a diagnosis of either SZ with bipolar disorder NOS (BPD NOS), SAD or bipolar disorder (BPD) with psychotic features. The critical distinction in the differential diagnosis is the relative time course of psychotic and affective symptoms: if psychotic symptoms are not present for at least 2 weeks in the absence of manic symptoms, a diagnosis of BPD with psychotic features is warranted; if psychotic symptoms are present for at least 2 weeks in the absence of manic symptoms AND manic symptoms are “relatively brief” in comparison to the total duration of illness then a diagnosis of SZ with BPD NOS is warranted. If none of these criteria are met, a diagnosis of SAD is then appropriate. For this reason, SAD has often been referred to as a “diagnosis by exclusion” [6].
Differential diagnosis based on the temporal relationship between psychotic and affective symptoms is often problematic at the clinical level. Because the relative proportion of affective and psychotic symptoms may change over the course of illness, a diagnosis of SAD may be warranted at a cross-sectional level during an acute episode whereas a diagnosis of SZ with BPD NOS may be warranted at the longitudinal level. Consistent with this hypothesis, Schwartz et al [7] found that the concordance of diagnoses at baseline vs. 24-month follow up was relatively high for both SZ and affective disorders (91.72% and 82.98%, respectively) but low for SAD (36.36%) in a study of 548 patients presenting with their first episode of psychosis; of those diagnosed with SAD at baseline, 42.24% switched to SZ and 21.21% switched to affective disorders at the 24-month follow up.
In addition to differences in illness course, clinical and neurocognitive variables may also differentiate SAD from SZ and psychotic BPD. Studies seeking to elucidate differences among these groups, however, have reported mixed results. For example, while some studies have reported differences in levels of negative [8], [9], disorganized [9] and positive symptoms [10] among SZ, SAD and BPD groups, others have reported no differences in negative [11], [10], disorganized [11] and positive symptoms [8], [9]. Assessment of differences in neurocognitive variables have also produced mixed findings (see [12] for a comprehensive review). Some studies suggest that the cognitive impairment in SAD is similar to SZ and worse than BPD while others have suggest that the cognitive impairment in SAD is similar to BPD and better than SZ. Yet others have suggested that the cognitive impairment in SAD is intermediate to those of SZ and BPD. Such conclusions, however, have been drawn primarily from cross-sectional studies that have focused on differences between the diagnostic groups at a static time point. Although prospective, longitudinal studies of first-episode psychosis have repeatedly found that cognitive decline during the early stages of illness predict conversion to SZ but not to BPD [13], [14], [15], [16], little effort has been directed at elucidating the cognitive trajectory (i.e. the change from premorbid to current cognitive function) of SAD.
Because SAD is a diagnosis that is dependent on the course of the illness, the utilization of dependent measures that cover the entire illness course may substantially enhance our ability to detect clinical features that differentiate SAD from SZ and psychotic BPD [17]. Thus, the present study evaluated differences in clinical features, including affective and psychotic symptoms, manifested over the entire course of illness in diagnostic groups including SZ without a concomitant mood syndrome, SZ with a concomitant mood syndrome, SAD and psychotic bipolar disorder. Moreover, because cognitive trajectory during the course of illness appears to reliably differentiate between SZ and affective disorders [18], we also sought to explore differences in cognitive trajectories that might exist among these diagnostic groups.
Methods
Sample
The sample included 993 subjects recruited from the inpatient and outpatient clinical services of the Zucker Hillside Hospital, a division of the North Shore–Long Island Jewish Health System, where patients are screened for potential recruitment into research studies by the Clinical Assessment and Training (CAT) unit of the National Institutes of Health–funded Hillside Hospital Intervention Research Center. The CAT unit monitors the inpatient and outpatient hospital census daily and conducts preliminary screening and recruitment functions. Inclusion criteria for this study included a clinical diagnosis of a psychotic disorder, no active substance abuse, fluency in the English language, and the ability to provide informed consent. All subjects provided written informed consent to a protocol approved by the Institutional Review Board of the North Shore-Long Island Jewish Health System. The total sample was divided based on DSM-IV diagnoses and included 1] schizophrenia with no history of major affective episodes (SZ−; N = 371), 2) schizophrenia with a superimposed mood syndrome (depressive disorder NOS or bipolar disorder NOS) (SZ+; N = 224), 3) schizoaffective disorder (SAD; N = 129) and 4) bipolar I disorder with psychotic features (BPD+; N = 269).
Clinical Assessment
Each subject was assessed with the Structured Clinical Interview for the DSM-IV (SCID), which was administered by trained and reliable raters. Information obtained from the SCID was supplemented by a comprehensive review of all available medical records and when possible, interviews with family informants. Information derived from the interview along with information from the medical record and family informants, were utilized to rate the SCID. The SCID data were then compiled into a narrative clinical case summary describing the patient's entire illness course. Diagnoses were then determined by a consensus among a minimum of three expert diagnosticians from the ZHH faculty. We have also operationalized DSM–IV Criterion C for schizoaffective disorder, which differentiates it from schizophrenia. Criterion C requires that mood symptoms meeting criteria for a mood episode ‘must be present for a substantial portion of the entire period of illness' for a diagnosis of schizoaffective disorder to be made. Our operationalized criterion defined ‘a substantial portion’ as greater than 30% of the total duration of illness.
Because symptom severity often varies during the course of illness, a lifetime symptom severity rating rather than a cross-sectional rating was used [17], [19]. Lifetime symptom ratings were derived from SCID data and included overall ratings on two categories of symptoms: 1) psychotic symptoms including negative symptoms, positive symptoms and disorganized symptoms and 2) affective symptoms including depressive and manic symptoms. Individual psychotic symptom ratings were obtained by summing the scores for each symptom within a domain such that the negative symptom rating included ratings on avolition, alogia and affective flattening [20], the positive symptom rating included ratings on delusions (referential, paranoid, grandiose, somatic, control, thought broadcasting, bizarre, and other delusions) and hallucinations (auditory, visual, tactile and other hallucinations) [21] and the disorganization symptom rating included ratings on disorganized speech and disorganized behavior [22]. The total psychotic symptom rating was produced by summing all of these categories. Individual affective symptom ratings were also obtained by summing the scores for each symptom within a domain such that manic symptoms rating included ratings on elevated, euphoric or irritable mood, inflated self-esteem, decreased need for sleep, pressured speech or talkativeness, flight of ideas or racing thoughts, distractibility, increase in activity and impulsivity [23] and the depressive symptom rating included ratings on depressed mood, anhedonia, weight or appetite disturbance, sleep disturbance, psychomotor retardation or agitation, energy disturbance, worthlessness or inappropriate guilt, diminished concentration or difficulty making decisions and suicidal thoughts or behavior. The total affective symptom rating was produced by summing the overall manic and depressive scores.
Ratings on each of the items were recorded based on the subject's report during the interview as well as the medical record and other available sources and are rated on a continuous scale where 1 = absent, 2 = subthreshold and 3 = present. All symptoms were rated based on a lifetime history. Because affective symptoms may be rated for both present and past mood episodes, the affective symptoms used to create the composite score were computed using whichever section (present or past) yielded the higher score.
Neurocognitive Measures
Participants were administered a battery of standardized cognitive measures comprised of the Wechsler Adult Intelligence Test-Revised (WAIS-R)-Digit Span; California Verbal Learning Test (CVLT)-Abridged; Controlled Oral Word Association Test (COWAT), fluency (animal naming), and Trail Making Tests A & B. Because our interest was primarily in lifetime illness course, simple comparisons among groups on these neurocognitive measures would not be informative. Thus, we sought to assess the change in neurocognitive function over time across diagnostic groups. Because longitudinal data were not available we used an alternative approach to generate indices of cognitive trajectory over the course of illness.
Following common practice in the psychiatric literature [24], we estimated premorbid IQ using the Wide Range Achievement Test-Third Edition-Reading Subtest (WRAT-3). WRAT-3 is a test that assesses single word reading skill which, like command of general knowledge and vocabulary, is particularly resistant to the effects of deterioration associated with brain disease and is considered a reliable estimate of pre-morbid IQ in patient populations [25].
As a proxy for current IQ we calculated “general cognitive ability”, or (g), as the first component of an unrotated principal components analysis utilizing all of the cognitive tests administered, except the WRAT-3. A detailed description of the PCA methods used to derive g is provided in Burdick et al. [26]. Briefly, all cognitive variable data were transformed to standardized z-scores and missing values were replaced by the mean of the group. No case with more than two missing values was retained in the sample and a formal missing value analysis was conducted to rule out any consistent patterns in missing values. A single factor model was produced (extracted variables with eigenvalues of >1.0 using the regression method). This first unrotated factor explained 51.7% of the variance and represented a general cognitive ability factor. Each of the individual measures loaded onto the first factor with covariance of >0.64.
Statistical Analyses
Demographic variables.
Comparison of demographic variables including sex, race and family history of psychotic illness were carried out using chi square analyses. Additional analyses of demographic variables including age, age at onset of psychiatric illness, duration of psychiatric illness and global assessment of functioning score were carried out using a series of one-way ANCOVAs that covaried for any differences observed in sex, race or family history of psychotic illness.
Symptom dimensions.
To evaluate the differences between diagnostic groups on psychotic and affective symptom clusters, ANCOVA's were carried out to compare diagnostic groups on lifetime severity of psychotic and affective symptoms. In these analyses, all of the demographic variables that were shown to differ between groups were entered into the model as covariates. Significant results were followed up with post-hoc analyses to determine the specific differences among groups.
Neurocognitive measures.
Consistent with methodology used in Kremen et al. [25] we measured deviations from premorbid IQ by using a regression approach. This method is preferable to using raw score differences because the premorbid-current discrepancy may not be equivalent at all IQ levels. This was done by regressing g on WRAT-3 in a healthy control sample matched on sex, age and race (n = 145) and using the resulting regression equation to generate standardized scores, representing estimated premorbid IQ, in each of the diagnostic groups. Thus, the putative measure of cognitive trajectory described is actually the discrepancy between current IQ, as measured by g, and estimated premorbid IQ based on a predicted score [14].
To evaluate differences in the cognitive trajectories of the diagnostic groups we carried out a repeated-measure ANOVA where the within-subjects factor represented our putative cognitive trajectory [estimated premorbid IQ derived from WRAT regression vs. current IQ estimated from g] and diagnostic group represented the between-subjects factor. However, because cognitive trajectories are likely to vary as a function of demographic characteristics and level of clinical symptomatology, this analysis was followed-up with a repeated-measure ANCOVA that included these variables as covariates.
Results
Demographic variables
Comparison of demographic variables amongst the groups revealed a significant difference between groups on sex distribution with fewer females in the both the SZ− and SZ+ groups relative to the SAD group and BPD+ groups. Differences in racial composition were also observed between groups with more non-whites in the SZ− group relative to both the SAD and BPD+ groups and more non-whites in the SZ+ group relative to the BPD+ group. Moreover, diagnostic groups also differed in the family history of psychotic illness with the BPD+ group being more likely to have a family history of psychotic illness than the SZ− group. A series of ANCOVA's, which covaried for all three of these factors, were carried out to assess differences in diagnostic group on age, age at onset of psychiatric illness, duration of psychiatric illness and GAF score. These analyses revealed significant differences between groups on age, with post-hoc analyses indicating that the SZ+ group, on average, was older than the both the SZ− and BPD+ groups. Significant differences between groups was also noted for illness duration with post-hoc tests indicating that the SZ+ group had a longer illness duration than the BPD+ group. Finally, differences between groups were also observed on GAF score with the BPD+ group having higher functioning than any of the other 3 groups and the SZ+ group higher than the SZ− group. No differences were observed between groups on age at onset of psychiatric illness. All of these results are shown in Table 1.
Symptom dimensions
To evaluate the differences between diagnostic groups on psychotic and affective symptom clusters, ANCOVA's were carried out using ratings of lifetime severity of psychotic and affective symptoms. In these analyses, sex, race, family history of psychotic illness, age, illness duration and GAF score were included as covariates. Diagnostic groups differed on both overall psychosis as well as overall affective symptoms. Post hoc analyses on lifetime severity of psychotic symptoms indicated that the BPD+ group had significantly less severe psychosis than any of the other 3 groups. No differences in psychotic symptoms were noted between the SZ+, SZ− and SAD groups. Post hoc analyses on lifetime severity of affective symptoms indicated that lifetime severity of affective symptoms were significantly different for all pairwise comparisons with a gradation in severity across diagnostic categories. Specifically, the SZ− group had the lowest overall rating, followed by the SZ+ group and then the SAD group and finally the BPD+ group. These data are illustrated in Figure 1.
The boxes used to identify the groups encompass the mean of each group as well as their standard deviations on both dimensions: schizophrenia without mood syndrome [SZ−]; schizophrenia with superimposed mood syndrome [SZ+]; schizoaffective disorder [SAD]; bipolar disorder with psychotic features [BPD+].
Exploratory analyses were conducted to assess differences in diagnostic groups based on the specific symptom domains contained within the overall psychotic and affective symptom composite scores (e.g.: negative symptoms, manic symptoms, etc.). These analyses included the same covariates as the analyses conducted on the overall composite scores. The overall model was significant with significant differences being observed on all of the symptom domains. Post hoc analyses indicated that lifetime severity of mania was significantly different for all pairwise comparisons with a gradation in severity across diagnostic categories. Specifically, the SZ− group had the lowest overall rating, followed by the SZ+ group and then the SAD group and finally the BPD+ group. For lifetime severity of depressive symptoms, only the SZ− group differed from the other groups with the SZ+, SAD and BPD+ groups showing comparable levels of depressive symptomatology. For lifetime severity of disorganized, delusional and hallucination symptoms, only the BPD+ group differed from the others with significantly lower scores on these dimensions than either the SZ−, SZ+ or SAD groups. For the lifetime severity of negative symptoms, The BPD+ group had significantly lower ratings than any of the other groups and the SZ+ and SAD groups had lower ratings than the SZ− group. No difference was observed on negative symptoms for the SZ+ and SAD groups. All of these results are shown in Table 2.
Neurocognitive measures
To evaluate differences in cognitive trajectories between diagnostic groups we carried out a repeated-measures ANOVA where cognitive decline, measured by the discrepancy between our estimate of premorbid IQ and our proxy of current IQ (g), represented the within-subjects factor and diagnostic group the between-subjects factor. This analysis yielded a significant cognitive decline x diagnostic group interaction (F = 7.33; df = 3,629; p<0.0001); a significant main effect of diagnostic group (F = 12.54; df = 3, 629; p<0.0001) was also observed but was better accounted for by the interaction effect (see Figure 2). Because cognitive decline is likely to vary as a function of both demographic characteristics and level of clinical symptomatology, this analysis was followed-up with a repeated-measures ANCOVA that included sex, race, age, illness duration, GAF score as well as the scores on all symptom domains (delusions & hallucinations, negative, disorganized, manic and depressive symptoms) as covariates. This analysis yielded similar results indicating a significant cognitive decline x diagnostic group interaction (F = 3.07; df = 3,438; p = 0.03) as well as a significant main effect of group (F = 2.61; df = 3,438; p = 0.05). Significant covariates in this model included age (p = 0.04), race (p<0.0001) and depressive symptoms (p = 0.007). Post-hoc tests, corrected for multiple testing using a Bonferroni correction, indicated that the SAD group significantly differed from the BPD+ group on the putative measure of cognitive decline (p = 0.03). No other differences between diagnostic groups were observed. These data are illustrated in Figure 2.
Data are presented as residual scores as opposed to raw scores. Means have been adjusted for differences in demographic factors as well as lifetime symptom severity between groups: schizophrenia without mood syndrome [SZ−]; schizophrenia with superimposed mood syndrome [SZ+]; schizoaffective disorder [SAD]; bipolar disorder with psychotic features [BPD+].
Discussion
The results of the present analyses suggest that there are several clinical characteristics of SAD that are more consistent with the SZ diagnostic groups and several others that are more consistent with the BPD+ group. Consistent with previous literature [27], the SAD group was similar to the BPD+ group [and different from both the SZ− and SZ+ groups] on several demographic characteristics including race and sex composition. In regards to lifetime severity of psychotic symptoms, the SAD group did not differ significantly from the SZ− and SZ+ group indicating comparable levels of psychosis across these diagnostic groups. Upon further analysis, however, the observed similarities in psychotic symptoms across the SZ−, SZ+ and SAD groups was limited to the positive dimensions of psychosis (hallucinations and delusions). In terms of the negative symptoms of psychosis (avolition, alogia and flat affect), all of the groups were significantly different from one another with the SZ− group showing the highest level of negative symptoms followed by the SZ+ group, the SAD group and the BPD+ group.
Comparison of groups on lifetime severity of affective symptoms also indicated significant differences between all of the groups with the BPD+ group showing the highest level of affective symptoms followed by the SAD group, the SZ+ group and SZ− group. Upon further analysis, however, the observed differences in affective symptoms were primarily limited to the lifetime severity of manic symptoms. On measures of lifetime severity of manic symptoms, all of the groups were significantly different from one another with the BPD+ group having the highest rating, followed by the SAD group, the SZ+ group and the SZ− group. On measures of lifetime severity of depressive symptoms, however, only the SZ− group differed from the other diagnostic groups with the SZ+, SAD and BPD+ groups showing comparable levels of depressive symptomatology over the illness course.
At the clinical level it is often difficult to differentiate between negative symptoms and depressive symptoms. Thus, it could be argued that our findings suggesting comparable levels of depressive symptoms among the SZ+, SAD and BPD+, which all differed from the SZ− group, is related to a tendency to under-diagnose negative symptoms and over-diagnose depressive symptoms in patients with a history of affective disturbance. Given the inverse relationship between negative and depressive symptoms in the present study (r = −0.23; p<0.0001), this interpretation cannot be ruled out. However, if the classification of depressive symptoms was merely an artifact of the classification of negative symptoms and vice versa, it is likely that we would have found that the lifetime history of negative symptoms was comparable across the SZ+, SAD and BPD+ diagnostic groups. To the contrary, we found that lifetime severity of negative symptoms significantly differed between all of these groups.
Comparison of groups on our putative measure of cognitive decline indicated that the cognitive deterioration across the course of illness was significantly worse for the SAD group than the BP+ group, with the SZ− and SZ+ group showing a decline in cognitive functioning intermediate to BPD+ and SAD. Because these analyses covaried for differences in demographic characteristics and lifetime symptomatology, this finding cannot be attributed to differences in these factors across diagnostic groups. Although it might be argued that the diagnostic groups show different levels of decline as a result of differences in level of functioning at the time of testing, the GAF score, which represents level of functioning at time of assessment, was also included as a covariate in these analyses. Moreover, these results do not appear to be driven by a single cognitive domain as the patterns of raw scores across diagnostic groups are consistent across most domains. These data are shown in Table 3. To our knowledge the present analysis represents the first data to assess cognitive decline across the spectrum of diagnoses from SZ to psychotic BPD.
It should be noted that our SAD group was considerably smaller than the other groups we assessed. Although our analyses indicated that we were sufficiently powered to detect differences amongst the groups with all preliminary and primary analyses carried out with >85% power, it is possible that the differences in sample size may have had an impact on the overall stability of the results. Finally, our data are limited by collection of clinical and neurocognitive data at a single time point, although determination of lifetime clinical ratings was bolstered by availability of substantial chart histories. Nevertheless, the convergence of these results suggests that the identification of differences in longitudinal clinical and neurocognitive profiles in patients suffering from a range of psychotic illnesses is possible. The identification of such differences may provide insight into the pathology underlying these illnesses. Moreover, the present results suggest that SAD may represent a disease entity that is distinct from both SZ and BPD. Future prospective field trials will be needed to provide longitudinal validation of the schizoaffective diagnosis as a useful clinical entity.
Author Contributions
Conceived and designed the experiments: PD KEB TL SGS AKM. Performed the experiments: PD KEB. Analyzed the data: PD KEB. Wrote the paper: PD KEB TL SGS AKM.
References
- 1. Kasanin J (1933) The acute schizo-affective psychoses. Am J Psychiatry 13: 97–126.
- 2.
American Psychiatric Association (1952) Diagnostic and Statistical Manual of Mental Disorders. Washington, DC: American Psychiatric Press.
- 3.
American Psychiatric Association (1968) Diagnostic and Statistical Manual of Mental Disorders-II. Washington, DC: American Psychiatric Press.
- 4.
American Psychiatric Association (1987) Diagnostic and Statistical Manual of Mental Disorders-IIIR. Washington, DC: American Psychiatric Press.
- 5.
American Psychiatric Association (2000) Diagnostic and Statistical Manual of Mental Disorders-IV Text Revision. Washington, DC: American Psychiatric Press.
- 6. Craddock N, O'Donovan MC, Owen MJ (2009) Psychosis genetics: modeling the relationship between schizophrenia, bipolar disorder, and mixed (or “schizoaffective”) psychoses. Schizophr Bull 35(3): 482–90.
- 7. Schwartz JE, Fennig S, Tanenberg-Karant M, Carlson G, Craig T, et al. (2000) Congruence of diagnoses 2 years after a first-admission diagnosis of psychosis. Arch Gen Psychiatry 57: 593–600.
- 8. Kendler KS, McGuire M, Gruenberg AM, Walsh D (1995) Examining the validity of DSM-III-R schizoaffective disorder and its putative subtypes in the Roscommon Family Study. Am J Psychiatry 152(5): 755–64.
- 9. Peralta V, Cuesta MJ (2008) Exploring the borders of the schizoaffective spectrum: a categorical and dimensional approach. J Affect Disord 108(1–2): 71–86.
- 10. Evans JD, Heaton RK, Paulsen JS, McAdams LA, Heaton SC, et al. (1999) Schizoaffective disorder: a form of schizophrenia or affective disorder? J Clin Psychiatry 60(12): 874–82.
- 11. Cuesta MJ, Peralta V (1995) Are positive and negative symptoms relevant to cross-sectional diagnosis of schizophrenic and schizoaffective patients? Compr Psychiatry 36(5): 353–61.
- 12. Cheniaux E, Landeira-Fernandez J, Lessa Telles L, Lessa JL, Dias A, et al. (2008) Does schizoaffective disorder really exist? A systematic review of the studies that compared schizoaffective disorder with schizophrenia or mood disorders. J Affect Disord 106: 109–117.
- 13. Fuller R, Nopoulos P, Arndt S, O'Leary D, Ho BC, et al. (2002) Longitudinal assessment of premorbid cognitive functioning in patients with schizophrenia through examination of standardized scholastic test performance. Am J Psychiatry 159: 1183–1189.
- 14. Reichenberg A, Weiser M, Rapp MA, Rabinowitz J, Caspi A, et al. (2005) Elaboration on premorbid intellectual performance in schizophrenia: premorbid intellectual decline and risk for schizophrenia. Arch Gen Psychiatry 62: 1297–1304.
- 15. Davidson M, Reichenberg A, Rabinowitz J, Weiser M, Kaplan Z, et al. (1999) Behavioral and intellectual markers for schizophrenia in apparently healthy male adolescents. Am J Psychiatry 156: 1328–1335.
- 16. Brewer WJ, Francey SM, Wood SJ, Jackson HJ, Pantelis C, et al. (2005) Memory impairments identified in people at ultra-high risk for psychosis who later develop first-episode psychosis. Am J Psychiatry 162: 71–78.
- 17. Craddock N, Owen MJ (2007) Rethinking psychosis: the disadvantages of a dichotomous classification now outweigh the advantages. World Psychiatry 6: 84–91.
- 18. Keefe RS, Fenton WS (2007) How should DSM-V criteria for schizophrenia include cognitive impairment? Schizophr Bull 33(4): 912–20.
- 19. Levinson DF, Mowry BJ (1991) Defining the schizophrenia spectrum: issues for genetic linkage studies. Schizophr Bull 17: 491–514.
- 20. DeRosse P, Funke B, Burdick KE, Lencz T, Ekholm JM, et al. (2006) Dysbindin genotype and negative symptoms in schizophrenia. Am J Psychiatry 163: 532–534.
- 21. DeRosse P, Hodgkinson CA, Lencz T, Burdick KE, Kane JM, et al. (2007) Disrupted in schizophrenia 1 genotype and positive symptoms in schizophrenia. Biol Psychiatry 61: 1208–1210.
- 22. DeRosse P, Lencz T, Burdick KE, Siris SG, Kane JM, et al. (2008) The genetics of symptom-based phenotypes: toward a molecular classification of schizophrenia. Schizophr Bull 34: 1047–1053.
- 23. DeRosse P, Funke B, Burdick KE, Lencz T, Goldberg TE, et al. (2006) COMT genotype and manic symptoms in schizophrenia. Schizophr Res 87: 28–31.
- 24. Keefe RS, Eesley CE, Poe MP (2005) Defining a cognitive function decrement in schizophrenia. Biol Psychiatry 57(6): 688–91.
- 25. Kremen WS, Lyons MJ, Boake C, Xian H, Jacobson KC, et al. (2006) A discordant twin study of premorbid cognitive ability in schizophrenia. J Clin Exp Neuropsychol 28: 208–224.
- 26. Burdick KE, Lencz T, Funke B, Finn CT, Szeszko PR, et al. (2006) Genetic variation in DTNBP1 influences general cognitive ability. Hum Mol Genet 163: 532–534.
- 27. Salokangas RK, Honkonen T, Saarinen S (2003) Women have later onset than men in schizophrenia – but only in its paranoid form. Results of the DSP project. Eur Psychiatry 18(6): 274–81.