Figures
Abstract
Loneliness is a highly prevalent experience in schizophrenia. Theoretical models developed in the general population propose that loneliness is tantamount to a feeling of being unsafe, is accompanied by enhanced environmental threat perception, and leads to poor physical, emotional, and cognitive functioning. Previous research has reported that loneliness is associated with poorer physical and emotional health in schizophrenia; however, few studies have directly compared loneliness and its correlates in persons with schizophrenia and non-psychiatric comparison subjects. The purpose of the current study was to evaluate similarities and differences in the construct of loneliness, the equivalency of the measurement of this construct, and similarities and differences in the pattern of external correlates of loneliness between schizophrenia and non-psychiatric comparison groups. The third version of the University of California, Los Angeles Loneliness Scale (UCLA-3) was administered to 116 individuals with schizophrenia or schizoaffective disorder and 106 non-psychiatric comparison subjects. Additional clinical and positive psychological measures were collected, as well as demographic characteristics of the two groups. Multiple groups confirmatory factor analysis revealed that the UCLA-3 was best characterized by a bifactor model in which all items loaded on a general loneliness dimension as well as one of two orthogonal method factors reflecting item wording in both groups. Furthermore, the UCLA-3 exhibited invariant measurement of these latent constructs across groups. Mean levels of loneliness were nearly a standard deviation higher in the schizophrenia group. Nonetheless, the overall pattern and strength of correlates were largely similar across groups, with loneliness being positively associated with depression, anxiety, and perceived stress, and negatively correlated with mental well-being, happiness, and resilience. Subtle differences in correlates of age, optimism, and satisfaction with life were found. Overall, loneliness appears to be distinct from other schizophrenia-related deficits and operates similarly across schizophrenia and NC groups, suggesting that theoretical models of loneliness developed in the general population may generalize to schizophrenia.
Citation: Eglit GML, Palmer BW, Martin AS, Tu X, Jeste DV (2018) Loneliness in schizophrenia: Construct clarification, measurement, and clinical relevance. PLoS ONE 13(3): e0194021. https://doi.org/10.1371/journal.pone.0194021
Editor: Sinan Guloksuz, Department of Psychiatry and Neuropsychology, Maastricht University Medical Center, NETHERLANDS
Received: November 2, 2017; Accepted: February 22, 2018; Published: March 22, 2018
This is an open access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This work was supported, in part, by National Institute of Mental Health (NIMH) grant 5R01 MH094151-04 (Jeste), the National Institute of Mental Health T32 Geriatric Mental Health Program MH019934 (PI: Jeste), and University of California San Diego’s Stein Institute for Research on Aging (Director: Jeste). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: I have read the journal’s policy and the authors of this manuscript have the following competing interests: Dilip V. Jeste has received funding from the National Institute Mental Health. He is currently receiving grant funding by National Institute of Mental Health (NIMH) grant 5R01 MH094151-04 (Jeste) and the National Institute of Mental Health T32 Geriatric Mental Health Program MH019934 (PI: Jeste). This does not alter our adherence to PLOS ONE policies on sharing data and materials.
Introduction
Loneliness is increasingly being recognized as an important contributor to health and wellness. Surveys have highlighted a near doubling of the prevalence of loneliness from 20% to 35% among U.S. adults over the past decade [1–3]. Loneliness has been identified as a major risk factor for a range of negative health outcomes, including heart disease, depression, anxiety, and Alzheimer’s disease [4]. Furthermore, recent research suggests that loneliness, among other behavior and mood changes, may represent one of the earliest symptoms of neurocognitive disorders associated with aging [5–7]. In recognition of the negative impact and growing prevalence of loneliness, the former US Surgeon General Murthy has advocated treating this “loneliness epidemic” as a major public health concern, whose impact is on par with that of cigarette smoking and obesity [2].
Individuals with serious mental illnesses, especially those with psychotic disorders, may be especially prone to loneliness. In particular, individuals with schizophrenia are subject to stigma [8] and have greater clinical (e.g., positive symptoms, negative symptoms, etc.) challenges. In addition, on average, individuals with schizophrenia experience greater socio-environmental (e.g., poverty, low rates of employment, low rates of marriage) difficulties [9, 10], and are objectively less integrated within their communities [11, 12], although their perceived sense of belonging within the community may not differ from individuals without schizophrenia living in the same community [13]. Recent surveys indicate that self-reported annual rates of loneliness among individuals with schizophrenia and other psychotic disorders (76 to 80%) are approximately 2.3 times higher than those in the general population (35%) [14, 15]. Highlighting its clinical importance, loneliness has been reported as a significant contributor to worse quality of life in schizophrenia [16, 17] and individuals with psychotic disorders cite loneliness as one of the most important challenges in their life, second only to financial concerns [18].
Conceptually, loneliness has been defined as a distressing feeling arising from the perception that one’s social needs are not currently being met [4]. Implicit in this definition is the recognition that loneliness is related to the subjective perception of social isolation and not necessarily with an objective lack of social support. Empirical research within the general population suggests that loneliness is characterized by several negative cognitive beliefs or processes, including enhanced vigilance for social threat, expectations of generally negative social interactions, and a memory bias favoring negative over positive social information. As a result, lonely individuals often experience feelings of hostility, stress, pessimism, anxiety, and low self-esteem [19, 20]. This elevated perception of environmental threat is believed to lead to chronic activation of the autonomic nervous system and the hypothalamic-pituitary adrenocortical (HPA) axis, resulting in poor physical health outcomes, particularly as regards cardiovascular health and immune functioning [4].
Prior studies suggest that while individuals with schizophrenia experience more severe levels of loneliness, their experience of loneliness may be associated with similar cognitive biases and downstream effects on emotional and physical health as found in the general population [21–25]. Specifically, loneliness in schizophrenia is associated with negative interpersonal expectations and attributions of others [26, 27], internalized stigma [22], lower self-efficacy for community life [24], lower self-esteem [24], paranoia [26, 28], depression [25], anxiety [28], hypertension [25] and abnormal hemoglobin A1c levels [25].
Overall, the existing studies suggest some similarities of the effects of loneliness among people with schizophrenia and those from the general population. However, a more fundamental question still rests unanswered regarding the nature of the basic construct of “loneliness” in schizophrenia. To our knowledge there have been no published studies of the structure of the construct of loneliness in this group of people. A related concern is whether scales for quantifying loneliness function equivalently among individuals with schizophrenia compared to people in the general population or whether loneliness measures are subject to bias across these groups. Ensuring the generalizability of the construct of loneliness and the equivalency of its measurement is a prerequisite for making cross-group comparisons [29]. Moreover, evidence suggesting that the construct of loneliness differs across groups may call into question the generalizability of models of loneliness derived from the general population to schizophrenia.
This oversight is especially problematic as there is some ambiguity over the nature of the construct of loneliness. Factor analytic studies of the most commonly administered measure of loneliness, the UCLA Loneliness Scale [30], have reported mixed findings [31], with studies reporting that one [32], versus two [33], versus three [34, 35] factors underlie this scale in non-psychiatric populations. One-factor models describe this scale as consisting of a single general loneliness dimension; two-factor models describe this scale as consisting of dimensions of “Intimate Other” (lack of romantic or particularly close relationships) and “Social Other” (lack of a group or network of friends); and three-factor models describe this scale in terms of dimensions of “Isolation” (feelings of aloneness, rejection, and withdrawal), “Relational Connectedness” (feelings of familiarity, closeness and support), and “Collective Connectedness” (feelings of group identification and cohesion). These distinct conceptualizations of the loneliness construct have implications not only for assessment of loneliness, but also its treatment. If there are multiple dimensions of loneliness, interventions may need to be tailored to address specific aspects of loneliness in different groups.
Alternatively, Russell [30] proposed a bifactor model of the third version of the UCLA Loneliness Scale, the UCLA-3, in recognition of the potential impact of variable item wording on this scale. Bifactor models allow items to load on both a common general factor and an additional orthogonal group/nuisance factor. General factors reflect the target latent construct of the scale while group/nuisance factors typically reflect content domains within the target construct or method effects related to item wording [36]. In Russell’s model, items were specified to load on a general bipolar loneliness factor, as well as one of two orthogonal method factors reflecting the direction of item wording (positively vs. negatively worded items). Russell found that this model exhibited a strong model fit across four different samples of students, nurses, teachers, and older adults (see also [37]). This suggests that, after controlling for method effects related to item wording, the UCLA-3 consists of a single general loneliness dimension.
The goals of present study were to evaluate the nature and degree of similarity of the construct of loneliness across individuals with schizophrenia and non-psychiatric comparison subjects (NCs). Specifically, the study had four key aims: (1) to determine the factor structure of one of the most widely used and well-validated loneliness scales for the general population, the UCLA-3, by evaluating the comparative fit of one, two, three, and bifactor models of this scale among NCs and individuals with schizophrenia separately; (2) to evaluate the generalizability of the latent structure of loneliness and the equivalency of its measurement across these groups; (3) to determine differences in levels of loneliness across groups; and (4) to examine the degree to which loneliness scores correlate similarly across groups with important demographic, clinical, and positive psychological variables. We hypothesized that the UCLA-3 would be best characterized by Russell’s [30] bifactor model, that this model would generalize across samples, that individuals with schizophrenia would report higher mean levels of loneliness than NCs, and that loneliness would correlate with a similar pattern of variables across the two groups.
Methods
Participants
The present report was based on a secondary analysis of data from an ongoing study of schizophrenia at the University of California San Diego, supported by a grant from the National Institute of Mental Health. Some of these participants’ data have been used in prior reports (for example, [38, 39]), but this report represents the first examination of loneliness within this sample. For this report, the sample was restricted to individuals with complete UCLA-3 data. The study sample consisted of 116 non-institutionalized/outpatient adults with schizophrenia or schizoaffective disorder and 106 NCs who were administered the UCLA-3. Exclusion criteria were 1) other DSM IV-TR Axis 1 diagnosis; 2) alcohol or other substance use disorder (with the exception of tobacco) within the 3-months preceding enrollment; or 3) dementia, intellectual disability disorder, or other major neurological disorder potentially affecting cognition. In addition, participants were excluded if they had a medical disability that interfered with their ability to participate in the study assessments. Diagnoses were established using the Structured Clinical Interview for the DSM-IV-TR (SCI) [40] for the schizophrenia group and using the Mini-International Neuropsychiatric Interview [41] for the NC group, administered by a trained Research Associate (RA). Participants with schizophrenia were recruited from local outpatient clinics, medical centers, private physicians and board-and-care facilities and NC participants were recruited through flyers in the community, advertisements in local media and word of mouth. Participant recruitment was balanced by age, so as to have equal numbers of participants across groups at each age binned by half decade. The study protocol was reviewed and approved by the University of California, San Diego Human Research Protections Program (Project # 101631). The above-named institutional review board specifically approved this study. All participants provided written informed consent.
Measures and procedures
Sociodemographic and clinical characteristics.
Age, education, gender, marital status, living status, personal and family income, ethnicity, age of onset of schizophrenia and antipsychotic type and dose (expressed in terms of the World Health Organization (WHO) Defined Daily Dose (DDD) [42, 43] were determined via interview and/or record review. Individuals who reported living alone in an apartment or house, who were homeless, or who lived in a single room occupancy were coded as residing alone, individuals who reported living with someone in an apartment or house were coded as residing with someone else, and individuals who lived in a Board and Care facility were coded as living in a Board and Care facility. Personal and family income were coded according to the following income levels: (1) < $10,000; (2) $10,000–$19,999; (3) $20,000–$34,999; (4) $35,000–$49,999; (5) $50,000–$74,999; (6) $75,000–$99,999; (7) $100,000–$149,000; and (8) ≥ $150,000. In addition, information on social status was collected via the Hollingshead Index of Social Position (HISP) [44]. The HISP is a self-report measure of social position based on occupational and educational attainment, which is combined to classify an individual as (1) upper, (2) upper-middle, (3) middle, (4) middle-lower, and (5) lower social status position. Social position is characterized for current social position, longest held social position, and highest attained social position.
Loneliness.
All participants completed the UCLA-3 [30], a 20-item self-report measure. Each item is preceded by the stem “How often do you feel…?”. Response categories correspond to the frequency of the item and consist of “Never,” “Sometimes”, “Often,” and “Always.” Eleven items on the scale are negatively worded, with higher frequency ratings denoting greater levels of loneliness (e.g., “How often do you feel that you lack companionship?”) and nine items are positively worded, in which higher frequency ratings correspond to lower levels of loneliness (e.g., “How often do you feel part of a group of friends?”). The UCLA-3 has demonstrated strong test-retest reliability [30], internal consistency [30, 45, 46], discriminant validity [46], and convergent validity [30, 46] among non-psychiatric samples, as well as strong internal consistency among individuals with schizophrenia [26, 47].
Severity of psychopathology.
Severity of psychopathology was measured with the Scales for the Assessment of Positive and Negative Symptoms (SAPS and SANS, respectively) [48, 49], which were administered and scored by a trained RA. In addition, all participants completed several self-report measures, including the Brief Symptom Inventory—Anxiety Subscale [50] and the Calgary Depression Scale [51]. Assessment of cognition targeted executive functions, as this domain may be particularly relevant to schizophrenia and/or its impact on everyday functioning [52–54]. The following subtests from the Delis-Kaplan Executive Functioning System (D-KEFS) [55] were used to calculate an executive functioning composite: Trail Making (Letter-Number Sequencing Task), Color Word Inhibition (Switching condition), and the Letter Fluency task (total F, A, and S trials). The raw scores within each subtest were converted to z-scores using the Normalized Rank function of SPSS 24, and coded such that higher z-scores on each subtest represented better performance; a composite mean z-score was then calculated as the average across all three subtests for each individual.
Positive psychological factors.
Levels of positive psychological factors were measured with several self-report scales, including the four-item Happiness factor from the Center for Epidemiological Studies—Depression Scale [56], the Life Orientation Test—Revised (a measure of optimism) [57], the Connor-Davidson Resilience Scale– 10 item version [58, 59], the Perceived Stress Scale [60], and the Satisfaction with Life Scale [61].
Data analyses
NC versus schizophrenia group differences in sociodemographic and clinical characteristics, as well as positive psychological factors, were compared using independent t-tests for continuous variables, the Mann-Whitney U test for ordinal variables, and Pearson Chi-square for categorical variables. Significance was defined as p < .05; two tailed.
Primary data analyses of the UCLA-3 involved three steps: (1) comparison of factor analytic models, (2) evaluation of measurement invariance, and (3) examination of correlates of loneliness (UCLA-3) scores within each group, and comparison of the magnitude of those correlations between groups.
Initial primary data analyses compared factor analytic models of the UCLA-3 separately among the NCs and schizophrenia groups using confirmatory factor analysis (CFA). Four factor analytic models were specified and compared using CFA: (1) a unidimensional model with all 20 items loading onto a single latent loneliness factor and was specified following Hartshorne [32]; (2) a two-factor model corresponding to that of Wilson et al. [33], with eight items loading on a “Social Other” factor and 12 items on an “Intimate Other” factor; (3) a three-factor model paralleling that of Hawkley et al. [34], in which five items were specified to load on a “Relational Connectedness” factor, 11 items on an “Isolation” factor, and four items on a “Collective Connectedness” factor; and (4) a bifactor model that corresponded to that of Russell [30] in which all items were specified to load on a general factor reflecting individual differences on the target loneliness dimension and one of two orthogonal method factors corresponding to positive and negative item wording. Table 1 presents a mapping of items in the one, two, three, and bifactor models under investigation. After establishing best fitting factor models, internal consistency of CFA-derived UCLA scales was evaluated with Cronbach’s alpha.
Following the recommendations of Brown [29] and Kline [62], multiple goodness-of-fit indices were evaluated to determine model fit and comparative superiority. Fit indices evaluated were the model chi-square, Root Mean Square Error of Approximation (RMSEA) [63], Bentler Comparative Fit Index (CFI) [64], the Tucker-Lewis Index (TLI) [65], and the Standardized Root Mean Square Residual (SRMR). Values indicating acceptable fit on each index were as follows: RMSEA close to .06 or below; SRMR close to .08 or below; CFI close to .95 or greater; and TLI close to .95 or greater [66].
The second data analytic step involved evaluating measurement invariance of the UCLA-3 across NC and schizophrenia groups using multiple groups CFA [67]. Invariance testing in multiple groups CFA is a multi-step procedure in which a hierarchical sequence of increasingly restrictive models is evaluated. Restriction of models is achieved by imposing additional equivalency constraints on parameter estimates across groups. Models evaluated to establish measurement invariance were, in order of evaluation, a configural invariant model (with equivalent factor structure), a weak invariant model (with equivalent item-factor loadings), and a strong invariant model (with equivalent item-intercepts). Strict invariance, in which item residuals are constrained to equivalence, was not evaluated, as item residuals are comprised in part of random error variance and are thus not expected to be equivalent across groups. Moreover, Little [68] has argued that enforcing strict invariance can distort subsequent parameter estimates and most authors contend that strict invariance is not required to establish measurement invariance [29, 68, 69]. Following the establishment of measurement invariance, differences in latent construct variances and means were evaluated across groups by constraining equivalence on these latent parameters. To anticipate what will be discussed in the Results section below, mean levels of underlying latent factors were found to be different across groups. To describe mean differences in the latent loneliness construct, effect sizes of latent mean differences were calculated in terms of Hancock’s [70] latent mean difference analogue of Cohen’s d.
Criteria for measurement invariance followed the recommendations of Little [68], in which distinct criteria were used to evaluate configural invariance, weak and strong invariance, and equivalency of latent construct variances and means. Configural invariance was assessed by determining whether the same factor model with the same pattern of item-factor loadings exhibited acceptable fit across groups separately and when both groups were combined into a single, larger group. Weak and strong invariance was determined by evaluating the change in CFI values across successive models, with a change of < .01 in CFI indicating invariance across groups [71]. Finally, group differences on latent variances and means were evaluated by inspecting change in X2 values over successive models, with significant X2 change values indicating group differences in latent parameters.
Rhemtulla, Brosseau-Liard, & Savalie [72] have argued that items on Likert-type scales consisting of less than five response categories should be treated as categorical, instead of continuous, variables. As such, we used robust weighted least squares, a method appropriate for categorical variables, to estimate all CFA models [29]. Effects coding was used to set latent variable scales in all CFA models, with one exception. Owing to difficulties establishing model convergence, user-provided start values were required in the latent mean invariance multiple group CFA model, thereby necessitating standardized latent variance scaling.
The third data analytic step involved analysis of sociodemographic, clinical, and positive psychological correlates of loneliness. Pearson’s product moment correlation coefficient was calculated between the UCLA-3 and continuous variables, Spearman’s rank-order correlation coefficient between the UCLA-3 and ordinal variables, and point-biserial correlation coefficients between the UCLA-3 and binary variables. In addition, analysis of variance was conducted to explore differences on the UCLA-3 across levels of non-binary nominal variables (i.e., living situation). Comparisons between groups on the magnitude of Pearson’s product moment correlation coefficients were then conducted using Wilcox-Muska’s bootstrapped test for independent correlations [73, 74]. The Wilcox-Muska test uses a percentile bootstrap method to construct a 95% confidence interval of the difference in two independent correlations. Confidence intervals that do not overlap with 0 are interpreted as statistically significant. For Spearman’s rank-order correlation coefficients, bootstrapped 95% confidence intervals were computed separately for relevant variables within schizophrenia and NC groups. Non-overlapping 95% confidence intervals across schizophrenia and NC groups were deemed significant.
All analyses were conducted in R version 3.3.3 [75]. The lavaan package [76] was used for confirmatory factor modeling. The psych package [77] was used to compute Chronbach’s alpha on CFA-derived UCLA-3 scales and to calculate bootstrapped 95% confidence intervals around Spearman’s rank-order correlation coefficients, and the stats package [75] was used to calculate correlations with external variables. Finally, the WRS2 package [78] was used to calculate the Wilcox-Muska’s test of difference between independent correlation coefficients. See S1 File for data used in this study.
Results
Group differences on sociodemographic, clinical, and positive psychological variables
The NC group had significantly higher mean education higher socioeconomic status and higher personal and family income and were more likely to be married and living with someone else. NC and schizophrenia groups did not differ in age, ethnicity, or gender (Table 2). The schizophrenia group had, as expected, worse clinical and positive psychological functioning, as evidenced by higher levels of depression, anxiety, and perceived stress, and lower levels of executive functioning, mental well-being, physical well-being, happiness, optimism, resilience, and satisfaction with life.
Factor analyses
The chi-square index of model fit was significant for all factor models other than the bifactor model in both NC and schizophrenia groups (Table 3). Notably, the Chi-square goodness-of-fit index is often significant among adequately fitting models due to its sensitivity to large sample size [29]. Therefore, additional fit measures were inspected to determine model fit and comparative superiority. In both NC and schizophrenia groups, the three-factor model exhibited near acceptable fit while the bifactor model exhibited consistently acceptable fit according to Hu and Bentler [66] criteria. Of these two models, the bifactor model exhibited superior relative fit across all indices. Therefore, the bifactor model was deemed the best-fitting model in both groups.
Given that factor analyses revealed a single underlying loneliness dimension after accounting for method effects, Cronbach’s alpha was calculated on the total score of the UCLA-3 as a measure of internal consistency. This total score exhibited an alpha coefficient of .94 (95% CI = .92–.95) in the NC group and .90 (95% CI = .88–.93) in the schizophrenia group. These values represent an excellent level of internal consistency [79].
Invariance testing across groups
Table 4 presents fit information for invariance assessment of the UCLA-3 across NC and schizophrenia groups. Configural invariance was established by determining that the same factor model—i.e., Russell’s [30] bifactor model—exhibited acceptable fit for both groups separately and after combining the two groups into a single, larger sample. Inspection of Table 3 reveals that the change in CFI values did not exceed .01 in successive models in the weak or strong invariant models. Taken together, this suggests that the UCLA-3 exhibited the same factor structure (configural invariance), level of item-factor loadings (weak invariance), and item intercept levels (strong invariance) across groups, thus establishing measurement invariance of the UCLA-3. Figs 1 and 2 present depictions of the completely standardized final factor model of the UCLA-3 after imposing measurement invariance across groups.
Note. Depicted are the completely standardized parameter estimates of the final measurement invariance model; equality constraints were imposed on the unstandardized parameter estimates.
Note. Depicted are the completely standardized parameter estimates of the final measurement invariance model; equality constraints were imposed on the unstandardized parameter estimates.
Subsequent models tested the equivalence of latent parameter estimates—i.e., latent factor variances and means—across groups. While the equivalent latent variance model did not exhibit a significant change in X2, the equivalent latent means model did, indicating group differences on the latent factor means underlying the UCLA-3. As can be seen in Table 3, the mean levels of the Loneliness, Positive Wording, and Negative Wording latent factors all differed across groups. After controlling for item wording-related method effects, the schizophrenia group reported a .954 standard deviation higher mean level of loneliness than the NC group.
Association of loneliness with sociodemographics and clinical characteristics and positive psychological characteristics
The overall pattern of correlations between the UCLA-3 total score and demographic, clinical, and positive psychological variables was similar in NC and schizophrenia groups (Table 5)—i.e., in both NC and schizophrenia groups, loneliness correlated positively with current social position, depression, anxiety, and perceived stress, and negatively with mental well-being, happiness, resilience, optimism, and satisfaction with life. In contrast, age and personal income correlated negatively and longest held social position correlated positively with loneliness in the NC, but not in the schizophrenia group. However, among individuals with schizophrenia, younger age of schizophrenia onset and positive, but not negative, symptom severity were associated with loneliness. Comparisons of the magnitude of correlation coefficients in the NC versus schizophrenia groups revealed significantly higher magnitude correlations among the NC versus schizophrenia groups in terms of the correlations between loneliness and age, optimism, and satisfaction with life. Magnitude of correlation coefficients across groups did not differ on any other sociodemographic factor other than age. In addition, loneliness did not differ across individuals who resided alone (M = 37.18, SD = 10.69) or resided with someone else (M = 33.99, SD = 10.30) in the NC group, t(104) = 1.29, p = .20, or who resided alone (M = 47.95, SD = 10.14), resided with someone else (M = 47.44, SD = 13.54), or resided in a Board and Care facility (M = 44.54, SD = 8.96) in the schizophrenia group, F(2,113) = 1.14, p = .32.
Discussion
To our knowledge, this was the first study to explore the factor structure and psychometric properties of the UCLA-3 among individuals with schizophrenia, as well as being the first to evaluate the equivalency of this measure across NC and schizophrenia groups. Comparisons between previously proposed factor models of this scale revealed that a bifactor model in which all items loaded on a general loneliness factor and one of two orthogonal method factors exhibited the best fit within both schizophrenia and NC groups. Furthermore, the UCLA-3 exhibited equivalent measurement of these latent factors across groups and excellent internal consistency within both groups. Taken together, these results indicate that, after accounting for method effects related to item wording, loneliness in schizophrenia and NC individuals is a unidimensional construct, that this construct is similar across groups, and that the UCLA-3 measures this construct in an equivalent fashion across groups. This indicates that the UCLA-3 is appropriate for making cross-group comparisons between NC and schizophrenia groups.
These factor analytic findings supporting a bifactor model are consistent with several previous studies of the UCLA-3 conducted in NC samples [30, 37]. Others, however, have found one [32], two [33, 80], and three [31, 34, 35] factor models as best fitting this measure in NC samples. However, many of these conflicting studies were conducted on prior versions of the UCLA Loneliness Scale [32, 33, 35, 80], which used more complex wording (e.g., double negatives) and so, may not generalize to the UCLA-3. In addition, none of these alternative models have previously been compared to Russell’s bifactor model. Comparison to this latter model was particularly important because apparent multidimensionality can often arise in scales due to failure to control for method effects or item content groupings [36]. The findings of the current study suggest that, after accounting for method effects due to item wording, intrapersonal, interpersonal, and broader group-level feelings of loneliness are strongly inter-related and cannot be disentangled among persons with schizophrenia and NC individuals.
The similarity in the construct of loneliness across NC and schizophrenia groups was further supported by the similarity in their profiles of loneliness correlates. Specifically, loneliness was similarly positively correlated with current social position, depression, anxiety, and perceived stress, and negatively correlated with mental well-being, happiness, and resilience in both groups. Moreover, the magnitude of correlation coefficients across groups did not differ for gender, education, marital status, highest and longest social status position, personal and family income, executive functioning, or physical well-being. This similar profile of correlates occurred despite differences in mean levels of loneliness across groups, with individuals with schizophrenia reporting mean levels of loneliness nearly a standard deviation higher than those in NC persons. These differences in mean levels are consistent with those seen in several prior studies [21–25]. Overall, these findings suggest that while loneliness is more severe in schizophrenia, it likely operates in a broadly similar fashion among NCs and individuals with schizophrenia. In particular, loneliness appears to be accompanied by a similar increase in perceived stress, presumably due to enhanced vigilance for social threat, and is associated with worse emotional health in both groups. This further suggests that previously proposed cognitive biases accompanying loneliness in NC populations might also be present in schizophrenia. Loneliness in schizophrenia is thus likely not a mere proxy for some other schizophrenia-related deficit (e.g., depression, negative symptoms, etc.), but rather is a distinct phenomenon with clinically meaningful negative effects. Given the high prevalence and negative impact of loneliness in schizophrenia, additional clinical attention to this important phenomenon is warranted.
Despite this overall similarity, there were a few differences in the magnitude of correlations across groups. Specifically, NC individuals exhibited a stronger positive association between loneliness and age than individuals with schizophrenia, for whom this correlation was not significant. A likely explanation for this finding is that the age-related socio-environmental factors that contribute to the association of age with loneliness in the general population may be less relevant in schizophrenia, such as marital quality and losing a partner [81]. In addition, NCs exhibited a stronger negative association between loneliness and optimism and satisfaction with life than persons with schizophrenia, despite the statistical significance of both of these correlations within the two groups. It may be the case that, due to the larger number of clinical (e.g., positive symptoms, negative symptoms, depression) and socio-environmental (e.g., unemployment, financial concerns) challenges in schizophrenia, there are more determinants of optimism and satisfaction with life, leading any single determinant to have a relatively weaker impact in schizophrenia as opposed to the general population.
More broadly, this latter point speaks to the potential for the unique clinical features of schizophrenia to alter the correlation of loneliness with other sociodemographic, clinical, and positive psychological factors. For instance, positive symptoms, which are positively correlated with loneliness, often diminish over the course of the lifespan among individuals with schizophrenia [82]. It is thus possible that diminished levels of positive symptoms in older age may in turn reduce the correlation of loneliness with age. We re-ran the current analyses statistically adjusting for unique clinical features of schizophrenia that were significantly correlated with loneliness. Positive symptoms were the only features that fit these criteria. Statistically adjusting models for positive symptoms did not substantively change the correlations within the schizophrenia group or the significance of differences in magnitude of correlation coefficients across schizophrenia and NC groups, indicating that this unique clinical feature does not confound the results of the current study. Nonetheless, there are other clinical features that are unique to schizophrenia, such as internalized stigma, that we did not collect data on and thus were not able to statistically control for. Future research aimed at evaluating loneliness across schizophrenia and non-schizophrenia groups should attempt to ascertain the impact of and, when necessary, control for these unique factors.
In addition, it should be noted that schizophrenia and NC groups differ not only in diagnostic status, but also in the social environments that they inhabit. In this regard, it may be necessary to distinguish between the direct effects of schizophrenia on loneliness versus the effects of schizophrenia on socioeconomic status, as the two paths may have different implications for treatment or policy. In general, individuals with schizophrenia are less likely to be employed, married, and live with someone else and typically have lower social status and personal incomes [8–10]. In addition, the communities in which they reside tend to have fewer opportunities and resources [11–13]. Taken together, it is likely that individuals with schizophrenia are objectively more socially isolated than NC individuals, which may impact their subjective perception of social isolation (i.e., loneliness). While research in the general population has typically not found that objective social isolation and loneliness are correlated with one another (largely due to individual differences in the need and desire for social contact), this issue has not been explored in schizophrenia [83]. In the current study, we found that most aspects of one’s social environment were not correlated with loneliness in the schizophrenia group, including marital status, living situation, and personal income, although current social status position and family income were. In addition, the magnitude of correlation coefficients of loneliness with each social factor examined in the current study did not differ across schizophrenia and NC groups, suggesting that these social factors have a similar impact in both populations.
Notably, however, one’s social environment consists of many more relevant characteristics than those measured in the present study. These characteristics include the physical aspects of one’s community (e.g., availability of community resources), social aspects of one’s community (e.g., community cohesion, stability/turnover rates of residence, quantity and quality of social relationships), and psychological aspects of one’s community (e.g., sense of community belonging), among others [84]. Previous research has found that relative to community-matched non-psychiatric individuals, individuals with schizophrenia and other psychiatric disabilities often report lower use of and engagement with community resources [11, 12] and lower quality and quantity of social relationships [11, 12, 85], but report a similar sense of community belonging [13, 85] and satisfaction with life [13]. These findings parallel the lack of an association between objective and subjective aspects of social isolation found in the general population. However, the similarity in subjective perception of community belonging across community-matched schizophrenia and non-psychiatric groups is somewhat inconsistent with the finding of higher levels of loneliness among individuals with schizophrenia relative to non-psychiatric individuals, which was found in the current study and in several previous studies [21–25]. It may be the case that subjective sense of belonging within the community is related to but only partially overlaps with the construct of loneliness. Consistent with this, some factor models of loneliness distinguish between “Isolation” (feelings of aloneness, rejection, and withdrawal), “Relational Connectedness” (feelings of familiarity, closeness and support), and “Collective Connectedness” (feelings of group identification and cohesion), with only this latter dimension likely overlapping with sense of community belonging [34]. Future research should explore the role of these finer-grained physical, social, and psychological aspects of the social environment in relation to loneliness in schizophrenia.
Many of the correlations with loneliness in NC and schizophrenia groups found in the current study are consistent with those found in previous research. Previous research has similarly shown an association of loneliness with poorer emotional and physical health, perceived stress, and reduced quality of life, as well as mild increases in loneliness in middle adulthood in the general population [3, 4, 86]. In contrast, inconsistent with previous research, we did not find an association between loneliness and cognition, which may be due to the relatively low levels of loneliness within our NC group. Within the schizophrenia group, similar to previous research, loneliness was positively associated with depression [25], anxiety [28], and positive symptoms [26, 28], and negatively correlated with satisfaction with life [16, 17]. We expanded on this research by demonstrating that loneliness was associated with a broader range of clinical and positive psychological characteristics, including age of schizophrenia onset, mental well-being, perceived stress, optimism, resilience, and happiness.
One limitation of the present study is that the sample size was somewhat small for factor-analytic purposes [29]. Nonetheless, we were able to derive an adequately fitting factor model and document significant correlates of loneliness. A second limitation is that we were unable to explore all psychometric features of the UCLA-3; additional research is needed to evaluate the test-retest reliability, convergent validity, and discriminant validity of this measure among people with schizophrenia. Thirdly, our results may not generalize to patients with more severe illness such as the institutionalized ones or to people from other racial/ethnic groups. Also, we do not know if our findings are specific to schizophrenia or also apply to other serious mental illnesses. Finally, we did not collect information on physical, social, and psychological aspects of the community integration or neighborhood characteristics. These factors may impact levels of loneliness, and thus should be collected as part of future studies.
Research among NC samples has shown that loneliness can lead to negative physical, cognitive, and emotional health outcomes over time [4]. Although cross-sectional results show that loneliness is associated with poor physical and emotional health in schizophrenia, it remains to be seen if loneliness predicts declines in these areas longitudinally [15, 23, 25, 26]. Prospective longitudinal research may also help clarify the factors that may predispose individuals with schizophrenia to loneliness, including psychological factors (e.g., distorted beliefs) and/or social-environmental factors (e.g., poverty, community integration, and housing circumstances). Finally, given its high prevalence and association with factors contributing to worse quality of life and physical and emotional health in schizophrenia, loneliness may be a promising target for interventional research.
Despite the above limitations, the present findings are important in documenting similarities in the construct of loneliness and its correlates across NC and schizophrenia groups. In both groups, loneliness was associated with increased perceived stress and worse emotional health and satisfaction with life. Loneliness thus appears to be distinct from other schizophrenia-related deficits and is an important yet under-recognized problem in schizophrenia. Loneliness needs to be studied as a specific target for intervention research in persons with this serious mental illness.
Acknowledgments
The authors wish to express their gratitude to Rebecca Daly for management of the data for this report.
References
- 1. Holland E. The government’s role in combating loneliness. The Wall Street Journal. 2017 September 12, 2017.
- 2.
McGregor J. This former surgeon general says there’s a ‘loneliness epidemic’ and work is partly to blame. The Washingon Post. 2017 October 4, 2017.
- 3.
Persons AAoR. Loneliness among older adults: A national survy of adults 45+. AARP The Magazine [Internet]. 2010.
- 4. Hawkley LC, Cacioppo JT. Loneliness matters: a theoretical and empirical review of consequences and mechanisms. Ann Behav Med. 2010;40(2):218–27. pmid:20652462.
- 5. Rosenberg PB, Mielke MM, Appleby BS, Oh ES, Geda YE, Lyketsos CG. The association of neuropsychiatric symptoms in MCI with incident dementia and Alzheimer disease. The American journal of geriatric psychiatry: official journal of the American Association for Geriatric Psychiatry. 2013;21(7):685–95. Epub 2013/04/10. pmid:23567400.
- 6. Rosenberg PB, Mielke MM, Xue QL, Carlson MC. Depressive symptoms predict incident cognitive impairment in cognitive healthy older women. The American journal of geriatric psychiatry: official journal of the American Association for Geriatric Psychiatry. 2010;18(3):204–11. Epub 2010/03/13. pmid:20224517.
- 7. Donovan NJ, Okereke OI, Vannini P, Amariglio RE, Rentz DM, Marshall GA, et al. Association of Higher Cortical Amyloid Burden With Loneliness in Cognitively Normal Older Adults. JAMA psychiatry. 2016;73(12):1230–7. Epub 2016/11/03. pmid:27806159.
- 8. Dickerson FB, Sommerville J, Origoni AE, Ringel NB, Parente F. Experiences of stigma among outpatients with schizophrenia. Schizophrenia Bulletin. 2002;28(1):143–55. Epub 2002/06/06. pmid:12047014.
- 9. Marwaha S, Johnson S. Schizophrenia and employment—a review. Social psychiatry and psychiatric epidemiology. 2004;39(5):337–49. Epub 2004/05/11. pmid:15133589.
- 10. Cohen CI. Poverty and the course of schizophrenia: implications for research and policy. Hospital & community psychiatry. 1993;44(10):951–8. Epub 1993/10/01. pmid:8225275.
- 11. Abdallah C, Cohen CI, Sanchez-Almira M, Reyes P, Ramirez P. Community integration and associated factors among older adults with schizophrenia. Psychiatric Services. 2009;60(12):1642–8. pmid:19952155
- 12. Yanos PT, Stefanic A, Tsemberis S. Objective community integration of mental health consumers living in supported housing and of others in the community. Psychiatric Services. 2012;63(5):438–44. pmid:22549530
- 13. Yanos PT, Stefanic A, Tsemberis S. Psychological community integration among people with psychiatric disabilities and nondisabled community members. Journal of Community Psychology. 2011;39(4):390–401.
- 14. Stain HJ, Galletly CA, Clark S, Wilson J, Killen EA, Anthes L, et al. Understanding the social costs of psychosis: the experience of adults affected by psychosis identified within the second Australian National Survey of Psychosis. Aust N Z J Psychiatry. 2012;46(9):879–89. pmid:22645395.
- 15. Badcock JC, Shah S, Mackinnon A, Stain HJ, Galletly C, Jablensky A, et al. Loneliness in psychotic disorders and its association with cognitive function and symptom profile. Schizophr Res. 2015;169(1–3):268–73. pmid:26527247.
- 16. Weiner A, Roe D, Mashiach-Eizenberg M, Baloush-Kleinman V, Maoz H, Yanos PT. Housing model for persons with serious mental illness moderates the relation between loneliness and quality of life. Community Ment Health J. 2010;46(4):389–97. pmid:20035384.
- 17. Roe D, Mashiach-Eizenberg M, Lysaker PH. The relation between objective and subjective domains of recovery among persons with schizophrenia-related disorders. Schizophr Res. 2011;131(1–3):133–8. pmid:21669512.
- 18. Morgan VA, Waterreus A, Carr V, Castle D, Cohen M, Harvey C, et al. Responding to challenges for people with psychotic illness: Updated evidence from the Survey of High Impact Psychosis. Australian & New Zealand Journal of Psychiatry. 2017;51(2):124–40.
- 19. Cacioppo JT, Hawkley LC, Ernst JM, Burleson M, Bertnson GG, Nouriani B, et al. Loneliness within a nomological net: An evolutionary perspective. Journal of Research in Personality. 2006;40(6):1054–85.
- 20. Cacioppo JT, Hawkley LC. Perceived social isolation and cognition. Trends in cognitive sciences. 2009;13(10):447–54. Epub 2009/09/04. pmid:19726219.
- 21. Brown C. A comparison of living situation and loneliness for people with mental illness. Psychiatric Rehabilitation Journal. 1996;20(2):59–63.
- 22. Chrostek A, Grygiel P, Anczewska M, Wciorka J, Switaj P. The intensity and correlates of the feelings of loneliness in people with psychosis. Compr Psychiatry. 2016;70:190–9. pmid:27560792.
- 23. Michael J, Park S. Anomalous bodily experiences and perceived social isolation in schizophrenia: An extension of the Social Deafferentation Hypothesis. Schizophr Res. 2016;176(2–3):392–7. pmid:27344986.
- 24. Shioda A, Tadaka E, Okochi A. Loneliness and related factors among people with schizophrenia in Japan: a cross-sectional study. J Psychiatr Ment Health Nurs. 2016;23(6–7):399–408. pmid:27485911.
- 25. Tremeau F, Antonius D, Malaspina D, Goff DC, Javitt DC. Loneliness in schizophrenia and its possible correlates. An exploratory study. Psychiatry Res. 2016;246:211–7. pmid:27721059.
- 26. Lamster F, Lincoln TM, Nittel CM, Rief W, Mehl S. The lonely road to paranoia. A path-analytic investigation of loneliness and paranoia. Compr Psychiatry. 2017;74:35–43. pmid:28092774.
- 27. Tharayil D. Self, social, and family perceptions in relation to loneliness controlling for depression among individuals with schizophrenia. The Internet Journal of Mental Health. 2006;4(1):1–14.
- 28. Sundermann O, Onwumere J, Kane F, Morgan C, Kuipers E. Social networks and support in first-episode psychosis: exploring the role of loneliness and anxiety. Soc Psychiatry Psychiatr Epidemiol. 2014;49(3):359–66. pmid:23955376.
- 29.
Brown TA. Confirmatory factor analysis for applied research. Little TD, editor. New York: Guilford Press; 2006.
- 30. Russell DW. UCLA Loneliness Scale (Version 3): reliability, validity, and factor structure. J Pers Assess. 1996;66(1):20–40. pmid:8576833.
- 31. Shevlin M, Murphy S, Murphy J. The latent structure of loneliness: testing competing factor models of the UCLA Loneliness Scale in a large adolescent sample. Assessment. 2015;22(2):208–15. pmid:25022276.
- 32. Hartshorne TS. Psychometric properties and confirmatory factor analysis of the UCLA loneliness scale. J Pers Assess. 1993;61(1):182–95. pmid:16370798.
- 33. Wilson D, Cutts J, Lees I, Mapungwana S, Maunganidze L. Psychometric properties of the revised UCLA Loneliness Scale and two short-form measures of loneliness in Zimbabwe. J Pers Assess. 1992;59(1):72–81. pmid:1512681.
- 34. Hawkley LC, Browne MW, Cacioppo JT. How can I connected with thee? Let me count the ways. Psychological Science. 2005;16(10):798–804. pmid:16181443
- 35. Dussault M, Fernet C, Austin S, Leroux M. Revisiting the factorial validity of the Revised UCLA Loneliness Scale: a test of competing models in a sample of teachers. Psychol Rep. 2009;105(3 Pt 1):849–56. pmid:20099547.
- 36. Reise SP, Moore TM, Haviland MG. Bifactor models and rotations: exploring the extent to which multidimensional data yield univocal scale scores. J Pers Assess. 2010;92(6):544–59. Epub 2010/10/19. pmid:20954056.
- 37. Durak M, Senol-Durak E. Psychometric Qualities of the UCLA Loneliness Scale-Version 3 as Applied in a Turkish Culture. Educational Gerontology. 2010;36(10–11):988–1007.
- 38. Hong S, Lee EE, Martin AS, Soontornniyomkij B, Soontornniyomkij V, Achim CL, et al. Abnormalities in chemokine levels in schizophrenia and their clinical correlates. Schizophr Res. 2017;181:63–9. Epub 2016/09/22. pmid:27650194.
- 39. Lee EE, Eyler LT, Wolkowitz OM, Martin AS, Reuter C, Kraemer H, et al. Elevated plasma F2-isoprostane levels in schizophrenia. Schizophr Res. 2016;176(2–3):320–6. Epub 2016/06/20. pmid:27318521.
- 40.
First MB, Spitzer RL, Miriam G, Williams JBW. Structured clinical interview for DSM-IV-TR axis I disorders, research version, patient edition (SCID-I/P). New York: New York State Psychiatric Institute; 2002.
- 41. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. The Journal of clinical psychiatry. 1998;59 Suppl 20:22–33;quiz 4–57. Epub 1999/01/09. pmid:9881538.
- 42.
Organization WH. Introduction to Drug Utilization Research. In: Organization WH, editor. Oslo, Norway2003.
- 43. Sweileh WM, Odeh JB, Shraim NY, Zyoud SH, Sawalha AF, Al-Jabi SW. Evaluation of Defined Daily Dose, percentage of British National Formulary maximum and chlorpromazine equivalents in antipsychotic drug utilization. Saudi pharmaceutical journal: SPJ: the official publication of the Saudi Pharmaceutical Society. 2014;22(2):127–32. Epub 2014/03/22. pmid:24648824.
- 44.
Hollingshead AB. Four factor index of social position. 1975.
- 45. Vassar M, Crosby JW. A reliability generalization study of coefficient alpha for the UCLA loneliness scale. J Pers Assess. 2008;90(6):601–7. pmid:18925502.
- 46. Lasgaard M. Reliability and validity of the Danish version of the UCLA Loneliness Scale. Personality and Individual Differences. 2007;42(7):1359–66.
- 47. Stein CH, Aguirre R, Hunt MG. Social networks and personal loss among young adults with mental illness and their parents: A family perspective. Psychiatric Rehabilitation Journal. 2013;36(1):15–21. pmid:23477645
- 48.
Andreasen NC. Scale for the Assessment of Negative Symptoms (SANS). In: Iowa Uo, editor. Iowa City, Iowa1983.
- 49.
Andreasen NC. Scale for the Assessment of Positive Symptoms (SAPS). In: Iowa Uo, editor. Iowa City, Iowa1984.
- 50. Derogatis LR, Melisaratos N. The Brief Symptom Inventory: an introductory report. Psychological medicine. 1983;13(3):595–605. Epub 1983/08/01. pmid:6622612.
- 51. Addington D, Addington J, Maticka-Tyndale E. Assessing depression in schizophrenia: the Calgary Depression Scale. The British journal of psychiatry Supplement. 1993;(22):39–44. Epub 1993/12/01. pmid:8110442.
- 52. Fucetola R, Seidman LJ, Kremen WS, Faraone SV, Goldstein JM, Tsuang MT. Age and neuropsychologic function in schizophrenia: a decline in executive abilities beyond that observed in healthy volunteers. Biological psychiatry. 2000;48(2):137–46. Epub 2000/07/21. pmid:10903410.
- 53.
Palmer BW, Heaton RK. Executive dysfunction in schizophrenia. In: Sharma T, Harvey P, editors. Cognition in schizophrenia: Impairments, importance, and treatment strategies. New York: Oxford University Press; 2000. p. 52–72.
- 54. Wobrock T, Ecker UK, Scherk H, Schneider-Axmann T, Falkai P, Gruber O. Cognitive impairment of executive function as a core symptom of schizophrenia. The world journal of biological psychiatry: the official journal of the World Federation of Societies of Biological Psychiatry. 2009;10(4 Pt 2):442–51. Epub 2008/07/09. pmid:18609418.
- 55.
Delis D, Kaplan E, Kramer J. Delis-Kaplan Executive Functioning Scale (D-KEFS): Examiner’s manual. San Antonio, TX: The Psychological Corporation; 2001.
- 56. Radloff LS. The CES-D scale: a self-report depression scale for research in the general population. Aplied Psychological Measurement. 1973;1(3):385–401.
- 57. Scheier MF, Carver CS, Bridges MW. Distinguishing optimism from neuroticism (and trait anxiety, self-mastery, and self-esteem): a reevaluation of the Life Orientation Test. J Pers Soc Psychol. 1994;67(6):1063–78. Epub 1994/12/01. pmid:7815302.
- 58. Connor KM, Davidson JR. Development of a new resilience scale: the Connor-Davidson Resilience Scale (CD-RISC). Depression and anxiety. 2003;18(2):76–82. Epub 2003/09/10. pmid:12964174.
- 59. Campbell-Sills L, Stein MB. Psychometric analysis and refinement of the Connor-davidson Resilience Scale (CD-RISC): Validation of a 10-item measure of resilience. Journal of traumatic stress. 2007;20(6):1019–28. Epub 2007/12/25. pmid:18157881.
- 60. Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. Journal of health and social behavior. 1983;24(4):385–96. Epub 1983/12/01. pmid:6668417.
- 61. Diener E, Emmons RA, Larsen RJ, Griffin S. The Satisfaction With Life Scale. J Pers Assess. 1985;49(1):71–5. Epub 1985/02/01. pmid:16367493.
- 62.
Kline RB. Principle and practices of structural equation modeling. Fourth edition ed. Little TD, editor. New York: Guilford Press; 2016.
- 63. Steiger JH. Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research. 1990;25:173–80. pmid:26794479
- 64. Bentler PM. Comparative fit indexes in structural models. Psychological Bulletin. 1990;107:238–46. pmid:2320703
- 65. Tucker LR, Lews C. A reliability coefficient for maximum likelihood factor analysis. Psychometrika. 1973;38:1–10.
- 66. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structural analysis: Conventional criteria versus new alternatives. Structural Equation Modeling. 1999;6:1–55.
- 67.
Widaman KF, Reise SP. Exploring the measurement invariance of psychological instruments: Applications in the substance use domain. In: Bryant KJ, Windle M, West SG, editors. The science of prevention: Methodological advances from alcohol and substance abuse research. Washington, D.C.: American Psychological Association; 1997. p. 281–324.
- 68.
Little TD. Longitudinal structural equation modeling. New York: The Guilford Press; 2013.
- 69.
Beaujean AA. Latent variable modeling using R: A step-by-step guide. New York, NY: Taylor & Francis Group; 2014.
- 70. Hancock GR. Effect size, power, and sample size determination for structured means modeling and MIMIC approaches to between-groups hypothesis testing of means on a single latent construct. Psychometrika. 2001;66(3):373–88.
- 71. Cheung GW, Rensvold RB. Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal. 2002;9:233–55.
- 72. Rhemtulla M, Brosseau-Liard PE, Savalei V. When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological methods. 2012;17(3):354–73. Epub 2012/07/18. pmid:22799625.
- 73. Wilcox R, Muska J. Comparing correlation coefficients. Communications in Statistics—Simulation and Computation. 2002;31:49–59.
- 74. Wilcox R. Comparing Pearson correlations: Dealing with heteroscedasticity and nonnormality. Communications in Statistics—Simulation and Computation. 2009;38(10):2220–34.
- 75.
Team RC. R: A langauge and environment for statistical computing. In: Computing RFfS, editor. Vienna, Austria2017.
- 76. Rosseel Y. lavaan: An R pacakge for structural equation modeling. Journal of Statistical Software. 2012;48(2):1–36.
- 77.
Revelle W. psych: Procedures for personality and psychological research. Evanston, Illinois: Northwestern University; 2017.
- 78.
Mair P, Schoenbrodt F, Wilcox R. WRS2: Wilcox robust estimation and testing. 2017.
- 79.
George D, Mallery P. SPSS for Windows step by tstep: A simple guide and reference. 11.0 update. Fourth edition ed. Boston: Allyn & Bacon; 2003.
- 80. Joiner TE Jr., Lewinsohn PM, Seeley JR. The core of loneliness: lack of pleasurable engagement—more so than painful disconnection—predicts social impairment, depression onset, and recovery from depressive disorders among adolescents. J Pers Assess. 2002;79(3):472–91. pmid:12511016.
- 81. Qualter P, Vanhalst J, Harris R, Van Roekel E, Lodder G, Bangee M, et al. Loneliness across the life span. Perspectives on psychological science: a journal of the Association for Psychological Science. 2015;10(2):250–64. Epub 2015/04/25. pmid:25910393.
- 82. Jeste DV, Twamley EW, Eyler Zorrilla LT, Golshan S, Patterson TL, Palmer BW. Aging and outcome in schizophrenia. Acta psychiatrica Scandinavica. 2003;107(5):336–43. Epub 2003/05/20. pmid:12752029.
- 83. Coyle CE, Dugan E. Social isolation, loneliness and health among older adults. Journal of aging and health. 2012;24(8):1346–63. Epub 2012/09/26. pmid:23006425.
- 84. Won YL, Solomon PL. Community integration of persons with psychiatric disabilities in supportive independent housing: a conceptual model and methodological considerations. Mental health services research. 2002;4(1):13–28. Epub 2002/07/02. pmid:12090303.
- 85. Aubrey T, Myner J. Community integration and quality of life: A comparison of persons with psychiatric disabilities in housing programs and community residents who are neighbours. Canadian Journal of Community Mental Health. 1996;15(5):5–20.
- 86.
Demakakos P, Nunn S, Nazroo J. Loneliness, relative deprivation and life satisfaction. In: Banks J, Breeze E, Lessof C, Nazroo J, editors. Retirement, health and relationships of the older population in England: The 2004 English Longitudinal Study of Ageing. London: Institute for Fiscal Studies; 2006.