http://orcid.org/0000-0003-3941-9434
Figures
Abstract
Frequent users of hospital emergency departments (EDs) are a medically and socially vulnerable population. The Coordinated Access to Care from Hospital EDs (CATCH-ED) study examined the effectiveness of a brief case management intervention in reducing ED use and improving health outcomes among frequent ED users with mental health or addiction challenges in a large urban centre. Adults (≥18 years of age) who had five or more ED visits in the past 12-months, with at least one visit for mental health or addictions problems were randomized to either brief case management (N = 83) or usual care (N = 83) and followed for 12 months. The primary outcome of effectiveness was the frequency of ED visits during 12 months after study enrolment. Secondary outcomes included days in hospital, mental health and addiction symptom severity and health-related quality of life, measured by the SF-12. Compared to usual care, CATCH-ED participants saw a 14% reduction in frequency of ED visits during the 12-month post-randomization period [rate ratio (RR) = 0.86, 95% CI 0.64–1.15)], however, this finding did not reach statistical significance. There were also no statistically significant differences between the groups at 12 months in the number of days spent in hospital (RR = 1.16, 95% CI 0.59–2.29), physical (1.50, 95% CI -2.15–5.15) or mental (-3.97, 95% CI -8.13–0.19) component scores of the SF-12, severity of psychiatric symptoms (-0.41, 95% CI -2.30–1.49), alcohol (0.053 95% -0.017–0.12) or drug (-0.0027, 95% CI -0.0028–0.023) use. Compared to usual care, a brief case management intervention did not result in significantly reduced ED use or improved health outcomes among frequent ED users with mental health or addictions challenges in a large urban centre in Canada. Future studies need to evaluate the availability and accessibility of community-based resources for individuals with frequent ED use.
Citation: Stergiopoulos V, Gozdzik A, Cohen A, Guimond T, Hwang SW, Kurdyak P, et al. (2017) The effect of brief case management on emergency department use of frequent users in mental health: Findings of a randomized controlled trial. PLoS ONE 12(8): e0182157. https://doi.org/10.1371/journal.pone.0182157
Editor: Jacobus P. van Wouwe, TNO, NETHERLANDS
Received: February 11, 2017; Accepted: July 10, 2017; Published: August 3, 2017
Copyright: © 2017 Stergiopoulos et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: To protect the confidentiality of study participants, study data are available only to researchers who meet the criteria for access to confidential data. External researchers interested in study data may contact the study Principal Investigator (VS) and submit a research ethics application to St. Michael's Hospital Research Ethics Board [Address: Research Ethics Office, St. Michael’s Hospital, 30 Bond St, Toronto, Ontario, M5B 1W8, Canada; Telephone:416-864-6060 Ext. 2557; Email: PatelD@smh.ca].
Funding: This trial was funded by BRIDGES, an initiative of the Ontario Ministry of Health and Long Term Care. The CATCH-ED intervention was initiated with funding and support from the Toronto Central Local Health Integration Network and sponsored by the Toronto Mental Health and Addictions Acute Care Alliance, and the Mental Health and Addictions Frequent Users Advisory Committee. Views in this manuscript are solely those of the authors. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Frequent users of emergency departments (EDs), often defined as those with four or more visits in a year [1], comprise a small proportion of ED users (4.5–8%), but account for 21–28% of all ED visits [2]. Although frequent ED users represent a heterogeneous population with diverse health needs [2], studies across jurisdictions have noted several commonalities, including high rates of acute and chronic medical conditions, mental illness and addictions [3, 4], homelessness [5, 6] and perceived unmet mental health needs [7, 8], when compared to non-frequent ED users. According to a systematic review, presenting complaints are likewise varied among frequent ED users and include worsening of existing chronic conditions, pain, substance or mental health related challenges and a variety of different complaints upon each visit [2]. However, mental health or substance misuse related reasons are very common [9, 10], particularly among the most frequent ED users [11]. While several studies have shown that frequent ED use is mostly episodic in nature, with only approximately 25–30% of frequent users in a given year maintaining similar levels of ED use in the following year [12, 13], a recent study observed that among the group of most frequent ED users (those with 18 or more ED visits/year) in the province of Manitoba, 70% had the same level of ED use in the calendar year prior to the study [10]. Interestingly, this most frequent ED user group had the highest rate of a physician-based diagnosis of a mental illness, compared to less frequent users [10], suggesting that the highest frequency ED users comprise a population with high rates of mental illness, addiction and complex unmet needs.
Many jurisdictions have implemented interventions to reduce frequent ED use in effort to reduce costs and improve health outcomes for this population. To date, case management has been the most studied intervention for frequent ED users [1, 14], resulting in significant reductions in ED use in two prior randomized controlled trials (RCTs) [15, 16]. However, a recent meta-analysis noted that care coordination strategies, including case management, were only effective in reducing ED visits among older patients and were not effective in reducing health service use among patients with mental illness [17]. As mental illness contributes to frequent ED use across jurisdictions [18], there is an urgent need for interventions that address the unique needs of this population.
The goal of the CATCH-ED trial was to assess the effectiveness of brief intensive case management in reducing ED utilization among frequent ED users with mental health or addiction challenges, in Toronto, Canada, over 12 months of follow up. Secondary outcomes of interest included days in hospital, physical and mental health status, alcohol and drug use. Exploratory outcomes included disease-specific quality of life and the number of hospital admissions. We hypothesized that brief intensive case management would lead to reduced acute health care use and improved health outcomes in this population, when compared to usual care.
Methods
Study design
We conducted a non-blinded parallel-group randomised controlled trial of a brief intensive case management intervention for frequent ED users implemented across 6 EDs in Toronto, Canada. Participants were recruited from November 2012 and September 2013 and followed for 12 months. The study protocol (S1 File) was approved by the research ethics boards of all 6 participating hospitals, which are affiliated with the University of Toronto and the Toronto Academic Health Science Network: Centre for Addiction and Mental Health, St. Michael’s Hospital, St. Joseph’s Health Centre, Sunnybrook Health Sciences Centre, Toronto East General Hospital and University Health Network. The study was registered with ClinicalTrials.gov (NCT01622244) on June 4, 2012. The study design has been described in detail elsewhere [19].
Setting
Toronto is Canada’s largest city, with 2.6 million residents in 2011 [20]], and has the highest concentration of health services in Canada [21]. Access to ED services is free for permanent residents of the province of Ontario and covered by the Ontario Health Insurance Plan (OHIP); with some minor exceptions (e.g. ambulance transports other than between hospitals). During 2013/14, the Toronto Central Local Health Integration Network (LHIN) reported that approximately 4.1% (N = 42,549) of all ED visits in central Toronto were for mental health and substance abuse-related reasons [21]. Based on 2013/14 data, repeat unscheduled ED visits for mental health and substance use reasons comprised 27.9% and 41.7%, respectively, of all repeat visits within 30 days [21].
Participants
Study participants were identified by ED clinicians at participating hospitals either via frequent user lists or automated flagging systems, and referred to the study team with participant consent. Study eligibility was further assessed by a member of the research team, who obtained written informed consent from eligible participants prior to study enrolment. Study eligibility criteria included: adult age (≥ 18 years of age), a history of 5 or more ED visits in the past year to any one of 6-participating hospital EDs and at least one ED visits in the past year for a mental health or addictions-related condition. Participants who had a history of 5 or more ED visits in the past but did not have at least one visits for a mental health or addictions-related condition were excluded. All study participants provided written informed consent.
Randomization
Randomization was performed upon completion of the eligibility screening and baseline interviews using a computer connected to the study data coordination centre. The participants’ allocation was communicated to participants as it was revealed, and those randomized to the intervention group were immediately referred to a CATCH-ED case manager. Block randomization was utilized, with a 1:1 allocation ratio and randomly selected block sizes, to maintain balance in the allocation of participants to the treatment groups at intermediate points in the recruitment process [22]. Although the study was not blinded due to the nature of the intervention, the primary outcome of ED utilization and other health care use outcomes were derived from administrative data held at the Institute for Clinical Evaluative Sciences (ICES).
Procedures
Participants who met study inclusion criteria were randomly assigned to the CATCH-ED intervention or a usual care group and met with a member of the research team to complete a series of questionnaires at 3-month intervals over 12 months. Participant responses were uploaded to the data coordinating centre’s secure server, using tablet computers. Participant interviews were conducted in various locations, based on participant preference, including the research team’s office, service provider locations and public settings.
Participant interviews alternated between longer interviews at baseline, 6- and 12- months (approximately one hour) and shorter interviews at 3- and 9-months (approximately 15 min). In months without a scheduled interview, participants were contacted for a very brief monthly check-in. Participants were compensated with a cash honorarium ($25–50) and transit fare upon completion of each follow-up interview. To improve retention, participants were asked to provide current contact information for family members, friends and service providers, at each contact point.
Intervention
Participants randomized to the intervention group were connected to CATCH-ED case managers, seconded from three community mental health agencies in Toronto. Case managers had access to a range of dedicated community support options, including primary care, peer support, mental health and addictions counselling, and other health and social services as needed, through partnerships with four community health centres and one peer outreach agency. A CATCH-ED program manager supervised case managers and ensured they maintained small caseloads of approximately 15 clients each. The CATCH-ED intervention was informed by the Critical Time Intervention (CTI) model [23, 24], an empirically supported time-limited case management intervention developed to prevent homelessness and other adverse outcomes for people with mental illness at the point of discharge from various institutions, including hospitals, shelters and prisons. CATCH-ED case managers worked with participants over 4–6 months to first foster engagement and identify needs and goals, secondly to connect participants to needed community-based services, and finally to transition and transfer participant care to longer-term community services [23, 24]. As part of the program, case managers offered outreach and home visits, crisis intervention, supportive therapy, practical needs assistance and care coordination, aiming to integrate hospital, community and social care and improve continuity of care.
Usual care
All participants, including usual care participants, received an education session and a resource guide that described available community-based services and resources, which they were able to access at their discretion.
Measures
The primary outcome measure was the frequency of ED visits during the 12-month period following randomization. Secondary outcomes assessed at 12 months included past month mental health symptom severity, measured by the modified Colorado Symptom Index [25]; alcohol and drug addiction severity, measured by the Addiction Severity Index (ASI) [26]; health-related quality of life [physical and mental component scores of the SF-12 [27] and the overall health EQ-5D Visual Analogue Scale (VAS) [28]] and length of stay (days) in hospital during the 12-month period following treatment allocation. Exploratory outcomes included disease-specific quality of life, measured using the QoLI-20 [29], both total summary score and a single global item at 12 months after randomization and the frequency of hospital admissions during the 12-month period following randomization.
All health care use outcomes (ED visits, length of hospital stay and hospital admissions) were analysed for consenting participants using administrative data held at the Institute of Clinical Evaluative Sciences (ICES). All other participant outcomes used participant self-report data captured during interviews with research staff.
More detailed descriptions of the measures are found elsewhere [19].
Sample size
To account for the over-dispersed distribution of our primary outcome, as well as the natural reduction in ED visits over time, sample size was calculated using the usual care group outcomes of a previously published randomized controlled trial of case management among frequent ED users (≥5 visits/year) [15]. Using previously published formulas for recurring count outcomes [30], a 20% rate reduction would be detectable if each arm had 64 participants. To allow for up to 30% attrition, the final sample size was set at 83 participants in each arm, for a total of 166 participants. Sample size estimates were verified via simulation.
Statistical methods
Data was analysed using the intent-to-treat principle. Of the 166 participants enrolled in the study, 160 (96%) gave consent to access their administrative health data records, of whom 159 were successfully linked (79 and 80, from the CATCH-ED and usual care arms, respectively) using personal health identifiers (unique OHIP numbers or name and date of birth). Count outcomes included administrative health care use data (ED visits, days in hospital, hospital admissions, number of primary care provider visits) which were modelled using an analysis of covariance framework that compared the number of outcome events in the CATCH-ED group compared to the TAU group during the 12-month post-randomization period, adjusting for baseline number of events accrued in the 12-month pre-randomization period, as well as participant age and sex. Models used a negative binomial distribution due to the over-dispersion of the data (variance greater than the mean) and generated rate ratios (RR) and their 95% CI for the 12-month post-randomization period. Rate ratios calculated the ratio of the estimated frequency of CATCH-ED events divided by the frequency of TAU events for the 12-month post-randomization period, adjusting for baseline frequencies.
Normally distributed outcomes included self-reported continuous secondary and exploratory outcomes which approximated the normal distribution (SF-12 physical and mental component summary scores, EQ-5D utility score, CSI summary score, QoLI-20 total score, Global item of QoLI20, ASI drug and alcohol composite scores) were analysed using an analysis of covariance framework to model difference in means (95% CI) between CATCH-ED and TAU groups at 12-month post-randomization, adjusting for baseline values.
All analyses were completed using R (https://www.r-project.org/). Significance level for all tests was set at 5%.
Results
Participants
Between November 2012 and September 2013, the research team received a total of 271 unique referrals from participating hospital EDs. In total, 199 individuals were assessed for eligibility, 27 of whom declined to participate and 6 did not meet the inclusion criteria, resulting in a final enrolment sample of 166 participants (Fig 1). At 12 months’ post-randomization, the rate for completion of follow-up interviews was 91.6% (N = 76) and 90.4% (N = 75) for the usual care and CATCH-ED groups, respectively. The primary reasons for loss-to-follow-up were death (N = 6 for CATCH-ED and N = 3 for TAU participants) and inability to contact or locate the participant (N = 1 for CATCH-ED and N = 4 for TAU participants). Qualitative data collection was completed between August 2013 and December 2013 and reported separately [7]. The baseline characteristics of participants are shown in Table 1.
Primary outcomes
Compared to TAU, CATCH-ED participants had a 14% reduction in ED visits during the 12-month post-randomization period [rate ratio (RR) = 0.86, 95% CI 0.64–1.15)], adjusting for baseline values, age and sex. This reduction did not reach statistical significance (P = 0.31) (Tables 2 and 3).
Secondary outcomes
Similarly, adjusting for baseline values, the number of days spent in hospital (length of stay, LOS) during the 12-month post-randomization period did not differ statistically between the intervention and TAU group (RR = 1.16 95% CI 0.59–2.29).
There were no statistically significant differences between the groups at 12 months for SF-12 physical (1.50, 95% CI -2.15–5.15) or mental (-3.97, 95% CI -8.13–0.19) component scores, the overall health VAS of the EQ-5D (-4.17, 95% CI -12.4–4.03) and the severity of psychiatric symptoms (-0.41, 95% CI -2.30–1.49), adjusted for their corresponding baseline values. Similarly, there was no significant reduction in the severity of alcohol use or drug use, either when including all participants (0.053, 95% -0.017–0.12 and -0.0027, 95% CI-0.028–0.023, respectively) or when limiting analyses only to participants with ASI scores greater than zero on alcohol and drug use scales (0.061, 95% -0.039 to 0.051 and -0.0017, 95% CI -0.048 to 0.023, respectively), adjusting for baseline values.
Exploratory outcomes
Neither the frequency of hospital admissions (RR = 0.78 95% CI 0.46–1.30) nor the number of visits to primary care providers (RR = 0.83, 95% CI 0.63–1.09) differed by allocation group at 12-months post-randomization. Compared to TAU, CATCH-ED participants saw a reduction in disease-specific quality of life (QoLI20 total score) (-9.12, 95% CI -17.57 to 4.31), however, this instrument had a substantial number of missing data (only 50% of participants had total scores at both time points) and should be considered cautiously. Due to the extent of missing item-level data, the analysis was repeated with the global indicator (“How do you feel about your life as a whole?”), which has a reliability coefficient α >0.90 with the 20-item scale [31]. This global indicator did not show any statically significant differences between groups at 12 months (-0.19, 95% CI -0.36–0.74), adjusted for baseline values.
Discussion
Our study found that after 12 months, frequent ED users with mental health conditions who received a brief intensive case management intervention had a 14% decrease in ED visits compared to those who received usual care, however, this decrease was not statistically significant. We also did not observe statistically significant differences between intervention and usual care participant groups for any other service use or health related secondary or exploratory outcome. The finding of a reduction in disease specific (mental health) quality of life, which decreased in the intervention compared to usual care group, should be interpreted with caution given the extent of missing data for this outcome.
Our findings are supported by a recent systematic review and meta-analysis, noting that care coordination strategies, including case management, are not effective in reducing hospital use among adults with mental illness [17]. Nonetheless, this study adds to the mixed but growing literature regarding the effectiveness of case management in reducing ED visits among frequent ED users. Among studies with randomized designs, two have shown that case management can lead to significant reductions in ED use among frequent ED users [15, 16], one saw increased ED use in the intervention group [32], while a recent trial showed no statistical difference between groups [33]. The high heterogeneity between studies, most importantly in how frequent users are defined, but also in participant demographic and clinical characteristics, the nature of the intervention (type and quality of case management) and system level-factors such as availability and accessibility of usual care services, may contribute to the lack of consistent findings and certainly limits the ability to compare findings between studies. Similar to our study, the most recent trial used the same definition of frequent users (≥5 ED visits in past 12 months), was held in a country with universal health insurance coverage and privately delivered health care (Switzerland) and showed a trend towards reduced ED use which did not reach statistical significance [33]. In comparison, of the two case management trials which showed a statistically significant reduction in ED among frequent ED users, the first took place in the US [15], while the second, conducted in a country with universal health insurance (Sweden), used telephone-based case management, an arguably different intervention [16]. Finally, a prior negative trial in the US used care plans and identified frequent users as those ≥10 ED visits in a year [32]. None of these trials focused on frequent ED users experiencing mental illness or addictions. In addition to these challenges in the existing literature, it is worth noting that case management is a complex intervention, often poorly characterized in studies and lacks the well-defined fidelity measures of assertive community treatment [34]]; as a result, services received may vary greatly between individuals in the same study and certainly between studies and jurisdictions [34, 35], with services received by the control group approximating those received by the intervention group in some studies [35]. It remains unclear whether the failure to reduce ED visits in this population reflects the failure of intensive case management in principle or in actual delivery of the intervention.
The lack of consistent findings by this and earlier studies suggests the need to re-examine the use of targeted case management interventions for frequent ED-user populations. Firstly, not all frequent ED use may be preventable or inappropriate [2, 7], and frequent ED users with complex health, mental health and substance related conditions in particular, such as our participants, may have crisis needs that cannot be addressed by available community-based services [36, 37]. Qualitative findings from our study indicate that participants perceived the ED as the only available, accessible and acceptable option for crisis care [7]. Furthermore, CATCH-ED study participants reported that visits to the ED were often sanctioned or encouraged by community-based providers who were commonly not available to address urgent or emergent crisis needs [7]. It is important for future research to examine the service needs and preferences of people with mental illness and addictions and the availability of appropriate community based services, particularly when planning efforts to reduce frequent ED use [7, 36, 37]. The availability of alternative services for urgent mental health conditions, including crisis respite services and urgent care centres, may help reduce ED visits by providing services which are currently only accessible to patients who visit the ED. For example, recent research has found that peer respite programs can reduce the odds of use of inpatient or emergency services among adults receiving publicly funded behavioural health services in the United States [38]. Secondly, brief case management has been shown to be effective in reducing psychiatric rehospitalisation [39] and improving other outcomes for homeless adults when provided at the point of discharge from various institutions, perhaps because these participants were specifically lacking connections to community-based resources. In contrast, community-dwelling frequent-ED users who are already well-connected to health and social services, including primary care [2], may not benefit from additional community-based services. For example, a 3-month CTI program failed to reduce use of acute care use (emergency department visits or hospitalization) among housed community-dwelling veterans with serious mental illness discharged from hospital psychiatric inpatient units [40]. Roland and Abel (2012) have highlighted several misconceptions around reducing ED use among frequent users [41], questioning the introduction of new services, especially when, as in our study, such services cannot replace the availability, comprehensiveness, and accessibility of the ED. Finally, while not observed in the current study, others have noted that care coordination strategies appear to improve patient experiences and outcomes; McWilliams (2016) argues that better patient care is in itself a worthy cause, even in the absence of cost savings or reduced service utilization [42].
Our study is not without limitations. Firstly, due to the nature of the intervention, participants and research staff were not blinded to treatment allocation. Secondly, the intervention’s effectiveness was assessed at 12-months, which may not have been long enough for potential benefits to show group differences in this population. However, an earlier trial demonstrated cost-effectiveness of case management for frequent ED users at both 12- and 24-months [15].
In conclusion, we found that compared to usual care, a brief intensive case management intervention did not result in reduced ED use among a population of frequent ED users with mental illness or addictions in Toronto, Canada. Future studies need to examine the availability, accessibility and appropriateness of existing community based services for people with complex health, mental health or addiction needs.
Acknowledgments
The authors would like to thank all study participants for their contributions to this trial. In addition, we would like to thank Deborah Wise Harris, primary study coordinator, and all research staff for their contributions to this research project.
References
- 1. Althaus F, Paroz S, Hugli O, Ghali WA, Daeppen JB, Peytremann-Bridevaux I, et al. Effectiveness of interventions targeting frequent users of emergency departments: a systematic review. Ann Emerg Med. 2011;58(1):41–52 e42. pmid:21689565.
- 2. LaCalle E, Rabin E. Frequent users of emergency departments: the myths, the data, and the policy implications. Ann Emerg Med. 2010;56(1):42–8. Epub 2010/03/30. pmid:20346540.
- 3. Minassian A, Vilke GM, Wilson MP. Frequent Emergency Department Visits are More Prevalent in Psychiatric, Alcohol Abuse, and Dual Diagnosis Conditions than in Chronic Viral Illnesses Such as Hepatitis and Human Immunodeficiency Virus. The Journal of Emergency Medicine. 2013;45(4):520–5. http://dx.doi.org/10.1016/j.jemermed.2013.05.007. pmid:23845528
- 4. Bieler G, Paroz S, Faouzi M, Trueb L, Vaucher P, Althaus F, et al. Social and Medical Vulnerability Factors of Emergency Department Frequent Users in a Universal Health Insurance System. Acad Emerg Med. 2012;19(1):63–8. pmid:22221292
- 5. Chang G, Weiss AP, Orav EJ, Rauch SL. Predictors of frequent emergency department use among patients with psychiatric illness. Gen Hosp Psychiatry. 2014;36(6):716–20. pmid:25312277.
- 6. Lang T, Davido A, Diakite B, Agay E, Viel JF, Flicoteaux B. Using the hospital emergency department as a regular source of care. Eur J Epidemiol. 1997;13(2):223–8. Epub 1997/02/01. pmid:9085009.
- 7. Wise-Harris D, Pauly D, Kahan D, Tan de Bibiana J, Hwang SW, Stergiopoulos V. "Hospital was the Only Option": Experiences of Frequent Emergency Department Users in Mental Health. Adm Policy Ment Health. 2016. Epub 2016/03/11. pmid:26961781.
- 8. Chambers C, Chiu S, Katic M, Kiss A, Redelmeier DA, Levinson W, et al. High utilizers of emergency health services in a population-based cohort of homeless adults. Am J Public Health. 2013;103 Suppl 2:S302–10. Epub 2013/10/24. pmid:24148033;
- 9. Capp R, Rosenthal MS, Desai MM, Kelley L, Borgstrom C, Cobbs-Lomax DL, et al. Characteristics of Medicaid enrollees with frequent ED use. Am J Emerg Med. 2013;31(9):1333–7. pmid:23850143.
- 10. Doupe MB, Palatnick W, Day S, Chateau D, Soodeen RA, Burchill C, et al. Frequent users of emergency departments: developing standard definitions and defining prominent risk factors. Ann Emerg Med. 2012;60(1):24–32. pmid:22305330.
- 11. Norman C, Mello M, Choi B. Identifying Frequent Users of an Urban Emergency Medical Service Using Descriptive Statistics and Regression Analyses. West J Emerg Med. 2016;17(1). pmid:26823929
- 12. Fuda KK, Immekus R. Frequent users of Massachusetts emergency departments: a statewide analysis. Ann Emerg Med. 2006;48(1):9–16. Epub 2006/06/20. pmid:16781915.
- 13. Cook LJ, Knight S, Junkins EP, Mann NC, Dean JM, Olson LM. Repeat patients to the emergency department in a statewide database. Acad Emerg Med. 2004;11.
- 14. Soril LJJ, Leggett LE, Lorenzetti DL, Noseworthy TW, Clement FM. Reducing Frequent Visits to the Emergency Department: A Systematic Review of Interventions. PLoS One. 2015;10(4):e0123660. pmid:25874866
- 15. Shumway M, Boccellari A, O'Brien K, Okin RL. Cost-effectiveness of clinical case management for ED frequent users: results of a randomized trial. Am J Emerg Med. 2008;26(2):155–64. Epub 2008/02/15. pmid:18272094.
- 16. Reinius P, Johansson M, Fjellner A, Werr J, Ohlen G, Edgren G. A telephone-based case-management intervention reduces healthcare utilization for frequent emergency department visitors. Eur J Emerg Med. 2013;20(5):327–34. pmid:22960802.
- 17. Tricco AC, Antony J, Ivers NM, Ashoor HM, Khan PA, Blondal E, et al. Effectiveness of quality improvement strategies for coordination of care to reduce use of health care services: a systematic review and meta-analysis. CMAJ. 2014;186(15):E568–78. pmid:25225226;
- 18. Soril LJJ, Leggett LE, Lorenzetti DL, Noseworthy TW, Clement FM. Characteristics of Frequent Users of the Emergency Department in the General Adult Population: A Systematic Review of International Healthcare Systems. Health Policy. 2016;120(5):452–61. http://dx.doi.org/10.1016/j.healthpol.2016.02.006. pmid:26947060.
- 19. Stergiopoulos V, Gozdzik A, Tan de Bibiana J, Guimond T, Hwang SW, Wasylenki DA, et al. Brief case management versus usual care for frequent users of emergency departments: the Coordinated Access to Care from Hospital Emergency Departments (CATCH-ED) randomized controlled trial. BMC Health Serv Res. 2016;16(1):432. pmid:27557705;
- 20.
Statistics Canada. Toronto, Ontario (Code 3520005) and Ontario (Code 35) (table). Census Profile. 2011 Census. Ottawa, Canada2011 [updated August 11 2016December 2016]. http://www12.statcan.gc.ca/census-recensement/2011/dp-pd/prof/index.cfm?Lang=E.
- 21.
Toronto Central Local Health Integration Network. Toronto Central LHIN Annual Report 2014–2015 Toronto, Canada2015. http://www.torontocentrallhin.on.ca/accountability/annualreport.aspx.
- 22. Efird J. Blocked randomization with randomly selected block sizes. Int J Environ Res Public Health. 2011;8(1):15–20. Epub 2011/02/15. pmid:21318011;
- 23. Susser E, Valencia E, Conover S, Felix A, Tsai WY, Wyatt RJ. Preventing recurrent homelessness among mentally ill men: a "critical time" intervention after discharge from a shelter. Am J Public Health. 1997;87(2):256–62. pmid:9103106
- 24. Herman DB. Transitional Support for Adults With Severe Mental Illness: Critical Time Intervention and Its Roots in Assertive Community Treatment. Research on Social Work Practice. 2014;24(5):556–63.
- 25. Boothroyd R, Chen H. The Psychometric Properties of the Colorado Symptom Index. Adm Policy Ment Health. 2008;35(5):370–8. pmid:18561020
- 26. McLellan AT, Kushner H, Metzger D, Peters R, Smith I, Grissom G, et al. The Fifth Edition of the Addiction Severity Index. J Subst Abuse Treat. 1992;9(3):199–213. pmid:1334156.
- 27. Ware J Jr., Kosinski M, Keller SD. A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity. MedCare. 1996;34(3):220–33.
- 28. Brooks R. EuroQol: the current state of play. Health Policy. 1996;37(1):53–72. pmid:10158943
- 29. Lehman AF. Measures of quality of life among persons with severe and persistent mental disorders. Soc Psychiatry Psychiatr Epidemiol. 1996;31(2):78–88. pmid:8881088
- 30. Tango T. Sample size formula for randomized controlled trials with counts of recurrent events. Statistics & Probability Letters. 2009;79(4):466–72. http://dx.doi.org/10.1016/j.spl.2008.09.016.
- 31. Uttaro T, Lehman A. Graded response modeling of the Quality of Life Interview. Eval Program Plann. 1999;22(1):41–52.
- 32. Spillane LL, Lumb EW, Cobaugh DJ, Wilcox SR, Clark JS, Schneider SM. Frequent users of the emergency department: can we intervene? Acad Emerg Med. 1997;4(6):574–80. pmid:9189190.
- 33. Bodenmann P, Velonaki VS, Griffin JL, Baggio S, Iglesias K, Moschetti K, et al. Case Management may Reduce Emergency Department Frequent use in a Universal Health Coverage System: a Randomized Controlled Trial. J Gen Intern Med. 2016. Epub 2016/07/13. pmid:27400922.
- 34. Burns T, Catty J, Dash M, Roberts C, Lockwood A, Marshall M. Use of intensive case management to reduce time in hospital in people with severe mental illness: systematic review and meta-regression. BMJ. 2007;335(7615):336. pmid:17631513
- 35. Marshall M. What have we learnt from 40 years of research on Intensive Case Management? Epidemiol Psichiatr Soc. 2008;17(2):106–9. Epub 2008/07/01. pmid:18589624.
- 36. Poremski D, Harris DW, Kahan D, Pauly D, Leszcz M, O'Campo P, et al. Improving continuity of care for frequent users of emergency departments: service user and provider perspectives. Gen Hosp Psychiatry. 2016;40:55–9. pmid:26906469.
- 37. Kahan D, Poremski D, Wise-Harris D, Pauly D, Leszcz M, Wasylenki D, et al. Perceived Case Management Needs and Service Preferences of Frequent Emergency Department Users: Lessons Learned in a Large Urban Centre. PLoS One. 2016;11(12):e0168782. Epub 2016/12/22. pmid:28002491;
- 38. Croft B, Isvan N. Impact of the 2nd story peer respite program on use of inpatient and emergency services. Psychiatr Serv. 2015;66(6):632–7. Epub 2015/03/03. pmid:25726982.
- 39. Tomita A, Herman DB. The impact of critical time intervention in reducing psychiatric rehospitalization after hospital discharge. Psychiatr Serv. 2012;63(9):935–7. Epub 2012/07/20. pmid:22810163;
- 40. Dixon L, Goldberg R, Iannone V, Lucksted A, Brown C, Kreyenbuhl J, et al. Use of a critical time intervention to promote continuity of care after psychiatric inpatient hospitalization. Psychiatr Serv. 2009;60(4):451–8. Epub 2009/04/03. pmid:19339319.
- 41. Roland M, Abel G. Reducing emergency admissions: are we on the right track? BMJ. 2012;345:e6017. Epub 2012/09/20. pmid:22990102.
- 42. McWilliams JM. Cost Containment and the Tale of Care Coordination. N Engl J Med. 2016;375(23):2218–20. Epub 2016/12/14. pmid:27959672.