Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Implementing a function-based cognitive strategy intervention within inter-professional stroke rehabilitation teams: Changes in provider knowledge, self-efficacy and practice

  • Sara E. McEwen ,

    Roles Conceptualization, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Writing – original draft, Writing – review & editing

    sara.mcewen@sunnybrook.ca

    Affiliations St. John’s Rehab Research Program, Sunnybrook Research Institute, Toronto, Ontario, Canada, Department of Physical Therapy, University of Toronto, Toronto, Ontario, Canada, Rehabilitation Sciences Institute, University of Toronto, Toronto, Ontario, Canada

  • Michelle Donald,

    Roles Investigation, Methodology, Project administration, Resources, Writing – review & editing

    Current address: Central Local Health Integration Network, Markham, Ontario, Canada

    Affiliation North & East GTA Stroke Network, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada

  • Katelyn Jutzi,

    Roles Data curation, Formal analysis, Investigation, Methodology, Project administration, Visualization, Writing – review & editing

    Affiliation St. John’s Rehab Research Program, Sunnybrook Research Institute, Toronto, Ontario, Canada

  • Kay-Ann Allen,

    Roles Data curation, Formal analysis, Investigation, Project administration, Supervision, Visualization, Writing – review & editing

    Affiliation St. John’s Rehab Research Program, Sunnybrook Research Institute, Toronto, Ontario, Canada

  • Lisa Avery,

    Roles Conceptualization, Data curation, Formal analysis, Software, Visualization, Writing – review & editing

    Affiliation Avery Information Services Ltd., Orillia, Ontario, Canada

  • Deirdre R. Dawson,

    Roles Conceptualization, Resources, Writing – review & editing

    Affiliations Rehabilitation Sciences Institute, University of Toronto, Toronto, Ontario, Canada, Department & Occupational Science & Occupational Therapy, University of Toronto, Toronto, Ontario, Canada, Rotman Research Institute, Baycrest, Toronto, Ontario, Canada

  • Mary Egan,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation School of Rehabilitation Sciences, University of Ottawa, Ottawa, Ontario, Canada

  • Katherine Dittmann,

    Roles Data curation, Formal analysis, Investigation, Resources, Writing – review & editing

    Affiliation St. John’s Rehab Research Program, Sunnybrook Research Institute, Toronto, Ontario, Canada

  • Anne Hunt,

    Roles Conceptualization, Investigation, Methodology, Project administration, Supervision, Writing – review & editing

    Affiliations Rehabilitation Sciences Institute, University of Toronto, Toronto, Ontario, Canada, Department & Occupational Science & Occupational Therapy, University of Toronto, Toronto, Ontario, Canada, Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Toronto, Ontario, Canada

  • Jennifer Hutter,

    Roles Data curation, Formal analysis, Investigation, Software, Visualization, Writing – review & editing

    Affiliation St. John’s Rehab Research Program, Sunnybrook Research Institute, Toronto, Ontario, Canada

  • Sylvia Quant,

    Roles Conceptualization, Writing – review & editing

    Affiliations Department of Physical Therapy, University of Toronto, Toronto, Ontario, Canada, North & East GTA Stroke Network, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada

  • Jorge Rios,

    Roles Data curation, Formal analysis, Investigation, Methodology, Project administration, Software, Supervision, Visualization, Writing – review & editing

    Affiliation St. John’s Rehab Research Program, Sunnybrook Research Institute, Toronto, Ontario, Canada

  • Elizabeth Linkewich

    Roles Conceptualization, Funding acquisition, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

    Affiliations North & East GTA Stroke Network, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada, Department & Occupational Science & Occupational Therapy, University of Toronto, Toronto, Ontario, Canada, Practice-Based Research, Sunnybrook Research Institute, Toronto, Ontario, Canada

Abstract

Background

The Cognitive Orientation to daily Occupational Performance (CO-OP) approach is a complex rehabilitation intervention in which clients are taught to use problem-solving cognitive strategies to acquire personally-meaningful functional skills, and health care providers are required to shift control regarding treatment goals and intervention strategies to their clients. A multi-faceted, supported, knowledge translation (KT) initiative was targeted at the implementation of CO-OP in inpatient stroke rehabilitation teams at five freestanding rehabilitation hospitals. The study objective was to estimate changes in rehabilitation clinicians’ knowledge, self-efficacy, and practice related to implementing CO-OP.

Methods

A single arm pre-post and 6-month follow up study was conducted. CO-OP KT consisted of a 2-day workshop, 4 months of implementation support, a consolidation session, and infrastructure support. In addition, a sustainability plan was implemented. Consistent with CO-OP principles, teams were given control over specific implementation goals and strategies. Multiple choice questions (MCQ) were used to assess knowledge. A self-efficacy questionnaire with 3 subscales (Promoting Cognitive Strategy Use, PCSU; Client-Focused Therapy, CFT; Top-Down Assessment and Treatment, TDAT) was developed for the study. Medical record audits were used to investigate practice change. Data analysis for knowledge and self-efficacy utilized mixed effects models. Medical record audits were analyzed with frequency counts and chi-squares.

Results

Sixty-five health care providers consisting mainly of occupational and physical therapists entered the study. Mixed effects models revealed intervention effects for MCQs, CFT, and PCSU at post intervention and follow-up, but no effect on TDAT. No charts showed any evidence of CO-OP use at baseline, compared to 8/40 (20%) post intervention. Post intervention there was a trend towards reduction in impairment goals and significantly more component goals were set (z = 2.7, p = .007).

Introduction

While it is well established that implementing even a relatively simple practice change can be challenging, few studies have examined the implementation of a complex intervention in inter-professional, multi-site environments. A group of knowledge users and researchers in a large urban centre in Canada embarked on such a project in stroke rehabilitation, to address two concerns: One, persons with cognitive impairments following a stroke had decreased access to inpatient rehabilitation [1], despite evidence of its benefits for them [2]; and two, when rehabilitation was accessed, persons with cognitive impairment received services based on outdated impairment-reduction models, rather than recommended function-based approaches [3]. There was evidence to suggest that these two issues could be traced back to a reported lack of skills and knowledge on the part of stroke rehabilitation teams to work with persons with cognitive impairments [3]. A multi-faceted, supported, knowledge translation (KT) initiative, targeted specifically at the inter-professional application of the Cognitive Orientation to daily Occupational Performance (CO-OP) approach in inpatient stroke rehabilitation teams at five freestanding rehabilitation hospitals [4] was implemented and evaluated. CO-OP is a person-centred treatment approach, framed around the use of cognitive strategies, which is aligned with Canadian Stroke Best Practice Recommendations for cognitive rehabilitation [5]. The project, called CO-OP KT, has three embedded studies related to client outcomes; provider knowledge, self-efficacy, and practice; and health system level changes in access to inpatient rehabilitation for persons with cognitive impairments. The protocol for the larger project has been published [6]. The focus of this paper is on findings related to changes in providers’ knowledge, self-efficacy, and practice to implement a cognitive-strategy-based approach following the CO-OP KT intervention.

The clinical intervention: CO-OP

CO-OP is a functional, client-goal-focused, problem solving approach that is associated with improved function, activity performance, participation, and self-efficacy among persons with a wide range of conditions, including cognitive impairment following a stroke [713]. In the stroke population, several studies have demonstrated these benefits, including randomized controlled trials in inpatient rehabilitation and sub-acute rehabilitation. Anecdotally we are aware that CO-OP is used by several health professional disciplines, including occupational therapy, physical therapy, and therapeutic recreation, and one publication provides preliminary evidence that the inter-professional application of CO-OP is feasible [14].

CO-OP is described as a top-down approach that prioritizes whole-task practice of functional activities (e.g. practicing walking, dressing, or remembering a grocery list). This is in comparison to bottom-up approaches that prioritize impairment reduction, such as strengthening or memory exercises done with the premise that functional activity will develop once the impairments are remediated. CO-OP has seven key features, five of which are considered essential elements: client-chosen functional goals, dynamic performance analysis, cognitive strategy use, guided discovery, and use of enabling principles [15]. In the first session, the client and a rehabilitation clinician work together, using the Canadian Occupational Performance Measure (COPM) [16], to select personally-important activities with which the client is having performance issues. These activities form the basis of the rehabilitation goals and become the focus of the CO-OP intervention. In the next meeting, the client is taught a global cognitive strategy (Goal-Plan-Do-Check [17]) that is then used in all subsequent sessions as the main problem-solving framework to facilitate skill acquisition/goal attainment. The client identifies a Goal, and then is guided by the clinician to make a Plan, then Does the Plan and finally Checks to see if the plan worked. The clinician uses guided discovery rather than explicit instruction to guide the client to analyze the task to be performed and to discover strategies that are specific to that client’s individual performance challenges with that particular activity. A detailed description of CO-OP’s administration procedures is available in a publication by Polatajko and Mandich, 2004 [4], and current thinking on its theoretical foundations and essential elements are available in a book published in 2017 [18], which also includes details regarding adaptations for persons who have experienced stroke [19].

Basic CO-OP training is provided through a 3-day standardized workshop that is overseen by the International CO-OP Academy (co-opacademy.ca). CO-OP instructors, who are certified and monitored by the Academy provide the standardized workshop. It consists of two full days of instruction and practice in CO-OP, followed by a consolidation day approximately two to six months after participants had a chance to practice using CO-OP in their clinical settings. During the consolidation day, participants present and discuss cases, and form goals and plans for ongoing implementation of CO-OP.

Desired practice change, implementation considerations, and proposed solutions

The desired change was that stroke rehabilitation team members learn to use the CO-OP Approach, and incorporate it into their individual and team practices. We did not set a target for level of CO-OP use (e.g., use of CO-OP with all clients with stroke or with 50% of clients with stroke), just that it be used as much as feasible, and that, once learned, it would be used by participants for most clients, including those with cognitive impairments.

We anticipated that the uptake of CO-OP within an inter-professional inpatient stroke rehabilitation team would require careful consideration for implementation. The first consideration was that CO-OP was originally designed for use by a single clinician, primarily occupational therapists, usually in an outpatient setting. Although CO-OP has been used successfully in inpatient stroke rehabilitation [7, 11], and by occupational and physical therapists working together [14], it had not been previously used by a full inter-professional team in an inpatient setting. Thus, the exact processes for an inpatient, inter-professional application were not known, and would have to be worked out by the individual participating teams and research team.

The second consideration was that using CO-OP requires health professionals to move away from traditional bottom-up impairment-reduction therapies and towards a top-down, experiential learning-based approach. Stroke rehabilitation has traditionally focused on impairment-level treatments, such as reducing muscle tone, improving balance, or improving attention and memory, with the belief that altering body functions and structures will eventually translate to functional improvements. There is little empirical evidence to suggest this to be true [2, 20], and more holistic experiential learning-based theories have emerged, arguing that functional recovery results from learning-dependent neuroplasticity, which is optimized through a complex interaction of cognitive, psychological, and contextual factors that consider an individual’s specific needs [21]. CO-OP asks that a therapist shift away from a focus on, for example, exercises that improve a client’s memory, and instead focus on helping the client to develop strategies to support function, such as determining the need to use a shopping list to remember items to buy while carrying out their self-identified goal of grocery shopping. While impairment reduction aims still exist, they are moved to the background of treatment, while meaningful, functional goals are moved to the foreground. This shift of focus to task-specific training of activities that are important to the person is in line with best practice recommendations [22], but does require a shift from impairment focus that is deeply ingrained in stroke rehabilitation [23].

The third consideration was that using CO-OP requires that the functional treatment goals come directly from the client. While client-centred goal setting has been the focus of publications and conversations for decades [24], its use in practice is still inconsistent [25]. In addition, therapists frequently cite cognitive impairment as a significant barrier to client goal setting [26, 27].

The fourth consideration was that a main therapeutic technique in CO-OP is guided discovery. Guided discovery requires that health professionals guide clients to discover their own solutions to performance problems by asking questions and coaching, rather than providing them direct instruction or relying on manual facilitation techniques of which the client is unaware. Urquhart and Skidmore [28] reported that over 95% of the instructions given by occupational and physical therapists and speech-language pathologists to persons with stroke are directive rather than guided, indicating the enormity of this desired practice change.

Finally, and perhaps most importantly, three of the considerations, using a top-down learning-based approach, having client goals be the direct focus of therapy, and using guided discovery, all require that the therapist embrace shared decision making and shift considerable control of therapeutic goals and intervention to the client. Numerous barriers to using shared decision making exist for health care providers, including attitudes, lack of familiarity and experience with the process, lack of continuity of care, client-provider relationships, lack of resources, and time [29].

To address these anticipated challenges, we began with an equal knowledge user and researcher partnership, and used the Knowledge to Action (KTA) framework as a foundation for our KT program development [30]. The KTA framework is well-known and has been used successfully in several projects [3135], including in stroke rehabilitation [36]. The KTA framework takes a macro view of KT, consisting of a central knowledge creation cycle and a concurrent action cycle that outlines several action phases to guide the application of knowledge in practice. It helped us to structure our initial problem solving regarding the specific KT challenge, the local context, and potential barriers. We aimed for an active, multi-component KT approach to effect widespread, sustained practice change [3739]. We incorporated inter-professional collaboration, which promotes effective working relationships among health care providers from different disciplines and their clients and enables optimal health outcomes by building on the foundational elements of “respect, trust, shared decision making and partnerships” [40]. We addressed health system components (e.g., engagement of decision makers), as they are believed to be important in moving evidence to practice in complex environments, particularly when shifts in culture, attitudes, and behaviour are required [41, 42]. It is also well understood that support from management is a significant implementation facilitator [37, 38, 43], and that it is closely linked to more receptive staff attitudes [38]. Finally, to further address the enormity of the required paradigm shift, CO-OP KT was framed within the CO-OP process to give as much individual and site control over changes as possible. Within this approach, individual sites were asked to set implementation goals that made sense within their context, an implementation facilitator (role described below) guided discovery to help teams develop, implement, and check plans, and teams were guided to modify plans when they were not achieving the desired result.

Objectives

The overall aim of this study was to estimate changes in rehabilitation clinicians’ knowledge, self-efficacy, and practice related to implementing a complex, client-centred, cognitive-strategy-based treatment approach following the multi-faceted KT initiative known as CO-OP KT. The specific research objectives were as follows:

  1. Describe research participants’ knowledge and self-efficacy related to implementing a cognitive-strategy-based treatment approach, including by discipline and research site, at baseline, post-intervention, and at a 6-month follow-up;
  2. Estimate the effect of CO-OP KT on post-intervention and 6-month follow-up changes in rehabilitation clinicians’ knowledge and self-efficacy;
  3. Estimate the amount of clinical practical use of a cognitive-strategy-based treatment approach before and after the CO-OP KT intervention, using indicators from medical records.

Methods

This study is one of three sub-studies within a larger project; the current study examines health care provider outcomes, another examines health system level outcomes, and a third examines patient level outcomes. The study involving patient outcomes was registered in 2016 on NIH’s website clinicaltrials.gov, registration #NCT02597569. A single arm pre-post-follow up study was conducted with stroke rehabilitation clinicians from five publicly-funded, freestanding rehabilitation hospitals in a Toronto, Ontario, Canada. Research Ethics Board approval was obtained from the Mount Sinai Hospital Research Ethics Board, the Providence Healthcare Research Ethics Board, the Sunnybrook Health Sciences Centre Research Ethics Board, the University Health Network Research Ethics Board, and the West Park Healthcare Centre Joint Research Ethics Board. All clinicians who were invited to complete the questionnaires provided informed consent. Patient data were extracted from medical charts and the ethics committees waived consent.

Table 1 provides an overview of the relative timing of assessments and intervention elements.

Recruitment/Participants

Participants were recruited from each of the five inpatient stroke rehabilitation sites. All healthcare professionals providing direct care were invited by email to participate in the CO-OP KT. The research team recommended that each site group include all or most occupational and physical therapists and speech-language pathologists, at least one nurse, and any other team members who showed interest (e.g. occupational and physical therapist assistants, social workers) and who had a direct client care role. As all members were invited, no sample size calculations were required, however, we planned for an average of 15 healthcare professionals per site. Funds were offered for replacement of staff attending the initial 2-day workshop.

As is typical in institutional settings, and because the training necessitated a substantial number of team members be absent from client care for two full days, team managers made the final decisions about who could and could not participate, in consultation with the research team. For example, in some rare cases, the manager did not approve a team member attending CO-OP training if they could not find a replacement professional to provide coverage for his or her clients. In some cases, the research team reviewed the proposed list of attendees and made suggestions to the manager about removing someone from the list (e.g. a clinical educator who did not provide direct client care) or additions to the list (e.g. a nurse to round out the inter-professional team).

The CO-OP KT intervention

The CO-OP KT intervention consists of the following components:

  1. The standardized initial CO-OP 2-day workshop, which includes two full days of instruction and practice, led by an experienced and certified CO-OP instructor who was not part of the research team;
  2. A 4-month implementation support period that included the following:
    1. Support of an implementation facilitator to promote attainment of site-specific implementation goals through bi-weekly face-to-face meetings with participants, interim email and phone support, and site-specific tailoring of implementation support processes;
    2. Implementation materials, including an implementation workbook, posters, and information cards; and
    3. Access to a CO-OP instructor who was able to visit sites once or twice to answer specific questions.
  3. The established CO-OP training workshop consolidation session, run in this case as a half-day session for each team separately at the end of the support period, led by a certified CO-OP instructor who was part of the research team (SM); and
  4. Infrastructure support:
    1. Linkages with an existing stroke network knowledge translation infrastructure, including a virtual community of practice, regular engagement of team leaders and decision makers; and
    2. Access to a short (approximately thirty minutes to complete) introductory online CO-OP module for all team members who did not attend the workshop, called CO-OP I (http://ot.utoronto.ca/clinical-community-alumni/continuing-education/coop/).

In addition to the formal CO-OP KT program (2-day workshop, implementation support, consolidation session, infrastructure support), we also developed a sustainability plan that was put into action after the formal CO-OP KT intervention period had ended. The sustainability plan included the following components:

  1. Establishment of site champions;
  2. Bi-monthly teleconferences with site champions facilitated by the stroke network regional education coordinator;
  3. Quarterly teleconferences with the site leaders facilitated by the stroke network regional director; and
  4. Free access to an online version of the CO-OP workshop and consolidation session for new team members (http://ot.utoronto.ca/clinical-community-alumni/continuing-education/coop/).

Outcome indicators

Three constructs were measured in this study: knowledge, self-efficacy, and practice change. The outcome measures and indicators for each are described below, and Table 1 provides an overview of key assessment and intervention time points. Knowledge and self-efficacy were assessed on a slightly different timeline than practice. Knowledge and self-efficacy were assessed at the following time points: pre-intervention (T1); post-workshop (T2); post CO-OP KT intervention (including implementation support and consolidation sessions but excluding the sustainability plan), approximately 4 months after T2 (T3); and 6-month follow-up (T4). Practice was assessed by medical record audits, which were conducted approximately six months before the start of CO-OP KT (A1), and within the month after the consolidation sessions (A2).

Knowledge was assessed using a subset of a bank of multiple-choice questions (MCQs) that had previously been developed for use in the established CO-OP workshops. The 26 MCQs covered the CO-OP definition, objectives, and details about the approach’s seven key features. At each assessment time point a research staff member sent each participant a link to the survey with a unique and unidentifiable code to use when each participant logged in. Other than site and discipline, no personal identifiers were collected.

Self-efficacy was assessed using a 21-item, 0 to100-point survey developed based on Bandura’s guidelines [44], named the Self-Efficacy Rating for Top-down Approaches (SERTA). The SERTA was developed specifically for use in this study. Its 21 items came from CO-OP’s treatment fidelity checklist [45] and were refined with input from the research team and a group of certified CO-OP instructors. Three subcomponents were established using principle component analysis and expert opinion: 1) Top-Down Approaches and Assessments (TDAT), 2) Client-Focused Therapy (CFT), and 3) Promoting Cognitive Strategy Use (PCSU). As with the MCQs, a research staff member sent each participant a link to the survey at each assessment time point with a unique and unidentifiable code to use when the participant logged in. Other than site and discipline, no personal identifiers were collected.

The number of MCQ and SERTA items and the 4- and 6-month time lags between T2 and T3 and T3 and T4 respectively were felt by the research team to be sufficient to mitigate and potential recall bias. Practice was assessed by medical record audits. The main inclusion criterion was charts of clients who had been discharged home from a high intensity stroke rehabilitation program 6 months before or within the month after CO-OP KT. The post-intervention audit included an additional criterion that the client had to have received treatment from at least one provider who participated in CO-OP KT. At each time point, medical records departments were asked to retrieve 12 records within the appropriate discharge period, and the reviewers selected the first eight charts that met the criteria. The records were reviewed for documentation related to treatment goals; whether the goals comprised of a functional activity (e.g. independence with upper body dressing), a component of a functional activity (e.g. reaching), or an impairment-reduction goal (, e.g. increase in arm strength); clear evidence of client involvement in the goal-setting process; and use of the CO-OP Approach or its elements in treatment. Working definitions (Table 2) were developed for each item coded in the medical record audit, and two to three members of the research team made consensus-based decisions about how an item should be coded when the coder was unsure.

Data analysis

Data were cleaned and verified. Descriptive statistics were compiled for all outcomes. To examine post-intervention and follow-up changes relative to baseline scores for the SERTA and MCQ and to understand the incremental effects of the workshop and the support period on MCQ and SERTA scores while allowing for variability among participants and sites, mixed effects models were used. All team members with at least two assessments available were included in the analysis. Dummy variables were created to allow the assessment of incremental change at each time point. To examine the effectiveness of the CO-OP KT intervention as a whole (2-day workshop + implementation support + consolidation session + infrastructure support), we initially examined the pre-intervention (T1), post-intervention (T3) and follow-up assessments (T4), while excluding the post-2-day-workshop (T2) evaluations. Within-subject dependence was modeled using participant-level random effects at baseline, intervention and follow-up. Site-level random effects were also modelled at each time point. Random effects < 0.01 were removed from the model, resulting in improved Bayesian information criterion (BIC) statistics, and no changes to the fixed effects in all cases. Model fit was assessed by checking the normality of the model residuals and random effects. To determine the relative contributions of the workshop and the support period to the overall intervention effects, secondary models were fit incorporating the post-workshop data and examining the distinct changes from T1 to T2 and T2 to T3 (whereas the primary analysis examined the combined T1 to T3 change).

Results of the medical record audit were analyzed with frequency counts, and pre and post comparisons were made with chi-square analyses. Statistical analyses were completed using SPSS version 24 and SAS version 9.4.

Results

The flow of health care provider participants in this study are displayed in the CONSORT diagram, Fig 1. Sixty-five health care providers entered the study at T1. Regarding responses to the MCQ and SERTA, 20% (n = 13) withdrawal rate occurred by T2 (within the month following the workshop), with an additional 20% (n = 13) withdrawal at T3 and 6% (n = 4) more at T4. Thus, the overall withdrawal rate by the T4 follow-up was 46%. Of the 46%, 12 participants (40%) were not working at the site (e.g., changed jobs, went on leave, etc.), while 18 participants (60%) were still part of the team but did not respond to the surveys for unknown reasons.

It should be noted that one site had complex organizational restructuring issues during the initial recruitment that resolved before the 2-day workshop, but not in time to allow a full complement of participants to attend the training. A condensed 1-day workshop was therefore held for six additional participants approximately one month later. The additional six participants are included in Fig 1.

Table 3 provides the distribution of participants by site and by discipline, showing individual site participation ranging from 11 to 18 individuals, and involving disciplines of occupational therapy, physiotherapy, occupational therapist and physiotherapist assistants, speech-language pathology, social work, and nursing.

Table 4 provides the mean and standard deviation scores for the MCQ and SERTA subscales at all time points. Table 5 provides the results of the mixed effects modeling for the MCQ and SERTA data. The effects of each time point are incremental from the previous, i.e. the value given for Intervention (T2 +T3) is the amount of change over Baseline (T1), and the value given for Follow Up (T4) is the amount of change over the Intervention value. The secondary model, shown in italics in Table 5, examined the relative effects of the workshop and the support period, and the values given reflect the approximate amounts of Intervention change that can be attributed to the Workshop (T2) or subsequent Support Period (T3). For the primary model, significant intervention effects were seen for two of the three SERTA subscales (CFT: Client-focused therapy and PCSU: Promoting cognitive strategy use) and the MCQ data, at T3 and T4., The secondary model, shown in italics revealed that the effect for the change in knowledge (MCQ data) came largely from the workshop. The post workshop change was 11.4 points, (6.3, 16.4) compared to -2.3 (-6.4,1,8) for the support period. For SERTA, the opposite was true, with the bulk of the effect coming from the support period and negligible change occurring following the workshop. For the most efficacious SERTA subscale, CFT, the effect of the workshop was 0.5 (-2.9, 3.9) and the effect of the support period was 4.7 (1.1, 8.3). Although not significant, there was a change in TDAT of 3.8 points from after the workshop to the end of the support period (T3), and an additional incremental change of 3.4 points from the end of T3 until the follow-up at T4.

thumbnail
Table 4. Means and standard deviations for MCQ and SERTA data at all time points.

https://doi.org/10.1371/journal.pone.0212988.t004

thumbnail
Table 5. Mixed effects models—Fixed effects [and 95% Confidence Intervals] and random effects in SERTA sub-scale domain scores and MCQ scores.

https://doi.org/10.1371/journal.pone.0212988.t005

The medical record audit examined eight charts per site, 40 in total, 6 months before CO-OP KT and another 40 in the month following CO-OP KT. No charts showed any evidence of CO-OP use at baseline, compared to 8/40 (20%) charts from four out of five sites following CO-OP KT. Evidence of client-centred goal-setting was present in 29/40 (72.5%) charts at baseline and 34/40 (85%) charts after the KT intervention (chi-square 1.86, p = .17). The total number of functional goals set for all sites before and after CO-OP KT was 185 and 198, respectively; the number of impairment-based goals set for all sites before and after CO-OP KT was 92 and 77, respectively (a reduction of 6%); and the number of component-based goals set for all sites before and after CO-OP KT was 9 and 25, respectively (an increase of 7%). There was an association between goal type and assessment time (chi-square = 8.973; p = .011). Post-hoc test revealed that there were more component goals in the post group (z = 2.7, p = .007).

Discussion

The CO-OP KT intervention was associated with significant improvements in knowledge, aspects of self-efficacy, and aspects of practice related to the multi-site implementation of the CO-OP Approach in inter-professional stroke rehabilitation teams. Knowledge, self-efficacy in promoting cognitive strategy use and self-efficacy in client-focused therapy were all maintained 6-months after the CO-OP KT intervention ended. There was no significant change in self-efficacy for using a top-down approach. Changes in knowledge occurred after the workshop and were largely maintained but not augmented during the support period, whereas changes in self-efficacy occurred predominantly during the support period rather than after the workshop. The audit of medical records revealed some limited evidence of practice change. In this discussion, we suggest mechanisms that may have influenced the improvements in knowledge and self-efficacy, suggest potential reasons why change did not occur in self-efficacy for top-down approaches, expand on the findings from the audit of medical records, and outline study limitations and future directions.

The improvements demonstrated in knowledge and aspects of self-efficacy represent important shifts towards a implementing a collaborative person-provider rehabilitation model, and we postulate these successes come from the strong and embedded researcher/knowledge user partnership, a focus on site-specific implementation goals and site-driven implementation strategies, and the use of existing health system (stroke network) education and communication infrastructure. Furthermore, we suggest that these aspects of the intervention are likely generalizable to other KT projects that aim to shift the care dynamic towards a more equal person-provider partnership. Scholl et al’s scoping review identifies the importance of organizational and system-level characteristics in implementing shared decision making-based approaches into routine care [46]. The maintenance of improvements may have been facilitated by the individual teams’ ownership of implementation goals and strategies and the comprehensive sustainability plan that was implemented after the formal implementation support period.

No significant change occurred in health care providers’ self-efficacy related to top-down approaches. It may be that this is a theoretical construct that does not have obvious practical applicability for providers and was thus not integrated into their clinical reasoning. It may also be that a bottom-up, impairment focus is so deeply ingrained in the larger stroke rehabilitation system that making this shift will require system-level changes before teams and individuals can adopt this thinking. However, there are a number of important barriers to such a shift. First, the Canadian Stroke Best Practice Guidelines, which guide practice in Ontario, implicitly define stroke rehabilitation as a process of expert-led impairment reduction [23]. Improved adoption of promising top-down interventions that focus on person-centred goals may not be possible without explicit examination of underlying ideas about what stroke recovery is and how rehabilitation institutions that provide stroke recovery care can best support it. Second, bottom-up, neurophysiological approaches such as Bobath [47] or Neurodevelopmental Treatment [48], which lack evidence of effectiveness [20], are still widely used in stroke rehabilitation. A Cochrane Collaborative review reported a significant detrimental effect of these neurophysiological types of approaches on independence in activities of daily living and gait velocity [20], suggesting that these approaches require de-implementation. Presad and Ionnadis (2014) [49] have said that de-implementation may meet “fierce tactical resistance”, and that evidence wars, in which providers evoke outdated or lesser-quality evidence, can hinder de-implementation. De-implementation is largely understudied in implementation science [50], but evidence is emerging to suggest that the barriers and facilitators are different than those related to implementation and may need to be addressed separately [51].

Our audit of the medical records provided some concrete evidence of practice change, in that no records mentioned aspects of CO-OP use prior to the KT intervention and 20% mentioned it after. However, in real terms, only eight of 40 charts audited post intervention had any documentation related to use of the CO-OP Approach, and one site showed no evidence at all. Although this is likely evidence of incomplete implementation of CO-OP, it was also probably compounded by the lack of relevant documentation structures. During the implementation support period, all teams asked the implementation facilitators for advice on documentation. We had not developed documentation structures, because we believed that sites would develop their own procedures that fit within their existing site-specific systems. In hindsight, the time and energy required to develop documentation procedures might place on front-line providers, in addition to learning and implementing a new technique that includes new terminology, was too burdensome. In future similar projects, we recommend providing a documentation framework or guidelines as a starting point that teams can then modify to suit their context.

Study limitations

This study was limited in that it was a single arm study with no control group, occurring in a large and complex health system over several months, in which many potentially confounding events may have occurred. Thus, it is impossible to know with certainty whether changes seen were entirely due to the CO-OP KT intervention, or whether other system factors may have had influence. Additionally, multiple statistical comparisons may have overestimated some of the positive findings. As the CO-OP KT intervention was multi-faceted, and was studied as a whole, it is difficult to know which components were more or less effective than others. Not providing a documentation framework for participants may have hindered both their CO-OP implementation and our ability to use medical record audit as an indicator of practice change. While it is likely that the large degree of control given to individual sites for implementation goals and plans may have contributed to the overall success of the project, the issues with documentation highlight the importance of having individualization occur within a clear, structured framework.

Conclusion

CO-OP is a complex clinical intervention in which clients are taught to use problem-solving cognitive strategies to acquire personally-meaningful functional skills, and health care providers are required to shift control regarding treatment goals and intervention strategies to their clients. In using an inter-professional multi-faceted KT intervention in which similar principles were applied (i.e. control over implementation goals and strategies was shifted from researchers to the participating teams), documented practice change was present but limited, and sustained improvements in health care providers’ knowledge and aspects of self-efficacy.

Acknowledgments

The authors would like to acknowledge the Toronto Stroke Networks and site leads and champions from all participating sites for their contribution to the study.

References

  1. 1. Sharp S, Linkewich E, Willems J, Tahair N, Levy C, Bayley M. Abstract T P259: What Should Really be Happening to Our Stroke Patients Post-Acute Care?: A System Best Practice Model for Inpatient Rehab. Stroke. 2014;45(suppl 1):ATP259–ATP259.
  2. 2. Cicerone KD, Langenbahn DM, Braden C, Malec JF, Kalmar K, Fraas M, et al. Evidence-Based Cognitive Rehabilitation: Updated Review of the Literature From 2003 Through 2008. Arch Phys Med Rehabil. 2011;92(4):519–530. pmid:21440699
  3. 3. Linkewich E, Tahair N, Quant S. Access to Rehabilitation for Stroke Patients With Cognitive Impairment in Toronto. Arch Phys Med Rehabil. 2014;95(10):e14.
  4. 4. Polatajko H, Mandich A. Enabling Occupation in Children: The Cognitive Orientation to daily Occupational Performance (CO-OP) Approach. 1st ed. Ottawa, ON: CAOT Publications ACE; 2004.
  5. 5. Eskes G, Lanctot K on behalf of the Mood Cognition and Fatigue following Stroke Writing Group. Mood, Cognition and Fatigue following Stroke Module 2015. Ottawa, ON: Heart and Stroke Foundation; 2015.
  6. 6. McEwen SE, Donald M, Dawson D, Egan MY, Hunt A, Quant S, et al. A multi-faceted knowledge translation approach to support persons with stroke and cognitive impairment: evaluation protocol. Implement Sci. 2015;10:157–157. pmid:26542936
  7. 7. Skidmore ER, Dawson DR, Butters MA, Grattan ES, Juengst SB, Whyte EM, et al. Strategy Training Shows Promise for Addressing Disability in the First 6 Months After Stroke. Neurorehabil Neural Repair. 2015;29(7):668–676. pmid:25505221
  8. 8. McEwen S, Polatajko H, Baum C, Rios J, Cirone D, Doherty M, et al. Combined Cognitive-Strategy and Task-Specific Training Improve Transfer to Untrained Activities in Subacute Stroke: An Exploratory Randomized Controlled Trial. Neurorehabil Neural Repair. 2015;29(6):526–536. pmid:25416738
  9. 9. McEwen SE, Polatajko HJ, Huijbregts MPJ, Ryan JD. Exploring a cognitive-based treatment approach to improve motor-based skill performance in chronic stroke: Results of three single case experiments. Brain Inj. 2009;23(13–14):1041–1053. pmid:19909052
  10. 10. McEwen SE, Polatajko HJ, Huijbregts MP, Ryan JD. Inter-task transfer of meaningful, functional skills following a cognitive-based treatment: Results of three multiple baseline design experiments in adults with chronic stroke. Neuropsychol Rehabil. 2010;20(4):541–61. pmid:20397111
  11. 11. Skidmore ER, Holm MB, Whyte EM, Dew MA, Dawson D, Becker JT. The feasibility of meta-cognitive strategy training in acute inpatient stroke rehabilitation: Case report. Neuropsychol Rehabil. 2011;21(2):208–223. pmid:21391121
  12. 12. Polatajko HJ, McEwen SE, Ryan JD, Baum CM. Pilot randomized controlled trial investigating cognitive strategy use to improve goal performance after stroke. Am J Occup Ther. 2012;66(1):104–9. pmid:22389945
  13. 13. Skidmore ER, Dawson DR, Whyte EM, Butters MA, Dew MA, Grattan ES, et al. Developing complex interventions: lessons learned from a pilot study examining strategy training in acute stroke rehabilitation. Clin Rehabil. 2014;28(4):378–387. pmid:24113727
  14. 14. McEwen S, Cirone D, Lee B. Incorporating a Cognitive Strategy Approach into an Outpatient Stroke Physiotherapy Programme: Case Report. Physiother Canada. 2017;69(3):193–196. pmid:30275634
  15. 15. Skidmore ER, McEwen SE, Green D, van den Houten J, Dawson D, Polatajko HJ. Essential Elements and Key Features of the CO–OP Approach. In: Dawson DR, McEwen SE, Polatajko HJ, editors. Cognitive Orientation to daily Occupational Performance in Occupational Therapy: Using the CO-OP Approach to Enable Participation Across the Lifespan. 1st ed. Bethesda, MD: AOTA Press; 2017. p. 11–20.
  16. 16. Law M, Baptiste S, Carswell A, McColl M, Polatajko H, Pollock N. Canadian Occupational Performance Measure. 5th ed. Ottawa, ON: CAOT Publications ACE; 2014.
  17. 17. Meichenbaum D. Cognitive-behavior Modification: An Integrative Approach. 1st ed. New York City, NY: Springer US; 1977.
  18. 18. Dawson DR, McEwen SE, Polatajko HJ, editors. Cognitive Orientation to daily Occupational Performance in Occupational Therapy: Using the CO-OP Approach to Enable Participation Across the Lifespan. 1st ed. Bethesda, MD: AOTA Press; 2017.
  19. 19. McEwen SE, Poulin V, Skidmore ER, Wolf TJ. Using the CO–OP Approach: Stroke. In: Dawson DR, McEwen SE, Polatajko HJ, editors. Cognitive Orientation to daily Occupational Performance in Occupational Therapy: Using the CO-OP Approach to Enable Participation Across the Lifespan. 1st ed. Bethesda, MD: AOTA Press; 2017. p. 93–117.
  20. 20. Pollock A, Baer G, Campbell P, Choo PL, Forster A, Morris J, et al. Physical rehabilitation approaches for the recovery of function and mobility following stroke. The Cochrane database of systematic reviews. 2014;4:CD001920. pmid:24756870
  21. 21. Winstein CJ, Kay DB. Chapter 16—Translating the science into practice: shaping rehabilitation practice to enhance recovery after brain damage. In: Dancause N, Nadeau S, Rossignol S, editors. Prog Brain Res. 218: Elsevier; 2015. p. 331–360
  22. 22. Hebert D, Lindsay MP, McIntyre A, Kirton A, Rumney PG, Bagg S, et al. Canadian stroke best practice recommendations: Stroke rehabilitation practice guidelines, update 2015. Int J Stroke. 2016;11(4):459–484. pmid:27079654
  23. 23. Egan M, Laliberte-Rudman D, Rutkowski N, Lanoix M, Meyer M, McEwen S, et al. Canadian stroke best practice recommendations: Implications for design and allocation of rehabilitation after hospital discharge. Disabil Rehabil. 2019:Forthcoming.
  24. 24. Härter M, Moumjid N, Cornuz J, Elwyn G, van der Weijden T. Shared decision making in 2017: International accomplishments in policy, research and implementation. Zeitschrift für Evidenz, Fortbildung und Qualität im Gesundheitswesen. 2017;123-124:1–5. pmid:28546053
  25. 25. Couët N, Desroches S, Robitaille H, Vaillancourt H, Leblanc A, Turcotte S, et al. Assessments of the extent to which health-care providers involve patients in decision making: a systematic review of studies using the OPTION instrument. Health Expect. 2015;18(4):542–561. pmid:23451939
  26. 26. Plant SE, Tyson SF, Kirk S, Parsons J. What are the barriers and facilitators to goal-setting during rehabilitation for stroke and other acquired brain injuries? A systematic review and meta-synthesis. Clin Rehabil. 2016;30(9):921–930. pmid:27496701
  27. 27. Hunt AW, Le Dorze G, Trentham B, Polatajko HJ, Dawson DR. Elucidating a Goal-Setting Continuum in Brain Injury Rehabilitation. Qual Health Res. 2015;25(8):1044–1055. pmid:26187534
  28. 28. Urquhart JR, Skidmore ER. Guided and directed cues: developing a standardized coding scheme for clinical practice. OTJR (Thorofare N J). 2014;34(4):202–8. pmid:25347758
  29. 29. Armstrong MJ. Shared decision-making in stroke: an evolving approach to improved patient care. Stroke Vasc Neurol. 2017;2(2):84–87. pmid:28959495
  30. 30. Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, et al. Lost in knowledge translation: Time for a map? J Contin Educ Health Prof. 2006;26(1):13–24. pmid:16557505
  31. 31. Munce S, Kastner M, Cramm H, Lal S, Deschêne S-M, Auais M, et al. Applying the Knowledge to Action Framework to Plan a Strategy for Implementing Breast Cancer Screening Guidelines: an Interprofessional Perspective. J Cancer Educ. 2013;28(3):481–487. pmid:23749437
  32. 32. Sibley KM, Salbach NM. Applying Knowledge Translation Theory to Physical Therapy Research and Practice in Balance and Gait Assessment: Case Report. Phys Ther. 2015;95(4):579–587. pmid:24970093
  33. 33. Kastner M, Straus SE. Application of the Knowledge-to-Action and Medical Research Council frameworks in the development of an osteoporosis clinical decision support tool. J Clin Epidemiol. 2012;65(11):1163–1170. pmid:22858301
  34. 34. Laur C, Keller HH. Implementing best practice in hospital multidisciplinary nutritional care: an example of using the knowledge-to-action process for a research program. J Multidiscip Healthc. 2015;8:463–472. pmid:26491344
  35. 35. Moore JE, Marquez C, Dufresne K, Harris C, Park J, Sayal R, et al. Supporting the implementation of stroke quality-based procedures (QBPs): a mixed methods evaluation to identify knowledge translation activities, knowledge translation interventions, and determinants of implementation across Ontario. BMC Health Serv Res. 2018;18(1):466–466. pmid:29914466
  36. 36. Janzen S, McIntyre A, Richardson M, Britt E, Teasell R. Building a Knowledge to Action Program in Stroke Rehabilitation. Can J Neurol Sci. 2016;43(5):619–625. pmid:27456566
  37. 37. Menon A, Korner-Bitensky N, Kastner M, McKibbon K, Straus SE. Strategies for rehabilitation professionals to move evidence based knowledge into practice: A systematic review. J Rehabil Med. 2009;41:1024–1032. pmid:19893996
  38. 38. Ploeg J, Davies B, Edwards N, Gifford W, Miller PE. Factors Influencing Best-Practice Guideline Implementation: Lessons Learned from Administrators, Nursing Staff, and Project Leaders. Worldviews Evid Based Nurs. 2007;4(4):210–219. pmid:18076464
  39. 39. Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implement Sci. 2012;7(1).
  40. 40. Canadian Interprofessional Health Collaborative. A national interprofessional competency framework. Vancouver, BC: Canadian Interprofessional Health Collaborative; 2010.
  41. 41. National Collaborating Centre for Methods and Tools. Knowledge translation initiatives using a systems approach. Hamilton, ON: McMaster University; 2013.
  42. 42. Kitson AL. The need for systems change: reflections on knowledge translation and organizational change. J Adv Nurs. 2009;65(1):217–228. pmid:19032518
  43. 43. Miao M, Power E, O’Halloran R. Factors affecting speech pathologists’ implementation of stroke management guidelines: a thematic analysis. Disabil Rehabil. 2015;37(8):674–85. pmid:25003482
  44. 44. Bandura A. Guide for Constructing Self-Efficacy Scales. Self-Efficacy Beliefs of Adolescents. 1st ed. Greenwich, CT: Information Age Publishing; 2006. p. 307–337.
  45. 45. The CO-OP Academy. The CO-OP Academy: Information for researchers Toronto, ON: The CO-OP Academy; 2018 [cited 2019]. http://co-opacademy.ca/research-and-publications/information-for-researchers/.
  46. 46. Scholl I, LaRussa A, Hahlweg P, Kobrin S, Elwyn G. Organizational- and system-level characteristics that influence implementation of shared decision-making and strategies to address them—a scoping review. Implement Sci. 2018;13(1). pmid:29523167
  47. 47. Bobath B. Treatment of adult hemiplegia. Physiotherapy. 1977;63:310–313. pmid:928541
  48. 48. Instructors Group of NDTA. The NDT/Bobath (Neuro-Developmental Treatment/Bobath) Definition: NDTA; 2016 [updated 27 May 2016]. http://www.ndta.org/What-is-NDT
  49. 49. Prasad V, Ioannidis JP. Evidence-based de-implementation for contradicted, unproven, and aspiring healthcare practices. Implement Sci. 2014;9. pmid:24398253
  50. 50. Norton WE, Kennedy AE, Chambers DA. Studying de-implementation in health: an analysis of funded research grants. Implement Sci. 2017;12(1). pmid:29202782
  51. 51. van Bodegom-Vos L, Davidoff F, Marang-van de Mheen PJ. Implementation and de-implementation: two sides of the same coin? BMJ Qual Saf. 2017;26(6):495. pmid:27512102