Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Comparison of bilateral and unilateral upper limb training in people with stroke: A systematic review and meta-analysis

  • Pei-ming Chen,

    Roles Formal analysis, Investigation, Writing – original draft, Writing – review & editing

    Affiliation Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong, China (SAR)

  • Patrick W. H. Kwong,

    Roles Writing – original draft, Writing – review & editing

    Affiliation Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong, China (SAR)

  • Claudia K. Y. Lai,

    Roles Writing – review & editing

    Affiliation School of Nursing, The Hong Kong Polytechnic University, Hong Kong, China (SAR)

  • Shamay S. M. Ng

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Supervision, Writing – original draft, Writing – review & editing

    Shamay.Ng@polyu.edu.hk

    Affiliation Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong, China (SAR)

Abstract

Background and objectives

Bilateral upper limb training (BULT) and unilateral upper limb training (UULT) are two effective strategies for the recovery of upper limb motor function after stroke. This meta-analysis aimed to compare the improvements in motor impairment and functional performances of people with stroke after BULT and UULT.

Research design and methods

This systematic review and meta-analysis identified 21 randomized controlled trials (RCTs) met the eligibility criteria from CINAHL, Medline, Embase, Cochrane Library and PubMed. The outcome measures were the Fugl-Meyer Assessment of Upper Extremity (FMA-UE), Wolf Motor Function Test (WMFT), Action Research Arm Test (ARAT) and Box and Block Test (BBT), which are validated measures of upper limb function.

Results

Twenty-one studies involving 842 subjects with stroke were included. Compared with UULT, BULT yielded a significantly greater mean difference (MD) in the FMA-UE (MD = 2.21, 95% Confidence Interval (CI), 0.12 to 4.30, p = 0.04; I2 = 86%, p<0.001). However, a comparison of BULT and UULT yielded insignificant mean difference (MD) in terms of the time required to complete the WMFT (MD = 0.44; 95%CI, -2.22 to 3.10, p = 0.75; I2 = 55%, p = 0.06) and standard mean difference (SMD) in terms of the functional ability scores on the WMFT, ARAT and BBT (SMD = 0.25; 95%CI, -0.02 to 0.52, p = 0.07; I2 = 54%, p = 0.02).

Discussion and implications

Compared to UULT, BULT yielded superior improvements in the improving motor impairment of people with stroke, as measured by the FMA-UE. However, these strategies did not yield significant differences in terms of the functional performance of people with stroke, as measured by the WMFT, ARAT and BBT. More comparative studies of the effects of BULT and UULT are needed to increase the reliability of these conclusions.

Introduction

Stroke often causes upper limb motor function deficits. Accordingly, people with stroke tend to be more reliant on others during their daily lives [1]. Severe motor impairments in the upper limbs were found to persist for 6 months after stroke in a third of people with stroke [2]. More than half of the activities of daily living (e.g. dressing, feeding and cooking) rely on upper limb functions [3]. Therefore, motor impairment in the upper limb presents a significant barrier to reintegration into society [4].

Unilateral upper limb training (UULT), a common rehabilitative strategy for people with stroke, includes repetitive task-related training [57]and constraint-induced movement training (CIMT) [813]. During CIMT, the subjects are required to wear a constraint mitten on the unaffected upper limb and to perform intensive training with affected side for at least 6 hours per day. Compared with CIMT, task-related training is a less intensive form of goal-directed training. This form uses various types of motor tasks to help subjects to derive optimal control strategies for solving problems related to motor abilities. Wolf et al. [8]compared the effects of a 14-session CIMT program with dose-matched conventional therapy (day treatment program, outpatient visits, physiotherapy and occupational therapy) on the motor outcomes of people with sub-acute stroke. In that study, CIMT induced a significantly greater increase in the Quality of Movement in Motor Activity Log (MAL) score (p<0.01) and a significant reduction in the time needed to complete the Wolf Motor Function Test (WMFT) (p<0.01), compared to the conventional treatment program. Additionally, task-related training was also found to be superior to conventional therapy for rehabilitating upper limb function. Narayan et al. [7]found that 20 sessions of task-related upper limb training, including reaching and lifting objects with different shapes using the affected upper limb, were superior to dose-matched neurodevelopmental-based therapy as measured by the Fugl-Meyer Assessment of Upper Extremity (FMA-UE), WMFT, MAL and Action Research Arm Test (ARAT).

Bilateral upper limb training (BULT) is another stroke motor rehabilitation strategy in which the subjects are required to perform motor tasks with both upper limbs. Here, the unimpaired limb is used to increase the functional recovery of the impaired limb by facilitating coupling effects between the two limbs [14]. BULT includes bilateral functional task training [1519], bilateral robotic-assisted training [2022] and bilateral arm training with rhythmic cueing [2325]. Several studies have indicated the superiority of BULT over various conventional therapies (including neurodevelopmental therapy[18, 26], occupational therapy [19, 27, 28], physiotherapy [17, 21, 28] and unilateral robotic-assisted training [20]) for improving the FMA-UE, WMFT, ARAT and MAL and the ranges of motion (ROM) of the shoulder, elbow and wrist joints in people with stroke.

Several clinical trials have also demonstrated the ability of BULT to improve hemiplegic arm functions [2933]. In two systematic reviews [29, 32], combinations of BULT with other therapies, such as electrical stimulation and auditory rhythmic cueing, effectively increased the functional WMFT scores of patients with acute to chronic stroke immediately after completion of the intervention. However, those reviews [29, 32] included single-group pre-post studies [3439]. Moreover, the reviews [29, 32] did not directly compare the results of BULT and UULT in people with stroke and thus, were unable to demonstrate which approach more effectively improved the performance of the paretic upper limb, based on functional scales such as the FMA-UE, WMFT and ARAT.

By contrast, two recently published meta-analyses [33, 40] compare the abilities of BULT and UULT to improve the FMA-UE, WMFT, ARAT and MAL in people with stroke. Van Delden et al. [33] categorized studies according to the motor impairment level, as measured by the FMA-UE, Brunnstorm Stage, WMFT and ARAT. The results showed that UULT and BULT yielded similar improvement in the FMA-UE, WMFT, ARAT and MAL scores of people with stroke. Lee et al. [40] compared the effects of BULT with those of unilateral task-related training and CIMT during upper limb rehabilitation after stroke. Notably, CIMT was more effective than BULT in improving the WMFT and ARAT score. However, this finding should be interpreted cautiously because only three studies [16, 41, 42] were included in the meta-analysis.

Although CIMT can be used to train the paretic upper limb intensively, a direct comparison of the effects of CIMT and BULT on the rehabilitation of upper limb motor function in people with stroke may be inappropriate. First, CIMT requires the subjects to wear a constraint mitten on the unaffected upper limb and to perform intensive training for at least 6 hours per day [43]. Page et al. [44] found that about 68% of subjects with stroke were unable to complete the full schedule of CIMT because of the training requirement and restrictive device. According to Blanton et al. [45], only 20–25% of patients with chronic stroke benefited from CIMT because of the tight training schedule and potential risk induced by the restricted training plan. By contrast, BULT has a lower training intensity. Patients are expected to complete approximately 1 to 2 hours of training per session on 3 to 5 days per week [24, 46], in contrast to the CIMT schedule of 6 hours of supervised task practice on each of 14 consecutive days [10, 47, 48]. Second, most CIMT studies applied stringent inclusion criteria, including at least 10 degrees of wrist extension, thumb abduction and finger extension on the affected side [49]. Compared with CIMT, BULT only requires people with stroke to maintain volitional control of the non-paretic arm, to be capable of flexing the paretic arm and shoulder and to have maintained the residual grip function of the paretic hand [18, 25]. CIMT is only applied to stroke survivors with mild to moderate levels of upper limb dysfunction. Thus, the exclusion of CIMT from a comparison of the effects of BULT and UULT in people with stroke would improve the validity of the quantitative results.

Although several meta-analyses [33, 40] have compared the effects of BULT and UULT in people with stroke according to the FMA-UE, WMFT and ARAT, these meta-analyses treated CIMT as a subtype of UULT and included it in comparison with BULT. To the best of our knowledge, no studies have excluded CIMT when comparing the effects of BULT and UULT in people with stroke. This systematic review and meta-analytical review aimed to evaluate the available randomized controlled trials (RCTs) that compared the effects of BULT and UULT, but excluding CIMT on improvements in the FMA-UE, WMFT and ARAT score of people after stroke.

Methodology

Study selection criteria

An exhaustive search of the literature was conducted to identify publications related to the effectiveness of BULT. The CINAHL, Medline, Embase, Cochrane Library and PubMed databases were searched systematically through April 2018 using the keywords listed in Table 1.

All identified full-text English language journal articles were screened independently by the two reviewers (PM and PK). The reference lists of the selected articles were then examined to identify additional potential articles. The inclusion criteria were applied to identify studies that (1) were randomized control trials; (2) reported quantitative behavior outcome measures; (3) had investigated the effects of interventions on upper limb function; (4) included an intervention group with bilateral movement training; (5) an intervention group with unilateral movement training or conventional occupational therapy or physiotherapy; and (6) included people with stroke. The following exclusion criteria were also applied: (1) the use of BULT in both the experimental and control groups; (2) failure to provide data on the outcome measures; (3) the studies with was a single session design; (4) systematic review or meta-analyses; and (5) inclusion of CIMT as the UULT.

Risk of bias

The methodological quality of the studies was assessed using the Cochrane Collaboration tool for assessing the risk of bias [50]. Studies that provided information clearly (i.e., randomized, subject-blinded) were rated as low risk for the corresponding items. If the study provided the information against the assessed items (i.e. non-randomized, not blinded), the study was rated as high risk for those items. If no information suitable for our judgment process was provided, the study was rated as unclear.

Data synthesis and analysis

Two reviewers (PM and PK) extracted the participants’ demographic information (age, gender, post-stroke duration post stroke, type of lesion and side of hemiparesis), details of the intervention (type, intensity and duration) and outcome measures to identify the study characteristics. The third reviewer (SMN) made judgments if discrepancies occurred between the two reviewers. The International Classification of Functioning, Disability and Health (ICF), which is regarded as the international standard for evaluations of health and disability, was used to assess motor impairment and functional performance. The ICF can facilitate a more comprehensive understanding of the effectiveness of bilateral movement training during stroke rehabilitation and an optimal bilateral movement training scheme for improving upper limb function.

According to the ICF framework, the outcome measure for the meta-analysis was divided into two domains: (1) motor impairment and (2) functional performance. The effect size of each outcome was computed by calculating the mean difference (MD), standard mean difference (SMD) and 95% confidence interval (CI), as appropriate. If a study did not provide the standard deviation (SD) of the MD or SMD, this value was estimated using the following formula, with the correlation coefficient (Corr) set to 0.8 [50]:

The results of the meta-analysis were then visualized using a forest plot (Review Manager 5.3; The Nordic Cochrane Centre, Cochrane Collaboration, Copenhagen, Denmark). To compare the effects of BULT and UULT during different phases of stroke, the included studies were classified as acute (mean post-stroke duration<1 month), sub-acute (mean post-stroke duration>1month to <1 year), chronic (mean post-stroke duration>1 year) or not reported.

To investigate the influence of treatment dosage on the effect size estimates, meta- regression analyses were performed using STATA 12.0 (Stata Corporation, College Station, TX, USA).

Publication bias

Egger’s test is more frequently used than other tests to detect publication bias in a meta-analysis [51]. Accordingly, Egger’s test[52] was used to detect the probability of publication bias in this study.

Heterogeneity test

The Higgins I2 index was used to evaluate the heterogeneity of the studies. The I2 boundary was set at 50%. A random effect model was used when I2 >50%, indicating heterogeneity. A fixed effect model was used when I2 <50%, indicating homogeneity (51).

Results

Study identification

The search strategy yielded 828 citations on April 10, 2018. After excluding duplicated articles, 375 potentially relevant articles were subjected to further screening via a review of the abstracts. During this meta-analysis, the third reviewer made judgments on two of the screened articles [15, 20] that were ultimately included. Finally, 21 full-text articles with 842 subjects fulfilled the eligibility criteria of the review. Details of the studies’ identification, screening, eligibility and inclusion criteria are shown in Fig 1.

thumbnail
Fig 1. The preferred reporting items for systematic reviews and meta-analysis flowchart of study identification.

https://doi.org/10.1371/journal.pone.0216357.g001

Methodological quality

Fig 2 presents the methodological quality of the included studies as evaluated using the Cochrane Collaboration risk of bias assessment tool [50].

thumbnail
Fig 2. Risk of bias summary: A review of the authors' judgments about the risk of bias of each item in each included study.

https://doi.org/10.1371/journal.pone.0216357.g002

Characteristics of the subjects

Four studies [17, 21, 53, 54] compared the effects of BULT and UULT in subjects with acute stroke. Two studies [26, 46] compared the effects of BULT and UULT in people with sub-acute stroke. Thirteen studies [15, 16, 18, 19, 2225, 28, 5558] compared the effects of these rehabilitation strategies in subjects with chronic stroke. Two studies [20, 27] did not report details of the post-stroke duration. The demographic characteristics of the subjects and the characteristics of the studies are shown in Tables 2 and 3, respectively.

thumbnail
Table 2. Cohort characteristics of studies included in the meta-analysis (alphabetically list).

https://doi.org/10.1371/journal.pone.0216357.t002

thumbnail
Table 3. Characteristics of the included studies, including types, duration, frequency of intervention and outcome measures.

https://doi.org/10.1371/journal.pone.0216357.t003

Characteristics of the intervention

Nine studies [1518, 21, 27, 53, 54, 57] compared the effects of bilateral functional task training (e.g., folding a towel, lifting two cups and picking up two pegs bilaterally) and unilateral task-related training. Four studies [17, 21, 53, 54] compared these effects in people with acute stroke. Two studies [16, 18]compared the effects of bilateral functional task training and dose-matched neurodevelopmental therapy, weight-bearing exercises and unilateral functional task training. Two studies [15, 57] compared the effects of bilateral functional task training and unilateral functional task training in people with chronic stroke. Lee and colleagues [27] investigated the combined effects of 30 minutes of bilateral functional arm training and 30 minutes of standardized occupational therapy, which included neurodevelopmental therapy, stretching exercises, resistance training and fine movement training of the affected upper limb. The outcomes of combined therapy were then compared with those observed after 60 minutes of standardized occupational therapy.

Seven studies [19, 20, 22, 24, 26, 46, 55] explored the effects of bilateral robotic-assisted or resistance training on upper limb motor function after stroke. Three studies [20, 24, 55] compared the effects of 90 minutes of bilateral robotic-assisted training and of 90 minutes of unilateral robotic-assisted training. Three studies [19, 22, 26] compared the effects of bilateral robotic-assisted training and of dose-matched unilateral functional task training in subjects with chronic stroke. Hsieh et al. [46] compared a combination of robotic-assisted priming and task-oriented training with task-oriented training alone on the affected upper limbs of patients with sub-acute stroke.

Five studies [23, 25, 28, 56, 58] compared the effects of bilateral arm training involving rhythmic auditory cueing with the effects of dose-matched unilateral upper limb training, which included neurodevelopmental therapy, upper limb mobilization, strengthening exercises and fine movement training.

Meta-analysis

Based on the measurement items categorized by the previous studies [59, 60], this review compared the overall effects of BULT and UULT on (1) improved motor impairment by pooling the results of the FMA-UE and on (2) functional performance by pooling the results of the WMFT, ARAT and the box and block test (BBT). The details of these outcome measures are presented in Table 4.

thumbnail
Table 4. Pooled assessments used to conduct the meta-analysis.

https://doi.org/10.1371/journal.pone.0216357.t004

The meta regression indicated that the number of training sessions (p = 0.947), total duration of training (p = 0.217) and duration of training per session (p = 0.316) had no significant impact on the effect size of FMA-UE.

Publication bias

According to the results of Egger’s test (Fig 3), no significant publication bias was observed in the meta-analysis of FMA-UE (p = 0.774) or of WMFT, ARAT or BBT (p = 0.950).

thumbnail
Fig 3. Results of Egger’s test for the publication bias in motor impairment (above) and functional performance (below).

SND: standard normal deviation, CI: confidence interval.

https://doi.org/10.1371/journal.pone.0216357.g003

Outcomes on motor impairment

In 16 studies [1823, 2528, 46, 5458], the FMA-UE was used to measure improvements in stroke-induced motor impairment (Fig 4). The meta-analysis revealed a significantly greater improvement in motor impairment in the BULT group, compared with the UULT group (MD = 2.21, 95%CI: 0.12 to 4.30, p = 0.04; I2 = 86%, p<0.001). However, no significant improvements were observed with BULT when compared with UULT in the subgroups according to post-stroke duration (chronic: MD = 2.03, 95%CI: -0.19 to 4.26, p = 0.07; I2 = 82%, p<0.001; subacute: MD = -1.58, 95%CI: -4.66 to 1.49, p = 0.31; I2 = 0%, p = 0.55; acute: MD = 4.01, 95%CI, -4.72 to 12.75, p = 0.37; I2 = 84%, p = 0.01; not report: MD = 3.63, 95%CI: -4.30 to 11.55, p = 0.37; I2 = 74%, p = 0.05).

thumbnail
Fig 4. Differences in the mean (95%CI) effect of BULT relative to UULT in terms of FMA-UE, using pooled by pooling data from 16 studies.

CI: confidence interval, IV: inverse variable, SD: standard deviation.

https://doi.org/10.1371/journal.pone.0216357.g004

Functional performance outcomes

In this study, improvements in functional performance were assessed using the time component of WMFT and the WMFT, ARAT and BBT scores.

The improvement in functional performance was measured by the functional ability scores of the WMFT, ARAT and BBT in 12 studies (15–17, 19, 21, 24, 25, 27, 28, 46, 53, 54) (Fig 5). Among them, four studies [17, 21, 28, 53] investigated the improvement in functional ability by ARAT, four studies [16, 19, 24, 25] measured the functional ability score of the WMFT and four studies (15, 27, 46, 54) measured BBT. No significant difference was observed between BULT and UULT in terms of improvements in the score component of the WMFT (SMD = 0.25, 95%CI: -0.02 to 0.52; p = 0.07; I2 = 54%, p = 0.02). Similarly, BULT did not yield significant improvement when compared with UULT in any of the post-stroke duration subgroups (chronic: SMD = 0.34, 95%CI: -0.17 to 0.85, p = 0.19; I2 = 63%, p = 0.03; subacute: SMD = -0.42, 95%CI: -1.13 to 0.30, p = 0.25; acute: SMD = 0.24, 95%CI: -0.12 to 0.59, p = 0.19; I2 = 52%, p = 0.10; not report: SMD = 0.68, 95%CI: -0.06 to 1.42, p = 0.07).

thumbnail
Fig 5. Difference in the mean (95%CI) effect of BULT related to UULT on the measures of WMFT, ARAT and BBT in data pooled from 12 studies.

CI: confidence interval, IV: inverse variable, SD: standard deviation.

https://doi.org/10.1371/journal.pone.0216357.g005

Five studies [16, 2325, 56] were used to evaluate the effect on improvement in the time required for the WMFT (Fig 6). A comparison of BULT and UULT revealed no significant difference in the time component of the WMFT (MD = 0.44, 95%CI: -2.22 to 3.10; p = 0.75; I2 = 55%, p = 0.06). Similarly, BULT did not yield a no significant improvement over UULT in the subgroups (chronic: MD = 0.44, 95%CI, -2.22 to 3.10, p = 0.75; I2 = 55%, p = 0.06).

thumbnail
Fig 6. Difference in the mean (95%CI) effect of BULT relative to UULT on the time component of WMFT in data pooled from 5 studies.

CI: confidence interval, IV: inverse variable, SD: standard deviation.

https://doi.org/10.1371/journal.pone.0216357.g006

Discussion

This is the first systematic review and meta-analysis to compare the effects of BULT and UULT on motor impairment and functional performance in people with stroke after excluding CIMT. The exclusion of CIMT may provide a more realistic overview of the effects of actual rehabilitation efforts. The meta-analysis examined the pooled results of 21 RCTs including 842 subjects with stroke. According to this analysis, BULT yielded significantly greater improvement in the FMA-UE, compared to UULT. However, no significant differences in the change of functional performance as indicated by the WMFT, ARAT and BBT were observed between BULT and UULT.

Motor impairment

Our results are partially consistent with the findings of a review by Coupar et al. [30]. In that review [30] of two sets of four studies, the authors found that BULT was more effective than the usual care in terms of improving the FMA-UE scores in people with stroke. However, Coupar and colleagues [30] found no differential effects between BULT and UULT in terms of improving the FMA-UE score [17, 26, 65, 66]. Our inclusion and exclusion criteria enabled us to include 4 studies [17, 23, 26, 54]from the review by Coupar and 12 other RCTs in our meta-analysis. Thus, our review may have elicited more robust estimations of the overall effects of BULT and UULT on improvments in the FMA-UE.

Two reviews [33, 40] found that BULT and UULT yielded similar reductions in motor impairment in people with stroke, as indicated by the FMA-UE score. However, these results should be interpreted cautiously because van Delden [25, 42, 65, 66] and Lee [25, 42, 65, 67] each reviewed four studies to estimate the effects of BULT and UULT on the FMA-UE. In contrast, our meta-analysis on FMA-UE was based on 16 RCTs, and included a larger sample size. Our review would therefore have a stronger power to detect a difference between BULT and UULT in terms of an improved FMA-UE score. The reviews by Lee [40] and van Delden [33] also included two studies [42, 66] that compared the effects of BULT and CIMT on improved FMA-UE scores. In our study, we only compared BULT with task-related training. This heterogeneity in the study samples explains the different conclusions of our review and the other two reviews.

Our review demonstrated a significantly greater improvement in the FMA-UE scores of people with stroke after BULT, compared with UULT. Moreover, we found no significant association of the training dosage with the improvements in FMA-UE. Therefore, the different levels of improvement between BULT and UULT was mainly attributable to the types of intervention (BULT/UULT). The excitability typically decreases in the lesional cerebral hemisphere and increases in the contralesional hemisphere [6870]. TMS studies [67, 7173] have indicated that this restoration of interhemispheric imbalance positively correlates with motor recovery after stroke. Accordingly, the different levels of improvement in the FMA-UE scores after BULT and UULT may be related to the use of different mechanisms to facilitate the reorganization in the lesional hemisphere. UULT is based on the principle of activation in the lesional hemisphere via assisted or resisted unilateral training of the paretic limb [8, 74, 75]. Compared with UULT, BULT activates similar neural networks in the bilateral hemispheres during the simultaneous activation of homologous muscle groups [14, 7678]. Studies have shown that BULT can activate the distributed corticospinal pathway bilaterally via ipsilateral corticospinal fibers [7981], contralateral corticospinal fibers [8284] and the corpus callosum[85, 86]. Compared with UULT, BULT may evoke greater activation of the lesional hemisphere by recruiting more neural pathways [14]. In the BULT group, increased activation in the lesional hemisphere might have led to greater improvements in motor impairment, as indicated by the FMA-UE scores.

Functional performance

Consistent with the findings of previous reviews [33, 40], our meta-analysis indicated that BULT was not superior to UULT in terms of improving the functional performance of people with stroke, as measured by the WMFT, ARAT and BBT. Although we observed a significantly greater improvement in the FMA-UE with BULT than with UULT, we observed no significant differences in functional performance between the training strategies. Buchner [87] reported a non-linear relationship between leg strength and gait speed in people with stroke. This curve revealed a positive slope that gradually decreased to zero; in other words, the curve eventually reached a plateau, as the leg strength increased. A muscle strength threshold is required to perform each type of activity. However, increased strength does not result in an improved gait speed until a certain threshold is reached [88]. Similarly, the improvement in the FMA-UE score and the functional performance may also exhibit a non-linear relationship. Although previous studies [62, 8991] reported a moderate to good correlation between the FMA-UE and functional performance-related scales (e.g., WMFT, ARAT and BBT), the non-linear relationship observed between these fators in our meta-analysis may reflect an inability of the stroke survivors to achieve the motor control threshold needed to perform the functional tasks. Although the FMA-UE improved to a significantly greater level in the BULT group when compared with the UULT group, this significant improvement may have been insufficient to yield a significant improvement in functional performance.

Our meta-analysis revealed that bilateral functional task training tended to yield a larger SMD for improving functional performance, compared to bilateral robotic-assisted training and bilateral arm training with auditory cueing. However, this result should be interpreted cautiously because although our meta-analysis included 9 of studies [1518, 21, 27, 53, 54, 57] on bilateral functional task training (the largest proportion), it also included only 7 studies [19, 20, 22, 24, 26, 46, 55] of bilateral robotic-assisted training and 5 studies [23, 25, 28, 56, 58] of bilateral arm training with auditory cueing. Therefore, the inclusion of more studies of bilateral robotic-assisted training and bilateral arm training with auditory cueing would support more robust conclusions regarding the effects of the different types of BULT. Moreover, we used WMFT, ARAT and BBT to estimate improvements in functional performance. The items included in these evaluation tools, such as gripping objects, folding a towel and lifting objects, are similar to the components of bilateral functional task training. Accordingly, there may be a stronger learning effect in the studies that investigated bilateral functional task training, compared to those that investigated bilateral robotic-assisted training and bilateral arm training with auditory cueing.

This systematic review had several limitations. First, we only examined 21 studies with 842 subjects. This sample size may not have been sufficiently large to detect significant differences in the functional performance outcomes. Second, the results of this review may not be generalizable to all stroke survivors. In addition to the 13 studies [15, 16, 18, 19, 2225, 28, 5558] of people with chronic stroke included in this study, only 4 studies [17, 21, 53, 54] of people with acute stroke and 2 studies [26, 46] of people with sub-acute stroke investigated the effects of BULT. Therefore, the true effect of BULT may be underestimated because of the small number of included non-chronic stroke studies. The inclusion of more studies with subjects in different phases of stroke would increase the generalizability of our conclusions. Third, most studies of Asian populations reported a significant improvement after BULT, compared with UULT. By contrast, most studies conducted in western countries reported insignificant differences between BULT and UULT. However, the reason underlying this discrepancy remains unclear. In future reviews, clear methodological information and a larger sample size may help to explain this phenomenon. Fourth, we only evaluated the immediate effects of the outcome measures. Our meta-analysis did not calculate the carry-over effects of BULT and UULT in terms of improving the FMA-UE, WMFT, ARAT and BBT score, as only 29% of the studies [17, 26, 28, 46, 53, 57] included in our review provided data from the follow-up assessments. Thus, our findings may not provide sufficient power to estimate the carry-over effects of BULT and UULT in people with stroke. These carry-over effects should be explored further. Fifth, the studies included in this review did not classify the severity of the motor impairment experienced by people with stroke. Therefore, we did not have sufficient information to analyze the effects of BULT and UULT with respect to the severity of the motor impairment.

Conclusions

Both BULT and UULT can help to improve motor impairment and functional performance after stroke. Notably, BULT was superior to UULT in terms of improving motor impairment after stroke, as measured by the FMA-UE. However, BULT and UULT yielded similar effects on functional performance in people with stroke, as measured by the WMFT, ARAT and BBT.

Supporting information

Acknowledgments

The authors wish to express their gratitude to Mr Jiaqi ZHANG for his assistance in editing and plotting the graphs.

References

  1. 1. Benjamin EJ, Blaha MJ, Chiuve SE, Cushman M, Das SR, Deo R, et al. Heart disease and stroke statistics-2017 update: a report from the American Heart Association. Circulation. 2017;135(10):e146–e603. pmid:28122885
  2. 2. Kwakkel G, Kollen BJ, van der Grond J, Prevo AJ. Probability of regaining dexterity in the flaccid upper limb: impact of severity of paresis and time since onset in acute stroke. Stroke. 2003;34(9):2181–6. Epub 2003/08/09. pmid:12907818.
  3. 3. Ingram JN, Körding KP, Howard IS, Wolpert DM. The statistics of natural hand movements. Experimental brain research. 2008;188(2):223–36. pmid:18369608
  4. 4. Harris JE, Eng JJ. Paretic upper-limb strength best explains arm activity in people with stroke. Physical therapy. 2007;87(1):88–97. pmid:17179441
  5. 5. Hubbard IJ, Carey LM, Budd TW, Levi C, McElduff P, Hudson S, et al. A randomized controlled trial of the effect of early upper-limb training on stroke recovery and brain activation. Neurorehabilitation and neural repair. 2015;29(8):703–13. pmid:25527488
  6. 6. Thielman GT, Dean CM, Gentile A. Rehabilitation of reaching after stroke: Task-related training versus progressive resistive exercise1. Archives of physical medicine and rehabilitation. 2004;85(10):1613–8. pmid:15468020
  7. 7. Narayan Arya K, Verma R, Garg R, Sharma V, Agarwal M, Aggarwal G. Meaningful task-specific training (MTST) for stroke rehabilitation: a randomized controlled trial. Topics in Stroke Rehabilitation. 2012;19(3):193–211. pmid:22668675
  8. 8. Wolf SL, Winstein CJ, Miller JP, Taub E, Uswatte G, Morris D, et al. Effect of constraint-induced movement therapy on upper extremity function 3 to 9 months after stroke: the EXCITE randomized clinical trial. Jama. 2006;296(17):2095–104. pmid:17077374
  9. 9. Page SJ, Levine P, Leonard A, Szaflarski JP, Kissela BM. Modified constraint-induced therapy in chronic stroke: results of a single-blinded randomized controlled trial. Physical therapy. 2008;88(3):333–40. pmid:18174447
  10. 10. Hammer AM, Lindmark B. Effects of forced use on arm function in the subacute phase after stroke: a randomized, clinical pilot study. Physical Therapy. 2009;89(6):526–39. pmid:19372172
  11. 11. Wu C-y, Lin K-c, Chen H-c, Chen I-h, Hong W-h. Effects of modified constraint-induced movement therapy on movement kinematics and daily function in patients with stroke: a kinematic study of motor control mechanisms. Neurorehabilitation and neural repair. 2007;21(5):460–6. pmid:17601803
  12. 12. Lin K-C, Wu C-Y, Wei T-H, Gung C, Lee C-Y, Liu J-S. Effects of modified constraint-induced movement therapy on reach-to-grasp movements and functional performance after chronic stroke: a randomized controlled study. Clinical rehabilitation. 2007;21(12):1075–86. pmid:18042603
  13. 13. Kwakkel G, Winters C, Van Wegen EE, Nijland RH, Van Kuijk AA, Visser-Meily A, et al. Effects of unilateral upper limb training in two distinct prognostic groups early after stroke: the EXPLICIT-stroke randomized clinical trial. Neurorehabilitation and neural repair. 2016;30(9):804–16. pmid:26747128
  14. 14. Cauraugh JH, Summers JJ. Neural plasticity and bilateral movements: a rehabilitation approach for chronic stroke. Progress in neurobiology. 2005;75(5):309–20. pmid:15885874
  15. 15. Han KJ, Kim JY. The effects of bilateral movement training on upper limb function in chronic stroke patients. Journal of physical therapy science. 2016;28(8):2299–302. pmid:27630418
  16. 16. Wu C-y, Chuang L-l, Lin K-c, Chen H-c, Tsay P-k. Randomized trial of distributed constraint-induced therapy versus bilateral arm training for the rehabilitation of upper-limb motor control and function after stroke. Neurorehabilitation and neural repair. 2011;25(2):130–9. pmid:20947493
  17. 17. Morris JH, van Wijck F, Joice S, Ogston SA, Cole I, MacWalter RS. A comparison of bilateral and unilateral upper-limb task training in early poststroke rehabilitation: a randomized controlled trial. Archives of physical medicine and rehabilitation. 2008;89(7):1237–45. pmid:18586126
  18. 18. Lin KC, Chen YA, Chen CL, Wu CY, Chang YF. The effects of bilateral arm training on motor control and functional performance in chronic stroke: a randomized controlled study. Neurorehabilitation and neural repair. 2010;24(1):42–51. Epub 2009/09/05. pmid:19729583.
  19. 19. Lin C-H, Chou L-W, Luo H-J, Tsai P-Y, Lieu F-K, Chiang S-L, et al. Effects of computer-aided Interlimb force coupling training on paretic hand and arm motor control following chronic stroke: A randomized controlled trial. PloS one. 2015;10(7):e0131048. pmid:26193492
  20. 20. Kim H, Miller LM, Fedulow I, Simkins M, Abrams GM, Byl N, et al. Kinematic data analysis for post-stroke patients following bilateral versus unilateral rehabilitation with an upper limb wearable robotic system. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2013;21(2):153–64. pmid:22855233
  21. 21. Meng G, Meng X, Tan Y, Yu J, Jin A, Zhao Y, et al. Short-term Efficacy of Hand-Arm Bimanual Intensive Training on Upper Arm Function in Acute Stroke Patients: A Randomized Controlled Trial. Frontiers in neurology. 2017;8:726. Epub 2018/02/07. pmid:29403422; PubMed Central PMCID: PMCPMC5780635.
  22. 22. Liao WW, Wu CY, Hsieh YW, Lin KC, Chang WY. Effects of robot-assisted upper limb rehabilitation on daily function and real-world arm activity in patients with chronic stroke: a randomized controlled trial. Clinical rehabilitation. 2012;26(2):111–20. Epub 2011/08/16. pmid:21840917.
  23. 23. Luft AR, McCombe-Waller S, Whitall J, Forrester LW, Macko R, Sorkin JD, et al. Repetitive bilateral arm training and motor cortex activation in chronic stroke: a randomized controlled trial. Jama. 2004;292(15):1853–61. pmid:15494583
  24. 24. Wu C-y, Yang C-l, Lin K-c, Wu L-l. Unilateral versus bilateral robot-assisted rehabilitation on arm-trunk control and functions post stroke: a randomized controlled trial. Journal of neuroengineering and rehabilitation. 2013;10(1):35.
  25. 25. Whitall J, Waller SM, Sorkin JD, Forrester LW, Macko RF, Hanley DF, et al. Bilateral and unilateral arm training improve motor function through differing neuroplastic mechanisms: a single-blinded randomized controlled trial. Neurorehabilitation and neural repair. 2011;25(2):118–29. pmid:20930212
  26. 26. Lum PS, Burgar CG, Van der Loos M, Shor PC, Majmundar M, Yap R. MIME robotic device for upper-limb neurorehabilitation in subacute stroke subjects: A follow-up study. J Rehabil Res Dev. 2006;43(5):631–42. Epub 2006/11/24. pmid:17123204.
  27. 27. Lee M-J, Lee J-H, Koo H-M, Lee S-M. Effectiveness of bilateral arm training for improving extremity function and activities of daily living performance in hemiplegic patients. Journal of Stroke and Cerebrovascular Diseases. 2017;26(5):1020–5. pmid:28162905
  28. 28. van Delden AL, Peper CL, Nienhuys KN, Zijp NI, Beek PJ, Kwakkel G. Unilateral versus bilateral upper limb training after stroke: the Upper Limb Training After Stroke clinical trial. Stroke. 2013;44(9):2613–6. Epub 2013/07/23. pmid:23868279.
  29. 29. Cauraugh JH, Lodha N, Naik SK, Summers JJ. Bilateral movement training and stroke motor recovery progress: a structured review and meta-analysis. Human movement science. 2010;29(5):853–70. pmid:19926154
  30. 30. Coupar F, Pollock A, Van Wijck F, Morris J, Langhorne P. Simultaneous bilateral training for improving arm function after stroke. Cochrane Database Syst Rev. 2010;4(4).
  31. 31. Latimer CP, Keeling J, Lin B, Henderson M, Hale LA. The impact of bilateral therapy on upper limb function after chronic stroke: a systematic review. Disability and rehabilitation. 2010;32(15):1221–31. pmid:20156045
  32. 32. Stewart KC, Cauraugh JH, Summers JJ. Bilateral movement training and stroke rehabilitation: a systematic review and meta-analysis. Journal of the neurological sciences. 2006;244(1–2):89–95. pmid:16476449
  33. 33. Van Delden A, Peper C, Beek PJ, Kwakkel G. Unilateral versus bilateral upper limb exercise therapy after stroke: a systematic review. Journal of rehabilitation medicine. 2012;44(2):106–17. pmid:22266762
  34. 34. Cauraugh JH, Kim S-B, Summers JJ. Chronic stroke longitudinal motor improvements: cumulative learning evidence found in the upper extremity. Cerebrovascular Diseases. 2008;25(1–2):115–21. pmid:18073464
  35. 35. Hesse S, Werner C, Pohl M, Rueckriem S, Mehrholz J, Lingnau ML. Computerized arm training improves the motor control of the severely affected arm after stroke: a single-blinded randomized trial in two centers. Stroke. 2005;36(9):1960–6. Epub 2005/08/20. pmid:16109908.
  36. 36. Richards LG, Senesac CR, Davis SB, Woodbury ML, Nadeau SE. Bilateral arm training with rhythmic auditory cueing in chronic stroke: not always efficacious. Neurorehabilitation and neural repair. 2008;22(2):180–4. pmid:17660456
  37. 37. Chang J-J, Tung W-L, Wu W-L, Huang M-H, Su F-C. Effects of robot-aided bilateral force-induced isokinetic arm training combined with conventional rehabilitation on arm motor function in patients with chronic stroke. Archives of physical medicine and rehabilitation. 2007;88(10):1332–8. pmid:17908578
  38. 38. Stinear CM, Barber PA, Coxon JP, Fleming MK, Byblow WD. Priming the motor system enhances the effects of upper limb therapy in chronic stroke. Brain: a journal of neurology. 2008;131(5):1381–90.
  39. 39. Whitall J, Waller SM, Silver KH, Macko RF. Repetitive bilateral arm training with rhythmic auditory cueing improves motor function in chronic hemiparetic stroke. Stroke. 2000;31(10):2390–5. pmid:11022069
  40. 40. Lee Y, Kim MY, Park J-H, Park HY. Comparison of the effects of bilateral and unilateral training after stroke: A meta-analysis. NeuroRehabilitation. 2017;40(3):301–13. pmid:28211818
  41. 41. Suputtitada A, Suwanwela NC, Tumvitee S. Effectiveness of constraint-induced movement therapy in chronic stroke patients. J Med Assoc Thai. 2004;87(12):1482–90. pmid:15822545
  42. 42. Van der Lee JH, Wagenaar RC, Lankhorst GJ, Vogelaar TW, Devillé WL, Bouter LM. Forced use of the upper extremity in chronic stroke patients: results from a single-blind randomized clinical trial. Stroke. 1999;30(11):2369–75. pmid:10548673
  43. 43. Taub E, Uswatte G, Pidikiti R. Constraint-induced movement therapy: a new family of techniques with broad application to physical rehabilitation-a clinical review. Journal of rehabilitation research and development. 1999;36(3):237–51. pmid:10659807
  44. 44. Page SJ, Levine P, Sisto S, Bond Q, Johnston MV. Stroke patients' and therapists' opinions of constraint-induced movement therapy. Clinical rehabilitation. 2002;16(1):55–60. pmid:11837526
  45. 45. Blanton S, Wolf SL. An application of upper-extremity constraint-induced movement therapy in a patient with subacute stroke. Physical therapy. 1999;79(9):847–53. pmid:10479785
  46. 46. Hsieh Y-w, Wu C-y, Wang W-e, Lin K-c, Chang K-c, Chen C-c, et al. Bilateral robotic priming before task-oriented approach in subacute stroke rehabilitation: a pilot randomized controlled trial. Clinical rehabilitation. 2017;31(2):225–33. pmid:26893457
  47. 47. Taub E, Miller NE, Novack TA, Fleming W, Nepomuceno C, Connell J, et al. Technique to improve chronic motor deficit after stroke. Archives of physical medicine and rehabilitation. 1993;74(4):347–54. pmid:8466415
  48. 48. Miltner WH, Bauder H, Sommer M, Dettmers C, Taub E. Effects of constraint-induced movement therapy on patients with chronic motor deficits after stroke: a replication. Stroke. 1999;30(3):586–92. pmid:10066856
  49. 49. Brogårdh C. Constraint Induced Movement Therapy: influence of restraint and type of training on performance and on brain plasticity: Samhällsmedicin och rehabilitering; 2006.
  50. 50. Green S, Higgins J. Cochrane handbook for systematic reviews of interventions. Version; 2005.
  51. 51. Lin L, Chu H, Murad MH, Hong C, Qu Z, Cole SR, et al. Empirical comparison of publication bias tests in meta-analysis. Journal of general internal medicine. 2018;33(8):1260–7. pmid:29663281
  52. 52. Egger M, Smith GD, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. Bmj. 1997;315(7109):629–34. pmid:9310563
  53. 53. Brunner IC, Skouen JS, Strand LI. Is modified constraint-induced movement therapy more effective than bimanual training in improving arm motor function in the subacute phase post stroke? A randomized controlled trial. Clinical rehabilitation. 2012;26(12):1078–86. pmid:22561098
  54. 54. Desrosiers J, Bourbonnais D, Corriveau H, Gosselin S, Bravo G. Effectiveness of unilateral and symmetrical bilateral task training for arm during the subacute phase after stroke: a randomized controlled trial. Clinical rehabilitation. 2005;19(6):581–93. pmid:16180593
  55. 55. Yang C-L, Lin K-C, Chen H-C, Wu C-Y, Chen C-L. Pilot comparative study of unilateral and bilateral robot-assisted training on upper-extremity performance in patients with stroke. American Journal of Occupational Therapy. 2012;66(2):198–206. pmid:22394529
  56. 56. Waller SM, Liu W, Whitall J. Temporal and spatial control following bilateral versus unilateral training. Human movement science. 2008;27(5):749–58. pmid:18639360
  57. 57. Singer BJ, Vallence A-M, Cleary S, Cooper I, Loftus AM. The effect of EMG triggered electrical stimulation plus task practice on arm function in chronic stroke patients with moderate-severe arm deficits. Restorative neurology and neuroscience. 2013;31(6):681–91. pmid:23963340
  58. 58. Shahine EM, Shafshak TS. The effect of repetitive bilateral arm training with rhythmic auditory cueing on motor performance and central motor changes in patients with chronic stroke. Egyptian Rheumatology and Rehabilitation. 2014;41(1):8.
  59. 59. Salter K, Jutai J, Teasell R, Foley N, Bitensky J, Bayley M. Issues for selection of outcome measures in stroke rehabilitation: ICF Participation. Disability and rehabilitation. 2005;27(9):507–28. pmid:16040555
  60. 60. Santisteban L, Térémetz M, Bleton J-P, Baron J-C, Maier MA, Lindberg PG. Upper limb outcome measures used in stroke rehabilitation studies: a systematic literature review. PloS one. 2016;11(5):e0154792. pmid:27152853
  61. 61. Fugl-Meyer AR, Jääskö L, Leyman I, Olsson S, Steglind S. The post-stroke hemiplegic patient. 1. a method for evaluation of physical performance. Scandinavian journal of rehabilitation medicine. 1975;7(1):13–31. pmid:1135616
  62. 62. Wolf SL, Catlin PA, Ellis M, Archer AL, Morgan B, Piacentino A. Assessing Wolf motor function test as outcome measure for research in patients after stroke. Stroke. 2001;32(7):1635–9. pmid:11441212
  63. 63. Van der Lee JH, De Groot V, Beckerman H, Wagenaar RC, Lankhorst GJ, Bouter LM. The intra-and interrater reliability of the action research arm test: a practical test of upper extremity function in patients with stroke. Archives of physical medicine and rehabilitation. 2001;82(1):14–9. pmid:11239280
  64. 64. Mathiowetz V, Volland G, Kashman N, Weber K. Adult norms for the Box and Block Test of manual dexterity. The American journal of occupational therapy. 1985;39(6):386–91. pmid:3160243
  65. 65. Lin K-c, Chang Y-f, Wu C-y, Chen Y-a. Effects of constraint-induced therapy versus bilateral arm training on motor performance, daily functions, and quality of life in stroke survivors. Neurorehabilitation and neural repair. 2009;23(5):441–8. pmid:19118130
  66. 66. Stoykov ME, Lewis GN, Corcos DM. Comparison of bilateral and unilateral training for upper extremity hemiparesis in stroke. Neurorehabilitation and neural repair. 2009;23(9):945–53. pmid:19531608
  67. 67. Summers JJ, Kagerer FA, Garry MI, Hiraga CY, Loftus A, Cauraugh JH. Bilateral and unilateral movement training on upper limb function in chronic stroke patients: A TMS study. Journal of the neurological sciences. 2007;252(1):76–82. Epub 2006/12/01. pmid:17134723.
  68. 68. Grefkes C, Ward NS. Cortical reorganization after stroke: how much and how functional? The Neuroscientist. 2014;20(1):56–70. pmid:23774218
  69. 69. Murase N, Duque J, Mazzocchio R, Cohen LG. Influence of interhemispheric interactions on motor function in chronic stroke. Annals of Neurology: Official Journal of the American Neurological Association and the Child Neurology Society. 2004;55(3):400–9.
  70. 70. Boddington L, Reynolds J. Targeting interhemispheric inhibition with neuromodulation to enhance stroke rehabilitation. Brain stimulation. 2017;10(2):214–22. pmid:28117178
  71. 71. Ferbert A, Vielhaber S, Meincke U, Buchner H. Transcranial magnetic stimulation in pontine infarction: correlation to degree of paresis. Journal of Neurology, Neurosurgery & Psychiatry. 1992;55(4):294–9.
  72. 72. Stinear JW, Byblow WD. Rhythmic bilateral movement training modulates corticomotor excitability and enhances upper limb motricity poststroke: a pilot study. Journal of Clinical Neurophysiology. 2004;21(2):124–31. pmid:15284604
  73. 73. Calautti C, Baron J-C. Functional neuroimaging studies of motor recovery after stroke in adults: a review. Stroke. 2003;34(6):1553–66. pmid:12738893
  74. 74. Grotta JC, Noser EA, Ro T, Boake C, Levin H, Aronowski J, et al. Constraint-induced movement therapy. Stroke. 2004;35(11_suppl_1):2699–701. pmid:15375308
  75. 75. Bonita R, Beaglehole R. Recovery of motor function after stroke. Stroke. 1988;19(12):1497–500. pmid:3201508
  76. 76. Swinnen SP, Duysens J. Neuro-behavioral determinants of interlimb coordination: a multidisciplinary approach: Springer Science & Business Media; 2012.
  77. 77. Carson R. Neural pathways mediating bilateral interactions between the upper limbs. Brain Research Reviews. 2005;49(3):641–62. pmid:15904971
  78. 78. Hallett M. Plasticity of the human motor cortex and recovery from stroke. Brain research reviews. 2001;36(2–3):169–74. pmid:11690613
  79. 79. Cattaert D, Semjen A, Summers J. Simulating a neural cross-talk model for between-hand interference during bimanual circle drawing. Biological Cybernetics. 1999;81(4):343–58. pmid:10541937
  80. 80. Turton A, Wroe S, Trepte N, Fraser C, Lemon R. Contralateral and ipsilateral EMG responses to transcranial magnetic stimulation during recovery of arm and hand function after stroke. Electroencephalography and Clinical Neurophysiology/Electromyography and Motor Control. 1996;101(4):316–28. pmid:8761041
  81. 81. Netz J, Lammers T, Hömberg V. Reorganization of motor output in the non-affected hemisphere after stroke. Brain: a journal of neurology. 1997;120(9):1579–86.
  82. 82. Ziemann U, Hallett M. Hemispheric asymmetry of ipsilateral motor cortex activation during unimanual motor tasks: further evidence for motor dominance. Clinical Neurophysiology. 2001;112(1):107–13. pmid:11137667
  83. 83. Carson R, Riek S, Mackey D, Meichenbaum D, Willms K, Forner M, et al. Excitability changes in human forearm corticospinal projections and spinal reflex pathways during rhythmic voluntary movement of the opposite limb. The Journal of physiology. 2004;560(3):929–40.
  84. 84. Carson RG, Riek S, Bawa P. Electromyographic activity, H-reflex modulation and corticospinal input to forearm motoneurones during active and passive rhythmic movements. Human movement science. 1999;18(2–3):307–43.
  85. 85. Ugawa Y, Hanajima R, Kanazawa I. Interhemispheric facilitation of the hand area of the human motor cortex. Neuroscience letters. 1993;160(2):153–5. pmid:8247346
  86. 86. Hanajima R, Ugawa Y, Machii K, Mochizuki H, Terao Y, Enomoto H, et al. Interhemispheric facilitation of the hand motor area in humans. The Journal of Physiology. 2001;531(3):849–59.
  87. 87. Buchner DM, Larson EB, Wagner EH, Koepsell TD, De Lateur BJ. Evidence for a non-linear relationship between leg strength and gait speed. Age and ageing. 1996;25(5):386–91. pmid:8921145
  88. 88. Bohannon RW. Muscle strength and muscle training after stroke. Journal of rehabilitation Medicine. 2007;39(1):14–20. pmid:17225032
  89. 89. Hodics TM, Nakatsuka K, Upreti B, Alex A, Smith PS, Pezzullo JC. Wolf Motor Function Test for characterizing moderate to severe hemiparesis in stroke patients. Archives of physical medicine and rehabilitation. 2012;93(11):1963–7. pmid:22579647
  90. 90. Platz T, Pinkowski C, van Wijck F, Kim I-H, Di Bella P, Johnson G. Reliability and validity of arm function assessment with standardized guidelines for the Fugl-Meyer Test, Action Research Arm Test and Box and Block Test: a multicentre study. Clinical rehabilitation. 2005;19(4):404–11. pmid:15929509
  91. 91. Edwards DF, Lang CE, Wagner JM, Birkenmeier R, Dromerick AW. An evaluation of the Wolf Motor Function Test in motor trials early after stroke. Archives of physical medicine and rehabilitation. 2012;93(4):660–8. pmid:22336104