http://orcid.org/0000-0002-4320-8595
Figures
Abstract
Background
People with stroke have a low peak aerobic capacity and experience increased effort during performance of daily activities. The purpose of this study was to examine test-retest reliability of a portable ergospirometry system in people with stroke during performance of functional activities in a field-test. Secondary aims were to examine the proportion of oxygen consumed during the field-test in relation to the peak-test and to analyse the correlation between the oxygen uptake during the field-test and peak-test in order to support the validity of the field-test.
Methods
With simultaneous measurement of oxygen consumption, participants performed a standardized field-test consisting of five activities; walking over ground, stair walking, stepping over obstacles, walking slalom between cones and from a standing position lifting objects from one height to another. All activities were performed in self-selected speed. Prior to the field-test, a peak aerobic capacity test was performed. The field-test was repeated minimum 2 and maximum 14 days between the tests. ICC2,1 and Bland Altman tests (Limits of Agreement, LoA) were used to analyse test-retest reliability.
Results
In total 31 participants (39% women, mean (SD) age 54.5 (12.7) years and 21.1 (14.3) months’ post-stroke) were included. The ICC2,1 was ≥ 0.80 for absolute V̇O2, relative V̇O2, minute ventilation, CO2, respiratory exchange ratio, heart rate and Borgs rating of perceived exertion. ICC2,1 for total time to complete the field-test was 0.99. Mean difference in steady state V̇O2 during Test 1 and Test 2 was -0.40 (2.12) The LoAs were -3.75 and 4.51. Participants spent 60.7% of their V̇O2peak performing functional activities. Correlation between field-test and peak-test was 0.689, p = 0.001 for absolute and 0.733, p = 0.001 for relative V̇O2.
Conclusions
This study presents first evidence on reliability of oxygen uptake during performance of functional activities after stroke, showing very good test-retest reliability. The secondary analysis showed that the amount of energy spent during the field-test relative to the peak-test was high and the correlation between the two test was good, supporting the validity of this method.
Citation: Gjellesvik TI, Brurok B, Tjønna AE, Tørhaug T, Askim T (2017) Oxygen uptake during functional activities after stroke—Reliability and validity of a portable ergospirometry system. PLoS ONE 12(10): e0186894. https://doi.org/10.1371/journal.pone.0186894
Editor: Alessandro Zagatto, Sao Paulo State University, BRAZIL
Received: April 5, 2017; Accepted: September 18, 2017; Published: October 24, 2017
Copyright: © 2017 Gjellesvik et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The Norwegian Act on Health Research Legislation regulates deposition of health data. The underlying data for the analysis presented in this manuscript contains sensitive information. Even though the data are anonymous, it will be possible to identify participants based on a certain combination of the variables. To solve this problem some of the variables have to be recoded into categories before making it available for replication of the analysis. Data can also be available on request to Central Norway Regional Committee of Medical and Health Research Ethics at rek-midt@mh.ntnu.no, for the purpose of performing alternative analysis than those described in the original research protocol.
Funding: The study received grants from the The Liaison Committee for education, research and innovation in Central Norway. The Norwegian Fund for Post-Graduate Training in Physiotherapy provided funding in the planning of the study. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Physical activity and exercise is highly recommended in the chronic phase after stroke to sustain functions gained in rehabilitation and as part of long-term secondary prevention of recurrent vascular events. [1–3] However, studies have found that stroke survivors have a reduced peak aerobic capacity in addition to an elevated energy expenditure (ie. oxygen uptake) in walking. [4] During performance of daily activities (ADL), oxygen uptake (V̇O2) increases in line with the demand of the activity. [5] After stroke, the V̇O2 in walking activities has been found to be nearly twice as high as in age, sex and weight matched healthy persons. [6, 7]
One limitation from research assessing V̇O2 during walking in the stroke population, is the lack of knowledge of their V̇O2peak, making it impossible to calculate the relative strain during ADL, [8–11] which has been shown to be high in patients with other cardiovascular diseases. [12, 13]
Test-retest reliability of an incremental V̇O2peak has shown to be good in chronic stroke survivors. [14] Reliable and valid methods are also needed to examine V̇O2 and energy expenditure during ADL in the stroke population. Different portable metabolic ergospirometry systems have been developed to meet this demand. [15] However, the measurement properties of these systems have been poorly investigated in the chronic stroke population. So far, only two studies have assessed the test-retest reliability of portable devices, showing good to excellent reliability during treadmill walking and over ground walking in people with chronic stroke. [8] [10] The MetaMax system (Cortex Biophysik, Leipzig, Germany) has been validated against the Douglas-Bag technique which is known to be the gold-standard in ergospirometry testing and has been found to be valid in healthy individuals. [16] Hence, assessing the concurrent validity against V̇O2peak and the relative strain during ADL would be of great interest to support the validity of this method in the stroke population.
In order to evaluate the reliability of V̇O2 during submaximal functional activities we designed a standardized field-test to measure V̇O2, related cardiopulmonary variables, heart rate (HR) and rating of perceived exertion (RPE) on the Borg scale during the performance of five functional activities in a sample of stroke participants. We also wanted to determine the proportion of energy expenditure (i.e. V̇O2) during the field-test in relation to the peak-test people after stroke specifically were consuming during the performance of the functional activities. Furthermore, to support the validity of this system we wanted to assess the correlation between V̇O2 during the field-test and peak aerobic capacity (V̇O2peak).
The specific aims were: I) To determine test-retest reliability of the MetaMax II portable ergospirometry system for measuring V̇O2 and related variables during five functional activities in people with stroke. II) To assess the proportion of V̇O2 consumed during self-paced functional activities in relation to V̇O2peak. III) To assess the correlation between the V̇O2 consumed during self-paced functional activities and during the peak-test.
Our primary hypothesis was that test-retest reliability of cardiopulmonary ergospirometry measured by a portable system during five functional activities was good with an ICC ≥ 0.80.
Our secondary hypotheses were that people after stroke spend more than 50% of their V̇O2peak during performance of functional activities in a standardized field-test and that the correlation between the V̇O2peak and the V̇O2 consumed during functional tasks was strong (r>0.60).
Methods
Participants
Participants were recruited from the Stroke Unit and a from a rehabilitation centre at Trondheim University Hospital, Norway. Inclusion started in May 2014 and ended in May 2015. Groups of 4–5 participants were included at a time. Inclusion criteria were; diagnosis of stroke, ≥ 4 months and ≤ 5 years from onset, 18 to 75 years old and living in near proximity to test sites. In addition, a minimum score on the modified Rankin Scale (mRS) of 0–3 was required. Participants were excluded if they had serious heart or lung diseases preventing them from being tested or a resting blood pressure >180/100. Participants were examined by a medical doctor before final inclusion to the study. All participants received oral and written information about the study and gave written consent. The study was approved by the Regional Committee for Medical and Health Research Ethics (REK-Vest, 2014/55).
Study design
This study had a test-retest design with an initial baseline assessment of V̇O2peak and functional tests at inclusion. Two to fourteen days later the test and retest of the ergospirometry system during functional activities in a standardized field-test was performed, with a minimum of two days between the tests. Fig 1 depicts details of the study design. No clinical change in V̇O2peak was expected during this period as the participants were asked to maintain their daily activity levels and none of the participants took part in rehabilitation or any intensive training programme.
Procedures
The same MetaMax II ergospirometry system and software was used during all test sessions. Before the V̇O2peak treadmill- test and the field-test, the oxygen (O2) and carbon dioxide (CO2) sensors were calibrated using a gas mixture sample of 15.0% O2 and 5.0% CO2. In addition, room air calibration and pressure were performed before each test. The turbine volume transducer was calibrated using a 3.0-L syringe (Hans Rudolph Inc., Kansas, USA). A facemask was positioned over the participant’s mouth and nose with the volume transducer attached. V̇O2 and related variables were measured continuously and averaged over 10-s periods. During field-testing, each participant wore the mixing chamber, transmitter and battery in a harness attached to their back in a vest (total of 1.25 kg). Cardiopulmonary variables were sent from the transmitter to a receiver and real-time measures were displayed with the MetaSoft 1 program on a laptop. The equipment has been validated for ventilatory and metabolic demand previously. [17] Measured cardiopulmonary performance parameters were V̇O2 for both absolute (L/min) and relative to body mass (mL/kg/min), carbon dioxide output (VCO2), minute ventilation rate (VE) and respiratory exchange ratio (RER). In addition, heart rate (HR) was recorded with Polar heart rate monitor (Polar Electro, Finland), and participants level of perceived exertion on the Borg scale were registered. [18] Immediately after the treadmill peak aerobic test we analysed blood lactate level drawn from the fingertip with the Lactate Pro™ Analyzer (Arkray KDK, Japan).
Test of balance, gait and cognitive function
In order to retrieve relevant background information on the participant’s physical and cognitive function, a set of functional tests were performed at inclusion (Test 1). Bergs balance test was applied to assess balance, [19] 10 meter walk test was applied to assess normal and maximal gait speed, [20] The Scandinavian Stroke Scale[21] was applied to assess severity of stroke, the modified Rankin Scale[22] was applied to assess independence in daily living and the Mini Mental State Examination test (MMSE) [23] was applied to assess cognitive function.
V̇O2peak-test
The medical doctor evaluated individual electronic patient records and performed a preparticipation health risk screening according to the guidelines for exercise testing and prescription, established by the American College of Sports Medicine (ACSM)[24]. Their body mass and height was measured and rounded to the nearest 0.5 cm. The test procedure was explained to each participant and they were familiarized to treadmill walking and the test equipment. An individualized ramped protocol was used to assess each participant’s V̇O2peak. After a 10–15 minutes’ warm-up period, their maximal walking speed was assessed and the test started with gradually increasing inclination by 2% every minute to voluntational fatigue. Verbal encouragements were given during the test and one study assistant took care of the participants’ safety. The V̇O2peak–test was conducted in a laboratory setting. Borgs RPE, peak HR and blood lactate levels were registered at termination of the test. Test termination criteria to assess V̇O2peak were a levelling off in V̇O2 despite further increase in work load, RER ≥1.05, blood lactate concentration ≥ 7.0 mmol/L and RPE ≥15. For the data analysis, the average of the 3 highest continuous 10-second V̇O2-measures was used in the calculation of V̇O2peak.
V̇O2 during the Six-minute walk test (6MWT)
Before the field-test, each participant performed a 6MWT with simultaneous measurements of V̇O2 and HR recordings wearing the portable MetaMax II device and a HR monitor. Participants were instructed to walk as far as possible during the 6 minutes between two cones 25 meter apart in a hospital corridor. They were instructed to walk at their safest but fastest walking speed. Information on remaining time was given every minute. No other encouragements were given during the test. HR was registered and averaged over the last 30 seconds of the test and the total distance in meters were registered. RPE was registered immediately after termination of the test.
V̇O2 during the standardized field-test
The field-test consisted of 5 different functional activities; walking over ground, walking with changing directions, walking over obstacles, stair walking (1 floor—19 steps) and from a standing position, lifting 5 (4x1 and 1x2 kg) objects from one height to another and back again. The starting positions of the objects were 55 cm above floor level and they were to be lifted to a height of 155 cm with their non-affected arm. Fig 2 shows an illustration of the field-test. On both test days, under supervision and instructions from the study coordinator, the participants performed a familiarization round in the field-test without wearing the portable metabolic ergospirometry equipment. The actual test started with the participant sitting for 3 minutes on a chair wearing the portable equipment attached to reach steady state and get used to the equipment. Each participant performed two laps in the field-test without a break between. Time used to complete the test was registered with a stopwatch.
For field-testing, participants were instructed to wear the same shoes/clothing and if applicable orthoses and assistive devices for the two test days. In contrast to the 6MWT, the participants were instructed to walk at “their comfortable” speed during the field-test. In detail, they were told to walk and perform the activities, as they would do in their own home. The average of the last 30 seconds (3 continuous measurements) for all cardiopulmonary variables and HR were used in the calculations. At the end of the field-test, participants were asked to report their level of perceived exertion on the Borg 6–20 scale.
Any adverse events during or after the tests were recorded.
The same testers performed the test and the re-tests. However, the results from the first test was not available for the testers when the re-test was performed.
Statistical analysis
Descriptive statistics are presented as means and standard deviations (SD). The test-retest reliability was calculated using a 2-way mixed intra class correlation coefficient (ICC2,1). The accuracy of the ICC2,1 was quantified using the 95% confidence interval (CI). The Pearson correlation coefficient was used to analyze the correlation between V̇O2 during the peak-test and the field-test. To test the limits of agreement in V̇O2 (mL/kg/min) between Test 1 and Test 2 a Bland Altman analysis was performed and a Bland Altman plot was used to depict the difference in steady state VO2 against the mean of the two measurements. Horizontal lines were drawn at the mean difference and the limits of agreement (LoA) were defined as the mean difference plus or minus 1.96 times the SD of the difference between Test 1 and Test 2. All statistical analyzes were performed in SPSS Inc. Version 22 (Chicago, Ill., USA) with an alpha level >0.05.
Results
In total 31 participants (12 women) were included in the study. Participant’s characteristics are depicted in Table 1. The mean (SD) age was 54.5 (12.7) years, the normal gait speed was 0.94 (0.52) m/s.
For all cardiopulmonary variables except RER the ICC between Test 1 and Test 2 was ≥ .80. Moreover, Bland Altman plots of within subject change in steady state V̇O2 as a function of mean steady state V̇O2 during Test 1 and Test 2 (Fig 3) demonstrate a mean difference of -0.40 (2.12) The upper LoA was drawn at 4.51, while the lower LoA was drawn at -3.75. For V̇O2, both absolute values and related to body mass, the participants consumed more than 60% of their total aerobic capacity performing self-paced functional activities. V̇O2 during the 6MWT showed similar results (Tables 2 and 3).
Red horizontal line represents the mean difference between tests. Green horizontal lines are reference lines representing 5% and 95% confidence intervals (± 1.96 SD).
One person did not complete the V̇O2peak test because of comorbidity influencing the well-being of the person at the time of the V̇O2peak-test. However, the field-test was performed as planned. The mean (SD) V̇O2 was 33.59 (9.54) mL/kg/min during the peak-test and 19.0 (3.2) mL/kg/min during the field-test (Table 4). The time used to complete the field-test ranged from less than 3 minutes to more than 12 minutes (Table 4).
A moderate correlation was found for both absolute (L/min) and relative (mL/kg/min) V̇O2 values between the treadmill peak-test and the field-test, r = 0.689 and r = 0.733, p>0.001, respectively (Table 4).
The rating on the Borgs scale of perceived exertion during the field-test was 75.5 (16.4) % of the rating during the peak test (Table 4). The correlation between these ratings was poor (r = -0.179).
Adverse events
One participant with epilepsy as comorbidity, experienced a mild seizure within 1 hour after the V̇O2peak-test. The incident happened at the hospital where the test had been performed. He was admitted to the neurological ward and was observed for 2 hours before he could leave the hospital. The responsible medical doctor considered that it was safe for him to continue his participation in the study. No other adverse events were registered within the course of this study.
Discussion
This is the first study to assess test-retest reliability of a portable metabolic ergospirometry measurement system during functional activities in people with chronic stroke. The main finding was that the MetaMax II system was reliable for measuring energy expenditure during functional activities in people with mild to moderate stroke.
Our secondary hypotheses were also confirmed as the correlation between V̇O2 from the peak-and the field-test reached r>0.6 and because participants spent more than 50% of their peak aerobic capacity during the field-test.
Nunnally and Bernstein (1994) [25], argued that an ICC of ≥ .70 or greater is considered acceptable but higher values are more favorable. In the present study, we found very good reliability (ICC ≥ .80) for walking distance, V̇O2, CO2, HR and RPE during 6MWT. However, only distance and V̇O2 reached an ICC ≥ .90. This is in contrast to the results from Stookey et al. (2013) who reported ICC values ≥ .90 for V̇O2, VE and CO2 using a portable ergospirometry system (Vmax, Sensor Medics) during the 6MWT in people with stroke. [8] Our ICC values during the field-test were slightly lower compared to the 6MWT. However, all variables except the RER achieved an ICC ≥80. Possible explanations for the slightly lower ICC values during the field-test might be the more complex nature of functional activities, challenging the metabolic demands of our sample more than over-ground walking. Although the limits of agreement depicted for steady state VO2 in the present study were a bit larger than those reported by Stookey et al., [8] we believe that our findings indicates that small changes also can be detected by the portable metabolic ergospirometry measurement system during functional tasks.
Interestingly, the relationship between the V̇O2 and V̇O2peak was almost the same during the 6MWT and the field-test, indicating that performing daily activities at comfortable speed is as strenuous as walking 6 minutes at fast speed in this population. Spruit et al. (2011) found that patients with chronic heart failure spent more than 50% of their V̇O2peak while getting dressed measured with portable ergospirometry [12] whereas in our study, we found that people with stroke spent more than 60% of their V̇O2peak during functional activities in the standardized field-test.
According to a recent systematic review, it is well documented that stroke survivors consume more energy during walking compared to healthy controls. [7] In addition, Slawinski et al. (2014) assessed the energy cost of stroke participants clearing and skirting obstacles and found that the stroke group had a higher energy cost compared to a matched healthy group. [9] This is in line with the study of Kafri et al. (2014) who reported that stroke survivors have a high metabolic cost during various functional activities. [11] An interesting conclusion from the above mentioned studies is the lack of difference in V̇O2 during the activities performed between participants with stroke and the healthy control groups. This is explained by the higher speed of walking in healthy individuals compared to the persons with stroke. A limitation from this research is that the participants’ V̇O2peak is estimated indirectly.
So far, no studies have assessed the correlation between V̇O2 measured during a treadmill peak-test and a standardized field-test consisting of regular daily activities. According to de Vet et al. (2011), criterion validity is defined as the degree to which the scores of an instrument are an adequate reflection of a gold standard. [26] Furthermore, criterion validity can be subdivided into concurrent validity and predictive validity. Unfortunately, there exist no gold standard for measuring oxygen consumption during a field test. Hence, the criterion validity can only be supported by assessing the strength of the relationship against another clinical measure, which in our study was the peak-test. The relationship between V̇O2 in the peak- and field-test was expected to be stable. Hence, the correlation (r>0.6) found in the present study strengthens the validity of the MetaMax II portable ergospirometry system applied during the field test.
Methodological considerations
Even though a sample size of 31 participants as included in the present study is regarded as a fair sample size according to the COSMIN checklist [26], it is a relatively large sample size compared to similar studies in the stroke population assessing V̇O2 measures. [10, 14] Additionally, robust testing of V̇O2peak prior to assessing V̇O2 during functional activities allowed for calculations of relative strain during the standardized field-test, which may be considered as a strength of the present study.
Our participants were relatively young, however at approximately the same age as similar studies conducted in this population. [7] The participants were also at the higher end of the scale in terms of physical functioning. Hence, the results from the present study should not be generalized to the stroke population at the lower end of the scale in terms of physical functioning. [7]
Our results were averaged over the last 30 seconds of the field-test lasting for more than 4 minutes. For those participants spending longer time to complete the test, the V̇O2 during some activities would be higher and exact knowledge about the V̇O2 in each activity would have been useful, but this was not the purpose in the present study.
Finally, by using the same testers during both occasions of field-testing may have introduced a potential bias. To minimize such bias, the testers were instructed not to review cardiopulmonary test values from the first test before conducting the second test. In addition, participants were unaware of their test results.
Clinical implications
Our results suggest that the portable MetaMax II ergospirometry measurement system is a reliable and valid tool for measuring energy consumption during daily activities after stroke. This method has the potential to reliably evaluate cardiorespiratory changes after rehabilitation programs and interventions in the stroke population. Caution should be taken in generalizing the findings from the present study to more severely affected stroke survivors and older individuals.
Conclusions
This is the first study to establish the test-retest reliability of portable oxygen uptake measurement in people with stroke performing functional activities. Our results demonstrate good to very good test-retest reliability of portable ergospirometry, indicating that the equipment for the most important cardiopulmonary performance parameters could be used outside laboratory settings. The participants in the present study spent a great proportion of their peak aerobic capacity during activities frequently encountered in daily life. Finally, the correlation between V̇O2 during the peak incremental treadmill test and the field-test was good, supporting the validity of this method.
Acknowledgments
The authors would like to thank all participants for their effort and enthusiasm in this study. We are also grateful to the staff at “Fys.Med. Lian” for their patience and help during testing and to Roland Stock for help with an illustration of the field-test. Test-equipment was provided by NeXtMove, Norwegian University of Science and Technology (NTNU). NeXtMove is funded by the Faculty of Medicine at NTNU and Central Norway Regional Health Authority.
References
- 1. Feigin VL, Roth GA, Naghavi M, Parmar P, Krishnamurthi R, Chugh S, et al. Global burden of stroke and risk factors in 188 countries, during 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet Neurol. 2016;15(9):913–24. Epub 2016/06/14. pmid:27291521.
- 2. Hankey GJ. Stroke. Lancet (London, England). 2016. Epub 2016/09/18. pmid:27637676.
- 3. Saunders DH, Sanderson M, Hayes S, Kilrane M, Greig CA, Brazzelli M, et al. Physical fitness training for stroke patients. The Cochrane database of systematic reviews. 2016;3:Cd003316. Epub 2016/03/25. pmid:27010219.
- 4. Macko RF, DeSouza CA, Tretter LD, Silver KH, Smith GV, Anderson PA, et al. Treadmill aerobic exercise training reduces the energy expenditure and cardiovascular demands of hemiparetic gait in chronic stroke patients. A preliminary report. Stroke; a journal of cerebral circulation. 1997;28(2):326–30. pmid:9040684.
- 5. Ainsworth BE, Haskell WL, Herrmann SD, Meckes N, Bassett DR Jr, Tudor-Locke C, et al. 2011 Compendium of Physical Activities: a second update of codes and MET values. Medicine and science in sports and exercise. 2011;43(8):1575–81. Epub 2011/06/18. pmid:21681120.
- 6. Billinger SA, Arena R, Bernhardt J, Eng JJ, Franklin BA, Johnson CM, et al. Physical activity and exercise recommendations for stroke survivors: a statement for healthcare professionals from the American Heart Association/American Stroke Association. Stroke; a journal of cerebral circulation. 2014;45(8):2532–53. pmid:24846875.
- 7. Kramer S, Johnson L, Bernhardt J, Cumming T. Energy Expenditure and Cost During Walking After Stroke: A Systematic Review. Arch Phys Med Rehabil. 2016;97(4):619–32 e1. Epub 2015/12/22. pmid:26686877.
- 8. Stookey AD, McCusker MG, Sorkin JD, Katzel LI, Shaughnessy M, Macko RF, et al. Test-retest reliability of portable metabolic monitoring after disabling stroke. Neurorehabil Neural Repair. 2013;27(9):872–7. Epub 2013/08/01. pmid:23901060.
- 9. Slawinski J, Pradon D, Bensmail D, Roche N, Zory R. Energy cost of obstacle crossing in stroke patients. Am J Phys Med Rehabil. 2014;93(12):1044–50. Epub 2014/06/12. pmid:24919075.
- 10. Platts MM, Rafferty D, Paul L. Metabolic cost of over ground gait in younger stroke patients and healthy controls. Medicine and science in sports and exercise. 2006;38(6):1041–6. Epub 2006/06/16. pmid:16775542.
- 11. Kafri M, Myslinski MJ, Gade VK, Deutsch JE. High metabolic cost and low energy expenditure for typical motor activities among individuals in the chronic phase after stroke. J Neurol Phys Ther. 2014;38(4):226–32. Epub 2014/09/10. pmid:25198864.
- 12. Spruit MA, Wouters EF, Eterman RM, Meijer K, Wagers SS, Stakenborg KH, et al. Task-related oxygen uptake and symptoms during activities of daily life in CHF patients and healthy subjects. Eur J Appl Physiol. 2011;111(8):1679–86. Epub 2011/01/07. pmid:21210281.
- 13. Nieuwenburg-van Tilborg EM, Horstman AM, Zwarts B, de Groot S. Physical strain during activities of daily living of patients with coronary artery disease. Clinical physiology and functional imaging. 2014;34(2):83–9. Epub 2013/07/03. pmid:23815382.
- 14. da Cunha-Filho IT, Henson H, Wankadia S, Protas EJ. Reliability of measures of gait performance and oxygen consumption with stroke survivors. J Rehabil Res Dev. 2003;40(1):19–25. Epub 2004/05/20. pmid:15150717.
- 15. Overstreet BS, Bassett DR Jr., Crouter SE, Rider BC, Parr B. Portable open-circuit spirometry systems: a review. The Journal of sports medicine and physical fitness. 2016. Epub 2016/02/11. pmid:26861831.
- 16. Larsson PU, Wadell KM, Jakobsson EJ, Burlin LU, Henriksson-Larsen KB. Validation of the MetaMax II portable metabolic measurement system. Int J Sports Med. 2004;25(2):115–23. pmid:14986194.
- 17. Medbo JI, Mamen A, Welde B, von Heimburg E, Stokke R. Examination of the Metamax I and II oxygen analysers during exercise studies in the laboratory. Scand J Clin Lab Invest. 2002;62(8):585–98. Epub 2003/02/05. pmid:12564617.
- 18. Borg G. Ratings of perceived exertion and heart rates during short-term cycle exercise and their use in a new cycling strength test. Int J Sports Med. 1982;3(3):153–8. Epub 1982/08/01. pmid:7129724.
- 19. Berg K, Wood-Dauphinee S, Williams JI. The Balance Scale: reliability assessment with elderly residents and patients with an acute stroke. Scand J Rehabil Med. 1995;27(1):27–36. Epub 1995/03/01. pmid:7792547.
- 20. Bohannon RW. Comfortable and maximum walking speed of adults aged 20–79 years: reference values and determinants. Age Ageing. 1997;26(1):15–9. Epub 1997/01/01. pmid:9143432
- 21. Multicenter trial of hemodilution in ischemic stroke—background and study protocol. Scandinavian Stroke Study Group. Stroke; a journal of cerebral circulation. 1985;16(5):885–90. Epub 1985/09/01. pmid:3901425.
- 22. Kwon S, Hartzema AG, Duncan PW, Min-Lai S. Disability measures in stroke: relationship among the Barthel Index, the Functional Independence Measure, and the Modified Rankin Scale. Stroke; a journal of cerebral circulation. 2004;35(4):918–23. Epub 2004/02/21. pmid:14976324.
- 23. Folstein MF, Folstein SE, McHugh PR. "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. Journal of psychiatric research. 1975;12(3):189–98. Epub 1975/11/01. pmid:1202204.
- 24. Riebe D, Franklin BA, Thompson PD, Garber CE, Whitfield GP, Magal M, et al. Updating ACSM's Recommendations for Exercise Preparticipation Health Screening. Medicine and science in sports and exercise. 2015;47(11):2473–9. Epub 2015/10/17. pmid:26473759.
- 25.
NJ C., BI H.. Psychometric Theory. New York: McGraw-Hill; 1994.
- 26.
de Vet HCW, Terwee CB, Mokkink LB, Knol DL. Measurement in Medicine: A Practical Guide: Cambridge University Press; 2011.