Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Comparison of alternative full and brief versions of functional status scales among older adults in China

  • Jeremy Reich ,

    Contributed equally to this work with: Jeremy Reich, Mark G. Thompson

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Writing – original draft, Writing – review & editing

    Affiliation Influenza Division, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • Mark G. Thompson ,

    Contributed equally to this work with: Jeremy Reich, Mark G. Thompson

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Writing – original draft, Writing – review & editing

    isq8@cdc.gov

    Affiliation Influenza Division, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • Benjamin J. Cowling,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Writing – original draft, Writing – review & editing

    Affiliation WHO Collaborating Centre for Infectious Disease Epidemiology and Control, School of Public Health, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong Special Administrative Region, China

  • A. Danielle Iuliano,

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

    Affiliation Influenza Division, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • Carolyn Greene,

    Roles Conceptualization, Investigation, Methodology, Project administration, Resources, Supervision, Writing – review & editing

    Affiliation Influenza Division, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • Yuyun Chen,

    Roles Conceptualization, Data curation, Investigation, Methodology, Project administration, Supervision

    Affiliation WHO Collaborating Centre for Infectious Disease Epidemiology and Control, School of Public Health, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong Special Administrative Region, China

  • Rachael Phadnis,

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Project administration, Supervision

    Affiliation Abt Associates, Cambridge, Massachusetts, United States of America

  • Nancy H. L. Leung,

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Writing – review & editing

    Affiliation WHO Collaborating Centre for Infectious Disease Epidemiology and Control, School of Public Health, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong Special Administrative Region, China

  • Ying Song,

    Roles Investigation, Methodology, Project administration, Supervision, Writing – review & editing

    Affiliation Influenza Division, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  • Vicky J. Fang,

    Roles Data curation, Formal analysis, Investigation, Project administration, Writing – review & editing

    Affiliation WHO Collaborating Centre for Infectious Disease Epidemiology and Control, School of Public Health, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong Special Administrative Region, China

  • Cuiling Xu,

    Roles Conceptualization, Investigation, Methodology, Writing – review & editing

    Affiliation Chinese National Influenza Center, National Institute for Viral Disease Control and Prevention, Collaboration Innovation Center for Diagnosis and Treatment of Infectious Diseases, Chinese Center for Disease Control and Prevention, Beijing, China

  • Qigang Dai,

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Project administration, Writing – review & editing

    Affiliation Department of Acute Infectious Disease Control and Prevention, Jiangsu Provincial Center for Disease Control and Prevention, Nanjing, China

  • Jun Zhang,

    Roles Conceptualization, Data curation, Investigation, Methodology, Project administration, Supervision, Validation

    Affiliation Suzhou Center for Disease Prevention and Control, Suzhou, China

  • Hongjun Zhang,

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Project administration, Supervision

    Affiliation Yancheng Center for Disease Prevention and Control, Yancheng, China

  • Fiona Havers,

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Writing – original draft, Writing – review & editing

    Affiliation Influenza Division, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America

  •  [ ... ],
  • on behalf of the CARES investigators

    The complete membership of the author group can be found in the Acknowledgments.

  • [ view all ]
  • [ view less ]

Abstract

Background

Brief assessments of functional status for community-dwelling older adults are needed given expanded interest in the measurement of functional decline.

Methods

As part of a 2015 prospective cohort study of older adults aged 60–89 years in Jiangsu Province, China, 1506 participants were randomly assigned to two groups; each group was administered one of two alternative 20-item versions of a scale to assess activities of daily living (ADL) and instrumental activities of daily living (IADL) drawn from multiple commonly-used scales. One version asked if they required help to perform activities (ADL-IADL-HELP-20), while the other version provided additional response options if activities could be done alone but with difficulty (ADL-IADL-DIFFICULTY-20). Item responses to both versions were compared using the binomial test for differences in proportion (with Wald 95% confidence interval [CI]). A brief 9-item scale (ADL-IADL-DIFFICULTY-9) was developed favoring items identified as difficult or requiring help by ≥4%, with low redundancy and/or residual correlations, and with significant correlations with age and other health indicators. We repeated assessment of the measurement properties of the brief scale in two subsequent samples of older adults in Hong Kong in 2016 (aged 70–79 years; n = 404) and 2017 (aged 65–82 years; n = 1854).

Results

Asking if an activity can be done alone but with difficulty increased the proportion of participants reporting restriction on 9 of 20 items, for which 95% CI for difference scores did not overlap with zero; the proportion with at least one limitation increased from 28.6% to 34.2% or an absolute increase of 5.6% (95% CI = 0.9–10.3%), which was a relative increase of 19.6%. The brief ADL-IADL-DIFFICULTY-9 maintained excellent internal consistency (α = 0.93) and had similar ceiling effect (68.1%), invariant item ordering (H trans = .41; medium), and correlations with age and other health measures compared with the 20-item version. The brief scale performed similarly when subsequently administered to older adults in Hong Kong.

Conclusions

Asking if tasks can be done alone but with difficulty can modestly reduce ceiling effects. It’s possible that the length of commonly-used scales can be reduced by over half if researchers are primarily interested in a summed indicator rather than an inventory of specific types of deficits.

Introduction

The measurement of functional status is relevant to an expanding range of research topics within gerontology [1, 2] and vaccinology [3] due to associations with quality of life, healthcare costs, and clinical decision-making [4, 5]. Measures of functional status may be more closely associated with deterioration in immune function [6] than chronological age which has traditionally been used as a proxy for immunosenescence [7]. In evaluations of influenza vaccines, for example, broader measures of frailty that include limitations in functional status have been associated with antibody response to vaccination [8, 9] and differences in clinical protection from vaccination [10]. For studies such as these, where functional status is not the primary topic of interest, the ideal measurement tool should focus on functional capabilities and limitations that are relevant to community-dwelling older adults and should be brief, given budget and time constraints.

Developing valid, reliable, and efficient ways of assessing ADLs and IADLs has been a common challenge in geriatric research for decades. Early measures developed for institutionalized and disabled older adults had high ceiling effects when administered in community-based studies, with the vast majority of participants having almost perfect functioning and few deficits [11]. The Groningen Activity Restriction Scale (GARS) [12] and other measures specifically designed for community-dwelling older adults included physically and cognitively demanding activities that were more sensitive to modest impairment. The GARS and other measures interested in the early phases of decline and the subjective nature of some functional deficits [13, 14] also introduced new response options so participants can identify activities that could be performed without help but no longer with ease.

Here, we describe the results of four steps we took to develop and evaluate measures of functional status in the context of a prospective cohort study of older adults in Eastern China [15] and two ongoing influenza vaccine immunogenicity trials in Hong Kong [16]. Our first aim was to identify a functional status measurement tool that was appropriate for community-dwelling older adults in China. Specifically, we compared the measurement properties of two alternative versions of a 20-item scale to assess both activities of daily living (ADL) and instrumental activities of daily living (IADL) that were featured in commonly-used ADL-IADL scales and indices (described below). The two versions differed in their response options. Our local partners preferred to use a version that only asks older adults whether or not they require help to perform activities, similar to one application of GARS [12] and several other assessments of ADL-IADL [17, 18]. We compared this to a second version that includes both the “need help” options and the original GARS response options which ask the participant to identify activities that can be performed alone but with difficulty. As noted by the developers of GARS [19, 20] and other ADL and/or IADL tools [21, 22], we expected the version that included the full range of response options would be more sensitive to modest functional impairments and thus be more appropriate to studies of community-dwelling older adults. Nonetheless, to our knowledge, no previous study has compared the information value of these alternative response options.

Our second aim was to examine whether the number of ADL-IADL items could be reduced, while retaining items with high information value and maintaining high internal consistency. Third, we used insights from these comparisons to develop an ADL-IADL scale with fewer items and then compared results from this brief scale to other frequently used ADL-IADL scales. Fourth, we subsequently assessed whether the same pattern of findings regarding the performance of this brief scale was repeated two additional study populations.

Materials and methods

Study samples

This study includes data from three samples of older adults. The primary aims of this study were examined in the China Ageing Respiratory Infections Study (CARES) prospective cohort study of community-dwelling older adults 60–89 years of age residing in the cities of Suzhou and Yancheng in Jiangsu Province in Eastern China, in 2015. Most recruitment occurred through telephone and home visits to a random selection of older adults in the region; further details on methods and measures for CARES are described elsewhere [15]. The 1,506 CARES participants were randomly assigned to two groups; each group was administered one of two versions of the 20-item ADL-IADL scale.

For the final study aim, the brief scale developed through the analysis of information from the CARES sample was subsequently administered to community-dwelling participants in two influenza vaccine immunogenicity trials in Hong Kong: (a) Immunogenicity of twice-annual vaccination against seasonal influenza for two hemispheres in older adults in Hong Kong–a randomized controlled trial (RETAIN) in 2016 with 404 older adults aged 70–79 years recruited from ambulatory clinics, and (b) Immunogenicity of alternative annual influenza vaccines in older adults in Hong Kong–a randomized controlled trial (PIVOT) in 2017 with 1854 older adults aged 65–82 years recruited from senior centers and other community outreach efforts. In all three samples, older adults with clinical diagnoses of dementia and/or those who did not pass the Mini-cog dementia screen tool [23] were excluded.

Measures

The 20-item ADL-IADL measure include activities featured in the GARS [19, 20, 24], the Barthel Index [22, 25], the Frailty Index [26], Katz ADL scale [17], the Groningen Frailty Indicator [27], the Lawton IADL Scale [28], the Vulnerable Elders Survey (VES) [29], and indicators developed from two large longitudinal studies of older adults in Canada [30] and Beijing, China [31]. During the development of ADL and IADL measures over the past 50 years, various indicators have borrowed and refined the activities that are measured and how these items are phrased. Eighteen of the 20 ADL-IADL items we examined were featured activities in the GARS, though the exact wording differed for 11 of these items (S1 Table of S1 File). Item wordings were changed to improve consistency with how these activities were featured in other scales and/or to improve comprehension when translated based on feedback from study staff and pilot participants. One activity was only featured in the GARS, but all other activities were included in 2 to 7 measures of the nine measures we reviewed (S1 Table of S1 File). The current measure includes 12 activities focused on ADL and 8 activities focused on IADL, including ambulation, shopping, personal hygiene, food preparation, laundry, housekeeping, dressing, and feeding (S1 Table of S1 File).

The measures were administered by trained study staff. Half of the CARES participants (n = 748) were randomly assigned to receive the ADL-IADL scale version that asked if each activity could be done alone without help or if the activity required help sometimes, often, very often, or all the time (ADL-IADL-HELP-20). The other half (n = 758) received a version with the same 20 items, the same options for needing help, but if the activity could be performed alone, additional response options were given to distinguish between activities that could be done alone but with great difficulty, some difficulty, or no difficulty (ADL-IADL-DIFFICULTY-20). This group of participants were also asked questions that could be used to create scores that were similar to two other commonly used brief functional status measures: (1) the Vulnerable Elders Survey (VES) [29] is a 13-item scale that includes age, self-rated health, difficulty with activities, and specific physical capabilities (e.g., walking a quarter mile, carrying objects as heavy as 10 pounds), and (2) the Lawton IADL scale [28] rates level of performance on 8 activities (e.g., use of telephone, medication use, handling finances). The published scoring system was applied for both scales, though the exact wording of some activities differed from the original scales due to Chinese translation and the need for common administration methods.

A common set of additional variables were assessed in the CARES cohort and in the PIVOT and RETAIN trials (S2 Table of S1 File), including socio-demographic characteristics (age, sex, marital status, and educational level), self-reported days sick and days healthy in the past month, self-rated current health status [32], and number of days leaving home in the prior week. The number of chronic conditions (including cardiovascular, lung, kidney, liver, or neurological diseases; diabetes, cancers, osteoarthritis, or depression) was assessed in CARES and PIVOT, but not RETAIN. Additional variables, such as self-reported number of falls in the past 12 months, number of hospitalizations in the past two years, number of medications taken each day, and the Mini-Mental State Examination (MMSE) [33], which assesses cognitive functioning, were only assessed in the CARES cohort [33] (S2 Table of S1 File).

Statistical analyses

Similar to previous efforts to develop and evaluate functional status scales or sub-scales [27, 34], we used a combination of traditional psychometric evaluations (classical test theory) and more recent psychometric evaluations (item response theory). For the first aim, we compared the proportion of participants reporting limitations on an item-by-item basis forADL-IADL-HELP-20 andADL-IADL-DIFFICULTY-20, using a binomial test for differences in proportion with Wald 95% confidence interval (CI). We also compared the total proportion of older adults reporting at least one limitation across items using the same statistic. For the total summed scales, additional comparisons included: (a) internal consistency using Cronbach’s alpha (α), with standard thresholds [35], (b) invariant item ordering [36], using H trans (HT) and previously published thresholds [37, 38], and (c) correlations with other health-related variables as indicators of concurrent validity. All scale and item scores were log-transformed prior to assessing correlations given the skewed nature of response distributions.

For our second aim we identified ADL-IADL items that could potentially be eliminated using a two-stage process (Fig 1). In the first stage, items were considered to have good information value if they identified a substantial percentage of participants (≥4%) as having limitations; items were considered to have low information value if ≤2% of participants had limitations. Also, in this first stage, a principal component factor analysis (with oblique rotation) confirmed that a single common factor explained 65% of the variance among the ADL-IADL-DIFFICULTY-20 items. We calculated the correlation of each item with the total ADL-IADL-DIFFICULTY-20 scale after adjusting for the common factor score. Items with relatively low residual correlations (<1 standard deviation [SD] below the mean correlation) were considered good performers because most of the item variance was explained by the common factor; items with relatively high residual correlations (>1 SD above the mean) were considered poor performers because a substantial amount of item variance was not explained by the common factor; this approach is consistent with previous studies on measurement development [34, 39]. In the second stage, items with neutral performance in the first stage were evaluated based on indicators of concurrent validity; specifically, we examined Pearson correlations with age, self-rated health, and number of days per week the participant leaves the home. In both stages one and two, items with redundant content were also excluded if a better performing item focused on a very similar task.

thumbnail
Fig 1. Decision tree of ADL-IADL item categorization into good, neutral, and poor performing item categories.

https://doi.org/10.1371/journal.pone.0234698.g001

For our third aim, the resulting brief scale (ADL-IADL-DIFFICULTY-9) was compared to the full ADL-IADL-DIFFICULTY-20 and two other previously published scales (the VES and Lawton IADL scale) based on internal consistency (Cronbach’s alpha), invariant item ordering (using HT), and concurrent validity (correlations with other health indicators). Fourth, we examined external validity by evaluating these same indicators when the ADL-IADL-DIFFICULTY-9 scale was subsequently administered in the RETAIN and PIVOT samples in Hong Kong.

The study protocol received ethical approval from the Institutional Review Board of the University of Hong Kong (Ref: UW15 404), and the Ethics Committee of Jiangsu Provincial Center for Disease Control and Prevention (Ref: JSJK2015-B013-02). Written consent was provided by all participants.

Results

Participant characteristics

Demographic and health characteristics of participants in the three study samples are presented in Table 1 (additional descriptive information in S3 Table of S1 File). The random sub-samples that were administered the two ADL-IADL scale versions had similar characteristics, with the exception of somewhat better self-reported health among those who were administered the ADL-IADL-HELP-20. By study design, the age composition differs for CARES (aged 60–89 years), RETAIN (aged 70–79 years), and PIVOT (aged 65–82 years). Women comprised over half of the participants in CARES (55%) and PIVOT (57%), but only 34% of RETAIN participants. About two-thirds of participants had secondary schooling or higher education in the Hong Kong-based RETAIN (62%) and PIVOT (65%) cohorts compared to only 15% of the CARES participants in mainland China. The RETAIN and PIVOT participants had worse self-rated health than CARES participants. However, the three samples were similar in numbers of sick and healthy days reported in the past month.

thumbnail
Table 1. Sample characteristics in CARES cohort and RETAIN and PIVOT vaccine trrials.

https://doi.org/10.1371/journal.pone.0234698.t001

Comparison of the two ADL-IADL scale response option versions

When the definition of functional limitation was expanded from tasks that require help (ADL-IADL-HELP-20) to include tasks that can be performed alone but with difficulty (ADL-IADL-DIFFICULTY-20), the proportion of participants with limitations increased for all task items; this increase was statistically significant for 9 of the 20 items (Table 2). For example, the numbers of participants that reported limitations performing light and heavy housework or climbing stairs were statistically significantly higher when participants were asked if they could do the task alone but found it difficult. As a summed scale, ADL-IADL-HELP-20 identified 28.6% of participants as having at least one limitation compared to 34.2% using the ADL-IADL-DIFFICULTY-20. Thus, asking if an activity can be done alone but with difficulty increased the proportion of cohort participants with at least one limitation by 5.6% (95% CI = 0.9–10.3%); this is a relative increase of 19.6%.

thumbnail
Table 2. Percentage (%) of participants reporting any functional limitation on scales with response options that focused on need for help only (ADL-IADL-HELP-20) and response options also asessing difficulty completing tasks without help (ADL-IADL-20-DIFFICULTY) in the CARES Cohort in Eastern China, 2015.

https://doi.org/10.1371/journal.pone.0234698.t002

The item and scale performance indicators were similar for the scale with either response option versions (S4 Table of S1 File). Both scales have excellent internal consistency (α ≥ 0.90). Invariant item ordering was high (HT ≥ 0.5) for ADL-IADL-HELP-20 and medium for ADL-IADL-DIFFICULTY-20 (0.4 ≤ HT < 0.5). Both versions were similarly associated with age, self-rated health, chronic conditions, MMSE scores, and number of days leaving home per week. The only statistically significant difference observed was a correlation of 0.16 (95% CI = 0.09, 0.23) between ADL-IADL-DIFFICULTY-20 and number of falls in the past year compared to a zero association (95% CI = -0.07, 0.08) with ADL-IADL-HELP-20.

Selection of nine items for a brief ADL-IADL-DIFFICULTY scale

As summarized in Fig 1, the number of ADL-IADL-DIFFICULTY-20 items was reduced in two stages (S5 Table of S1 File). Based on item performance, four items were excluded as poor performers because few older adults (≤2%) reported needing help or experiencing difficulty and/or the item had high residual correlations with other items. Eight items displayed good performance on these indicators; of these, three items were excluded due to redundant content with other good performing items, leaving five items with good performance. Eight items with neutral performance in this first stage were then examined for concurrent validity. Four items were associated with at least two of three indicators (age, self-rated health, and days leaving home per week); of these, one item was excluded due to redundant content. Four items were related to one indicator, and one of these (standing up from chair) was retained because it addresses a mobility task that is not covered by other items. The nine selected items are referred to as ADL-IADL-DIFFICULTY-9 include ambulating, shopping, personal hygiene, housekeeping, and food preparation activities:

  • Walking around outdoors or in my neighborhood
  • Shopping for groceries
  • Climb a flight of stairs
  • Wash my whole body by taking a shower or bath
  • Take care of my feet and toenails
  • Do "light" housework like dusting or tidying up
  • Do "heavy" housework like mopping or vacuuming the floor
  • Prepare dinner
  • Stand up from sitting in a chair

Comparison of ADL-IADL-DIFFICULTY-9 scale with other scales

The brief version (ADL-IADL-DIFFICULTY-9) maintained excellent internal consistency (α = 0.93) and was similar to the 20-item version in invariant item ordering and ceiling effect (Table 3). The ADL-IADL-DIFFICULTY-9 has better internal consistency than the VES (α = 0.75) and Lawton IADL (α = 0.73) scales that were administered to this same sub-sample (Table 3). However, the VES and Lawton had better invariant item ordering ratings indicating that the ranking from most to least endorsed items within these scales was more consistent than the ranking for ADL-IADL-DIFFICULTY-9. The magnitude of correlations between the ADL-IADL-DIFFICULTY-9 and other health and functioning indicators were similar to those observed for the longer ADL-IADL-DIFFICULTY-20, VES, and Lawton IALD scales (Table 3).

thumbnail
Table 3. Measurement indicators and concurrent validity indicators for ADL-IADL-DIFFICULTY-9, ADL-IADL-DIFFICULTY-20, and two other published functional status measures.

https://doi.org/10.1371/journal.pone.0234698.t003

Performance of ADL-IADL-DIFFICULTY-9 scale in two subsequent studies

The ADL-IADL-DIFFICULTY-9 items were administered in two subsequent studies in Hong Kong. To aid in cross-study comparisons, Table 4 presents the measurement indicators with CARES participants narrowed to similar age ranges for these studies. The ADL-IADL-DIFFICULTY-9 maintained good (α = 0.82) to excellent (α = 0.90) internal consistency in the RETAIN and PIVOT samples, respectively. The ceiling effect of the summed scale was also statistically similar in the new samples. However, the invariant item ordering ratings were lower in the new samples compared to its performance with similar age groups in the CARES sample; in other words, consistency in which activities were reported as most to least difficult were lower among RETAIN and PIVOT participants. The pattern and direction of correlations between the ADL-IADL-DIFFICULTY-9 scores and other health indicators was similar for CARES and the new samples, with one exception. The ADL-IADL-DIFFICULTY-9 was not associated with the number of healthy days in the past month in the CARES (aged 65–84 years) sample, but this association was statistically significant among the PIVOT participants.

thumbnail
Table 4. Cross-study comparison of ADL-IADL-DIFFICULTY-9 from the CARES cohort and RETAIN and PIVOT vaccine trials.

https://doi.org/10.1371/journal.pone.0234698.t004

Discussion

We compared the measurement properties of two versions of an ADL and IADL measure (with activities drawn from commonly used scales) in the CARES cohort of community-dwelling older adults aged 60–89 years in Jiangsu Province, China, and developed a brief 9-item version of the scale that we further examined in two subsequent studies. Functional deficits were identified in about 20% more of the participants who were asked about difficulty performing activities alone (ADL-IADL-DIFFICULTY-20) compared to the other random half of participants who were only asked about needing help from others to perform activities (ADL-IADL-HELP-20). The brief scale we introduced here (ADL-IADL-DIFFICULTY-9) maintained excellent internal consistency and had almost identical associations with age and other measures of health and functioning when compared to the full 20-item version in the CARES cohort and when the brief scale was administered to older adults in Hong Kong.

To our knowledge, no prior study had compared the added value of response options that considered activities that could be done independently but with difficulty. We found that the expanded response options on ADL-IADL-DIFFICULTY-20 increased the proportion of older adults reporting a deficit on about half (9 of 20) of the items. This was most notable for the more physically demanding activities, such as “heavy housework” and “climb a flight of stairs.” Nonetheless, even with the expanded response options, two-thirds of CARES participants (65.8%) reported requiring no help and having no difficulty with ADLs and IADLs. Thus, assessments that include even more physically, cognitively, and socially challenging tasks (e.g., [34, 40]) may be needed to further reduce the ceiling effect.

Our findings suggest that the length of ADL-IADL scales like the GARS can be reduced by over half if researchers are primarily interested in a summed indicator rather than an inventory of specific types of deficits. The brief version (ADL-IADL-DIFFICULTY-9) had a similar ceiling effect (68.1%) to the 20-item version, in part because item selection favored activities that required help and/or were difficult to perform alone by at least 4% of participants. The retained items included activities that required mobility (e.g., walk around outdoors), physical stamina (e.g., climb a flight of stairs), dexterity (e.g., take care of my feet and toenails), and more complex mental and physical coordination (e.g., do “heavy” housework). One reason for excluding items was redundancy with other items. Although identifying specific deficits is helpful in clinical care and occupational therapy, multiple items regarding different types of housework, for example, do not offer added information in a summed scale. Other items were excluded because few participants found these difficult, which is to be expected since these activities are typically essential for independent living in the community (e.g., dressing and undressing; feed myself).

Nonetheless, the exclusion of 11 items had almost no impact on the internal consistency of the summed scale, which remained excellent (α >.90) for the brief ADL-IADL-DIFFICULTY-9, and notably higher than two other widely used ADL and IADL measures, VES (α = .64) and Lawton IADL (α = .73), which were administered to the same participants. Associations with indicators of criterion validity were also largely unchanged for the brief scale, since we intentionally selected items associated with age, self-rated health, and the number of days the participant left home in the prior week. Nonetheless, the pattern and magnitude of associations between the brief scale and health indicators were also similar to those of the VES and Lawton IADL. Results from the administration of the ADL-IADL-DIFFICULTY-9 in two new studies in Hong Kong were reassuring; the ceiling effect, internal consistency, and pattern of associations were similar, despite differences in sex, age, education, culture, and environments of participants in Hong Kong versus Eastern China.

Among the study’s strengths are its comparison of two random samples of older adults who received alternative versions of response options. Our study also assessed the performance of our brief scale in two new samples independent of the original sample. Our examination of functional status in the context of other health indicators (including chronic conditions and medications, cognitive functioning, history of falls, and reports of health and illness in the prior month) and other ADL/IADL scales is also a strength. Our study contributes to a relatively small but growing literature on functional status and frailty measurement among older adults in China (e.g., [5, 31, 41, 42]), where the rapidly aging population presents numerous societal challenges [43]. Data on older adults in Eastern China, where CARES took place, is especially limited.

Our study also has at least three limitations. First, our assessment of ADL, IADL, other health indicators relied on self-report, which is likely subject to information biases, including errors in recall and social desirability bias. This likely resulted in under-reporting of impairment and increased measurement error. Similarly, the presence and extent of “difficulty” performing an activity requires subjective interpretation, which also introduces measurement error. Second, our findings are based on cross-sectional associations, and future research is needed to examine whether the full and brief scales have similar predictive associations with changes in health status over time. Third, we relied primarily on classical or traditional measurement approaches and did not fully take advantage of methods from item response theory (see [1, 27]). Some of our decision criteria, such as what constituted low percentage of responses (≤2%) were informed by the findings in this particular study and do not correspond to well-established measurement design rules. The “medium” level of invariant item ordering observed for the ADL-IADL-DIFFICULTY-9 and 20-item versions suggests the item hierarchies (or which activities were most and least difficult) varied across CARES participants; consistency was even worse in the Hong Kong samples. It is possible that further calibration of item difficulty and personal ability (e.g., with Rasch analysis [44]) might refine item selection or inform alternative approaches to scoring item responses. Nonetheless, high invariant item ordering is a challenging and rarely met measurement yardstick [34]. It is also possible that individual differences in which ADLs and IADLs are difficult to perform should be expected, especially in populations with wide variations in education, living arrangements, and proximity to family support [20].

As interest in measuring functional status continues to expand, brief scales like ADL-IADL-DIFFICULTY-9 may be useful for studies that wish to identify relatively modest or early signs of functional decline but wish to limit the time burden on participants or have other logistical or budget constraints. Since functional status is only one element of a multi-component frailty phenotype, it is often measured with only a few items in frailty scales [2, 26]. It’s possible that a brief functional status scale, such as the one presented here, could be incorporated into frailty measurement as a unique component alongside other assessments of self-reported health or performance-based measures [26, 45], which taken together may increase the ability to predict subsequent health outcomes, like falls [46], hospital admissions [4], and mortality [2, 4, 31].

Acknowledgments

CARES investigators also include: Yi Guan, Chi Kin Lam, Qian Xiong, J. S. Malik Peiris (The University of Hong Kong); Zhang Ran, Lindsay Kim, Min Levine, Brett Whitaker (United States CDC); Pat Shifflet, William Campbell (Abt Associates); Qigang Dai (Jiangsu CDC); Lin Luan, Benfeng Zheng, Yu Xia (Suzhou CDC); Renjie Jiang, Hongjun Zhang, Guoqing Chen (Yancheng CDC); Luzhao Feng, Jiandong Zheng (China CDC). Benjamin J. Cowling (bcowling@hku.hk) is lead investigator for these authors.

The authors would like to thank Eduardo Azziz-Baumgartner, Alicia Fry, Jerome Tokars, and Lawrence Barker for helpful comments and technical support.

Disclaimer: The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.

References

  1. 1. Fieo RA, Austin EJ, Starr JM, Deary IJ. Calibrating ADL-IADL scales to improve measurement accuracy and to extend the disability construct into the preclinical range: a systematic review. BMC geriatrics. 2011;11:42. Epub 2011/08/19. pmid:21846335
  2. 2. Theou O, Brothers TD, Mitnitski A, Rockwood K. Operationalization of frailty using eight commonly used scales and comparison of their ability to predict all-cause mortality. Journal of the American Geriatrics Society. 2013;61(9):1537–51. Epub 2013/09/14. pmid:24028357.
  3. 3. Ridda I, Macintyre CR, Lindley R, Gao Z, Sullivan JS, Yuan FF, et al. Immunological responses to pneumococcal vaccine in frail older people. Vaccine. 2009;27(10):1628–36. Epub 2008/12/23. pmid:19100304.
  4. 4. Hao Q, Zhou L, Dong B, Yang M, Dong B, Weil Y. The role of frailty in predicting mortality and readmission in older adults in acute care wards: a prospective study. Scientific reports. 2019;9(1):1207. Epub 2019/02/06. pmid:30718784
  5. 5. Ye B, Gao J, Fu H. Associations between lifestyle, physical and social environments and frailty among Chinese older people: a multilevel analysis. BMC geriatrics. 2018;18(1):314. Epub 2018/12/15. pmid:30547760
  6. 6. Pawelec G. Age and immunity: What is “immunosenescence”? Experimental Gerontology. 2018;105:4–9. https://doi.org/10.1016/j.exger.2017.10.024 pmid:29111233
  7. 7. Mitnitski A, Collerton J, Martin-Ruiz C, Jagger C, von Zglinicki T, Rockwood K, et al. Age-related frailty and its association with biological markers of ageing. BMC medicine. 2015;13:161. Epub 2015/07/15. pmid:26166298
  8. 8. Yao X, Hamilton RG, Weng NP, Xue QL, Bream JH, Li H, et al. Frailty is associated with impairment of vaccine-induced antibody response and increase in post-vaccination influenza infection in community-dwelling older adults. Vaccine. 2011;29(31):5015–21. pmid:21565245.
  9. 9. Moehling KK, Nowalk MP, Lin CJ, Bertolet M, Ross TM, Carter CE, et al. The effect of frailty on HAI response to influenza vaccine among community-dwelling adults >/ = 50 years of age. Human vaccines & immunotherapeutics. 2018;14(2):361–7. Epub 2017/11/28. pmid:29172948
  10. 10. Puig-Barbera J, Garcia-de-Lomas J, Diez-Domingo J, Arnedo-Pena A, Ruiz-Garcia M, Limon-Ramirez R, et al. Influenza vaccine effectiveness in preventing influenza A(H3N2)-related hospitalizations in adults targeted for vaccination by type of vaccine: a hospital-based test-negative study, 2011–2012 A(H3N2) predominant influenza season, Valencia, Spain. PloS one. 2014;9(11):e112294. Epub 2014/11/14. pmid:25392931
  11. 11. McHorney CA. Measuring and monitoring general health status in elderly persons: practical and methodological issues in using the SF-36 Health Survey. The Gerontologist. 1996;36(5):571–83. Epub 1996/10/01. pmid:8942101.
  12. 12. Kempen GI, Suurmeijer TP. The development of a hierarchical polychotomous ADL-IADL scale for noninstitutionalized elders. The Gerontologist. 1990;30(4):497–502. Epub 1990/08/01. pmid:2394384
  13. 13. Avlund K, Schultz-Larsen K, Kreiner S. The measurement of instrumental ADL: content validity and construct validity. Aging (Milan, Italy). 1993;5(5):371–83. Epub 1993/10/01.
  14. 14. Avlund K, Kreiner S, Schultz-Larsen K. Construct validation and the Rasch model: functional ability of healthy elderly people. Scandinavian journal of social medicine. 1993;21(4):233–46. Epub 1993/12/01. pmid:8310276.
  15. 15. Cowling BJ, Xu C, Tang F, Zhang J, Shen J, Havers F, et al. Cohort profile: the China Ageing REespiratory infections Study (CARES), a prospective cohort study in older adults in Eastern China. BMJ open. 2017;7(10):e017503. Epub 2017/11/03. pmid:29092901
  16. 16. Cowling B, et al. Comparative Immunogenicity of Several Enhanced Influenza Vaccine Options for Older Adults: A Randomized Controlled Trial. Clinical infectious diseases: an official publication of the Infectious Diseases Society of America. IN PRESS.
  17. 17. Katz S, Downs TD, Cash HR, Grotz RC. Progress in development of the index of ADL. The Gerontologist. 1970;10(1):20–30. Epub 1970/01/01. pmid:5420677.
  18. 18. Roedl KJ, Wilson LS, Fine J. A systematic review and comparison of functional assessments of community-dwelling elderly patients. Journal of the American Association of Nurse Practitioners. 2016;28(3):160–9. Epub 2015/05/13. pmid:25964008.
  19. 19. Kempen GI, Miedema I, Ormel J, Molenaar W. The assessment of disability with the Groningen Activity Restriction Scale. Conceptual framework and psychometric properties. Soc Sci Med. 1996;43(11):1601–10. Epub 1996/12/01. pmid:8961404.
  20. 20. Suurmeijer TP, Doeglas DM, Moum T, Briancon S, Krol B, Sanderman R, et al. The Groningen Activity Restriction Scale for measuring disability: its utility in international comparisons. American journal of public health. 1994;84(8):1270–3. Epub 1994/08/01. pmid:8059884
  21. 21. Mahoney FI, Barthel DW. FUNCTIONAL EVALUATION: THE BARTHEL INDEX. Maryland state medical journal. 1965;14:61–5. Epub 1965/02/01. pmid:14258950.
  22. 22. Wade DT, Collin C. The Barthel ADL Index: a standard measure of physical disability? Int Disabil Stud. 1988;10(2):64–7. Epub 1988/01/01. pmid:3042746.
  23. 23. Borson S, Scanlan J, Brush M, Vitaliano P, Dokmak A. The mini-cog: a cognitive ’vital signs’ measure for dementia screening in multi-lingual elderly. International journal of geriatric psychiatry. 2000;15(11):1021–7. Epub 2000/12/13. pmid:11113982.
  24. 24. Doeglas D, Krol B, Guillemin F, Suurmeijer T, Sanderman R, Smedstad LM, et al. The assessment of functional status in rheumatoid arthritis: a cross cultural, longitudinal comparison of the Health Assessment Questionnaire and the Groningen Activity Restriction Scale. The Journal of rheumatology. 1995;22(10):1834–43. Epub 1995/10/01. pmid:8991979.
  25. 25. Wade DT, Hewer RL. Functional abilities after stroke: measurement, natural history and prognosis. Journal of neurology, neurosurgery, and psychiatry. 1987;50(2):177–82. Epub 1987/02/01. pmid:3572432
  26. 26. Searle SD, Mitnitski A, Gahbauer EA, Gill TM, Rockwood K. A standard procedure for creating a frailty index. BMC Geriatr. 2008;8:24. Epub 2008/10/02. pmid:18826625
  27. 27. Bielderman A, van der Schans CP, van Lieshout MR, de Greef MH, Boersma F, Krijnen WP, et al. Multidimensional structure of the Groningen Frailty Indicator in community-dwelling older people. BMC Geriatr. 2013;13:86. Epub 2013/08/24. pmid:23968433
  28. 28. Lawton MP, Brody EM. Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist. 1969;9(3):179–86. Epub 1969/01/01. pmid:5349366.
  29. 29. Saliba D, Elliott M, Rubenstein LZ, Solomon DH, Young RT, Kamberg CJ, et al. The Vulnerable Elders Survey: a tool for identifying vulnerable older people in the community. Journal of the American Geriatrics Society. 2001;49(12):1691–9. Epub 2002/02/15. pmid:11844005.
  30. 30. Song X, Mitnitski A, Rockwood K. Age-related deficit accumulation and the risk of late-life dementia. Alzheimer’s research & therapy. 2014;6(5–8):54. Epub 2014/10/31. pmid:25356088
  31. 31. Shi J, Song X, Yu P, Tang Z, Mitnitski A, Fang X, et al. Analysis of frailty and survival from late middle age in the Beijing Longitudinal Study of Aging. BMC geriatrics. 2011;11:17. Epub 2011/04/22. pmid:21507234
  32. 32. Thompson MG, Gaglani MJ, Naleway A, Thaker S, Ball S. Changes in Self-Rated Health and Subjective Social Status over Time in a Cohort of Healthcare Personnel. J Health Psychol. 2013. pmid:23682064.
  33. 33. Molloy DW, Standish TI. A guide to the standardized Mini-Mental State Examination. International psychogeriatrics. 1997;9 Suppl 1:87–94; discussion 143–50. Epub 1997/01/01. pmid:9447431.
  34. 34. Fieo R, Manly JJ, Schupf N, Stern Y. Functional status in the young-old: establishing a working prototype of an extended-instrumental activities of daily living scale. The journals of gerontology Series A, Biological sciences and medical sciences. 2014;69(6):766–72. Epub 2013/10/24. pmid:24149431
  35. 35. Cronbach LJ, Meehl PE. Construct validity in psychological tests. Psychological bulletin. 1955;52(4):281–302. Epub 1955/07/01. pmid:13245896.
  36. 36. Watson R, Wang W, Thompson DR, Meijer RR. Investigating invariant item ordering in the Mental Health Inventory: An illustration of the use of different methods. Personality and Individual Differences. 2014;66:74–8. https://doi.org/10.1016/j.paid.2014.03.017.
  37. 37. Ligtvoet R, Vermunt JK. Latent class models for testing monotonicity and invariant item ordering for polytomous items. The British journal of mathematical and statistical psychology. 2012;65(2):237–50. Epub 2011/06/10. pmid:21651508.
  38. 38. Watson R, van der Ark LA, Lin LC, Fieo R, Deary IJ, Meijer RR. Item response theory: how Mokken scaling can be used in clinical practice. Journal of clinical nursing. 2012;21(19–20):2736–46. Epub 2011/09/03. pmid:21883577.
  39. 39. Smith EV Jr. Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. Journal of applied measurement. 2002;3(2):205–31. Epub 2002/05/16. pmid:12011501.
  40. 40. Fieo R, Zahodne L, Tang MX, Manly JJ, Cohen R, Stern Y. The Historical Progression From ADL Scrutiny to IADL to Advanced ADL: Assessing Functional Status in the Earliest Stages of Dementia. The journals of gerontology Series A, Biological sciences and medical sciences. 2018;73(12):1695–700. Epub 2017/12/16. pmid:29244089
  41. 41. Zheng Z, Guan S, Ding H, Wang Z, Zhang J, Zhao J, et al. Prevalence and Incidence of Frailty in Community-Dwelling Older People: Beijing Longitudinal Study of Aging II. Journal of the American Geriatrics Society. 2016;64(6):1281–6. Epub 2016/06/21. pmid:27321607.
  42. 42. Woo J, Yu R, Wong M, Yeung F, Wong M, Lum C. Frailty Screening in the Community Using the FRAIL Scale. Journal of the American Medical Directors Association. 2015;16(5):412–9. Epub 2015/03/04. pmid:25732832.
  43. 43. Li J, Vellas B, Dong B, Cesari M. Frailty in China. Journal of the American Medical Directors Association. 2015;16(8):711–2. Epub 2015/07/01. pmid:26123255.
  44. 44. Fisher AG. The assessment of IADL motor skills: an application of many-faceted Rasch analysis. The American journal of occupational therapy: official publication of the American Occupational Therapy Association. 1993;47(4):319–29. Epub 1993/04/01. pmid:8322873.
  45. 45. Reuben DB, Seeman TE, Keeler E, Hayes RP, Bowman L, Sewall A, et al. Refining the categorization of physical functional status: the added value of combining self-reported and performance-based measures. The journals of gerontology Series A, Biological sciences and medical sciences. 2004;59(10):1056–61. Epub 2004/11/06. pmid:15528778.
  46. 46. Palumbo P, Palmerini L, Bandinelli S, Chiari L. Fall Risk Assessment Tools for Elderly Living in the Community: Can We Do Better? PloS one. 2015;10(12):e0146247. Epub 2015/12/31. pmid:26716861