http://orcid.org/0000-0003-3376-5731
Figures
Abstract
Objective
The aim of the study was to determine the longitudinal validity, reproducibility, responsiveness and interpretability of the adult version of the Brisbane Burn Scar Impact Profile, a patient-report measure of health-related quality of life.
Methods
A prospective longitudinal cohort study of patients with or at risk of burn scarring was conducted at three assessment points (at baseline around the time of wound healing, one to two weeks post-baseline and 1-month post-baseline). Participants attending a major metropolitan adult burn centre at baseline were recruited. Participants completed the Brisbane Burn Scar Impact Profile and the 36-item Short Form Health Survey and Patient Observer Scar Assessment Scale. Intraclass Correlation Coefficients (ICCs), smallest detectable change, percentage of those who improved, stayed the same or worsened and Area under the Receiver Operating Characteristic Curve (AUC) were used to test the aim.
Results
Data were included for 118 participants at baseline, 68 participants at one to two weeks and 57 participants at 1-month post-baseline. All groups of items had acceptable reproducibility, except for the overall impact of burn scars (ICC = 0.69), the impact of sensations which was not expected to be stable (ICC = 0.63), mobility and daily activities (ICC = 0.63, 0.67 respectively). The responsiveness of six out of seven groups of items able to be tested against external criterion was supported (AUC = 0.72–0.75). Hypothesised correlations of changes in the Brisbane Burn Scar Impact Profile items with changes in criterion measures generally supported longitudinal validity (e.g., nine out of thirteen hypotheses using the SF-36 as an external criterion were supported). Internal consistency estimates, item-total and inter-item correlations indicated there was likely redundancy of some groups of items, particularly in the relationships and social interaction, appearance and emotional reactions items (Chronbach’s alpha range = 0.94–0.95).
Citation: Tyack Z, Kimble R, McPhail S, Plaza A, Simons M (2017) Psychometric properties of the Brisbane Burn Scar Impact Profile in adults with burn scars. PLoS ONE 12(9): e0184452. https://doi.org/10.1371/journal.pone.0184452
Editor: Leila Harhaus, BG Trauma Center Ludwigshafen, GERMANY
Received: March 9, 2017; Accepted: August 24, 2017; Published: September 13, 2017
Copyright: © 2017 Tyack et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The individual data used in this study cannot be made publicly available due to ethical constraints and governance arrangements to protect patient privacy and ensure appropriate data use. Data can be requested from the data custodians with appropriate ethical and governance approvals from Metro South Health who can be contacted at the following email: EthicsResearch.PAH@health.qld.gov.au. Interested readers can address data requests to: z.tyack@uq.edu.au.
Funding: Queensland Children’s Medical Research Institute provided funding to support the use of consumables and time for the lead investigator to collect the data. Central Queensland Hospital and Health Service provided staff support for the lead investigator to oversee the project. The Queensland Health, Health Practitioner Research Scheme 2012–2013 provided funding for a research assistant to assist to collect the data. The Australian Catholic University provided staff support for the lead investigator to collect data. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: RK was a member of the Queensland Children's Medical Research Centre at the time that funding was provided for the study. ZT was a staff member of the Central Queensland Hospital and Health Service District and Australian Catholic University at the time those organisations provided support for the study. AP was staff member at the Royal Brisbane and Women's Hospital where the research was conducted. This does not alter our adherence to PLOS ONE policies on sharing data and materials.
Introduction
Burns can have devastating physical and psychological effects on individuals. In addition, treatments for burns and burn-related scarring use substantial amounts of healthcare resources [1] which, in the case of scar-related interventions, can continue long after the acute burn management has been completed. Scarring is a normal part of healing after tissue damage; however, in some patients an exaggerated response occurs involving complex molecular and cellular processes that are thought to be linked to immune [2] and sensorineural responses. The most common form of these exaggerated scar responses are hypertrophic scars [3] that are characterised by redness and thickness. It is estimated that 32 to 72 percent of patients with burns will develop hypertrophic scars [4]. The substantial burden of disease attributed to burn scars is demonstrated by findings that those with burn scarring have a significantly higher risk of re-admission and have treatment costs that are 5.6 times higher than those without scarring [5]. Studies of the effectiveness of scar interventions have been limited by the use of outcome measures with unknown psychometric properties among people with burn scarring and that have frequently not included the measurement of health-related quality of life.
The importance of measuring health-related quality of life in patients with burn scarring has been highlighted. Studies have found associations between burn scar severity, visibility and health-related quality of life [6], and limitations in three or more domains of health-related quality of life have been found in adults up to and including 18 months post-burn [7]. A new condition-specific patient-report outcome measure (PROM) of health-related quality of life was developed for people at risk of, or with burn scarring, as no such measure existed (termed the Brisbane Burn Scar Impact Profile—BBSIP, available at www.ccbtr.com.au [8]. This is the first known burn scar specific PROM measuring health-related quality of life. It is also the first multidimensional health-related PROM for people with burns to be developed based on interviews of patients themselves (N = 30 adults and children) [8], as existing burn-specific multidimensional health-related PROMs were developed using a literature review and expert opinion [9]. Content validity is also supported by the item development being based on a burn-scar specific conceptual framework of health-related quality of life [10]. Items were grouped into overall impact of scars; the intensity, frequency and impact of itch, pain and other sensations; work and daily activities (mobility and daily activities items); relationships and social interaction; and appearance, emotional reactions; and physical symptoms. The measure included items distinct from other burn-specific PROMs for burns including items measuring the intensity of tightness; sensitivity to cold, touch, or clothing; the impact of sensations when going downhill or downstairs; the impact of scar treatments and fatigue linked to burn scars; and the impact of scars on daily routines [8].
Although preliminary content validation has been conducted [8] work was required to test other psychometric properties of the Brisbane Burn Scar Impact Profile (BBSIP). The aim of this study was to test the longitudinal validity, reproducibility, and responsiveness of the BBSIP in the post-acute period in line with an evaluative purpose (tracking changes in scarring over this period).
Materials and methods
Design, setting, participants, and interventions
A prospective longitudinal cohort study of patients with three assessment points ((baseline around the time of wound healing, one to two weeks post-baseline (termed 1-week follow-up) and 1-month post-baseline (termed 1-month follow-up)) was conducted. The setting was an outpatient clinic that provided burn care to adults at a major metropolitan Australian hospital in Brisbane. Consecutive patients were sampled from 2013 to 2015 (17/04/2013–04/07/2013; 26/09/2013–10/10/2013; 16/01/2014–28/07/2014; 3/11/2014–24/11/2014) based on the availability of two assessors.
A sample size of 50 participants was sought for testing longitudinal validity, reproducibility, and responsiveness which is considered an appropriate sample size for testing those psychometric properties [11]. This sample size was sufficient to detect an ICC of 0.80 with 95% confidence intervals from 0.70 to 0.90 [12]. A sample size of 49 participants was also sufficient to detect a one sample correlation of 0.39 with 80 percent power and an alpha of 0.05 [13]. Eligibility criteria were: patients with scarring or with the potential to scar who attended the treating centre for their acute burn or follow-up management, aged over 18 years, having completed the BBSIP on at least one occasion, having burn wounds that were at least approximately 85% healed with the potential to scar at the baseline assessment. Patients with a range of burn scar severity (including those with scarring that restricted range of motion) were invited to participate. Patients with a cognitive, intellectual or physical impairment that impaired communication or memory were excluded, as were those with scars not caused by a burn injury and those who had eye or respiratory burns alone.
Participants received face-to-face usual care interventions during the study period which was tailored to their clinical presentation and the priorities identified by the treating team. Usual care in this setting included pressure garments, wound dressings, exercises, taping to prevent or manage contractures, oro-facial orthoses or splints to prevent or manage contractures, return-to-work programs, skin moisturizers, skin massage, medication for sleep, itch or psychopathology, psychological screening and non-pharmacological intervention such as counselling. The length and frequency of intervention received varied across participants. After skin healing outpatient appointments were typically scheduled weekly or fortnightly initially, if the patient required pressure garments that needed to be measured or fitted. Patients requiring ongoing scar management were typically reviewed monthly or second monthly if they lived locally or every three to six months if they lived a long distance from the treating centre (with regular follow-up continued locally). The majority of the participants received their acute burn care in the setting where the study was conducted.
Questionnaires and other outcome measures
The adult version of the BBSIP, measuring health-related quality of life of adults with burns scars, was tested. The development of the measure, preliminary content validation and a conceptual framework linked to development of the measure have been previously described [8]. The measure consists of 66 items and 10 item groupings. Items of the BBSIP are rated using a range of response formats including dichotomous scales for items such as the presence or absence of open wounds; 11-point numeric rating scales for the intensity of sensory items (where 0 indicates the absence of the sensation and 10 indicates the sensation as bad as it can possibly be); 7-point likert scales for overall impact, daily living activities, emotional reactions, and social functioning; and 5-point likert scales for the frequency of sensory items and intensity of physical symptoms. The lower end of each scale indicates worse health-related quality of life.
Other measures included were the observer and patient scales of the Patient Observer Scar Assessment Scale (POSAS) and the 36-item Short Form Health Survey (SF-36, version 2.0). The POSAS has been deemed to have acceptable reliability but indeterminant content and construct validity and internal consistency in a 2012 systematic review of burn scar rating scales [14]. Since that review, further work has supported the internal consistency and predictive validity of the patient and observer scale [15]. Structural validity has generally been supported using RASCH analysis although inclusion of the surface area items when assessing burn scars was not supported [16] and thus was not included in this study. The SF-36 is a generic measure of health-related quality of life that consists of eight subscales that were used in this study (physical functioning, role-physical, bodily pain, general health, vitality, social functioning, role emotional and mental health). The eight SF-36 dimensions were scored on 0 to 100 percentage scales with lower values indicating worse health-related quality of life. The SF-36 has been validated in adult patients with burns with discriminant and temporal validity supported [17].
Demographic details and clinical characteristics were collected from patients or their medical records and included gender, highest level of education attained, scar location, restrictions in range of motion (or joint contractures or scars pulling on other body parts), skin grafting, age, Fitzpatrick skin type, percent total body surface area burned (TBSA), days post-burn, and days to wound healing.
Procedures
The COnsensus based Standards for the selection of health Measurement INstruments (COSMIN) checklist [18] was used as a guide for reporting the psychometric properties. All outcome measures were completed in paper format at baseline, 1-week follow-up (to determine reproducibility) and 1-month follow-up (to determine longitudinal validity and responsiveness). The criteria of 85% skin healing for baseline measurements to be taken was judged visually by an assessor. Two assessors were involved in obtaining consent, providing instructions and the PROMs to participants. The order of the PROMs and instructions were standardised. A 1- to 2-week test retest interval was chosen as the period during which physical scar properties such as thickness and vascularity were expected to be relatively stable, based on other studies that have examined reproducibility of scar measures using this interval [19,20]. The POSAS and scar intensity components of the BBSIP were administered for the worst area of scarring, which patients were asked to identify prior to the measures being administered. The only exception to this was when the scar site was difficult to relocate. In this case another worst area of scarring was chosen by the patient. This worst area was identified using a 3 by 3cm area, marked on the skin using a soft tipped skin pencil. When patients were unable to return to the hospital to complete the measures, the 1-week follow-up and 1-month follow-up measures were posted with a self-addressed return envelope and instructions for completion at home. Approximate time to wound healing was obtained from the medical records or judged visually by the assessor when patients returned to the hospital.
Statistical analysis
Validity (convergent and divergent).
Hypothesised correlations between scores on the BBSIP items and total score and respective items and subscale scores of the POSAS and SF-36 were specified a-priori (as highlighted in the tables) and were expected to be higher than 0.3 at baseline and higher than correlations with other items at 1-month follow-up. Correlations of changes in BBSIP scores with changes in respective SF-36 and POSAS items over the 1-month follow-up were also analysed to determine longitudinal validity. In brief, the pain item of the POSAS was expected to correlate more strongly with the pain item of the BBSIP as well as with the tightness item based on our previous work. The patient’s overall opinion of the scar on the POSAS was expected to correlate strongly with the appearance items of the BBSIP at baseline and for change from baseline to 1-month follow-up compared to respective correlations with other items. The sensory-related items of the BBSIP were expected to correlate more strongly with the itch and pain items of the POSAS than with other POSAS items, with correlations between respective items expected to be strongest (i.e. itch on the BBSIP with itch on the POSAS). Changes in BBSIP individual and group items related to mood and emotional responses were expected to correlate more strongly with the SF-36 mental health subscale than with other subscales. BBSIP individual and group items related to ADL, mobility, work and daily activities, and physical scar symptoms were expected to correlate more strongly with SF-36 physical functioning subscales than with other SF-36 subscales. BBSIP individual and group items related to social functioning were expected to correlate more strongly with the SF-36 social functioning subscale than with other SF-36 subscales. The BBSIP items of tight scars making you tired was expected to correlate more strongly with the vitality subscale of the SF-36 than with other SF-36 subscales.
Descriptive statistics, internal consistency and inter-item correlations.
Descriptive statistics were used to describe the study sample (e.g. means and standard deviations, medians and interquartile ranges for continuous data, and frequencies and percentages for count data). Differences in demographic and clinical variables of participants between the time points were examined using related-sample data analyses (Wilcoxon Signed Rank Test for ordinal data and McNemar Test for nominal data). Missing data on the SF-36 data were imputed using the mean values of the remaining dimension items as recommended [21], when less than 50% of the items were missing. When 50% or greater of SF-36 subscale items were missing, data were treated as missing. Individual BBSIP items scored as not applicable were treated as missing and only complete data were used in individual item analyses. Total BBSIP subscale scores were calculated where the number of missing or not applicable items was less than 50% of the subscale items, by summing the available scores divided by the number of available items. Chronbach’s alpha and inter-item and item-total correlations using Spearman’s rho were used to indicate the internal consistency and inter-relatedness of items considered to group into sub-scales. Chronbach’s alpha of 0.7 to 0.9, item-total correlations of 0.3 to 0.7 [22] and inter-item correlations of approximately 0.20 to 0.40 [23] were considered ideal with higher values indicating potential redundancy of items.
Reproducibility and responsiveness.
Reproducibility was tested by examining agreement and reliability. Agreement between baseline and 1-week follow-up was examined for all items using the number and percentage of items with exact agreement, agreement within 1-point and agreement within 2-points were also calculated for items with three or more response options. Agreement was also examined using standard errors of measurement (SEM), and smallest detectable change (SDC), where assumptions of normality were met. The SEM was calculated as √σ2 (where σ2 was the mean square error term from the ICC ANOVA) [11, 24] and the SDC was calculated as 1.96 x √2 x SEM. Reliability was examined using Cohen’s kappa for the dichotomous item and Intraclass Correlation Coefficients (ICC’s) for other items. ICC’s were calculated using a two-way, random effects model and associated confidence intervals and absolute agreement, with an ICC of greater than 0.7 considered acceptable [11].
Responsiveness was determined using Receiver Operating Characteristic Curves (ROC) to assess the area under the curve (AUC) corresponding to the correct identification of patients who changed using external criterion. The AUC can range from 0.5 (no discriminatory accuracy) to 1.0 (perfect accuracy) with an AUC of 0.7 indicating acceptable responsiveness of the item or domain [11]. Spearman’s rho was used to examine correlations between change scores and change in the external criterion with a correlation of 0.3 required for the external criterion to establish responsiveness [25]. Two comparisons were used where the POSAS patient scale items were an appropriate external criterion (worsening verses no worsening) and three comparisons were used where the SF-36 subscales were an appropriate external criterion (change versus no change), where change was defined as greater than the mean change per month on SF-36 subscales found in a previous study of an adult burn population [17] (e.g. greater than 5 points on the physical functioning scale versus less than or equal to 5 points).
Interpretability.
It was assumed that evidence of some improvement would be detected in individual items and groups of items in the presence of tailored scar and psychosocial interventions that were typically provided after the baseline measurement, thus the percentage of those who stayed the same, improved and worsened was determined for the 1-month follow-up. At 1-month follow-up a greater number of participants were expected to have scar thickness and roughness stay the same or worsen than improve but for scar colour and sensory symptoms a larger number were expected to stay the same or improve compared to worsen, based on previous work on the trajectory of patient-reported scar severity in people receiving scar interventions similar to those provided to the study participants after burns [15]. Interpretability was also examined using the medians and interquartile ranges of subgroups expected to differ and percentage of missing items. Three subgroups of improved, stable and deteriorated were examined using SF-36 physical, social and mental health subscales and POSAS patient scale items of pain and overall opinion as criterion, with theory-based cutoffs used for the SF-36.
Both single items and groups of items of the BBSIP were tested where appropriate. Significance was reported using p-vales of less than 0.05. Statistical analyses were performed using IBM SPSS Statistics for Windows, Version 23.0. (Armonk, New York: IBM Corporation). Ethical approval was provided by Metro South Human Research Ethics Committee in 2011 (HREC12/QPAH/595) with written informed consent to participate obtained from all participants included in the study.
Results
The number of participants who were included in the study and completed testing at each timepoint is presented in Fig 1. Participant sociodemographic, injury, scar and skin type characteristics for the baseline, 1-week and 1-month follow-up samples are reported in Table 1. Participants were predominantly male, had a median age of 34 years, and the majority had a secondary education and received skin grafting. There were no significant differences in the characteristics of participants between baseline and 1-week follow-up and baseline and 1-month follow-up (Table 1).
At baseline the mean scar thickness score reported by an observer using the POSAS was 3.68 (SD = 2.00) which remained the same at 3.68 (SD = 2.03) at 1-month follow-up (scale range 1 to 10). At baseline the mean scar thickness reported by the patient using the POSAS was higher (mean = 5.82, SD = 2.77) and also remained relatively constant at 1-month follow-up (mean = 5.57, SD = 2.91). At baseline the mean overall opinion of the patient regarding their scar using the POSAS was 6.97 (SD = 2.33) which reduced slightly to 6.39 (SD = 2.43) at 1-month follow-up.
The percentage of missing scores for individual items varied from zero to three percent across the items at baseline and from zero to five percent across the items at 1-week follow-up (with the highest percent missing items on overall impact on life (5%) and driving a car or vehicle (3%)). At 1-month follow-up the percentage of missing items varied from zero to four percent across the items, with the highest percentage of missing items for appearance, emotional reactions and physical symptom items.
Cronbach’s alpha estimates as well as item-total and inter-item correlations (S1 Table) generally supported the internal consistency of subscales, but indicated there may be some redundancy of items within some item groupings, particularly for the relationships and social interaction items, appearance items and emotional reactions items.
Generally, hypothesised correlations of change in BBSIP items and groups of items with changes in criterion measures supported longitudinal validity (12 out of 19 hypotheses using the POSAS as the external criterion were supported and 9 out of 13 hypotheses using the SF-36 as an external criterion were supported). Correlations at baseline and between changes from baseline to 1-month follow-up on the BBSIP items and relevant POSAS patient scale items (Table 2) supported the validity and longitudinal validity of individual items of the overall impact of itch, pain and other sensations on your life, itch intensity, tightness intensity, sensitivity intensity, pain intensity, and tight and thick scar items; and the group items of the total sensory intensity score and physical symptoms total score. Correlations between changes from baseline to 1-month follow-up on the BBSIP items and relevant SF-36 dimensions (Table 3) supported the validity and longitudinal validity of the individual items of the overall impact on work and daily activities, overall impact on mood and emotional reactions, impact of sensations on physical scar symptoms and mood, and the physical scar symptom of ‘tight’. Validity and longitudinal validity was supported for the subscales of mobility, daily activities, social and relationships and emotional reactions.
The longitudinal validity of individual items related to discomfort, colour, hardness and the appearance of scars was not supported using hypothesised correlations with changes in respective POSAS patient scale items, as correlations were stronger with changes in other POSAS items. However, the validity of the appearance items and appearance total score at baseline was supported. The correlations between changes in individual and group BBSIP items and changes in items of the SF-36 or POSAS were generally in the expected direction (negative correlations with the SF-36 = 16/17 correlations; positive correlations with the POSAS = 23/26 correlations).
Reproducibility of the BBSIP, POSAS and SF-36
For the items expected to be stable, test-retest reliability coefficients were 0.6 or higher for the majority of items, and ranged from not acceptable (ICC = 0.26 for getting in and out of a chair or car) to acceptable (ICC = 0.80 for bothered by the appearance of scars) (Table 4). All of the individual appearance items had acceptable test-retest reliability based on the criterion of coefficients of 0.7 or higher. Most of the relationships and social interaction individual items had coefficients that were close to or higher than the criterion of 0.7 and thus mostly had acceptable test-retest reliability. Of the daily activities, mobility, or severity of physical symptom items only the eating and drinking item and the physical symptom total score had coefficients of 0.7 or higher. However the strength of ICC’s of the SF-36 physical functioning and role physical subscales (0.40 and 0.68) were similar to the daily activities and mobility item ICC’s (range 0.26 to 0.71). Further, the strength of physical symptom item ICC’s (0.39–0.77) had a similar range to ICC’s of corresponding POSAS-patient scale items (range 0.53 to 0.72) (S2 Table). Groups of items had higher test-retest reliability coefficients than individual items and were all greater than 0.7 except for the impact of sensations (which was not expected to be stable), overall impact of burn scars (which had an ICC that was close to acceptable), mobility and daily activities. Whilst reproducibility was not deemed a necessary property for items related to sensations and emotional responses by the investigators, the reliability of these items indicated they were almost as stable as other items with ICC values ranging from 0.47 (impact of sensations on physical activities) to 0.80 (embarrassed).
For the 7-point response scale items that were expected to be stable, agreement measured using the SDC ranged from 2.15 (eating or drinking) to 3.99 (work) and agreement within a 1-point difference ranged from 51 to 89 percent. For the 5-point response scale items that were expected to be stable (i.e. the severity of physical symptoms items), agreement measured using the SDC ranged from 1.83 to 2.61 and agreement within a 1-point difference ranged from 80 to 92 percent. The 11-point sensory intensity response scale items and the 7-point emotional response items were not expected to be stable thus reproducibility was not deemed a necessary property although values have been reported in Table 4.
Responsiveness and longitudinal validity of the BBSIP
The number of participants included varied from 41 to 54 across ROC analyses, with greater than 50 participants included for the majority of analyses. The responsiveness of the individual item of overall impact on work and daily activities was supported using non-parametric estimations of the AUC (AUC>0.7). The responsiveness of seven out of eight subscales scores able to be tested against a criterion was supported including the frequency of sensory symptoms, impact of sensations, mobility, daily activities, relationships and social interaction, and physical symptoms (AUC> 0.7). The median BBSIP change scores of those who improved, stayed the same and deteriorated on the criterion were generally in the expected direction further supporting longitudinal validity (Table 5). The percentage of people who improved varied from 15 to 86 percent and who worsened varied from 2 to 38 percent across the BBSIP individual items and groups of items, from baseline to 1-month follow-up.
Interpretability of the BBSIP
The percentage of individual items with the lowest score varied from 0 to 58 percent and for groups of items varied from 0 to 25 percent at baseline. The percentage of individual items with the highest score varied from 1 to 33 percent and for groups of items varied from 0 to 8 percent at baseline. High percentages of the lowest score were expected for many individual items as testing included people who were at risk of scarring who may have had few physical or sensory symptoms of scarring at baseline. As expected the majority of sensory items stayed the same or improved between baseline and 1-month follow-up. Changes in the physical symptom items were also as expected (e.g., scar thickness stayed the same or worsened for the majority of participants) over the same time period. The ability of the measure to detect change was demonstrated by improvement of up to 75 percent and by worsening of up to 36 percent on individual items scores between baseline and 1-month follow-up.
Discussion
There was support for the longitudinal validity, reproducibility, responsiveness, and interpretability of most groups of items and some individual items of the BBSIP, thus the BBSIP appears suitable as an evaluative measure in people at risk of, or with burn scarring. However, not all results supported these properties, particularly the individual and group items related to mobility and daily activities, that were less reproducible than expected, and the appearance items for which baseline validity but not longitudinal validity was supported. In contrast, emotional and sensory symptoms items, that were expected to have reproducibility coefficients of lower than 0.7, performed better than expected. Support was also found for the validity of many items at baseline, although this was not the focus of the present study. It appears likely from the results that a shortened BBSIP may be appropriate for picking up change, based on the most responsive groups of items and likely redundancy of some items. However, further testing of the items at a longer time post-burn, and interpreting the results in the context of factor analysis is first recommended prior to deleting items or creating a shortened BBSIP that is suitable to pick up changes, which was beyond the scope of the present study but which is planned for a future study.
The BBSIP is the first known burn scar specific PROM measuring health-related quality of life, that was developed from interviews with patients themselves. As such it includes unique content in comparison to existing burn-specific multidimensional PROMs, by covering a broad range of sensory and emotional symptoms, fatigue and the impact of treatment linked to scarring. These existing PROMs include the Burn Specific Health Scale and shortened versions [26–28] and Young Adults Burns Outcome Questionnaire [29]. For example, the only sensory symptom captured by the brief and revised versions of the Burn-Specific Health Scale is heat sensitivity (not cold sensitivity, itch, pain, or sensitivity to light touch or clothing which are covered by the BBSIP). The only sensory symptoms captured by the Young Adults Burns Outcome Questionnaire are itch and pain in relation to the burned area (not in relation to the scar area) and the only emotional symptoms captured are being angry and sad (as opposed to the additional BBSIP symptoms of irritable or cranky, anxious or nervous, stressed, low in self-confidence, embarrassed and worried). Further, fatigue or vitality are not covered by the Burn-Specific Health Scale revised version or the Young Adults Burns Outcome Questionnaire. Although two items in the Abbreviated Burn Specific Health Scale cover this aspect these items are not specific to burn scars, thus differ to the BBSIP item of ‘tight scars resulting in tiredness’.
In comparison to existing multidimensional PROMs for patients with scars more broadly, the BBSIP also includes unique content. These existing PROMs include the Patient-Reported Impact of Scar Measure (PRISM) [19]; the Patient Scar Assessment Questionnaire (PSAQ) [30]; and Bock quality of life questionnaire for patients with keloid and hypertrophic scarring (Bock) [31]. For example, the PRISM does not include sensitivity to touch or clothing, sensitivity to hot or cold temperature, emotional symptoms of depression or anxiety, or scar tightness items which are represented in the BBSIP. Although the PSAQ and Bock each have an item representing pulling or stiffness [32], tightness is not specifically represented. In comparison, sensory or physical tightness is well represented in the BBSIP with 3-items, as it was highlighted as important based on our previous interviews with patients [10]. Interestingly, a similar sensory quality of ‘stiffness’ has been reported in other work involving patients with burn scars [33]. The importance of a ‘tightness’ quality is reflected by the likely action of myofibroblasts in creating contractile activity that results in tension in burn scars [34]. Scar contractures (which are present in up to 40 percent of people with burns) are the most severe form of this action [34].
Whilst the PRISM and the PSAQ had the advantage of being developed using interviews with patients [32], it is unclear whether the patients interviewed included any people with burn scars. No people with contracted scars were reported as being included in the development and validation samples of the PRISM [19]. This difference in populations may have contributed to the lack of items reflecting tightness in the PRISM. Further testing of the BBSIP and other scar-specific and burn-specific PROMs in future studies will be important to determine the relative importance of the unique content of the BBSIP in detecting patient-reported changes in burn scarring.
The test period, which commenced around the time of wound healing when exaggerated scar responses were emerging, may not have been the ideal period for reproducibility testing of mobility and daily activities items which were not stable. However, there is a need for a measure of health-related quality of life for people with burn scarring that can be used during periods when components of health-related quality of life are not stable. Therefore an alternative (more stable) point in the recovery (and/or less time between assessments) may be better for testing the reproducibility of these items. It is noteworthy that other PROMs that measured constructs similar to mobility and daily activity captured by the BBSIP (such as the SF-36 physical function and role physical subscales) had test-retest coefficients similar to the BBSIP in this study, supporting the likely instability of those components of health-related quality of life. Although Brown et al (2010) used a longer test-retest interval of at least 2-weeks for their quality of life measure for scars and reported reliability of 0.83 for the symptom scale and 0.89 for the quality of life scale, the lack of inclusion of people with contracted scars and testing that appeared to be conducted on scars with a mean duration of greater than 6-months likely contributed to differences in their findings [19].
The lower number of participants who completed follow-up testing in comparison to baseline was another important consideration when interpreting findings from the present study. It was plausible that there may have been variability in the characteristics of the samples between baseline and follow-up testing which may have impacted on the generalisability of the results. However, a comparison of the characteristics of participants between baseline and follow-up timepoints did not indicate that there were significant differences in the characteristics of the samples, which may indicate a lower likelihood of response bias influencing the results.
Future directions for testing the BBSIP include determining responsiveness using other external criterion such as the site of scarring which may have had a more consistent correlation of 0.3 or greater across BBSIP items. Interestingly the tightness and discomfort items correlated most strongly with the total score of the intensity of sensations subscale which may indicate further investigation of the method of obtaining a score for groups of items is warranted (i.e. a weighted score may be more appropriate than a summed score). However, Streiner and Norman (2015) have reported that in most cases a weighted score does not add substantially thus at this point using a simple summed score for groups of items would seem reasonable [22]. Testing using a larger sample size and over longer follow-up periods to confirm the validity of individual item and subscale change scores would be valuable as sample size and time between assessments may have impacted on the findings. Thus additional testing with larger-scale investigations, including the influence of subgroup differences such as those with skin contractures versus no skin contractures, are warranted in order to confirm or refute the favourable findings observed in the present study.
Conclusions
Health-related quality of life should be an important focus of studies evaluating the effectiveness of scar interventions and of clinical rehabilitation of people at risk of or with burn scars. This study reports on the psychometric testing of the BBSIP with support for validity, longitudinal validity, reproducibility, responsiveness and interpretability of most groups of items and some individual items. As testing was conducted during the post-acute period (around the time of skin healing) when the greatest changes in health-related quality of life have been demonstrated, improved reproducibility and longitudinal validity estimates might reasonably be expected at a longer time post-burn.
Supporting information
S1 Table. Descriptive statistics and correlations of individual items of the BBSIP with subscale scores and respective SF-36 at baseline a.
https://doi.org/10.1371/journal.pone.0184452.s001
(PDF)
S2 Table. Reproducibility of the Patient Observer Scar Assessment Scale Items and SF-36 dimensions.
https://doi.org/10.1371/journal.pone.0184452.s002
(PDF)
Acknowledgments
The authors thank the patients with burns scarring who participated in the study. The authors also wish to acknowledge support by the Queensland Children’s Medical Research Institute, Central Queensland Hospital and Health Service, the Queensland Health, Health Practitioner Research Scheme 2012–2013, and the Australian Catholic University. We sincerely thank Professor Jenny Ziviani and Dr Leila Cuttle for providing input into the study design and assisting in obtaining funding for the study.
References
- 1. Ahn CS, Maitz PKM. The true cost of burn. Burns: journal of the International Society for Burn Injuries. 2012;38(7):967–74.
- 2. van der Veer WM, Bloemen MCT, Ulrich MMW, Molema G, van Zuijlen PP, Middelkoop E, et al. Potential cellular and molecular causes of hypertrophic scar formation. Burns: journal of the International Society for Burn Injuries. 2009;35(1):15–29.
- 3. Gangemi E, Gregori D, Berchialla P, et al. Epidemiology and risk factors for pathologic scarring after burn wounds. Archives of facial plastic surgery. 2008;10(2):93–102. pmid:18347236
- 4. Lawrence JW, Lawrence JW, Mason ST, Schomer K, Klein MB. Epidemiology and Impact of Scarring After Burn Injury. Journal of burn care & research. 2011;33(1):136–46.
- 5. Mirastschijski U, Sander JT, Zier U, Rennekampff HO, Weyand B, Vogt PM. The cost of post-burn scarring. Annals of burns and fire disasters. 2015;28(3):215. pmid:27279810
- 6. Niţescu C, Calotǎ DR, Stǎncioiu TA, Marinescu SA, Florescu IP, Lascǎr I. Psychological impact of burn scars on quality of life in patients with extensive burns who received allotransplant. Romanian Journal of Morphology and Embryology. 2012;53(3):577–83. pmid:22990550
- 7. van Loey NE, van Beeck EF, Faber BW, van de Schoot R, Bremer M. Health-related quality of life after burns: A prospective multicenter cohort study with 18 months follow-up. Journal of Trauma and Acute Care Surgery. 2012;72(2):513–20. pmid:22439227
- 8. Tyack Z, Ziviani J, Kimble R, Plaza A, Jones A, Cuttle L, et al. Measuring the impact of burn scarring on health-related quality of life: Development and preliminary content validation of the Brisbane Burn Scar Impact Profile (BBSIP) for children and adults. Burns: journal of the International Society for Burn Injuries. 2015;41(7):1405–19.
- 9. Griffiths C, Guest E, White P, Gaskin E, Rumsey N, Pleat J, et al. A Systematic Review of Patient-Reported Outcome Measures Used in Adult Burn Research. Journal of Burn Care & Research. 2017;38(2):e521–e45.
- 10. Simons M, Price N, Kimble R, Tyack Z. Patient experiences of burn scars in adults and children and development of a health-related quality of life conceptual model: A qualitative study. Burns: journal of the International Society for Burn Injuries. 2016, 42(3): 620–32.
- 11. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. Journal of clinical epidemiology. 2007;60(1):34–42. pmid:17161752
- 12. Giraudeau B, Mary JY. Planning a reproducibility study: How many subjects and how many replicates per subject for an expected width of 95 percent confidence interval for the intraclass correlation coefficient? Stat Med 2001; 20: 3205–14. pmid:11746313
- 13.
QFAB Bioinformatics. (2015). ANZMTG Statistical Decision Tree, Power Calculator. (Version 1.0) [Web Application]. Retrieved from http://www.anzmtg.org/stats/PowerCalculator
- 14. Tyack Z, Simons M, Spinks A, Wasiak J. A systematic review of the quality of burn scar rating scales for clinical and research use. Burns: journal of the International Society for Burn Injuries. 2012;38(1):6–18.
- 15. Van Der Wal MBA, Vloemans JFPM, Tuinebreijer WE, Van De Ven P, Van Unen E, Van Zuijlen PPM, et al. Outcome after burns: An observational study on burn scar maturation and predictors for severe scarring. Wound Repair and Regeneration. 2012;20(5):676–87. pmid:22985039
- 16. van der Wal MB, Tuinebreijer WE, Bloemen MC, Verhaegen PD, Middelkoop E, van Zuijlen PP. Rasch analysis of the Patient and Observer Scar Assessment Scale (POSAS) in burn scars. Quality of life research: an international journal of quality of life aspects of treatment, care and rehabilitation. 2012;21(1):13–23.
- 17. Edgar D, Dawson A, Hankey G, Phillips M, Wood F. Demonstration of the validity of the SF-36 for measurement of the temporal recovery of quality of life outcomes in burns survivors. Burns: journal of the International Society for Burn Injuries. 2010;36(7):1013–20.
- 18. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Quality of Life Research. 2010;19(4):539–49. pmid:20169472
- 19. Brown BC, McKenna SP, Solomon M, Wilburn J, McGrouther DA, Bayat A. The patient-reported impact of scars measure: development and validation. Plastic and reconstructive surgery. 2010;125(5):1439–49. pmid:20440163
- 20. Nedelec B, Correa JA, Rachelska G, Armour A, Lasalle L. Quantitative measurement of hypertrophic scar: Intrarater reliability, sensitivity, and specificity. Journal of Burn Care and Research. 2008;29(3):489–500. pmid:18388577
- 21.
Ware JE, Snow KK, Kosinski M, G B.. SF-36 Health Survey. Manual and interpretation guide. Boston: The Health Institute, New England Medical Center, 1993
- 22.
Streiner D, Norman GR, Cairney J. Health measurement scales: a practical guide to their development and use. New York, New York: Oxford University Press; 2015.
- 23. Briggs SR, Cheek JM. The role of factor analysis in the development and evaluation of personality scales. Journal of Personality. 1986;54(1):106–48.
- 24. de Vet HCW, Terwee CB, Knol DL, Bouter LM. When to use agreement versus reliability measures. Journal of clinical epidemiology. 2006;59(10):1033–9. pmid:16980142
- 25. Revicki D, Hays RD, Cella D, Sloan J. Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. Journal of clinical epidemiology. 2008;61(2):102–9. pmid:18177782
- 26. Blades B, Mellis N, Munster AM. A burn specific health scale. The Journal of Trauma. 1982;22(10):872–5. pmid:7131607
- 27. Blalock SJ, Bunker BJ, DeVellis RF. Measuring health status among survivors of burn injury: revisions of the Burn Specific Health Scale. The Journal of Trauma. 1994;36(4):508–15. pmid:8158712
- 28. Munster AM, Horowitz GL, Tudahl LA. The Abbreviated Burn-Specific Health Scale. The Journal of Trauma. 1987;27(4):425–8. pmid:3573091
- 29. Ryan CM, Schneider JC, Kazis LE, Lee A, Li NC, Hinson M, et al. Benchmarks for multidimensional recovery after burn injury in young adults: the development, validation, and testing of the American Burn Association/Shriners Hospitals for Children young adult burn outcome questionnaire. Journal of Burn Care & Research: official publication of the American Burn Association. 2013;34(3):e121–42.
- 30. Durani P, McGrouther DA, Ferguson MW. The Patient Scar Assessment Questionnaire: A Reliable and Valid Patient-Reported Outcomes Measure for Linear Scars. Plastic and Reconstructive surgery. 2009;123(5):1481–9. pmid:19407619
- 31. Bock O, Schmid-Ott G, Malewski P, Mrowietz U. Quality of life of patients with keloid and hypertrophic scarring. Archives of Dermatological Research. 2006;297(10):433. pmid:16528552
- 32. Mundy LR, Miller HC, Klassen AF, Cano SJ, Pusic AL. Patient-Reported Outcome Instruments for Surgical and Traumatic Scars: A Systematic Review of their Development, Content, and Psychometric Validation. Aesthetic Plastic Surgery. 2016;40(5):792–800.33. pmid:27357634
- 33. Ward RS, Saffle JR, Schnebly WA, Hayes-Lundy C, Reddy R. Sensory loss over grafted areas in patients with burns. The Journal of Burn Care & Rehabilitation. 1989;10(6):536.
- 34. Schouten HJ, Nieuwenhuis MK, Van Zuijlen PPM. A review on static splinting therapy to prevent burn scar contracture: Do clinical and experimental data warrant its clinical application? Burns: Journal of the International Society for Burn Injuries. 2012;38(1):19–25.