http://orcid.org/0000-0001-7493-2925
Figures
Abstract
Background
A review of the literature reveals a lack of validated instruments that particularly measure quality in the hospital discharge process. This study aims to develop and validate a survey instrument feasible for measuring quality (≥65 years) related to the discharge process based on elderly patients’ experiences.
Methods
Construction of the Discharge Care Patient Experience Survey (DICARES) was based on 16 items identified by literature reviews. Intraclass correlation for test–retest was applied to assess consistency of the survey. Explorative factors analysis was applied to identify and validate the factor structures of the DICARES. Cronbach’s α was used to assess internal reliability. To evaluate the external validity of the final DICARES questionnaire the patients’ scores were correlated with scores obtained from the three other questionnaires; the Nordic Patient Experiences Questionnaire, the 12-Item Short-Form Health Survey and Subjective Health Complaints. The DICARES association with readmissions was examined.
Results
A total of 270 patients responded (64.4%). The mean age of participants was 77.1 years and 57.8% were men. The exploratory factor analysis resulted in a 10-item instrument consisting of three factors explaining 63.5% of the total variance. The Cronbach’s α were satisfactory (≥70). Overall intraclass correlation was 0.76. A moderate Spearman correlation (rho = 0.54, p <0.01) was found between the total mean DICARES score and total mean score of the Nordic Patient Experiences Questionnaire. The total mean DICARES score was inversely associated with the quality indicator based on readmissions (OR 0.62, CI 95: 0.41–0.95, p = 0.028)
Citation: Boge RM, Haugen AS, Nilsen RM, Harthug S (2018) Elderly patients’ (≥65 years) experiences associated with discharge; Development, validity and reliability of the Discharge Care Experiences Survey. PLoS ONE 13(11): e0206904. https://doi.org/10.1371/journal.pone.0206904
Editor: Paul Sullivan, Imperial College, London, UNITED KINGDOM
Received: January 14, 2018; Accepted: October 22, 2018; Published: November 7, 2018
Copyright: © 2018 Boge et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: This work was carried out with research grants from the Western Norway Regional Health Authority Trust; 1) Project number 911936, 2) A minor grant from the Patient Safety Program, 3) A local Health Research Scholarship, 4) ASH is funded with a postdoctoral research grant (grant number: HV1172). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. URL:https://helse-vest.no/vart-oppdrag/vare-hovudoppgaver/forsking.
Competing interests: The authors have declared that no competing interests exist.
Background
To discharge elderly patients from hospitals or transfer these patients between different levels of health care institutions is one of the most significant challenges in health care services [1–4]. The discharge process includes a wide range of care professionals in a variety of settings, and it’s a coordinated, patient-centred, transparent process starting before admission if possible, or as soon after admission as suitable [5]. To recover and gain health after hospitalization adherence to therapy is crucial [6, 7]. According to the National Health Services (NHS), England, United Kingdom, people have a key role in protecting their own health, and to choose suited treatment and handle long-term conditions. Self-management/self-care is a term used to include all initiatives a person do to acknowledge, treat, and maintain his own health [7]. This may be done independently or in association with the healthcare system. The wellbeing and the safety in elderly patients are particularly at risk in the discharge process, because aging makes us more vulnerable due to loss of physical and mental function, and also the increased disease burden [8, 9]. Hence, quality in the discharge process requires caring interaction with the patients and their caregivers, and it involves considerable and accurate cooperation within the hospital as well as with the municipalities. Despite this knowledge, patients and caregivers are commonly unprepared for what will emerge after discharge, and they are frustrated by having to perform tasks their health care practitioners have left undone [10]. Introduction of experience surveys that provide feedback to the hospital departments can be one of several measures to improve the quality of the discharge process [1]. Even though readmission rate is nonspecific and may be affected by various conditions many healthcare organizations use it as an overall quality indicator [11]. There is a need for a more suitable approach to assess hospital performance in the patient discharge process. Patient experience; “the sum of all interactions influenced by all interactions shaped by an organization’s culture across the continuum of care” [12], has been recognized as an important facet of understanding quality since it reveals strengths and weaknesses in respect of efficiency and safety [12–14]. A survey about the experiences may be directed against specific parts of the care, not only as a global indicator.
Patient satisfaction and patient experiences are overlapping and both are important parts of healthcare quality [15]. The main difference between the concepts’ is that if patients are asked to rate how satisfied they are, the ratings tend to be very positive, while specific questions about the patients’ experiences with respect to certain processes provide more variation and are useful to customize interventions [16]. A systematic review by Doyle et al. [17] shows a positive association between examinations of patient experience, patient safety and clinical efficacy, and patient experience surveys may therefore pose as an appropriate basis of a quality indicator in general. Elderly patients express a clear preference to participate, but experience that the actual practice of involving old people in the discharge process is not well developed [18, 19]. Few studies have explored quality by use of patients’ experiences, and this deficiency of understanding the patient perspective has delayed the ability of hospitals to establish interventions which address these underlying causes of readmission [20]. Tools to measure patient experiences of quality of hospital care have been developed [1, 21], but the feasibility for use in quality improvement work is limited due to methodological weaknesses such as questionnaire design, patient selections, the data collection process, and data entry errors [22]. Patient experience surveys can be applicable as targeted tools of good scientific standards if performed by skilled scientists [22].
The discharge process must emphasize the patients’ ability to take care of themselves after hospitalization [7], tools for quality assessments in the discharge process should therefore cover questions about how patients’ experience the first period after hospitalization. These experiences may reflect the quality of the tasks performed by health care personnel during the discharge process. However, we have not been able to find such appropriate and validated instruments. This study aimed to develop a feasible brief survey instrument to identify elderly patients’ experiences with the hospital discharge process and with the following period after hospitalization, and to examine its reliability, internal validity, and to test the external validity.
Methods
Design
A cross–sectional study design was chosen to develop and validate the Discharge Care experience Survey (DICARES), http://dx.doi.org/10.17504/protocols.io.sm2ec8e.
In the planning phase of the study we discussed the object of the study with an established group of patient representatives at our hospital. Input from the group was included in the design of the questionnaire.
Setting and study sample
Hospitals in Norway are owned by the state and the municipalities are committed to give health care services to their inhabitants when needed [3]. There is a written agreement between our hospital and the municipalities within the regional health authority. The municipality will be informed within 24 hours after admission if it is likely that the patient will need health care services from the municipality after discharge. The discharge planning start as soon after admission as possible for patients acutely admitted to hospital, and before admission for elective patients, if required. Elderly patients unable to take care of themselves after hospitalization are provided home based care services or nursing home facilities. Discharge planning includes assuring that the patients have got necessary aid equipment’s at home, and to inform the municipality or caregivers whether the patient is at risk of malnutrition, fall or pressure ulcers, with a plan for follow up when needed. Before leaving the hospital the patients will have an updated list of medication, a written patient information letter, have got a follow up appointment if required, and have had a discharge conversation with health care personnel responsible for the treatment. The patient’s general practitioner will receive a discharge letter from the hospital a week after discharge. To what degree health care personnel conform to these procedures is not documented.
In order to include elderly patients with significant comorbidities we recruited inpatients from five medical wards and one orthopaedic ward at a large tertiary teaching hospital in Bergen, Norway. Patients 65 years and above were included if hospitalized for more than 24 hours and were able to give their written informed consent. Patients living in nursing homes and patients with recognized reduced cognitive function were not included. Patients that met the inclusion criteria were invited to participate in the study by personal contact with the corresponding author. A paper-based survey including a pre-paid return envelope was sent to the patients approximately 30 days after hospital discharge during June 2013 to February 2015. Patients that did not respond within three weeks were reminded once by phone. Age and sex were recorded anonymously for non-responders. Data were plotted twice by two research assistants, and quality controlled for errors.
Survey development
In order to develop the DICARES we conducted a systematic literature search (S1 File) during February and March 2013 in the databases Medline, Embase, Cinahl, SveMed and PsycINFO. We adapted several elements from the PRISMA checklist as guidance. None of the databases used patient experience as MeSH term, therefore we applied patient satisfaction and patient perspective, and further patient discharge, patient transfer, continuity of patient care, patient hand over, patient hand off, primary health care, home based care, nursing homes, community health services and, community based care. The literature review identified 736 matches, reduced to 528 after duplicate control. Twenty–four abstracts met the inclusion criteria; qualitative and quantitative studies in English, Norwegian, Danish or Swedish, aimed at patients of both sex ≥ 65 years with hospital stays in somatic departments. If there were other participant groups in addition to the patients, for example relatives and / or healthcare personnel, it had to be clear what the patient’s experience was. Research before year 2000 had to be available both as an abstract and in full electronic text to be included. Intervention, follow-up and evaluation studies were excluded. Relevant matches were read in full text, and eight articles filled the criteria. Further we did a literature review in order to find questionnaires that included questions concerning the discharge process and the following weeks after hospitalization. To include candidate items for the new DICARES questionnaire based on the literature reviews we used an eclectic approach. An expert panel evaluated if the items were relevant to be included in the questionnaire. The expert panel consisted of researchers, health care personnel, and leaders at the hospital. Three items regarding patient participation were derived from a 15-item validated survey developed by Coleman et.al. [2] designed to be used by patients 18 years and older. The complete 15-item survey does not provide substantial more information than the three core questions selected [23]. Two more items on patient participation were obtained from a study of elderly patients by Foss et.al. [18]. Further, we included eleven items based on a 36-item survey developed by Kangovi et.al. [20]. These items are related to daily lives activities, adherence to discharge medications and emotional problems following the period after hospitalization from readmitted patients’ perspective. A total of 16 candidate items were translated and adjusted to fit our setting with respect to language, design, formatting and methodology (Table 1).
Forward translation of the DICARES was performed by two Norwegian registered nurses / researchers with knowledge of English language. Backward translations were completed by two independent native English translators with no prior knowledge of the questionnaire [24]. Inadequate expressions or concepts of the translation were discussed within the bilingual expert panel. All items were scored on a five point Likert-like scale: Not at all, To a little extent, To some extent, To a large extent and To a very large extent, and assigned values 1, 2, 3, 4 and 5, respectively. Values from negative statements (number 6, 7, 8, 9, 10, 11, 12, 13, 14, 15 and 16) were inverted to positive values. High score means a better condition for the patient. The total score was calculated as the mean of the items’ scores.
Our survey consisted of four questionnaires, with a total of 66 questions. This included the 16-item DICARES-candidate and three validated questionnaires: the eight-item Nordic Patient Experiences Questionnaire (NORPEQ) measuring quality of care in general in Norwegian hospitals based on six validated items [25, 26], the 12-Item Short-Form Health Survey (SF-12) assessing general health status (Physical Composite Scale and Mental Composite Scale) [27], and the 29-item symptom specific questionnaire Subjective Health Complaints (Musculoskeletal pain, Pseudoneurology, Gastrointestinal problems, Allergies and Flu) (SHC) [28, 29]. Additional one question about readmission within 30 days was included. Readmission data within 30 days [30] was also recorded from the electronically patient administrative system. Further information from this system included age, sex, date of admission, length of stay, International Classification of Diseases-10th version (ICD-10) codes [31], and a calculated Charlson comorbidity index [32] based on the ICD-10 codes.
Survey validation and statistics
When planning the study to explore the psychometric properties sample size was calculated to be at least 250 for detecting differences in the total DICARES score with outcome readmission, expected exposure 20%, power 80% and p<0.05. Population mean score values for each item were imputed if eight or more items scores in the initial 16 -item DICARES were completed. To investigate face validity [33] the first 22 patients who returned the survey, and had completed the 16 initial DICARES items, answered five additional identical questions, assessing whether the items were understandable, meaningful, relevant, easy to answer, and whether they were too personal. Nineteen patients returned the evaluation form, and based on the findings no items required to be changed. In order to assess test-retest reliability, fifty respondents were asked to complete the DICARES a second time after 21 days. Intraclass correlation (ICC) between the items was examined for consistencies in the test re-test measure. ICC estimates and their 95% confidence intervals (CI) were calculated based on a mean-rating (k = 2), absolute-agreement, two-way mixed-effects model [34], and was estimated using the following interpretation: Poor (0.40> r), Fair (0.59> r >0.40), Good (0.74> r >0.60 and Excellent (1.00> r >0.75) [35]. Explorative factor analysis was applied to identify the factor structure of the DICARES questionnaire as described by Pett et al. [36]. To assess the sampling adequacy, we used the Kaiser-Meyer-Olkin measure, and the Bartlett’s test of sphericity [36]. Principal component analysis with Varimax rotation was applied to identify factors structures of the initial 16 candidate items measuring patient experiences. Eigenvalues >1 was used to identify the number of factors, and absolute value for factor loadings was ≥0.30. If an item loaded moderate or strong to more than one factor, the item was allocated to the factor where it got the highest loading. The item with the highest loading was placed first in the factor.
Inter-correlation between the items of each factor was examined for internal reliability using Cronbachs’α and values ≥0.7 were considered acceptable [37]. Construct validity was assessed by inter-correlation of the factors, and by correlation of the final total DICARES score to the NORPEQ, the SF-12 and the SHC, using Spearman’s correlation coefficient. Moderate correlation coefficients between 0.30–0.49 were considered satisfactory [38]. Further, for external validity mean score of the final total DICARES score was compared with the mean NORPEQ score for the readmitted and non-readmitted patients, and tested using a two-sample t-test. For comparison with the previously validated NORPEQ questionnaire the total DICARES score was transformed to a 0–100 scale by subtracting one from the mean score of each item and then multiplying with 25. The external validation comprised a multiple stepwise, backward logistic regression analysis including DICARES total score, Charlson Comorbidity Index, sex, and age as independent variables and readmission within 30 days as a binary dependent variable. Missing data in the regression analysis were handled using complete case analysis. Statistical analyses were performed with SPSS version 23.0 (IBM Corp., Armonk, NY). All p-values were two-sided, and values <0.05 were considered statistically significant.
Ethics
Ethics approval and consent to participate.
This study was conducted in accordance with the Helsinki Declaration [39], and was accepted by the Western Norway Regional Committee for Medical and Health Research Ethics (Ref.: 2013-401b). The study was also approved by the respective hospital managers. Patients involved in the process signed a consent form prior to hospital discharge. Data from the survey, and questionnaires, were stored in a designated server at the hospital.
Results
Study sample
A flow chart of the recruitment to the study is shown in Fig 1. Initially, a total of 798 patients were eligible for inclusion and 419 of the 498 patients who met the inclusion criteria consented to participate. Of these 270 returned completed questionnaires, yielding a response rate of 64.4%.
Elderly inpatients (≥65) were recruited from five medical wards and one orthopaedic ward at Haukeland University Hospital, Bergen, Norway.
Patient characteristics.
The mean age of participants was 77.1 year (SD 7.2; range 65–98), and men accounted 57.8% of the sample (Table 2). The mean length of hospital stay was 8.3 days (SD 8.8; range 2–80; median 6.0) and 90% of the patients were discharged from medical wards. Fifty-one percent of the patients had more than three diagnoses, and the mean Charlson Comorbidity Index was 1.61 (SD 1.5). Seventy-two patients (26.7%) were readmitted to hospital within 30 days after discharge. The mean age for non-responders (n = 228) was 78.8 years (range: 65–94), and did not deviate significantly from the responders. There were significantly fewer men among non-responders than responders (34.4% versus 57.8%, p <0.001).
The DICARES scores
Nineteen questionnaires had less than 50% of the 16 items completed. The completion rate of the individual 16 items varied from 79.6% to 99.3% (Table 3). The total mean score for the 16 candidate items was 4.06 (SD 0.57). The lowest score was observed for item Opportunity to notify what was important (2.93, SD 1.13), whereas the highest score was observed for item Problems taking medicines (4.78, SD 0.67). Forty-five (90%) of the 50 re-test questionnaires were returned. The overall ICC was Excellent (0.76, CI 95; 0.70, 0.82), results for single-item measures are shown in Table 4.
Extracting factors from items.
Results from the exploratory factor analyses are shown in Table 5. The Kaiser-Meyer-Olkin measure of sampling adequacy was estimated to be 0.75, whereas the p-value for the Bartlett’s test of sphericity was <0.001.The estimated communalities varied between 0.4 and 0.8. Eigenvalues were 3.65, 1.63 and 1.06 for the three factors, and a total of 10 items were included in the final DICARES-model, explaining 63.5% of the common variance. All 10 items loaded satisfactorily (range of factor loadings 0.50–0.91) in the rotated component matrix. The three factors were named: Coping after discharge (three items), Participation in discharge planning (three items) and Adherence to treatment (four items). The corresponding Cronbach’s α for internal reliability were 0.73, 0.71 and 0.70, respectively. A moderate relationship between the three factors ranged from a Spearman’s correlation coefficient for internal validity was 0.32 to 0.47 (p = 0.01). The DICARES total mean score (10 items) was 4.04 (SD 0.65).
Comparison of the DICARES to validated instruments, age and comorbidity.
The DICARES total score correlated moderate positively to the NORPEQ score (Spearman’s rho = 0.54), SF-12 Mental Composite Scale score (Spearman’s rho = 0.55), and inversely with SHC Pseudoneurology (Spearman’s rho = -0.47), and SHC Musculoskeletal (Spearman’s rho = -0.36) (Table 6). Patients readmitted within 30 days scored significantly lower to the DICARES than those not readmitted (Table 7). Equivalent results were not recognized for the NORPEQ. As shown in Table 8, the DICARES and the Charlson Comorbidity Index were significantly associated with readmission.
Discussion
In this study we have developed a questionnaire instrument for use in quality improvement work. The DICARES is a three factor questionnaire measuring patient experiences based on 10 items concerning discharge from hospital, and the following period after hospitalization. The DICARES showed moderate correlation to the validated quality survey instrument NORPEQ. In contrast to NORPEQ, low scores on the DICARES were associated to readmission.
Birkelien and Madison have developed a framework for improving quality by use of patient experience in hospitals [40]. The DICARES may be a useful tool to measure and monitor targeted interventions emanating from the multifaceted components suggested in this framework. We did not find validated patient experiences instruments that explicit measured quality in the discharge process. However, Bettie et al. identified 11 instruments in a systematic review of instruments to measure patient experience of healthcare quality in hospitals [1]. Three instruments from Hong Kong, Ethiopia and India respectively are not discussed in the present study for consideration of possible cultural differences. Four of the eight remaining instruments included questions related to the discharge process and/or transition; The NHS Inpatient Survey (NHSIP), the Scottish Inpatient Patient Experience Survey (SIPES), the Picker Patient Experience Questionnaire (PPE-15) and the Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS). However, differences in approach, methodology and timing of administration limited comparison with the DICARS. In contrast to Kangovi et al. [20] we could not find that these four instruments included questions regarding self-care during the first period after the hospital stay. The SIPES got yes/no and three or more response alternatives, with timing of administration between four and five months after discharge, The PPE-15 got the same response alternatives whereas time of administration was within a month. The HCAHPS included the three Coleman’s items similar to the DICARES. Mode of administration of the HCAHPS was by mail, telephone, and interactive voice recognition, where data were collected between 48 hours to six weeks, and the instrument got a four- point Likert like scale. The Consumer Quality Index (CQI) questionnaire is based on the HCAHPS and was used by Smirnova et al. [41] in a study from 2017 that included almost 23,000 patients and where nearly half of the respondents were 65 years or older. The results showed that variations in the measurement of patient experiences could be attributed to variation in quality of care. Five items in the DICARES cover communication between the patients and the health care personnel, who has emerged as more important than previously thought [41]. The total mean score of the DICARES was 4.04, and somewhat higher than the score on the subscale Information at discharge according to the study of Smirnova et al. [41] with mean score 0.7, corresponding to 77% and 70% of maximum scores, respectively. Even if the results in the study of Smirnova et al. may be hampered by relatively low response rate and by methodological issues discussed by Felix et al. [22], we found this comprehensive study appropriate to compare with the DICARES, attributable to the large group of eldery patiets included in the study. The NORPEQ was included in the present study for comparison since it is used as a quality measurement in Norwegian hospitals [26]. Similar to the DICARES, the NORPEQ has statements scored on a five point Likert like scale and applies explorative factor analyses, which strengthen the credibility of comparison of the instruments.
The DICARES differed significantly in scores with respect to readmitted patients. This finding is in contrast to Felix et al. [22], who found results of the post discharge questionnaires were not associated with readmission. However, our finding regarding the DICARES, as compared to NORPEQ and readmission, is consistent to findings reported by Felix et al. [22]. In the development of the DICARES we have implemented some of the recommendations such as graded response scale instead of yes / no questions, which partly could explain the fact that we succeeded in identifying patients at risk of readmission. Another explanation for this result may be that DICARES covers statements related to self-care the first four weeks after discharge.
The DICARES items correspond with quality in the discharge process, for instance drug errors at the time of discharge can be a consequence of incomplete or inaccurate information, and as such, are important issues to survey [42]. The lowest response rate scores were found for the item Opportunity to notify what was important. This might reflect that older patients may encompasses rejection of own need, and are grateful and humble to the systems of care despite the lack of information and participation in the transition process [43]. It is less associated with instruments measuring health status (SF-12), or subjective health complaints (SHC). This is an argument for the DICARES as a questionnaire instrument reflecting quality in the discharge process. After adjusting for age and sex, a significant association was found between the DICARES, the Charlson Comorbidity Index and readmission, not unexpectedly the DICARES and the Charlson Comorbidity Index were independent determinants.
Factor analyses were performed to explore if the items included would give meaningful input in terms of understanding shortfalls in the discharge process, and to investigate whether the DICARES could provide hospitals with a tool for monitoring improvement processes. Validity testing of the instrument was considered satisfactory, and three factors were classified as acceptable. Naming of the factors; Coping after discharge, Participation in discharge planning and Adherence to treatment were suggestive as to what dimension each factor represents [36]. Participation in discharge planning has been recognized as important, even for very old patients [18], and it is advantageous at all levels in healthcare to empower patients and to improve services and health outcomes [44].
Coping is, according to Lazarus and Folkman, defined as “constantly changing cognitive and behavioural efforts to manage specific external and/or internal demands that are appraised as taxing or exceeding resources of the person” [45]. Comorbidity affects the relationship between coping and stress [4] and increased comorbidity is associated with higher severity levels of both depression and generalized anxiety [8]. Adherence require the patient’s agreement to recommendation, and is defined as “the extent to which a person’s behaviour–taking medication, following a diet, and/or executing lifestyle changes-corresponds with agreed recommendations from a healthcare provider” [46]. The World Health Organization claims that improving adherence to therapy would provide a significant advantage on investment through primary prevention [6].
A limitation is that our study was performed in one hospital on elderly patients predominantly from different medical departments, and one might argue that the study group is somewhat homogenous. However, the group included a satisfactory range of ages, sex and different medical conditions, and the final DICARES was acceptable with respect to missing data. We have no explanation for the relatively higher proportion of men among the responders than non-responders. The mean hospital stay was approximately eight days, which is somewhat higher compared to other studies [2, 4, 20, 25]. As compared to the national mean for all hospitalised patients, the readmission rate was above double. Higher age, and significant disease burden, may explain these findings [47]. After ethical considerations we decided to not include patients with reduced cognitive capacity, which also may represent a weakness in this study. These differences in population characteristics may influence the results, and limit the comparison with other studies. On the other hand, the study is performed in a well-defined patient population, and with careful sampling of data. The corresponding authors’ meeting with each patient, and that the consent form had to be signed before the patients’ were discharged probably contributed to the high response rate [48]. A limitation is that of the eligible 798 patients only 498 (38%) met the inclusion criteria and the most vulnerable patients were therefore not included in this study. To monitor and improve the discharge quality of patients not able to give informed consent, other methods than self–completing questionnaires should be employed. We do not know the reason for non-response and there is a potential for selection bias among the respondents even with the relatively high response rate.
A challenge with surveys performed after discharge is that many, especially frail elderly, might have a problem in remembering events four to five months after a hospital stay as used by some studies [1]. We chose a shorter time lag as this was relevant due to comparison with the quality indicator readmission within 30 days. It is possible that the moment that some respondents were asked to fill out the DICARES questionnaire coincided with their readmission. This might have negatively biased their perceptions of their previous hospitalization producing a recall bias. We chose to develop and validate a questionnaire on elderly patients’ experiences. This may be a weakness with respect to the fact that younger patients may have the same issues [49]. However, the largest numbers of patients on medical wards are elderly and they are also in particular at risk of unplanned hospital readmission ascribable to morbidity and functional decline [50]. Coleman’s three items obtained from the 15-item Care Transition Measure has the limitation that it was derived from a small single health plan in the USA and might over-represent behaviours specific to that plan, or the patients’ selection may be biased. They may not represent local European problems at discharge, which may be county / hospital / unit/ condition specific [51]. The psychometric properties of the DICARES were considered satisfactory.
Conclusions
This hospital based study suggests that the DICARES may be a feasible questionnaire instrument for measuring quality based on experiences of the discharge process among elderly patients (≥65 years). Our study also indicates that the DICARES is capable of monitoring the quality of care of important issues concerning the discharge process, and can be used as an additional tool for quality improvement care processes in hospitals. To further develop this instrument, it needs to be tested in a larger sample with a broader representation of patients in different hospital departments. The three-factor structure should be confirmed using a confirmatory factor analysis.
Supporting information
S1 File. Search strategy.
Systematic literature search of patients’ experiences transition from hospital to community health services.
https://doi.org/10.1371/journal.pone.0206904.s001
(PDF)
S2 File. Available data.
Anonymous data set including 270 respondents.
https://doi.org/10.1371/journal.pone.0206904.s002
(XLSX)
S3 File. The Norwegian version of the initial 16 item DICARES questionnaire.
Erfaringer knyttet til utskriving og tiden etter sykehusoppholdet.
https://doi.org/10.1371/journal.pone.0206904.s003
(PDF)
Acknowledgments
We thank the respondents for their efforts and healthcare professionals and head administration in the participating hospital. The authors also wish to thank the following contributors: Ragna Lind for her support with the early development of the study protocol, Kristel Hummelsund and Kristin Knapstad for accurate and efficient plotting of data, and Jacob Aamodt and Vilde Marie Barikmo Boge for thorough linguistic review.
References
- 1. Beattie M, Murphy DJ, Atherton I, Lauder W. Instruments to measure patient experience of healthcare quality in hospitals: a systematic review. Systematic reviews. 2015;4:97. pmid:26202326
- 2. Coleman EA, Mahoney E, Parry C. Assessing the quality of preparation for posthospital care from the patient's perspective: the care transitions measure. Medical care. 2005;43(3):246–55. pmid:15725981
- 3. Storm M, Siemsen IM, Laugaland K, Dyrstad DN, Aase K. Quality in transitional care of the elderly: Key challenges and relevant improvement measures. Int J Integr Care. 2014;14:e013. pmid:24868196
- 4. Forster AJ, Clark H, Mneard A, Dupuis N, Chernish R, Chandok N, et al. Adverse events among medical patients after discharge from hospital. CMAJ open. 2004;170(3):345–9.
- 5.
Leigh M. Discharge procedure. Poole hospital, NHS Foundation Trust; 2011. CEO 01—Version 6.0. [September 18, 2018]. Available from: https://www.poole.nhs.uk/pdf/2011%2011%2030%20Discharge%20Procedure%20v6.pdf.
- 6.
World Health Organization. Adherence to long-term therapies. 2003. [September 18, 2018]. Available from:http://www.who.int/chp/knowledge/publications/adherence_report/en/
- 7.
National Health Services. Supporting Self-management /self-care 2017, [September 18, 2018]. Available from: https://www.england.nhs.uk/ourwork/patient-participation/self-care/.
- 8. Schoevers RA, Beekman AT, Deeg DJ, Jonker C, van Tilburg W. Comorbidity and risk-patterns of depression, generalised anxiety disorder and mixed anxiety-depression in later life: results from the AMSTEL study. Int J Geriatr Psychiatry. 2003;18(11):994–1001. pmid:14618550
- 9. Bayliss EA, Ellis JL, Steiner JF. Barriers to self-management and quality-of-life outcomes in seniors with multimorbidities. Ann Fam Med. 2007;5(5):395–402. pmid:17893380
- 10. Coleman EA, Berenson RA. Lost in transition: challenges and opportunities for improving the quality of transitional care. Ann Intern Med. 2004;141(7):533–6. pmid:15466770
- 11. Kansagara D, Englander H, Salanitro A, Kagen D, Theobald C, Freeman M, et al. Risk prediction models for hospital readmission: a systematic review. JAMA. 2011;306(15):1688–98. pmid:22009101
- 12. Wolf JN, V, Marshburn . Defining Patient experience. Patient Exp J. 2014;1(1):7–9.
- 13.
National Health Services. High Quality Care For All. 2008. [September 18, 2018]. Available from: https://www.gov.uk/government/publications/high-quality-care-for-all-nhs-next-stage-review-final-report
- 14.
Institute of Medicine. Crossing the quality chasm: a new health system for the 21st century. Washington, DC: National Academy Press; 2001.
- 15. Bjertnaes OA, Sjetne IS, Iversen HH. Overall patient satisfaction with hospitals: effects of patient-reported experiences and fulfilment of expectations. BMJ Qual Saf. 2012;21(1):39–46. pmid:21873465
- 16. Jenkinson C, Coulter A, Bruster S. The Picker Patient Experience Questionnaire: development and validation using data from in-patient surveys in five countries. Int J Qual Health Care 2002;14(5):353–8. pmid:12389801
- 17. Doyle C, Lennox L, Bell D. A systematic review of evidence on the links between patient experience and clinical safety and effectiveness. BMJ open. 2013;3(1).
- 18. Foss C, Hofoss D. Elderly persons' experiences of participation in hospital discharge process. Patient Educ Couns. 2011;85(1):68–73. pmid:20884160
- 19. Rustad EC, Furnes B, Cronfalk BS, Dysvik E. Older patients' experiences during care transition. Patient Prefer Adherence. 2016;10:769–79. pmid:27274204
- 20. Kangovi S, Grande D, Meehan P, Mitra N, Shannon R, Long JA. Perceptions of readmitted patients on the transition from hospital to home. J Hosp Med. 2012;7(9):709–12. pmid:23212980
- 21. Foss C, Askautrud M. Measuring the participation of elderly patients in the discharge process from hospital: a critical review of existing instruments. Scand J Caring Sci. 2010;24 Suppl 1:46–55.
- 22. Felix HC, Seaberg B, Bursac Z, Thostenson J, Stewart MK. Why do patients keep coming back? Results of a readmitted patient survey. Soc Work Health Care. 2015;54(1):1–15. pmid:25588093
- 23. Parry C1, Mahoney E, Chalmers SA, Coleman EA. Assessing the quality of transitional care: further applications of the care transitions measure. Med Care. 2008 Mar;46(3):317–22. pmid:18388847
- 24.
World Health Organization. Process of translation and adaptation of instruments 2017. [September 18, 2018]. Available from: http://www.who.int/substance_abuse/research_tools/translation/en/.
- 25. Skudal KE, Garratt AM, Eriksson B, Leinonen T, Simonsen J, Bjertnaes OA. The Nordic Patient Experiences Questionnaire (NORPEQ): cross-national comparison of data quality, internal consistency and validity in four Nordic countries. BMJ Open. 2012;2(3).
- 26. Oltedal S, Garratt A, Bjertnaes O, Bjornsdottir M, Freil M, Sachs M. The NORPEQ patient experiences questionnaire: data quality, internal consistency and validity following a Norwegian inpatient survey. Scand J Public Health. 2007;35(5):540–7. pmid:17852989
- 27. Ware J Jr. A 12-item Short -Form Health Survey. Construction of Scales and Preliminary Tests of Reliability and Validity. Med Care. 1996;34(3):220–33. pmid:8628042
- 28. Eriksen H, Ihlebaek C. Examining the Role of Patient Experience Surveys in Measuring Health Care Quality. Scand J Psychol. 2002;43:101–3. pmid:12004946
- 29. Eriksen HR. A scoring system for subjective health complaints (SHC). Scand J Public Health. 1999;27(1):63–72. pmid:10847674
- 30. Fischer C, Lingsma HF, Marang-van de Mheen PJ, Kringos DS, Klazinga NS, Steyerber EW. Is the Readmission Rate a Valid Quality Indicator? A Review of the Evidence. PLoS One.2014;9(11):9.
- 31.
WHO. International Statistical Classification of Diseases and Related Health Problems 10th Revision 2016. [September 18, 2018]. Available from: http://apps.who.int/classifications/icd10/browse/2016/en.
- 32. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40(5):373–83. pmid:3558716
- 33. Rustoen T, Wiklund I, Hanestad BR, Burckhardt CS. Validity and reliability of the Norwegian version of the Ferrans and Powers Quality of Life Index. Scand J Caring Sci. 1999;13(2):96–101. pmid:10633739
- 34. Koo TK, Li MY. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J Chiropr Med 2016 Jun;15(2):155–63. pmid:27330520
- 35. Cicchetti DV. Guidelines, Criteria, and Rules of Thumb for Evaluating Normed and Standardized Assessment. Instruments in Psychology. 1994;Vol. 6(No. 4):284–90.
- 36.
Pett MA, Lackey N.R, Sullivan J.J. Making sense of Factor Analysis; The Use of Factor Analysis for Instrument Development in Health Care Research. California; SAGE Publications, Inc.; 2003.
- 37.
Nunnally J. Psychometric Theory., 1st ed ed. New York: McGraw-Hill; 1967
- 38.
Cohen J, Cohen P., West S. G., & Aiken L. S. Applied multiple regression/correlation analysis for the behavioral sciences. Mahwah, New Jearsey; Lawrence Erlbaum Associates 2003.
- 39.
World Medical Association. Declaration of Helsinki. 1964. [September 18, 2018]. Avaliable from: https://www.wma.net/what-we-do/medical-ethics/declaration-of-helsinki/
- 40. Birkelien NL. A Strategic Framework for Improving the Patient Experience in Hospitals. J Healthc Manag. 2017;62(4):250–9. pmid:28683048
- 41. Smirnova A, Lombarts K, Arah OA, van der Vleuten CPM. Closing the patient experience chasm: A two-level validation of the Consumer Quality Index Inpatient Hospital Care. Health expectations: an international journal of public participation in health care and health policy. Health Expect. 2017;20(5):1041–8. pmid:28218984
- 42. Witherington EM, Pirzada OM, Avery AJ. Communication gaps and readmissions to hospital for patients aged 75 years and older: observational study. Qual Saf Health Care. 2008;17(1):71–5. pmid:18245223
- 43. Hvalvik S, Dale B. The Transition from Hospital to Home: Older People’s Experiences. Open J Nurs. 2015;5:622–31.
- 44. Vahdat S, Hamzehgardeshi L, Hessam S, Hamzehgardeshi Z. Patient involvement in health care decision making: a review. Iran Red Cres Med J. 2014 January; 16(1): e12454.
- 45.
Lazarus R, Folkman S. Stress, appraisal, and coping. New York: Springer Publishing Company, Incorporated; 1984.
- 46.
Poupoulas V. From Compliance to Adherence to Concordance: The Evolution from Paternalistic Medicine to Patient Empowerment 2015. [September 18, 2018]. Available from: http://www.hps.com.au/knowledge-centre/clinical-articles/from-compliance-to-adherence-to-concordance/
- 47. Olthof M, Stevens M, Bulstra SK, van den Akker-Scheek I. The association between comorbidity and length of hospital stay and costs in total hip arthroplasty patients: a systematic review. J Arthroplasty. 2014;29(5):1009–14. pmid:24287128
- 48. Palonen M, Kaunonen M, Astedt-Kurki P. Exploring how to increase response rates to surveys of older people. Nurse Res.2016;23(5):15–9. pmid:27188568
- 49. Sofaer S, Crofton C, Goldstein E, Hoy E, Crabb J. What do consumers want to know about the quality of care in hospitals? Health Serv Res. 2005;40(6 Pt 2):2018–36.
- 50. Garcia-Perez L, Linertova R, Lorenzo-Riera A, Duque-Gonza B, Sarri´a-Santamera A. Risk factors for hospital readmissions in elderly patients: a systematic review. QJM 2011;104(8):639–51. pmid:21558329
- 51. Choi BC, Pak AW. A catalog of biases in questionnaires. Prev Chronic Dis 2005;2(1): A13. pmid:15670466