Figures
Abstract
Background
One-third of all medication errors causing harm to hospitalized patients occur in the medication preparation and administration phase, which is predominantly a nursing activity. To monitor, evaluate and improve the quality and safety of this process, evidence-based quality indicators can be used.
Objectives
The aim of study was to identify evidence-based quality indicators (structure, process and outcome) for safe in-hospital medication preparation and administration.
Methods
MEDLINE, EMBASE and CINAHL were searched for relevant studies published up to January 2015. Additionally, nine databases were searched to identify relevant grey literature. Two reviewers independently selected studies if (1) the method for quality indicator development combined a literature search with expert panel opinion, (2) the study contained quality indicators on medication safety, and (3) any of the quality indicators were applicable to hospital medication preparation and administration. A multidisciplinary team appraised the studies independently using the AIRE instrument, which contains four domains and 20 items. Quality indicators applicable to in-hospital medication preparation and administration were extracted using a structured form.
Results
The search identified 1683 studies, of which 64 were reviewed in detail and five met the inclusion criteria. Overall, according to the AIRE domains, all studies were clear on purpose; most of them applied stakeholder involvement and used evidence reasonably; usage of the indicator in practice was scarcely described. A total of 21 quality indicators were identified: 5 structure indicators (e.g. safety management and high alert medication), 11 process indicators (e.g. verification and protocols) and 5 outcome indicators (e.g. harm and death). These quality indicators partially cover the 7 rights.
Conclusion
Despite the relatively small number of included studies, the identified quality indicators can serve as an excellent starting point for further development of nursing specific quality indicators for medication safety. Especially on the right patient, right route, right time and right documentation there is room future development of quality indicators.
Citation: Smeulers M, Verweij L, Maaskant JM, de Boer M, Krediet CTP, Nieveen van Dijkum EJM, et al. (2015) Quality Indicators for Safe Medication Preparation and Administration: A Systematic Review. PLoS ONE 10(4): e0122695. https://doi.org/10.1371/journal.pone.0122695
Academic Editor: Francesco Pappalardo, University of Catania, ITALY
Received: August 18, 2014; Accepted: February 12, 2015; Published: April 17, 2015
Copyright: © 2015 Smeulers et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This work was supported by internal hospital fund for quality improvement: “What if your mother was in the hospital”. There are no other sources of support. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Medication safety is an important topic because medication errors (MEs) are a common, serious and expensive type of medical error [1]. According to the NCCMERP a ME is defined as 'any preventable event that may cause or lead to inappropriate medication use or patient harm while the medication is in the control of the health care professional, patient or consumer’[2]. The medication process is vulnerable and error prone as it is a complex five phase process: (a) prescribing, (b) verifying, (c) preparing/dispensing (d) administering, and (e) monitoring. A ME can originate in all of these phases.
Rates of medication errors vary, depending on the detection method used. Estimates of the incidence of MEs vary between 5% and 25% of all medication administrations [3–6]. One-third of all MEs causing harm to patients in hospitals occur in the medication preparation and administration phase, which is predominantly a nursing activity [3, 7]. In some settings, medication orders are transcribed, dispensed, and then delivered for nurse administration. In other circumstances and settings, nurses are involved in both the dispensing and preparation of medications (in a similar role to pharmacists), such as crushing pills and preparing syringes with the correct dose. To improve medication safety, the medication process has to be assessed. A widely used method to do this is with quality indicators (QIs) [4, 8–10]. Quality indicators are explicitly defined and measurable items referring to the structure, processes, or outcome of care [9, 11]. The structure is the environment in which health care is provided, and includes material and health resources, operational factors, and organizational characteristics of the health care facility. The process is the method by which health care is provided and includes the giving and receiving of care by the practitioners and health care system. The outcome is the consequence of health care and includes the health status of patients. Quality indicators are usually described with a numerator, a denominator, and a performance standard. After assessment of the quality of care, quality indicators are used to measure whether improvement actions have the desired result as well as to monitor performance.
In order to use quality indicators to assess care in terms of medication preparation and administration, we must first define good quality and safe care. To ensure safe medication preparation and administration, nurses are trained to practice the “7 rights” of medication administration: right patient, right drug, right dose, right time, right route, right reason and right documentation [12, 13]. However, adhering to these 7 rights is not just the responsibility of the individual nurse, but also of the health care organization, i.e. the system within which the nurse functions. An ISMP editorial states that “The 7 rights are broadly stated goals or desired outcomes of safe medication practices for which organizations must accept responsibility and design failsafe ways that they can be achieved” [14]. A good example of this is the organization policy to remove concentrated electrolytes from patient care areas. When a ME occurs, this is often due to breach of one of the 7 rights. Therefore in this review we aimed to identify evidence-based quality indicators (structure, process and outcome) for the 7 rights of safe in-hospital medication preparation and administration.
Methods
We conducted and reported this study according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement (S1 Appendix)[15].
Search strategy
To identify relevant studies, we systematically searched three electronic databases: MEDLINE, EMBASE and CINAHL. These databases were searched from their start date to January 19, 2015; no limitations on language or year of publication were applied. The search terms used combined keywords and medical subject headings for medication safety and quality indicators. We used the following search terms: patient safety, medication safety, medication error, medication administration, quality indicators, quality of care, nurses and nursing care (S2 Appendix for full searches of the databases).
In addition, we conducted a grey literature search in nine sources (search term used: indicators medication safety) to identify studies not indexed in the databases listed above:
- Institute for Healthcare Improvement at www.ihi.org.
- Agency for Healthcare Research and Quality (AHRQ) at www.ahrq.gov.
- The Joint Commission International at www.jointcommissioninternational.org.
- Open Grey at www.opengrey.eu.
- ProQuest at www.proquest.com.
- National Health Services at www.nhs.uk.
- The Australian Commission on Safety and Quality in Healthcare at www.safetyandquality.gov.au.
- The Canadian Patient Safety Institute at www.patientsafetyinstitute.ca.
- The National Institute of Health and Care Excellence at www.nice.org.uk.
Study selection
Studies were included if: (1) the methodology of the study combined a literature search with expert panel opinion, (2) if the results of the study contained quality indicators on medication safety (for example: procedures on handling of (high alert) medications or rates of medication error), and (3) if any of the quality indicators were applicable to the medication preparation and administration phase in a hospital setting. Studies had to combine a literature search with expert panel opinion because this has been described as the most rigorous way to develop quality indicators [11, 16].
Two reviewers (MS and LV) independently selected studies from the search of the electronic databases based on title and abstract. The full texts of the studies selected in the first step were reviewed independently by the same reviewers. In case of disagreement, a third reviewer (HV) was involved to reach a consensus decision on inclusion. Also, the reference lists of the included studies were checked to identify any relevant studies that had not been found in the electronic search. To conclude, HV searched and reviewed the grey literature registries on January 19 2015, potential relevant hits were checked by MS.
Data extraction and analysis
A structured data extraction form was used to describe the studies and quality indicators for medication preparation and administration process (S3 Appendix). The extracted information consisted of the applicable setting, a description of the quality indicator and/or the explanation/description of the numerator and denominator, and the type of quality indicator according to the structure, process and outcome framework of Donabedian. Two reviewers (MS and LV) independently completed the data extraction. Any disagreement between the reviewers was again resolved by consensus decision with a third reviewer (HV).
Methodological assessment
For the methodological assessment of the quality of the included studies, we used the AIRE Instrument (Appraisal of Indicators through Research and Evaluation), which is a validated instrument developed to assess whether the aim and the organizational context of the quality indicators are clearly described and whether the quality indicators are evidence based [17]. The AIRE instrument contains 20 items, divided into four domains: purpose, stakeholder involvement, evidence and usage (S4 Appendix). Each item is scored on a four-point Likert scale ranging from 1 (strongly disagree; confident that the criterion has not been fulfilled or no information was available) to 4 (agree; confident that the criterion has been fulfilled). The AIRE instrument recommends a minimum of four independent reviewers for reliable scores. All authors (n = 7) independently appraised the included studies with the AIRE instrument. They represent a multidisciplinary group with backgrounds in internal medicine, surgery, pediatrics, pharmacy, nursing and quality of care. The AIRE Instrument was completed for a total set of quality indicators instead of for each quality indicator separately, because the studies only gave general information about the development of the total set of quality indicators and the evidence on which they were based. For each of the four domains, an independent standardized score can be calculated. However, we decided to use the individual item scores because we found them to be more informative. No guidance was available on the definition of a high or low score. For this study we arbitrarily defined individual item scores with a total between 7–13 as low, those between 14–20 as moderate and those between 21–28 as high. One author (MS) performed data entry and calculated the scores, while another (LV) cross checked the data entry and calculations.
Results
Search and study characteristics
The electronic search identified 1682 potentially relevant studies. Based on their title and abstract, 63 studies were reviewed in detail. Four studies met the inclusion criteria. The main reason for excluding studies was the inability to meet the methodological inclusion criteria for a combined literature search and expert panel opinion. Checking the references of the included studies yielded one additional study, resulting in a total amount of five included studies (Fig 1 and S5 Appendix). The grey literature search did not result in any additional studies.
The five included studies were published between 1995 and 2010 (Table 1). None of the studies had undertaken quality indicator development specifically for the nursing process of medication preparation and administration. Two studies (Cheng et al. and Nigam et al.) originated from Canada, and both aimed to develop quality indicators for medication safety [18, 19]. The Australian NSW TAG study was commissioned by the Department of Health, which used the data to publish a manual of medication safety indicators for hospitals [20]. This study was not listed as a scientific study; it was found through the reference search. The McLoughlin et al. study had a wider scope and was undertaken as part of the Organization for Economic Cooperation and Development (OECD) Quality Indicator Project, which aimed at developing an initial set of patient safety indicators. It involved several countries (Australia, Canada, the EU, Portugal, Spain and the United States) [21]. The QRC Advisor study was a study by the American Nurses Association that aimed to develop quality indicators for safety and quality of nursing care [22].
Methodological assessment
According to the AIRE domains, the methodological quality of the included studies varied (Table 2). All the studies were clear on purpose, and most of them applied stakeholder involvement and used evidence reasonably. They described usage of the indicator in practice only occasionally [18–21]. The NSW TAG study published in 2007 had the highest scores, with high scores (21–28) in three of the four domains and moderate scores (14–20) in one domain [20]. Individual item scores were low (7–13) on item 8 (the indicator has been formally endorsed), item 11 (the supporting evidence has been critically appraised), item 14 (a strategy for risk adjustment has been considered and described) and item 17 (the indicator has sufficient discriminative power).
Quality indicators
From the included studies, a total of 21 partly overlapping quality indicators were identified and categorized (Table 3): five structure indicators, eleven process indicators and five outcome indicators. Three structure indicators were related to the implementation of safety management systems: incident reporting and analysis, prospective medication safety analysis and the availability of a top 10 high alert medication list that are associated with harm or deaths (the original author classified the availability of a top 10 high alert medication list as an outcome indicator, but we classified it as a structure indicator because the list was derived from incident reports). Two studies reported structure indicators on the limitation of availability of high alert medications (concentrated electrolytes and narcotics). The process indicators can be divided into three categories: verification of prescriptions either by pharmacists or an electronic system, protocols for medications that are driven by specific administration regimes (high alert medications, chemotherapy, antibiotic and thromboprophylactic medications) and documentation of relevant medication related clinical information (adverse drug reactions and postoperative pain management). The only patient-relevant outcome indicators identified were in the category of adverse events, for which various definitions of MEs were used. Of the five definitions of MEs, four included only MEs that resulted in harm or death.
We mapped the identified quality indicator categories onto the 7 rights (Table 4). Almost all categories can be mapped onto “right drug” and “right dose”. The quality indicators on verification by a pharmacist and use of protocols for specific medication also address “right reason.” The electronic verification adds “right patient” and “right documentation.” The structure indicators in the category safety management cannot be mapped onto any of the 7 rights because these indicators are not specific for any of the rights. A prospective risk analysis or incident analysis, for example, can be on various topics in medication safety and can therefore be mapped onto any of the 7 rights. The definitions of the indicators in the outcome category adverse events are not specific enough to map onto any of the 7 rights.
Discussion
A total of 21 evidence-based quality indicators were identified for the nursing process of safe in-hospital medication preparation and administration according to the 7 rights. Since quality indicators are used for quality assessment and both internal and external transparency and benchmarking, it is important to use reliable and valid quality indicators with clear definitions. Our study indicates that only five studies used an evidence-based approach, with a combined literature search and expert panel opinion, for quality indicator development. We also found that the clinical implication and feasibility of the quality indicators were poorly studied or described. These are important aspects to consider, because if data collection for the indicator is difficult, this might result in poor or insufficient data and an unreliable indicator.
The extracted quality indicators can be categorized according to the structure, process and outcome framework. However, most quality indicators referred to the structure and process of care; the only outcome indicator found was adverse events expressed as patient harm or death.
The goals addressed by the 7 rights are only partly covered with the current quality indicators and mainly address “right drug” and “right dose.” Quality indicators on verification by a pharmacist and electronic verification rely on the availability of pharmacists and electronic systems, which are not common practice in every hospital. No quality indicators were found that address “right time” and “right route”. Electronic verification systems could also check on this, but the quality indicators we extracted did not include this function. The nurse-dependent “right time” is especially important for time-critical scheduled medications, such as those identified by the Institute for Safe Medication Practices (ISMP) [23]. These are medications for which maintenance doses that are administered with dosing schedule deviations of more than 30 minutes may cause harm or result in a substantially sub-optimal therapy or pharmacological effect. These include medications with a dosing schedule more frequent than every four hours, medications that must be administered apart from other medications and certain medications that require administration within a specified period of time before, after, or with meals (for example, rapid-, short-, or ultra-short-acting insulin and certain oral anti diabetic agents).
Four of the five outcome quality indicators we found use different definitions of “MEs resulting in harm and death.” Rates of MEs vary, depending on the detection method used as well as the definition of numerator and denominator. Due to this lack of uniformity, incidence rates are difficult to compare. A generally accepted definition of MEs that defines both scope and content is required [24]. Also, the MEs resulting in harm and death are only a small portion of all MEs and near misses; consequently this might be an opportunity to develop more specific definitions of MEs related to the 7 rights.
Overall, we conclude that evidence-based quality indicators for medication safety with clear definitions are scarce, but the identified quality indicators provide an excellent starting point for further development.
Limitations
As demonstrated in this systematic review, little research has been done on quality indicators for the safety of medication preparation and administration. However, our restriction to include only indicators that are developed through an evidence based approach may have led to the exclusion of useful indicators that are developed with other approaches. For instance, in the NICE guideline on safe nurse staffing a clearly defined indicator on medication administration errors is reported, along with eight other indicators for safe staffing (e.g. falls, pressure ulcers, missed breaks, compliance with mandatory training) [25]. This indicator on medication administration errors is well described (numerator, denominator, data source) and has excellent face validity for medication preparation and administration. The interpretation of this indicator, on the other hand, requires caution because the observed rates are heavily influenced by the general reporting level of errors.
Also, we may have underestimated the quality of some studies. The methodological appraisal of the studies was based on information derived from the included studies, but the development process, in particular, was not always described in detail.
Implications for research
The identified quality indicators focus mainly on specific medication procedures or protocols. Future development of quality indicators could therefore focus more on nursing-specific quality indicators for the critical phases of medication preparation and administration. The 7 rights can be used to identify topics on which quality indicators are needed. Our study shows that there is room for further development, especially on the right patient, right route, right time, right reason and right documentation. We recommend that future studies use the AIRE instrument when developing quality indicators, especially to overcome the currently underexposed areas such as formal endorsement, critical appraisal of the evidence, risk adjustment and sufficient discriminative power.
Implications for practice
We found that most of the included studies had methodological flaws. However, the aphorism of evidence-based practice is to “use the best available evidence” [26] and from this perspective it is advisable to consider using the identified quality indicators. When selecting the indicators to be used locally, it is important for endorsers and users to critically review the quality indicators on acceptability, feasibility of acquiring the right data, reliability, sensitivity to change, and validity [11]. Also, adaptation of quality indicators to the local setting may be needed, because the medication process and system may vary between countries. Even when a quality indicator is evidence-based and clearly defined, hospital boards as well as professionals need to believe in the quality benefits to be gained in exchange for their efforts to collect all the necessary data, and it should be feasible for them to integrate it as much as possible in existing processes, electronic systems and data collections. Adaptation and review of quality indicators can be done, for instance, through surveys, interviews or focus groups. Periodic evaluation reports with insightful interpretation of the results can monitor performance, promote evidence-based quality improvement initiatives, and ultimately serve to evaluate effectiveness [27–29].
Acknowledgments
The authors wish to thank Faridi van Etten, clinical librarian, for developing the search strategies.
Author Contributions
Conceived and designed the experiments: MS LV HV. Wrote the paper: MS. Literature selection and data extraction: MS LV HV. Critical appraissal with Aire instrument: MS LV JM MB CK EN HV. Selection of indicators: MS LV HV. Reviewing manuscript: LV JM MB CK EN HV.
References
- 1. Classen DC, Pestotnik SL, Evans RS, Lloyd JF, Burke JP. Adverse drug events in hospitalized patients. Excess length of stay, extra costs, and attributable mortality. Jama. 1997;277(4):301–6. PubMed pmid:9002492.
- 2.
National coordinating council for medication error reporting and prevention NCCMERP. What is a medication error? [cited 2012 Jan 5]. Available: http://www.nccmerp.org/aboutMedErrors.html.
- 3. Barker KN, Flynn EA, Pepper GA, Bates DW, Mikeal RL. Medication errors observed in 36 health care facilities. ArchInternMed. 2002;162(16):1897–903. doi: ioi10605 [pii].
- 4.
Hughes RG, Blegen MA. Medication Administration Safety. In: Patient safety and quality: An evidence-based handbook for nurses. Rockville, MD: Agency for Healthcare Research and Quality; 2008 p 397–457.
- 5. Krahenbuhl-Melcher A, Schlienger R, Lampert M, Haschke M, Drewe J, Krahenbuhl S. Drug-related problems in hospitals: a review of the recent literature. Drug Saf. 2007;30(5):379–407. doi: 3053 [pii]. pmid:17472418
- 6.
Institute of Medicine. Aspden P, Wolcott J, Bootman JL, Cronenwett LR, editors. Preventing Medication Errors: Quality Chasm Series. Washington DC: The National Academies Press; 2007. pmid:17931580
- 7. Leape LL, Bates DW, Cullen DJ, Cooper J, Demonaco HJ, Gallivan T, et al. Systems analysis of adverse drug events. ADE Prevention Study Group. JAMA. 1995;274(1):35–43. pmid:7791256
- 8. Brook RH, McGlynn EA, Shekelle PG. Defining and measuring quality of care: a perspective from US researchers. Int J Qual Health Care. 2000;12(4):281–95. PubMed pmid:10985266.
- 9.
Donabedian A. Exploration in Quality Assessment and Monitoring Vol.1. The Definition of Quality and Approaches to Its Assessment. Ann Arbor, MI: Health Administration Press; 1980.
- 10. Mainz J. Defining and classifying clinical indicators for quality improvement. Int J Qual Health Care. 2003;15(6):523–30. PubMed pmid:14660535.
- 11. Campbell SM, Braspenning J, Hutchinson A, Marshall MN. Research methods used in developing and applying quality indicators in primary care. Bmj. 2003;326(7393):816–9. PubMed pmid:12689983; PubMed Central PMCID: PMCPmc1125721.
- 12. Pape TM. Applying airline safety practices to medication administration. MedsurgNurs. 2003;12(2):77–93.
- 13. Wakefield DS, Wakefield BJ, Borders T, Uden-Holman T, Blegen M, Vaughn T. Understanding and comparing differences in reported medication administration error rates. AmJMedQual. 1999;14(2):73–80. pmid:10337117
- 14.
Institute for Safe Medication Practices. The five rights: A destination without a map. 2007 [cited 2014 July 30]. Available: http://www.ismp.org/newsletters/acutecare/articles/20070125.asp.
- 15. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Bmj. 2009;339:b2535. PubMed pmid:19622551; PubMed Central PMCID: PMCPmc2714657.
- 16.
Fitch K, Bernstein SJ, Aguila MS, Burnand B, LaCalle JR, Lazaro P, et al. The RAND/UCLA Appropriateness Method User's Manual; 2001.
- 17.
de Koning J, Smulders A, Klazinga NS. The Appraisal of Indicators through Research and Evaluation (AIRE) instrument. Academic Medical Center, Amsterdam, The Netherlands; 2006. https://doi.org/10.1111/acem.12591 pmid:25676528
- 18. Cheng R, Yoo L, Ho C, Kadija M. Identification of medication safety indicators in acute care settings for public reporting in Ontario. Healthcare quarterly (Toronto, Ont). 2010;13 Spec No:26–34. PubMed pmid:20959727.
- 19. Nigam R, Mackinnon NJ, U D , Hartnell NR, Levy AR, Gurnham ME, et al. Development of canadian safety indicators for medication use. Healthcare quarterly (Toronto, Ont). 2008;11(3 Spec No.):47–53. PubMed pmid:18382161.
- 20.
NSW Therapeutic Advisory Group. Indicators for Quality Use of Medicines in Australian Hospitals; 2007 [cited 2014 Jan 8] Available: http://www.ciap.health.nsw.gov.au/nswtag/pages/indicators.html.
- 21. McLoughlin V, Millar J, Mattke S, Franca M, Jonsson PM, Somekh D, et al. Selecting indicators for patient safety at the health system level in OECD countries. Int J Qual Health Care. 2006;18 Suppl 1:14–20. PubMed pmid:16954511.
- 22. Nurses develop indicators to measure the safety and quality of health care. QRC advisor. 1995;11:1,7–1,8.
- 23.
Institute for Safe Medication Practices ISMP. Acute Care Guidelines for Timely Administration of Scheduled Medications. 2011 [cited 2014 March 30]. Available: http://www.ismp.org/tools/guidelines/acutecare/tasm.pdf.
- 24. Lisby M, Nielsen LP, Brock B, Mainz J. How are medication errors defined? A systematic literature review of definitions and characteristics. Int J Qual Health Care. 2010;22(6):507–18. PubMed pmid:20956285.
- 25.
National Institution for Health and Care Excellence NICE. NICE Guideline: Safe staffing for nursing in adult inpatient wards in acute hospitals. 2014 July. [cited 2015 Jan 29] Available: http://www.nice.org.uk/sg1.
- 26. Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn't. 1996. Clinical orthopaedics and related research. 2007;455:3–5. PubMed pmid:17340682.
- 27. Glasziou P, Ogrinc G, Goodman S. Can evidence-based medicine and clinical quality improvement learn from each other? BMJ quality & safety. 2011;20 Suppl 1:i13–7. PubMed pmid:21450763; PubMed Central PMCID: PMCPmc3066698.
- 28. Shojania KG, Grimshaw JM. Evidence-based quality improvement: the state of the science. Health affairs (Project Hope). 2005;24(1):138–50. PubMed pmid:15647225.
- 29. Levin RF, Keefer JM, Marren J, Vetter M, Lauder B, Sobolewski S. Evidence-based practice improvement: merging 2 paradigms. Journal of nursing care quality. 2010;25(2):117–26. PubMed pmid:19680149.