http://orcid.org/0000-0002-4127-7909
Correction
8 May 2024: Saldanha V, de Araújo IB, Lima SIVC, Martins RR, Oliveira AG (2024) Correction: Risk factors for drug-related problems in a general hospital: A large prospective cohort. PLOS ONE 19(5): e0303708. https://doi.org/10.1371/journal.pone.0303708 View correction
Figures
Abstract
Objective
To identify risk factors for potential Drug-Related Problems (DRP) at admission in hospitalized patients.
Methodology
Prospective cohort study conducted in adults patients hospitalized (May 2016 to May 2018) in a general tertiary care hospital in Brazil. Potential DRP were detected by daily review of 100% of electronic medication orders by hospital pharmacists and classified by the Pharmaceutical Care Network Europe classification system (PCNE version 6.2). For the identification of risk factors of potential DRP, backward stepwise logistic regression was used to identify the set of independent predictors among over 120 variables collected in the initial 48 hours after admission in a training set consisting of 2/3 of the study population. The model was validated in the remaining sample.
Results
The study population consisted of 1686 patients aged 52.0+/- 18.3 years-old, 51.4% females, with a median length of stay of 3.24 days, and 4.5% in-hospital mortality. The cumulative incidence of potential DRP was 14.5%. Admission for elective surgery and main diagnosis of disease of the circulatory system were associated with reduced risk of DRP (OR 0.41 and 0.57, respectively, p<0.05). The independent risk factors of DRP are heart rate ≥ 80 bpm (OR 1.41, p = 0.05), prescription of more than seven drugs in day 2 (OR 1.63, p = 0.05), prescription in day 1 of drugs of the Anatomical Therapeutic Chemical Code (ATC) class A (alimentary tract and metabolism, OR 2.24, p = 0.003), prescription in day 2 of two or more ATC class A drugs (OR = 3.52, p<0.001), and in day 1 of ATC class J drugs (antiinfectives for systemic use, OR 1.97, p = 0.001). In the validation set, the c-statistic of the predictive model was 0.65, the sensitivity was 56.1% and the specificity was 65.2%.
Citation: Saldanha V, Araújo IBd, Lima SIVC, Martins RR, Oliveira AG (2020) Risk factors for drug-related problems in a general hospital: A large prospective cohort. PLoS ONE 15(5): e0230215. https://doi.org/10.1371/journal.pone.0230215
Editor: Naeti Suksomboon, Mahidol University, THAILAND
Received: October 18, 2019; Accepted: February 24, 2020; Published: May 5, 2020
Copyright: © 2020 Saldanha et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Drug-related problems (DRP) are defined as “events or circumstances involving drug therapy that actually or potentially interfere with desired health outcomes” [1]. The definition of DRP is comprehensive, encompassing the concepts of adverse events, which may be preventable or not, adverse reactions, which are not preventable, and medication errors, which include prescription errors, drug dispensing errors, and drug administration errors [2]. DRP that are detected are classified as potential, if they have the prospective of causing harm to the patient regardless of whether a harm was actually observed, and manifest if they did have caused harm to the patient [1]. Therefore, potential DRP do not necessarily imply patient injury: medication errors, for example, uncommonly lead to patient harm.
Events related to medication use are common in adults [3] and children [4], at any level of care [5–8]. Problems involving medication are associated with a higher number of hospitalizations, long-term hospitalizations, admission to emergency services, additional visits to the doctor's office, additional prescriptions and death [9,10]. Therefore, the economic burden and morbimortality are evident [8,11,12]. As reported in previous studies, the cumulative incidence of DRP in hospitalized patients showed large variation, from 27.8% [13] to 81% [14], mainly in relation to the characteristics of the target population [14], the methodology adopted for their detection and their classification [15]. Several classification systems of DRP have emerged, among them the Pharmaceutical Care Network (PCNE), which has been the most widely used internationally in hospital clinical practice [16].
Several strategies for detecting DRP have been used to assist in the daily monitoring of drug therapy. According to the literature, these have included medical chart review, associated or not with electronic alerting systems [17], and the integration of pharmacists into the health care teams during ward rounds [18]. In pharmacoepidemiology, medical chart review is considered the gold standard [19] for improvement of the safety of the medication process [17, 20–22] and, from this process, to enable the identification of clinical and demographic characteristics that may be considered predictors of increased risk developing a DRP in hospitalized patients. The knowledge of risk factors of DRP for a population exposed to a multifactorial environment, such as the hospital, is necessary to assist in directing actions for the implementation of damage prevention strategies, offering quality and safety in health care and resource optimization.
Currently, little is known about risk factors for the development of DRP in the average patient in a general hospital. Risk factors for DRP have been specifically studied in elderly populations [23], patients from medical specialties such as cardiology [24,25] and paediatrics [26]. To the best of our knowledge, there has been a single report in the literature investigating risk factors and developing a risk score for DRP in adult patients at hospital admission in general wards, the study by Urbina et al [13], with a subsequent validation study by Ferrández et al. [27]. A 2015 study suggested a set of risk factors, but they were selected on the basis of expert opinions [28]. Therefore, the present study represents a further attempt to fill a knowledge gap regarding risk factors of potential DRP at admission in patients hospitalized in a general tertiary care hospital.
Patients and methods
This was prospective observational cohort study conducted at Onofre Lopes University Hospital, a public hospital in Natal, Rio Grande do Norte, Brazil, which was approved by the institution's Research Ethics Committee with approval number 1.439.845. All patients gave written informed consent and no incentives were offered to participants.
To avoid bias due to seasonality, patient enrolment proceeded without interruption for 2 years from May 2016 to May 2018. Inclusion criteria were: patients aged 18 years or older, of both sexes, who were hospitalized for more than 24 hours in the departments of nephrology, urology, cardiology, surgery (general, neurological, cardiovascular and oncological), endocrinology, rheumatology, neurology, gastroenterology and psychiatry, and who were administered at least one medication. Patients admitted for diagnostic purposes only, who were on cancer chemotherapy regimens, transplanted patients, pregnant women and patients hospitalized in the intensive care unit were excluded.
In order to obtain the target sample size distributed evenly over the defined two-year patient accrual period, a random sample of patients was obtained by enrolling into the study all eligible patients admitted on two different days (consecutive or not) of each study week A randomization list of the two days in each study week when patient enrolment would occur was prepared before the study start using a random number generator.
All patients included in the study cohort were followed throughout their hospital stay from admission to discharge. Potential DRP were detected by daily review of 100% of the electronic medication orders distributed evenly by groups of 3 pharmacists/day from a total of 21 hospital pharmacists assigned to the project. Although the hospital has an electronic patient record and a computerized physician order entry system (without an integrated DRP warning system), only the latter was inspected for the detection of DRP. Each potential DRP identified by the pharmacists was then classified by a clinical pharmacist with 9 years’ experience using the Pharmaceutical Care Network Europe classification system (PCNE version 6.2), according to the type of problem and causes. In cases of doubt in the accurate classification, another pharmacist with more than 10 years’ experience was consulted and a consensual decision was reached. No evaluation of adverse reactions and dispensing errors was made because the potential DRP detection method based exclusively on medication order review did not provide data to verify such problems. All identified potential DRP were subsequently reported to the healthcare team through standard forms in use in the hospital for that purpose.
Patient demographic and clinical data were collected from all patients at admission, as well prescription data in the first and second hospitalization day. These data were collected from all patients who were admitted to the medical and surgical clinics. The patient data were collected by pharmacy students and the identification of potential DRP was done by pharmacists from the hospital pharmacy service. Patient-related variables were age, sex, race, hospitalization in the previous 12 months, body mass index, vital signs, type of admission (medical, elective surgery or emergency surgery), co-morbidities, International Disease Classification version 10 (WHO-CID 10) chapter of the main diagnosis, Charlson's comorbidity index, and routine laboratory data (haemoglobin, leukocytes, creatinine, albumin, alanine aminotransferase, and gamma-glutamyl-transpeptidase). Drug related variables were number of drugs prescribed, number of drugs prescribed in each Anatomical Therapeutic Chemical Code (ATC) therapeutic group, number of drugs by route of administration, presence of drug-drug interaction, drug-food interaction and drug incompatibility.
Statistical analysis
The target sample size was defined at 1800 patients, which would afford 80% power at the two-tailed significance level of 5% to identify risk factors of DRP with an odds-ratio greater than 2.38 in variables with a prevalence of 5%, and with an odds-ratio greater than 1.64 in variables with a prevalence of 20%.
Stata 15 (Stata Corporation, College Station, TX, USA) was used in all analyses. All continuous predictor variables were dichotomized by constructing receiver operating characteristics (ROC) curves for each one and then selecting as cut-off the value corresponding to an approximately equal sensitivity and specificity for the occurrence of one or more DRP. For the identification of risk factors of DRP we used univariate logistic regression to test the association between a dependent binary variable, coded 0 if no DRP had been observed in a patient and 1 otherwise, with each demographic and clinical variable collected at admission and drug data collected on the first and second days of hospitalization. Only variables that occurred in more than 5% of the patients were analysed. Variables in which the test of the regression coefficient yielded a p-value greater than 0.20 were considered not associated. In an attempt to derive a predictive model that could be used as a risk stratification tool for DRP in patients hospitalized in a general tertiary-care hospital, the study population was randomly divided in a 2:1 ratio into a training set and a validation set. Using the training set, the variables identified in the previous univariate analysis were entered into a multivariate logistic regression model using a stepwise backward variable selection method retaining only those predictor variables associated with the outcome at the 5% significance level. Interactions were not tested and estimates relate to main effects only. Model fit in the training set was evaluated for discrimination by the area under the ROC curve (c-statistic) and for calibration with the Hosmer-Lemeshow test. The performance of the prediction model was assessed with the Brier score and with the analysis of the calibration plot and the calibration belt plot, obtained with the pmcalplot [29] and calibrationbelt [30] commands of Stata. Model sensitivity, specificity and predictive values positive and negative were computed. These statistics, as well as the c-statistic and calibration plots were then obtained from the validation set.
Results
During the two years’ enrolment period, there were 14,527 hospitalization episodes. From these, 3,877 (25%) were the total number of admissions in the two week days selected at random. After assessment of exclusion criteria 2,026 patients were excluded and a further 23 patients declined participation in the study. In the remaining 1,803 hospitalization episodes, there were 1,686 distinct patients. Only the first hospitalization episode was considered in patients with multiple hospitalizations.
The mean age of the 1,686 unique patients representing the study population was 52.0 ± 18.3 years and 867 (51.4%) were female. Table 1 summarizes the main characteristics of the study population.
The total number of potential DRP detected by the hospital pharmacists was 519 in 245 patients, corresponding to a cumulative incidence of potential DRP in the study cohort of 14.5% (95% confidence interval (CI) 12.9%– 16.3%). The average number of DRP among hospitalized patients was 0.31 ± 0.90 (95%CI 0.26–0.35) and among patients with potential DRP was 1.90 ± 1.46 (95%CI 1.72–2.09). A summary of the detected potential DRP in the four problem classes and according to causes is presented in Table 2.
For the univariate analysis by logistic regression of the variables associated with the occurrence of one or more potential DRP, the following variables were excluded from the analysis because they were observed in less than 5% of the patients: body temperature > 37.5 C, administration of one or more medications of ATC classes D (dermatologicals), G (genito-urinary system and sex hormones), L (antineoplastic and immunomodulating agents), S (sensory organs) and V (various), all administration routes except oral, intravenous and subcutaneous, all ICD-10 chapters of main diagnosis except chapters II (neoplasms), IX (circulatory system), X (respiratory system), XI (digestive system) and XIV (genitourinary system).
In univariate logistic regression analysis (Fig 1), the following patient-related variables collected at hospital admission were statistically significantly associated, at the 5% significance level, with an increased risk of occurrence of one or more potential DRP: hospitalization during the previous 12 months (OR 1.37), Charlson’s Comorbidity Index ≥5 (OR 1.50), Body Mass Index < 25.0 kg/m2 (OR 1.36), heart rate ≥ 80 beat per minute (OR 1.85), haemoglobin < 11.5g/dL (OR 1.92) and leukocytes ≥ 8 K/dL (OR1.48); hospitalization for elective surgery decreased the risk of potential DRP occurrence (OR 0.44).
In the analysis of the variables related to the drugs prescribed in the first 24 hours of hospitalization, the risk for potential DRP decreases when an ATC classification code A drug (alimentary tract and metabolism) was present in the prescription (OR 0.66) or an ATC code M drug (musculo-skeletal system, OR 0.43). Drug-related factors that increase the risk of DRP were prescription of ≥ 7 medications (OR 1.68), drug-drug incompatibility (OR 1.74), prescription of intravenous drug (OR 1.96) and subcutaneously (OR 1.74), prescription of ATC code H medications (systemic hormonal preparations, OR 1.48), administration of ATC code J drugs (antiinfectives for systemic use, OR 1.72), and administration of ATC code P drugs (antiparasitic medications, OR 2.19).
In the second day of hospitalization, risk factors are the same as those identified in the first 24 hours of hospitalization, but with different odds-ratios. The exception is the prescription of two or more alimentary tract and metabolism agents that increases the risk of potential DRP (OR 2.24).
The prescription of 2 or more alimentary tract and metabolism agent and of 2 or more agents that act in the blood and blood forming organs (ATC code B) in the first 2 days of hospitalization are factors of increased risk for the occurrence of potential DRP, in addition to the factors observed on the second day of hospitalization.
Table 3 shows the three most prescribed medications corresponding to each of the variables associated with the occurrence of one or more DRP identified in the univariate analysis.
For the development of a clinical instrument predictive of the occurrence of one or more potential DRP in patients hospitalized in a general tertiary care hospital, the training set consisting of 1,124 patients was used to develop a multivariate model by logistic regression with stepwise variable selection of all the variables identified by univariate analysis. Haemoglobin and leucocyte count were excluded from the analysis because those data were missing in a large proportion of patients. Table 4 presents the variables that were independently associated with the occurrence of one or more potential DRP in multivariate logistic regression. The Aikake Information criterium was reduced from 899.6 in the full model with 37 variables to 865.8 in the final model with 7 variables. The pseudo R-squared was 0.09.
Elective surgery was associated with a reduced risk of potential DRP (adjusted odds-ratio (aOR) 0.41, p<0.001), as well the main diagnosis of disease of circulatory system (aOR 0.57, p = 0.035). Elective surgery was the reason for hospitalization in 1064 (63.1%) patients. Heart rate ≥ 80 beat per minute (bpm) increased the risk of DRP (aOR 1.41, p = 0.053) and was observed in 724 (42.9%) patients. The risk of potential DRP was increased in patients who had two or more drugs of ATC class A (alimentary tract and metabolism) prescribed on the second day of hospitalization (aOR 3.52, p<0.001), observed in 1055 patients (62.6%), and one or more on day one (aOR 2.24, p = 0.003), which was observed in 583 (34.6%) patients, who were prescribed with a drug of ATC class J (antiinfectives for systemic use) in day one (aOR 1.97, p = 0.001), observed in 386 (22.9%) patients, and in patients prescribed with seven or more drugs in day 2 (aOR 1.63, p = 0.022), with was seen in 1002 (59.4%) patients. The final predictive model was applied to the validation set for determination of the model fit and predictive performance in a distinct set of patients. Model calibration was adequate as assessed by the Hosmer-Lemeshow test (p = 0.57). The calibration plot shown in Fig 2 obtained in the training and in the validation set with 562 patients shows excellent fit of the model to the data in the training set (intercept -0.001, slope 1.002) with some loss of calibration in the training set (intercept -0.033, slope 0.589).
Fig 3 shows the calibration belt in the training and the validation sets, again showing good fit of the model to the data in the raining set. In the validation set the calibration belt show that the model somehow overestimates the risk of potential DRP in patients with higher risk.
The light grey area represents the 80% confidence bands and the dark grey areas the 95% confidence bands.
Model discrimination, assessed by the area under the ROC curve, was 0.71 (95% confidence interval (CI) 0.66–0.75) in the training set and 0.65 (95% CI 0.58–0.71 in the validation set. Fig 4 presents the ROC curves in the training and in the validation sets.
The Brier score was 0.11 indicating adequate predictive performance of the model. Table 5 presents the sensitivity, specificity and predictive values of the model in the training and the validation sets setting as classification cut-off a predicted probability of potential DRP of 14.6%.
Discussion
The present study was based on a large prospective cohort of patients randomly selected among all adult patients admitted to a general tertiary care hospital during a two-year period, excluding patients under chemotherapy and immunosuppression. Several risk factors of potential drug-related problems were identified among patients variables collected at admission and among medicines prescribed in the first two days of hospitalization, with a set of seven independent risk factors identified by multivariate analysis. A multivariate model based on those risk factors demonstrated good fit to the data and fair predictive performance considering that the predicted outcome has low incidence in this patient population.
The most common potential DRP in our study, “effect of drug treatment not optimal”, relate to dosage inadequacy, especially an interval of administration of drug doses shorter than recommended. The occurrence of these errors may be related to insufficient knowledge about newer drugs and clinical protocols by prescribers as a consequence of our hospital being a university hospital, with constant admission of interns and residents with limited experience in pharmacotherapy. Another common DRP in our findings refers to “high treatment costs”, which were due to excessive length of treatment duration, often with antimicrobials in situations of therapeutic ineffectiveness. As noted by, Saokews et al., the use of antimicrobials without proper monitoring results in increased costs, as well as in therapeutic ineffectiveness and patient risk [31].
Although the identification of the patients at risk of events involving drug therapy among adult patients hospitalized in general hospitals is of unquestionable clinical importance, to the best of our knowledge only one observational study has been published with that aim [13]. In that study, Urbina et al. searched for risk factors of DRP using the data of a prospective cohort of 8713 patients admitted to a tertiary care university hospital during a six-month period. Potential DRP were detected both by an alert system coupled with a computerized medical record with an integrated physician order entry and by manual review of all medication orders by a team of clinical pharmacists. They identified several independent risk factors of one or more DRP, namely age, Charlson’s Comorbidity index, polypharmacy, several diagnostic categories (circulatory, digestive, musculoskeletal and connective, kidney and urinary tract) and drugs in several ATC classification classes (cardiovascular system drugs, systemic hormones, systemic antiinfectives, sensory organs agents, and various). The study included an initial validation of the identified predictor variables in 4058 subsequent admissions, reporting an area under the ROC curve of 0.78, with a second validation [27] being published later, based on retrospective cohort of 52,987 patients from the same hospital observed over 4 years, reporting an area under the ROC curve of 0.75. Our study adds to the knowledge base of risk factors of DRP in hospitalized patients by corroborating some of the results of the Urbina study. Several of those independent risk factors correspond or are related to risk factors identified in univariate analysis in our study such as older age, polypharmacy, antiinfectives use. Our study also identified digestive system drugs as important risk factors, with ondansetron and metoclopramide responsible for an important number of DRP. Therefore, the present study also strengthens the notion that risk stratification systems of DRP in patients hospitalized in general hospitals may be successfully developed. One important difference between the two studies, though, is that near one fourth of the potential DRP in the Urbina study were prescription errors related to inadequate utilization of the computerized physician order entry system by the physicians, which may limit the generalizability of the findings, whereas in our study prescription errors related to the use of a computational tool were not that important.
Other studies have presented results on related topics, but none on risk factors of potential DRP in patients in general hospital. Some studies have reported risk factors of adverse drug reactions or adverse events [32–34]. Other studies have described risk factors of potential DRP in specific patient populations, such as a study in a retrospective cohort of 200 patients with rheumatoid arthritis that identified polypharmacy, multiple comorbidities, hyperlipidaemia, renal failure and osteoarthritis as risk factors [35], and a prospective study conducted in 842 patients hospitalized in cardiology wards that concluded that female sex, first hospital admission and each additional medication received increased the risk factors of DRP [25].
In our study, the analysis of variables on hospital admission indicated that elective surgery admission had lower risk of potential DRP, most likely due to a shorter length of stay, less comorbidities, lower complexity of the processes of care and, consequently, fewer medication orders. In contrast, recurrent hospitalizations within the same year, indicating a need to care of previously unresolved and complex health problems, as well as Charlson’s comorbidity index ≥ 5 are related to increased complexity of care [36]. Patient variables such as body mass index below the normal range, increased heart rate, anemia, and leukocytosis are clinical signs common to several serious conditions, especially infections and blood abnormalities [37].
Upon admission and within the next 48 hours, risk factors related to the occurrence of potential DRP include seven or more prescribed medicines, potential drug-drug incompatibilities in the medication order, prescription of drugs administered by the intravenous and subcutaneous routes, and specific ATC classes (alimentary tract and metabolism agents, systemic hormonal preparations, systemic antinfectives, musculo-skeletal, and antiparasitic drugs). Polypharmacy, consisting of the prescription of seven or more medications, predisposes to drug interactions and adverse drug events, especially in patients with comorbidities [38]. Drug-drug incompatibilities are, by definition, cause of DRP. In multivariate analysis drug-drug interactions were no longer statistically significant probably because the drugs more often involved in drug-drug-incompatibilities were alimentary tract agents, which are more markedly associated to the occurrence of DRP. Antiparasitic drugs refer mostly, in the ATC classification, to intravenous metronidazole used for the treatment of infections caused by anaerobic bacteria.
The administration of a single alimentary tract and metabolism agent on admission is associated with decreased risk of potential DRP, possibly because this is routine in patients admitted to elective surgery. However, when controlling for elective surgery in multivariate analysis, the prescription of one medication of that ATC class in day 1, or two or more in day 2, increases the risk of potential DRP.
The seven independent predictors of DRP were selected by multivariate analysis from over 123 candidate variables covering patient demographic, clinical and pharmacotherapeutic data collected within the initial 48 hours upon hospital admission. Many of the study variables overlap the variable set reported in the study by Urbina et al [13] but one important distinction is that we collected, and analysed separately, data on medications prescribed on the first and second hospitalization day. The rationale behind this approach was because the medication prescribed upon patient admission, before the results of several diagnostic exams are known, is often changed the next day when the clinical problems are more accurately identified. The analysis of model calibration and discrimination was in line with the results reported by Urbina et al. [13], the validation of the model in an independent sample of patients indicated that the model is robust but, although sensitivity and specificity values are interesting, they are not in the ideal range for clinical utilization. Therefore, continuing efforts in this line of research are necessary to develop models with better predictive properties.
This study has some limitations. Data were obtained from a single institution, which may somehow prevent the generalization of our findings. In addition, because potential DRPs have been identified from hospital pharmacy records and medical reports, there may be underreporting in view of the method used to identify potential DRPs. The lack of support from an effective computerized warning system of potential DRP and the absence of the clinical pharmacist at patient bedside visits may also have led to under-detection of potential DRP.
However, considering the large sample size and the very limited literature on risk factors of DRP among patients admitted to a general hospital, we believe that the results are quite relevant. The prospective cohort design, the adoption of standard classification system of DRP, and review of 100% of the medication orders by a team of clinical pharmacists are methodological aspects of the study that contribute to the validity of the results.
The identification of predictors of potential DRP is of great clinical value for the selection of patients requiring preventive measures to improve medication safety and quality of care. The development of risk stratification tools to support the work of the healthcare team, especially the clinical pharmacist, will most likely allow the optimization of time and resources. Risk stratification directs drug-related harm prevention strategies, thereby reducing morbidity and mortality, costs, treatment time and, consequently, improving the quality of care.
Future studies should search for additional risk factors of DRP in different hospital settings, including laboratory parameters, focusing not just on variables collected at patient admission but preferably throughout the entire hospital stay.
Conclusion
The risk of one or more potential DRP during hospitalization in a general hospital was found to be increased in patients with increased heart rate, patients prescribed in the second hospital day with two or more agents acting on the alimentary tract and metabolism or with a systemic anti-infective, and patients administered 2 or more agents acting on blood or blood products during the first two days, while patients admitted for elective surgery have lower risk of potential DRP. The assessment of these risk factors within the first 24 hours of hospitalization may help in the identification of patients at risk for DRP, and may enable clinical pharmacists to guide and target preventive measures in order to limit the occurrence of manifest DRP.
Acknowledgments
The authors would like to thank the pharmacists of the University Hospital Onofre Lopes for the registration of the interventions and the students of the Pharmacy course Bruna Cordeiro Araújo, Gislayne Correia, José Marinaldo Filho, Maria Luiza Fernandes, Thaise Marijara Almeida, Tiago Viana, Mariana Fernandes Gomes, Luma Araújo Farias and Kaline dos Santos Lima for the data collection. We also thank Adriana Cristina Silva for informatics support.
References
- 1.
Pharmaceutical Care Network Europe (PCNE). The definition of drug-related problems. V 6.2. Zuidlaren: The Foundation; 2009 Nov. 9p. Available at: https://www.pcne.org/upload/files/11_PCNE_classification_V6-2.pdf.
- 2. Nebeker JR, Barach P, Samore MH. Clarifying adverse drug events: a clinician's guide to terminology, documentation, and reporting. Ann Intern Med. 2004;140:795–801. pmid:15148066
- 3. Qu C, Meng L, Wang N, Chen Y, Yang X, Wang J, et al. Identify and categorize drug-related problems in hospitalized surgical patients in China. Int J Clin Pharm. 2019;41:13–17. pmid:30610549
- 4. Birarra MK, Heye TB, Shibeshi W. Assessment of drug-related problems in pediatric ward of Zewditu Memorial Referral Hospital, Addis Ababa, Ethiopia. Int J Clin Pharm. 2017;39:1039–46. pmid:28689305
- 5. Meyer-Massetti C, Meier CR, Guglielmo BJ. The scope of drug-related problems in the home care setting. Int J Clin Pharm. 2018;40:325–34. pmid:29322475
- 6. Silva C, Ramalho C, Luz I, Monteiro J, Fresco P. Drug-related problems in institutionalized, polymedicated elderly patients: opportunities for pharmacist intervention. Int J Clin Pharm. 2015;37:327–34. pmid:25637404
- 7. Szilvay A, Somogyi O, Mesko A, Zelko R, Hanko B. Qualitative and quantitative research of medication review and drug-related problems in Hungarian community pharmacies: a pilot study. BMC Health Serv Res. 2019;19:282. pmid:31053135
- 8. Tasaka Y, Tanaka A, Yasunaga D, Asakawa T, Araki H, Tanaka M. Potential drug-related problems detected by routine pharmaceutical interventions: safety and economic contributions made by hospital pharmacists in Japan. J Pharm Health Care Sci. 2018;4:33. pmid:30564432
- 9. Al Hamid A, Ghaleb M, Aljadhey H, Aslanpour Z. A systematic review of hospitalization resulting from medicine-related problems in adult patients. Br J Clin Pharmacol. 2014;78:202–17. pmid:24283967
- 10. Alghamdy MS, Randhawa MA, Al-Wahhas MH, Al-Jumaan MA. Admissions for drug-related problems at the Emergency Department of a University Hospital in the Kingdom of Saudi Arabia. J Family Community Med. 2015;22:44–8. pmid:25657611
- 11. Baena MI, Fajardo PC, Pintor-Marmol A, Faus MJ, Marin R, Zarzuelo A, et al. Negative clinical outcomes of medication resulting in emergency department visits. Eur J Clin Pharmacol. 2014;70:79–87. pmid:24091839
- 12. Gastelurrutia P, Benrimoj SI, Espejo J, Tuneu L, Mangues MA, Bayes-Genis A. Negative clinical outcomes associated with drug-related problems in heart failure (HF) outpatients: impact of a pharmacist in a multidisciplinary HF clinic. J Card Fail. 2011;17:217–23. pmid:21362530
- 13. Urbina O, Ferrandez O, Grau S, Luque S, Mojal S, Marin-Casino M, et al. Design of a score to identify hospitalized patients at risk of drug-related problems. Pharmacoepidemiol Drug Saf. 2014;23:923–32. pmid:24817497
- 14. Blix HS, Viktil KK, Reikvam A, Moger TA, Hjemaas BJ, Pretsch P, et al. The majority of hospitalised patients have drug-related problems: results from a prospective study in general hospitals. Eur J Clin Pharmacol. 2004;60:651–8. pmid:15568140
- 15. Krahenbuhl-Melcher A, Schlienger R, Lampert M, Haschke M, Drewe J, Krahenbuhl S. Drug-related problems in hospitals: a review of the recent literature. Drug Saf. 2007;30:379–407. pmid:17472418
- 16. Lampert ML, Kraehenbuehl S, Hug BL. Drug-related problems: evaluation of a classification system in the daily practice of a Swiss University Hospital. Pharm World Sci. 2008;30:768–76. pmid:18357512
- 17. Roten I, Marty S, Beney J. Electronic screening of medical records to detect inpatients at risk of drug-related problems. Pharm World Sci. 2010;32:103–7. pmid:20012362
- 18. Rodrigues JPV, Marques FA, Goncalves A, Campos MSA, Reis TMD, Morelo MRS, et al. Analysis of clinical pharmacist interventions in the neurology unit of a Brazilian tertiary teaching hospital. PLoS ONE. 2019;14:e0210779. pmid:30657771
- 19. Rashed AN, Neubert A, Tomlin S, Jackman J, Alhamdan H, AlShaikh A, et al. Epidemiology and potential associated risk factors of drug-related problems in hospitalised children in the United Kingdom and Saudi Arabia. Eur J Clin Pharmacol. 2012;68:1657–66. pmid:22644343
- 20. Bedouch P, Allenet B, Grass A, Labarere J, Brudieu E, Bosson JL, et al. Drug-related problems in medical wards with a computerized physician order entry system. J Clin Pharm Ther. 2009;34:187–95. pmid:19250139
- 21. Hammar T, Lidstrom B, Petersson G, Gustafson Y, Eiermann B. Potential drug-related problems detected by electronic expert support system: physicians' views on clinical relevance. Int J Clin Pharm. 2015;37:941–8. pmid:26047943
- 22. Tora H, Bo H, Bodil L, Goran P, Birgit E. Potential drug related problems detected by electronic expert support system in patients with multi-dose drug dispensing. Int J Clin Pharm. 2014;36:943–52. pmid:24974220
- 23. Stampfli D, Boeni F, Gerber A, Battig VAD, Weidmann R, Hersberger KE, et al. Assessing the ability of the Drug-Associated Risk Tool (DART) questionnaire to stratify hospitalised older patients according to their risk of drug-related problems: a cross-sectional validation study. BMJ Open. 2018;8:e021284. pmid:29950469
- 24. Abdela OA, Bhagavathula AS, Getachew H, Kelifa Y. Risk factors for developing drug-related problems in patients with cardiovascular diseases attending Gondar University Hospital, Ethiopia. J Pharm Bioallied Sci. 2016;8:289–95. pmid:28216952
- 25. Urbina O, Ferrandez O, Luque S, Grau S, Mojal S, Pellicer R, et al. Patient risk factors for developing a drug-related problem in a cardiology ward. Ther Clin Risk Manag. 2015;11:9–15. pmid:25565852
- 26. Rashed AN, Wilton L, Lo CC, Kwong BY, Leung S, Wong IC. Epidemiology and potential risk factors of drug-related problems in Hong Kong paediatric wards. Br J Clin Pharmacol. 2014;77:873–9. pmid:24868576
- 27. Ferrandez O, Grau S, Urbina O, Mojal S, Riu M, Salas E. Validation of a score to identify inpatients at risk of a drug-related problem during a 4-year period. Saudi Pharm J. 2018;26:703–8. pmid:29991914
- 28. Kaufmann CP, Stampfli D, Hersberger KE, Lampert ML. Determination of risk factors for drug-related problems: a multidisciplinary triangulation process. BMJ Open. 2015;5:e006376. pmid:25795686
- 29. Ensor J, Snell KI, Martin EC. PMCALPLOT: Stata module to produce calibration plot of prediction model performance. Statistical Software Components S458486, Boston College Department of Economics, revised 01 Nov 2018.
- 30. Finazzi S, Poole D, Luciani D, Cogo PE, Bertolini G. Calibration belt for quality-of-care assessment based on dichotomous outcomes. PloS ONE. 2011;6:e16110. pmid:21373178
- 31. Saokaew S, Maphanta S, Thangsomboon P. Impact of pharmacist’s interventions on cost of drug therapy in intensive care unit. Pharm Pract (Granada). 2009;7:81–7. pmid:25152782
- 32. Bates DW, Miller EB, Cullen DJ, Burdick L, Williams L, Laird N, et al. Patient risk factors for adverse drug events in hospitalized patients. ADE Prevention Study Group. Arch Internal Med. 1999;159:2553–60. pmid:10573045
- 33. Onder G, Petrovic M, Tangiisuran B, Meinardi MC, Markito-Notenboom WP, Somers A, et al. Development and validation of a score to assess risk of adverse drug reactions among in-hospital patients 65 years or older: the GerontoNet ADR risk score. Arch Intern Med. 2010;170:1142–8. pmid:20625022
- 34. Zopf Y, Rabe C, Neubert A, Hahn EG, Dormann H. Risk factors associated with adverse drug reactions following hospital admission: a prospective analysis of 907 patients in two German university hospitals. Drug Saf. 2008;31:789–98. pmid:18707193
- 35. Ma SN, Zaman Huri H, Yahya F. Drug-related problems in patients with rheumatoid arthritis. Ther Clin Risk Manag. 2019;15:505–24. pmid:30962689
- 36. Sinvani L, Kuriakose R, Tariq S, Kozikowski A, Patel V, Smilios C, et al. Using Charlson Comorbidity Index to Predict Short-Term Clinical Outcomes in Hospitalized Older Adults. J Healthc Qual. 2019;41:146–53. pmid:31094947
- 37. Liang SY. Sepsis and Other Infectious Disease Emergencies in the Elderly. Emerg Med Clin North Am. 2016;34(3):501–22. pmid:27475012
- 38. Menditto E, Gimeno Miguel A, Moreno Juste A, Poblador Plou B, Aza Pascual-Salcedo M, Orlando V, et al. Patterns of multimorbidity and polypharmacy in young and adult population: Systematic associations among chronic diseases and drugs using factor analysis. PloS ONE. 2019;14:e0210701. pmid:30726245