http://orcid.org/0000-0003-3818-9761
Figures
Abstract
Background
Assessing adherence to Early goal-directed therapy (EGDT) is challenging and might account for the negative findings and generalisability of the major trials to a real-life setting. This study was aimed (1) to extract key components of pediatric EGDT guidelines potentially becoming adherence criteria; (2) to classify adherence criteria into complete, clinically important, and feasible; and (3) to compare percent adherence to selected guidelines using the three approaches.
Methods
This study started with review of existing evidence to extract key components of pediatric EGDT guidelines. Modified Delphi method was then conducted in two rounds among national experts to identify feasible and/or clinically important criteria. Data from the national prospective multicenter study “Clinical Effectiveness of the Utilization of Bundled Care for Severe Sepsis and Septicemia Children” at King Chulalongkorn Memorial Hospital (KCMH) during 1 June 2012 and 28 February 2014 was used to compare percentage of adherence across the three approaches.
Results
Of 28 components extracted from the review, 10 were identified by the national experts through the Modified Delphi as feasible whereas 8 were identified as clinically important. Thirty-one severe sepsis patients (48.39% male, median age 3.4 years) were reviewed. Sepsis mortality was 9.7%, a significant reduction from 19% and 42% in 2010 and 2007, respectively. Based on the complete adherence criteria, the percent adherence varied from 60.71% to 89.29% (overall mean 76.84%), with lower adherence in the dead than the survived cases (73.81% vs 77.17%; p = 0.55). The percent adherence varied by criteria used: 69.35%, 76.84%, and 84.52% for clinical importance, complete, and feasibility criteria, respectively.
Conclusion
Adherence determination based on selected clinical importance alone might result in an incorrectly estimated clinical benefit of EGDT guidelines, especially in a resource-limited setting. Both clinical importance and feasibility should be integrated into the development of adherence assessment criteria.
Citation: Saetae T, Pongpirul K, Samransamruajkit R (2019) Assessment of early goal-directed therapy guideline adherence: Balancing clinical importance and feasibility. PLoS ONE 14(3): e0213802. https://doi.org/10.1371/journal.pone.0213802
Editor: Yan Li, Cleveland Clinic, UNITED STATES
Received: November 2, 2018; Accepted: February 28, 2019; Published: March 15, 2019
Copyright: © 2019 Saetae et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: This study received funding support from the National Research Council of Thailand. The funding body did not involve in the study design, data collection, data analysis, data interpretation, or manuscript preparation.
Competing interests: The authors have declared that no competing interests exist.
Abbreviations: ARISE, Australasian Resuscitation in Sepsis Evaluation; ARDS, Acute Respiratory Distress Syndrome; CVP, Central Venous Pressure; ECMO, Extracorporeal Membrane Oxygenation; EGDT, Early Goal-Directed Therapy; ED, Emergency Department; ICU, Intensive Care Unit; IVIg, Intravenous Immunoglobulin; KCMH, King Chulalongkorn Memorial Hospital; ProCESS, Protocolized Care for Early Septic Shock; ProMISe, Protocolised Management in Sepsis; ScvO2, Central Venous Oxygen Saturation; SD, Standard Deviation
Introduction
Severe sepsis and septic shock are associated with significant morbidity and mortality [1, 2]. Early goal-directed therapy (EGDT)—a strategy for hemodynamic optimization—has been advocated in clinical practice for sepsis management [2–7]. The Surviving Sepsis Campaign was introduced in 2004 and later updated in 2008 and 2012, covering management of adult and pediatric patients with severe sepsis and septic shock [8, 9]. Unfortunately, many recommendations were based on low-quality adult-focused evidence and expert consensus [10]. Nonetheless, the guideline has been underused; for instance, only 7% of the emergency physicians routinely implemented adult EGDT, based on a survey of 30 academic tertiary care hospitals in the US [11]. Barriers to guideline implementation included a critical shortage of nursing staff, problems in obtaining central venous pressure (CVP) monitoring, and challenges in early identification of patients with sepsis [12, 13]. The other factors were the lack of adequate time and staff, physical space in the emergency department (ED), communication with medical specialties, and identifying appropriate patients.
The negative findings of the ProCESS trial [14], the ARISE study [15], as well as the ProMISe study [16] on the effectiveness of EGDT may not fully support the implementation of a standardised protocol for dynamic care process for adult patients. However, it should be noted that protocol-based care is not just a collection of clinically effective components but a series of inter-related interventions. Although assessing adherence to a complex guideline is challenging, these studies included only cases with full adherence to the guideline defined based on some unempirical adherence criteria.
As high-quality studies usually were conducted in a controlled setting with a full resource, the generalisability of the findings to less feasible settings was unquestionably limited. While information on the protocol adherence in the three major trials was presented in the supplementary appendix of the published articles, some significant discrepancies of compliances between both trials were noted but the relevant discussion was limited [14–16]. It would be unfair for institutions in resource-limited areas that could have benefited from ‘partial’ implementation of the guideline if only the findings from the major studies were used. In the real-life setting, both clinical importance and feasibility of the guideline components should be addressed.
Variation of adherence determination across studies exists whereas the three recent trials contained similar components (Table 1). For example, Mikkelsen et al used only ScvO2 measurement and achievement of hemodynamic goals as main outcome variables to identify factors associated with not initiating EGDT in emergency department [17]. Another study by Crowe et al introduced an extensive list of adherence criteria [18] to assess the effect of EGDT on mortality. Regardless of the negative findings from the modified version, the EGDT for sepsis has still been widely accepted.
Implementation feasibility of each guideline component was first addressed by O’Neill et al [19]. Seven core components of adult EGDT guideline were assessed for implementation difficulty in a community-based setting. Using percent adherence as the measure, arterial line placement, ScvO2 measurement were the most difficult elements.
Consequently, it was not uncommon to see a “simplified” or “reduced” version of EGDT be implemented in many resource-limited institutions whereas evidence on whether such approach offered comparable outcomes has been limited, especially in pediatric patients. Finding from a prospective cohort study by Sankar et al suggested that even intermittent (rather than continuous) ScvO2 monitoring could still reduce the mortality rate and improve organ dysfunction [20], which was later supported by the recent meta-analysis [21].
It could be assumed that ScvO2 monitoring was one of the critical EGDT components that could be modified when feasibility is of concern. However, whether this concept can be applied to the other EGDT components is still unclear. Empirical evidence on assessing the balance between clinical importance and feasibility of each EGDT component is essential. We synthesized adherence criteria from the pediatric EGDT sepsis guidelines, determined the feasibility of each guideline components, and comparatively assessed the guideline adherence of the care provided to the patients at our institution.
Materials and methods
Synthesis of adherence criteria
A panel of five pediatric critical care experts was asked to discuss the EGDT guideline of the Surviving Sepsis Campaign 2012 [9] and selected literature on guideline compliance [14–19]. Finally, a list of key components was produced. EGDT components that were conceptual and/or can be implemented at any time point were classified as ‘general’ whereas the other components were ‘sequential’ components.
Feasibility determination
A modified Delphi technique was used to determine the feasibility of each guideline component. Feasibility was defined as the likelihood of actual implementation perceived by the clinicians of a specific setting. This can be affected by organizational factors such as the availability of essential equipment and healthcare professional factors such as inadequate skill for central line insertion.
Then, two rounds of the survey were conducted among 20 pediatric pulmonary & critical care specialists. They were regarded as clinical experts in the treatment of severe sepsis and septic shock in children and therefore should be able to identify the most feasible components of the EGDT sepsis guideline. Their responses in the first round were analysed in order to come up with an anonymous summary, which was presented in the second round of the survey.
The questionnaire contained the 28 items identified by the experts as described above. Each respondent was asked to respond to the question “Do you agree that each following items comply in your center?,” using 5-point Likert scale (1 strongly disagree; 2 disagree; 3 neither agree or disagree; 4 agree; 5 strongly agree).
Exploratory EGDT adherence assessment at an institution
We defined the ten most agreeable components as feasible and all eight components of ProCESS, ARISE, and ProMISe studies as clinically important. Medical records of 31 randomly selected cases (one case per week for every other week) of severe sepsis and septic shock children at King Chulalongkorn Memorial Hospital (KCMH) during 1 June 2012 to 28 February 2014 were reviewed to assess the adherence to EGDT guideline based on the complete, feasibility, and clinical importance criteria.
This study was part of the “Clinical effectiveness of the utilization of bundled care for severe sepsis and septic shock in children at King Chulalongkorn Memorial Hospital” project, which was approved by Journal Research Ethics Committes (JREC), Bangkok, Thailand (JREC 015/55).
Results
Synthesis of adherence criteria
The 28 components were divided into 18 general and 10 sequential components (Table 2). All the extracted components from EGDT guideline were listed with the agreement score (mean +/- SD) in the modified Delphi rounds in S1 Table. The changes of means across the two rounds of Modified Delphi technique reflected the extent to which their respondent groups modified their responses to each of the factors whereas final interpretation was made using in the second round.
Feasibility determination
The top ten most feasible components were choices of initial fluid resuscitation (S1); the dose of fluid bolus (S2); the timing of broad-spectrum antibiotics given (S7); strategy for patients with ARDS (G1); hydrocortisone use (S8); crystalloid use as initial fluid resuscitation (G6); site of the central venous catheter (G2); fresh frozen plasma (G3), platelet (G4), and red blood cell transfusion (G5). The ten least feasible components included lactate and ScVO2 level at 6 hours after treatment (S10); maximum dose of fluid bolus (S6); keeping lactate level < 4 mmol/L (G13); lactate evaluation (G14); ScVO2 measurement (G15); renal replacement therapy when indicated (G16); ECMO when indicated (G17); starting inotrope since 2nd dose of fluid resuscitation (S4); IVIg usage (G18); maximum dose of dopamine (S6).
Exploratory EGDT adherence assessment at an institution
There were 15 male and 16 female patients with median age of 3.4 years (Interquartile Range: 0.7 to 11.8). Twenty-five patients survived, resulting in 9.7% mortality.
Adherence to all 28 items in each case at our institution was shown in S2 Table. For each of the patient, the adhered components were shaded. Percent adherence was calculated by dividing the number of shaded cells by the number of total cells. The row was sorted by percent adherence, from lowest to highest, with the three dead patients listed at the top. None of the patients had perfect adherence. The percent adherence varied from 60.71% to 89.29% (overall mean 76.84%), with insignificantly lower adherence in the dead than the survived cases (73.81% vs 77.17%; p = 0.5514).
Ten perfectly adhered (100%) components included the choice of initial fluid resuscitation (S1); maximum dose of fluid bolus (S3); hydrocortisone use (S8); strategy for the patient with ARDS (G1); platelet transfusion (G4); red blood cell transfusion (G5); dobutamine use (G11); renal replacement when indicated (G16); ECMO when indicated (G17); and immunoglobulin use (G18). The five least adhered components were central venous catheter insertion within one hour (G9; 26%); timing of inotropic drug (S4; 29%); position of central venous catheter (G2; 39%); arterial line insertion (G12; 45%); lactate should be < 4 mmol/L (G13; 52%); lactate evaluation (G14; 52%). Significantly more general components adhered than sequential components (81.8% vs 68.1%). The percent adherence varied by criteria used: 69.35%, 76.84%, and 84.52% for clinical importance, complete, and feasibility criteria, respectively. Adherence seemed to be insignificantly lower among the dead than the survived cases across all criteria (Table 3, Fig 1). The detailed analysis of adherence based on the feasibility and clinical important criteria were presented in S3 and S4 Tables.
Discussion
To our knowledge, our work is the first attempt that used a systematic approach to explore details of complex guideline for adherence in children with sepsis. The panel of experts helped to classify the 28 key components, extracted from the literature review, into feasible and clinically important ones. Given the non-representativeness of our experts, these components were used only for the exploration of adherence assessment in this study. Percent adherence assessed by various criteria was calculated, based on the data from a tertiary hospital in Thailand. Findings from our study suggested potential impact of criteria on the assessment of EGDT adherence. Also, even partial adherence to EGDT guideline might still contribute to better outcomes, regardless of the criteria used.
We explored the feasibility of many more EGDT components than the previous study by O’Neill et al (28 vs 7 components). In their study, arterial line insertion, CVP measurement, and ScvO2 monitoring were the least adhered components (42%, 27%, and 15% adherence, respectively [19]. Our study revealed similar findings (45% adherence to arterial line insertion) whereas higher 84% adherence to CVP measurement and ScvO2 monitoring at our facility might reflect the effect of setting (ED vs ICU).
Despite negative effect of EGDT on mortality in the major trials [14–16], a significant reduction of mortality at our site from 42% in 2007 to 19% in 2010 (p<0.02) [22] and 9.7% in this study still supported the clinical benefit of EGDT, even when partially implemented. However, many other factors could contribute to the reduction of mortality so the direct clinical benefit of EGST could not be inferred from our data. Based on the adherence criteria used by ProCESS, ARISE, and ProMISe studies, 94% (29/31) of our patients would have been excluded, suggesting that including only fully adhered cases might lead to potentially incorrect estimation of EGDT effect on clinical outcomes in the real-life setting.
The incremental gain from EGDT implementation might be relatively small in fully equipped settings with a high standard of care, as suggested by negative findings from the major trials [14–16]. One limitation of these well-designed clinical trials was the exclusion of partially adhered cases. However, findings from our study suggested that a partially implemented EGDT might still improve clinical outcomes, at least in a developing country like Thailand.
To deal with imperfect adherence in real life setting, a balanced determination between clinically important and feasible components must be carefully considered using prioritization approaches presented in Table 4. In the ideal setting, all the 28 components must be fully implemented. Otherwise, the two clinically important and feasible components (G5 and S2) must be done. Next, barriers to implementing the other six clinically important components (G8, G9, G11, G15, S9, S10) should be removed. When all clinically important components are fully adhered, the eight feasible-yet-less important components (G1, G2, G3, G4, G6, S1, S7, S8) are encouraged. As feasibility is context-specific, each institution must identify feasible components in order to come up with the prioritized opportunity for improvement of EGDT adherence.
Conclusions
Adherence determination based on selected clinical importance alone might result in an incorrectly estimated benefit of clinical guideline, especially in a resource-limited setting. This pitfall of measurement may confound the effect of EGDT sepsis guideline on clinical outcomes. Both clinical importance and feasibility should be integrated into the development of adherence assessment criteria.
Supporting information
S1 Table. Two-Round modified Delphi on feasibility of EGDT components.
https://doi.org/10.1371/journal.pone.0213802.s001
(DOCX)
S2 Table. Adherence to EGDT components at King Chulalongkorn Memorial Hospital.
https://doi.org/10.1371/journal.pone.0213802.s002
(DOCX)
S3 Table. Adherence, using feasibility criteria in King Chulalongkorn Memorial Hospital.
https://doi.org/10.1371/journal.pone.0213802.s003
(DOCX)
S4 Table. Adherence, using Clinical Importance criteria in King Chulalongkorn Memorial Hospital.
https://doi.org/10.1371/journal.pone.0213802.s004
(DOCX)
S1 File. King Chulalongkorn Memorial Hospital EGDT compliance data.
https://doi.org/10.1371/journal.pone.0213802.s005
(XLS)
Acknowledgments
We are deeply grateful to pediatric pulmonary & critical care specialists for identification the most feasible components of the EGDT sepsis guideline. We would also like to extend our sincere thanks to pediatric intensive care unit staff, ward staff and residents from Department of Pediatrics, Faculty of Medicine, Chulalongkorn University for their kindly help to collect the patients’ data.
References
- 1. Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR. Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Critical care medicine. 2001;29(7):1303–10. pmid:11445675
- 2. Jones AE, Focht A, Horton JM, Kline JA. Prospective external validation of the clinical effectiveness of an emergency department-based early goal-directed therapy protocol for severe sepsis and septic shock. Chest. 2007;132(2):425–32. pmid:17573521
- 3. Rivers E, Nguyen B, Havstad S, Ressler J, Muzzin A, Knoblich B, et al. Early goal-directed therapy in the treatment of severe sepsis and septic shock. The New England journal of medicine. 2001;345(19):1368–77. pmid:11794169
- 4. Trzeciak S, Dellinger RP, Abate NL, Cowan RM, Stauss M, Kilgannon JH, et al. Translating research to clinical practice: a 1-year experience with implementing early goal-directed therapy for septic shock in the emergency department. Chest. 2006;129(2):225–32. pmid:16478835
- 5. Shapiro NI, Howell MD, Talmor D, Lahey D, Ngo L, Buras J, et al. Implementation and outcomes of the Multiple Urgent Sepsis Therapies (MUST) protocol. Critical care medicine. 2006;34(4):1025–32. pmid:16484890
- 6. Kortgen A, Niederprum P, Bauer M. Implementation of an evidence-based "standard operating procedure" and outcome in septic shock. Critical care medicine. 2006;34(4):943–9. pmid:16484902
- 7. Micek ST, Roubinian N, Heuring T, Bode M, Williams J, Harrison C, et al. Before-after study of a standardized hospital order set for the management of septic shock. Critical care medicine. 2006;34(11):2707–13. pmid:16943733
- 8. Dellinger RP, Levy MM, Carlet JM, Bion J, Parker MM, Jaeschke R, et al. Surviving Sepsis Campaign: international guidelines for management of severe sepsis and septic shock: 2008. Critical care medicine. 2008;36(1):296–327. pmid:18158437
- 9. Dellinger RP, Levy MM, Rhodes A, Annane D, Gerlach H, Opal SM, et al. Surviving sepsis campaign: international guidelines for management of severe sepsis and septic shock: 2012. Critical care medicine. 2013;41(2):580–637. pmid:23353941
- 10. Kawasaki T. Update on pediatric sepsis: a review. Journal of Intensive Care. 2017;5(1):1–12.
- 11. Jones AE, Kline JA. Use of goal-directed therapy for severe sepsis and septic shock in academic emergency departments. Critical care medicine. 2005;33(8):1888–9; author reply 9–90. pmid:16096485
- 12. Carlbom DJ, Rubenfeld GD. Barriers to implementing protocol-based sepsis resuscitation in the emergency department—results of a national survey. Critical care medicine. 2007;35(11):2525–32. pmid:18075366
- 13. Nguyen HB, Lynch EL, Mou JA, Lyon K, Wittlake WA, Corbett SW. The utility of a quality improvement bundle in bridging the gap between research and standard care in the management of severe sepsis and septic shock in the emergency department. Academic emergency medicine: official journal of the Society for Academic Emergency Medicine. 2007;14(11):1079–86.
- 14. Process Investigators, Yealy DM, Kellum JA, Huang DT, Barnato AE, Weissfeld LA, et al. A randomized trial of protocol-based care for early septic shock. The New England journal of medicine. 2014;370(18):1683–93. pmid:24635773
- 15. Arise Investigators, Anzics Clinical Trials Group, Peake SL, Delaney A, Bailey M, Bellomo R, et al. Goal-directed resuscitation for patients with early septic shock. The New England journal of medicine. 2014;371(16):1496–506. pmid:25272316
- 16. Mouncey PR, Osborn TM, Power GS, Harrison DA, Sadique MZ, Grieve RD, et al. Trial of Early, Goal-Directed Resuscitation for Septic Shock. The New England journal of medicine. 2015.
- 17. Mikkelsen ME, Gaieski DF, Goyal M, Miltiades AN, Munson JC, Pines JM, et al. Factors associated with nonadherence to early goal-directed therapy in the ED. Chest. 2010;138(3):551–8. pmid:20173053
- 18. Crowe CA, Mistry CD, Rzechula K, Kulstad CE. Evaluation of a modified early goal-directed therapy protocol. The American journal of emergency medicine. 2010;28(6):689–93. pmid:20637384
- 19. O'Neill R, Morales J, Jule M. Early goal-directed therapy (EGDT) for severe sepsis/septic shock: which components of treatment are more difficult to implement in a community-based emergency department? The Journal of emergency medicine. 2012;42(5):503–10. pmid:21549546
- 20. Sankar J, Sankar MJ, Suresh CP, Dubey NK, Singh A. Early goal-directed therapy in pediatric septic shock: comparison of outcomes "with" and "without" intermittent superior venacaval oxygen saturation monitoring: a prospective cohort study*. Pediatric critical care medicine: a journal of the Society of Critical Care Medicine and the World Federation of Pediatric Intensive and Critical Care Societies. 2014;15(4):e157–67.
- 21. Angus DC, Barnato AE, Bell D, Bellomo R, Chong C-R, Coats TJ, et al. A systematic review and meta-analysis of early goal-directed therapy for septic shock: the ARISE, ProCESS and ProMISe Investigators. Intensive care medicine. 2015;41(9):1549–60. pmid:25952825
- 22. Samransamruajkit R, Uppala R, Pongsanon K, Deelodejanawong J, Sritippayawan S, Prapphal N. Clinical outcomes after utilizing surviving sepsis campaign in children with septic shock and prognostic value of initial plasma NT-proBNP. Indian journal of critical care medicine: peer-reviewed, official publication of Indian Society of Critical Care Medicine. 2014;18(2):70–6.