Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The Prevalence of Compassion Fatigue and Burnout among Healthcare Professionals in Intensive Care Units: A Systematic Review

  • Margo M. C. van Mol ,

    m.vanmol@erasmusmc.nl

    Affiliation Department of Intensive Care Adults, Erasmus MC University Medical Center, Rotterdam, The Netherlands

  • Erwin J. O. Kompanje,

    Affiliation Department of Intensive Care Adults, Erasmus MC University Medical Center, Rotterdam, The Netherlands

  • Dominique D. Benoit,

    Affiliation Department of Intensive Care, Medical Unit Ghent University Hospital, Ghent, Belgium

  • Jan Bakker,

    Affiliation Department of Intensive Care Adults, Erasmus MC University Medical Center, Rotterdam, The Netherlands

  • Marjan D. Nijkamp

    Affiliation Faculty of Psychology and Educational Sciences, Open University of the Netherlands, Heerlen, The Netherlands

Abstract

Background

Working in the stressful environment of the Intensive Care Unit (ICU) is an emotionally charged challenge that might affect the emotional stability of medical staff. The quality of care for ICU patients and their relatives might be threatened through long-term absenteeism or a brain and skill drain if the healthcare professionals leave their jobs prematurely in order to preserve their own health.

Purpose

The purpose of this review is to evaluate the literature related to emotional distress among healthcare professionals in the ICU, with an emphasis on the prevalence of burnout and compassion fatigue and the available preventive strategies.

Methods

A systematic literature review was conducted, using Embase, Medline OvidSP, Cinahl, Web-of-science, PsychINFO, PubMed publisher, Cochrane and Google Scholar for articles published between 1992 and June, 2014. Studies reporting the prevalence of burnout, compassion fatigue, secondary traumatic stress and vicarious trauma in ICU healthcare professionals were included, as well as related intervention studies.

Results

Forty of the 1623 identified publications, which included 14,770 respondents, met the selection criteria. Two studies reported the prevalence of compassion fatigue as 7.3% and 40%; five studies described the prevalence of secondary traumatic stress ranging from 0% to 38.5%. The reported prevalence of burnout in the ICU varied from 0% to 70.1%. A wide range of intervention strategies emerged from the recent literature search, such as different intensivist work schedules, educational programs on coping with emotional distress, improving communication skills, and relaxation methods.

Conclusions

The true prevalence of burnout, compassion fatigue, secondary traumatic stress and vicarious trauma in ICU healthcare professionals remains open for discussion. A thorough exploration of emotional distress in relation to communication skills, ethical rounds, and mindfulness might provide an appropriate starting point for the development of further preventive strategies.

Introduction

An Intensive Care Unit (ICU) can be full of stressful situations for patients, relatives and healthcare professionals. A growing body of evidence suggests that burnout among ICU nurses [1] and ICU physicians [2] is a remarkable result of the demanding and continuously high-stress work environment. It has been suggested that ICU professionals could be emotionally affected by end-of-life issues [3], ethical decision making [4], observing the continuous suffering of patients [5], disproportionate care or medical futility [6], miscommunication [7], and demanding relatives of the patients [8]. Moreover, many patients in the ICU lack decision-making capacity; therefore, the healthcare professionals depend on communication with relatives for decision making, which can complicate the communication process [9]. In addition, the ICU work environment has become increasingly technical, which requires extended skills in advanced life sustaining medical therapies.

These aspects may lead to moral distress or avoidance behavior [10], and consequently increase emotional distress. This job stress can have a negative effect on an individual´s enjoyment of work. It might even result in long-term absenteeism or a threatening brain and skill drain if the professionals leave their jobs prematurely to preserve their own health, ultimately leading to economic burdens [11]. In addition, these processes may even reduce the quality of care for patients and relatives [12].

Work-related stress with the accompanying emotions provoked specifically in ICU is well documented over the previous years [1215]. The high-stakes, high stress environment that ICU professionals practice in, are incredibly demanding intellectually, physically, and emotionally. Both physical warning signs (such as headaches, sleeping disturbances, low back pain and stomach problems) and mental responses (such as irritability or hostility, loss of concentration, low self-confidence and emotional instability) could indicate individual stress reactions [1618]. However, these are non-specific symptoms which cannot depict the origin of stress and subsequently constrain effective coping mechanisms or the developing of preventive strategies for this ongoing process.

Stress reactions are the first indication of the presence of an emotional trauma. These reactions are defined as a set of conscious and unconscious behaviors, cognitions and emotions, to deal with the stressor [19]. In the research field of traumatization, which focuses on the process and origin of developing stress symptoms, there is a distinct difference in primary and secondary traumatization [20]. Primary traumatization is the process that can occur from having persistent, intense and direct contact with a traumatic event, such as a situation of war, violence or sexual abuse. This process can lead to posttraumatic stress disorder [21]. Secondary traumatization is the process via an indirect exposure, which may develop from hearing about a traumatic event or caring for someone who has experienced a traumatic event. This process may lead to burnout, compassion fatigue, vicarious trauma, and secondary traumatic stress [20,22].

Burnout

Burnout (BO), an emotional and behavioral impairment that results from the exposure to high levels of occupational stress, has been described as a combination of three factors: emotional exhaustion, depersonalization and personal accomplishment [23]. Individuals who are at risk of a BO, usually have some level of perfectionism and feel guilty if they do not perform as well as they would like to. This goal-oriented mindset could cause an extreme imbalance in work-related situations and might lead to long-term absenteeism. Although BO can be severe, it has also been viewed as a contagious syndrome [24]. The social context, and especially the interaction with complaining colleagues, might play an important role in the development of BO. Furthermore, BO has been mentioned as a fashionable diagnosis because a clear and standardized definition is lacking [8,25]. A substantial number of studies on BO in a broad range of professions were published and a peak in media coverage occurred since the first description [26]. However, since its origination, the operationalization and measurement of BO have differed enormously.

Compassion Fatigue

Compassion fatigue (CF) has been defined as a state of physical or psychological distress in caregivers, which occurs as a consequence of an ongoing and snowballing process in a demanding relationship with needy individuals [27,28]. It has been associated with a ‘helper syndrome’ that results from continuous disappointing situations and leads to moral distress [29]. CF was described for the first time in the early nineties as the loss of compassion in result of repeated exposure to suffering during work [30]. A little later, CF was defined as secondary traumatic stress (STS) resulting from a deep involvement with a primarily traumatized person, because of the “more friendly framing” [29]. From this time on, CF has interchangeably been referred to as secondary- and posttraumatic stress (S/PTS) or vicarious trauma (VT) [2729,31]. CF consists of two parts. The first part contains issues such as exhaustion, frustration, and depression, typical associated with BO. The second part is the negative feeling driven by concerns such as hyper-vigilance, avoidance, fear and intrusion, which are also characteristics of S/PTS.

Relationships of Concepts

Although BO is closely related to CF, the underlying mechanism most likely differs. BO is believed to be related to occupational factors, such as workload, autonomy, and rewarding, rather than personal relationships [32]. In contrast, an inability to engage, or enter into a caring relationship, is considered to be the core of CF [33]. What becomes more and more apparent is the level of complexity in the various concepts and mutual relationships. Besides the already mentioned interchangeably usage of CF and STS, a significant positive correlation between CF and BO was found in some studies, suggesting an overlay in one or more of the components of these phenomena [20,22]. According to Elkonin and Lizelle, BO illustrates the end result of traumatic stress in the professional life of the caregiver and could be an extreme case of CF [22]. Conversely, Sabo suggested BO as a pre-condition for CF [33], and Aycock proposed that CF replaces the outdated notion of BO in describing the phenomenon in oncology nurses [34]. This review explores all mentioned concepts, taken together in this study as emotional distress, because of the same range of causes, coping mechanisms, and consequences in the field of traumatization.

Aim of the Study

The main purpose of this review was to evaluate the literature on emotional distress among professionals in the ICU according the PRISMA method, with an emphasis on the prevalence of burnout and compassion fatigue. We enhanced some new knowledge in this field to assess the current literature precisely and compare the measuring instruments and the results of the studies. Furthermore, while the sometimes devastating personal and organizational consequences of BO and CF have been published previously, very few studies have addressed the effectiveness of preventive strategies. This review aims to provide a starting point for clinical practice guideline developers and summarizes interventions to prevent the negative consequences of emotional distress among healthcare professionals in the ICU. The following research questions have been addressed:

  1. What is the prevalence of compassion fatigue and burnout among healthcare professionals in the ICU?
  2. Which preventive strategies have been successfully applied to reduce emotional distress among ICU professionals?

Methods

A systematic review of the scientific literature was conducted to obtain original articles for appraisal. Pre-determined search strategies were followed and quality criteria were applied as guidelines to conduct the review process [35]. The current study was performed in accordance with the PRISMA statement (S1 PRISMA 2009 Checklist) [36]. This review study did not need ethical approval nor was individual consent needed.

Search Strategy

A systematic search in the computerized databases of Embase, Medline OvidSP, Cinahl, Web-of-science, PsychINFO, PubMed publisher, Cochrane and Google Scholar has been performed. The following Medical Subject Headings (MeSH) were used: burnout, empathy and fatigue. This search was supplemented with compassion fatigue and secondary traumatic stress as free text words. The Boolean indicator ‘AND’ was used to select the studies applied to the ICU healthcare professionals. All terms were tailored to the thesaurus of each database, the complete search strategy is recorded in the protocol (S1 Table). Local unpublished surveys, unpublished reports and academic theses were not included. All references were retrieved, organized and stored with EndNote X7.1 version 17.

Eligibility Criteria

In the first round, the references from each database were screened by the title and abstract for relevancy. We included studies that 1) dealt with the prevalence, as described in the article or calculated from the presented data, or 2) described an intervention on BO, CF, VT or S/PTS. All studies were set within an ICU, Critical Care Unit, Neonatology Intensive Care Unit or Pediatric Intensive Care Unit, and were applicable to healthcare professionals i.e. nurses or physicians. We were particularly interested in effects of the interventions on the professional quality of life of the individual workers. We chose 1992 as the initial search year because the first article on CF in nurses was published that year [30], the search included original articles written in the English language all years through 30 June 2014. We excluded studies on coping with work stress and the causes and consequences of BO.

After the full text was read in the second selection round, the articles were limited to the prevalence presented as percentages or numbers of BO, CF, VT or S/PTS and intervention studies in which respondents are being pre- and post-tested or compared in two groups in different regimes. Finally, the included articles were manually checked for new references until no further studies were identified.

Qualitative Data Extraction

A set of quality criteria was developed to assess the methodological soundness [27,35], see Table 1. The total study quality has been computed as 12.5% for each positive scored criterion, at least six of eight criteria should be applicable.

thumbnail
Table 1. Set of criteria used to appraise the study quality.

https://doi.org/10.1371/journal.pone.0136955.t001

Three of the authors (MvM, MN and EK) independently extracted qualitative information from each article. The following information was determined: ´bibliographic information´ (e.g., first author, year of publication), ´aim of the study´, ´definition of concepts´, ´setting´ (e.g., general or academic hospital), ´population and sample size´ (e.g., nurses or physicians), ´method design´, ´measuring instrument, validation and reliability´, and ´prevalence´. Disagreements between the three reviewers were discussed until a consensus was reached.

Results

The review process, which is illustrated in Fig 1, began with 2580 references retrieved from the electronic databases. Deleting duplicate references (n = 1620) and a manual search (n = 3) resulted in 136 relevant publications after the first selection round. Subsequently, the references only published as an abstract (n = 39) or non English (n = 30) were removed. A few studies were excluded because prevalence could not be calculated from the presented data [3739] or effects of the intervention were not measured [17]. Finally, a sample of 30 eligible articles on the prevalence of emotional distress and 10 associated intervention studies were appraised as methodologically sound and included for extensive review [20,22,4077]. The assessment of all articles which were read in full text, as indicated in additional file S2, had an excellent inter-rater agreement using Cohen´s kappa (k = 0.912).

thumbnail
Fig 1. Flowchart review process.

An adapted PRISMA flowchart of the total review process on the prevalence of compassion fatigue and burnout among healthcare professionals in the intensive care unit.

https://doi.org/10.1371/journal.pone.0136955.g001

An overview of the included publications, with the study characteristics such as setting, sample size, sample characteristics and quality assessment, is provided in Table 2. Most of the studies were conducted in Europe and North-America (70%), nine studies were conducted in an academic or tertiary hospital setting (22.5%) and other study settings included small, large or a mix of hospital samples. The number of respondents varied between 25 and 3,052; in most studies female respondents were over-represented. The response rates varied between 24.8% [50] and 98.8% [77]. In Table 3 all the sample characteristics are summarized.

thumbnail
Table 2. An overview of the included articles with the study characteristics.

https://doi.org/10.1371/journal.pone.0136955.t002

thumbnail
Table 3. The sample characteristics of the included studies.

https://doi.org/10.1371/journal.pone.0136955.t003

Prevalence

Studies on the prevalence of CF and S/PTS in the ICU were less frequent than studies of BO, as shown in Table 4, and only one study mentioned VT [22]. The Professional Quality of Care (ProQOL) questionnaire, which was used in some of the reviewed studies, was developed to measure both CF and BO [78]. Additionally, this questionnaire distinguishes also the positive effects of caring, referred to as compassion satisfaction. Over time, this tool has been validated in various healthcare work environments and has proven to be reliable and feasible for medical staff [27,79]. According to the ProQOL-revisited V, two different studies showed 7.3% [20] and 40% [22] of the respondents who scored high on CF compared with 1.2% and 23%, respectively, who had severe BO. Two other studies, which were using the ProQOL, measured a 0% high risk for BO, as well as S/PTS as stated by the authors [57,76]. However, succeeding studies described the prevalence of S/PTS as 17%, using the Posttraumatic Diagnostic Scale [44], and 38.5% using the Davidson Trauma Scale [72]. Additionally, 24% of 230 full-time working ICU nurses in a university hospital experienced some symptoms of S/PTS, such as nightmares, according to results from the Post Traumatic Stress Syndrome 10 Questions Inventory, compared to 14% in general nurses and 29% in the control group [60].

thumbnail
Table 4. Amount of articles on the prevalence of emotional distress and prevalence range.

https://doi.org/10.1371/journal.pone.0136955.t004

BO is mostly assessed by the Maslach Burnout Inventory (MBI), according to some authors as the standard tool for measuring the severity of BO [2,41,66]. The MBI is a highly reliable and validated 22-item self-report questionnaire that evaluates the three domains of BO in independent subscales: emotional exhaustion, depersonalization and personal accomplishment. The MBI was predominately used (n = 22, 70.0%), including the French (n = 4), the Portuguese (n = 2), the Chinese (n = 2), the Korean (n = 1) and the German (n = 1) validated versions, in addition to the original English version.

The reported prevalence rate of BO in the ICU, measured with the MBI, varied from 14.0%, after a preventive intervention [65], to 70.1% when BO was defined as a high score on only one subscale [41]. The latter study also stated that the prevalence would be 17.7% if BO had been defined as a high score on the combined subscales. Similarly, Czaja et al. reported a prevalence rate of 68.0% with BO defined as a high score on any BO symptom, and 45% for the emotional exhaustion subscale [44]. Some other studies defined a high risk for BO by a cut-off score in the emotional exhaustion subscale, leading to estimates of prevalence varying from 25.0% to 51.9% [50,51,55,67,70]; four studies defined BO by a total MBI score of > -9 and reported the prevalence in the range of 28.0% to 46.5% [46,61,64,74].

One study presented a significantly lower prevalence of BO in ICU healthcare professionals (n = 121); 14.5% in the ICU compared to 21.9% in the oncology department (n = 82), 17.5% in the operating theatre (n = 88), 17.2% in the surgical department (n = 134), and 12.4% in the medical department (n = 109) [66]. No difference for the Neonatology Intensive Care Unit or Pediatric Intensive Care Unit, with the prevalence ranging from 1.2% [20] to 41% [47], was found compared to the adult ICU, with the prevalence ranging from 16% [77] to 46.5% [46], measured with the MBI. Correspondingly, no clustering of prevalence rates was identified for specific hospital settings (i.e., an academic or regional hospital), professional role (i.e., doctors or nurses), or number of respondents in the study group.

A summary of the diverse measurement instruments, cut-off scores and reported prevalence, are shown in Table 5.

thumbnail
Table 5. A summary of the diverse measuring instruments, cut-off scores and found prevalences.

https://doi.org/10.1371/journal.pone.0136955.t005

The included studies reported a broad range of variables related to emotional distress, see Table 6. Work environment [22,46,68,74], professional role [61,67] and conflicts [46,64] were significantly and positively related to the measured phenomenon. However, some studies stated opposite results. Most confusing variable was the female sex, with an increasing [46,66] versus a decreasing [61] effect, and no significantly measured influence [42,50,52,64] on emotional distress.

thumbnail
Table 6. Relationship of a variable with emotional distress, pro and con.

https://doi.org/10.1371/journal.pone.0136955.t006

Preventive Strategies

A wide range of intervention strategies to reduce emotional distress among ICU professionals emerge from the recent literature, see Table 7. Ten studies measured the effect of an intervention, such as different intensivist work schedules [40,48], educational programs on emotional distress [45,58], improving elements of family-centered care and communication skills [56,65,71], strategies regarding personality and coping [62,63], and relaxation exercises [59,75] such as yoga and mindfulness. In addition, seven of the included studies suggested preventive strategies, varying from improving the work environment [49,55,68], focussing more on social support and individual coping strategies [54], changing team composition to include a greater number of women [61], developing teambuilding and periodic job rotation [42], and a mix of all these elements [67].

thumbnail
Table 7. Summary of the interventions on emotional distress.

https://doi.org/10.1371/journal.pone.0136955.t007

According to Quenot et al. [65], the implementation of a set of active, intensive communication strategies regarding end-of-life care in the ICU has been associated with significantly lower rates of BO after the intervention. These strategies comprised elements in the organization, (i.e., the introduction of unrestricted visiting hours and the availability of a staff psychologist for consultation on demand), communication, (i.e., daily meetings of the caregiving team with the patient and/or their family and the discussion of palliative care options), ethics, (i.e., a special section in every patient´s medical record or ethical rounds), and stress debriefings and conflict prevention. Reductions of almost 50% and 60% were reported in the relative risk of BO and depression, respectively, after some of these interventions. Another promising preventive strategy is mindfulness training. West et al. [80] measured a positive effect of 19 biweekly discussion groups, which included elements of mindfulness, reflection and shared experience, on physician well-being. Furthermore, Lederer et al. [53] mentioned a positive influence on the prevalence of a fully developed BO due to the support of a facilitator. An external psychologist provided support whenever needed in two of the five ICUs included in this study; more specifically, individuals with a high risk of BO were less likely to consult the psychologist. In contrast, peer support had no significant effect on BO [45]. Finally, educational seminars on CF increased both awareness and resources for the prevention of emotional distress in the future [58]. The participants in that study felt significantly less tense and reported being more calm and peaceful after the intervention.

Discussion

This comprehensive systematic review identified thirty studies that investigated the prevalence of BO, CF, VT or S/PTS among healthcare professionals working in ICUs. It is clear that working at an ICU correlates with a substantial risk of emotional distress, all of the included studies underscored the stressful environment in the ICU. From this perspective, it is even more strikingly to find contradictory results with lower percentages or means on BO, CF or S/PTS in the ICU compared to other wards [20,44,66,72], which is also esthablished in supplementary studies [79,81]. This anomaly might be explained through unique personal qualities, such as resilience, empathic ability, coping mechanisms or emotional intelligence, and environmental factors, such as training, mental support, organizational culture or the differences between cultures and countries.

Although the risk of emotional distress has been recognized in this review, the true magnitude of the explored phenomena remains unclear for several reasons. First, the definitions of the types of distress have been used interchangeably across studies; more specifically, CF has been measured with the same subscale of the ProQOL as S/PTS [20,22,76]. One of the key elements in the ProQOL model is the empathic ability of the caregivers and the therapeutic relationship with clients. However, a profound analysis has shown that STS and CF really differ regarding their content validity [82]. In contrast to STS, which refers to symptoms related to a process of indirect traumatization, CF is stressing the diminished sympathy to someone´s suffering, and the lessened desire to help in a broad context through the meaning of compassion [20,83]. The loss of this compassionate energy is also mentioned in a conceptual analysis of CF, in which is stated that the synonymous use of CF with STS is far removed from Joinson´s original meaning [28]. In addition, Sabo suggested that the binary dimension of CF in the ProQOL (i.e., you either have it or not), is not congruent human nature, which is characterized by gradual responses similar to slightly, moderately or severely. More fundamentally, the model also failed to clearly conceptualize empathy, thus making it difficult to understand the background of CF [33]. Therefore, Coetzee and Klopper [28]p237 distinguished CF again as a loss of the nurturing ability that is vital to compassionate care. The essential issue of the caring professionals is to deliver themselves; being present and empathic. If this process stagnates, the emotional price of caring can become a burden in personal life, manifested by emotional distress such as CF.

The Secondary Traumatic Stress Scale is the only instrument that is designed to assess the symptoms of STS by a 17-item Likert scale [18], however, this questionnaire has not been used among ICU professionals. The ProQOL has been used in many healthcare settings, is profoundly tested, and marked as a valid and reliable instrument [84]. However, the STS/CF subscale is fundamentally based on the concept of STS, with items explicitly pointing at traumatic stress reactions such as a startle reflex, intrusive and frightening thoughts, re-experiencing situations, and avoidance. To sum up, there is no measurement instrument to assess CF in the meaning of a lost ability to care.

Second, the reported prevalence of emotional distress differed based on the applied measurement instruments. The ProQOL seemed incapable of detecting a risk for severe burnout, which is illustrated with prevalence rates around zero [20,57,76], in comparison, the prevalence with the MBI ranged from 14.0% up to 70.1%. Meadors et al. provided a valuable and comprehensive overview of the mental trauma literature in the non-adult ICUs, and found a low prevalence of CF (7.3%) and BO (1.2%) with the ProQOL [20]. They suggested that drop out by the already over-exhausted individuals participating in the study to explain their results; this reason of self-selection bias may have a substantial role in all of the studies on this topic. In contrast to these results, another study among 162 intensivists working at a paediatric intensive care in Argentina described a 41% BO prevalence measured by the MBI [47], and a study of 173 nurses working at a tertiary children´s hospital found that 68% of respondents had at least one BO symptom [44]. In short, the MBI is characterized by a more discriminative power than the ProQOL. Nevertheless, the highest prevalence of CF, defined by the authors as such and measured by the ProQOL, was 40.0% and reported in a study of 30 registered nurses in two ICUs in South Africa [22]; a 23% prevalence of BO was found in the same study. It was stated that there was a noteworthy shortage of ICU nurses in that country, and most of the participants were not trained for nursing critically ill patients. Thus, the work environment might have been particularly stressful due to a lack of appropriate nursing skills and ICU knowledge. The highest prevalence of S/PTS, 38.5%, was measured with the Davidson Trauma Scale in a study of 26 ICU-nurses in a SARS unit in Taiwan; this group was compared to 17 critical care and 15 neurology nurses working in two non-SARS units [72]. However, a study using the ProQOL in an academic hospital with 68 nurses in the United States did not find a severe risk for S/PTS [76]. This difference might be explained partially by the extreme working conditions associated with the SARS outbreak and the difference in measuring instruments. Although the last two studies addressed relevant issues, it may be difficult to identify changeable determinants in the work setting to prevent the consequences of emotional distress.

Third, the outcome scales or cut-off points used to indicate the prevalence of burnout measured with the MBI have a wide range, as presented in Table 5. A great deal of work has been done with the MBI, both conceptualizing and measuring BO in a valid and reliable way [85]. However, it should be used uniformly, with an evaluation of all three subscales together. As shown, Czaja et al. [44] used a moderate to high score in one subscale with emotional exhaustion above 17 to establish the prevalence of BO, with 68% as a result. In contrast, Zhang et al.[77] found a prevalence of 16%, with BO defined a high score on emotional exhaustion (above 31), depersonalization (above 11), and a low score on personal accomplishment (above 42). Schaufeli and Van Dierendonk (1995) stated that caution is needed when cut-off points are used to classify the severity of BO, which could also be nation specific [86]. All in all, the prevalence might be affected by the used measuring instrument as well as the different cut-off points and subscales. Finally, the variety of research variables, i.e., whether the variables are significantly related to emotional distress in the ICU, perpetuates the lack of clarity.

Therefore, the true prevalence of BO, CF, S/PTS and VT in ICU-professionals remains open for discussion, which might emphasize the need for a ´gold standard´ which will be used in all future research. To begin, the concepts specifically related to the ICU healthcare environment have to be defined by a wide-ranging consensus committee, e.g by conducting a Delphi study. Subsequently, more agreement is needed to address the discrepancies in measurement issues, and to better investigate emotional distress with a large international quantitative observational multicenter study. Only one such study has been published to date [24], from which an impressive amount of data on burnout were already gathered in 1994. The results were reported not sooner than 2005 because they formed part of a larger study on the organizational influence on the effectiveness and efficiency of ICUs. This study is still of importance because of the focus on fundamental psychological processes, such as emotional contagion in burnout, and the relationships between variables. However, the prevalence of BO among ICU professionals might change over time and a broader view on emotional distress would be preferable.

It is highly recommended to further investigate and compare the consequences of emotional distress in the ICU in a valid comparative manner to indicate the relevance of the problem. However, cross-sectional study designs cannot reveal causal relationships between contributing variables, individual coping mechanisms or organizational preventive strategies to emotional distress. A prospective longitudinal study design would be recommended to bridge this gap. In addition, a pitfall of these approaches is the focus on questionnaires and scoring systems because of the reliance on a cut-off points intended to ´establish´ a phenomenon and socially desirable or exaggerated answers of the respondents. Besides quantitative research, in-depth semi-structured interviews are required to stress the deeper driving forces in an individual to provide more insights into the thoughts and behaviors in reaction to a stressful work environment.

To develop adequate preventive strategies for emotional distress, it is essential to know the individual´s incentive to choose a caring profession in addition to ones unconsciously chosen coping strategies to deal with the stressful work settings. Some encouraging preventive strategies to combat emotional distress in ICU professionals have been developed recently [53,65,80]. A review study of intervention programs for BO found that most of the person-directed interventions, such as cognitive behavioural training, counselling, and relaxation exercises, led to a significant reduction in BO lasting for at least 6 months after the intervention. Although the organization-directed interventions, such as primary nursing, management skills, and social support, were classified by this study as having less study evidence, they were also significantly effective [87]. Combined person- and organization-directed multifaceted interventions with refresher courses reported the best results. At this point, it might be interesting to investigate the effect of a combination of relevant and changeable determinants, such as communication skills, educational sessions in stress management, and mindfulness training for ICU professionals.

The improvement of communications skills might support the interaction with patients and relatives, and reduce conflicts with colleagues or management [7,64]. An intensive three-day training for oncologists resulted in the integration of many of the key communication skills in their daily practice, for up to 15 months post-course [88]. Furthermore, significantly more expressions of empathy were reported in this study and successively interpreted as an increase of self-efficacy. This, in turn, could enhance compassionate care and increase personal well-being. Educational sessions in stress management might expand the awareness of emotional distress and methods to apply in response to this distress [45,58,62]. The awareness of stressful situations and knowing the vital signs of BO or CF, are the first steps in maintaining a healthy work life. In a lack of awareness the ongoing devastating process may continue until a total mental or physical breakdown. Personality [39] and emotional intelligence [62], especially the meta-cognitive capacity of the individual, might provide some clues for the energy in trying to change things in the ´here and now at the bedside´ within their level of responsibility. Mindful meditation might be a source of strength for preventing the hidden effects of stress, and gives the individual healthcare professional the ability to pay attention in the present moment and respond wisely, instead of reacting later with negative feelings [89,90]. Balancing human intimacy and professional distance, and remaining appropriately present and compassionate, may be recognized as a valuable personal ability. This ability could be taught, and effectively enhanced, through self-awareness and mindful meditation which is potentially useful in promoting well-being and stress management in healthcare professionals [8991].

Strengths and Methodological Limitations

The main strengths of this review were the systematic approach and reproducible method. It was based on explicit search strategies, eight applicable databases and unambiguous criteria for selecting suitable and high-quality studies. Because randomized controlled trials or rigorous observational studies are rare in this area, a meta-analysis could not be performed [35].

Although measures in the included studies have been taken to prevent social desirability (e.g. guaranteed anonymity), the internal validity might be threatened due to self-report questionnaires. Furthermore, the Hawthorne effect could have biased the results of the reported studies. Some of these studies tried to limit this bias by explicitly not mentioning the measured concept to the respondents [44,60]. Moreover, the response rates in the very low ends, e.g. selection bias, and high ends, e.g. mandatory participation, could be questioned.

This literature review aimed to be highly sensitive in order to be as comprehensive as possible, and therefore had a lower precision. Thus, many irrelevant references were included in the beginning of the review process. This could lead to an erroneous exclusion of a relevant reference. Further, the search was limited to original articles, which suggests the potential to miss information on the topic. However, because of the focus on the prevalence rather than the causes or consequences, this approach was a justified decision. The restriction in language could also have caused an incomplete overview of the relevant studies.

As in every review, a publication bias may have occurred. Positive results are more likely to be submitted and published in scientific journals than inconclusive or negative results, and insignificant outcomes will probably not be mentioned in an abstract [92,93], accordingly putting too much emphasis on the significant mental effects of stress in the ICU. Moreover, negative or inconclusive results remain unpublished; consequently, there might be an over reported prevalence of burnout or compassion fatigue.

Conclusions

Working in the ICU environment is an emotionally charged challenge, and the emotional price of caring might become a burden for professionals’ personal lives, possibly manifested in compassion fatigue or burnout. This study adds some new viewpoints in the lack of common understanding of the theoretical constructs, which is reflected by the variously defined (and interpreted) negative outcomes of providing care in the ICU setting among the included studies. The true magnitude of the emotional distress in the ICU healthcare professionals remains unclear due to a lack of unity in measurements as well. This study also suggests that policymakers should introduce interventions to prevent the negative consequences of emotional distress. A longitudinal experimental study is needed to examine the emotional distress among ICU professionals in relation to their communication skills, educational sessions on stress management, and mindfulness. Only in this way evidence-based best practice interventions can be formulated.

Acknowledgments

We would like to thank W.M. Bramer, biomedical information specialist Erasmus MC, for his assistance in the data-gathering process.

Author Contributions

Conceived and designed the experiments: MvM EK DB JB MN. Performed the experiments: MvM EK MN. Analyzed the data: MvM EK MN. Wrote the paper: MvM EK DB JB MN.

References

  1. 1. Schaufeli WB, Keijsers GJ, Reis Miranda D (1995) Burnout, technology use, and ICU-performance. In: Organizational risk factors for job stress. Sauter SL, Murphy LR eds. APA Books, Washington pp 259–271.
  2. 2. Embriaco N, Papazian L, Kentish-Barnes N, Pochard F, Azoulay E (2007) Burnout syndrome among critical care healthcare workers. Curr Opin Crit Care 13: 482–488. pmid:17762223
  3. 3. Todaro-Franceschi V (2013) Critical care nurses' perceptions of preparedness and ability to care for the dying and their professional quality of life. DCCN 32: 184–190. pmid:23759913
  4. 4. Teixeira C, Ribeiro O, Fonseca AM, Carvalho AS (2013) Ethical decision making in intensive care units: a burnout risk factor? Results from a multicentre study conducted with physicians and nurses. J Med Ethics 40(2): 97–103. pmid:23408707
  5. 5. Todaro-Franceschi V (2013) Compassion fatigue and burnout in nursing. Enhancing professional quality of life. Springer, New York.
  6. 6. Kompanje EJ, Piers RD, Benoit DD (2013) Causes and consequences of disproportionate care in intensive care medicine. Curr Opin Critic Care 19: 630–635.
  7. 7. Curtis JR, Sprung CL, Azoulay E (2014) The importance of word choice in the care of critically ill patients and their families. Int Care Med 40: 606–608.
  8. 8. Epp K (2012) Burnout in critical care nurses: a literature review. Dynamics 23: 25–31. pmid:23342935
  9. 9. Curtis JR, Ciechanowski PS, Downey L, Gold J, Nielsen EL, Shannon SE, et al (2012) Development and evaluation of an interprofessional communication intervention to improve family outcomes in the ICU. Contemp Clin Trials 33: 1245–1254. pmid:22772089
  10. 10. De Villers MJ, DeVon HA (2013) Moral distress and avoidance behavior in nurses working in critical care and noncritical care units. Nurs Ethics 20: 589–603. pmid:23186938
  11. 11. Böckerman P, Ilmakunnas P (2008) Interaction of working conditions, job satisfaction, and sickness absences: evidence from a representative sample of employees. Soc Scie Med 67: 520–528.
  12. 12. Donchin Y, Seagull FJ (2002) The hostile environment of the intensive care unit Review. Curr Opin Crit Care 8: 316–320. pmid:12386492
  13. 13. Crickmore R (1987) A review of stress in the intensive care unit. Intens Care Nurs 3: 19–27.
  14. 14. Grzeskowiak M, Bartkowska-Sniatkowska A, Rosada-Kurasinska J, Kielbasiewicz-Drozdowska I, Janicki PK (2011) Stress assessment by anaesthesiologists and nurses working in paediatric intensive care units. East J Med 17: 59–66.
  15. 15. Hays MA, All AC, Mannahan C, Cuaderes E, Wallace D (2006) Reported stressors and ways of coping utilized by intensive care unit nurses. Dimens Crit Care Nurs 25: 185–193. pmid:16868472
  16. 16. Marcial L, Brazina M, Diaz A, Jaramillo C, Marentes G, Mazmanian N, (2013) A brief article: is this the cost of caring? A student perspective on compassion fatigue. DCCN 32: 18–21. pmid:23222222
  17. 17. Caine RM, Ter-Bagdasarian L (2003) Early identification and management of critical incident stress. Crit Care Nurse 23: 59–65. pmid:12640960
  18. 18. Beck CT (2011) Secondary traumatic stress in nurses: a systematic review. Archives of psychiatric nurs 25: 1–10.
  19. 19. Figley CR (2013) Trauma and its wake: Routledge. New York.
  20. 20. Meadors P, Lamson A, Swanson M, White M, Sira N (2010) Secondary traumatization in pediatric healthcare providers: Compassion fatigue, burnout, and secondary traumatic stress. Omega J Death Dying 60: 103–128.
  21. 21. National Center for Post Traumatic Stress Disorder (2014). For Professionals; PTSD overview and Assessment. Available: http://www.ptsd.va.gov/. Accessed 25 April 2014.
  22. 22. Elkonin D, Lizelle (2011) Positive and negative emotional responses to work-related trauma of intensive care nurses in private health care facilities. Health SA Gesondheid 16: 1–8.
  23. 23. Schaufeli W, Bakker A (2013) [The psychology of labor and health, 3th ed.] De psychologie van arbeid en gezondheid. Derde geheel herziene druk ed. Bohn Stafleu van Loghum, Houten.
  24. 24. Bakker AB, Le Blanc PM, Schaufeli WB (2005) Burnout contagion among intensive care nurses. J Adv Nurs 51: 276–287. pmid:16033595
  25. 25. Kaschka WP, Korczak D, Broich K (2011) Burnout: A fashionable diagnosis. Deutsches Ärzteblatt International 108: 781.
  26. 26. Freudenberger H (1980) Burnout: The Cost of High Achievement. Anchor Press, New York.
  27. 27. Nimmo A, Huggard P (2013) A Systematic Review of the Measurement of Compassion fatigue, Vicarious Trauma, and Secondary Traumatic Stress in Physicians. Australas J Disaster Trauma Stud 1: 37–44.
  28. 28. Coetzee SK, Klopper HC (2010) Compassion fatigue within nursing practice: A concept analysis. Nurs Health Sci 12: 235–243. pmid:20602697
  29. 29. Figley CR (1995) Coping with Secondary Traumatic Stress Disorder in Those Who Treat the Traumatized. Routledge, New York.
  30. 30. Joinson C (1992) Coping with compassion fatigue. Nurs 22: 116, 118–119.
  31. 31. Jenkins B, Warren NA (2012) Concept analysis: Compassion fatigue and effects upon critical care nurses. Crit Care Nurs Q 35: 388–395. pmid:22948373
  32. 32. Whitebird RR, Asche SE, Thompson GL, Rossom R, Heinrich R (2013) Stress, Burnout, Compassion Fatigue, and Mental Health in Hospice Workers in Minnesota. Journal of palliative medicine 16: 1534–1539. pmid:24199789
  33. 33. Sabo B (2011) Reflecting on the concept of compassion fatigue. Online J Issues Nurs 16: 1.
  34. 34. Aycock N, Boyle D (2009) Interventions to manage compassion fatigue in oncology nursing. Clinical journal of oncology nursing 13: 183–191. pmid:19349265
  35. 35. Fink A, (2010) Conducting research literature reviews: from the Internet to paper. 3rd ed. SAGE Publications Inc, Thousand Oaks.
  36. 36. Liberati et al (2009) The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration. PloS Med 6:e10000100.
  37. 37. Losa Iglesias ME, Becerro de Bengoa Vallejo R (2013) Prevalence and relationship between burnout, job satisfaction, stress, and clinical manifestations in spanish critical care nurses. DCCN 32: 130–137. pmid:23571196
  38. 38. Klopper HC, Coetzee SK, Pretorius R, Bester P (2012) Practice environment, job satisfaction and burnout of critical care nurses in South Africa. J Nurs Manage 20: 685–695.
  39. 39. Myhren H, Ekeberg O, Stokland O (2013) Job Satisfaction and Burnout among Intensive Care Unit Nurses and Physicians. Crit Care Res Pract 2013: 786176. pmid:24303211
  40. 40. Ali NA, Hammersley J, Hoffmann SP, O'Brien JM Jr., Phillips GS, Warren E, et al. (2011) Continuity of care in intensive care units: a cluster-randomized trial of intensivist staffing. Am J Resp Crit Care Med 184: 803–808. pmid:21719756
  41. 41. Barbosa FT, Leao BA, Tavares GMS, dos Santos JGRP (2012) Burnout syndrome and weekly workload of on-call physicians: Cross-sectional study. Sao Paulo Med J 130: 282–288. pmid:23174866
  42. 42. Bellieni CV, Righetti P, Ciampa R, Iacoponi F, Coviello C, Buonocore G (2012) Assessing burnout among neonatologists. J Matern-Fetal Neonatal Med 25: 2130–2134. pmid:22571319
  43. 43. Cho S, June KJ, Kim YM, Cho YA, Yoo CS, Yun S, et al (2009) Nurse staffing, quality of nursing care and nurse job outcomes in intensive care units. J Clin Nurs 18: 1729–1737. pmid:19646118
  44. 44. Czaja AS, Moss M, Mealer M (2012) Symptoms of Posttraumatic Stress Disorder Among Pediatric Acute Care Nurses. J Pediatr Nurs 27: 357–365. pmid:22703683
  45. 45. Eagle S, Creel A, Alexandrov A (2012) The effect of facilitated peer support sessions on burnout and grief management among health care providers in pediatric intensive care units: A pilot study. J Palliative Med 15: 1178–1180.
  46. 46. Embriaco N, Azoulay E, Barrau K, Kentish N, Pochard F, Loundou A, et al (2007) High level of burnout in intensivists: prevalence and associated factors. Am J Resp Crit Care Med 175: 686–692. pmid:17234905
  47. 47. Galvan ME, Vassallo JC, Rodriquez SP, Otero P, Montonati MM, Cardigni G, et al., (2012) Physician's burnout in pediatric intensive care units from Argentina. Arch Argent Pediatr 110: 466–473. pmid:23224303
  48. 48. Garland A, Roberts D, Graff L (2012) Twenty-four–Hour Intensivist Presence: A Pilot Study of Effects on Intensive Care Unit Patients, Families, Doctors, and Nurses. American journal of respiratory and critical care medicine 185: 738–743. pmid:22246176
  49. 49. Goetz K, Beutel S, Mueller G, Trierweiler-Hauke B, Mahler C (2012) Work-related behaviour and experience patterns of nurses. International Nursing Review 59: 88–93.
  50. 50. Guntupalli K, Fromm RE Jr (1996) Burnout in the internist-intensivist. Intens Care Med 22: 625–630.
  51. 51. Guntupalli KK, Wachtel S, Mallampalli A, Surani S (2014) Burnout in the intensive care unit professionals. Indian J Crit Care Med 18: 139–143. pmid:24701063
  52. 52. Karanikola MN, Papathanassoglou ED, Mpouzika M, Lemonidou C (2012) Burnout syndrome indices in Greek intensive care nursing personnel. DCCN 31: 94–101. pmid:22333719
  53. 53. Lederer W, Kinzl JF, Traweger C, Dosch J, Sumann G (2008) Fully developed burnout and burnout risk in intensive care personnel at a university hospital. Anaesth Intensive Care 36: 208–213. pmid:18361012
  54. 54. Liu K, You L, Chen S, Hao Y, Zhu X, Zhang L, et al (2012) The relationship between hospital work environment and nurse outcomes in Guangdong, China: a nurse questionnaire survey. J Clin Nurs 21: 1476–1485. pmid:22380003
  55. 55. Liu Y, While A, Li SJ, Ye WQ (2013) Job satisfaction and work related variables in Chinese cardiac critical care nurses. J Nurs Manag
  56. 56. Loiselle CG, Gelinas C, Cassoff J, Boileau J, McVey L (2012) A pre-post evaluation of the Adler/Sheiner Programme (ASP): a nursing informational programme to support families and nurses in an intensive care unit (ICU). Intensive Crit Care Nurs 28: 32–40. pmid:22209308
  57. 57. Mason VM, Leslie G, Clark K, Lyons P, Walke E, et al. (2014) Compassion fatigue, moral distress, and work engagement in surgical intensive care unit trauma nurses: a pilot study. DCCN 33: 215–225. pmid:24895952
  58. 58. Meadors P, Lamson A (2008) Compassion Fatigue and Secondary Traumatization: Provider Self Care on Intensive Care Units for Children. J Pediatr Health Care 22: 24–34. pmid:18174086
  59. 59. Mehrabi T, Azadi F, Pahlavanzadeh S, Meghdadi N (2012) The effect of yoga on coping strategies among intensive care unit nurses. Iran J Nurs Midwifery Res 17: 421–424. pmid:23922582
  60. 60. Mealer ML, Shelton A, Berg B, Rothbaum B, Moss M (2007) Increased prevalence of post-traumatic stress disorder symptoms in critical care nurses. Am J Resp Crit Care Med 175: 693–697. pmid:17185650
  61. 61. Merlani P, Verdon M, Businger A, Domenighetti G, Pargger H, Ricou B (2011) Burnout in ICU caregivers: a multicenter study of factors associated to centers. Am J Resp Crit Care Med 184:1140–1146. pmid:21852543
  62. 62. Nooryan K, Gasparyan K, Sharif F, Zoladl M (2011) The effect of teaching emotional intelligence (EI) items on job related stress in physicians and nurses working in ICU wards in hospitals, Yerevan, Armenia. Int J Collab Res Intern Med Public Health 3: 704–713.
  63. 63. Nooryan K, Gasparyan K, Sharif F, Zoladl M (2012) Controlling anxiety in physicians and nurses working in intensive care units using emotional intelligence items as an anxiety management tool in Iran. Int J gen med 5: 5. pmid:22259255
  64. 64. Poncet MC, Toullic P, Papazian L, Kentish-Barnes N, Timsit J, Pochard F, Chevret S, et al (2007) Burnout syndrome in critical care nursing staff. Am J Resp Crit Care Med 175: 698–704. pmid:17110646
  65. 65. Quenot JP, Rigaud JP, Prin S, Barbar S, Pavon A, Hamet M, et al (2012) Suffering among carers working in critical care can be reduced by an intensive communication strategy on end-of-life practices. Intens Care Med 38: 55–61.
  66. 66. Raftopoulos V, Charalambous A, Talias M (2012) The factors associated with the burnout syndrome and fatigue in Cypriot nurses: a census report. BMC Public Health 12: 457 pmid:22716044
  67. 67. Raggio B, Malacarne B (2007) Burnout in Intensive Care Unit. Minerva Anestesiol 73: 195–200. pmid:17468736
  68. 68. Rochefort C, Clarke SP (2010) Nurses' work environments, care rationing, job outcomes, and quality of care on neonatal units. J Adv Nurs 66: 2213–2224. pmid:20626479
  69. 69. Saini R, Kaur S, Das K (2011) Assessment of stress and burnout among intensive care nurses at a tertiary care hospital. J. Mental Health Human Behav 16(1): 43–47.
  70. 70. Shehabi Y, Dobb G, Jenkins I, Pascoe R, Edwards N, Butt W (2008) Burnout syndrome among Australian intensivists: a survey. Crit Care Resusc 10: 312–315. pmid:19049482
  71. 71. Sluiter JK, Bos AP, Tol D, Calff M, Krijnen M, et al. (2005) Is staff well-being and communication enhanced by multidisciplinary work shift evaluations? Intens Care Med 31: 1409–1414.
  72. 72. Su TP, Lien T, Yang C, Su Y, Wang J, Tsai S, et al (2007) Prevalence of psychiatric morbidity and psychological adaptation of the nurses in a structured SARS caring unit during outbreak: A prospective and periodic assessment study in Taiwan. J Psychiatr Res 41: 119–130. pmid:16460760
  73. 73. Teixeira C, Ribeiro O, Fonseca AM, Carvalho AS (2013) Burnout in intensive care units—a consideration of the possible prevalence and frequency of new risk factors: A descriptive correlational multicentre study. BMC Anesthesiol 13: 38. pmid:24172172
  74. 74. Verdon M, Merlani P, Perneger T, Ricou B (2008) Burnout in a surgical ICU team. Intensive Care Medicine 34: 152–156. pmid:17943271
  75. 75. West CP, Dyrbye LN, Rabatin JT, Call TG, Davidson JH, Multari A, et al. (2014) Intervention to Promote Physician Well-being, Job Satisfaction, and Professionalism: A Randomized Clinical Trial. JAMA Int Med 174: 527–533.
  76. 76. Young JL, Derr DM, Cicchillo VJ, Bressler S (2011) Compassion satisfaction, burnout, and secondary traumatic stress in heart and vascular nurses. Crit Care Nurs Q 34: 227–234. pmid:21670622
  77. 77. Zhang XC, Huang DS, Guan P (2014) Job burnout among critical care nurses from 14 adult intensive care units in northeastern China: a cross-sectional survey. BMJ Open 4: e004813. pmid:24948747
  78. 78. Stamm BH (2002) Measuring Compassion Satisfaction as Well as Fatigue: Developmental History of the Compassion Satisfaction and Fatigue Test. In: Figley CR, editor. In: Treating Compassion Fatigue. New York: Routledge. pp 107–117.
  79. 79. Smart D, English A, James J, Wilson M, Daratha KB, Childres B, et al (2013) Compassion fatigue and satisfaction: A cross-sectional survey among US healthcare workers. Nurs Health Sci
  80. 80. West CP, Dyrbye LN, Rabatin FT, Call TG, Davidson JH, Multari A, et al (2014) Intervention to Promote Physician Well-being, Job Satisfaction, and Professionalism: A Randomized Clinical Trial. JAMA Int Med.
  81. 81. Kerasiotis B, Motta RW (2004) Assessment of PTSD symptoms in emergency room, intensive care unit, and general floor nurses. Int J Emerg Ment Health 6: 121–133. pmid:15481474
  82. 82. Jenkins SR, Baird S (2002) Secondary traumatic stress and vicarious trauma: A validational study. Journal of traumatic stress 15: 423–432. pmid:12392231
  83. 83. Yoder EA (2010) Compassion fatigue in nurses. Applied Nursing Research 23: 191–197. pmid:21035028
  84. 84. Stamm BH (2010) The concise ProQOL manual. Pocatello, ID: ProQOL org.
  85. 85. Leiter MP, Bakker AB, Maslach C (2014) Burnout at Work: A Psychological Perspective: Psychology Press.
  86. 86. Schaufeli WB, Van Dierendonck D (1995) A cautionary note about the cross-national and clinical validity of cut-off points for the Maslach Burnout Inventory. Psychological reports 76: 1083–1090. pmid:7480470
  87. 87. Awa WL, Plaumann M, Walter U (2010) Burnout prevention: A review of intervention programs. Pat Educ Couns 78: 184–190.
  88. 88. Fallowfield L, Jenkins V, Farewell V, Solis-Trapala I (2003) Enduring impact of communication skills training: results of a 12-month follow-up. Brit J Cancer 89: 1445–1449. pmid:14562015
  89. 89. Davies WR (2008) Mindful meditation: healing burnout in critical care nursing. Holistic nurs pract 22: 32–36.
  90. 90. Lan HK, Subramanian P, Rahmat N, Kar PC (2014) The effects of mindfulness training program on reducing stress and promoting well-being among nurses in critical care units. Austral. J. Adv Nurs 31(3): 22–31.
  91. 91. Kearney MK, Weininger RB, Vachon MLS (2009) Self-care of physicians caring for patients at the end of life:“Being connected… a key to my survival”. JAMA 301(11): 1155–1164. pmid:19293416
  92. 92. Sackett DL (1979) Bias in analytic research. J Chronic Diseases 32: 51–63.
  93. 93. Rosenthal R (1979) The file drawer problem and tolerance for null results. Psych Bull 86: 638.