Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Mortality Prediction in Patients Undergoing Non-Invasive Ventilation in Intermediate Care

  • Diego Martinez-Urbistondo,

    Affiliation Clínica Universidad de Navarra, Department of Internal Medicine, Division of Intermediate Care and Hospitalists Unit, Pamplona, Spain

  • Félix Alegre,

    Affiliation Clínica Universidad de Navarra, Department of Internal Medicine, Division of Intermediate Care and Hospitalists Unit, Pamplona, Spain

  • Francisco Carmona-Torre,

    Affiliation Clínica Universidad de Navarra, Department of Internal Medicine, Division of Intermediate Care and Hospitalists Unit, Pamplona, Spain

  • Ana Huerta,

    Affiliation Clínica Universidad de Navarra, Department of Internal Medicine, Division of Intermediate Care and Hospitalists Unit, Pamplona, Spain

  • Nerea Fernandez-Ros,

    Affiliation Clínica Universidad de Navarra, Department of Internal Medicine, Division of Intermediate Care and Hospitalists Unit, Pamplona, Spain

  • Manuel Fortún Landecho,

    Affiliations Clínica Universidad de Navarra, Department of Internal Medicine, Division of Intermediate Care and Hospitalists Unit, Pamplona, Spain, Instituto de Investigación Sanitaria de Navarra (IdiSNA), Pamplona, Spain

  • Alberto García-Mouriz,

    Affiliation Clínica Universidad de Navarra, Information Technology, Pamplona, Spain

  • Jorge M. Núñez-Córdoba,

    Affiliations Clínica Universidad de Navarra, Division of Biostatistics, Research Support Service, Central Clinical Trials Unit, Pamplona, Spain, Department of Preventive Medicine and Public Health, Medical School, Universidad de Navarra, Pamplona, Spain, Epidemiology and Public Health Area, Instituto de Investigación Sanitaria de Navarra (IdiSNA), Pamplona, Spain

  • Nicolás García,

    Affiliation Clínica Universidad de Navarra, Department of Internal Medicine, Division of Intermediate Care and Hospitalists Unit, Pamplona, Spain

  • Jorge Quiroga,

    Affiliations Clínica Universidad de Navarra, Department of Internal Medicine, Division of Intermediate Care and Hospitalists Unit, Pamplona, Spain, Instituto de Investigación Sanitaria de Navarra (IdiSNA), Pamplona, Spain, Centro de Investigación Biomédica en Red de Enfermedades Hepáticas y Digestivas (CIBEREHD), Pamplona, Spain

  • Juan Felipe Lucena

    flucena@unav.es

    Affiliation Clínica Universidad de Navarra, Department of Internal Medicine, Division of Intermediate Care and Hospitalists Unit, Pamplona, Spain

Abstract

Background

Intermediate Care Units (ImCU) have become an alternative scenario to perform Non-Invasive Ventilation (NIV). The limited number of prognostic studies in this population support the need of mortality prediction evaluation in this context.

Objective

The objective of this study is to analyze the performance of Simplified Acute Physiology Score (SAPS) II and 3 in patients undergoing NIV in an ImCU. Additionally, we searched for new variables that could be useful to customize these scores, in order to improve mortality prediction.

Design

Cohort study with prospectively collected data from all patients admitted to a single center ImCU who received NIV. The SAPS II and 3 scores with their respective predicted mortality rates were calculated. Discrimination and calibration were evaluated by calculating the area under the receiver operating characteristic curve (AUC) and with the Hosmer-Lemeshow goodness of fit test for the models, respectively. Binary logistic regression was used to identify new variables to customize the scores for mortality prediction in this setting.

Patients

The study included 241 patients consecutively admitted to an ImCU staffed by hospitalists from April 2006 to December 2013.

Key Results

The observed in-hospital mortality was 32.4% resulting in a Standardized Mortality Ratio (SMR) of 1.35 for SAPS II and 0.68 for SAPS 3. Mortality discrimination based on the AUC was 0.73 for SAPS II and 0.69 for SAPS 3. Customized models including immunosuppression, chronic obstructive pulmonary disease (COPD), acute pulmonary edema (APE), lactic acid, pCO2 and haemoglobin levels showed better discrimination than old scores with similar calibration power.

Conclusions

These results suggest that SAPS II and 3 should be customized with additional patient-risk factors to improve mortality prediction in patients undergoing NIV in intermediate care.

Introduction

Non-Invasive Ventilation (NIV) reduces in-hospital mortality in selected patients with acute respiratory failure (ARF) [14]. Currently, indications and success of this ventilation mode depend on ARF etiology, the evolution in the first hours of the PaO2/FiO2 ratio, pH, pCO2 and the respiratory rate [57]. For this reason, initiation of NIV in ARF should be done under continuous surveillance [5]. In this context, Intermediate Care Units (ImCU) may offer a suitable alternative to the intensive care unit (ICU), due to the availability of non-invasive monitoring and specialized staff and nursing dedication [8].

Statistically significant differences in Simplified Acute Physiology Score (SAPS) II and Acute Physiology and Chronic Health Evaluation (APACHE) II scores have been found between survivors and non-survivors who underwent NIV due to acute lung injury (ALI) [9], acute respiratory distress syndrome (ARDS) [10], COPD exacerbation [11], acute pulmonary edema (APE) [12], interstitial lung disease [13] and acute myasthenia gravis [14]. Regarding the performance of SAPS 3, a revised version of SAPS II, which includes more comorbidities and physiological values within the first hour of admission [15], the information is even more limited. Metnitz et al., [16] described a cohort of 157 patients who underwent Pressure Support Ventilation (PSV) from a multicenter multinational study of the SAPS 3 data base. The study was descriptive, without information regarding the calibration and discrimination power of the score.

In this context, conventional scores show high dependence on case-mix for accurate prediction [1719] and do not include important respiratory variables, such as ARF etiology, hemoglobin and pCO2 levels [2024]. Therefore, the objectives of this study were: (i) to describe the outcomes of NIV population in an ImCU, (ii) to evaluate the performance of SAPS II and 3 in mortality prediction of patients undergoing NIV in this area and (iii) to customize the scores with new variables in order to improve their performance.

Materials and Methods

The study was performed at the Clínica Universidad de Navarra, an academic medical center in Pamplona, Spain. Our ImCU is a 9-bed multi-purpose area staffed by hospitalists and shared with coronary and stroke units while being independent from the mixed ICU. Each bed is equipped with continuous telemetry, pulse-oxymetry, noninvasive arterial blood pressure, central venous pressure monitoring, and non-invasive pressure support ventilation with BiPAP. The signals are relayed to a central monitoring station and the nurse-patient ratio is 1:3. Demographics, past medical history, reasons for admission, physiological parameters at the time of admission and during the first 24 hours of ImCU stay, laboratory variables and survival to hospital discharge were prospectively recorded by the authors. Admission and discharge criteria of the ImCU were set according to previous guidelines defined by The American College of Critical Care Medicine [8].

Every consecutive patient undergoing NIV from April 2006 to December 2013 was evaluated and included in the study. Exclusion criteria from ImCU admission were: age less than 18 years, severe respiratory failure at imminent risk of intubation, status epilepticus and catastrophic brain illness. ImCU readmissions were also excluded from the final analysis. In-hospital mortality was the end point of the study.

Indication of NIV was established according to previously published guidelines [5]. Patients were divided in four groups of ARF etiology: COPD exacerbation, acute pulmonary edema, hypoventilation due to neuromuscular disease and hypoxemic ARF. NIV failure was defined as the discharge of patients to the ICU to be intubated or the in-hospital death of subjects due to ARF when do-not resuscitate (DNR) orders were set.

Ethical Standards

The study protocol was approved by the Institutional Review Board (IRB) at the Clínica Universidad de Navarra (ref. 129/2010). The IRB waived the need for informed consent, because it did not interfere with decisions related to patients care. The study has been performed in accordance with the ethical of the 1964 Declaration of Helsinki and its later amendments.

Statistical Analysis

Data were prospectively collected after patient admission, into a computer database by the authors and based on the electronic medical record system of the Clínica Universidad de Navarra. Continuous variables were reported as mean and standard deviation, and as median and interquartile range (IQR) when appropriate. These variables were analyzed by t-Student, ANOVA, U-Mann Whitney and Kruskal Wallis tests. Categorical variables were summarized as absolute frequencies and percentages, and analyzed by chi-square test. Performance of the prognostic scores was assessed by standard procedures to measure discrimination and calibration. Discrimination was evaluated by calculating the area under receiver operating characteristic (ROC) curve (AUC) [25] and calibration was assessed using the Hosmer-Lemeshow goodness-of-fit test, in which a high p value (> 0.05) was interpreted as a good fit for the models [26, 27]. In the rest of the analyses, statistically significant results were considered when p <0.05. Standardized mortality ratios (SMR) (ratio of observed to expected deaths) were calculated for each model and ARF etiology subgroup. Customized models were developed using binary logistic regression. The variables included in the model were: hemoglobin, pCO2 and lactic acid levels, SAPS II score, COPD diagnosis and APE, previously described in NIV mortality prediction [5,2124]. Immunosuppression, DNR orders and the SAPS 3 score, were also included in the analysis, due to their potential clinical application in predicting NIV mortality.

Statistical analyses was performed, using SPSS for Windows, version 20.0 (SPSS Inc, Chicago, IL).

Model Validation

The customized models were validated internally by bootstrapping. The bootstrap method randomly draws multiple samples with replacement from the original cohort. The model is developed again in each bootstrap sample yielding a different AUC (c-statistic) to each bootstrap model [28]. An average of these c-indexes was calculated. The bootstrap procedure was performed with 1000 draws with replacement in the study cohort.

Results

From April 2006 to December 2013, a total of 241 patients were non-invasively ventilated in the ImCU of our hospital and constituted the study group. Demographic characteristics, co-morbidities, location prior to admission, discharge location, variables at admission and length of hospital stay are described in Table 1. The population had a mean age of 68 years, and a female percentage of 37.3%. Most frequent co-morbidities were hypertension (55.6%), immunosuppression (56.2%) and COPD (29.9%). The general ward was the principal location prior to admission (63.5%) followed by the emergency room (23.3%) and the ICU (9.1%). Most patients were discharged to the general ward (67.6%) or to the ICU (19.1%).

Reasons for NIV application in the ImCU were COPD exacerbation (18.25%), hypoxemic acute respiratory failure (56.85%), acute pulmonary edema (17.01%) and neuromuscular disease (7.89%), as shown in Table 2. The expected mortality was 24.02+/-17.91% for SAPS II (median: 18% IQR: 11–34%) and 45.75+/-22.68% for SAPS 3 (median: 44% IQR: 28–63%), while the observed in-hospital mortality was of 32.4% (78/241 patients), resulting in a SMR of 1.35 for SAPS II and of 0.69 for SAPS 3. Mortality location distribution was: 19/78 at the ImCU (24.3%), 24/78 at ICU (30.7%) and 35/78 at the general ward (45%).

Mortality prediction based on SAPS II showed conflicting results, considering the NIV indication. A mismatch was observed between the SMR of the hypoxemic respiratory failure and the neuromuscular disease groups (1.63 vs 0.55, respectively). However, the prediction power was acceptable for the groups of COPD (1.10) and APE (0.85). Interestingly, SAPS 3 tended to overestimate mortality in all the groups according to SMR, being more accurate for hypoxemic ARF (0.86) (Table 2).

Performance of SAPS II and 3 is described in Table 3. Discrimination according to AUC was of 0.73 (CI 95% 0.69–0.80) for SAPS II and 0.69 (CI 95% 0.63–0.77) for SAPS 3. Results from the Hosmer-Lemeshow goodness-of-fit tests showed a good calibration for both scores: (χ2 = 7.35, p = 0.49) for SAPS II and (χ2 = 4.45, p = 0.81) for SAPS 3.

Univariate analysis was done for mortality prediction, including SAPS II, SAPS 3 and other important variables in the ARF context. Statistically significant differences were found for NIV indications, immunosuppression, patients with do-not-resuscitate orders (DNR), previous diagnosis of COPD, pCO2 (mmHg), lactic acid (mg/dl), hemoglobin (g/dl), SAPS II and SAPS 3 (p<0.05 for all) (Table 4). Other variables such as hypertension, coronary artery disease and white blood cell count were found to be not statistically significant in this analysis.

thumbnail
Table 4. Univariate analysis of new variables for NIV mortality prediction.

https://doi.org/10.1371/journal.pone.0139702.t004

All these variables were converted to dichotomous after sensitivity analysis and included together with SAPS II and 3 in independent logistic regression models. Then, two customized models (SAPS II-CNIV and SAPS 3-CNIV) were developed from logistic regression results (Tables 5 and 6).

thumbnail
Table 5. Logistic regression and score customization for SAPS II.

https://doi.org/10.1371/journal.pone.0139702.t005

thumbnail
Table 6. Logistic regression and score customization for SAPS 3.

https://doi.org/10.1371/journal.pone.0139702.t006

In the SAPS II-CNIV model, immunosuppression and lactic acid over 2 mg/dl were found to be risk factors, while previous diagnosis of COPD, acute pulmonary edema and haemoglobin levels over 10.7 g/dl were found to be protective factors (p<0.05). Carbon dioxide pressure (pCO2) > 55 mmHg was protective and near to statistical significance (p = 0.09). Interestingly, DNR orders were not statistically significant in this model (p = 0.20), probably due to a colinearity phenomenon (comorbidities, immunosuppression and metastatic cancer). Each variable was given a prognostic value to be included in the customized score, which was established as the weight of each variable in mortality prediction in comparison to a SAPS II single point (Table 5).

The SAPS 3-CNIV model showed statistical significance of DNR orders and lactic acid > 2 mg/dl as risk factors and previous diagnosis of COPD, APE and haemoglobin levels > 10.7 g/dl as protective factors (p<0.05). Meanwhile, pCO2 > 55 mmHg was a protective factor near to statistical significance (p = 0.09). Immunosuppression was not included in the analysis to avoid co-linearity phenomenon, as this variable is part of the original SAPS 3. Prognostic values were assigned to each variable in the same way than in SAPS II-CNIV (Table 6).

AUC for SAPS II-CNIV and SAPS 3-CNIV were 0.84 and 0.79 respectively. Both scores showed similar calibration performance based on the Hosmer-Lemeshow goodness-of-fit test: (χ2 = 5.62, p = 0.69) for SAPS II and (χ2 = 8.41, p = 0.39) for SAPS 3. The bootstrap adjusted AUC for SAPS II-CNIV was 0.83 (95% CI 0.78–0.89) and 0.78 (95% CI 0.72–0.84) for SAPS 3-CNIV.

Table 3 show these values for an easy comparison between primary and customized scores. Fig 1 shows the AUROC curves of primary scores compared to customized versions (Fig 1 Panel A and B).

thumbnail
Fig 1. Receiver Operating Characteristic curves in the different prognostic models.

(A) SAPS II and SAPS II-CNIV. (B) SAPS 3 and SAPS 3-CNIV.

https://doi.org/10.1371/journal.pone.0139702.g001

In an effort to simplify the application of the customized scores, sensitivity analysis was performed on SAPS II-CNIV and 3-CNIV to find critical values which could classify patients in statistically different mortality groups. After this procedure, SAPS II-CNIV was divided in 4 mortality groups and SAPS 3-CNIV in 3. Cut-off values and death probability for each group are shown in Tables 7 and 8.

thumbnail
Table 7. Clinical application of SAPS II-CNIV: Death probability according to customized scores.

https://doi.org/10.1371/journal.pone.0139702.t007

thumbnail
Table 8. Clinical application of SAPS 3-CNIV: Death probability according to customized scores.

https://doi.org/10.1371/journal.pone.0139702.t008

Discussion

The results of the current study highlight the importance of customizing SAPS II and 3 with patient-risk factors to improve mortality prediction in patients undergoing NIV in Intermediate Care.

To our knowledge, no previous studies described a complete evaluation of the discrimination and calibration power of SAPS II and 3 in non-invasively ventilated patients. In this study, SAPS II and 3 showed decreased prediction accuracy in terms of discrimination and calibration as compared to original cohort results of both scores in critically ill patients [15,29] and also in ImCU population [3032].

This fact could be explained by the importance of patient-risk factors in the NIV mortality prediction. Mortality in ARF is highly dependent on respiratory variables at the beginning of the technique [5]. In this context pO2, pCO2, lactic acid and hemoglobin levels at admission have demonstrated to influence mortality prediction in this subgroup of patients [2024].

Differences in mortality depending on ARF etiology have been extensively described [3335]. The results in the etiology subgroups of our study are in agreement with previous descriptions; being lower in COPD exacerbation, neuromuscular disease and APE (10–20%), and higher in hypoxemic respiratory failure (50–80%) [5,36,37]. Nevertheless, neither ARF etiology nor previously described physiological variables are included in the original SAPS models.

For this reason, an evaluation combining the use of severity scores and patient-risk factors, could improve the accuracy of mortality prediction in NIV users. In our study, the two customized SAPS II and 3 models appeared to be a synthesis of both concepts, with an acceptable discrimination and calibration power. Additionally, internal validation was assessed by bootstrapping method.

The higher overall mortality of our cohort, in comparison to previously published series [16,36], could be due to differences in case-mix population. The contribution of advanced oncologic (24.5%) and DNR-order patients (29.9%), of our cohort could, at least, partially explain these results. Furthermore, the results of this study support previous descriptions regarding the efficacy of Intermediate Care for NIV application.

Previous studies described the potential of Intermediate Care in terms of cost-containment, rational ICU utilization and triage flexibility for acute patients [38,39]. Recently, Capuzzo et al. [40] described the positive impact of the presence of an ImCU in terms of adjusted hospital mortality for patients admitted in intensive care. Nonetheless, we need more, larger and controlled trials to definitively establish the indications and limitations of the ImCU.

The patients with higher scores and significant mortality risk should be followed carefully, in order to avoid unnecessary delays in transfer to ICU or intubation. However, we need external validation studies to establish the cut-off points for ICU admission.

The most relevant studies for mortality prediction in critical care were multicentric and with extensive number of patients [15, 29]. However, the number of patients in other NIV studies is similar to the present sample [14,1114,36,37]. The cohort of Metnitz et al. [16] derived from a multicenter multinational study of the SAPS 3 database, included 157 patients who underwent PSV. The study was descriptive, without information regarding the calibration and discrimination power of the score and with an observed to expected mortality ratio of 0.79, compared with our SMR of 0.69. These differences could be explained by the overfitting bias of the SAPS 3 score when the validation case mix cohort is substantially different from the original study. These limitations emphasize the need to find specific scores for mortality prediction in NIV. We need more studies, with validation cohorts of the SAPS II-CNIV and SAPS 3-CNIV scores, before its routine application in intensive care.

Conclusions

SAPS II and 3 models, combined with complementary patient-risk factors, could improve mortality prediction in patients undergoing NIV in the ImCU.

Acknowledgments

The authors thank the Nursing Staff of the ImCU for their unconditional support in patient care.

Author Contributions

Conceived and designed the experiments: DMU JFL JQ. Performed the experiments: DMU FA FCT MFL NFR AH AGM NG JFL JQ. Analyzed the data: DMU FA FCT JFL JQ JMNC. Contributed reagents/materials/analysis tools: DMU FA FCT MFL NFR AH AGM NG JFL JQ JMNC. Wrote the paper: DMU JQ JFL.

References

  1. 1. Brochard L, Isabey D, Piquet J, Amaro P, Mancebo J, Messadi AA, et al. Reversal of acute exacerbations of chronic obstructive lung disease by inspiratory assistance with a face mask. N Engl J Med 1990; 323:1523–1530
  2. 2. Bott J, Carroll MP, Conway JH, Keilty SE, Ward EM, Brown AM, et al. Randomised controlled trial of nasal ventilation in acute ventilatory failure due to chronic obstructive airways disease. Lancet 1993; 341:1555–1557
  3. 3. Kramer N, Meyer TJ, Meharg J, Cece RD, Hill NS. Randomized, prospective trial of noninvasive positive pressure ventilation in acute respiratory failure. Am J Respir Crit Care Med 1995;151:1799–1806
  4. 4. Plant PK, Owen JL, Elliott MW. Early use of non-invasive ventilation for acute exacerbations of chronic obstructive pulmonary disease on general respiratory wards: A multicenter randomized controlled trial. Lancet 2000; 355:1931–1935
  5. 5. Hill NS, Brennan J, Garpestad E, Nava S. Noninvasive ventilation in acute respiratory failure. Crit Care Med. 2007 Oct; 35(10):2402–7.
  6. 6. Garpestad E, Brennan J, Hill NS. Noninvasive ventilation for critical care. Chest. 2007 Aug;132(2):711–20.
  7. 7. Lefevre J-C, Dimassi S, Brochard L. NIV in hypoxaemic acute respiratory failure. Eur Respir Mon 2012; 55: 65–80.
  8. 8. Nasraway SA, Cohen IL, Dennis RC, Howenstein MA, Nikas DK, Warren J, et al. Guidelines on admission and discharge for adult intermediate care units. American College of Critical Care Medicine of the Society of Critical Care Medicine. Crit Care Med. 1998 Mar;26(3):607–10
  9. 9. Yoshida Y, Takeda S, Akada S, Hongo T, Tanaka K, Sakamoto A. Factors predicting successful noninvasive ventilation in acute lung injury. J Anesth. 2008;22(3):201–6.
  10. 10. Antonelli M, Conti G, Esquinas A, Montini L, Maggiore SM, Bello G, et al. A multiple-center survey on the use in clinical practice of noninvasive ventilation as a first-line intervention for acute respiratory distress syndrome. Crit Care Med. 2007 Jan;35(1):18–25.
  11. 11. Phua J, Kong K, Lee KH, Shen L, Lim TK. Noninvasive ventilation in hypercapnic acute respiratory failure due to chronic obstructive pulmonary disease vs. other conditions: effectiveness and predictors of failure. Intensive Care Med. 2005 Apr; 31(4):533–9.
  12. 12. Rodríguez Mulero L, Carrillo Alcaraz A, Melgarejo Moreno A, Renedo Villarroya A, Párraga Ramírez M, et al. [Predictive factors related to success of non-invasive ventilation and mortality in the treatment of acute cardiogenic pulmonary edema]. Med Clin (Barc). 2005 Feb 5;124(4):126–31.
  13. 13. Güngör G, Tatar D, Saltürk C, Cimen P, Karakurt Z, Kirakli C, et al. Why do patients with interstitial lung diseases fail in the ICU? A 2-center cohort study. Respir Care. 2013 Mar;58(3):525–31
  14. 14. Wu JY, Kuo PH, Fan PC, Wu HD, Shih FY, Yang PC. The role of non-invasive ventilation and factors predicting extubation outcome in myasthenic crisis. Neurocrit Care. 2009;10(1):35–42.
  15. 15. Metnitz PG, Moreno RP, Almeida E, Jordan B, Bauer P, Campos RA, et al. SAPS 3-From evaluation of the patient to evaluation of the intensive care unit. Part 1: Objectives, methods and cohort description. Intensive Care Med. 2005 Oct; 31(10):1336–44.
  16. 16. Metnitz PG, Metnitz B, Moreno RP, Bauer P, Del Sorbo L, Hoermann C, et al. Epidemiology of mechanical ventilation: analysis of the SAPS 3 database. Intensive Care Med. 2009 May; 35(5):816–25.
  17. 17. Apolone G, Bertolini D, D’Amico R, Iapichino G, Cattaneo A, De Salvo G, et al. The performance of SAPS II in a cohort of patients admitted to 99 Italian ICUs: results from GiViTi. Grupo Italiano per la Valutazione degli interventi in Terapia Intensiva. Intensive Care Med 1996;22:1368–1378.
  18. 18. Moreno R, Miranda DR, Fidler V, Van Schilfgaarde R. Evaluation of two outcome prediction models on an independent database. Crit Care Med 1998;26:50–61
  19. 19. Metnitz PG, Vesely H, Valentin A, Popow C, Hiesmayr M, Lenz K, et al. Evaluation of an interdisciplinary data set for national intensive care unit assessment. Crit Care Med 1999;27:1486–1491.
  20. 20. Walkey AJ, Wiener RS. Use of noninvasive ventilation in patients with acute respiratory failure, 2000–2009: a population-based study.Ann Am Thorac Soc. 2013 Feb;10(1):10–7.
  21. 21. Kollert F, Tippelt A, Müller C, Jörres RA, Porzelius C, Pfeifer M, et al. Hemoglobin levels above anemia thresholds are maximally predictive for long-term survival in COPD with chronic respiratory failure. Respir Care. 2013 Jul; 58(7):1204–12.
  22. 22. Nicolini A, Tonveronachi E, Navalesi P, Antonelli M, Valentini I, Melotti RM, et al. Effectiveness and predictors of success of noninvasive ventilation during H1N1 pandemics: a multicenter study. Minerva Anestesiol. 2012 Dec;78(12):1333–40.
  23. 23. Carron M, Freo U, Zorzi M, Ori CJ. Predictors of failure of noninvasive ventilation in patients with severe community-acquired pneumonia. Crit Care. 2010 Sep; 25(3):540.e9–14.
  24. 24. Confalonieri M, Garuti G, Cattaruzza MS, Osborn JF, Antonelli M, Conti G, et al. A chart of failure risk for noninvasive ventilation in patients with COPD exacerbation. Eur Respir J. 2005 Feb;25(2):348–55.
  25. 25. Zweig MH, Campbell G. Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. Clin Chem 1993, 39:561–577.
  26. 26. Hunt JP, Meyer AA. Predicting survival in the intensive care unit. Curr Probl Surg 1997;34:527–599
  27. 27. Lemeshow S, Hosmer DW. A review of goodness of fit statistics for use in the development of logistic regression model. Am J Epidemiol 1982;115:92–106.
  28. 28. Labarere J, Bertrand R, Fine MJ. How to derive and validate clinical prediction models for use in intensive care medicine. Intensive Care Med 2014;40:513–527 pmid:24570265
  29. 29. Le Gall JL, Lemeshow S, Saulnier F. A New Simplified Acute Physiology Score (SAPS II) Based on a European/North American Multicenter Study. JAMA. 1993;270:2957–2963
  30. 30. Lucena JF, Alegre F, Rodil R, Landecho MF, García-Mouriz A, Marqués M, et al. Results of a retrospective observational study of intermediate care staffed by hospitalists: impact on mortality, co-management, and teaching. J Hosp Med. 2012 May-Jun;7(5):411–5.
  31. 31. Lucena JF, Alegre F, Martinez-Urbistondo D, Landecho MF, Huerta A, García-Mouriz A, et al. (2013) Performance of SAPS II and SAPS 3 in Intermediate Care. PLoS ONE 8(10): e77229.
  32. 32. Auriant I, Vinatier I, Thaler F, Tourneur M, Loirat P. Simplified acute physiology score II for measuring severity of illness in intermediate care units. Crit Care Med. 1998;26(8):1368–71.
  33. 33. Antonelli M, Conti G, Moro ML, Esquinas A, Gonzalez-Diaz G, Confalonieri M, et al. Predictors of failure of noninvasive positive pressure ventilation in patients with acute hypoxemic respiratory failure: a multi-center study. Intensive Care Med 2001;27(11):1718–1728.
  34. 34. Conti G, Antonelli M, Navalesi P, Rocco M, Bufi M, Spadetta G, et al. Noninvasive vs. conventional mechanical ventilation in patients with chronic obstructive pulmonary disease after failure of medical treatment in the ward: a randomized trial. Intensive Care Med 2002;28(12):1701–1707.
  35. 35. Nava S, Ceriana P. Causes of failure of noninvasive mechanical ventilation. Respir Care. 2004;49(3):295–303.
  36. 36. Ozsancak Ugurlu A, Sidhom SS, Khodabandeh A, Ieong M, Mohr C, Lin DY, et al. Use and outcomes of noninvasive positive pressure ventilation in acute care hospitals in massachusetts. Chest. 2014 May 1;145(5):964–71.
  37. 37. Azoulay E, Kouatchet A, Jaber S, Lambert J, Meziani F, Schmidt M, et al. Noninvasive mechanical ventilation in patients having declined tracheal intubation. Intensive Care Med. 2013;39(2):292–301.
  38. 38. Zimmerman JE, Wagner DP, Knaus WA, Williams JF, Kolakowski D, Draper EA. The use of risk predictions to identify candidates for intermediate care units. Implications for intensive care utilization and cost. Chest. 1995;108(2):490–9.
  39. 39. Bertolini G, Confalonieri M, Rossi C, Rossi G, Simini B, Gorini M, et al. Costs of the COPD. Differences between intensive care unit and respiratory intermediate care unit. Respir Med 2005;99:894–900.
  40. 40. Capuzzo M, Volta C, Tassinati T, Moreno R, Valentin A, Guidet B, et al. Hospital mortality of adults admitted to Intensive Care Units in hospitals with and without Intermediate Care Units: a multicentre European cohort study. Crit Care. 2014;18(5):551–565.