Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Efficacy of Mesenchymal Stromal Cell Therapy for Acute Lung Injury in Preclinical Animal Models: A Systematic Review

  • Lauralyn A. McIntyre ,

    lmcintyre@ohri.ca

    Affiliations Department of Medicine (Division of Critical Care), University of Ottawa, Ottawa, Ontario, Canada, The Ottawa Hospital Research Institute, Ottawa, Ontario, Canada, Department of Epidemiology and Community Medicine, University of Ottawa, Ottawa, Ontario, Canada

  • David Moher,

    Affiliations The Ottawa Hospital Research Institute, Ottawa, Ontario, Canada, Department of Epidemiology and Community Medicine, University of Ottawa, Ottawa, Ontario, Canada, Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada

  • Dean A. Fergusson,

    Affiliations The Ottawa Hospital Research Institute, Ottawa, Ontario, Canada, Department of Epidemiology and Community Medicine, University of Ottawa, Ottawa, Ontario, Canada

  • Katrina J. Sullivan,

    Affiliation The Ottawa Hospital Research Institute, Ottawa, Ontario, Canada

  • Shirley H. J. Mei,

    Affiliation The Ottawa Hospital Research Institute, Ottawa, Ontario, Canada

  • Manoj Lalu,

    Affiliations The Ottawa Hospital Research Institute, Ottawa, Ontario, Canada, Department of Anesthesiology, University of Ottawa, Ottawa, Ontario, Canada

  • John Marshall,

    Affiliation Department of Surgery and Critical Care Medicine, Keenan Research Centre of the Li Ka Shing Knowledge Institute, St. Michaels Hospital, The University of Toronto, Toronto, Ontario, Canada

  • Malcolm Mcleod,

    Affiliation Centre for Clinical Brain Sciences, The University of Edinburgh, Edinburgh, Scotland, United Kingdom

  • Gilly Griffin,

    Affiliation The Ottawa Hospital Research Institute, Ottawa, Ontario, Canada

  • Jeremy Grimshaw,

    Affiliations The Ottawa Hospital Research Institute, Ottawa, Ontario, Canada, Department of Epidemiology and Community Medicine, University of Ottawa, Ottawa, Ontario, Canada, Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada

  • Alexis Turgeon,

    Affiliations Department of Anesthesiology and Critical Care Medicine, Division of Critical Care Medicine, Université Laval, Laval, Québec City, Québec, Canada, Population Health and Optimal Health Practice Research Unit (Trauma—Emergency—Critical Care Medicine), CHU de Québec Research Center, CHU de Québec (Hôpital de l'Enfant-Jésus), Laval, Québec City, Québec, Canada

  • Marc T. Avey,

    Affiliation The Ottawa Hospital Research Institute, Ottawa, Ontario, Canada

  • Michael A. Rudnicki,

    Affiliations Department of Medicine (Division of Critical Care), University of Ottawa, Ottawa, Ontario, Canada, The Ottawa Hospital Research Institute, Ottawa, Ontario, Canada, Department of Cell and Molecular Medicine, University of Ottawa, Ottawa, Ontario, Canada

  • Mazen Jazi,

    Affiliation University of Ottawa, Ottawa, Canada

  • Jason Fishman,

    Affiliation Department of Anesthesiology and Critical Care Medicine, Division of Critical Care Medicine, Université Laval, Laval, Québec City, Québec, Canada

  • Duncan J. Stewart,

    Affiliations The Ottawa Hospital Research Institute, Ottawa, Ontario, Canada, Department of Cell and Molecular Medicine, University of Ottawa, Ottawa, Ontario, Canada

  •  [ ... ],
  • Canadian Critical Care Translational Biology Group
  • [ view all ]
  • [ view less ]

Abstract

The Acute Respiratory Distress Syndrome (ARDS) is a devastating clinical condition that is associated with a 30–40% risk of death, and significant long term morbidity for those who survive. Mesenchymal stromal cells (MSC) have emerged as a potential novel treatment as in pre-clinical models they have been shown to modulate inflammation (a major pathophysiological hallmark of ARDS) while enhancing bacterial clearance and reducing organ injury and death. A systematic search of MEDLINE, EMBASE, BIOSIS and Web of Science was performed to identify pre-clinical studies that examined the efficacy MSCs as compared to diseased controls for the treatment of Acute Lung Injury (ALI) (the pre-clinical correlate of human ARDS) on mortality, a clinically relevant outcome. We assessed study quality and pooled results using random effect meta-analysis. A total of 54 publications met our inclusion criteria of which 17 (21 experiments) reported mortality and were included in the meta-analysis. Treatment with MSCs, as compared to controls, significantly decreased the overall odds of death in animals with ALI (Odds Ratio 0.24, 95% Confidence Interval 0.18–0.34, I2 8%). Efficacy was maintained across different types of animal models and means of ALI induction; MSC origin, source, route of administration and preparation; and the clinical relevance of the model (timing of MSC administration, administration of fluids and or antibiotics). Reporting of standard MSC characterization for experiments that used human MSCs and risks of bias was generally poor, and although not statistically significant, a funnel plot analysis for overall mortality suggested the presence of publication bias. The results from our meta-analysis support that MSCs substantially reduce the odds of death in animal models of ALI but important reporting elements were sub optimal and limit the strength of our conclusions.

Introduction

The Acute Respiratory Distress Syndrome (ARDS) was first recognized in the 1960s as a clinical syndrome of severe acute respiratory failure. Although definitions have been recently revised, the consistent hallmarks are the acuity of presentation, and the presence of severe hypoxemia and bilateral pulmonary infiltrates[1]. It is a devastating clinical condition with approximately 200 000 new cases identified per year in the United States and a case fatality rate of approximately 30–40%[1]. Those who do recover experience a significant decrease in quality of life with long term physical, physiological, and emotional dysfunction[2]. Over the last several decades many novel therapeutics have been evaluated for the treatment of ARDS yet none have proven efficacious, and thus supportive care strategies including institution of antibiotics, low tidal volume mechanical ventilation, and fluid restriction remain the mainstays of therapy[1,3]. Critiques of novel therapeutics have highlighted inadequate clinical trial design and conduct, and more recently inadequacies of preclinical design and conduct as reasons for failure of translation[46]. Recent advances in the study and knowledge of stem cells has allowed for stem cell therapy to emerge as a potential novel therapeutic for the treatment of ARDS. Mesenchymal stromal cells (MSCs) are immune-modulatory and pre-clinical studies in animal models of acute lung injury (ALI) (the pre-clinical correlate of human ARDS) suggest MSCs reduce inflammation, augment tissue repair, enhance pathogen clearance, and reduce death[711]. This systematic review was conducted to better inform a decision to translate MSC therapy for pre-clinical ALI into a human clinical trial. We aimed to systematically summarize all pre-clinical studies to examine the efficacy of this treatment as compared to a diseased control group across different animal and ALI induction models; MSC origin, source and preparation; and the clinical relevance of ALI models on the clinically relevant outcome death.

Results

Study Characteristics

Our search yielded 3810 citations to screen. After preliminary screening a total of 358 citations were pulled for full text review; 54 publications met our pre-defined eligibility criteria and were included in the review (Fig 1)[7,1062] These reported 70 experiments (Table 1, S1 File, S1 Table), of which 21(from 17 publications) reported our primary outcome death and were included in the meta-analysis.[7,10,1518,29,31,32,34,37,41,43,44,46,47,59]

Of the 70 experiments the majority originated from Asia (51%, n = 36)[10,12,1518,2022,2628,3235,3739,43,48,49,5256,5860,62], with 27% (n = 19) from North America[7,11,13,24,25,29,36,4042,47,50,51,57], 11% (n = 8) from Europe[19,23,30,44,46], 4% (n = 3) from Australia or New Zealand[14,45], and 6% (n = 4) from a collaboration between countries (n = 2 Italy/United States, n = 2 Canada/Brazil) (S1 Table)[31,61]. Rats and mice were studied in 47% (n = 33)[12,1521,23,24,2628,30,32,3436,40,42,43,48,52,53,56,60] and 46% (n = 32)[7,10,11,13,14,22,25,29,31,33,37,41,4447,4951,5759,61] of experiments, respectively, while 7% (n = 5) of experiments were conducted on rabbits[38,39,54,55,62]. Two experiments included animals with compromised immune systems (severe combined immune-deficient (SCID) mice)[14,45]. Several methods were used to induce ALI in the animals. These included direct (29%, n = 20)[7,10,11,13,21,22,25,29,33,37,49,50,55,57,58,61] and indirect (31%, n = 22) [12,15,17,31,32,34,4042,46,47,5153,59,61] lung infection or inflammation, direct (10%, n = 7)[14,4345,48,56] and indirect (10%, n = 7) [18,20,26,28,60] chemical induction, trauma (9%, n = 6) [24,36,38,39,54,62], induction by the ventilator (7%, n = 5)[19,23,30], pulmonary ischemia and reperfusion (3%, n = 2)[27,35], and a combination of the above methods (1%, n = 1)[16]. Of the 11 experiments that were infectious pre-clinical ALI models[7,10,11,17,31,41,46,47,59], 17% (n = 2) involved the administration of fluids to the animals[41,59], 8% (n = 1) the administration of antibiotics[10], and 17% (n = 2) the administration of both fluids and antibiotics[41,47].

To treat pre-clinical ALI, the majority of experiments (54%; n = 38) used syngeneic MSCs[7,16,1930,3234,38,39,41,43,4851,54,56,57,61,62], 37% (n = 26) used xenogenic cells[1015,18,31,37,40,42,45,46,52,53,5759], 9% (n = 6) allogeneic cells [36,44,46,47,55,60], and 3% (n = 2) used autologous MSCs[17,35]. The source of MSCs included bone marrow (77%, n = 54)[7,11,13,14,16,1934,36,3844,4751,5356,5962], adipose tissue (11%, n = 8)[12,17,35,46,52,57,58], and umbilical cord (11%, n = 8)[10,15,18,37,45]. MSCs were most often administered as a single dose (89%, n = 62)[7,1016,1829,3134,3656,5862] and via an intravenous route (74%, n = 52)[1216,18,20,2224,2628,3036,38,39,41,43,45,4756,5862]. In 71% (n = 50) of the experiments it was unclear if the MSCs infused were fresh or cryopreserved[7,10,12,15,16,1930,3234,3639,4349,5156,5862]; 24% (n = 17) indicated the cells infused were fresh[11,13,14,17,31,35,4042,50,57] and 4% (n = 3) indicated the cells were cryopreserved[18]. The dose of MSCs administered varied between 5.0 x 104 and 3.6 x 107. The majority (84%, n = 59) of experiments included 1 MSC intervention arm[7,1019,2145,4852,5456,5862]. Eleven (16%) of the experiments included more than one MSC arm[13,18,20,32,46,47,53,57]. Phosphate buffered saline (40%, n = 28)[7,10,11,13,2123,26,2931,33,3739,42,44,47,54,58,59,62], normal saline (31%, n = 22)[12,1418,34,36,41,45,49,50,52,55,61], and fibroblasts (21%, n = 15)[10,13,15,2325,2931,45,47,51] were the most common control agents used in the experiments.

Risk of Bias

Risk of bias[63] (S2 Table) was evaluated for the 21 experiments that reported death and were included in the meta-analysis [7,10,1518,29,31,32,34,37,41,43,44,46,47,59]. None of the 21 experiments were considered low risk of bias across all domains and none were considered low risk of bias for each of randomization, allocation concealment, and blinding. Although 48% (n = 10)[10,15,17,18,32,34,41,59] of the experiments indicated the group allocation was randomized, none described the randomization procedures or that personnel conducting the experiments were blinded to the study groups [7,10,1518,29,31,32,34,37,41,43,44,46,47,59]. For 71% (n = 15) of the experiments, animals were either allowed to die or assessors for the mortality outcome were blinded to the study groups (low risk)[7,10,16,18,29,31,34,41,44,46,47]; blinding of the mortality outcome was unclear for the remainder (29%, n = 6)[15,17,32,37,43,59]. For assessment of the 'incomplete outcome data risk of bias domain, most of the experiments were either of unclear or high risk of bias (67%, n = 14)[7,10,29,31,37,41,43,44,46,47,59], while 33% (n = 7) were low risk[1518,32,34]. The death outcome was considered selectively reported (high risk of bias) in 10% (n = 2)[43,44] of publications, with 90% of studies being assessed as low risk of bias (n = 19)[7,10,1518,29,31,32,34,37,41,46,47,59]. Other potential sources of bias (source of funding, conflict of interest and pre-specified sample size calculations) were evaluated; 1 publication was considered at low risk of bias for all three variables[17] (S3 Table).

Meta-Analysis: Primary Outcome Mortality

Mortality was reported as an outcome in 33% (n = 23) of the 70 experiments[7,10,1519,29,31,32,34,37,41,43,44,46,47,59,60]. One experiment was not included as it did not have an ALI diseased control group as a comparison[19], and another experiment did not present data in a form that allowed for number of events to be analyzed[18]. Therefore, data from 21 experiments (17 publications) were included in the meta-analysis [7,10,1518,29,31,32,34,37,41,43,44,46,47,59].

Treating pre-clinical ALI with MSCs significantly decreased the overall odds of death (Odds Ratio (OR) 0.24, 95% Confidence Interval (CI) 0.18–0.34) compared to diseased controls without substantial heterogeneity (I2 8%) (Fig 2). The odds of death were also reduced when examined at pre-specified death time points (death at less than or equal to 2 days (OR 0.31, 95% CI 0.21–0.44, I2 16%), between 2 to 4 days (OR 0.32, 95% CI 0.18–0.54, I2 23%), and greater than 4 days (OR 0.18, 95% CI 0.09–0.35, I2 0%) (Fig 3A). The treatment effect was examined for pre-specified sub groups (animal gender and species, ALI experimental model, MSC origin and source, route of administration, and MSC preparation) (Fig 3B and 3C). All of these sub groups suggested a similar protective treatment effect of MSCs with exception of one “MSC origin” subgroup that originated from one experiment[17]. In this experiment autologous adipose-derived MSCs were administered to a rat model of indirect infection model via an intraperitoneal route (OR for death 2.78, 95% CI 0.66–11.62).

thumbnail
Fig 2. Forest plot of mesenchymal stem cellson the odds of mortality in preclinical models of acute lung injury.

Letters indicate two separate mortality experiments within one publication.

https://doi.org/10.1371/journal.pone.0147170.g002

thumbnail
Fig 3. Subgroup analyses of mesenchymal stem cellson the odds of mortality in preclinical models of acute lung injury.

Fig 3A: Forest plot of mesenchymal stem cells on the odds of mortality at a priori determined time points. Fig 3B: Forest plot of mesenchymal stem cells on the odds of mortality according to animal species, gender and experimental model of acute lung injury. Fig 3C: Forest plot of mesenchymal stem cells on the odds of mortality according to MSC origin, source, preparation, and route of administration, as well as comparator control groups. Subgroup analyses conducted to examine the robustness of the treatment effect according to the clinical relevance of the ALI model (timing of MSC administration in relation to ALI induction and resuscitation of the animals) (Fig 3D) indicated a reduction in the odds of death regardless of the timing of administration of the cells, although the protective effect of MSCs appeared less the longer the delay in treatment initiation. There were no significant differences in the treatment effect of MSCs with more clinically relevant animal models (e.g. use of antibiotics, resuscitation fluid, or the combination of resuscitation fluid and antibiotics). Analyses conducted according to selective outcome reporting and incomplete outcome reporting did not reveal substantial differences in the estimate of effect (Fig 3E). Fig 3D: Forest plot of mesenchymal stem cells on the odds of mortality according to timing of MSC administration and method of resuscitation. Fig 3E: Forest plot of mesenchymal stem cells on the odds of mortality according to domains of the Cochrane Risk of Bias.

https://doi.org/10.1371/journal.pone.0147170.g003

Publication Bias

Visually, the funnel plot suggested some degree of asymmetry (e.g., possible publication bias) although this was not confirmed by Egger regression (p-value of 0.16) (Fig 4).

thumbnail
Fig 4. Funnel plot of standard error by log odds ratio for overall mortality indicates the possibility of publication bias.

https://doi.org/10.1371/journal.pone.0147170.g004

MSC Characterization

We evaluated reporting of standard MSC characterization criteria according to the International Society for Cellular Therapy guidelines[64] for the 18 of 54 publications that included the administration of human (xenogenic) MSCs (S4 Table)[1015,18,31,32,37,40,42,45,46,52,5759]. None of these reported all three criteria (plastic adherence, differentiation potential, and cell surface antigen expression). The ability for MSCs to adhere to plastic was reported in 39% (n = 7)[10,12,15,37,45,57,59] of publications. MSC differentiation into 3 cell lineages (adipocytes, osteoblasts and chondroblasts) was reported in 6% (n = 1)[10]; whereas differentiation into one or two cell lines (adipocytes and or osteoblasts) was reported in 6% (n = 1)[45] and 28% (n = 5[15,37,42,46,57] of the publications respectively. One publication (6%) reported the proportion of cell surface antigen expression in accordance with the recommended International Society for Cellular Therapy guidelines[18]. MSCs were purchased from another manufacturer in 39% (n = 7) publications[11,13,14,18,31,40,42]; none of these reported all three MSC characterization criteria according to Dominici et al[64].

Discussion

To the best of our knowledge this is the first systematic review to examine the effect of MSCs on mortality in pre-clinical ALI. The results show that treatment of pre-clinical ALI with MSCs reduces the odds of death compared to untreated diseased control animals. This was true for overall mortality, as well as mortality at pre-defined time intervals (≤2, > 2 to ≤ 4, and > 4 days). Subgroup analyses according to the species, gender, and ALI experimental model; MSC origin, source, route and preparation of MSCs; and clinical relevance of the ALI model (timing of MSC administration, administration of fluids and/or antibiotics in relevant models) all found MSCs, as compared to controls, were associated with reductions in death. Visualization of funnel plots suggested the presence of publication bias, although this was not statistically significant.

Results of our systematic review suggest that MSCs are beneficial across a range of animal models and experimental conditions and it is encouraging that the protective effects of MSCs appeared to be sustained even when more clinically relevant animal models were studied. For example, MSCs reduced death as compared to diseased controls even when the initiation of MSC therapy was delayed to longer than 6 hours post pre-clinical ALI induction. Although not statistically significant, the magnitude of reduction in the odds of death was less the longer MSC administration was delayed suggesting at least in animal models of ALI that time to treatment may impact the magnitude of effect. Antibiotics were administered in only 3 of the 11 experiments that were infectious models of ALI. The conduct of clinically relevant experiments is important in the evaluation of MSC efficacy especially when the therapeutic approach is being considered for clinical evaluation.

We found that some characteristics of study reporting were inadequate. For example, reporting on the 3 standardized characterization criteria for human MSCs[64] was poor; no publication reported on all 3 criteria. Investigators should provide more detailed reporting on the characterization of the MSCs to enable adequate comparisons across different research experiments as well as the conduct of future meta-analyses according to these variables. Empirical evidence suggests that use of reporting guidelines are effective to improve the completeness of reporting[65] and the ARRIVE (Animal Research: Reporting of In Vivo Experiments) guidelines are one way to help improve the reporting of animal studies[66].

Reporting of risk of bias domains[63] was also generally poor. None of the 21 experiments were considered a low risk of bias for all domains. Reporting these domains in pre-clinical studies is important as the methodological shortcoming that bias the treatment effects in clinical trials[67,68] may also apply to pre-clinical studies. Some pre-clinical interventional research in stroke and emergency medicine suggest that methodological weaknesses may be associated with inflations in the estimates of the effect size for different treatments[69]. As one example, although approximately 50% of experiments included in our review were reported as randomized, none explained the randomization method and none indicated that the allocation lists were concealed from personnel involved in the conduct of the experiment. Both of these domains are important measures of internal validity in randomized trials. We submit that when comparative efficacy pre-clinical MSC studies are being conducted, they should aim for the same methodological rigor as clinical trials to ensure a non-biased estimate of the true treatment effect.

Our systematic review has several strengths. We included a systematic and transparent search of the literature and involved an independent review of our search strategy to ensure identification of all eligible citations. We reported a primary outcome that is relevant in the clinical domain and several pre-specified sub group analyses to examine heterogeneity of the treatment effect. However, our review is limited by the publication of pre-clinical studies that are available in the public domain. Furthermore, since visualization of the funnel plot and the Egger's regression test suggested some evidence of publication bias, we cannot rule out that the treatment effect of MSCs could be less strong, not effective, or harmful in certain animal sub groups of unpublished data. However, the consistency of effect of MSCs observed across several subgroup analyses in the published literature is encouraging and we included a systematic search that was PRESS reviewed[70] to identify both published and unpublished studies.

In conclusion, MSCs appear substantially to reduce death in pre-clinical models of ALI and across many sub groups. Our review suggests that this therapy could provide a potential future treatment for many different types of acute lung injury and provides supportive evidence for moving toward their evaluation in human clinical trials. However, we also found that certain reporting elements related to risk of bias domains and MSC characterization were inadequate which could be improved substantially with use of a pre-clinical reporting guideline such as ARRIVE (Animal Research: Reporting of In Vivo Experiments).

Methods

Our protocol was registered on the CAMARADES website in March 2014 (http://www.dcn.ed.ac.uk/camarades/files/MSCs%20in%20preclinical%20models%20of%20acute%20lung%20injury.pdf) and published in Systematic Reviews[67]. Our methods are in accordance to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA)[71] and are briefly described here (S5 Table).

Inclusion/Exclusion Criteria

We included randomized and non-randomized studies that examined an in vivo model of experimentally induced ALI compared to a diseased control group, where MSCs were administered during or after the experimental induction of ALI. We excluded neonatal animal ALI models (i.e., mice or rats less than 10 days of age); MSC prevention studies (i.e. mesenchymal stromal cells administered prior to lung injury); studies where MSCs were differentiated, altered, or engineered to over or under express particular genes; or where MSCs were administered with another therapy or cell type (not including co-interventions such as antibiotics or steroids).

Literature Search

We searched Ovid MEDLINE (1946 onwards), Ovid MEDLINE In-Process & Other Non-Indexed Citations (1946 onwards), and Embase Classic + Embase (using the OVID platform) (1947 onwards), as well as BIOSIS (1926 onwards) and Web of Science (using Web of Knowledge) (1900 onwards) until June 5, 2013 with no language restrictions. The search was designed by an information specialist and used key words such as “Mesenchymal Stem Cells”, “Adult Respiratory Distress Syndrome”, “Acute Lung Injury”, and “Animal Experimentation” and was modified according to the database searched for best results. Prior to execution, the MEDLINE search strategy was peer reviewed using the PRESS tool (Peer Review of Electronic Search Strategies)[70]. All references were de-duplicated manually within Reference Manager prior to screening.[72]

A grey literature search of targeted conferences and animal research organizations not covered in these electronic databases was also performed. Additional references were sought through hand-searching the bibliographies of reviews and a random sample of included studies.

Screening

All citations were screened for inclusion with 2 trained systematic reviewers using a liberal accelerated method[73]. Screening occurred at two levels; title and abstracts were screened at level 1 and full-texts were screened at level 2. Disagreements were resolved by consensus and by consultation with a third member of the team when necessary.

Data Extraction

Data was collected on general study characteristics(e.g. study design, region of origin, funding sources, etc.), MSC characterization criteria (e.g. MSC source, tissue origin, dose, etc.), risk of bias (e.g. random sequence generation, blinding, etc.), and outcome measurements including death (primary) and serum/plasma inflammatory cytokines, organ function, and bacterial clearance for infectious ALI models (secondary). All data extracted were verified by a second reviewer. Disagreements during extraction were resolved by consensus or third party consultation. Data for the mortality outcome was collected as number of events. For two experiments, the sample size of the animals studied was presented as a range (n = 11–12[29]and n = 8–10[46]); authors were contacted for clarification and both responded with the actual sample size. When the number of deaths could not be ascertained, the report was excluded from further analysis (n = 1)[60].

Primary and Secondary Endpoints

Overall mortality was defined as death that was reported at the latest follow up point. Mortality was also reported at pre-specified time intervals: less than 2 days, between 2–4 days, and greater than 4 days after induction of ALI to quantify the effect of MSC treatment in pre-clinical ALI over time. This paper presents the results of the primary outcome analyses. The secondary outcome analyses will be reported in a future paper.

Assessing Risk of Bias

Risk of bias was assessed using the Cochrane Risk of Bias tool for experiments that reported mortality[63]. The Cochrane assessment examines seven domains of bias: 1) Sequence generation, 2) Allocation concealment, 3) Blinding of participants and personnel, 4) Blinding of outcome assessors, 5) Incomplete outcome data, 6) Selective outcome reporting, and 7) Other sources of bias. Other sources of bias were assessed based on the source of funding, a conflict of interest statement and sample size determination. Assessment was done in duplicate, with disagreements resolved through consensus or consultation with a third party.

Since death maybe a subjective assessment in pre-clinical experiments when it is defined according to physiological endpoints[74], for assessment of the 'blinding of the outcome' risk of bias domain we considered the experiment to be of low risk if animals were allowed to die or if it was reported in the manuscript that the assessors of this outcome were blinded to the study groups (applicable when death was defined according to a physiological endpoint).

Assessing MSC Characterization Criteria

Experiments that included the administration of human MSCs were assessed for the recommended minimal characterization criteria for multi-potent human MSCs, as defined by the International Society for Cellular Therapy (ISCT)[64]. The ISCT proposed a total of three criteria to define human MSCs: 1) the ability for MSCs to adhere to plastic in standard tissue culture flasks, 2) demonstration of multipotent differentiation potential into osteoblasts, adipocytes and chondroblasts under standard in vitro differentiating conditions, and 3) expression of specific surface antigens on the MSCs: ≥ 95% of the cells must express CD105, CD73 and CD90; ≤ 2% can express CD45, CD34, CD14 or CD11b, CD79α or CD19, and HLA-DR[64].

Analysis

Mortality data was pooled across included studies using a random effects model and described according to odds ratios and 95% confidence intervals. To allow for meta-analysis, when an experiment included multiple MSC intervention arms or diseased control arms, the mortality data were pooled into a single intervention and control value. Forest plots were utilized to visualize the data. Statistical heterogeneity of the included studies was assessed using the I2 test with 95% confidence intervals. Publication bias was assessed visually using a funnel plot and analytically using Egger’s regression test.

Planned subgroup analyses were performed to examine the heterogeneity of the treatment effect of MSCs on overall mortality (Table 1). Pre-specified subgroups included analyses according to the animal model and gender; ALI model; MSC origin, source, and preparation, route of administration; clinical relevance of the model (timing of MSC administration in relation to ALI induction and resuscitation (as defined by administration of fluids, antibiotics or fluids and antibiotics for infectious ALI models)), and risk of bias domains.

Supporting Information

S1 Table. General characteristics of all included experiments.

https://doi.org/10.1371/journal.pone.0147170.s002

(DOCX)

S2 Table. Cochrane risk of bias assessment.

https://doi.org/10.1371/journal.pone.0147170.s003

(DOCX)

S3 Table. Cochrane “other” risk of bias assessment.

https://doi.org/10.1371/journal.pone.0147170.s004

(DOCX)

S4 Table. Criteria for identification of cell population as human mesenchymal stromal cells.

https://doi.org/10.1371/journal.pone.0147170.s005

(DOCX)

Acknowledgments

We thank Becky Skidmore for designing the literature search and Kaitryn Campbell for conducting PRESS for the search strategy; Raymond Daniel for systematic search assistance; Kavita Singh for designing, screening, and data extraction forms; Misty Pratt, Grace Christou, Kavita Singh, and Mona Ghannad for extracting data; Sijia Wang and Dr. Yupu Deng for extracting Chinese articles; and Ranjeeta Mallick for statistical support. We would also like to thank the Canadian Critical Care Translational Biology Group for their contributions to the protocol design and critical review of the manuscript.

Author Contributions

Conceived and designed the experiments: LAM DM DAF SHJM ML JM MM GG JG AT MTA MAR JF DJS. Performed the experiments: LAM KJS SHJM MTA ML MJ JF. Analyzed the data: LAM DM DAF SHJM ML JM MM GG JG AT MTA DJS KJS. Wrote the paper: LAM DM DAF KJS SHJM ML JM MM GG JG AT MTA MAR MJ JF DJS.

References

  1. 1. Gotts JE, Matthay MA. Mesenchymal stem cells and acute lung injury. Crit Care Clin 2011; 27(3):719–733. pmid:21742225
  2. 2. Herridge MS, Cheung AM, Tansey CM, Matte-Martyn A, Diaz-Granados N, Al Saidi F, et al. One-year outcomes in survivors of the acute respiratory distress syndrome. N Engl J Med 2003; 348(8):683–693. pmid:12594312
  3. 3. Wiedemann HP, Wheeler AP, Bernard GR, Thompson BT, Hayden D, deBoisblanc B, et al. Comparison of two fluid-management strategies in acute lung injury. N Engl J Med 2006; 354(24):2564–2575. pmid:16714767
  4. 4. Hackam DG. Translating animal research into clinical benefit. Br Med J 2007; 334(7586):163–164.
  5. 5. Hackam DG, Redelmeier DA. Translation of research evidence from animals to humans. JAMA 2006; 296(14):1731–1732. pmid:17032985
  6. 6. Marshall JC. Why have clinical trials in sepsis failed? Trends Mol Med 2014; 20(4):195–203. pmid:24581450
  7. 7. Gupta N, Su X, Popov B, Lee JW, Serikov V, Matthay MA. Intrapulmonary delivery of bone marrow-derived mesenchymal stem cells improves survival and attenuates endotoxin-induced acute lung injury in mice. J Immunol 2007; 179(3):1855–1863. pmid:17641052
  8. 8. Yang H, Wen Y, Bin J, Hou-You Y, Yu-Tong W. Protection of bone marrow mesenchymal stem cells from acute lung injury induced by paraquat poisoning. Clin Toxicol (Phila) 2011; 49(4):298–302.
  9. 9. Islam MN, Sun L, Lindert J, Das SR, Bhattacharya J. Restoration of Alveolar Bioenergetics By Bone Marrow-Derived Mesenchymal Stromal Cells. Am J Respir Crit Care Med 2011.183.1. 2011.
  10. 10. Kim ES, Chang YS, Choi SJ, Kim JK, Yoo HS, Ahn SY, et al. Intratracheal transplantation of human umbilical cord blood-derived mesenchymal stem cells attenuates Escherichia coli-induced acute lung injury in mice. Respir Res 2011; 12:108. pmid:21843339
  11. 11. Krasnodembskaya A, Song Y, Fang X, Gupta N, Serikov V, Lee JW, et al. Antibacterial effect of human mesenchymal stem cells is mediated in part from secretion of the antimicrobial peptide LL-37. Stem Cells 2010; 28(12):2229–2238. pmid:20945332
  12. 12. Shin S, Kim Y, Jeong S, Hong S, Kim I, Lee W, et al. The therapeutic effect of human adult stem cells derived from adipose tissue in endotoxemic rat model. Int J Med Sci 2013; 10(1):8–18. pmid:23289000
  13. 13. Danchuk S, Ylostalo JH, Hossain F, Sorge R, Ramsey A, Bonvillain RW, et al. Human multipotent stromal cells attenuate lipopolysaccharide-induced acute lung injury in mice via secretion of tumor necrosis factor-alpha-induced protein 6. Stem Cell Res Ther 2011; 2(3):27. pmid:21569482
  14. 14. Lim R, Milton P, Murphy SV, Dickinson H, Chan ST, Jenkin G. Human mesenchymal stem cells reduce lung injury in immunocompromised mice but not in immunocompetent mice. Respiration 2013; 85(4):332–341. pmid:23207668
  15. 15. Li J, Li D, Liu X, Tang S, Wei F. Human umbilical cord mesenchymal stem cells reduce systemic inflammation and attenuate LPS-induced acute lung injury in rats. J Inflamm (Lond) 2012; 9(1):33.
  16. 16. Zhao Y, Yang C, Wang H, Li H, Du J, Gu W, et al. Therapeutic effects of bone marrow-derived mesenchymal stem cells on pulmonary impact injury complicated with endotoxemia in rats. Int Immunopharmacol 2013; 15(2):246–253. pmid:23273653
  17. 17. Chang CL, Leu S, Sung HC, Zhen YY, Cho CL, Chen A, et al. Impact of apoptotic adipose-derived mesenchymal stem cells on attenuating organ damage and reducing mortality in rat sepsis syndrome induced by cecal puncture and ligation. J Transl Med 2012; 10:244. pmid:23217183
  18. 18. Yang B, Bai B, Liu CX, Wang SQ, Jiang X, Zhu CL, et al. Effect of umbilical cord mesenchymal stem cells on treatment of severe acute pancreatitis in rats. Cytotherapy 2013; 15(2):154–162. pmid:23321327
  19. 19. Yilmaz S, Inandiklioglu N, Yildizdas D, Subasi C, Acikalin A, Kuyucu Y, et al. Mesenchymal stem cell: does it work in an experimental model with acute respiratory distress syndrome? Stem Cell Rev 2013; 9(1):80–92. pmid:22810359
  20. 20. Huang Y, Yin W, Zhang XM, Wang YT, Yu HY, Hao L, et al. [Optimal conditions of bone marrow mesenchymal stem cells on paraquat-induced acute lung injury in rats]. Zhonghua Lao Dong Wei Sheng Zhi Ye Bing Za Zhi 2012; 30(9):645–649. pmid:23257085
  21. 21. Qin ZH, Xu JF, Qu JM, Zhang J, Sai Y, Chen CM, et al. Intrapleural delivery of MSCs attenuates acute lung injury by paracrine/endocrine mechanism. J Cell Mol Med 2012; 16(11):2745–2753. pmid:22697354
  22. 22. Tai WL, Dong ZX, Zhang DD, Wang DH. Therapeutic effect of intravenous bone marrow-derived mesenchymal stem cell transplantation on early-stage LPS-induced acute lung injury in mice. Nan Fang Yi Ke Da Xue Xue Bao 2012; 32(3):283–290. pmid:22445968
  23. 23. Curley GF, Ansari B, Hayes M, Devaney J, Masterson C, Ryan A, et al. Effects of intratracheal mesenchymal stromal cell therapy during recovery and resolution after ventilator-induced lung injury. Anesthesiology 2013; 118(4):924–932. pmid:23377221
  24. 24. Hannoush EJ, Elhassan I, Sifri ZC, Mohr AA, Alzate WD, Livingston DH. Role of bone marrow and mesenchymal stem cells in healing after traumatic injury. Surgery 2013; 153(1):44–51. pmid:22862904
  25. 25. Ionescu L, Byrne RN, van HT, Vadivel A, Alphonse RS, Rey-Parra GJ, et al. Stem cell conditioned medium improves acute lung injury in mice: in vivo evidence for stem cell paracrine action. Am J Physiol Lung Cell Mol Physiol 2012; 303(11):L967–L977. pmid:23023971
  26. 26. Xu YL, Liu YL, Wang Q, Li G, Lu XD, Kong B. Intravenous transplantation of mesenchymal stem cells attenuates oleic acid induced acute lung injury in rats. Chin Med J (Engl) 2012; 125(11):2012–2018.
  27. 27. Chen S, Chen L, Wu X, Lin J, Fang J, Chen X, et al. Ischemia postconditioning and mesenchymal stem cells engraftment synergistically attenuate ischemia reperfusion-induced lung injury in rats. J Surg Res 2012; 178(1):81–91. pmid:22520057
  28. 28. Wang L, Tu XH, Zhao P, Song JX, Zou ZD. Protective effect of transplanted bone marrow-derived mesenchymal stem cells on pancreatitis-associated lung injury in rats. Mol Med Report 2012; 6(2):287–292.
  29. 29. Gupta N, Krasnodembskaya A, Kapetanaki M, Mouded M, Tan X, Serikov V, et al. Mesenchymal stem cells enhance survival and bacterial clearance in murine Escherichia coli pneumonia. Thorax 2012; 67(6):533–539. pmid:22250097
  30. 30. Curley GF, Hayes M, Ansari B, Shaw G, Ryan A, Barry F, et al. Mesenchymal stem cells enhance recovery and repair following ventilator-induced lung injury in the rat. Thorax 2012; 67(6):496–501. pmid:22106021
  31. 31. Krasnodembskaya A, Samarani G, Song Y, Zhuo H, Su X, Lee JW, et al. Human mesenchymal stem cells reduce mortality and bacteremia in gram-negative sepsis in mice in part by enhancing the phagocytic activity of blood monocytes. Am J Physiol Lung Cell Mol Physiol 2012; 302(10):L1003–L1013. pmid:22427530
  32. 32. Wu Q, Wang F, Hou Y, Chen S, Wang B, Lu F, et al. The effect of allogenetic bone marrow-derived mesenchymal stem cell transplantation on lung aquaporin-1 and -5 in a rat model of severe acute pancreatitis. Hepatogastroenterology 2012; 59(116):965–976. pmid:22456279
  33. 33. Song L, Xu J, Qu J, Sai Y, Chen C, Yu L, et al. A therapeutic role for mesenchymal stem cells in acute lung injury independent of hypoxia-induced mitogenic factor. J Cell Mol Med 2012; 16(2):376–385. pmid:21477220
  34. 34. Liang ZX, Sun JP, Wang P, Tian Q, Yang Z, Chen LA. Bone marrow-derived mesenchymal stem cells protect rats from endotoxin-induced acute lung injury. Chin Med J (Engl) 2011; 124(17):2715–2722.
  35. 35. Sun CK, Yen CH, Lin YC, Tsai TH, Chang LT, Kao YH, et al. Autologous transplantation of adipose-derived mesenchymal stem cells markedly reduced acute ischemia-reperfusion lung injury in a rodent model. J Transl Med 2011; 9:118. pmid:21781312
  36. 36. Hannoush EJ, Sifri ZC, Elhassan IO, Mohr AM, Alzate WD, Offin M, et al. Impact of enhanced mobilization of bone marrow derived cells to site of injury. J Trauma 2011; 71(2):283–289. pmid:21825928
  37. 37. Sun J, Han ZB, Liao W, Yang SG, Yang Z, Yu J, et al. Intrapulmonary delivery of human umbilical cord mesenchymal stem cells attenuates acute lung injury by expanding CD4+CD25+ Forkhead Boxp3 (FOXP3)+ regulatory T cells and balancing anti- and pro-inflammatory factors. Cell Physiol Biochem 2011; 27(5):587–596. pmid:21691076
  38. 38. Zhu F, Guo GH, Huang S, Chen RS, Chen W, Zhan JH. [The effect of bone marrow mesenchymal stem cells engraftment on lung tissue at early stage of smoke inhalation injury in rabbits]. Zhongguo Wei Zhong Bing Ji Jiu Yi Xue 2011; 23(1):18–20. pmid:21251360
  39. 39. Zhu F, Guo GH, Chen W, Peng Y, Xing JJ, Wang NY. [Effect of bone marrow-derived mesenchymal stem cells transplantation on the inflammatory response and lung injury in rabbit with inhalation injury]. Zhonghua Shao Shang Za Zhi 2010; 26(5):360–365. pmid:21162784
  40. 40. Yagi H, Soto-Gutierrez A, Kitagawa Y, Tilles AW, Tompkins RG, Yarmush ML. Bone marrow mesenchymal stromal cells attenuate organ injury induced by LPS and burn. Cell Transplant 2010; 19(6):823–830. pmid:20573305
  41. 41. Mei SH, Haitsma JJ, Dos Santos CC, Deng Y, Lai PF, Slutsky AS, et al. Mesenchymal stem cells reduce inflammation while enhancing bacterial clearance and improving survival in sepsis. Am J Respir Crit Care Med 2010; 182(8):1047–1057. pmid:20558630
  42. 42. Yagi H, Soto-Gutierrez A, Navarro-Alvarez N, Nahmias Y, Goldwasser Y, Kitagawa Y, et al. Reactive bone marrow stromal cells attenuate systemic inflammation via sTNFR1. Mol Ther 2010; 18(10):1857–1864. pmid:20664529
  43. 43. Lee SH, Jang AS, Kim YE, Cha JY, Kim TH, Jung S, et al. Modulation of cytokine and nitric oxide by mesenchymal stem cell transfer in lung injury/fibrosis. Respir Res 2010; 11:16. pmid:20137099
  44. 44. Leblond AL, Naud P, Forest V, Gourden C, Sagan C, Romefort B, et al. Developing cell therapy techniques for respiratory disease: intratracheal delivery of genetically engineered stem cells in a murine model of airway injury. Hum Gene Ther 2009; 20(11):1329–1343. pmid:19606934
  45. 45. Moodley Y, Atienza D, Manuelpillai U, Samuel CS, Tchongue J, Ilancheran S, et al. Human umbilical cord mesenchymal stem cells reduce fibrosis of bleomycin-induced lung injury. Am J Pathol 2009; 175(1):303–313. pmid:19497992
  46. 46. Gonzalez-Rey E, Anderson P, Gonzalez MA, Rico L, Buscher D, Delgado M. Human adult stem cells derived from adipose tissue protect against experimental colitis and sepsis. Gut 2009; 58(7):929–939. pmid:19136511
  47. 47. Nemeth K, Leelahavanichkul A, Yuen PS, Mayer B, Parmelee A, Doi K, et al. Bone marrow stromal cells attenuate sepsis via prostaglandin E(2)-dependent reprogramming of host macrophages to increase their interleukin-10 production. Nat Med 2009; 15(1):42–49. pmid:19098906
  48. 48. Zhao F, Zhang YF, Liu YG, Zhou JJ, Li ZK, Wu CG, et al. Therapeutic effects of bone marrow-derived mesenchymal stem cells engraftment on bleomycin-induced lung injury in rats. Transplant Proc 2008; 40(5):1700–1705. pmid:18589176
  49. 49. Xu J, Qu J, Cao L, Sai Y, Chen C, He L, et al. Mesenchymal stem cell-based angiopoietin-1 gene therapy for acute lung injury induced by lipopolysaccharide in mice. J Pathol 2008; 214(4):472–481. pmid:18213733
  50. 50. Mei SH, McCarter SD, Deng Y, Parker CH, Liles WC, Stewart DJ. Prevention of LPS-induced acute lung inury in mice by mesenchymal stem cells overexpressing angiopoietin 1. PLoS Med 2007; 4(9):e269. pmid:17803352
  51. 51. Xu J, Woods CR, Mora AL, Joodi R, Brigham KL, Iyer S, et al. Prevention of endotoxin-induced systemic response by bone marrow-derived mesenchymal stem cells in mice. Am J Physiol Lung Cell Mol Physiol 2007; 293(1):L131–L141. pmid:17416739
  52. 52. Gao P, Yang X, Mungur L, Kampo S, Wen Q. Adipose tissue-derived stem cells attenuate acute lung injury through eNOS and eNOS-derived NO. Int J Mol Med 2013; 1(6):1313–1318.
  53. 53. Wu H, Li T, Xu J, Huang L. Effect of mesenchymal stem cells on expression of cyclophilin A in lipopolysaccharide-induced acute lung injury rat. Journal of International Pharmaceutical Research 2012; 39(5):425–429.
  54. 54. Chen W, Zhu F, Guo GH, Zhan JH. [Effect of bone marrow mesenchymal stem cells engraftment on secretion of inflammatory cytokine in the early stages of smoke inhalation injury in rabbits]. Zhongguo Wei Zhong Bing Ji Jiu Yi Xue 2011; 23(1):21–23. pmid:21251361
  55. 55. Zhang F, Cheng J, Chu D-L, Sun Y-N, Wang C-L, Huang J. Prevention of bone marrow mesenchymal stem cell transplantation against acute lung injury in rabbits. Journal of Clinical Rehabilitative Tissue Engineering Research 2009; 13(27):5225–5228.
  56. 56. Zhao F, Li S-Q, Ti X-Y, Song L-Q, Li Z-K, Wu C-G, et al. Effects of bone marrow mesenchymal stem cells on transforming growth factor beta and monocyte chemoattractant protein-1 in lung injury rats. Journal of Clinical Rehabilitative Tissue Engineering Research 2008; 12(29):5627–5630.
  57. 57. Zhang S, Danchuk SD, Imhof KM, Semon JA, Scruggs BA, Bonvillain RW, et al. Comparison of the therapeutic effects of human and mouse adipose-derived stem cells in a murine model of lipopolysaccharide-induced acute lung injury. Stem Cell Res Ther 2013; 4(1):13. pmid:23360775
  58. 58. Chien MH, Bien MY, Ku CC, Chang YC, Pao HY, Yang YL, et al. Systemic human orbital fat-derived stem/stromal cell transplantation ameliorates acute inflammation in lipopolysaccharide-induced acute lung injury. Crit Care Med 2012; 40(4):1245–1253. pmid:22202710
  59. 59. Bi LK, Tang B, Zhu B, Xie C-L, Li S, Lin T-X, et al. Systemic delivery of IL-10 by bone marrow derived stromal cells has therapeutic benefits in sepsis therapy. Progress in Biochemistry and Biophysics 37[6], 678–685. 2010.
  60. 60. Yang H, Wen Y, Hou-You Y, Yu-Tong W, Chuan-ming L, Jian X, et al. Combined treatment with bone marrow mesenchymal stem cells and methylprednisolone in paraquat-induced acute lung injury. BMC Emerg Med 2013; 13 Suppl 1:S5. pmid:23902576
  61. 61. Maron-Gutierrez T, Silva JD, Asensi KD, Bakker-Abreu I, Shan Y, Diaz BL, et al. Effects of mesenchymal stem cell therapy on the time course of pulmonary remodeling depend on the etiology of lung injury in mice. Crit Care Med 2013; 41(11):e319–e333. pmid:23760104
  62. 62. Zhu F, Guo GH, Chen W, Wang NY. Effects of bone marrow-derived mesenchymal stem cells engraftment on vascular endothelial cell growth factor in lung tissue and plasma at early stage of smoke inhalation injury. World J Emerg Med 2010; 1(3):224–228. pmid:25214973
  63. 63. The Cochrane Collaboration, 2011. In: Higgins JPT, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions. Version 5.1.0 ed. 2011.
  64. 64. Dominici M, Le BK, Mueller I, Slaper-Cortenbach I, Marini F, Krause D, et al. Minimal criteria for defining multipotent mesenchymal stromal cells. The International Society for Cellular Therapy position statement. Cytotherapy 2006; 8(4):315–317. pmid:16923606
  65. 65. Stevens A, Shamseer L, Weinstein E, Yazdi F, Turner L, Thielman J, et al. Relation of completeness of reporting of health research to journals' endorsement of reporting guidelines: systematic review. Br Med J 2014; 348:g3804.
  66. 66. Kilkenny C, Browne WJ, Cuthill IC, Emerson M, Altman DG. Improving bioscience research reporting: the ARRIVE guidelines for reporting animal research. Osteoarthritis Cartilage 2012; 20(4):256–260. pmid:22424462
  67. 67. Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJM, Gavaghan DJ, et al. Assessing the Quality of Reports of Randomized Clinical Trials: Is Blinding Necessary? Control Clin Trials 1996; 17:1–12. pmid:8721797
  68. 68. Moher D, Pham B, Jones A, Cook DJ, Jadad AR, Moher M, et al. Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? [see comments.]. Lancet 1998; 352(9128):609–613. pmid:9746022
  69. 69. van der Worp HB, Howells DW, Sena ES, Porritt MJ, Rewell S, O'Collins V, et al. Can Animal Models of Disease Reliably Inform Human Studies? PLoS Medicine 2010; 7(3).
  70. 70. Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C. An evidence-based practice guideline for the peer review of electronic search strategies. J Clin Epidemiol 2009; 62(9):944–952. pmid:19230612
  71. 71. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med 2009; 151(4):264–9, W64. pmid:19622511
  72. 72. Reference Manager 2008, Thomson Reuters; 2008.
  73. 73. Khangura S, Konnyu K, Cushman R, Grimshaw J, Moher D. Evidence summaries: the evolution of a rapid review approach. Syst Rev 2012; 1:10. pmid:22587960
  74. 74. Canadian Council on Animal Care. CCAC Policy Stement on: ethics of animal investigation. 1989. Ottawa, Ontario.