Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

A simple prediction score system for malignant brain edema progression in large hemispheric infarction

  • KwangWook Jo,

    Affiliation Department of Neurosurgery, Bucheon St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea

  • Suhas S. Bajgur,

    Affiliation Department of Neurosurgery, School of Medicine, University of Texas, Houston, Texas, United States of America

  • Hoon Kim,

    Affiliation Department of Neurosurgery, Bucheon St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea

  • Huimahn A. Choi,

    Affiliation Department of Neurosurgery, School of Medicine, University of Texas, Houston, Texas, United States of America

  • Pil-Woo Huh ,

    jkw945453@gmail.com

    Affiliation Department of Neurosurgery, Uijeongbu St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea

  • Kiwon Lee

    Affiliation Department of Neurosurgery, School of Medicine, University of Texas, Houston, Texas, United States of America

Abstract

Malignant brain edema (MBE) due to hemispheric infarction can result in brain herniation, poor outcomes, and death; outcome may be improved if certain interventions, such as decompressive craniectomy, are performed early. We sought to generate a prediction score to easily identify those patients at high risk for MBE. 121 patients with large hemispheric infarction (LHI) (2011 to 2014) were included. Patients were divided into two groups: those who developed MBE and those who did not. Independent predictors of MBE were identified by logistic regression and a score was developed. Four factors were independently associated with MBE: baseline National Institutes of Health Stroke Scale (NIHSS) score (p = 0.048), Alberta Stroke Program Early Computed Tomography Score (ASPECTS) (p = 0.007), collateral score (CS) (p<0.001) and revascularization failure (p = 0.013). Points were assigned for each factor as follows: NIHSS ≤ 8 (= 0), 9–17 (= 1), ≥ 18 (= 2); ASPECTS≤ 7 (= 1), >8 (= 0); CS<2 (= 1), ≥2 (= 0); revascularization failure (= 1),success (= 0). The MBE Score (MBES) represents the sum of these individual points. Of 26 patients with a MBES of 0 to 1, none developed MBE. All patients with a MBES of 6 developed MBE. Both MBE development and functional outcomes were strongly associated with the MBES (p = 0.007 and 0.002, respectively). The MBE score is a simple reliable tool for the prediction of MBE.

Introduction

Malignant large hemispheric infarction (LHI) constitutes approximately 10% of supratentorial acute ischemic stroke (AIS) and has historically been associated with high morbidity and mortality. Secondary brain injury is primarily caused by malignant brain edema (MBE) that can lead to irreversible tissue damage, inadequate cerebral blood flow, increased intracranial pressure (ICP), and brain herniation [13]. Early decompressive craniectomy (DC) has been demonstrated to be an effective treatment strategy to reduce morbidity and mortality in several randomized controlled studies [47], although the ideal candidate for DC and exact timing of DC continues to be debated. Being able to identify those patients at highest risk for MBE and therefore those who may particularly benefit from early DC is important. Previous studies have identified several risk factors for the development of MBE such as: initial National Institutes of Health Stroke Scale (NIHSS) score, Alberta Stroke Program Early CT Score (ASPECTS), collateral score (CS), clot burden score (CBS) and diffusion/perfusion parameters in magnetic resonance image (MRI) [812].That being said, no simple prediction score for the development of MBE has yet been developed. The aim of this study was to identify independent risk factors for the development of MBE in order to generate a simple, reliable prediction score based on strength of association of each independent risk factor.

Subjects and methods

Patients

Institutional review board approval of Bucheon St. Mary’s Hospitlal of The catholic university of Korea was obtained for all aspects of this study (HC13RISI0087). Demographic and clinical information, baseline laboratory values, and radiologic image information was analyzed retrospectively from the stroke database of a single academic institution from January 2011 through September 2014. The severity of the patients’ initial neurological deficits was assessed via NIHSS by an experienced neurosurgeon and neurologist in the emergency department. The inclusion criteria for our study were as follows: (1) adult patients (≥18 years) with clinical and computed tomography (CT) evidence of acute ischemic stroke with CT angiography (CTA) evidence of proximal MCA occlusion, with or without internal carotid artery (ICA) occlusion; (2) MRI confirmation of acute ischemic stroke via diffusion-weighted imaging (DWI); and (3) availability of follow-up CT/CTA. Exclusion criteria were: (1) concurrent hemorrhagic stroke; (2) concurrent infarction in remote vascular territories; and (3) comorbidities likely to influence both pre-morbid and long-term functional outcomes (previous disabling neurological disease, dementia, terminal illness).

Image acquisition

All patients received urgent acute stroke imaging (non-contrast CT, CTA) in the emergency department, acquired using a standardized protocol with a 64 slice multidetector CT scanner. Axial maximum intensity projection (MIP) images were obtained with 5 mm slices [9]. The ASPECTS, CBS, and CS were independently adjudicated on the patient’s baseline scans by two experienced neurosurgeons (H.K. and K.W.J.), as previously described [7,9,13].MRI was performed on every patient to confirm AIS and determine the exact extent of infarction. Revascularization was determined via 1) peri-procedural angiography if the patient was eligible for intra-arterial therapy, and/or 2) a 24 hour post-stroke CTA, obtained in all patients. On follow-up CTA, revascularization was defined as the visualization of distal vessels in the distribution of the previously occluded MCA compared to initial CTA. A non-contrast head CT was also performed at 24 hours post-stroke in all patients to reassess brain edema. Additional imaging was then performed as needed by the clinical team.

Treatment protocol

Intravenous tissue plasminogen activator (t-PA) was given to those patients within a 3- hour time window from symptom onset. As CTA evidence of proximal large vessel occlusion was an inclusion criterion in our study, all patients within a 6 hour time window then underwent diagnostic angiography. If a proximal vessel occlusion was confirmed on angiography, intra-arterial mechanical thrombectomy was attempted using the Solitaire FR Revascularization Device.

All patients were subsequently admitted to the intensive care unit and treated according to standard protocols. All patients meeting both radiologic criteria for MBE and neurologic deterioration (NIHSS increase by greater than 2 points and decrease in the level of consciousness to a score of 1 or greater on item 1A of the NIHSS) were considered for decompressive craniectomy within 72 hours from stroke ictus without any age cut-off. The decision to perform DC was made in consultation with the patient/patient’s family and full written informed consent was obtained.

Definition of MBE cohort

The patients were divided into those who developed MBE versus those who did not. The MBE cohort was defined in accordance with previously published studies [1416] as those patients with: 1) acute, complete MCA infarction with early parenchymal hypodensity of at least 50% of the MCA territory and signs of local brain swelling such as sulcal effacement and compression of the lateral ventricle; 2) midline shift of >5 mm at the septum pellucidum or pineal gland with obliteration of the basal cisterns; and 3) neurological deterioration consisting of a NIHSS increase by >2 points and decrease in the level of consciousness to a score of ≥ 1 on item 1A of the NIHSS.

Clinical assessments

Early neurological deficits were assessed via the NIHSS by an attending neurosurgeon and intensivist [17]. Functional outcome at 90 days after symptom onset was evaluated by a rehabilitation attending using the Modified Rankin Scale (mRS) score. Favorable outcome was defined as a mRS of ≤2 and unfavorable outcome was defined as a mRS of ≥ 3 [18].

Selecting the scoring variables

We pre-specified age, gender, NIHSS, ASPECTS, clot burden score (CBS), collateral score (CS), clot location and revascularization status as probable predictors of MBE. These are parameters that could be determined within few hours of admission. The NIHSS is a standard tool for clinical assessment in AIS and baseline NIHSS is a commonly used predictor of outcome [10,19]. The NIHSS score ranges from 0–42 with higher score suggesting poor outcome. Various cut-offs have been recommended to determine severity of stroke [9,10,19]. ASPECT score is another useful scoring scale for assessing severity of LHI using CT [20]. One point is subtracted from a total of 10 to indicate evidence of a focal hypodensity and/or loss of gray/white matter differentiation in each of the 10 ASPECTS regions [20,21]. A score of 10 is normal, while a score of 0 reflects diffuse ischemic involvement in the whole MCA territory. Lower ASPECT scores are associated with greater extent of ischemic lesion in the MCA territory [22]. Clot Burden Score determines the extent of the clot in proximal anterior circulation by location and is graded on a scale of 0–10, 2 points are subtracted for a thrombus present in each of the supraclinoid segment and 1 point is subtracted for thrombus present in each of the infraclinoid segment, a score of 0 indicates complete vessel occlusion [23]. Leptomeningeal collateral circulation is critical in maintaining blood flow to the ischemic regions to reduce ischemic injury [24,25]. Despite its importance, it has been difficult to simply and quantitatively measure the degree of collateral flow. The CS is a useful tool for assessing leptomeningeal collateral circulation on CTA [9]. The range of CS scores was 0 to 3. (0 is absence of collateral supply to the occluded MCA territory. 1 is collateral supply ≤50% but >0% of the occluded MCA territory, 2 is collateral supply <100% but >50% of the occluded MCA territory, 3 is normal or greater compared to the normal contralateral hemisphere). Early recanalization may help to prevent extent of ischemic core and survive penumbra area and lead to improved clinical outcomes. Recent studies have shown rapid endovascular recanalization has been shown to improve clinical outcomes [2630].

Statistical analyses

Overall number (%), mean and standard deviation (SD), median and interquartile range (IQR) are reported as appropriate. Age, NIHSS, ASPECTS, CBS, and CS were considered continuous variables, while gender, lesion location, and revascularization status as categorical variables. Student’s t-test was used to analyze continuous variables, and χ2 or Fisher’s exact testto analyze categorical variables. Mann-Whitney U-test was used to compare medians between groups. Univariate analysis was done using logistic regression for continuous variables and χ2 or Fisher’s exact test for categorical variables. Variables with probability <0.2 from the univariate analysis were then entered into multivariate logistic regression model using forced entry method using only 3 variables at a time, thus meeting the recommendation of 10–15 events per predictor [31]. To assess the calibration of the model we used the Hosmer-Lemeshow χ2 test (P>0.05) [32]. The variance of the prediction model is described using Nagelkerke R2. Internal validation was performed using regular bootstrap sampling with 1000 repetitions [33,34]. The continuous variables were then categorized based on medians or tertiles and points were assigned to each category based on strength of association with MBE. The points were then summated to obtain the final prediction score. The area under the receiver operating characteristics (ROC) curve was used to assess the discrimination of the prediction score [35]. The threshold for statistical significance was set at p< 0.05. All statistical analyses were performed using the Statistical Package for the Social Sciences software version 22 (SPSS, Chicago, IL, USA).

Results

Baseline patient demographics

One hundred twenty-one patients with LHI hospitalized during January 2011 to September 2014were analyzed. Mean patient age was 68 years (±13.7), with 62 males (51%). The right hemisphere was infarcted in 64 patients (53%). 52 patients (43%) had evidence of carotid T-occlusion. The median (IQR) baseline NIHSS score was 12(8–22). The median (IQR) ASPECTS, CBS, and CS as assessed on initial CT/CTA were 7 (4–7), 6 (5–9), and 2 (0–2), respectively. Recanalization as evident on 24 hour follow-up CTA was achieved in 57(47%) patients. 36 patients (29.8%) developed MBE. The median (IQR) 90 day mRS was 4 (1–5). Demographic data is summarized in Table 1.

Developing the MBE score (MBES)

Seven of the pre-specified variables that had a p-value of >0.2 (Table 2) were entered into a logistic regression model with three variables at a time, two of the continuous (ASPECTS, NIHSS, CBS, CS) and one of binary predictor variable (gender, location of clot, revascularization status) (S1 Table). We used this hypothesis driven approach to address the relatively small number of outcome events in our study (N = 36) and to avoid overfitting the logistic regression model [31,36]. Four characteristic that were found to be significant across various models were then entered into a final logistic regression model to confirm if they independently predicted MBE (Table 3). An MBE risk stratification score was developed with points assigned based on strength of association. We divided the baseline NIHSS score into 3 subgroups based on study population tertiles: NIHSS ≤ 8, 9 to 17, and ≥ 18 and points were assigned 0, 1 and 2 respectively. We divided our population by tertiles to account for the score spread (0–42) and yet provide weight age comparable to other stronger predictor like CS. ASPECTS and CS were dichotomized based on medians. ASPECTS ≤ 7 received 1 point and zero if more than 7. CS was found to be the strongest independent predictor and therefore a score of <2 earned 2 points. One point was assigned if there was failure to revascularize. Individual points were then summated to calculate the total MBE score (MBES), with a range from 0 to 6 (Fig 1A). Each of the categorized variables was strongly associated with MBE (Table 4).

thumbnail
Fig 1.

(A) MBE Scoring Components and Scores. (B) Receiver operator characteristics curve showing MBES in comparison with other clinical scores (NIHSS, ASPECTS, CS) that predict MBE. Age is shown for reference only.

https://doi.org/10.1371/journal.pone.0171425.g001

MBES validation

The area under the ROC curve was 0.88 for prediction of MBE using MBES (Fig 1B). For the logistic regression model Hosmer-Lemeshow χ2and p-value were 3.87 and 0.86 respectively and Nagelkerke R2 was 0.59. A score of 5 or more had a sensitivity of 61% and a specificity of 97.6% for detection of MBE. The positive predictive value and negative predictive values were 91.7% and 85.6% respectively. The bootstrap corrected p-values were significant for all four predictor variables. Percentage of patients who developed MBE as stratified by MBES is presented in Fig 2A. None of the patients with MBES of 0 and 1 developed MBE, whereas all patients with a score of 6 developed MBE.

thumbnail
Fig 2.

(A) Rate of MBE across MBESs. (B) 90 day mRS score distribution across MBESs.

https://doi.org/10.1371/journal.pone.0171425.g002

MBES and outcome

The MBES was strongly associated with 90 day functional outcomes (p = 0.002). Patients with an MBES of 0–2 were more likely to have favorable 90 day mRS as compared to patients with a MBES of 3–6 (OR: 14.1, CI: 5.8–34.2, p<0.001). All patients with a MBES of 5 or 6 had unfavorable outcomes at 90 days (Fig 2B). Regarding mortality, the overall mortality was 9.1% (11 patients). 8 patients (73%) with a MBES of 6 died and remaining 3 survived with severe disability (mRS 5).

Discussion

Although early DC has been shown to be effective in reducing mortality and morbidity in patients with MBE [46,37], early DC before the onset of neurologic deterioration still is not commonly performed because of uncertainty of edema progression and surgery-related complications [8,9,38]. Any score that predicts the risk of MBE development would be a clinically useful tool for decision making at bedside especially to ascertain the timing of DC [812]. The objective of this study was to develop a simple, reliable prediction score using the known independent risk factors.

Understanding MBES

Clinical scoring systems provide an objective method of assessing disease severity and guides decision making. MBES is one such scoring system that we hope serves this purpose. We found four characteristics that independently predict MBE: baseline NIHSS, ASPECTS, CS, revascularization status. NIHSS has been in use for over a decade and its clinical utility is well described in the literature. Numerous studies have described NIHSS as a predictor of outcome. In this study we have shown that NIHSS also predicts MBE, and can be used in conjunction with other predictors to determine risk of MBE. Similar to our previous experience, an NIHSS≥18 was strongly associated with MBE [9].The ASPECTS is a reliable and reproducible way of quantifying the extent of parenchymal tissue damage after LHI [21]. The original ASPECTS study as well as a numerous other studies have clearly identified poor outcome in patients with score ≤7 [22]. Our study further indicates that patients with ASPECTS ≤ 7 tend to develop MBE. Presence of good collateral circulation sustains brain viability to arterial occlusion [24] on the other hand poor leptomeningeal collaterals as indicated by low CS of 0 and 1 can be ominous of continued tissue damage in presence of an ischemic insult [13]. In our study a CS of <2 strongly predicted MBE and is an important component of this scoring system.

DWI volume and Time to Peak (TTP) >+4s volumes were also powerful predictive factors. Assessment of perfusion by collateral flow and ischemic area volume is important. Although ASPECT and CS represent the extent of ischemic area and collateral flow, it does not show the perfusion state and ischemic core size. Thomalla GJ et al suggested that large DWI volume (>82 mL) and TTP >+4s volume (>162 mL) are predictive factors [39]. We acknowledge the importance of infarct volume measured by DWI. However, we chose not to include this parameter because we believe that a prediction score should be simple and feasible. In general, MRI is not the first choice for patients with suspected ischemic stroke in emergency settings because it is time consuming, and it is not always possible to conduct an MRI study in every hospital. Volume calculation and TTP measurements are not simple and need specialized programs and are not feasible especially in emergent situations. In addition, emergent perfusion MRI is often logistically difficult to perform in LHI patients.

Age is generally considered an important predictor of outcome. However, older age is also closely tied to brain atrophy and the amount of “room” available for brain edema to occur. In this study, we did not find an association between age and MBE. This may be due to a high number of older patients in our study population (54% older than 68 years). Further studies are warranted to understand the effect of age on MBE.

Decision making and MBES

Our results may provide some clues in making acute treatment decisions in patients with LHI. Patients with an MBES of 0–1 had no MBE and good outcome after medical treatment (90%, 81.3% respectively). In this group, initial medical treatment may be more beneficial. Patient with a MBES of 2 showed a slight increase in the risk of MBE (12.0%) and poor outcome (36.0%). In our study, 3 patients had a MBES of 2, all patients underwent medical treatment none died and they had a relatively high rate of good outcome (64%). In this group, close observation for MBE is needed to reduce morbidity. Patients with a MBES of 3–4 showed high risk of poor outcome (70.4%, 78.9%) although they showed relatively low rate of MBE (14.8%, 36.8%). In patients with a MBES of 4, 5 patients (26.3%) underwent DC within 72hrs. Two of them who underwent DC after 48hrs of ictus died however all patient who underwent DC within 48hrs survived and one among them showed good outcome (mRS 2) after DC. In this group, early DC (<48hrs) may be helpful to reduce mortality and morbidity. In the group with MBES of 5–6, all patients showed poor outcome regardless of surgical and medical treatment. In this group, DC should be considered only as a lifesaving measure because most patients remain severe disability. Quality of life and economic burden of long-term care should be taken into consideration in this group of patients. While, treatment decisions are currently made on a case-by-case basis according to the patient's clinical status and wishes and the expectations of their family members. MBES could be useful in surgical decision making and its role remains to be established in future studies.

Study limitations

This study has several limitations. First, this is a retrospective study, conducted with relatively a small number of patients of a single center. Second the number of outcome events (MBE) was small for multivariate analysis and therefore we had to be cautious about not over fitting the model, a validation of this model in larger study population would address this issue. Third this prediction score is based on a single-center experience and therefore needs to be externally validated before wider deployment. And finally with regards to DC, MBES is reliable for prediction of MBE and outcome according to standard treatment. However, these results may not be applicable when prophylactic DC is done (before any neurological deterioration). Our patients underwent DC after confirmation of MBE by neurologic examination and CT. MBES provides no information about the accurate timing of life-saving procedure like DC. A prospective trial is warranted to explore the relationship between MBES and timing of surgery.

True natural history of MBES 5–6 is unclear. If people withdraw care or withhold DC in this group because they believe everyone would have a poor outcome, this will be a “self-fulfilling prophecy”. It is particularly dangerous in younger patients who are likely have a great chance of survival with less disability. Further studies are needed to accurately assess the outcome of MBES 5–6, even in cases where they receive aggressive care, to ensure that their outcomes are truly poor.

Conclusion

This report of MBES is a preliminary and is the first simple grading scale for prediction of MBE progression and outcome. The MBES needs further research and validation to be used decision making in early aggressive treatment such as DC in patients with LHI. Also this decision making should include the patient's overall clinical status, expected quality of life, and wishes of patients and family.

Supporting information

S1 Table. Predictors of MBE (3 predictors at a time).

https://doi.org/10.1371/journal.pone.0171425.s001

(DOCX)

Author Contributions

  1. Conceptualization: KWJ HK.
  2. Data curation: HK SSB.
  3. Formal analysis: SSB.
  4. Investigation: HAC SSB.
  5. Methodology: P-WH KL KWJ.
  6. Project administration: P-WH.
  7. Resources: HK KWJ.
  8. Software: SSB KWJ.
  9. Supervision: P-WH KL.
  10. Validation: P-WH KL.
  11. Visualization: SSB.
  12. Writing – original draft: KL.
  13. Writing – review & editing: HAC KL KWJ.

References

  1. 1. Hacke W, Schwab S, Horn M, Spranger M, De Georgia M, von Kummer R. 'Malignant' middle cerebral artery territory infarction: clinical course and prognostic signs. Arch Neurol. 1996;53:309–15. pmid:8929152
  2. 2. Moulin DE, Lo R, Chiang J, Barnett HJ. Prognosis in middle cerebral artery occlusion. Stroke. 1985;16:282–4. pmid:3975967
  3. 3. Jeon SB, Koh Y, Choi HA, Lee K. Critical care for patients with massive ischemic stroke. J Stroke. 2014;16:146–60. pmid:25328873
  4. 4. Zweckberger K, Juettler E, Bosel J, Unterberg WA. Surgical aspects of decompression craniectomy in malignant stroke: review. Cerebrovasc Dis. 2014;38:313–23. pmid:25428636
  5. 5. Vahedi K, Vicaut E, Mateo J, Kurtz A, Orabi M, Guichard JP, et al. Sequential-design, multicenter, randomized, controlled trial of early decompressive craniectomy in malignant middle cerebral artery infarction (DECIMAL Trial). Stroke. 2007;38:2506–17. pmid:17690311
  6. 6. Juttler E, Schwab S, Schmiedek P, Unterberg A, Hennerici M, Woitzik J, et al. Decompressive Surgery for the Treatment of Malignant Infarction of the Middle Cerebral Artery (DESTINY): a randomized, controlled trial. Stroke. 2007;38:2518–25. pmid:17690310
  7. 7. Lu X, Huang B, Zheng J, Tao Y, Yu W, Tang L, et al. Decompressive craniectomy for the treatment of malignant infarction of the middle cerebral artery. Sci Rep. 2014;4:7070. pmid:25400113
  8. 8. Honeybul S, Ho KM, Gillett G. Outcome Following Decompressive Hemicraniectomy for Malignant Cerebral Infarction: Ethical Considerations. Stroke. 2015;46:2695–8. pmid:26243228
  9. 9. Kim H, Jin ST, Kim YW, Kim SR, Park IS, Jo KW. Predictors of malignant brain edema in middle cerebral artery infarction observed on CT angiography. J Clin Neurosci. 2015;22:554–60. pmid:25510537
  10. 10. Maas MB, Furie KL, Lev MH, Ay H, Singhal AB, Greer DM, et al. National Institutes of Health Stroke Scale score is poorly predictive of proximal occlusion in acute cerebral ischemia. Stroke. 2009;40:2988–93. pmid:19608992
  11. 11. Sillanpaa N, Saarinen JT, Rusanen H, Hakomaki J, Lahteela A, Numminen H, et al. The clot burden score, the Boston Acute Stroke Imaging Scale, the cerebral blood volume ASPECTS, and two novel imaging parameters in the prediction of clinical outcome of ischemic stroke patients receiving intravenous thrombolytic therapy. Neuroradiology. 2012;54:663–72. pmid:21904832
  12. 12. Chen R, Deng Z, Song Z. The prediction of malignant middle cerebral artery infarction: a predicting approach using random forest. J Stroke Cerebrovasc Dis. 2015;24:958–64. pmid:25804564
  13. 13. Lima FO, Furie KL, Silva GS, Lev MH, Camargo EC, Singhal AB, et al. The pattern of leptomeningeal collaterals on CT angiography is a strong predictor of long-term functional outcome in stroke patients with large vessel intracranial occlusion. Stroke. 2010;41:2316–22. pmid:20829514
  14. 14. Burghaus L, Liu WC, Dohmen C, Bosche B, Haupt WF. Evoked potentials in acute ischemic stroke within the first 24 h: possible predictor of a malignant course. Neurocrit Care. 2008;9:13–6. pmid:17982737
  15. 15. Schwab S, Steiner T, Aschoff A, Schwarz S, Steiner HH, Jansen O, et al. Early hemicraniectomy in patients with complete middle cerebral artery infarction. Stroke. 1998;29:1888–93. pmid:9731614
  16. 16. Arnaout OM, Aoun SG, Batjer HH, Bendok BR. Decompressive hemicraniectomy after malignant middle cerebral artery infarction: rationale and controversies. Neurosurg Focus. 2011;30:E18. pmid:21631219
  17. 17. Brott T, Adams HP Jr., Olinger CP, Marler JR, Barsan WG, Biller J, et al. Measurements of acute cerebral infarction: a clinical examination scale. Stroke. 1989;20:864–70. pmid:2749846
  18. 18. van Swieten JC, Koudstaal PJ, Visser MC, Schouten HJ, van Gijn J. Interobserver agreement for the assessment of handicap in stroke patients. Stroke. 1988;19:604–7. pmid:3363593
  19. 19. Daou B, Chalouhi N, Starke RM, Dalyai R, Hentschel K, Jabbour P, et al. Predictors of Outcome, Complications, and Recanalization of the Solitaire Device: A Study of 89 Cases. Neurosurgery. 2015;77:355–61. pmid:26075308
  20. 20. Barber PA, Demchuk AM, Zhang J, Buchan AM. Validity and reliability of a quantitative computed tomography score in predicting outcome of hyperacute stroke before thrombolytic therapy. ASPECTS Study Group. Alberta Stroke Programme Early CT Score. Lancet. 2000;355:1670–4. pmid:10905241
  21. 21. Pexman JH, Barber PA, Hill MD, Sevick RJ, Demchuk AM, Hudon ME, et al. Use of the Alberta Stroke Program Early CT Score (ASPECTS) for assessing CT scans in patients with acute stroke. AJNR Am J Neuroradiol. 2001;22:1534–42. pmid:11559501
  22. 22. MacCallum C, Churilov L, Mitchell P, Dowling R, Yan B. Low Alberta Stroke Program Early CT score (ASPECTS) associated with malignant middle cerebral artery infarction. Cerebrovasc Dis. 2014;38:39–45. pmid:25228461
  23. 23. Tan IY, Demchuk AM, Hopyan J, Zhang L, Gladstone D, Wong K, et al. CT angiography clot burden score and collateral score: correlation with clinical and radiologic outcomes in acute middle cerebral artery infarct. AJNR Am J Neuroradiol. 2009;30:525–31. pmid:19147716
  24. 24. Campbell BC, Christensen S, Tress BM, Churilov L, Desmond PM, Parsons MW, et al. Failure of collateral blood flow is associated with infarct growth in ischemic stroke. J Cereb Blood Flow Metab. 2013;33:1168–72. pmid:23652626
  25. 25. Miteff F, Levi CR, Bateman GA, Spratt N, McElduff P, Parsons MW. The independent predictive utility of computed tomography angiographic collateral status in acute ischaemic stroke. Brain. 2009;132:2231–8. pmid:19509116
  26. 26. Berkhemer OA, Fransen PS, Beumer D, van den Berg LA, Lingsma HF, Yoo AJ, et al. A randomized trial of intraarterial treatment for acute ischemic stroke. N Engl J Med. 2015;372:11–20. pmid:25517348
  27. 27. Campbell BC, Mitchell PJ, Kleinig TJ, Dewey HM, Churilov L, Yassi N, et al. Endovascular therapy for ischemic stroke with perfusion-imaging selection. N Engl J Med. 2015;372:1009–18. pmid:25671797
  28. 28. Goyal M, Demchuk AM, Menon BK, Eesa M, Rempel JL, Thornton J, et al. Randomized assessment of rapid endovascular treatment of ischemic stroke. N Engl J Med. 2015;372:1019–30. pmid:25671798
  29. 29. Saver JL, Goyal M, Bonafe A, Diener HC, Levy EI, Pereira VM, et al. Stent-retriever thrombectomy after intravenous t-PA vs. t-PA alone in stroke. N Engl J Med. 2015;372:2285–95. pmid:25882376
  30. 30. Jovin TG, Chamorro A, Cobo E, de Miquel MA, Molina CA, Rovira A, et al. Thrombectomy within 8 hours after symptom onset in ischemic stroke. N Engl J Med. 2015;372:2296–306. pmid:25882510
  31. 31. Babyak MA. What you see may not be what you get: a brief, nontechnical introduction to overfitting in regression-type models. Psychosom Med. 2004;66:411–21. pmid:15184705
  32. 32. Hosmer DW Jr, Lemeshow S. Applied logistic regression. 2nd ed. New York: John Wiley & Sons; 2004.
  33. 33. Steyerberg EW, Harrell FE Jr., Borsboom GJ, Eijkemans MJ, Vergouwe Y, Habbema JD. Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol. 2001;54:774–81. pmid:11470385
  34. 34. Efron B, Tibshirani RJ. An introduction to the bootstraped. Florida: CRC Press; 1994.
  35. 35. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36. pmid:7063747
  36. 36. Bursac Z, Gauss CH, Williams DK, Hosmer DW. Purposeful selection of variables in logistic regression. Source Code Biol Med. 2008;3:17. pmid:19087314
  37. 37. Hofmeijer J, Kappelle LJ, Algra A, Amelink GJ, van Gijn J, van der Worp HB. Surgical decompression for space-occupying cerebral infarction (the Hemicraniectomy After Middle Cerebral Artery infarction with Life-threatening Edema Trial [HAMLET]): a multicentre, open, randomised trial. Lancet Neurol. 2009;8:326–33. pmid:19269254
  38. 38. Kurland DB, Khaladj-Ghom A, Stokum JA, Carusillo B, Karimy JK, Gerzanich V, et al. Complications Associated with Decompressive Craniectomy: A Systematic Review. Neurocrit Care. 2015.
  39. 39. Thomalla GJ, Kucinski T, Schoder V, Fiehler J, Knab R, Zeumer H, et al. Prediction of malignant middle cerebral artery infarction by early perfusion- and diffusion-weighted magnetic resonance imaging. Stroke. 2003;34:1892–9. pmid:12855829