Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Transcranial Doppler-Based Surrogates for Cerebral Blood Flow: A Statistical Study

  • Joseph Hart,

    Affiliation Department of Mathematics, North Carolina State University, Raleigh, North Carolina, United States of America

  • Vera Novak,

    Affiliation Department of Neurology, Beth Israel Deaconess Medical Center, Boston, Massachusetts, United States of America

  • Charles Saunders,

    Affiliation Engineering and the Environment, University of Southampton, Southampton, United Kingdom

  • Pierre A. Gremaud

    gremaud@ncsu.edu

    Affiliation Department of Mathematics, North Carolina State University, Raleigh, North Carolina, United States of America

Abstract

It is commonly assumed that perfusion in a given cerebral territory can be inferred from Blood Flow Velocity (BFV) measurements in the corresponding stem artery. In order to test this hypothesis, we construct a cerebral blood flow (CBF) estimator based on transcranial Doppler (TCD) blood flow velocity and ten other easily available patient characteristics and clinical parameters. A total of 261 measurements were collected from 88 older patients. The estimator is based on local regression (Random Forest). Its performance is analyzed against baseline CBF from 3-D pseudocontinuous arterial spin labeling (pCASL) magnetic resonance imaging (MRI). Patient specific CBF predictions are of poor quality (r = 0.41 and p-value = 4.5 × 10−12); the hypothesis is thus not clearly supported by evidence.

Introduction

Cardiovascular diseases are the number one cause of death globally: more people die annually from them (31%) than from any other cause [1]. Cerebrovascular diseases account for a significant proportion of these deaths–nearly 40% for stroke alone. Consequently, considerable efforts are devoted to the development of cerebral blood flow (CBF) measurement methods [2]. These methods include magnetic resonance imaging (MRI), positron emission tomography (PET), single photon emission computed tomography (SPECT), perfusion CT, xenon CT and others. The relative performance of CBF measurement methods has been extensively studied [314]. For instance, two distinct MRI protocols are considered in [15]: pseudocontinuous arterial spin labeling (pCASL, which is the MRI protocol used in the present study) and phase contrast; measurements from the two protocols are only weakly correlated (r = .59). The reported results are sometimes contradictory: [7] reports strong correlation (r = .89) between dynamic susceptibility contrast MRI and pulsed Arterial Spin Labeling (ASL), while [4] finds the results from these two protocols uncorrelated.

It is often difficult to synthesize and compare such studies because of

  1. variable skill levels of the operators;
  2. differences in size and homogeneity of patient groups;
  3. population sizes that are too small to be statistically significant: among the previously cited studies, only two consider more than 35 subjects (152 subjects in [3] and 436 in [15]);
  4. differences in equipment,
  5. differences in the reported quantities and post-processing methods,
  6. inconsistencies in elapsed times between repeated measurements,
  7. differences in temporal vs. spatial resolutions across methods,
  8. inherent variability of CBF even within the same subject [16].

Reflecting the above challenges, no specific protocol is currently considered as gold standard [17].

Under the assumption of a Poiseuille flow, an estimate of CBF can be obtained from the TCD measurement of the centerline velocity v through (1) where R is a characteristic value of the vessel radius, M the mass of the territory under consideration–here, the Middle Cerebral Artery (MCA) territory–and θ the insonation angle (i.e. the angle between the ultrasound probe and the vessel). The values of M, R and θ can, in principle, be estimated from medical images for each patient. In particular, θ can be approximated through elementary trigonometry using anatomical images, the location of the insonation site and the MCA location at the depth of insonation. Formula (1) illustrates in particular the importance of the radius of the stem artery R when attempting to use BFV as a surrogate for CBF. The quadratic dependency of the flow on the radius and the possibility of varying radii during measurement are at the origin of the most strident dismissals of BFV as a possible surrogate for flow, see for instance [18]. The extent to which the radius varies during experiments is itself somewhat controversial. While both [19] and [20] analyze the MCA diameter during hypercapnia and hypocapnia through similar methodologies, these studies significantly differ in their findings [17].

Yet, over the last five years, more than 1800 studies have relied on measurements of BFV for diagnostic evaluation of CBF, vasoreactivity to CO2 and blood pressure challenges. The underlying assumption is that vasoreactivity of small vessels and perfusion in the corresponding vascular territory can be inferred from BFV measurements in the stem artery. We demonstrate in this paper that this hypothesis is not clearly supported by evidence. Our approach consists in constructing a CBF estimator based not only on blood flow velocity (BFV) measured by TCD but also on other predictors that are easy to access in a clinical setting. The approximation process is based on methods from nonparametric statistics which can handle mixtures of categorical and numerical variables as well as noisy data. More specifically, we train Random Forest approximations on various subsets of the data to predict CBF as measured by pCASL-MRI.

Materials and Methods

Subjects

The results are based on data from 88 subjects (38 men and 50 women over 50 years of mean age of 67.7±8.02 years). Participants were recruited to participate in clinical trials (ADA 1-06-CR-25; NIH-NINDS 1R01-NS045745-01A2; NIH-NIA 1 R01- AG028760A2; 2009-2011) from community advertisement and through Beth Israel Deaconess Medical Center, Joslin Diabetes Clinic patient registries and the Harvard Cooperative Program on Aging research subject registry. All participants signed the informed consent form for the studies approved by the Institutional Review Board at Beth Israel Deaconess Medical Center (BIDMC), i.e., the Committee on Clinical Investigations (CCI). The participants provided consent to the use of their data in future research. The original protocols were amended to include analyses evaluating the relationships between TCD and MRI; the amendments were approved by the BIDMC CCI. The current retrospective analyses use exclusively de-identified datasets.

The data for this retrospective analysis of 88 subjects were selected from a database of records prospectively collected at the Syncope and Falls in the Elderly Laboratory and the Center for Magnetic Resonance Imaging at BIDMC. The database was composed of records from three completed projects spanning January 2002 to February 2008: Cerebral vasoregulation in the elderly with stroke (March 2003-April 2005); Cerebral vasoregulation in diabetes (January 2002-December 2005); and Cerebral perfusion and cognitive decline in type 2 diabetes (January 2006-December 2008) (see Acknowledgment/Funding Section for grant numbers). Cohort characteristics are summarized in Table 1. BFV and CBF measurements are, ideally, acquired on both the left and right side of the brain for each patient; left and right measurements are considered independently on each side and correspond to a total of 261 measurements. For most patients, 49 of them, one left and one right measurements are available. A total of 32 patients have two left and two right measurements. A full description of the number of available measurements is given in Table 2. Several patients had multiple measurements spanning several projects (i.e., several years); this makes it possible to investigate the predictive values of this type of data, see Results and Discussion below.

thumbnail
Table 1. Cohort chacteristics and distribution of healthy, hypertensive (HTN), diabetic (DM), diabetic and hypertensive (DM-HTN) subjects.

https://doi.org/10.1371/journal.pone.0165536.t001

thumbnail
Table 2. Number of measurements (defined as either left or right MCA measurements) available per patient.

https://doi.org/10.1371/journal.pone.0165536.t002

A complete dataset for each subject includes: demographic data, laboratory values, plasma hematocrit, TCD-based BFV in MCA, pCASL perfusion, blood pressure end tidal CO2 at baseline, during hypercapnia, hypocapnia and cognitive challenge; time of flight MR angiography (TOEF MRA) to characterize vessels in the Circle of Willis (CoW) and T1 and T2 weighted images to characterize brain tissue volumes. TCD recordings were visually inspected for signal quality before including in the analysis. Baseline MCA BFV and baseline CBF from 3-D pCASL were acquired on the same day. Patients were on a no caffeine diet 24 hours before the exam. Antihypertensive medications were tapered and stopped on the day of the study; medications not affecting the cardiovascular system were allowed. The TCD and MRI protocols are discussed below.

Inclusion criteria were: (i) Healthy normotensive group: normotensive (BP under 140/90 mm Hg); not being treated for any systemic cardiovascular, renal, or neurological disease; no focal deficit on neurological exam; normal glucose and hemoglobin A1c. (ii) Hypertensive (HTN) group: BP over 140/90 mm Hg or diagnosed/treated for hypertension. (iii) Diabetes (DM) group: diagnosed and treated for type 2 diabetes mellitus for more than one year. (iv) DM-HTN group: with both hypertension and type 2 diabetes. Exclusion criteria were: type 1 DM, major event or surgery within 6 months, stroke history, carotid stenosis, intracranial stenosis, uncontrolled HTN, significant renal, liver, cardiac disease or failure, substance abuse, body mass index over 40, failed TCD insonation.

TCD protocol

About an hour after a light breakfast, participants were instrumented (PMD150 Spencer Technologies, Inc) with continuous monitoring of BFV in major Circle of Willis’ (CoW) vessels (anterior and middle cerebral arteries, ACAs and MCAs); continuous cardiovascular monitoring (beat-to-beat blood pressure, ECG), respiratory tidal volume, flow rate O2 and CO2 were simultaneously sampled at 500Hz using Labview. Blood pressure was measured beat-to-beat noninvasively from the finger using a volume-clamp method with a Portapres device (Finapres Medical Systems BV, Amsterdam, The Netherlands). TCD assessments were performed by an experienced sonographer (V.N.). Vessels were insonated bilaterally to record the maximum velocity for each vessel; probes were stabilized with 3D holders. A transtemporal window was used with sample volume set up in the Doppler mode, see Spencer Technologies and [21]. Average insonation depth was 54–57mm. The mean BFV v was calculated as an integral over time of the velocity envelope; systolic and diastolic peak velocities were recorded. Six minute supine baseline was acquired for each vascular territory. Insonation failure incidences were below 10%. Upon completion, participants were escorted to the MRI suite for MRI study.

MRI protocol

CASL [2226] is one of several Arterial Spin Labeling MRI techniques; it allows the non-invasive measurement of regional perfusion. It is based on electromagnetically labeling arterial blood water in the supplying vessels to an area under study. The CASL protocol uses “continuous” radio frequency pulses (≈ 2 seconds). After some time, the area is imaged; labeled and control states are compared to infer perfusion.

A GE 3 Tesla HDxt scanner with 8 channel brain coil was used. 3D CASL images were acquired with pseudo-continuous labeling, background suppression, and a volumetric stack of spirals fast spin echo acquisition. The resulting pseudocontinuous ASL (pCASL) [27] is a hybrid approach developed in collaboration with GE Healthcare. Modifications to the standard sequence include (i) interleaved labeling and background suppression [28] to enable longer labeling and better signal and (ii) transit time prescan [29, 30] to improve quantification of flow in subjects with vascular pathology or slow flow. Labeling was done at the level of cervical vertebra C1 for whole brain images and at the ICA level for vessel specific labeling [29]. Perfusion and vasoreactivity data were acquired through established protocols and methods [27, 29, 31, 32].

High resolution anatomical images were acquired through 3D magnetization prepared rapid gradient echo (MP-RAGE) and fluid attenuation inversion recovery (FLAIR). Perfusion images were averaged during each condition (6 minutes baseline normocapnia) to improve the signal-to-noise ratio. Perfusion and anatomical MR images (MP-RAGE and FLAIR) was co-registered to a standard template of regional vascular territories and segmented to calculate regional perfusion, gray matter, white matter, and cerebrospinal fluid volumes using the statistical parametric mapping software package (SPM, University College London, UK) [33] and tools written in IDL. ECG, end tidal O2, CO2 and blood pressure were simultaneously acquired. An anatomical template (Laboratory of Neuro Imaging, University of California, Los Angles, USA) was applied to measure gray matter (GM), white matter (WM) and intracranial volume (ICV). Vessel diameters were calculated from 3D MR angiography (time of flight, TOF) using the Medical Image Processing, Analysis, and Visualization (MIPAV) software from the Biomedical Imaging Research Services Section, NIH, Bethesda, MD, at 3 locations and averaged, see Fig 1. Based on image resolution, the accuracy of the resulting MCA diameters is conservatively estimated at ±0.4 mm.

thumbnail
Fig 1. Left: time-of-flight MRA 3-D reconstruction; right: single-slice transverse view; bottom: zoom on the locations of three MCA radius estimates.

https://doi.org/10.1371/journal.pone.0165536.g001

Predictor and response variables

We consider the pCASL-MRI CBF measurements yi, i = 1, …, N, where N is the number of observations, as response variables. The other factors xi = (xi,1, …, xi,14), i = 1, …, N, are predictor variables, namely hematocrit (HCT), intracranial volume (ICV), weight, height, grey matter to ICV fraction (GM/ICV), white matter to ICV fraction (WM/ICV), body mass index (BMI), age, head length (front to back), diabetes (Y/N), hypertension (Y/N), gender, TCD BFV and MCA diameter.

To lower the dimension of the problem and hence help prediction, we only retain one predictor from each group of strongly correlated variables. More precisely, the analysis below does not include GM/ICV or WM/ICV as they are strongly correlated to ICV, neither does it include weight which is determined by BMI and height. The 11 considered predictors are thus HCT, ICV, height, BMI, age, head length, diabetes, hypertension, gender, TCD BFV and MCA diameter. Statistical information about them is presented in Tables 1, 3 and 4. A previous version of this study included all 14 predictors; the difference between the two sets of results is barely detectable.

thumbnail
Table 3. Mean values, standard deviations, and number of measurements of the considered numerical variables which are independent of side (for age, see Table 1).

https://doi.org/10.1371/journal.pone.0165536.t003

thumbnail
Table 4. Mean values, standard deviations, and number of measurements of the considered numerical variables which are side dependent.

https://doi.org/10.1371/journal.pone.0165536.t004

Random Forests

The above dataset involves noisy measurements, correlated variables and both categorical and numerical inputs. To handle all three difficulties, we base our approach on Random Forests (RF) [34, 35] the principle of which we briefly recall. To describe a RF, we must first introduce regression trees [36, 37] which are essentially piecewise constant approximations based on the given data.

Fig 2 illustrates the construction of a regression tree for a generic problem with two predictors only. The first step of the algorithm consists in dividing the parameter space into two subdomains along either x1 = t1 or x2 = t1; the split-point t1 and the split variable, x1 or x2, are chosen so that approximation by constants on each side of t1 results in as small an error as possible. As the best constants are the mean values in each subdomain, the split point is taken so that each subdomain contains data points as similar as possible to each other. This simple recursive partitioning process is then repeated until a stopping criterion is satisfied (for instance, minimum number of data points in each subdomain [35]).

thumbnail
Fig 2. Illustration of a regression tree for a response depending on two predictors x1 and x2.

Left: tree description of the approximation of the data using five constant values ci, i = 1, …, 5; middle: geometrical depiction of the tree; right: graph of the approximating function.

https://doi.org/10.1371/journal.pone.0165536.g002

In general, the parameter space is partitioned into K “hyper-rectangular” regions Ωk, k = 1,…, K, in a space that has the dimension of the number of predictors. The response function is approximated by where x stands for the predictor variables, χk is the indicator function of Ωk and ck is a simple local model which is usually, as above, taken as the mean response in the leaf Ωk, i.e., , Ik = {j; xjΩk}.

While regression trees are fast, simple and robust to irrelevant and/or missing variables, they may suffer from low accuracy and instability as small dataset changes can result in large tree changes. By considering ensembles of trees, RFs [34, 35] partially alleviate these problems. In addition, RF based models allow for correlated parameters, nonlinear interactions, mixed data type (categorical and continuous) and can handle missing data in a natural way (see below). A RF model consists of an ensemble of trees , each tree being grown from a bootstrap sample of the N data points. The process is outlined in Algorithm 1. We take , m = 3, nmin = 5 and p = 11 in the results below.

Algorithm 1 Random Forest

function RF(x, y, , m, nmin)

Output: tree ensemble

for do

  draw a bootstrap sample with replacement of size N from the data (x, y)

  grow a tree Tt from the bootstrapped data, i.e.

  initiate domain R so as to contain all data

  for all terminal nodes R with |R| ≥ nmin do

   randomly select m variables among the p available variables

   determine the best split among these m variables

   split R into two daughter nodes

  end for

end for

end function

To make a prediction at a new point x, the values of each of the trees constructed above are averaged there (2) We refer to [35, 38] for additional information about implementation and the treatment of mixed data.

The data set contains N = 261 observations. Only 134 of these observations are complete. The imputation of missing values is an important part of data analysis and is the object of current research [39]. The flexibility of RF methods is here again an asset. We follow the iterative imputation scheme from [40] which has been shown to perform well even for mixed data. More precisely, let ξ be the N × (p + 1) data matrix, i.e., For the s-th variable ξ(s), s = 1,…, p + 1, we denote by the indices of the missing values in that column and by the rest of the indices. The data matrix ξ is then partitioned in four parts

  1. the observed part of ξ(s): ,
  2. the missing part of ξ(s): ,
  3. the part of ξ, without the s-th column, corresponding to : , i = 1,…, s − 1, s + 1,…, p + 1,
  4. the part of ξ, without the s-th column, corresponding to : , i = 1,…, s − 1, s + 1,…, p + 1.
The algorithm is initiated by making initial guesses for the missing values of ξ through mean imputation. Then, for each ξ(s), a RF is learned with predictor and response ; is then predicted by applying RF to and ξ is updated. The process is repeated till convergence of the data matrix.

Results

The scatter plot of the pCASL MRI CBF data versus the TCD velocity measurements shows no correlation, see Fig 3.

thumbnail
Fig 3. Scatter plot of the pCASL MRI CBF data versus TCD velocity.

https://doi.org/10.1371/journal.pone.0165536.g003

A comparison between pCASL MRI CBF data and TCD CBF as computed from Eq (1) (for the 98 observations for which estimations of M, R and θ are available) shows that the two are uncorrelated (r = 0.13 and p-value of 0.25). We conclude that the TCD and MRI data are not linearly correlated.

We investigate the possible existence of more involved dependencies through local regression in the form of random forest models. Four numerical experiments are conducted corresponding to four different levels of MRI measurement accessibility in the model’s learning set. In each one, an ensemble of 500 trees is constructed through bootstrap sampling. The sets on which the RF is “learned” are as follows.

  1. Experiment 1: All but one measurement: leave out one measurement cross-validation. This possibly includes multiple measurements for the same patient and the same side as the one being predicted.
  2. Experiment 2: Leave out measurements from the same patient and the same side. This possibly includes measurements for the same patient but excludes data from the same side as the one being predicted.
  3. Experiment 3: Leave out measurements taken at the same time. This possibly includes measurements taken from the same patient but at different times.
  4. Experiment 4: All but one patient: leave out one patient cross-validation. No MRI measurements from a specific patient are used to predict CBF for that patient.

Fig 4 displays the resulting relationship between predicted and observed CBF.

thumbnail
Fig 4. pCASL MRI CBF data versus predicted CBF.

From left to right and top to bottom, experiments 1 to 4, see text; corresponding relative correlations are r = 0.91, p-value = 2.2 × 10−16, r = 0.89, p-value = 2.2 × 10−16, r = .88, p-value = 2.2 × 10−16 and r = 0.41, p-value = 4.5 × 10−12.

https://doi.org/10.1371/journal.pone.0165536.g004

Discussion

The results from the above four experiments are summarized in Table 5.

thumbnail
Table 5. Correlations between predicted and measured CBF for the above four experiments.

Due to cross-validation and the number of the various measurements available, see Table 2, the number of data points used to learn the models vary.

https://doi.org/10.1371/journal.pone.0165536.t005

In experiments 1 and 2, CBF in one of the MCA territories, left or right, of a specific subject is predicted using CBF measurements taken from that subject on the opposite side. Both experiments have only limited practical interest with the possible exceptions of asymptomatic cases with poor/no insonation on one side, those who cannot undergo MRI imaging due to metal implants or cases with transient ischemia or other unexplained unilateral symptoms that would have otherwise normal imaging studies but would require continuous monitoring. In both cases, the predictor is however remarkably accurate, indicating low intrapatient variability.

In experiment 3, we only use CBF measurements taken at a different time (i.e., the subject came to the clinic on multiple occasions). There are 162 such data points as some subjects only came to the clinic one time. The results indicates that there may be some predictive power in combining TCD with previous CBF measurements.

If no CBF measurement for a specific patient informs the predictor (experiment 4), the proposed CBF estimator only gives a poor CBF approximation for that patient, as displayed in Fig 4, bottom right. The discrepancy observed in experiment 4 casts doubt on the usefulness of TCD measured BFV as a viable surrogate for CBF.

The results of experience 4 do not improve significantly if the model is learned separately on the sets of healthy and diseased subjects (r = .48 and p = 2.2 × 10−16). It is striking, as mentioned above, that adding an approximation of the insonation angle to the list of predictors (these are available for 98 observations only) does not improve correlation between predicted and observed CBF. Indeed, the insonation angle can take values from 0 to up to 40 degrees; the corresponding geometric factor 1/cos(θ), see Eq (1), can thus induce changes larger than 40% in the velocity readings. The fact that such a potentially important factor does not seem to make a significant difference points to the possible noisiness of the data.

For TCD, causes of noisiness includes the quadratic dependence of the flow on the diameter D. We rewrite Eq (1) as , where . Therefore, a relative measurement error Δ in the diameter, i.e., DD(1 + Δ), results in a relative error in surface area (and thus flow) of 2Δ + Δ2 ≈ 2Δ. In other words, a 10% relative error in diameter measurement, as is the case here and in [11], will potentially contribute over 20% of relative error in flow estimates. For MRI, the well-documented low signal-to-noise ratio [41] may contribute to noisiness of the pCASL-MRI measurements. Another potential source of noise is associated to difficulties in identifying perfusion territories. Indeed, perfusion measurements using pCASL in individual vascular territories are determined by co-registration of MR images to the standard template. There is, however, no accurate way to estimate the actual perfusion territory and collateral beds for a given patient. Imaging approaches that would specifically label MCA blood flow were not available in our protocol.

The above experiments display a noticeable bias as, for instance, a simple linear regression line would not intersect the origin in any of the four cases; this effect increases strongly as the amount of information used for inference diminishes from Experiment 1 to Experiment 4. Possible reasons for a systematic bias include the following.

  1. Underestimation of CBF through pCASL-MRI: This may result from the arterial transit time being longer than the post-labelling delay and may be exacerbated by possible collateral flows [42]. pCASL perfusion measurements also strongly correlate with hematocrit; consequently, CBF may be underestimated in subjects with lower hematocrit (common in older people) [43].
  2. Incorrect characterization of the flow profile: The predicted CBF relies on Eq (1) which results from the assumption of a Poiseuille flow, i.e., a flow where the longitudinal velocity V depends on the distance r to the centerline through , v being the centerline velocity measured by TCD. This parabolic profile is an idealization; the actual longitudinal velocity V may be a non-monotonic time-dependent function of r and/or may not have a cylindrical symmetry [44].
  3. One or more key predictors may be absent from the considered dataset.

The remarkable difference in accuracy between experiments 1-2 and 4 indicates that left and right MCA CBF are generally correlated for any given patient. Further analysis is needed to determine the predictive power of using CBF measurements from earlier visits to the clinic as in experiment 3; such a study would require additional data.

More generally, our experiments address the possibility of CBF prediction for a specific subject through data analytics by

  • collecting easily available information about that subject–the above predictors,
  • leveraging information, predictors and response, available for a group of “like-subjects” identified here through RF.

While such an approach would be an asset in the clinical setting in terms of both cost and convenience, the present results do not support its feasibility, at least for the set of predictors and response considered here.

Acknowledgments

This material is based upon work supported by the National Science Foundation (NSF) and the National Institutes of Health (NIH) under Awards No. DMS-1557761 and DMS-1522765 to P. Gremaud, by grant number UL1 RR025758 from the Harvard Clinical and Translational Science Center and award No. M01-RR-01032 from the National Center for Research Resources. Support to Dr. Novak from NIH—NINDS R01-NS045745, NIH-NIA 1R01- AG0287601A2 and from the American Diabetes Association (1-06-CR-25) is acknowledged. Dr. Novak was also supported by 1R01DK13902-01A1 unrelated to this project. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Center for Research Resources, the National Institutes of Health or the National Science Foundation.

We thank Rachael Bragg and Esther Martens for stimulating discussions and preliminary work on the analysis of the dataset.

Author Contributions

  1. Conceptualization: VN.
  2. Data curation: CS.
  3. Formal analysis: PAG.
  4. Funding acquisition: VN PAG.
  5. Investigation: JH VN PAG.
  6. Methodology: JH PAG.
  7. Resources: VN.
  8. Software: JH.
  9. Supervision: PAG.
  10. Visualization: JH.
  11. Writing – original draft: JH PAG.
  12. Writing – review & editing: PAG.

References

  1. 1. World Health Organization. Cardiovascular diseases (CVDs), Fact sheet No317; 2015.
  2. 2. Mette D, Strunk R, Zuccarello M. Cerebral blood flow measurement in neurosurgery. Trans Stroke Res. 2011;2:152–158. pmid:24323620
  3. 3. Henriksen OM, Kruuse C, Olesen J, Jensen LT, Larsson HBW, Birk S, et al. Sources of variability of resting cerebral blood flow in healthy subjects: a study using 133Xe SPECT measurements. J Cerebral Blood Flow Metab. 2013;33:787–792. pmid:23403374
  4. 4. Henriksen OM, Larsson HBW, Hansen AE, Grüner JM, Law I, Rostrup E. Estimation of intersubject variability of cerebral blood flow measurements using MRI and positron emission tomography. J Magn Reson Imaging. 2012;35:1290–1299. pmid:22246715
  5. 5. Knutsson L, Borjesson S, Larsson EM, Risberg J, Gustafson L, Passant U, et al. Absolute quantification of cerebral blood flow in normal volunteers: correlation between Xe-133SPECT and dynamic susceptibility contrast MRI. J Magn Reson Imaging. 2007;26:913–920. pmid:17896379
  6. 6. Knutsson L, Ståhlberg F, Wirestam R, van Osch MJ. Effects of blood non-linearity on absolute perfusion quantification using DSC-MRI: comparison with Xe-133 SPECT. Magn Reson Imaging. 2013;31:651–655. pmid:23375837
  7. 7. Knutsson L, van Westen D, Petersen ET, Markenroth Bloch K, Holtås S, Ståhlberg F, et al. Absolute quantification of cerebral blood flow: correlation between dynamic susceptibility contrast MRI and model-free arterial spin labeling. J Magn Reson Imaging. 2010;28:1–17. pmid:19695822
  8. 8. Koziak AM, Winter J, Lee TY, Thompson RT, St Lawrence KS. Validation study of a pulsed arterial spin labeling technique by comparison to perfusion computed tomography. Magn Reson Imaging. 2008;26:543–553. pmid:18063336
  9. 9. Qiu D, Straka M, Zun Z, Bammer R, Moseley ME, Zaharchuk G. Pseudocontinuous and velocity-selective arterial spin labeling in patients with long arterial transit delays: comparison with Xenon CT CBF. J Magn Reson Imaging. 2012;36:110–119. pmid:22359345
  10. 10. Vakil P, Lee JJ, Mouannes-Srour JJ, Derdeyn CP, Carroll TJ. Cerebrovascular occlusive disease: quantitative cerebral blood flow using dynamic susceptibility contrast MR Imaging correlates with quantitative H2[15O] PET. Radiology. 2013;266:879–886. pmid:23297337
  11. 11. Yonan KA, Greene ER, Sharrar JM, Caprihan A, Qualls C, Roldan CA. Middle cerebral artery blood flows by combining TCD velocities and MRA diameters: in vitro and in vivo validations. Ultrasound in Med & Biol. 2014;40:2692–2699. pmid:25218448
  12. 12. Zaharchuk G, Straka M, Marks MP, Albers GW, Moseley ME, Bammer R. Combined arterial spin label and dynamic susceptibility contrast measurement of cerebral blood flow. Magn Reson Med. 2010;63:1548–1556. pmid:20512858
  13. 13. van Golen LW, Kuijer JPA, Huisman MC, IJzerman RG, Barkhof F, Diamant M, et al. Quantification of cerebral blood flow in healthy volunteers and type 1 diabetic patients: comparison of MRI arterial spin labeling and [15]H2O positron emission tomography (PET). J Magn Res Im. 2014;40:1300–1309.
  14. 14. Gevers S, van Osch MJ, Bokkers RPH, Kies DA, Teeuwisse WM, Majoie CB, et al. Intra0 and multicenter reproducibility of pulsed continuous and pseudo-continuous arterial spin labeling methods for measuring cerebral perfusion. J Cerebral Blood Flow Metab. 2011;31:1706–1715. pmid:21304555
  15. 15. Dolui S, Wang Z, Wang DJJ, Mattay R, Finkel M, Elliott M, et al. Comparison of non-invasive MRI measurements of cerebral blood flow in a large multisite cohort. J Cereb Blood Flow Metab. 2016;36:1244–1256. pmid:27142868
  16. 16. Bremmer J, van Berckel BM, Persoon S, Kappelle LJ, Lammertsma AA, Kloet R, et al. Day-to-day test-retest variability of CBF, CMRO2, and OEF measurements using the dynamic 150 PET studies. Mol Imaging Biol. 2011;13:759–768. pmid:20700768
  17. 17. Ainslie PN, Hoiland RL. Transcranial Doppler ultrasound: Valid, invalid, or both? J Applied Physiol. 2014;117:1081–1083. pmid:25257879
  18. 18. Giller CA. The Emperor Has No Clothes: Velocity, Flow, and the Use of TCD. J Neuroimaging. 2003;13:97–98. pmid:12722490
  19. 19. Coverdale NS, Gati JS, Opalevych O, Perrotta A, Shoemaker JK. Cerebral blood flow velocity underestimates cerebral blood flow during modest hypercapnia and hypocapnia. J Applied Physiol. 2014;117:1090–1096. pmid:25012027
  20. 20. Verbree J, Bronzwaer ASGT, Ghariq E, Versluis MJ, Daemen MJAP, van Buchem MA, et al. Assessment of middle cerebral artery diameter during hypocapnia and hypercapnia in humans using ultra-high-field MRI. J Applied Physiol. 2014;117:1084–1089. pmid:25190741
  21. 21. Bathala L, Mehndiratta MM, Sharma VK. Trancranial Doppler: Technique and common findings (Part 1). Ann Indian Acad Neurol. 2013;16:174–179. pmid:23956559
  22. 22. Detre JA, Alsop DC. Perfusion magnetic resonance imaging with continuous arterial spin labeling: methods and clinical applications in the central nervous system. Eur J Radiol. 1999;30:115–124. pmid:10401592
  23. 23. Hajjar I, Zhao P, Alsop DC, Novak V. Hypertension and cerebral vasoreactivity: a continuous arterial spin labeling magnetic resonance imaging study. Hypertension. 2010; p. 859–864. pmid:20876450
  24. 24. Novak V, Peng CK, Atluri S. Cerebral vasoregulation during Valsalva maneuver in stroke. Clin Auton Res. 2003;13:370.
  25. 25. Novak V, Yang ACC, Lepicovsky L, Goldbeger AL, Lipsitz LA, Peng CK. Multimodal pressure-flow method to assess dynamics of cerebral autoregulation in stroke and hypertension. BioMedical Engineering Online. 2004;3:39. pmid:15504235
  26. 26. Novak V, Last D, Alsop DC. Cerebral blood flow velocity and periventricular white matter hyperintensities in type 2 diabetes. Diabetes Care. 2006;29:1529–1534. pmid:16801574
  27. 27. Dai W, de Bazelaire C, Alsop DC. Continuous flow-driven inversion for arterial spin labeling using pulsed radiofrequency and gradient fields. Magn Reson Med. 2008;60:1488–1497. pmid:19025913
  28. 28. Maleki N, Dai W, Alsop DC. Optimization of background suppression for arterial spin labeling perfusion imaging. Magn Res Mat Phys Biol Med. 2012;25:127–133. pmid:22009131
  29. 29. Dai W, Robson PM, Shankaranarayanan A, Aslop DC. Modified pulsed-continuous arterial spin labeling for labeling a single artery. Magn Reson Med. 2010;64:975–982. pmid:20665896
  30. 30. Dai WY, Robson PM, Shankaranarayanan A, Alsop DC. Reduced resolution transit delay prescan for quantitative continuous arterial spin labeling perfusion imaging. Magn Res Med. 2012;67:1252–1265. pmid:22084006
  31. 31. Novak V, Zhao P, Manor B, Sejdic E, Alsop D, Abduljalil A, et al. Adhesion molecules, altered vasoreactivity, and brain atrophy in type 2 diabetes. Diabetes Care. 2011;34:2438–2441. pmid:21926285
  32. 32. Watts TRMR, MacAskill MR, Pearson JF, Rüeger S, Pitcher TL, Livingston L, et al. Arterial spin labelling reveals an abnormal cerebral perfusion pattern in Parkinson’s disease. Brain. 2011;134:845–855. pmid:21310726
  33. 33. D’Agostino E, Maes F, Vandermeulen D, Suetens P. Non-rigid atlas-to-image registration by minimization of class-conditional image entropy. In: Barillot C, Haynor D, Hellier P, editors. Medical Image Computing and Computer-Assisted Intervention—MICCAI. Lecture notes in computer science. Springer-Verlag; 2004. p. 745–753.
  34. 34. Breiman L. Random Forests. Machine Learning. 2001;45:5–32.
  35. 35. Hastie T, Tibshirani R, Friedman J. The elements of statistical learning; data mining, inference, and prediction. 2nd ed. Springer; 2009.
  36. 36. Breiman L. Statistical modeling: the two cultures. Stat Sci. 2001;16:199–231.
  37. 37. Breiman L, Friedman JH, Olshen RA, Stone CJ. Classification and regression trees. Chapman & Hall/CRC; 1984.
  38. 38. Breiman L, Cutler A, Liaw A, Wiener M. Package’randomForest’, https://cran.r-project.org/web/packages/randomForest/randomForest.pdf; 2014.
  39. 39. Cevallos Valdiviezo H, van Aelst S. Tree-based prediction on incomplete data using imputation or surrogate decisions. Information Sc. 2015;311:163–181.
  40. 40. Stekhoven DJ, Bühlman P. MissForest–non-parametric missing value imputation for mixed-type data. Bioinformatics. 2012;28:112–118. pmid:22039212
  41. 41. Hermes M, Hagemann D, Britz P, Lieser S, Rock J, Naumann E, et al. Reproducibility of continuous arterial spin labeling perfusion MRI after 7 weeks. Magn Reson Mater Phy. 2007;20:103–115. pmid:17429703
  42. 42. Zhang K, Herzog H, Mauler J, Filss C, Okell TW, Rota Kops E, et al. Comparison of cerebral blood flow acquired by simultaneous [15O] water positron emission tomography and arterial spin labelling magnetic resonance imaging. J Cereb Blood Flow Metab. 2014;34:1373–1380. pmid:24849665
  43. 43. Zhao P, Alsop DC, AbdulJalil A, Selim M, Lipsitz L, Novak P, et al. Vasoreactivity and peri-infarct hyperintensities in stroke. Neurology. 2009;72:643–649. pmid:19221298
  44. 44. Kamenskiy AV, Dzenis YA, MacTaggart JN, Desyatova AS, Pipinos II. In vivo three-dimensional blood velocity profile shapes in the human common, internal, and external carotid arteries. J Vasc Surgery. 2011;54:1011–1020. pmid:21620627