Figures
Abstract
Alzheimer’s disease (AD), the most common form of dementia, shares many aspects of abnormal brain aging. We present a novel magnetic resonance imaging (MRI)-based biomarker that predicts the individual progression of mild cognitive impairment (MCI) to AD on the basis of pathological brain aging patterns. By employing kernel regression methods, the expression of normal brain-aging patterns forms the basis to estimate the brain age of a given new subject. If the estimated age is higher than the chronological age, a positive brain age gap estimation (BrainAGE) score indicates accelerated atrophy and is considered a risk factor for conversion to AD. Here, the BrainAGE framework was applied to predict the individual brain ages of 195 subjects with MCI at baseline, of which a total of 133 developed AD during 36 months of follow-up (corresponding to a pre-test probability of 68%). The ability of the BrainAGE framework to correctly identify MCI-converters was compared with the performance of commonly used cognitive scales, hippocampus volume, and state-of-the-art biomarkers derived from cerebrospinal fluid (CSF). With accuracy rates of up to 81%, BrainAGE outperformed all cognitive scales and CSF biomarkers in predicting conversion of MCI to AD within 3 years of follow-up. Each additional year in the BrainAGE score was associated with a 10% greater risk of developing AD (hazard rate: 1.10 [CI: 1.07–1.13]). Furthermore, the post-test probability was increased to 90% when using baseline BrainAGE scores to predict conversion to AD. The presented framework allows an accurate prediction even with multicenter data. Its fast and fully automated nature facilitates the integration into the clinical workflow. It can be exploited as a tool for screening as well as for monitoring treatment options.
Citation: Gaser C, Franke K, Klöppel S, Koutsouleris N, Sauer H, Alzheimer's Disease Neuroimaging Initiative (2013) BrainAGE in Mild Cognitive Impaired Patients: Predicting the Conversion to Alzheimer’s Disease. PLoS ONE 8(6): e67346. https://doi.org/10.1371/journal.pone.0067346
Editor: Stephen D. Ginsberg, Nathan Kline Institute and New York University School of Medicine, United States of America
Received: January 18, 2013; Accepted: May 16, 2013; Published: June 27, 2013
Copyright: © 2013 Gaser et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported by BMBF grant 01EV0709. Data used in preparation of this article were obtained from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database (adni.loni.ucla.edu). As such, the investigators within the ADNI contributed to the design and implementation of ADNI and/or provided data but did not participate in analysis or writing of this report. A complete listing of ADNI investigators can be found at: http://adni.loni.ucla.edu/wp-content/uploads/how_to_apply/ADNI_Acknowledgement_List.pdf. Data collection and sharing was funded by ADNI (National Institutes of Health (NIH) grant U01AG024904). ADNI itself is funded by the National Institute on Aging, the National Institute of Biomedical Imaging and Bioengineering, and through generous contributions from the following: Abbott, AstraZeneca AB, Bayer Schering Pharma AG, Bristol-Myers Squibb, Eisai Global Clinical Development, Elan Corporation, Genentech, GE Healthcare, GlaxoSmithKline, Innogenetics, Johnson and Johnson, Eli Lilly and Co., Medpace, Inc., Merck and Co., Inc., Novartis AG, Pfizer Inc, F. Hoffman-La Roche, Schering-Plough, Synarc, Inc., as well as non-profit partners the Alzheimer's Association and Alzheimer's Drug Discovery Foundation, with participation from the United States Food and Drug Administration. Private sector contributions to ADNI are facilitated by the Foundation for the National Institutes of Health (www.fnih.org). The grantee organization is the Northern California Institute for Research and Education, and the study is coordinated by the Alzheimer's Disease Cooperative Study at the University of California, San Diego. ADNI data are disseminated by the Laboratory for Neuro Imaging at the University of California Los Angeles. This research was also supported by NIH grants P30 AG010129, K01 AG030514, and the Dana Foundation. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Background
The global prevalence of dementia is projected to rise sharply over the coming decades. By 2050, 1 in 85 persons worldwide will be affected by Alzheimer’s disease (AD), the most common form of dementia [1]. Manifold pathological changes begin to develop years or decades before the onset of cognitive decline [2], including premature changes in gene expression [3], [4], accelerated age-associated changes of the default mode network [5], and most obviously, abnormal changes in brain structures already at the mild cognitive impairment (MCI) stage [6], [7]. Additionally, atrophic regions detected in AD patients were recently found to largely overlap with those regions showing a normal age-related decline in healthy control subjects [8].
Early detection and quantification of abnormal brain changes is important for the prospective identification and subsequent treatment of individuals at risk for cognitive decline and dementia. The best validated biomarkers for an early detection include markers of brain β-amyloid-plaque (Aβ) deposition, i.e. decreased CSF Aβ42 and positive Pittsburgh compound B (PiB) amyloid imaging, as well as markers of neurodegeneration, i.e. increased CSF tau, decreased fluorodeoxyglucose uptake on PET (FDG-PET), and structural magnetic resonance imaging (MRI) measures of cerebral atrophy [2]. More specifically, low concentrations of CSF Aβ42, associated with the formation of Aβ plaques in the brain, were found to correlate with the clinical diagnosis of AD [9], [10], but not with rates of brain atrophy [11]. The process of Aβ-plaque accumulation begins at least 5–10 years [12] or even up to two decades before probable manifestation of clinical symptoms and conversion to AD [13], but on its own is not sufficient to cause dementia [2], [14]–[18]. At some point in the AD disease course accelerated neurodegeneration takes place, preceding accelerated cognitive decline [2]. Although CSF tau was found to positively correlate with severity of cognitive impairment [12], [19], increased CSF tau is not specific for AD but seems to indicate neuronal injury and neurodegeneration in general [2], [20], [21]. Although brain atrophy in general is not specific for AD, MRI-detected atrophy was found to retain the closest relationship with cognitive decline [2], [22], [23] suggesting a crucial role for structural MRI in predicting future conversion to AD [2], [24].
Our recently introduced BrainAGE approach [25], [26] takes into account the widespread but sequential age-related brain tissue loss. Based on single time-point structural MRI the complex, multidimensional aging patterns across the whole brain are aggregated to one single value, i.e. the estimated brain age (Figure 1A). Consequently, although using only a standard MRI scan, the deviation in brain atrophy from normal brain aging can be directly quantified (Fig. 1B). We already demonstrated that the BrainAGE approach is capable of identifying pathological brain aging in subjects with MCI and AD, and observed profound relationships between BrainAGE, disease severity and prospective worsening of cognitive functions [27].
(A) The model of healthy brain aging is trained with the chronological age and preprocessed structural MRI data of a training sample (left; with an exemplary illustration of the most important voxel locations that were used by the age regression model). Subsequently, the individual brain ages of previously unseen test subjects are estimated, based on their MRI data (blue; picture modified from Schölkopf & Smola, 2002 [35]). (B) The difference between the estimated and chronological age results in the BrainAGE score, indicating abnormal brain aging. [Image reproduced from Franke & Gaser, 2012 [27], with permission from Hogrefe Publishing, Bern].
In order to explore the potential of applying the BrainAGE approach in early detection of abnormal brain changes, this study implemented this novel MRI-based biomarker to predict the conversion from MCI to AD within a time span of 36 months. We hypothesized that those individuals with greater BrainAGE scores would convert to AD with worse outcomes related to cognition and disease severity. Furthermore, a subsample of subjects with MCI, for whom CSF data are available, will be used to compare the performance of the BrainAGE framework in predicting conversion from MCI to AD to commonly used MRI and CSF biomarkers, which are widely used as state-of-the-art benchmark.
Methods
Subjects
We utilized data obtained from the ADNI database (www.loni.ucla.edu/ADNI), including all MCI subjects for whom baseline MRI data (1.5T), at least moderately confident diagnoses (i.e. confidence >2), hippocampus volumes (i.e. volumes of left and right hippocampus, calculated by FreeSurfer Version 4.3.), and test scores in certain cognitive scales (i.e. ADAS: Alzheimer’s Disease Assessment Scale, range 0–85; CDR-SB: Clinical Dementia Rating ‘sum of boxes’, range 0–18; MMSE: Mini-Mental State Examination, range 0–30) were available (data downloaded in May 2010). For the exact procedures of data collection and up-to-date information, see www.adni-info.org.
Adopting the diagnostic classification at baseline and follow-up, 195 subjects were grouped as (i) sMCI (stable MCI), if diagnosis was MCI at all available time points, but at least for 36 months (n = 62); (ii) pMCI_early (progressive MCI), if diagnosis was MCI at baseline but converted to AD within the first 12 months, without reversion to MCI or cognitive normal (NO) at any available follow-up (n = 58); (iii) pMCI_late, if diagnosis was MCI at baseline and conversion to AD was reported after the first 12 months (i.e. at 18, 24, or 36 months follow-up), without reversion to MCI or NO at any available follow-up (n = 75). Details of the characteristics of the ADNI test sample are presented in Table 1.
To compare the performance of the BrainAGE framework in predicting conversion from MCI to AD to the commonly used CSF biomarkers Aβ42, total and phosphorylated tau (T-Tau and P-Tau), a subsample of subjects with MCI, for whom those CSF data are available, is utilized (Table 1). Adopting the same criteria as described above, this subsample is grouped as sMCICSF (n = 33), pMCICSF_early (n = 32), and pMCICSF_late (n = 34). In terms of the main baseline characteristics (i.e., age, gender, education, cognition, hippocampus volumes), the CSF subsample was representative of the whole MCI sample used in this study (see Table 1).
To train and test the age estimation framework with respect to prediction accuracy and reliability, we used MRI data of healthy subjects from the publicly accessible IXI cohort (http://www.brain-development.org; data downloaded in February 2009) aged 50 years and older. To evaluate the accuracy of the age estimations, the subjects were divided into training and evaluation samples, i.e. after sorting the subjects by age every fourth subject entered the evaluation sample. Since the number of training samples was found to have the strongest influence on the accuracy of age prediction, MRI data of healthy subjects from the publicly accessible database OASIS (http://www.oasis-brains.org; data downloaded in June 2009) aged 50 years and older were also included in the training sample. In sum the training sample includes 320 cognitive normal elderly subjects. Details of the characteristics of the training sample are presented in Table 2.
Preprocessing of MRI Data and Data Reduction
Preprocessing of the T1-weighted images was done using the SPM8 package (http://www.fil.ion.ucl.ac.uk/spm) and the VBM8 toolbox (http://dbm.neuro.uni-jena.de), running under Matlab. All T1-weighted images were corrected for bias-field inhomogeneities, then spatially normalized and segmented into grey matter, white matter, and CSF within the same generative model [28]. The segmentation procedure was further extended by accounting for partial volume effects [29], by applying adaptive maximum a posteriori estimations [30], and by using a hidden Markov random field model [31] as described previously [32]. Only grey matter images were used. Following the pipeline proposed by Franke et al. [25], the images were processed with affine registration and smoothed with 8-mm full-width-at-half-maximum smoothing kernels. After smoothing, spatial resolution was set to 8 mm. Then, data reduction was performed by applying principal component analysis (PCA), utilizing the ‘Matlab Toolbox for Dimensionality Reduction’ (http://ict.ewi.tudelft.nl/~lvandermaaten/Home.html). PCA was only performed on the training sample and the estimated transformation parameters were subsequently applied to the test sample. No further data reduction or region pre-selection was accomplished.
Relevance Vector Regression (RVR)
Relevance vector machines (RVM) were introduced by Tipping [33] as a Bayesian alternative to support vector machines (SVM) for obtaining sparse solutions to pattern recognition tasks. The main idea behind SVMs is the transformation of training data from input space into high-dimensional space – the feature space – via a mapping function Φ [34], [35]. For the purpose of classification, the hyperplane that best separates the groups is computed within this feature space, resulting in a nonlinear decision boundary within the input space. The best separating hyperplane is found by maximizing the margin between the two groups. The data points lying on the margin boundaries are called support vectors since only these are used to specify the optimal separating hyperplane. For the case of real-valued output functions (rather than just binary outputs as used in classification), the SV algorithm was generalized to regression estimation [34], [35]. In support vector regression (SVR), a function has to be found that fits as many data points as possible. Analogous to the margin in classification, the regression line is surrounded by a tube. Data points lying within that tube do not influence the course of the regression line. Data points lying on the edge or outside that tube are called support vectors.
In contrast to the support vectors in SVM, the relevance vectors in RVM represent the prototypical examples within the specified classification or regression task, instead of solely representing separating attributes. Furthermore, severe overfitting associated with the maximum likelihood estimation of the model parameters was avoided by imposing an explicit zero-mean Gaussian prior [36], [37]. This prior is a characteristic feature of the RVM, and its use results in a vector of independent hyperparameters that reduces the data set [33], [38], [39]. Therefore, in most cases the number of relevance vectors is much smaller than the number of support vectors. Furthermore, in SVR additional parameters have to be determined or statistically optimized (e.g. with cross-validation loops) in order to control for model complexity and model fit. To control the behavior of the RVR, only the type of kernel has to be chosen, whereas all other parameters are automatically estimated by the learning procedure itself. More details can be found in [33], [35], [40].
Age Estimation Framework
The BrainAGE framework utilizes RVR [41] and was recently developed to estimate individual brain ages based on T1-weighted images [25]. As suggested by Franke et al. [25], the kernel was chosen to be a polynomial of degree 1, since age estimation accuracy was shown to not improve when choosing non-linear kernels. Thus, parameter optimization during the training procedure was not necessary.
In general, the model is trained with preprocessed whole brain structural MRI data (as described above) of the training sample. Subsequently, the brain age of a test subject can be estimated using the individual tissue-classified MRI data (as described above), aggregating the complex, multidimensional aging pattern across the whole brain into one single value. The difference between estimated and true chronological age will reveal the individual brain age gap estimation (BrainAGE) score. Consequently, the BrainAGE score directly quantifies the amount of acceleration or deceleration of brain aging. For example, if a 70 years old individual has a BrainAGE score of +5 years, this means that this individual shows the typical atrophy pattern of a 75 years old individual. For training the model as well as for predicting individual brain ages, we used “The Spider” (http://www.kyb.mpg.de/bs/people/spider/main.html), a freely available toolbox running under MATLAB. More detailed information as well as the most important features data that were used by the RVR for estimating the brain age can be found in Franke et al. [25].
Within this study, the framework was separately trained on male and female subjects in the training sample. With a mean absolute error of 3.8 years in the evaluation sample of healthy subjects the framework showed accurate performance in brain age estimation. Subsequently, the brain ages of the test subjects were estimated based on their baseline MRI data. The difference between the estimated and the true age resulted in the BrainAGE score, indicating accelerated (positive values) or decelerated (negative values) brain aging. PCA was performed on the training sample and the estimated transformation parameters were subsequently applied to the test subjects.
Statistical Analysis
The baseline BrainAGE scores as well as the cognitive scores (i.e. MMSE, CDR-SB, ADAS), the hippocampus volumes, and the CSF biomarker levels at baseline were compared between the diagnostic groups in both MCI test samples using an analysis of variance (ANOVA). To assess the relationship between BrainAGE and cognitive measures at baseline and follow-up, Pearson’s pairwise correlation was computed.
Receiver operating characteristics (ROC) for discriminating MCI subjects who converted to AD from those who remained stable during follow-up were computed in both MCI samples, resulting in the area under the ROC curve (AUC), which is also known as C-statistics or c-index. The AUC shows the quality of the classification, with 1.0 indicating a perfect discrimination and 0.5 indicating a result obtained by chance only. In order to test whether the resulting AUC derived from BrainAGE ROC analysis is statistically greater than the AUCs of cognitive scores, hippocampus volumes, and CSF biomarkers, one-tailed z-tests are performed. Additionally, the McNemar test for paired data was performed in order to statistically test whether predictions of conversion based on baseline BrainAGE scores are significantly better than predictions based on cognitive scores, hippocampus volumes, and CSF biomarkers.
Likelihood ratios were computed to determine the likelihood that a BrainAGE score or biomarker value above a determined threshold would be expected in pMCI relative to sMCI subjects. These ratios determined whether the use of a clinical biomarker substantially changes the post-test probability that a subject will convert to AD.
Within both MCI samples, univariate Cox regression was used to estimate the hazard rate for conversion to AD, adjusting for age, education years, and gender. The time-to-event variable was time from baseline visit to first visit with AD diagnosis for pMCI subjects. For sMCI subjects, the duration of follow-up was truncated at 3 years. The main predictor was the baseline BrainAGE score as a continuous variable initially and in quartiles subsequently. For comparison, Cox regression was also performed with baseline cognitive scores, hippocampus volumes, and CSF biomarkers as main predictors. As checked by log-minus-log-plots of survival, the assumption of proportional hazards was met for all Cox proportional hazard models. Cox regression was performed using SPSS. All other statistical testing was performed using Matlab.
Results
Whole MCI Sample
The diagnostic groups (i.e. pMCI_early, pMCI_late, sMCI) did not differ in terms age and education years (Table 1). As expected, at baseline examination all cognitive scores as well as the hippocampus volumes differed between groups (Figure 2B–F).
Shown are box plots for baseline (A) BrainAGE scores (in years), (B) MMSE scores, (C) CDR-SB scores, (D) ADAS scores, (E) left and (F) right hippocampus volumes (in mm3) of all diagnostic groups. Post-hoc t-tests resulting in significant differences between diagnostic groups are indicated (p<0.05; red lines). The boxes contain the values between the 25th and 75th percentiles, including the median (dashed line). Lines extending above and below each box symbolize data within 1.5 times the interquartile range (outliers are displayed with a +). Width of the boxes indicates the group size.
The baseline BrainAGE scores significantly differed between the diagnostic groups (F = 26.04; p<0.001), resulting in the following means: pMCI_early = 8.73 years, pMCI_late = 5.62 years, and sMCI = 0.75 years. As mentioned above, positive values indicate a higher estimated than chronological age. Post hoc t-tests showed significant differences (p<0.05) between all three diagnostic groups (Figure 2A).
As expected, cognitive abilities substantially declined during the follow-up intervals in both pMCI groups but remained stable in those who did not convert to AD (Figure 3A-C). Statistically significant correlations at baseline were only found between BrainAGE scores and CDR-SB as well as ADAS, but not for MMSE (Table 3). During follow-up, the correlations between baseline BrainAGE scores and clinical disease severity as well as cognitive functioning even increased, denoting a close relationship between pathological brain aging and prospective worsening of cognitive functioning.
Mean (A) MMSE, (B) CDR-SB, (C) ADAS scores in pMCI_early, pMCI_late, and sMCI subjects at baseline examination as well as all follow-up assessments. Error bars depict the standard error of the mean (SEM).
Our test sample included 195 subjects diagnosed with MCI at baseline. During 36 months of follow-up, a total of 133 of them developed AD, corresponding to a pre-test probability of 68%. More specifically, 30% of the MCI subjects converted to AD within the first 12 months after baseline examination (mean time to conversion: 312±96 days), whereas 38% of all MCI subjects converted to AD after the first year of follow-up (mean time to conversion: 705±228 days). By varying the threshold applied to the BrainAGE score, we constructed ROC curves for a binary discrimination between MCI subjects who remained stable during 3 years follow-up from those who converted to AD. With AUC’s (or c-index) of 0.83 and 0.78, and accuracy rates of 81% and 75% for the discrimination of sMCI vs. pMCI_early (Figure 4A) and all pMCI subjects (Figure 4B), respectively, the baseline BrainAGE score proved its encouraging potential to predict conversion to AD in MCI subjects. Furthermore, predicting future conversion to AD based on baseline BrainAGE scores was significantly more accurate than predictions based on chronological age, hippocampus volumes, and cognitive scores at baseline (Table 4).
ROC curves of individual subject classification to sMCI or pMCI based on baseline BrainAGE scores, cognitive scores, and hippocampus volumes for (A) early converters and (B) the whole sample. The areas under the ROC curves (AUCs) of cognitive scores and hippocampus volumes were tested against the AUC of BrainAGE: ***p<0.001; **p<0.01; *p<0.05.
For the whole MCI sample the post-test probability was increased to 90% when using baseline BrainAGE scores to predict conversion to AD within 36 months of follow-up (Figure 5A). This gain in certainty by 22% was highest for the baseline BrainAGE score as compared to baseline hippocampus volumes (right hippocampus: 16%; left hippocampus: 17%) or cognitive scores (MMSE: 11%; CDR-SB: 0%; ADAS: 18%).
Pre-test probability (blue) and post-test probability (blue+red), indicating the gain in prognostic certainty (red) for predicting conversion to AD within 36 months, based on (A) baseline BrainAGE scores, hippocampus volume, and cognitive measures within the whole MCI sample, as well as (B) baseline BrainAGE scores and CSF biomarkers in the CSF subsample.
Cox regression analysis showed an association of higher BrainAGE scores with a higher risk of developing AD (χ2 = 58.86, p<0.001; Table 5). Each additional year in the BrainAGE score was associated with a 10% greater risk of developing AD (hazard rate: 1.10, p<0.001; Table 5). Compared with subjects in the lowest BrainAGE quartile (−9.55 – −0.12 years), subjects in the 2nd quartile (−0.12–4.45 years) had about the same risk of developing AD (hazard ratio [HR]: 1.13; CI: 0.62–2.06; p = 0.68), those in the 3rd quartile (4.46–9.26 years) had a three times greater risk (HR: 3.12; CI: 1.80–5.40; p<0.001), and those in the 4th quartile (9.26–29.20 years) had a four times greater risk (HR: 4.66; CI: 2.61–8.29; p<0.001) of developing AD (Figure 6). Thus, MCI subjects showing abnormal atrophy patterns as marked by higher BrainAGE scores had a significantly increased risk and a cumulative probability of 88% in the 3rd quartile and 92% in the 4th quartile for conversion to AD. Furthermore, when performing Cox regression with all other baseline scores, BrainAGE again showed the best results (Table 5; Figure S1).
Kaplan-Meier survival curves based on Cox regression comparing cumulative AD incidence in subjects with MCI at baseline by BrainAGE score quartiles (p for trend <0.001). Duration of follow-up is truncated at 1250 days.
MCI Subsample with CSF Data
When comparing BrainAGE to state-of-the-art CSF biomarkers within this multi-center study, only the baseline BrainAGE scores significantly differed between the diagnostic groups in the CSF subsample (sMCICSF: 0.71 years; pMCICSF_late: 5.04; pMCICSF_early: 8.20; F = 10.82, p<0.001; Figure 7), but none of the baseline CSF biomarker levels (Table 1). BrainAGE scores in the CSF subsample did not differ between from those in the whole MCI sample (F = 0.15, p = 0.86).
Shown are box plots for (A) BrainAGE scores, (B) T-Tau, (C) P-Tau, and (D) Aβ42 concentration at baseline of all diagnostic groups in the subsample that also provides CSF data. The boxes contain the values between the 25th and 75th percentiles, including the median (grey line). Lines extending above and below each box symbolize data within 1.5 times the interquartile range (outliers are displayed with a +). Width of the boxes indicates the group size. Post-hoc t-tests resulted in significant differences between diagnostic groups only for baseline BrainAGE scores (p<0.05; red lines).
ROC analyses with baseline BrainAGE scores resulted in AUC’s (or c-index) of 0.84 and 0.75, and accuracy rates accuracy rates of 80% and 72% for the discrimination of sMCICSF vs. pMCICSF in early converters (Figure 8A) and in the whole CSF subsample (Figure 8B), respectively. Thus, baseline BrainAGE scores showed significantly better predictions than baseline T-Tau, P-Tau, and Aβ42 levels (Table 6).
ROC curves of individual subject classification to sMCICSF or pMCICSF based on baseline BrainAGE scores and CSF biomarkers for (A) early converters and (B) the whole CSF subsample. The areas under the ROC curves (AUCs) of the CSF biomarkers were tested against the AUC of BrainAGE: **p<0.01; *p<0.05.
Furthermore, when looking at the post-test probability in the CSF subsample, the pre-test probability of 67% for converting to AD within three years was increased by 21% using baseline BrainAGE scores (Figure 5B), but only slightly by using CSF biomarkers (T-Tau: 4%, P-Tau: 0%, Aβ42∶0%, Aβ42/P-Tau: 8%).
Also in the CSF subsample, Cox regression analysis showed a significant association of higher BrainAGE scores with a higher risk of developing AD (χ2 = 22.11, p<0.001; Table 5). In contrast, Cox regression with CSF biomarkers did not yield significant results for any of them (Table 7, Figure S2).
Discussion
The scope of this study was the implementation of a novel MRI-based biomarker based on the recently presented BrainAGE framework [25] to predict prospective cognitive decline and conversion to AD on an individual subject level. Using structural MRI data, our fully automated age estimation model aggregates the complex, multidimensional aging patterns across the whole brain to one single value (i.e. the BrainAGE score) and finally identifies pathological brain aging in MCI subjects who finally converted to AD within three years of follow-up, with increasing BrainAGE scores at baseline indicating an increased risk of developing AD.
This method already showed the advantage of accurately and reliably estimating the age of the brain with minimal preprocessing and parameter optimization [25], [26], using a single anatomical scan. Regarding the relevance within the clinical context, higher BrainAGE scores were recently demonstrated to be closely related to measures of clinical disease severity in AD patients, as well as prospective worsening of cognitive functioning in MCI subjects who converted to AD within three years [27]. Furthermore, already possessing higher BrainAGE scores at baseline, brain atrophy was shown to even accelerate during follow-up, with the speed of one additional year per follow-up year in pMCI subjects and 1.5 additional years per follow-up year in AD patients. Considering unequal follow-up durations in the pMCI and AD groups, this finally accumulated to mean BrainAGE scores of about 9 years at the last scan in both groups. Compared to that, sMCI and healthy control subjects did not show any irregularity in brain atrophy at baseline and follow-up [27].
In the study presented here, the BrainAGE approach was implemented to predict subsequent conversion to AD on a single subject level based on structural MRI at baseline. Focusing on subjects with mild memory impairment but preserved activities of daily life, we found accuracy rates of up to 81% for prediction of progression to AD. Even more interestingly, a high BrainAGE score increased the prognostic certainty of a subsequent conversion to AD from 68% in our clinically defined MCI sample to 90%. This gain in certainty may provide solid diagnostic grounds for early intervention strategies aimed at delaying or preventing the onset of full-scale AD in subjects at highest risk for the disease. Furthermore, our BrainAGE framework was more precise in predicting conversion of MCI to AD when compared to chronological age, cognitive scores, hippocampus volume, or state-of-the-art CSF biomarkers.
Cognitive decline was recently found to progressively accelerate years before being diagnosed as AD [42], and to be correlated with the atrophy rates in specified brain regions [43]. In addition, some studies focusing on regression methods to identify pathological brain structures specific for AD reported moderate performance measures when predicting one-year decline of cognitive functions in MCI [44]–[46]. Although not specifically trained to predict changes in cognitive scales, the BrainAGE scores estimated at baseline showed moderate correlations with measures of clinical disease severity and cognitive functioning up to three years in advance. These results as well as our recent results from a longitudinal BrainAGE study [26] support the suggested relationship between progressive acceleration in brain atrophy and worsening of cognitive functioning in progressive MCI.
Using high-dimensional pattern recognition with imaging data was recently suggested to provide a viable biomarker to detect subtle, but predictive, imaging phenotypes that precede cognitive decline while there is still opportunity for preventive or therapeutic interventions [47]. Current classification approaches attempt to identify disease-specific patterns that allow a separation of subjects with MCI or AD from healthy samples. Whilst most approaches are able to accurately differentiate between healthy controls and AD patients [48]–[50], it is the conversion from MCI to AD that is of greater clinical interest and clinical consequence. Attempting this issue, most approaches showed a substantial drop in accuracy when predicting MCI-to-AD conversion on an individual level, especially when relying on baseline data only [23], [51]–[55]. Nevertheless, individuals showing the first subtle signs of abnormal atrophy will benefit most from an early therapy, provided to reliably identify those individuals at risk of progressing to AD in future. For example, a recent study based on cortical thickness reported the accurate detection of 81% of those MCI subjects who were to be clinically diagnosed as AD patients 24 months later [52]. But this was only true when looking at those MCI subjects who were converting to AD, while ignoring those MCI subjects who did not convert. Consequently, the overall accuracy of sMCI vs. pMCI classification ranged from 48% at 6 months to 73% at 24 months. Furthermore, although a very recent study reported that combining MRI and CSF measures in a multivariate model resulted in better accuracy for predicting future conversion from MCI to AD, than using either MRI or CSF separately [56], the overall prediction accuracies for converters and non-converters ranged only from 58.6% to 66.4% at different time points. With sensitivity of 67% and specificity of 69%, another recent study [57] also achieved the most stable and reliable classification results when combining all available structural MRI features (i.e. hippocampus volume, tensor-based morphometry, cortical thickness). Thus, with accuracy rates up to 81% in predicting conversion to AD within the whole MCI sample up to three years in advance, BrainAGE is comparable or even outperforms recent classification studies that predicted decline of cognitive scores in MCI subjects or short-term conversion to AD (e.g., [51], [52]–[55], [58]).
Besides and in contrast to CSF biomarkers, MRI is non-invasive and can be performed more rapidly than a detailed neuropsychological testing. Furthermore, brain imaging is part of the diagnostic work-up [49], with MRI becoming the imaging modality of choice in many centers. Additionally, MRI was shown to retain the closest relationship with memory loss as well as worsening of clinical functions [2]. Consequently, current models of the dynamics of well established biomarkers of the Alzheimer’s pathological cascade suggest a crucial role for structural MRI in predicting future cognitive decline and conversion to AD [2], [24], [47]. Even though hippocampus volume has been shown to represent an independent risk factor for AD and robustly predicting conversion to AD in MCI subjects, the BrainAGE approach outperformed prediction utilizing baseline hippocampus volumes in the present study as well as in recently published classification studies [59]–[61].
One limitation of our approach might be that white matter lesions that occur primarily due to cerebro-vascular diseases are not detected in the segmentation approach. Those lesions are segmented as gray matter and might therefore influence the relevance vector regression. However, because such lesions only occur in a limited number of subjects it is very unlikely that they contribute to the relevance vectors because of their high local variance. In future, the segmentation should be extended by methods that allow an automated detection of white matter lesions even without any additional FLAIR sequence [62].
As stated before, the BrainAGE method builds on the assumption of AD being preceded by an acceleration in brain atrophy that resembles advanced aging (e.g., [3], [4]–[8]), although there are other studies rejecting that assumption (e.g., [63], [64]). However, the acceleration of spatiotemporal brain atrophy might only be seen in subjects in a preclinical stage, while in AD patients additional disease-specific pathological changes are occurring. Further, subjects with a high BrainAGE score but no AD-specific clinical profile may suffer from other neurodegenerative diseases. This issue should be explored by applying our framework to other neurodegenerative diseases. Furthermore, cognitive reserve, genetic status, education level, socioeconomic status, lifestyle, or vitamin supply may protect subjects from pathological brain aging or accelerated cognitive decline despite high BrainAGE scores [52], [65]–[68]. Thus, in future research we aim to disentangle age- and unrelated disease-based processes of brain tissue loss in AD. Additionally, we will elucidate the effects of the genetic status (e.g. Apolipoprotein E (APOE)) on the longitudinal changes in BrainAGE as well as on prediction of AD conversion, since especially the APOE ε4 allele is associated with modification of cognitive functioning [69]–[71] and GM reduction in AD patients [72] as well as healthy subjects [73].
In conclusion, BrainAGE has shown promising results on an individual level, contributing to an early indication of pathological brain aging in advance of severe clinical symptoms, or even predicting future cognitive decline. Compared to a wide range of existing classification approaches that require disease-specific data for training, the BrainAGE framework uses an independent database of healthy, non-demented subjects to model the normal brain-aging pattern and consequently recognizing subtle deviations from age-related brain atrophy in new test samples. As the BrainAGE approach utilizes only a single T1-weighted image per subject and already has proven to work fast and fully automated with multi-centre data, it can be easily implemented in clinical routine to encourage the identification of subtly abnormal atrophy patterns.
Supporting Information
Figure S1.
Cumulative probability of remaining AD-free in the whole MCI sample. Kaplan-Meier survival curves based on Cox regression comparing cumulative AD incidence in subjects with MCI at baseline by all baseline scores split at median. Duration of follow-up is truncated at 1250 days.
https://doi.org/10.1371/journal.pone.0067346.s001
(TIFF)
Figure S2.
Cumulative probability of remaining AD-free in the CSF subsample. Kaplan-Meier survival curves based on Cox regression comparing cumulative AD incidence in subjects with MCI at baseline by all CSF biomarker baseline levels split at median. Duration of follow-up is truncated at 1250 days.
https://doi.org/10.1371/journal.pone.0067346.s002
(TIFF)
Table S1.
Subject IDs from the ADNI database of the MCI test samples used in this study (subjects of the CSF subsample are indicated).
https://doi.org/10.1371/journal.pone.0067346.s003
(DOCX)
Acknowledgments
We are grateful to Dr. Rachel Yotter for her comments on the manuscript.
Data used in preparation of this article were obtained from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database (adni.loni.ucla.edu). As such, the investigators within the ADNI contributed to the design and implementation of ADNI and/or provided data but did not participate in analysis or writing of this report. A complete listing of ADNI investigators can be found at: http://adni.loni.ucla.edu/wp-content/uploads/how_to_apply/ADNI_Acknowledgement_List.pdf.
Author Contributions
Conceived and designed the experiments: CG KF. Analyzed the data: KF. Wrote the paper: CG KF. Commented on the manuscript: SK NK HS.
References
- 1. Brookmeyer R, Johnson E, Ziegler-Graham K, Arrighi HM (2007) Forecasting the global burden of Alzheimer's disease. Alzheimers Dement 3: 186–191.
- 2. Jack CR Jr, Knopman DS, Jagust WJ, Shaw LM, Aisen PS, et al. (2010) Hypothetical model of dynamic biomarkers of the Alzheimer's pathological cascade. Lancet Neurol 9: 119–128.
- 3. Cao K, Chen-Plotkin AS, Plotkin JB, Wang LS (2010) Age-correlated gene expression in normal and neurodegenerative human brain tissues. PLoS One 5: e13098.
- 4. Saetre P, Jazin E, Emilsson L (2011) Age-related changes in gene expression are accelerated in Alzheimer's disease. Synapse 65: 971–974.
- 5. Jones DT, Machulda MM, Vemuri P, McDade EM, Zeng G, et al. (2011) Age-related changes in the default mode network are more advanced in Alzheimer disease. Neurology 77: 1524–1531.
- 6. Driscoll I, Davatzikos C, An Y, Wu X, Shen D, et al. (2009) Longitudinal pattern of regional brain volume change differentiates normal aging from MCI. Neurology 72: 1906–1913.
- 7. Spulber G, Niskanen E, MacDonald S, Smilovici O, Chen K, et al. (2010) Whole brain atrophy rate predicts progression from MCI to Alzheimer's disease. Neurobiology of Aging 31: 1601–1605.
- 8. Dukart J, Schroeter ML, Mueller K (2011) Age correction in dementia–matching to a healthy brain. PLoS One 6: e22193.
- 9. Clark CM, Xie S, Chittams J, Ewbank D, Peskind E, et al. (2003) Cerebrospinal fluid tau and beta-amyloid: how well do these biomarkers reflect autopsy-confirmed dementia diagnoses? Arch Neurol 60: 1696–1702.
- 10. Strozyk D, Blennow K, White LR, Launer LJ (2003) CSF Abeta 42 levels correlate with amyloid-neuropathology in a population-based autopsy study. Neurology 60: 652–656.
- 11. Josephs KA, Whitwell JL, Ahmed Z, Shiung MM, Weigand SD, et al. (2008) Beta-amyloid burden is not associated with rates of brain atrophy. Ann Neurol 63: 204–212.
- 12. Buchhave P, Minthon L, Zetterberg H, Wallin AK, Blennow K, et al. (2012) Cerebrospinal fluid levels of beta-amyloid 1–42, but not of tau, are fully changed already 5 to 10 years before the onset of Alzheimer dementia. Arch Gen Psychiatry 69: 98–106.
- 13. Jack CR Jr, Lowe VJ, Weigand SD, Wiste HJ, Senjem ML, et al. (2009) Serial PIB and MRI in normal, mild cognitive impairment and Alzheimer's disease: implications for sequence of pathological events in Alzheimer's disease. Brain 132: 1355–1365.
- 14. Aizenstein HJ, Nebes RD, Saxton JA, Price JC, Mathis CA, et al. (2008) Frequent amyloid deposition without significant cognitive impairment among the elderly. Arch Neurol 65: 1509–1517.
- 15. Peskind ER, Li G, Shofer J, Quinn JF, Kaye JA, et al. (2006) Age and apolipoprotein E*4 allele effects on cerebrospinal fluid beta-amyloid 42 in adults with normal cognition. Arch Neurol 63: 936–939.
- 16. Price JL, McKeel DW Jr, Buckles VD, Roe CM, Xiong C, et al. (2009) Neuropathology of nondemented aging: presumptive evidence for preclinical Alzheimer disease. Neurobiol Aging 30: 1026–1036.
- 17. Price JL, Morris JC (1999) Tangles and plaques in nondemented aging and "preclinical" Alzheimer's disease. Ann Neurol 45: 358–368.
- 18. Savva GM, Wharton SB, Ince PG, Forster G, Matthews FE, et al. (2009) Age, neuropathology, and dementia. N Engl J Med 360: 2302–2309.
- 19. Shaw LM, Vanderstichele H, Knapik-Czajka M, Clark CM, Aisen PS, et al. (2009) Cerebrospinal fluid biomarker signature in Alzheimer's disease neuroimaging initiative subjects. Ann Neurol 65: 403–413.
- 20. Hesse C, Rosengren L, Andreasen N, Davidsson P, Vanderstichele H, et al. (2001) Transient increase in total tau but not phospho-tau in human cerebrospinal fluid after acute stroke. Neurosci Lett 297: 187–190.
- 21. Schoonenboom NS, Reesink FE, Verwey NA, Kester MI, Teunissen CE, et al. (2012) Cerebrospinal fluid markers for differential dementia diagnosis in a large memory clinic cohort. Neurology 78: 47–54.
- 22. Vemuri P, Wiste HJ, Weigand SD, Shaw LM, Trojanowski JQ, et al. (2009) MRI and CSF biomarkers in normal, MCI, and AD subjects: diagnostic discrimination and cognitive correlations. Neurology 73: 287–293.
- 23. Vemuri P, Wiste HJ, Weigand SD, Shaw LM, Trojanowski JQ, et al. (2009) MRI and CSF biomarkers in normal, MCI, and AD subjects: predicting future clinical change. Neurology 73: 294–301.
- 24. Frisoni GB, Fox NC, Jack CR Jr, Scheltens P, Thompson PM (2010) The clinical use of structural MRI in Alzheimer disease. Nat Rev Neurol 6: 67–77.
- 25. Franke K, Ziegler G, Klöppel S, Gaser C, the Alzheimer's Disease Neuroimaging Initiative (2010) Estimating the age of healthy subjects from T1-weighted MRI scans using kernel methods: Exploring the influence of various parameters. NeuroImage 50: 883–892.
- 26. Franke K, Luders E, May A, Wilke M, Gaser C (2012) Brain maturation: Predicting individual BrainAGE in children and adolescents using structural MRI. NeuroImage 63: 1305–1312.
- 27. Franke K, Gaser C, for the Alzheimer's Disease Neuroimaging Initiative (2012) Longitudinal changes in individual BrainAGE in healthy aging, mild cognitive impairment, and Alzheimer’s disease. GeroPsych: The Journal of Gerontopsychology and Geriatric Psychiatry 25: 235–245.
- 28. Ashburner J, Friston KJ (2005) Unified segmentation. NeuroImage 26: 839–851.
- 29. Tohka J, Zijdenbos A, Evans A (2004) Fast and robust parameter estimation for statistical partial volume models in brain MRI. NeuroImage 23: 84–97.
- 30. Rajapakse JC, Giedd JN, Rapoport JL (1997) Statistical approach to segmentation of single-channel cerebral MR images. IEEE Transactions on Medical Imaging 16: 176–186.
- 31. Cuadra MB, Cammoun L, Butz T, Cuisenaire O, Thiran JP (2005) Comparison and validation of tissue modelization and statistical classification methods in T1-weighted MR brain images. IEEE Transactions on Medical Imaging 24: 1548–1565.
- 32. Gaser C (2009) Partial volume segmentation with Adaptive Maximum a Posteriori (MAP) approach. NeuroImage 47: S121.
- 33.
Tipping M (2000) The Relevance Vector Machine. In: Solla SA, Leen TK, Müller K-R, editors. Advances in Neural Information Processing Systems 12. Cambridge, MA: MIT Press. 652–658.
- 34. Bennett KP, Campbell C (2003) Support vector machines: hype or hallelujah? SIGKDD Explorations 2: 1–13.
- 35.
Schölkopf B, Smola A (2002) Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. Cambridge, MA: MIT Press.
- 36. Ghosh S, Mujumdar PP (2008) Statistical downscaling of GCM simulations to streamflow using relevance vector machine. Advances in Water Resources 31: 132–146.
- 37.
Zheng Y-T, Neo S-Y, Chua T-S, Tian Q (2008) Probabilistic optimized ranking for multimedia semantic concept detection via RVM. Proceedings of the 2008 international conference on Content-based image and video retrieval. Niagara Falls, Canada: ACM. pp. 161–168.
- 38.
Faul A, Tipping ME (2002) Analysis of sparse Bayesian learning. In: Dietterich TG, Becker S, Ghahramani Z, editors. Advances in Neural Information Processing Systems 14: MIT Press. pp. 383–389.
- 39.
Tipping ME, Faul AC (2003) Fast marginal likelihood maximisation for sparse Bayesian models. In: Bishop CM, Frey BJ, editors; Jan 3–6; Key West, FL.
- 40.
Bishop CM (2006) Pattern Recognition and Machine Learning. New York, NY: Springer.
- 41. Tipping ME (2001) Sparse bayesian learning and the relevance vector machine. Journal of Machine Learning Research 1: 211–244.
- 42. Wilson RS, Leurgans SE, Boyle PA, Bennett DA (2011) Cognitive decline in prodromal Alzheimer disease and mild cognitive impairment. Archives of Neurology 68: 351–356.
- 43. Desikan RS, Fischl B, Cabral HJ, Kemper TL, Guttmann CR, et al. (2008) MRI measures of temporoparietal regions show differential rates of atrophy during prodromal AD. Neurology 71: 819–825.
- 44. Duchesne S, Caroli A, Geroldi C, Collins DL, Frisoni GB (2009) Relating one-year cognitive change in mild cognitive impairment to baseline MRI features. Neuroimage 47: 1363–1370.
- 45. Stonnington CM, Chu C, Klöppel S, Jack CR, Ashburner J, et al. (2010) Predicting clinical scores from magnetic resonance scans in Alzheimer's disease. Neuroimage 51: 1405–1413.
- 46. Wang Y, Fan Y, Bhatt P, Davatzikos C (2010) High-dimensional pattern regression using machine learning: from medical images to continuous clinical variables. Neuroimage 50: 1519–1535.
- 47. Clark VH, Resnick SM, Doshi J, Beason-Held LL, Zhou Y, et al. (2012) Longitudinal imaging pattern analysis (SPARE-CD index) detects early structural and functional changes before cognitive decline in healthy older adults. Neurobiology of Aging 33: 2733–2745.
- 48. Hinrichs C, Singh V, Xu G, Johnson SC (2011) Predictive markers for AD in a multi-modality framework: an analysis of MCI progression in the ADNI population. Neuroimage 55: 574–589.
- 49. Walhovd KB, Fjell AM, Brewer J, McEvoy LK, Fennema-Notestine C, et al. (2010) Combining MR imaging, positron-emission tomography, and CSF biomarkers in the diagnosis and prognosis of Alzheimer disease. AJNR Am J Neuroradiol 31: 347–354.
- 50. Zhang D, Wang Y, Zhou L, Yuan H, Shen D (2011) Multimodal classification of Alzheimer's disease and mild cognitive impairment. Neuroimage 55: 856–867.
- 51. Misra C, Fan Y, Davatzikos C (2009) Baseline and longitudinal patterns of brain atrophy in MCI patients, and their use in prediction of short-term conversion to AD: results from ADNI. Neuroimage 44: 1415–1422.
- 52. Querbes O, Aubry F, Pariente J, Lotterie JA, Demonet JF, et al. (2009) Early diagnosis of Alzheimer's disease using cortical thickness: impact of cognitive reserve. Brain 132: 2036–2047.
- 53. Teipel SJ, Born C, Ewers M, Bokde AL, Reiser MF, et al. (2007) Multivariate deformation-based analysis of brain atrophy to predict Alzheimer's disease in mild cognitive impairment. Neuroimage 38: 13–24.
- 54. Westman E, Simmons A, Zhang Y, Muehlboeck JS, Tunnard C, et al. (2011) Multivariate analysis of MRI data for Alzheimer's disease, mild cognitive impairment and healthy controls. Neuroimage 54: 1178–1187.
- 55. Davatzikos C, Bhatt P, Shaw LM, Batmanghelich KN, Trojanowski JQ (2011) Prediction of MCI to AD conversion, via MRI, CSF biomarkers, and pattern classification. Neurobiol Aging 32: 2322.e2319–2322.e2327.
- 56. Westman E, Muehlboeck J-S, Simmons A (2012) Combining MRI and CSF measures for classification of Alzheimer's disease and prediction of mild cognitive impairment conversion. Neuroimage 62: 229–238.
- 57. Wolz R, Julkunen V, Koikkalainen J, Niskanen E, Zhang DP, et al. (2011) Multi-Method Analysis of MRI Images in Early Diagnostics of Alzheimer’s Disease. Plos ONE 6: e25446.
- 58. Fan Y, Batmanghelich N, Clark CM, Davatzikos C (2008) Spatial patterns of brain atrophy in MCI patients, identified via high-dimensional pattern classification, predict subsequent cognitive decline. Neuroimage 39: 1731–1743.
- 59. Costafreda SG, Dinov ID, Tu Z, Shi Y, Liu CY, et al. (2011) Automated hippocampal shape analysis predicts the onset of dementia in mild cognitive impairment. Neuroimage 56: 212–219.
- 60. Risacher SL, Saykin AJ, West JD, Shen L, Firpi HA, et al. (2009) Baseline MRI predictors of conversion from MCI to probable AD in the ADNI cohort. Curr Alzheimer Res 6: 347–361.
- 61. Risacher SL, Shen L, West JD, Kim S, McDonald BC, et al. (2010) Longitudinal MRI atrophy biomarkers: relationship to conversion in the ADNI cohort. Neurobiol Aging 31: 1401–1418.
- 62. Klöppel S, Abdulkadir A, Hadjidemetriou S, Issleib S, Frings L, et al. (2011) A comparison of different automated methods for the detection of white matter lesions in MRI data. Neuroimage 57: 416–422.
- 63. Nelson PT, Head E, Schmitt FA, Davis PR, Neltner JH, et al. (2011) Alzheimer's disease is not "brain aging": neuropathological, genetic, and epidemiological human studies. Acta Neuropathol 121: 571–587.
- 64. Ohnishi T, Matsuda H, Tabira T, Asada T, Uno M (2001) Changes in brain morphology in Alzheimer disease and normal aging: is Alzheimer disease an exaggerated aging process? AJNR Am J Neuroradiol 22: 1680–1685.
- 65. Chen JH, Lin KP, Chen YC (2009) Risk factors for dementia. Journal of the Formosan Medical Association 108: 754–764.
- 66. Fotenos AF, Mintun MA, Snyder AZ, Morris JC, Buckner RL (2008) Brain volume decline in aging: evidence for a relation between socioeconomic status, preclinical Alzheimer disease, and reserve. Arch Neurol 65: 113–120.
- 67. Snowdon DA (2003) Healthy aging and dementia: findings from the Nun Study. Ann Intern Med 139: 450–454.
- 68.
Mangialasche F, Westman E, Kivipelto M, Muehlboeck JS, Cecchetti R, et al.. (2013) Classification and prediction of clinical diagnosis of Alzheimer's disease based on MRI and plasma measures of alpha−/gamma-tocotrienols and gamma-tocopherol. Journal of internal medicine.
- 69. Deary IJ, Whiteman MC, Pattie A, Starr JM, Hayward C, et al. (2002) Cognitive change and the APOE epsilon 4 allele. Nature 418: 932.
- 70. Cosentino S, Scarmeas N, Helzner E, Glymour MM, Brandt J, et al. (2008) APOE epsilon 4 allele predicts faster cognitive decline in mild Alzheimer disease. Neurology 70: 1842–1849.
- 71. Wishart HA, Saykin AJ, Rabin LA, Santulli RB, Flashman LA, et al. (2006) Increased brain activation during working memory in cognitively intact adults with the APOE epsilon4 allele. Am J Psychiatry 163: 1603–1610.
- 72. Filippini N, Rao A, Wetten S, Gibson RA, Borrie M, et al. (2009) Anatomically-distinct genetic associations of APOE epsilon4 allele load with regional cortical atrophy in Alzheimer's disease. Neuroimage 44: 724–728.
- 73. Bookheimer SY, Strojwas MH, Cohen MS, Saunders AM, Pericak-Vance MA, et al. (2000) Patterns of brain activation in people at risk for Alzheimer's disease. N Engl J Med 343: 450–456.