Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Effects of Different Correlation Metrics and Preprocessing Factors on Small-World Brain Functional Networks: A Resting-State Functional MRI Study

  • Xia Liang,

    Affiliation State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China

  • Jinhui Wang,

    Affiliation State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China

  • Chaogan Yan,

    Affiliation State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China

  • Ni Shu,

    Affiliation State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China

  • Ke Xu,

    Affiliation Department of Radiology, The First Affiliated Hospital, China Medical University, Shenyang, China

  • Gaolang Gong,

    Affiliation State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China

  • Yong He

    yong.he@bnu.edu.cn

    Affiliation State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China

Abstract

Graph theoretical analysis of brain networks based on resting-state functional MRI (R-fMRI) has attracted a great deal of attention in recent years. These analyses often involve the selection of correlation metrics and specific preprocessing steps. However, the influence of these factors on the topological properties of functional brain networks has not been systematically examined. Here, we investigated the influences of correlation metric choice (Pearson's correlation versus partial correlation), global signal presence (regressed or not) and frequency band selection [slow-5 (0.01–0.027 Hz) versus slow-4 (0.027–0.073 Hz)] on the topological properties of both binary and weighted brain networks derived from them, and we employed test-retest (TRT) analyses for further guidance on how to choose the “best” network modeling strategy from the reliability perspective. Our results show significant differences in global network metrics associated with both correlation metrics and global signals. Analysis of nodal degree revealed differing hub distributions for brain networks derived from Pearson's correlation versus partial correlation. TRT analysis revealed that the reliability of both global and local topological properties are modulated by correlation metrics and the global signal, with the highest reliability observed for Pearson's-correlation-based brain networks without global signal removal (WOGR-PEAR). The nodal reliability exhibited a spatially heterogeneous distribution wherein regions in association and limbic/paralimbic cortices showed moderate TRT reliability in Pearson's-correlation-based brain networks. Moreover, we found that there were significant frequency-related differences in topological properties of WOGR-PEAR networks, and brain networks derived in the 0.027–0.073 Hz band exhibited greater reliability than those in the 0.01–0.027 Hz band. Taken together, our results provide direct evidence regarding the influences of correlation metrics and specific preprocessing choices on both the global and nodal topological properties of functional brain networks. This study also has important implications for how to choose reliable analytical schemes in brain network studies.

Introduction

Resting-state functional MRI (R-fMRI) has recently emerged as a powerful tool for exploring spontaneous brain function [1]. The low-frequency (<0.1 Hz) fluctuations in the fMRI signal temporally interact across functionally related areas, collectively constituting a complex neural network, which has been referred to as “functional connectome” [2], [3]. Analyses of functional brain networks based on graph theory have revealed many non-trivial topological properties, such as small-world attributes (high local clustering and short path lengths [4]) [5], high efficiency at a low wiring cost [6] and highly connected hubs [7], [8], [9], [10]. Graph-based analysis has also been used to investigate the topological changes of functional brain networks under pathological conditions [3], [11], [12], [13]. These studies have shaped our understanding of how the functional brain network is topologically organized under both healthy and diseased states.

In general, a brain network is composed of two basic elements: nodes and edges. In R-fMRI-based brain networks, nodes usually represent brain entities (e.g., brain regions), and edges represent functional associations between the brain entities. How to define nodes and edges are two core questions in graph-based network analysis [3], [12], [14]. Recent studies have demonstrated that different nodal definitions lead to different results in brain network analysis [15], [16], [17], [18]. Likewise, there are similar concerns regarding the effects of edge definitions on the topological properties of brain networks. Different functional connectivity metrics have been used to define network edges in fMRI data analysis, including Pearson's correlation [8], [10], [17], [19] and partial correlation [20], [21], [22]. The former measures the general dependence between variables, whereas the latter estimates the direct interdependence after ruling out third-party effects [23], [24]. Recently, Smith et al. [25] demonstrated that both correlation methods provide excellent performance at estimating functional connections, but Pearson's correlation outperformed partial correlation when the number of nodes in brain networks significantly increased. Of note, most fMRI-based brain network studies have focused on only one of the two correlation metrics, and it remains unclear how the use of these different correlation metrics influences the topological properties of brain functional networks.

Another major concern in R-fMRI studies is related to preprocessing procedures. For example, some studies have removed global brain signals by regression to reduce confounding physiological effects [26], [27], [28], [29]. However, the validity of global signal regression in fMRI studies is still under debate [30], [31]. Recently, Weissenbacher et al [32] has quantitatively evaluated the impact of global signal regression on resting-state functional connectivity and found approximately doubled specificity of connections and widespread artificial anticorrelations after global signal regression. In the literature of functional brain networks, using R-fMRI, several research groups have constructed brain functional networks by regressing out the global signal [8], [10], [17], whereas others have not [7], [15], [20], [33]. A recent R-fMRI study has demonstrated that global signal removal alters topological structure of brain functional networks [34]. However, it remains unclear how the removal of global signals affects the topological properties of Pearson's-correlation-based and partial-correlation-based brain networks.

Another preprocessing factor that likely affects R-fMRI analysis is the use of different temporal filtering frequency bands. Buzsáki and colleagues [35], [36] observed that the center and range of different brain oscillation bands are distributed linearly on the natural logarithmic scale, suggesting that each band serves a different physiological function. Using R-fMRI, Salvador et al. [37], [38] found that the functional connectivity among brain regions depends on different frequency bands within the detectable frequency range. Moreover, functional brain networks derived from R-fMRI data exhibit differential small-world attributes across different frequency bands [6], [7], [39]. However, direct, detailed comparisons are needed to elucidate the influences of different frequency bands on the topological analysis of functional brain networks.

In consideration of these factors, relevant questions include how to choose among these different processing strategies and which combination of these factors provides the most appropriate descriptions for modeling R-fMRI-based brain networks. Given that no ‘golden standard’ currently exists, in this study, we sought to answer this question by assessing the test-retest (TRT) reliability of network analyses while varying processing factors, assuming that a ‘better’ network analytic strategy will produce a more reliable network structure. Although several recent studies have examined the TRT reliability of structural [40], [41] and functional [42], [43], [44], [45] brain networks, the effects of these processing factors on R-fMRI brain networks remain to be further elucidated.

In this study, we aimed to systematically investigate i) whether topological structures of brain functional networks derived from R-fMRI data are significantly influenced by varying processing choices (e.g., different correlation metrics: Pearson's correlation versus partial correlation; with and without global brain signal regression; different frequency bands) and ii) which R-fMRI processing strategy produces the most reliable topological structure across short-term (<1 h apart) and long-term (>5 months apart) scans. To address these questions, we first used a public R-fMRI dataset with 22 participants (http://www.nitrc.org/projects/fcon_1000/) (dataset 1) to construct functional brain networks under different processing strategies, and we then compared the topological properties of the resultant networks using paired statistical tests. Finally we employed another public R-fMRI dataset with 25 participants (http://www.nitrc.org/projects/trt) (dataset2) to evaluate the short- and long-term TRT reliability of brain networks derived from these different processing choices.

Materials and Methods

Data Acquisition

Dataset1.

Dataset1 was selected from a large sample R-fMRI dataset that was publicly released as a part of the 1000 Functional Connectomes Project (http://www.nitrc.org/projects/fcon_1000/) [2]. This dataset includes 22 right-handed healthy volunteers (20.1±1.67 years, 11 males) with no history of neurological or psychiatric disorders. Written informed consent was obtained from each participant, and the protocols were approved by the Ethics Committee of the Institutional Review Board of the Imaging Center for Brain Research, Beijing Normal University. All of the subjects were scanned in a 3.0 Tesla SIEMENS MR scanner at Beijing Normal University Imaging Center for Brain Research. The functional images were obtained using an echo-planar imaging sequence with the following parameters: 33 axial slices, thickness/gap = 3/0.6 mm, in-plane resolution = 64×64, time repetition = 2000 ms, time echo = 30 ms, flip angle = 90° and field of view = 200×200 mm2. During the resting-state session, the participants were instructed to hold still, keep their eyes closed, stay awake and not think of anything in particular. According to a simple questionnaire administered after the scan, none of the participants fell asleep during the scan.

Dataset2.

Dataset2 is a TRT R-fMRI dataset with 25 participants (30.7±8.8 years, 9 males) that is publicly available at NITRC (http://www.nitrc.org/projects/trt). All participants had no history of psychiatric or neurological illness. Informed consent was obtained prior to participation. Data collection was carried out according to protocols approved by the institutional review boards of New York University (NYU) and the NYU School of Medicine. Three resting-state scans were obtained for each participant using echo-planar imaging sequence on a Siemens Allegra 3.0-Tesla scanner with the following parameters: 39 axial slices, in-plane resolution = 64×64, time repetition = 2000 ms, time echo = 25 ms, flip angle = 90°, field of view = 192×192 mm2. Scans 2 and 3 were conducted in a single scan session, 45 min apart, 5–16 months (mean 11±4) after scan 1. All individuals were asked to relax and remain still with their eyes open during the scan.

Data Preprocessing

Both dataset1 and dataset2 were preprocessed as follows: the first 10 volumes were discarded to allow the MRI signal to reach a steady state and allow the subjects to adapt to the scanner noise. We used the statistical parametric mapping package (SPM5, http://www.fil.ion.ucl.ac.uk/spm) to perform image preprocessing as follows. First, functional images were corrected for the acquisition time delay between slices of each volume and for head motion between volumes using a six-parameter (rigid body) spatial transformation. The resulting images were further spatially normalized to the Montreal Neurological Institute (MNI) EPI template and resampled into 3-mm isotropic voxels. Given the widely used frequency interval of 0.01–0.1 Hz in the R-fMRI literature [1], [46], the preprocessed data were band-pass filtered within this primary band to reduce the effects of low frequency drift and high-frequency physiological noises. To investigate the impact of different frequency bands, we also applied Buzsaki's nomenclature [35] to divide the whole frequency spectrum into four different frequency intervals: slow-5 (0.01–0.027 Hz; centered at 0.0185 Hz), slow-4 (0.027–0.073 Hz; centered at 0.05), slow-3 (0.073–0.198 Hz; centered at 0.14 Hz) and slow-2 (0.198–0.25 Hz; centered at 0.22 Hz). This division has been used in several previous R-fMRI studies [47], [48], [49]. We restricted our analysis to the slow-5 and slow-4 bands because the other bands mainly reflect high-frequency physiological noises. Network analysis was performed for the two bands in the same manner as for the primary broadband (0.01–0.1 Hz) analysis (for a flowchart of the data process, see Fig. 1).

thumbnail
Figure 1. A flowchart for varying processing strategies prior to brain network construction.

https://doi.org/10.1371/journal.pone.0032766.g001

Correlation Matrix and Graph Construction

We defined network nodes by parcellating the brain into 90 regions of interest (ROIs) according to the Anatomical Automatic Labeling atlas (AAL) [50] (Table S1). A representative mean time series for each region was extracted by averaging the time series of all voxels within that region followed by multiple linear regression analysis to remove head motion profiles.

Global signal regression.

To evaluate the effects of global signal regression on network structure, we obtained two sets of time courses, one acquired using linear regression of global signals and the other acquired without it.

Correlation metrics.

The two sets of time series were then used to measure functional connectivity among regions by calculating Pearson's correlation coefficients and partial correlation coefficients between any possible pair of regional time series. The mean time course for each subject can be denoted as , where is the mean time series of the th region. The two connectivity metrics are calculated as follows:

Pearson's correlation:where denotes the average of .

Partial correlation:where represents the th element in the inverted covariance matrix from the data in matrix . Note that in partial correlation analysis, the length of the time series should be larger than the number of regions because the covariance matrix needs to be inverted; if not, the inversion can be numerically unstable. In the present analysis, we have more time series (N = 230 for dataset1 and N = 184 for dataset2) than regions (n = 90), and the inversions of partial correlation were stable all through the analysis.

Combination of the two sets of time series (global-signal regressed or not) with the two correlation methods (Pearson's correlation and partial correlation) resulted in four correlation matrices for each participant: 1) Pearson's-correlation-based functional connectivity estimation on data with global-signal regression (WGR-PEAR); 2) Partial-correlation-based functional connectivity estimation on data with global-signal regression (WGR-PAR); 3) Pearson's-correlation-based functional connectivity estimation on data without global-signal regression (WOGR-PEAR); and 4) Partial-correlation-based functional connectivity estimation on data without global-signal regression (WOGR-PAR).

All of the four types of correlation matrices derived above were further thresholded into binary networks. We chose network sparsity (S) (the number of existing edges divided by the maximum possible number of edges) as the threshold measurement. The sparsity threshold makes two groups of networks comparable by normalizing the number of edges among all of the networks and excluding the effects of low-level correlation discrepancies on topological architecture. Given the lack of a definitive way to select a single threshold, a continuous range of 0<S<1 was employed to threshold the correlation matrices into a set of binary matrices (i.e., networks).

Given that binary graphs neglect detailed information that may bias the topological analysis, we also generated weighted brain networks over the whole range of sparsity (0<S<1) from correlation matrices to explore the influences of the factors studied here (for details, see Text S1

Network Analysis

We investigated the topological properties of brain networks at both the global and regional level. At the global level, we focused on small-world parameters [clustering coefficient (Cp), characteristic path length (Lp), normalized clustering coefficient (γ), normalized characteristic path length (λ) and small-worldness (σ)], network efficiency [global efficiency (Eglob) and local efficiency (Eloc)], assortativity (α) and hierarchical topology (β). At the regional level, we computed the degree of centrality (k) for each brain region and employed the measure to identify network hubs because k is the most reliable nodal measurement [44]. To provide a threshold-independent network assessment, we calculated the area under the curve (AUC, i.e., the integral) for each network metric (both global and nodal). The integrated network metrics were used to perform further statistical comparisons and TRT reliability analysis. Network hubs were also identified by using the integrated degree values. The network parameters used in the present study are summarized in Table 1. For details about the computation of network parameters, see Text S1 and [51].

thumbnail
Table 1. Topological parameters of brain functional networks used in this study.

https://doi.org/10.1371/journal.pone.0032766.t001

Statistical Analysis

To determine the impact of each of the three processing factors (correlation metric, global signal regression and frequency band) on integrated global network parameters (Cp, Lp, , , , Eloc, Eglob, and ) and regional nodal property (k), nonparametric paired-sample Wilcoxon signed rank tests were performed on dataset1 in the following manner: 1) To evaluate the influence of the correlation measure, statistical comparisons were made between Pearson's-correlation-based networks and partial-correlation-based networks (i.e., WGR-PEAR vs. WGR-PAR and WOGR-PEAR vs. WOGR-PAR). 2) To evaluate the influence of removing global signals, statistical comparisons were made between networks with and without global signal regression in the case of Pearson's correlation metric (i.e., WGR-PEAR vs. WOGR-PEAR) because removing global signals is inherent to the partial correlation metric and makes the global signal an insignificant factor. The Bonferroni correction was used for multiple comparisons and the significance level set at p<0.017 (0.05/3). Of note, given the commonly used frequency band of 0.01 to 0.1 Hz in the existing literature of R-fMRI studies and for simplicity, the effects of the correlation metrics and global signals were estimated using only datasets that were band-filtered in the specific frequency interval of 0.01 to 0.1 Hz. 3) To evaluate the influence of different frequency bands, statistical comparisons were made between networks at two different frequency bands (i.e., slow-5 vs. slow-4). These networks were separately constructed under the following four conditions: WGR-PEAR, WOGR-PEAR, WGR-PAR and WOGR-PAR (Fig. S1, S2, S3, S4).

Test-Retest Reliability

To evaluate the TRT reliability of brain networks under different processing choices, we computed an intraclass correlation coefficient (ICC) [52] based on Dataset 2. For each global or nodal network measure derived under each combination of the three factors mentioned above, we obtained its short-term ICC between scans 2 and 3 and its long-term ICC between scan 1 and the average of scans 2 and 3. Of note, the averaging was done on individual functional connectivity matrices rather than graph metrics between scan 2 and scan 3 followed by computing graph metrics. The ICC has been defined as [52]:Where is the between-subject variance, is the within-subject variance and k is the number of repeated observations per subject. ICC is close to 1 for reliable measures that show low within-subject variance relative to between-subject variance and 0 (negative) otherwise. In the current study, reliability was recorded in terms of the criteria of [53], [54], with an ICC value from 0 to 0.25 indicating poor, 0.25 to 0.4 indicating low, 0.4 to 0.6 indicating fair, 0.6 to 0.75 indicating good and 0.75 to 1.0 indicating excellent reliability. Because the network metrics were integrated over the entire threshold range, ICC is a single scalar for each network measure.

Results

We generated both binary and weighted brain networks to evaluate the influences of processing factors on network topology and found similar results, indicating robust findings regardless of binary or weighted approach. Therefore, we only reported the results derived from binary networks here. For weighted results, see Supplemental figures (Fig. S5, Fig. S6, Fig. S7, Fig. S8, Fig. S9, Fig. S10, Fig. S11, Fig. S12).

Robust small-world functional brain networks

Graph theoretical analysis revealed that functional brain networks derived from R-fMRI data show prominent small-world architecture across a wide sparsity range, Figure 2 showed the global network parameters within a sparsity range from 0.1 to 0.4, where the networks are sparse and their small-world attributes are estimable [4]. Compared with random networks, brain networks are highly clustered (i.e., γ>1) and have approximately equivalent path lengths (λ∼1). We also compared the global and local efficiency of the brain networks with those of comparable random networks and regular lattices. The results show that the efficiency curves of the brain networks are generally intermediate between the two extreme cases: the brain networks have greater global efficiency than the lattices but less than the random networks, and they have greater local efficiency than the random networks but less than the lattices (Fig. 2). Taken together, our observations indicate that human functional brain networks have efficient small-world properties regardless of the correlation metric selected or the application of global signal regression. Furthermore, functional brain networks were found to be assortative (assortative coefficients ) and hierarchical (hierarchy coefficients ) over a wide sparsity range (Fig. 2). Under the two subdivided frequency bands (i.e., slow-5 and slow-4), all of the above-mentioned global topological characteristics (small-world, network efficiency, assortative and hierarchy) were also found to be present in the functional brain networks constructed under all four different conditions: WGR-PEAR (Fig. S1), WGR-PAR (Fig. S2), WOGR-PEAR (Fig. S3) and WOGR-PAR (Fig. S4).

thumbnail
Figure 2. Global topological properties of Pearson's-correlation and partial-correlation-based networks with and without global signal regression.

Plots show the changes in small-world parameters (Cp, Lp, γ, λ and σ), network efficiency (Local efficiency and Global efficiency), assortativity coefficient (α) and hierarchy coefficient (β) in functional brain networks dependent on both correlation metrics (Pearson's correlation or partial correlation) and global signal (regressed or not) as a function of sparsity thresholds. Local and global efficiency of random and regular networks with the same number of nodes and edges as the real networks were shown in gray lines in the network efficiency plots.

https://doi.org/10.1371/journal.pone.0032766.g002

Correlation metrics and global signal regression: dependence and reliability

Effects of correlation metrics.

We examined the effects of the different correlation metrics on both the global and regional properties of functional brain networks derived from the widely-used frequency band ranging from 0.01 to 0.1 Hz (i.e., WGR-PEAR vs. WGR-PAR and WOGR-PEAR vs. WOGR-PAR). We found that, compared with partial-correlation-based networks, Pearson's-correlation-based networks had greater Cp (WGR-PEAR>WGR-PAR: p = 4.61e−5; WOGR-PEAR>WOGR-PAR: p = 4.01e−5) and Eloc (WGR-PEAR>WGR-PEAR: p = 4.61e−5; WOGR-PEAR>WOGR-PAR: p = 4.01e−5) but longer Lp (WGR-PEAR>WGR-PAR: p = 9.15e−5; WOGR-PEAR>WGR-PAR: p = 4.01e−5) and λ (WGR-PEAR>WGR-PAR: p = 4.01e−5; WOGR-PEAR>WOGR-PAR: p = 4.01e−5) and lower Eglob (WGR-PEAR<WGR-PAR: p = 4.61e−5; WOGR-PEAR<WOGR-PAR: p = 4.01e−5) (Fig. 3). When scaled to degree-matched random networks, differences in Cp between the WGR-PEAR and WGR-PAR networks disappeared in γ, which could be due to the effect of normalization to random networks with topological property magnitudes similar to those of the corresponding brain networks. Moreover, compared with partial-correlation-based networks, Pearson's-correlation-based networks with global signal regression are marginally more assortative (WGR-PEAR>WGR-PAR: p = 0.018), and they are more hierarchical regardless of global signal regression (WGR-PEAR>WGR-PAR: p = 0.0036; WOGR-PEAR>WOGR-PAR: p = 0.001) (Fig. 3).

thumbnail
Figure 3. Correlation metrics and global signal dependent differences in global network properties.

Bars show the differences in the areas under curves (AUC) of (A) small-world parameters (Cp, Lp, γ, λ and σ), (B) network efficiency (Local efficiency and Global efficiency) and (C) assortativity coefficient (α) and hierarchy coefficient (β). Error bars correspond to standard deviation of the mean across participants. The asterisk indicates p<0.05.

https://doi.org/10.1371/journal.pone.0032766.g003

To explore influences on regional network architecture, we computed the degree of each node and then identified the network hub regions with the highest degree (for details, see Materials and Methods). Fig. 4 shows the nodal degree of all hub regions in WGR-PEAR, WGR-PAR, WOGR-PEAR and WOGR-PAR networks. As illustrated in Figure 4, brain networks derived from Pearson's versus partial correlation metrics appeared to have different hub distributions. In Pearson's-correlation-based networks (i.e., WGR-PEAR and WOGR-PEAR), the hubs are predominately located at several association cortical regions (e.g., the inferior temporal gyrus [ITG], the middle temporal gyrus [MTG] and the superior temporal gyrus [STG]) and paralimbic cortical regions (e.g., the superior temporal pole [TPOsup] and the middle cingulate gyrus [MCG]). However, in partial-correlation-based networks (i.e., WGR-PAR and WOGR-PAR), the network hubs are primarily located at regions in the primary cortex (e.g., the postcentral gyrus [PoCG] and calcarine [CAL]) and subcortical cortex (e.g., the thalamus [THA] and putamen [PUT]) with high degree (for details, see Fig. 4). Indeed, the correlation in nodal degree was very low between the Pearson's-correlation- and partial-correlation-based networks [r = 0.163 and p = 0.124 (WGR-PEAR vs. WGR-PAR); r = 0.176 and p = 0.09 (WOGR-PEAR vs. WOGR-PAR)].

thumbnail
Figure 4. Functional hubs derived from networks using different correlation metrics and global signal strategies.

(A) WGR-PEAR, (B) WOGR-PEAR, (C) WGR-PAR and (D) WOGR-PAR. Regions with degree>the mean+standard deviation were considered hubs. Node colors were coded according to their membership of classical cortex classifications: association cortex (red), limbic cortex (purple), paralimbic cortex (green), subcortical regions (light blue) and primary cortex regions (dark blue).

https://doi.org/10.1371/journal.pone.0032766.g004

Global signal effects.

We next evaluated the influence of global signal regression on global topological parameters in Pearson's-correlation-based brain networks (i.e., WGR-PEAR vs. WOGR-PEAR). WOGR-PEAR networks have greater Cp (p = 5.3e−5), γ (p = 0.0001) and Eloc (p = 0.0002) values than WGR-PEAR networks (Fig. 3). Additionally, WGR-PEAR networks are more assortative (p = 0.018) and hierarchical (p = 0.005) than WOGR-PAR networks. Brain networks with global signals removed versus conserved had a relatively consistent spatial pattern of hubs primarily distributed in the association cortex (e.g., ITG, MTG and STG) and paralimbic cortex (e.g., TPOsup and MCG) (Fig. 4). The nodal degree of all regions in WGR-PEAR networks were highly correlated with those in WOGR-PEAR networks (r = 0.966 and p<2.5e-4).

TRT reliability of network metrics.

Given that particular choices of processing options (i.e., correlation metrics and global signal regression) can make significant differences in network topological parameters, we next asked which analytical scheme would perform the best at modeling brain networks from the perspective of TRT reliability. Figure 5 shows the TRT reliability of 9 global network metrics under four different processing choices. Generally, most global network metrics exhibited poor to low reliability irrespective of the correlation metric or global signal regression. To test whether there is a difference in the TRT reliability associated with different processing options, we further performed a nonparametric paired-sample Wilcoxon signed rank test on the ICCs of global graph metrics. Our results showed that global graph metrics derived from Pearson's-correlation-based networks are more reliable than those derived from partial-correlation-based networks for both short-term scans (WOGR-PEAR>WOGR-PAR: p = 0.04) and long-term scans (WGR-PEAR>WGR-PAR: p = 0.003; WOGR-PEAR>WOGR-PAR: p = 0.016). Global signal regression produced less reliable results for short-term scans (WOGR-PEAR>WGR-PEAR: p = 0.019) but no significant differences for long-term scans (p = 0.46).

thumbnail
Figure 5. TRT reliability of global topological properties for Pearson's-correlation and partial-correlation-based networks with and without global signal regression.

The reliability was estimated using areas under curves (AUC) of each metric. Statistical analysis revealed significant differences in (A) short-term and/or (B) long-term TRT reliability driven by correlation metrics and/or global signal regression.

https://doi.org/10.1371/journal.pone.0032766.g005

We next evaluated the reliability of nodal degree in brain networks under the four different processing schemes, and the reliability of nodal degree was rendered onto brain surfaces (Fig. 6A, B). Our results showed that in Pearson's-correlation-based networks (WGR-PEAR and WOGR-PEAR networks), brain regions with fair reliability were predominately located in the association and limbic/paralimbic cortexes (Mesulam 1998). The association cortex regions include the left ANG, right paracentral lobe (PCL), right precunues (PCUN), bilateral superior frontal gyrus (dorsolateral) (SFGdor) and right ITG. The limbic/paralimbic regions include the bilateral hippocampus (HIP), bilateral MCG and left posterior cingulate gyrus (PCG). In addition, one primary cortex region of the left CAL was found to be fairly reliable. In partial-correlation-based networks, certain limbic/paralimbic and subcortical cortex regions exhibited fair reliability including the left PCUN, right HIP, right parahippocampal gyrus (PHG) and bilateral PUT. Statistical analysis of nodal reliability revealed that the TRT reliability of nodal degree was modulated by the two processing factors: Pearson's-correlation-based networks were more reliable than partial-correlation-based networks for both short-term scans (WGR-PEAR>WGR-PAR: p = 7.6e−7; WOGR-PEAR>WOGR-PAR: p = 1.2e−14) and long-term scans (WGR-PEAR>WGR-PAR: p = 3.6e−8; WOGR-PEAR>WOGR-PAR: p = 1.1e−10) (Fig. 6C, D). Networks without global signal regression were more reliable for both short-term scans (WOGR-PEAR>WGR-PEAR: p = 2.2e−7) and long-term scans (WOGR-PEAR>WGR-PEAR: p = 0.03) (Fig. 6C, D). These results suggest that WOGR-PEAR networks exhibit the most reliable topological properties for both short-term and/or long-term scans.

thumbnail
Figure 6. TRT reliability of nodal degree for Pearson's-correlation and partial-correlation-based networks with and without global signal regression.

Nodal TRT reliability values were projected onto MNI brain surface using the BrainNet viewer (http://www.nitrc.org/projects/bnv/) for (A) short-term scans and (B) long-term scans in WGR-PEAR networks, WGR-PAR networks, WOGR-PEAR networks and WOGR-PAR networks. Significant differences were found in TRT reliability of nodal degree driven by correlation metrics (Pearson's correlation/partial correlation) and global signal regression (with/without) for (C) short-term and (D) long-term scans. Nodal degree in WOGR-PEAR networks showed the highest ICC values. The asterisk indicates p<0.05. L, left hemisphere; R, right hemisphere.

https://doi.org/10.1371/journal.pone.0032766.g006

Frequency bands: dependence and reliability

To assess the influence of frequency band selection on network topology, we next divided the widely used frequency interval (0.01–0.1 Hz) into two sub-bands: slow-5 (0.01–0.027 Hz) and slow-4 (0.027–0.073 Hz) and re-performed the network analysis in these two bands in the case of WOGR-PEAR, given that the WOGR-PEAR networks exhibit the most reliable global and nodal topological architecture as shown above.

Effects on network topology.

There was no significant difference in the clustering coefficients or local efficiency of brain graphs driven by the different frequency bands. However, brain networks constructed in the 0.027–0.073 Hz frequency band were found to be more globally efficient than those in 0.01–0.027 Hz as indicated by shorter Lp (p = 0.0007) and greater global efficiency (p = 0.001) (Fig. 7). Additionally, our results revealed that brain networks in slow-4 are less assortative (p = 0.002) but more hierarchical (p = 3.79e−9) than those in slow-5 (Fig. 7). These results indicate that the selection of different frequency bands can have a significant influence on the global topological properties of functional brain networks. Fig. 8 shows the hubs in WOGR-PEAR networks in the two different frequency bands. Similar spatial patterns of network hubs were observed in the two frequency intervals mainly in association cortex regions (e.g., ITG, MTG, fusiform gyrus [FFG] and SFGdor) and paralimbic/limbic cortex regions (e.g., MCG, TPOsup and TPOmid) with a high correlation coefficient (r = 0.85, p = 0.00).

thumbnail
Figure 7. Frequency dependent differences in global network properties of functional brain networks.

Bars show the differences in the areas under curves (AUC) of (A) small-world parameters (Cp, Lp, γ, λ and σ), (B) network efficiency (Local efficiency and Global efficiency), (C) assortativity coefficient (α) and hierarchy coefficient (β). Error bars correspond to standard deviation of the mean across participants. The asterisk indicates p<0.05.

https://doi.org/10.1371/journal.pone.0032766.g007

thumbnail
Figure 8. Functional hubs derived from networks in different frequency bands.

Regions with degree>the mean+standard deviation are considered to be hubs. Node colors were coded according to their membership of classical cortex classifications: association cortex (red), limbic cortex (purple), paralimbic cortex (green), subcortical regions (light blue) and primary cortex regions (dark blue). (A) slow-5 (0.01–0.027 Hz). (B) slow-4 (0.027–0.073 Hz).

https://doi.org/10.1371/journal.pone.0032766.g008

TRT reliability of network metrics.

The brain networks in both frequency bands showed overall low reliability (Fig. 9). The TRT reliability of global brain network metrics appeared to be greater in slow-4 (0.027–0.073 Hz) than in slow-5 (0.01–0.027 Hz) by visual inspection. Subsequent statistical comparisons revealed that the TRT reliability of global network metrics was modulated by the frequency band with higher reliability observed for networks in slow-4 for long-term scans (p = 0.004) but not for short-term scans (p = 0.65). Nodal degree in the slow-5 and slow-4 brain networks exhibited similar short-term reliability with fair reliability regions mostly located in association and limbic/paralimbic cortex regions such as the right medial superior frontal gyrus (SFGmed), right medial orbitofrontal cortex (ORBmed), left ITG and bilateral MCG (Fig. 10A). Regions with fair long-term nodal degree reliability were also located in association and limbic/paralimbic cortex regions. However, networks in the slow-4 band displayed more fair reliability regions than slow-5 band networks including the left FFG, left ITG, bilateral ORBmed, right PCL, right PCG and right HIP (Fig. 10B). Statistical comparisons revealed that the nodal degree of brain networks in slow-4 showed greater reliability than those in slow-5 for long-term scans (p = 0.0018) but not for short-term scans (p = 0.26) (Fig. 10C, D). Note that for short-term scans, even not significant, slow-4 demonstrates greater ICC values than slow-5 on visual inspection, indicating a trend of frequency-dependent differences in reliability for short-term scans. The strengthened differences in reliability between slow-4 and slow-5 for long-term scans could be a result of decreased inter-scan reliability in slow-5 band. We performed statistical tests between inter-scan and intra-scan ICCs in the two slow bands, and confirmed that reliability is significant lower for long-term scans than short-term scans in slow-5 band (p = 0.004) but not in slow-4 band (p = 0.18). These results suggest that brain networks constructed in the slow-4 band are more reliable than those in slow-5, which may reflect the fact that different frequency bands could be associated with different physiological functions (Buzsaki and Draguhn, 2004). Nevertheless, further work is needed to verify this finding and investigate the specific brain function in different frequency bands.

thumbnail
Figure 9. TRT reliability of global topological properties for networks in different frequency bands.

The reliability was estimated using areas under curves (AUC) of each metric. Statistical analysis revealed significant differences in (A) short-term and/or (B) long-term TRT reliability driven by different frequency bands.

https://doi.org/10.1371/journal.pone.0032766.g009

thumbnail
Figure 10. TRT reliability of nodal degree for brain networks in different frequency bands.

TRT reliability values of nodal degree were projected onto MNI brain surface using the BrainNet viewer (http://www.nitrc.org/projects/bnv/) for (A) short-term scans and (B) long-term scans in slow-5 and slow-4. Significant differences were found in TRT reliability of nodal degree driven by different frequency bands for (C) short-term and (D) long-term scans. Nodal degree in brain networks in slow-4 band showed higher ICC values. The asterisk indicates p<0.05. L, left hemisphere; R, right hemisphere.

https://doi.org/10.1371/journal.pone.0032766.g010

Discussion

In this study, we investigated the influences of different correlation metrics and preprocessing steps (the application of global signal regression and the selection of a frequency band) on the topological properties of functional brain networks obtained using R-fMRI. Our results showed that both the global (Cp, Lp, γ , λ, Eloc, Eglob, α and β) and regional (nodal degree) topological properties of brain networks depend heavily on the correlation method (Pearson's correlation/partial correlation) used and the application of global signal removal. TRT analysis showed that Pearson's-correlation-based brain networks with global signals conserved (WOGR-PEAR) had the most reliable topological properties. We further found that there were significant frequency-related differences in topological properties in WOGR-PEAR networks. Brain networks in 0.027–0.073 Hz exhibited greater reliability than to those in 0.01–0.027 Hz. These results provide quantitative evidence regarding the influence of correlation metrics and specific preprocessing choices on both the global and nodal topological properties of functional brain networks. This study also has important implications on how to choose reliable analytical schemes and for the application of brain network studies under healthy and pathological conditions.

Efficient small-world functional brain networks

We found robust small-world properties in all functional brain networks regardless of the correlation metric or global signal regression (Fig. 2), which is in accordance with previous network studies [7], [17], [20]. We also found that functional brain networks constructed in different frequency bands all possess small-world organization (Fig. S1, S2, S3, S4), which has also been shown in previous studies [7], [39]. These results indicate that small-world architecture is well-suited and prevalent for functional brain networks with respect to densely connected clusters bridged by short paths, which may maximize the efficiency of information processing at a relatively low wiring cost [55].

In addition, the functional brain networks appeared to be assortative and hierarchical, irrespective of the correlation metric, global signal presence or frequency band. Assortativity is the tendency for a high degree hub to connect preferentially to other hubs, and this organization is most common in social networks. It has been shown that many networks can break down (become disconnected between pairs of nodes) by removing just a few of the hubs. However, Newman [56] revealed that assortative networks are robust against targeted removal of high-degree nodes, probably because the targeted hubs tend to be united together and removing them is somewhat redundant. Our results show that functional brain networks are assortative, which is consistent with previous studies [57], [58] and may suggest that functional brain systems are resilient when facing pathological attacks. Hierarchical networks are composed of numerous small, integrated clusters that are assembled into larger, less integrated groups. This self-similar nesting structure can be captured by the scaling relationship between the clustering coefficient and the network node degree. Hubs in hierarchical networks prefer to connect with nodes that have a small chance of linking to each other, which enables them to play the important role of bridging the small clusters into a single, integrated network [59]. Our observation that functional networks are hierarchical corresponds well with previous studies [39], [44], [45].

Effects of correlation metrics on brain network topology

We found significant correlation metric-dependent discrepancies in the global topological attributes of functional brain networks, which is in accordance with a recent EEG study [60]. Our results strongly indicate that most global topological parameters are sensitive to the correlation metric used. The observed differences should be attributable to the inherent properties of each metric. Pearson's correlation measures the interdependence between two time series. However, the correlation value may result from indirect relationship caused by common sources. Partial correlation parcels out common driver components and measures the direct temporal relationship between brain regions [23]. Including indirect connections in a network may have an influence on topological parameters. In addition, the methodological distinction may also result in differences in the strength and distribution of functional connectivity, thus accounting for the observed between-group differences in certain network attributes.

Regional network analysis revealed a distinct spatial pattern of hubs between Pearson's-correlation-based networks and partial-correlation-based networks. Hubs in the former were predominately composed of association cortical regions, which were in accordance with both functional [7], [10] and structural [61] network studies using Pearson's correlation, whereas hubs in the latter also appeared in primary cortex, paralimbic/limbic cortex and subcortical regions. There were very few studies have used partial correlation for hub identification. A structural network study has found hub regions mostly distributed in association cortex regions, and only 2 paralimbic cortex regions and 1 primary motor region were identified as hubs [62]. However, these results are hardly comparable with the present study because of different imaging modalities, different parcellation schemes (node definition) and different nodal metrics used for hub identification. The discrepancy in the spatial pattern of hub regions between Pearson's- and partial-correlation-based networks is not completely understood. A possible explanation could be that association cortex regions integrate multiple perceptive and cognitive functional systems [63] and thus play an important role in functional brain networks regardless of the connectivity metric used. Paralimbic/limbic and subcortical regions with extensive direct projections have been shown to mediate the homeostatic and autonomic aspects of the internal milieu [63]. These relatively isolated functions may account for their non-hub status in Pearson's correlated brain networks, whereas their extensive direct connections make them hubs in partial correlated networks because partial correlation counts only the direct interactions between brain regions.

TRT analysis showed that the reliability of global and nodal network metrics is modulated by the correlation metric used. Pearson's-correlation-based brain networks tended to have higher TRT reliability than partial-correlation-based networks. Possible reasons for this observation are due to the emergence of negative connectivity related to the partial correlation method. Previous studies have shown that negative correlations reduce the TRT reliability of functional connectivity [48] and network metrics [44]. Another reason could stem from validity issues surrounding the partial correlation method. Although partial correlation is prominent for its ability to cut indirect edges, it raises the opposite problem of losing real connections, which could lead to false-negative errors. A recent study demonstrated that partial correlation performs poorly at detecting connections in networks with a large number of node [25]. Together with this evidence, our results suggest that Pearson's correlation is more valid and reliable, whereas partial correlation should be treated with caution for resting-state brain network studies.

Effects of the global signal on brain network topology

We found significant global signal-related differences in the global network parameters of Pearson's-correlation-based networks, which may be associated with the effects of global signal correction on functional correlativity. These effects include the improved specificity of positive correlations and the emergence of negative correlations [27], [28], [30]. Although the exact biological basis of the global signal and the effect of its removal are not fully understood [30], [31], our results indicate that global signal correction may have a broad influence on the global topological properties of Pearson's-correlation-based networks.

The spatial pattern of hubs was broadly consistent between the global signal-removed and conserved brain networks. Similar results have been previously observed in the modular organization of functional brain networks [10]. This relatively stable regional topology indicates that the global signal might not significantly influence the regional architecture of functional brain networks.

TRT analysis revealed that brain networks without global signal removal outperform those with global signal removal with respect to the TRT reliability of their global topological properties, suggesting that the global signal should not be removed in Pearson's-correlation-based brain networks in terms of its TRT reliability.

Effects of frequency band on brain network topology

It has been found that the neuroelectric oscillations in different frequency bands progress linearly on the logarithmic scale [35] and are specifically associated with a variety of cognitive functions [64]. In the present study, on the basis of the approach of Penttonen and Buzsaki, we focused on the widely adopted frequency band (0.01–0.1 Hz) of spontaneous BOLD fluctuations and divided it into a slow-5 band (0.01–0.027 Hz) and a slow-4 band (0.027–0.073 Hz). By performing network analysis on both bands, we found that the small-world metrics (including global efficiency and ) were significantly higher in the slow-4 band than in the slow-5 band, which is consistent with previous studies [7], [39]. An interesting observation was that frequency has influence on global efficiency but not network hub. This could be a result with regard to the different roles of network hubs. Although networks in slow-5 and slow-4 bands have similar hub distribution, these hub regions could play different roles in different frequency bands. For example, a region could be a provincial hub in one frequency band but a connector hub in another frequency band. Provincial hubs are nodes that are highly connected by connections that are mostly contained within a single modular of the network, on the contrary, connections of connector hubs run mostly between two or more modules [65], [66]. Such discrepancy in hub roles could result in differences in global efficiency of the networks between slow-5 and slow-4 band. Future studies have to validate this and investigate the detailed hub roles in different frequency bands. Furthermore, TRT reliability analysis revealed the slow-4 band was more reliable for both global and regional network metrics than the slow-5 band. These results are in accordance with previous findings that showed that the slow-4 band has higher TRT reliability and more reliable BOLD fluctuation amplitude voxels than the slow-5 band [48]. Moreover, in fMRI-based studies, ADHD children have presented more diagnostic information in the slow-4 band than in other bands [47]. Patients with schizophrenia have been found to show widespread LFO amplitude abnormalities in the slow-4 frequency band [67]. Together with these findings in both normal and diseased populations, our results indicate that the topological properties of functional brain networks are dependent on the frequency interval used and are more reliable in the slow-4 band.

Methodological considerations

Choosing the ‘best’ processing step during network modeling is a very difficult task given the lack of a golden standard [12], [68]. In this study, we performed a systematic analysis of factors influencing brain networks and their TRT reliability. In addition, using balloon models to simulate functional brain networks is also likely to offer some informative guidance. By applying different processing choices to simulated networks with known topological properties, the processing pipeline resulting in the most accurate network model can be determined. Recently, Smith et al. [25] performed a comprehensive analysis with simulated fMRI data to validate multiple connectivity metrics, including the Pearson's and partial correlation metrics discussed in our present paper. They showed that these two connectivity metrics are very successful at estimating functional connectivity in general but that Pearson's correlation performs better when the network node number dramatically increases. This finding is confirmed by our TRT results, which show that the topological properties of brain networks constructed using Pearson's correlation are more reliable than those using partial correlation. It would be interesting to conduct simulated studies to validate different network estimation methods in the context of graph analysis, but this is beyond the scope of this paper.

Another consideration is the interaction between network node and edge definitions. As mentioned before, how to define nodes and edges are two key questions in network construction, and they are of importance in network studies. Network nodes in fMRI data can be defined according to a prior parcellated template or by sampling clusters of equal numbers of voxels. It has been shown that network topological properties can vary across different anatomical templates [17] and different spatial nodal sizes [18], but no absolutely standard approach to define network nodes currently exists. The analysis of edge definition in our present study is limited to AAL template-based brain networks, and caution should be exercised when applying the current results to networks constructed using other node definitions. Future studies will be required to clarify the interactions between node and edge definitions.

Moreover, the two datasets used here were acquired under different eyes conditions, eyes closed for dataset 1 and eyes open for dataset 2. Recent studies have shown that regional activities (e.g. ALFF, amplitude of low frequency fluctuations) and functional connectivity within the default and attention networks were significantly decreased for eyes closed scans comparing with eyes opened (or fixation) scans [69], [70]. However, whether these differences would result in topological alterations of brain network remains unclear. Future studies should be conducted to clarify this issue by collecting eyes closed and eyes opened R-fMRI data on the same subjects. In addition, the present study only investigated the influences of the two most frequently used correlation metrics, Pearson's correlation and partial correlation. Many other connectivity metrics exist for functional network analysis, such as mutual information and synchronization likelihood. Further work is needed to clarify the influences of other metrics on brain network architecture. Finally, given that the topology of global brain network and/or certain brain regions would be disrupted in diseased and aging people [3], [11], [12], [13], and thus render themselves more vulnerable or less reliable than normal controls, it would be interesting to explore possible specificities of such population with respect to specific correlation metrics or preprocessing steps, which may have important implications in the application of network analysis to the healthy and diseased brain.

Conclusion

The current work represents a systematic and quantitative evaluation of the effects of different processing choices on the architecture and TRT reliability of R-fMRI brain networks. Our results indicate that such brain networks have robust small-world configurations regardless of the correlation metric or preprocessing strategy (global signal regression and frequency interval) employed, but significant differences exist in both their global and regional topological parameters. These results suggest that comparisons of network studies with different processing strategies should be viewed with caution. TRT analysis showed that the reliability of network parameters was modulated by all three processing factors. In particular, topological properties were at their most reliable in the WOGR-PEAR networks. Furthermore, the TRT reliability of topological parameters was higher in the slow-4 band (0.027–0.073 Hz) than in the slow-5 band (0.01–0.027 Hz). Our results shed light on the processing strategies of functional brain networks acquired from resting-state fMRI. Our findings also provide a foundation for continued examination of network properties in typical and atypical populations.

Supporting Information

Figure S1.

Global topological properties in WGR-PEAR brain networks at different frequency bands. Plots show the changes in small-world parameters (Cp, Lp, γ, λ and σ), network efficiency (Local efficiency and Global efficiency), assortativity coefficient (α) and hierarchy coefficient (β) in functional brain networks at two different frequency bands (slow-5: 0.01–0.027 Hz, slow-4: 0.027–0.073 Hz) in case of WGR-PEAR as a function of sparsity thresholds. Local and global efficiency of random and regular networks with the same number of nodes and edges as the real networks were shown in gray lines in the network efficiency plots.

https://doi.org/10.1371/journal.pone.0032766.s001

(TIF)

Figure S2.

Global topological properties in WGR-PAR brain networks at different frequency bands. Plots show the changes in small-world parameters (Cp, Lp, γ, λ and σ), network efficiency (Local efficiency and Global efficiency), assortativity coefficient (α) and hierarchy coefficient (β) in functional brain networks at two different frequency bands (slow-5: 0.01–0.027 Hz, slow-4: 0.027–0.073 Hz) in case of WGR-PAR as a function of sparsity thresholds. Local and global efficiency of random and regular networks with the same number of nodes and edges as the real networks were shown in gray lines in the network efficiency plots.

https://doi.org/10.1371/journal.pone.0032766.s002

(TIF)

Figure S3.

Global topological properties in WOGR-PEAR brain networks at different frequency bands. Plots show the changes in small-world parameters (Cp, Lp, γ, λ and σ), network efficiency (Local efficiency and Global efficiency), assortativity coefficient (α) and hierarchy coefficient (β) in functional brain networks at two different frequency bands (slow-5: 0.01–0.027 Hz, slow-4: 0.027–0.073 Hz) in case of WOGR-PEAR as a function of sparsity thresholds. Local and global efficiency of random and regular networks with the same number of nodes and edges as the real networks were shown in gray lines in the network efficiency plots.

https://doi.org/10.1371/journal.pone.0032766.s003

(TIF)

Figure S4.

Global topological properties in WOGR-PAR brain networks at different frequency bands. Plots show the changes in small-world parameters (Cp, Lp, γ, λ and σ), network efficiency (Local efficiency and Global efficiency), assortativity coefficient (α) and hierarchy coefficient (β) in functional brain networks at two different frequency bands (slow-5: 0.01–0.027 Hz, slow-4: 0.027–0.073 Hz) in case of WOGR-PAR as a function of sparsity thresholds. Local and global efficiency of random and regular networks with the same number of nodes and edges as the real networks were shown in gray lines in the network efficiency plots.

https://doi.org/10.1371/journal.pone.0032766.s004

(TIF)

Figure S5.

Correlation metrics and global signal dependent differences in global network properties in weighted networks. Bars show the differences in the areas under curves (AUC) of (A) small-world parameters (Cp, Lp, γ, λ and σ), (B) network efficiency (Local efficiency and Global efficiency) and (C) assortativity coefficient (α) and hierarchy coefficient (β). Error bars correspond to standard deviation of the mean across participants. The asterisk indicates p<0.05.

https://doi.org/10.1371/journal.pone.0032766.s005

(TIF)

Figure S6.

Functional hubs derived from weighted networks using different correlation metrics and global signal strategies. (A) WGR-PEAR, (B) WOGR-PEAR, (C) WGR-PAR and (D) WOGR-PAR. Regions with degree>the mean+standard deviation were considered hubs. Node colors were coded according to their membership of classical cortex classifications: association cortex (red), limbic cortex (purple), paralimbic cortex (green), subcortical regions (light blue) and primary cortex regions (dark blue).

https://doi.org/10.1371/journal.pone.0032766.s006

(TIF)

Figure S7.

TRT reliability of global topological properties for Pearson's-correlation and partial-correlation-based weighted networks with and without global signal regression. The reliability was estimated using areas under curves (AUC) of each metric. Statistical analysis revealed significant differences in (A) short-term and/or (B) long-term TRT reliability driven by correlation metrics and/or global signal regression.

https://doi.org/10.1371/journal.pone.0032766.s007

(TIF)

Figure S8.

TRT reliability of nodal degree for Pearson's-correlation and partial-correlation-based weighted networks with and without global signal regression. Nodal TRT reliability values were projected onto MNI brain surface using the BrainNet viewer (http://www.nitrc.org/projects/bnv/) for (A) short-term scans and (B) long-term scans in WGR-PEAR networks, WGR-PAR networks, WOGR-PEAR networks and WOGR-PAR networks. Significant differences were found in TRT reliability of nodal degree driven by correlation metrics (Pearson's correlation/partial correlation) and global signal regression (with/without) for (C) short-term and (D) long-term scans. Nodal degree in WOGR-PEAR networks showed the highest ICC values. The asterisk indicates p<0.05. L, left hemisphere; R, right hemisphere.

https://doi.org/10.1371/journal.pone.0032766.s008

(TIF)

Figure S9.

Frequency dependent differences in global network properties of weighted functional brain networks. Bars show the differences in the areas under curves (AUC) of (A) small-world parameters (Cp, Lp, γ, λ and σ), (B) network efficiency (Local efficiency and Global efficiency), (C) assortativity coefficient (α) and hierarchy coefficient (β). Error bars correspond to standard deviation of the mean across participants. The asterisk indicates p<0.05.

https://doi.org/10.1371/journal.pone.0032766.s009

(TIF)

Figure S10.

Functional hubs derived from weighted networks in different frequency bands. Regions with degree>the mean+standard deviation are considered to be hubs. Node colors were coded according to their membership of classical cortex classifications: association cortex (red), limbic cortex (purple), paralimbic cortex (green), subcortical regions (light blue) and primary cortex regions (dark blue). (A) slow-5 (0.01–0.027 Hz). (B) slow-4 (0.027–0.073 Hz).

https://doi.org/10.1371/journal.pone.0032766.s010

(TIF)

Figure S11.

TRT reliability of global topological properties for weighted networks in different frequency bands. The reliability was estimated using areas under curves (AUC) of each metric. Statistical analysis revealed significant differences in (A) short-term and/or (B) long-term TRT reliability driven by different frequency bands.

https://doi.org/10.1371/journal.pone.0032766.s011

(TIF)

Figure S12.

TRT reliability of nodal degree for weighted brain networks in different frequency bands. TRT reliability values of nodal degree were projected onto MNI brain surface using the BrainNet viewer (http://www.nitrc.org/projects/bnv/) for (A) short-term scans and (B) long-term scans in slow-5 and slow-4. Significant differences were found in TRT reliability of nodal degree driven by different frequency bands for (C) short-term and (D) long-term scans. Nodal degree in brain networks in slow-4 band showed higher ICC values. The asterisk indicates p<0.05. L, left hemisphere; R, right hemisphere.

https://doi.org/10.1371/journal.pone.0032766.s012

(TIF)

Table S1.

Regions of interest from AAL atlas. The regions are listed in terms of a prior template of Anatomical Automatic Labeling atlas (Tzourio-Mazoyer et al., 2002).

https://doi.org/10.1371/journal.pone.0032766.s013

(DOC)

Acknowledgments

We thank Dr. Yufeng Zang and Dr. Michael P. Milham for kindly providing the Datasets.

Author Contributions

Conceived and designed the experiments: XL JHW YH. Performed the experiments: XL. Analyzed the data: XL. Contributed reagents/materials/analysis tools: CGY NS KX GLG. Wrote the paper: XL JHW CGY YH.

References

  1. 1. Fox MD, Raichle ME (2007) Spontaneous fluctuations in brain activity observed with functional magnetic resonance imaging. Nat Rev Neurosci 8: 700–711.
  2. 2. Biswal BB, Mennes M, Zuo XN, Gohel S, Kelly C, et al. (2010) Toward discovery science of human brain function. Proc Natl Acad Sci U S A 107: 4734–4739.
  3. 3. Bullmore E, Sporns O (2009) Complex brain networks: graph theoretical analysis of structural and functional systems. Nat Rev Neurosci.
  4. 4. Watts DJ, Strogatz SH (1998) Collective dynamics of ‘small-world’ networks. Nature 393: 440–442.
  5. 5. Salvador R, Suckling J, Coleman MR, Pickard JD, Menon D, et al. (2005) Neurophysiological architecture of functional magnetic resonance images of human brain. Cereb Cortex 15: 1332–1342.
  6. 6. Achard S, Bullmore E (2007) Efficiency and cost of economical brain functional networks. PLoS Comput Biol 3: e17.
  7. 7. Achard S, Salvador R, Whitcher B, Suckling J, Bullmore E (2006) A resilient, low-frequency, small-world human brain functional network with highly connected association cortical hubs. J Neurosci 26: 63–72.
  8. 8. Buckner RL, Sepulcre J, Talukdar T, Krienen FM, Liu H, et al. (2009) Cortical hubs revealed by intrinsic functional connectivity: mapping, assessment of stability, and relation to Alzheimer's disease. J Neurosci 29: 1860–1873.
  9. 9. Cole MW, Pathak S, Schneider W (2010) Identifying the brain's most globally connected regions. Neuroimage 49: 3132–3148.
  10. 10. He Y, Wang J, Wang L, Chen ZJ, Yan C, et al. (2009) Uncovering intrinsic modular organization of spontaneous brain activity in humans. PLoS One 4: e5226.
  11. 11. Bassett DS, Bullmore ET (2009) Human brain networks in health and disease. Curr Opin Neurol 22: 340–347.
  12. 12. He Y, Chen Z, Gong G, Evans A (2009) Neuronal networks in Alzheimer's disease. Neuroscientist 15: 333–350.
  13. 13. Sporns O (2011) The human connectome: a complex network. Annals of the New York Academy of Sciences 1224: 109–125.
  14. 14. Butts CT (2009) Revisiting the foundations of network analysis. Science 325: 414–416.
  15. 15. Fornito A, Zalesky A, Bullmore ET (2010) Network scaling effects in graph analytic studies of human resting-state fMRI data. Frontiers in Systems Neuroscience 4:
  16. 16. Hayasaka S, Laurienti PJ (2010) Comparison of characteristics between region-and voxel-based network analyses in resting-state fMRI data. Neuroimage 50: 499–508.
  17. 17. Wang J, Wang L, Zang Y, Yang H, Tang H, et al. (2009) Parcellation-dependent small-world brain functional networks: A resting-state fMRI study. Hum Brain Mapp.
  18. 18. Zalesky A, Fornito A, Harding IH, Cocchi L, Yucel M, et al. (2010) Whole-brain anatomical networks: does the choice of nodes matter? Neuroimage 50: 970–983.
  19. 19. Eguiluz VM, Chialvo DR, Cecchi GA, Baliki M, Apkarian AV (2005) Scale-free brain functional networks. Phys Rev Lett 94: 018102.
  20. 20. Liu Y, Liang M, Zhou Y, He Y, Hao Y, et al. (2008) Disrupted small-world networks in schizophrenia. Brain 131: 945–961.
  21. 21. Nakamura T, Hillary FG, Biswal BB (2009) Resting network plasticity following brain injury. PLoS One 4: e8220.
  22. 22. Zhang J, Wang J, Wu Q, Kuang W, Huang X, et al. (2011) Disrupted Brain Connectivity Networks in Drug-Naive, First-Episode Major Depressive Disorder. Biological Psychiatry 70: 334–342.
  23. 23. Pereda E, Quiroga RQ, Bhattacharya J (2005) Nonlinear multivariate analysis of neurophysiological signals. Prog Neurobiol 77: 1–37.
  24. 24. Sun FT, Miller LM, D'Esposito M (2004) Measuring interregional functional connectivity using coherence and partial coherence analyses of fMRI data. Neuroimage 21: 647–658.
  25. 25. Smith SM, Miller KL, Salimi-Khorshidi G, Webster M, Beckmann CF, et al. (2011) Network modelling methods for FMRI. Neuroimage 54: 875–891.
  26. 26. Birn RM, Diamond JB, Smith MA, Bandettini PA (2006) Separating respiratory-variation-related fluctuations from neuronal-activity-related fluctuations in fMRI. Neuroimage 31: 1536–1548.
  27. 27. Fox MD (2005) The human brain is intrinsically organized into dynamic, anticorrelated functional networks. PNAS.
  28. 28. Fransson P (2005) Spontaneous low-frequency BOLD signal fluctuations: an fMRI investigation of the resting-state default mode of brain function hypothesis. Hum Brain Mapp 26: 15–29.
  29. 29. Glover GH, Li TQ, Ress D (2000) Image-based method for retrospective correction of physiological motion effects in fMRI: RETROICOR. Magn Reson Med 44: 162–167.
  30. 30. Murphy K, Birn RM, Handwerker DA, Jones TB, Bandettini PA (2009) The impact of global signal regression on resting state correlations: are anti-correlated networks introduced? Neuroimage 44: 893–905.
  31. 31. Fox MD, Zhang D, Snyder AZ, Raichle ME (2009) The global signal and observed anticorrelated resting state brain networks. J Neurophysiol 101: 3270–3283.
  32. 32. Weissenbacher A, Kasess C, Gerstl F, Lanzenberger R, Moser E, et al. (2009) Correlations and anticorrelations in resting-state functional connectivity MRI: A quantitative comparison of preprocessing strategies. Neuroimage 47: 1408–1416.
  33. 33. Meunier D, Achard S, Morcom A, Bullmore E (2009) Age-related changes in modular organization of human brain functional networks. Neuroimage 44: 715–723.
  34. 34. Schwarz AJ, McGonigle J (2011) Negative edges and soft thresholding in complex network analysis of resting state functional connectivity data. Neuroimage 55: 1132–1146.
  35. 35. Buzsaki G, Draguhn A (2004) Neuronal oscillations in cortical networks. Science 304: 1926–1929.
  36. 36. Penttonen M, Buzsáki G (2003) Natural logarithmic relationship between brain oscillators. Thalamus & Related Systems 2: 145–152.
  37. 37. Salvador R, Martinez A, Pomarol-Clotet E, Gomar J, Vila F, et al. (2008) A simple view of the brain through a frequency-specific functional connectivity measure. Neuroimage 39: 279–289.
  38. 38. Salvador R, Suckling J, Schwarzbauer C, Bullmore E (2005) Undirected graphs of frequency-dependent functional connectivity in whole brain networks. Philos Trans R Soc Lond B Biol Sci 360: 937–946.
  39. 39. Supekar K, Musen M, Menon V (2009) Development of large-scale functional brain networks in children. PLoS Biol 7: e1000157.
  40. 40. Bassett DS, Brown JA, Deshpande V, Carlson JM, Grafton ST (2011) Conserved and variable architecture of human white matter connectivity. Neuroimage 54: 1262–1279.
  41. 41. Vaessen MJ, Hofman PAM, Tijssen HN, Aldenkamp AP, Jansen JFA, et al. (2010) The effect and reproducibility of different clinical DTI gradient sets on small world brain connectivity measures. Neuroimage 51: 1106–1116.
  42. 42. Deuker L, Bullmore ET, Smith M, Christensen S, Nathan PJ, et al. (2009) Reproducibility of graph metrics of human brain functional networks. Neuroimage 47: 1460–1468.
  43. 43. Telesford QK, Morgan AR, Hayasaka S, Simpson SL, Barret W, et al. (2010) Reproducibility of graph metrics in fMRI networks. Frontiers in Neuroinformatics 4:
  44. 44. Wang J-H, Zuo X-N, Gohel S, Milham MP, Biswal BB, et al. (2011) Graph Theoretical Analysis of Functional Brain Networks: Test-Retest Evaluation on Short- and Long-Term Resting-State Functional MRI Data. PLoS One 6: e21976.
  45. 45. Braun U, Plichta MM, Esslinger C, Sauer C, Haddad L, et al. (2012) Test–retest reliability of resting-state connectivity network characteristics using fMRI and graph theoretical measures. Neuroimage 59: 1404–1412.
  46. 46. Biswal B, Yetkin FZ, Haughton VM, Hyde JS (1995) Functional connectivity in the motor cortex of resting human brain using echo-planar MRI. Magn Reson Med 34: 537–541.
  47. 47. Di Martino A, Ghaffari M, Curchack J, Reiss P, Hyde C, et al. (2008) Decomposing intra-subject variability in children with attention-deficit/hyperactivity disorder. Biol Psychiatry 64: 607–614.
  48. 48. Zuo XN, Di Martino A, Kelly C, Shehzad ZE, Gee DG, et al. (2010) The oscillating brain: complex and reliable. Neuroimage 49: 1432–1445.
  49. 49. Han Y, Wang J, Zhao Z, Min B, Lu J, et al. (2011) Frequency-dependent changes in the amplitude of low-frequency fluctuations in amnestic mild cognitive impairment: A resting-state fMRI study. Neuroimage 55: 287–295.
  50. 50. Tzourio-Mazoyer NL, Papathanassiou D, Crivello F, Etard O, Delcroix N, et al. (2002) Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage 15: 273–289.
  51. 51. Rubinov M, Sporns O (2010) Complex network measures of brain connectivity: Uses and interpretations. Neuroimage 52: 1059–1069.
  52. 52. Shrout PE, Fleiss JL (1979) Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin 86: 420–428.
  53. 53. Sampat MP, Whitman GJ, Stephens TW, Broemeling LD, Heger NA, et al. (2006) The reliability of measuring physical characteristics of spiculated masses on mammography. Br J Radiol 79: S134–140.
  54. 54. Winer B (1971) Statistical principles in experimental design. New York: McGraw-Hill press. pp. 283–293.
  55. 55. Bassett DS, Bullmore E (2006) Small-world brain networks. Neuroscientist 12: 512–523.
  56. 56. Newman MEJ (2002) Assortative Mixing in Networks. Physical Review Letters 89: 208701.
  57. 57. Bassett DS, Bullmore E, Verchinski BA, Mattay VS, Weinberger DR, et al. (2008) Hierarchical organization of human cortical networks in health and schizophrenia. J Neurosci 28: 9239–9248.
  58. 58. Park C-h, Kim SY, Kim Y-H, Kim K (2008) Comparison of the small-world topology between anatomical and functional connectivity in the human brain. Physica A: Statistical Mechanics and its Applications 387: 5958–5962.
  59. 59. Ravasz E, Barabási A-L (2003) Hierarchical organization in complex networks. Physical Review E 67: 026112.
  60. 60. Jalili M, Knyazeva M (2011) Constructing brain functional networks from EEG: partial and unpartial correlations. J Integr Neurosci 10: 213–232.
  61. 61. He Y, Chen ZJ, Evans AC (2007) Small-world anatomical networks in the human brain revealed by cortical thickness from MRI. Cereb Cortex 17: 2407–2419.
  62. 62. He Y, Chen Z, Evans A (2008) Structural insights into aberrant topological patterns of large-scale cortical networks in Alzheimer's disease. J Neurosci 28: 4756–4766.
  63. 63. Mesulam M-M (1998) From sensation to cognition. Brain 121: 1013–1052.
  64. 64. Schroeder CE, Lakatos P (2009) Low-frequency neuronal oscillations as instruments of sensory selection. Trends in Neurosciences 32: 9–18.
  65. 65. Sporns O, Honey CJ, Kotter R (2007) Identification and classification of hubs in brain networks. PLoS ONE 2: e1049.
  66. 66. Guimera R, Nunes Amaral LA (2005) Functional cartography of complex metabolic networks. Nature 433: 895–900.
  67. 67. Hoptman MJ, Zuo X-N, Butler PD, Javitt DC, D'Angelo D, et al. (2010) Amplitude of low-frequency oscillations in schizophrenia: A resting state fMRI study. Schizophrenia Research 117: 13–20.
  68. 68. Bullmore ET, Bassett DS (2011) Brain Graphs: Graphical Models of the Human Brain Connectome. Annual Review of Clinical Psychology 7: null.
  69. 69. Yan C, Liu D, He Y, Zou Q, Zhu C, et al. (2009) Spontaneous Brain Activity in the Default Mode Network Is Sensitive to Different Resting-State Conditions with Limited Cognitive Load. PLoS ONE 4: e5743.
  70. 70. Van Dijk KRA, Hedden T, Venkataraman A, Evans KC, Lazar SW, et al. (2010) Intrinsic Functional Connectivity As a Tool For Human Connectomics: Theory, Properties, and Optimization. Journal of Neurophysiology 103: 297–321.