Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Inverse effects of tDCS over the left versus right DLPC on emotional processing: A pupillometry study

  • Jens Allaert ,

    Roles Data curation, Formal analysis, Methodology, Writing – original draft

    jens.allaert@ugent.be

    Affiliations Department of Head and Skin, Ghent University, University Hospital Ghent (UZ Ghent), Department of Psychiatry and Medical Psychology, Ghent, Belgium, Ghent Experimental Psychiatry (GHEP) Lab, Ghent University, Ghent, Belgium, Department of Experimental Clinical and Health Psychology, Ghent University, Ghent, Belgium

  • Alvaro Sanchez-Lopez,

    Roles Conceptualization, Data curation, Funding acquisition, Methodology, Resources, Supervision, Writing – review & editing

    Affiliation Department of Clinical Psychology, Universidad Complutense de Madrid, Madrid, Spain

  • Rudi De Raedt,

    Roles Conceptualization, Methodology, Resources, Supervision, Writing – review & editing

    Affiliation Department of Experimental Clinical and Health Psychology, Ghent University, Ghent, Belgium

  • Chris Baeken,

    Roles Conceptualization, Writing – review & editing

    Affiliations Department of Head and Skin, Ghent University, University Hospital Ghent (UZ Ghent), Department of Psychiatry and Medical Psychology, Ghent, Belgium, Ghent Experimental Psychiatry (GHEP) Lab, Ghent University, Ghent, Belgium, Department of Experimental Clinical and Health Psychology, Ghent University, Ghent, Belgium, Department of Psychiatry, Vrije Universiteit Brussel (VUB), University Hospital UZ Brussel, Brussels, Belgium

  • Marie-Anne Vanderhasselt

    Roles Conceptualization, Data curation, Funding acquisition, Methodology, Resources, Supervision, Validation, Writing – original draft, Writing – review & editing

    Affiliations Department of Head and Skin, Ghent University, University Hospital Ghent (UZ Ghent), Department of Psychiatry and Medical Psychology, Ghent, Belgium, Ghent Experimental Psychiatry (GHEP) Lab, Ghent University, Ghent, Belgium, Department of Experimental Clinical and Health Psychology, Ghent University, Ghent, Belgium

Abstract

Background and objectives

The Dorsolateral prefrontal cortex (DLPFC) is implicated in cognitive and emotional responses. Yet, research that investigates the causal role of the left versus right DLPFC during the processes of emotion appraisal is lacking. In the current study, transcranial direct current stimulation (tDCS) was used to disentangle the functional lateralization of the DLPFC on emotional processing in response to the anticipation of, and subsequent confrontation with emotional stimuli in healthy volunteers.

Methods

Forty-eight subjects received both active and sham (on separate days) anodal tDCS over either the left (N = 24) or right (N = 24) DLPFC. Subjects’ pupil dilation (PD, a physiological marker of cognitive resource allocation) was recorded while performing an appraisal task in which negative and positive emotion eliciting images were presented, each preceded by an informative cue indicating the valence of the upcoming stimulus.

Results

As compared to sham stimulation, left DLPFC anodal tDCS resulted in increased PD when confronted with negative emotional images, whereas right DLPFC anodal tDCS resulted in decreased PD when confronted with emotional images, irrespective of valence.

Limitations

The interpretation of pupil dilation in response to emotional stimuli is limited.

Conclusion

These findings suggest inverse lateralized DLPFC effects on cognitive resource allocation (as measured by pupillary responses) when confronted with emotional stimuli. The current findings may shed some light on mechanisms that explain the antidepressant effects of non-invasive brain stimulation of the left DLPFC.

Introduction

The regulation of emotional responses is essential for subjective wellbeing [1], and plays an important part in dealing with daily life hassles. Prefrontal cortico-limbic networks including the dorsolateral prefrontal cortex (DLPFC) and the ventrolateral prefrontal cortex (VLPFC) play an important role in this modulation of emotional responses [26]. For instance, it has been shown that when individuals are instructed to down-regulate their emotional responses towards emotional stimuli (i.e., reappraisal), activity in the DLPFC increases, while activity in the amygdala and self-reported negative affect decreases [5]. It is well known that the DLPFC has lateralized functioning. Increased right DLPFC activity is associated with emotion/mood dysregulation and deficits in the regulation of emotional attention [7], whereas increased left DLPFC activity is related to efficient emotion and emotional attention regulation [8]. In the same context, patients with mood disorders are characterized by a functional hemispheric imbalance of the DLPFC, with hyperactivity of the right DLPFC and hypoactivity of the left DLPFC [9]. Moreover, by using non-invasive brain stimulation (NIBS) techniques, augmenting activity in the left DLPFC or reducing activity in the right DLPFC has been shown to decrease depressive symptoms (for a review, see [10]). Research in healthy volunteers showed that anodal (i.e., excitatory) tDCS over the left DLPFC decreased emotional reactivity towards negative stimuli, as measured by both behavioral [11, 12], and psychophysiological [13] assessment methods.

To date, even though NIBS is optimal to study lateralization of DLPFC in emotional processing, research in healthy populations is currently limited to the scope of selective emotional attention [14]. Specifically, it has been shown that anodal (i.e., excitatory) tDCS over the right DLPFC leads to diminished emotional attentional disengagement, whereas anodal tDCS over the left DLPFC leads to improved emotional attentional disengagement. These latter effects were observed in a task requiring participants to intentionally implement top-down attention regulation (i.e., divert gaze away from emotional stimuli when prompted to engage with their neutral counterparts; [14, 15]). In other words, participants had to follow instructions in order to perform the emotional attention task. Yet, the DLPFC is implicated in the maintenance and implementation of goal-oriented behaviour (e.g., cognitive control, selective attention, [16]), and these lateralized effects might be related to attentional set differences between left and right DLPF activity [1719]. Moreover, the DLPFC is also involved in other anticipatory (related to attentional set) and reactive cognitive processes (e.g., [20]), that also play a role in emotional processing [21]. Emotional responses arise both when confronted with an emotion-eliciting event, as well as when anticipating such an event. For instance, the anticipation of a stressful event has been shown to generate similar emotional and physiological responses as the stressful event itself [22, 23], and anticipatory emotional processes may play an important role in emotion and stress regulation [24, 25]. Research is therefore warranted to investigate the functional lateralization of DLPFC functioning on emotional processing, when anticipating emotional stimuli and responding naturally (i.e., absence of task instructions) to these. Such research is important as it resembles real life contexts more closely (i.e., absence of explicit task instructions and/or pre-existing performance goals) and may shed light on the outcomes of a functional hemispheric DLPFC imbalance on emotional processing, thereby contributing to neuropsychological depression research.

Taken together, the aim of the current study was to investigate—using anodal tDCS versus sham (placebo stimulation)—the functional lateralization of the DLPFC (and its associated prefrontal cortico-limbic network) in regard to emotional processing when individuals respond naturally to emotional stimuli (i.e., response phase), and where they receive time to prepare to deal with these emotion-eliciting stimuli (i.e., anticipation phase), without explicit instructions on how to respond to such stimuli. For this purpose, pupil dilation was measured during the anticipation and response phase. Pupil dilation (i.e., an increase in pupil size), caused by the iris dilator muscle, is under control of the sympathetic nervous system [26, 27] and has been shown (under constant luminance conditions) to be positively related to emotional arousal [2830], cognitive load, mental effort, conflict processing, [3134], and emotion regulatory effort [3539]. Taken together, pupil dilation seems to reflect cognitive resource allocation for the processing of (emotional) stimuli, and can be measured during the anticipation of, and confrontation with, emotion-eliciting stimuli [25, 40].

First, based on previous research demonstrating reduced emotional reactivity towards negative stimuli after anodal tDCS applied to the left DLPFC (suggested due to an increase of cognitive control; [3, 1113]), we hypothesized that anodal tDCS applied to the left DLPFC (compared to sham tDCS) would result in larger PD (i.e., increased allocation of cognitive resources for emotional processing) during the presentation of negative stimuli (H1). Second, based on previous studies in which excitatory NIBS applied to the right DLPFC produced acute deficits in selective emotional attention [14, 15, 41], which in turn may contribute to impairments in emotion regulatory processes [42, 43], we hypothesized that anodal tDCS applied to the right DLPFC (versus sham tDCS over the right DLPFC) would result in decreased PD (i.e., decreased allocation of cognitive resources for emotional processing) during the presentation of emotional stimuli (H2). Finally, in view of an absence of research in which the causal role of the left and right DLPFC on emotional anticipatory processes during natural responding (without task instructions) is investigated, we have no clear surrounding hypothesis, and this section remains exploratory (but an innovative part of our study).

Materials and methods

Participants

Forty-eight healthy participants (aged 18–26; M = 21.35; SD = 2.21; 67% female) participated in the study. A post-hoc power analysis was conducted with G*Power [44] to compute the observed power, using the observed group × stimulation × phase × valence effect size (ηp2 = .12) and sample size (N = 48) as input, showing power (1- β) = .98. Participants were recruited through Facebook and the Ghent University web service. Selection criteria for participation was: right handedness, normal or corrected to normal vision (only contact lenses, glasses were not allowed due to technical issues with the eye-tracker to collect data from these participants), no pregnancy at time of stimulation, no history or current neurological or psychiatric disorders (checked using the Dutch version of the MINI screening; [45, 46]), no current use of psychoactive substances or psychotropic medication, no history of serious head injury. The experiment was conducted in accordance with the Declaration of Helsinki and the approval of Ghent University’s Medical Ethical Committee was obtained in advance. Furthermore, all participants provided written informed consent at the start of the experiment. Participants received € 30 for participation.

Materials

Emotional appraisal paradigm.

Participants were presented with a set of 30 positive (i.e., pleasant) and 30 negative (i.e., unpleasant) gray scaled pictures selected from the International Affective Picture System (IAPS; [47]). The following IAPS pictures were used for negative emotions: 1019, 1205, 1300, 2117, 2800, 2811, 2911, 3170, 3530, 3550, 6021, 6212, 6213, 6250, 6550, 6560, 6570, 8230, 8430, 8480, 9040, 9181, 9250, 9252, 9254, 9300, 9423, 9571, 9594, and 9635. For positive emotions, the following IAPS pictures were used: 1340, 1441, 1659, 1710, 1920, 2040, 2045, 2151, 2158, 2306, 2314, 2332, 2339, 2340, 2352, 2373, 2392, 2395, 2550, 4542, 4599, 4625, 4641, 5829, 5831, 5833, 5836, 7325, 8350, and 8540. Based on IAPS normative data, the perceived valence (on a 1 to Likert 9 scale, where 9 reflects completely positive and 1 reflects completely negative) of positive (M = 7.35; SD = .57) and negative (M = 2.52; SD = .70) pictures differed significantly, t(58) = 29.25, p < .001. Moreover, the arousal ratings (on a 1 to 9 Likert scale, where 9 reflects completely aroused and 1 reflects completely unaroused) between positive (M = 4.70; SD = .59) and negative (M = 6.16; SD = .52) pictures also differed significantly, t(58) = 10.41, p < .001. Each picture was displayed for 6 seconds, and a cue (e.g., the word ‘negative’ or ‘positive’), was presented during the 6 seconds prior to each picture’s appearance. The cue always indicated the correct valence of the upcoming picture, thereby informing subjects whether the upcoming stimulus would elicit negative or positive emotions. The order of the picture presentation was pseudo randomized in advance, with the constraint that no more than three pictures of the same valence were presented consecutively. Moreover, pictures were arranged in 3 blocks of each 20 trials, in which the frequency of both picture valences was equal in each block. Participants were told that a series of pictures would be displayed on the screen, and that a cue preceding each picture would inform them about its valence. Participants were instructed to respond naturally to each picture and to look at it for the whole time it was displayed on the screen. In order to control for confounding effects of luminance on pupil dilation [28], the grey-scaled pictures of both valence types were corrected to have similar luminance values. There was no significant difference in luminance between positive (M = 90.35; SD = 30.88) and negative (M = 104.38; SD = 23.61) pictures, p > .1. Stimulus presentation was programmed in MATLAB and stimuli were displayed on a 22-inch Mitsubishi 2070SB CRT monitor, using a Cambridge Research System ViSaGe visual stimulus generator. The stimulus generator featured a contrast resolution of 14 bits per gun. The average luminance of the monitor was 104 cd/m2 (4002 Td) and the output of the display was gamma corrected. Subjects were seated approximately 75 cm from the monitor, using a fixed head rest. See Fig 1 for a visualization of the paradigm.

Transcranial direct current stimulation (tDCS).

TDCS was applied with a saline-soaked pair of surface sponge electrodes (35 cm2) and delivered with a battery-driven stimulator (DC-Stimulator Plus, neuroConn GmbH). TDCS modulates the membrane potential of neurons through either depolarization (anodal tDCS) or hyperpolarization (cathodal tDCS), thereby reducing the neuron threshold and increasing neuronal excitability (excitatory effect) or increasing the neuron threshold and reducing the neuronal excitability (inhibitory effect), respectively [48]. To stimulate the left DLPFC, the anode electrode was vertically positioned over F3 according to the 10–20 international system for electroencephalogram electrode placement, whereas the right DLPFC was stimulated by positioning the anode electrode vertically over F4. The cathodal reference electrode was horizontally positioned over the supra-orbital area, contralateral to the anodal electrode location (Fp2 and Fp1, respectively). The electrode placement and method of localization is in accordance with previous tDCS studies, and has shown to produce significant effects on cognitive and emotional processing in a vast range of studies [48, 49]. A constant, direct current of 2 mA (current density = .06), with 15 seconds of ramp up and ramp down, was applied for 20 minutes. For sham stimulation (i.e., placebo stimulation condition in each group) the electrode placement was identical, however the current was directly ramped down after the initial ramp up phase. This procedure entails a reliable sham procedure because subjects are not able to discriminate real from sham stimulation [48]. Fig 2 shows a visualization of the electric field simulation for the left DLPFC (Fig 2A) and right DLPFC (Fig 2B) tDCS montage, which was performed using Soterix HD-Explore software.

thumbnail
Fig 2. Electric field simulations for tDCS over the left and right DLPFC.

The scale represents the electric field (V/m) induced by the anode and cathode.

https://doi.org/10.1371/journal.pone.0218327.g002

Eye tracker.

Pupillary responses were recorded during the appraisal task using a Cambridge Research System High-Speed Video Eye tracker (CRS HS-VET) at a sampling rate of 250 Hz, resulting in 1500 data samples for each phase (i.e., cue and target) of the trial. The eye tracker and CRT monitor were controlled using the CRS MATLAB toolboxes, and the eye tracking data was transferred to a computer along with event markers indicating the start and valence of every trial, along with the respective phases (cue, target). At the beginning of the task, the eye-tracker was calibrated by instructing subjects to direct their gaze towards 9 dots that were randomly presented on the screen, one by one. Dots were displayed in the four corners of the display, midway between each corner, and in the middle of screen.

Questionnaires.

To evaluate temporary changes in mood and physical states from before (Tpre) to after (Tpost) stimulation, ratings were obtained, using six visual analog scales (VAS; [50]). The six VASs comprised 3 mood measures (i.e., happiness, anger, sadness) and 3 measures of physical states (i.e., fatigue, vigor, tension). Participants were asked to describe how they felt at that moment, by indicating on horizontal 100 cm lines to what extent they experienced each state, ranging from “totally not” to “very much”.

Procedure

Participants were randomly assigned to either the left or right DLPFC stimulation group. A single-blind randomized crossover within-subjects design was used for each group: each participant received both active and sham tDCS (either over the left or right DLPFC) on two separate days, with an interval of at least 2 days (M = 8.67 days, SD = 3.43 days, range: 2–16 days). The order of both stimulation sessions (active and sham tDCS) was counterbalanced across participants. At the start of the experiment, after providing written informed consent, participants reported their mood on the self-report visual analog scales. Next, participants underwent either active or sham tDCS over either the left or right DLPFC, for a period of 20 minutes. All participants were exposed to the same stimulation context in both stimulation sessions, by asking them to remain calmly seated, to not talk or read, until the stimulation was finished. After the stimulation, participants again reported their mood on the visual analogue scales. Subsequently, participants performed the appraisal paradigm, which lasted for roughly 12 minutes. Finally, participants were debriefed and paid € 30 for their participation. For a visualization of the session procedure, see Fig 3. This study was part of a larger project investigating attentional control. During the experimental protocol, before performing the appraisal task, participants performed an attentional engagement-disengagement task and completed several questionnaires (e.g., emotion regulation strategies, rumination, and anxiety). These results are reported by Sanchez-Lopez et al. [14].

Pupil data preprocessing

First, the pupil data were visually inspected. A consistent trend in pupil dilation was observed during each first trial of every block, compared to consecutive trials. As pupil dilation is sensitive to changes in luminance, and the screen before each first trial of every block is relatively dark compared to the subsequent brighter grey-scale screens during trials, we argued that these systematic differences were due to difference in luminance. Therefore, the pupil data of every first trial from every block were excluded from subsequent analysis, resulting in 27 positive trials and 30 negative trials. Next, invalid data points containing eye blinks, missing or invalid data were linearly interpolated using the interp1 function in Matlab. Next, the data were smoothed, by means of a moving average, using the fastsmooth function in Matlab, with a 5-frame width and a 2-pass filter. Then, the data were detrended (to remove slow irrelevant changes) within each block with simple linear regressions, using the detrend function in Matlab. Consequently, a baseline correction was applied by subtracting the average pupil diameter during the first 165 ms of each trial from the pupil diameter on the consecutive data points during the trial. These pre-processing steps and baseline correction timespan are consistent with prior studies using similar designs [25, 51]. Then, the pupil data from all trials for every subject was averaged, per condition, excluding trials for which 50% or more contained invalid data. This resulted in four pupil waveforms (cue-positive, cue-negative, target-positive, and target-negative) for every subject. Across all conditions, all trials were retained in 79% of the subjects. Finally, in accordance with previous research [28], the mean pupil response for each condition was calculated in a window from 2 to 6 s after picture or cue onset, thereby excluding the initial pupil light reflex (0 to 2s).

Data analytic plan

First, to assess whether tDCS affected reported mood and physical states, two mixed MANOVA’s were conducted, with one featuring the mood states as dependent variables and the other featuring the physical states as dependent variables. These models included group (left DLPFC, right DLPFC) as between-subject factor, stimulation (active tDCS, sham tDCS) and time (pre-stimulation, post-stimulation) as within-subject factors.

Second, to investigate whether tDCS over the left versus right (relative to sham) differentially affected pupillary responses, a mixed ANOVA with group (left DLPFC, right DLPFC) as between-subject factor, stimulation (active tDCS, sham tDCS), phase (cue, target) and valence (negative, positive) as within-subject factors, and pupillary changes as dependent variable, was conducted. Then, to investigate the specific effect of tDCS over the left and right DLPFC, two repeated measures ANOVA’s were conducted for each group (left DLPFC, right DLPFC) separately, with stimulation (active tDCS, sham tDCS), phase (cue, target) and valence (negative, positive) as within-subject factors, and pupillary responses as dependent variable. For the left DLPFC, to address hypothesis 1, a planned comparison (paired t-test) was conducted, testing the difference in pupillary responses during negative targets between active and sham stimulation. For the right DLPFC, to address hypothesis 2, a planned comparisons (paired t-test) was conducted, testing the difference in pupillary responses during the target phase between active and sham stimulation. Furthermore, observed interaction effects that were outside of the scope of our hypotheses, were decomposed using Bonferroni-corrected pairwise comparisons, whereas planned comparisons where not corrected for multiple comparisons, as these did not involve multiple (exploratory) pairwise comparisons and were hypothesis-driven [52]. Additionally, the potential presence of non-significant tDCS effects during the cue phase were followed-up with Bayesian paired samples t-tests.

Results

Mood and physical states

Both the mixed MANOVA with the mood states as dependent variables, as well as the mixed MANOVA with the physical states as dependent variables, both with group (left DLPFC, right DLPFC) as between-subject factor, stimulation (active tDCS, sham tDCS) and time (pre-stimulation, post-stimulation) as within-subject factors, yielded non-significant effects of group × stimulation × time, all F’s < .39, all p’s > .76, or stimulation × time, F’s < 1.36, all p’s > .27, suggesting that tDCS did not influence mood or physical states. Table 1 displays descriptive statistics regarding mood.

tDCS effects on pupillary changes

Table 2 displays descriptive statistics regarding PD for the various conditions. A mixed ANOVA with group (left DLPFC, right DLPFC) as between-subject factor, stimulation (active tDCS, sham tDCS), phase (cue, target) and valence (negative, positive) as within-subject factors, was conducted. An effect of phase was observed, F(1, 46) = 253.48, p < .001, ηp2 = .85, with higher pupillary changes in the target phase (M = .11, SD = .01), compared to the cue phase (M = -.19, SD = .01). In addition, a main effect of valence was observed, F(1, 46) = 20.132, p < .001, ηp2 = .30, with higher pupillary changes during negative trials (M = -.01, SD = .01), compared to positive trials (M = -.072, SD = .01). However, these phase and valence effects were accounted by a phase × valence effect, F(1, 46) = 8.86, p = .01, ηp2 = .16. Bonferroni-corrected pairwise comparisons showed that the effect of phase was significant for both negative, t(47) = 12.53, p < .001, d = 1.81, and positive trials, t(47) = 13.97, p < .001, d = 2.02, whereas the effect of valence was only significant during the cue phase, t(47) = 4.81, p < .001, d = .70, but not during the target phase, t(47) = 1.28, p = .82. Furthermore, a significant effect of group × stimulation × phase, F(1, 46) = 4.84, p = .03, ηp2 = .10, and a significant effect of group × stimulation × phase × valence, F(1, 46) = 5.98, p = .02, ηp2 = .12, was observed. All remaining effects (i.e., group, stimulation, group × stimulation, group × phase, group × valence, stimulation × phase, stimulation × valence, group × stimulation × valence, group × phase × valence, stimulation × phase ×valence) were non-significant (all Fs < 2.11, all ps > .15). Further analyses including session order (i.e., active tDCS in the first session or active tDCS in the second session) as a between-subject factor in the mixed ANOVA showed that both the stimulation × phase × group, F(1, 44) = 4.25, p = .04, ηp2 = .09, and the stimulation × phase × valence × group, F(1, 44) = 4.67, p = .04, ηp2 = .09, effects remained significant, indicating the effect was not dependent on session order. Order was not implied in any main or interaction effects. To test the hypothesized inverse tDCS effects over the left and right DLPFC on pupillary changes, the four-way stimulation × phase × valence × group interaction was followed up by testing the stimulation × phase × valence interaction separately for each group.

thumbnail
Table 2. Descriptive statistics regarding pupil dilation changes relative to baseline.

https://doi.org/10.1371/journal.pone.0218327.t002

Effects of tDCS over the left DLPFC on pupillary changes

A repeated measures ANOVA with stimulation (active tDCS, sham tDCS), phase (cue, target) and valence (negative, positive) showed a significant stimulation × phase × valence interaction, F(1, 23) = 4.98, p = .04, ηp2 = .18. The planned comparison showed a significant difference in pupillary responses between negative targets during active tDCS, compared to sham tDCS, t(23) = 2.53, p = .02, d = .52 (see Fig 4A). Specifically, when viewing negative targets, pupil dilation was larger during active tDCS over the left DLPFC (M = .15, SD = .13), compared to sham tDCS over the left DLPFC (M = .07, SD = .11). No significant difference between active and sham tDCS was observed in pupillary responses during the cue phase of negative trials, t(23) = .82, p = .42, or in the cue phase of positive trials, t(23) = .61, p = .56. Furthermore, post-hoc Bayesian paired samples t-tests were conducted to investigate the relative support for HO (i.e., there is no difference between active and sham tDCS) versus H1 (i.e., there is a difference between active and sham tDCS over the left DLPFC) on pupillary responses during the cue phase. For positive cue’s, HO was 4.66 times more likely than H1, BF01 = 4.66, whereas for negative cue’s, HO was 1.46 times more likely than H1, BF01 = 1.46. Taken together, there is anecdotal to moderate evidence for HO (i.e., there is no difference in pupillary responses during the cue phase between active and sham tDCS over the left DLPFC).

thumbnail
Fig 4. TDCS effects of left (A) and right (B) DLPFC on pupil dilation during the target phase.

https://doi.org/10.1371/journal.pone.0218327.g004

Effects of tDCS over the right DLPFC on pupillary changes

A repeated measures ANOVA with stimulation (active tDCS, sham tDCS), phase (cue, target), and valence (negative, positive), showed no significant stimulation × phase × valence interaction, F(1, 23) = 1.26, p = .27, ηp2 = .05, however, a significant two-way stimulation × phase interaction was observed, F(1, 23) = 5.17, p = .03, ηp2 = .18. The planned comparison showed a significant difference in pupillary responses between targets during active tDCS, compared to sham tDCS, t(23) = 2.25, p = .04, d = .47 (see Fig 4B). Specifically, when viewing targets (irrespective of valence), pupillary changes were smaller during active tDCS over the right DLPFC (M = .09, SD = .08), compared to sham tDCS over the right DLPFC (M = .13, SD = .07). Moreover, in the cue phase, no significant difference between active and sham tDCS was observed in pupillary responses, t(23) = 1.44, p = .16. A post-hoc Bayesian paired samples t-test was conducted to investigate the relative support for HO (i.e., there is no difference between active and sham tDCS over the right DLPFC) versus H1 (i.e., there is a difference between active and sham tDCS) on pupillary responses during the cue phase. HO was 1.88 times more likely than H1, BF01 = 1.88, indicating anecdotal to moderate evidence for HO (i.e., there is no difference in pupillary responses during the cue phase between active and sham tDCS over the right DLPFC).

Discussion

The aim of the current neuro-modulation study was to investigate the functional lateralization of the DLPFC (and its associated prefrontal cortico-limbic network) in regard to cognitive resource allocation (as indexed by pupil dilation) for emotional processing when naturally responding during the anticipation of, and confrontation with, emotional stimuli. Essentially, both groups (left and right sham controlled tDCS) were comparable on depressive symptoms and mood, suggesting neither pre-existing nor task related differences in emotional processing. Moreover, results suggested no differential effects of tDCS versus sham stimulation on mood or physical states, which would be consistent with previous research showing that among healthy individuals, NIBS over the DLPFC is able to influence emotional processing, without specifically modulating mood [53].

Overall, our results support the assumption of differential effects of tDCS applied to the left versus the right DLPFC in pupillary responses to emotion-eliciting stimuli. First, anodal versus sham tDCS applied to the left DLPFC resulted in increased PD when attending to negative, but not positive images. Pupil dilation has been associated with both emotional arousal [28], cognitive effort [54], and also activity in the DLPFC [37]. Other authors argued that pupil dilation reflects top-down regulation of emotional stimuli (e.g., [55, 56]). In the current study, participants received no instructions to regulate or use effort; they were simply asked to respond naturally and spontaneously to every emotion-eliciting stimulus (participants carefully looked at the pictures, and did not close their eyes). Therefore, in the current study, although pupil dilation does not indicate about intentional regulation effort, it does inform about automatic changes in emotional processing (i.e., cognitive resource allocation) due to neuromodulation of the DLPFC. Furthermore, it informs about the change in the sympathetic nervous (and arousal related neurochemical) system following the identification and appraisal of an emotion-eliciting stimulus. Furthermore, it is probable that the increased cognitive resource allocation (due to active tDCS over the left DLPFC), contributes to improved (emotion) regulatory top-down processes (i.e., cognitive control). This would be in line with research suggesting that improved cognitive control is an important working mechanism in the effects of NIBS over the left DLPFC in reducing depressive symptoms [8, 10, 57], and emotional reactivity [1113]. However, this is speculative and further research is required to specifically investigate whether these changes in resource allocation contribute to improved cognitive control and reduced emotional reactivity.

Second, anodal versus sham tDCS over the right DLPFC resulted in decreased PD when confronted with emotional stimuli, irrespective of their emotional valence. The data show a difference in dilation due to real versus placebo stimulation, denoting an adjustment in sympathetic nervous system in response to tDCS. Prior studies using excitatory NIBS over the right DLPFC showed adverse effects on emotional attention (e.g., increased attention towards negative stimuli, reduced attentional control over emotional information; [14, 41, 5860]), which in turn is suggested to contribute to maladaptive emotion regulatory processes [42, 61]. These findings would be consistent with the notion that excitatory right DLPFC stimulation contributes to decreased cognitive resource allocation to process emotional information, impeding individuals’ capacity to engage in emotion regulatory processes. As mentioned earlier, a functional hemispheric imbalance of the DLPFC is a hallmark of depression, with increased activity in the right DLPFC relative to the left DLPFC [9]. Moreover, this increased activity in the right DLPFC is suggested to contribute to depressive symptoms, such as increased negative mood [7]. In addition, depressed individuals typically display impaired performance on experimental paradigms in which they have to exert cognitive effort to inhibit emotional information [6264]. Altogether, results of the current study add to this literature by showing that PD decreases following tDCS over the right DLPFC, possibly denoting a reduction in cognitive resource allocation to process emotional information. Of importance, in contrast to the findings of the left DLPFC, this effect was independent of emotional valence. The origin of this valence right DLPFC non-specific effect in contrast to the valence specific left DLPFC is puzzling, and is in line with previous inconsistent results produced by previous research (for a review, see [53]). For instance, the results of one study showed increased attention towards negative stimuli after excitatory NIBS over the right DLPFC [41], whereas another showed reduced attentional control towards emotional information (irrespective of valence; [14]). Thus, further research is required to investigate in which specific contexts valence specific effects are produced.

Third, effects of tDCS during the anticipation phase were non-significant. Furthermore, post-hoc Bayesian paired t-tests for both the left and right DLPFC showed anecdotal to moderate evidence for the absence of tDCS effects. Conceptually, it could be that the current paradigm did not incentivize participants to proactively engage in emotional regulatory processes during the anticipation phase, as the stimuli have no personal relevance. Future studies could use more self-relevant and emotionally provoking stimuli, such as (rigged) social feedback, as the need to belong is a fundamental human motivation and social feedback automatically prompts self-regulatory processes [6567].

Besides a number of strengths, such as a comparison of the left versus right DLPFC, and the employment of an appraisal paradigm allowing natural responding, it has to be noted that the current study has several limitations. First, only pupillary responses were measured. As a result, it is difficult to interpret what pupil dilation reflects, given that PD has been shown to reflect both arousal and cognitive effort to control emotional responses [28, 29]. Future studies would benefit from including additional, complementary psychophysiological and behavioral measures, such as skin conductance response (an index of arousal; [68, 69]), changes in heart rate variability (an index of emotional regulation success; [70]), and self-report ratings of arousal and valence. Second, based on the normative IAPS data, positive and negative images not only differed on valence, but also on arousal (negative images being more arousing than positive images). However, this does not affect the validity of the conclusions of the current study, as inferences were restricted to the comparison between real and sham stimulation, and not between negative and positive stimuli. Third, tDCS produces diffuse effects, resulting in not only the neuro-modulation of the target area (DLPFC), but also of its underling neuronal network and neighboring brain regions [7173]. For instance, the VLPFC is also implicated in emotional processing, and is located near the DLPFC [5]. Furthermore, research has shown that anodal tDCS over the VLPFC affects emotional processing and emotional reactivity [7477]. Therefore, some caution is warranted for the specificity of the DLPFC stimulation in the current study. Future studies would benefit from the inclusion of neuro-imaging assessment, which would allow to investigate the specific affected neuro-circuitry.

To conclude, the results of the current study corroborate the hypothesis of inverse lateralized DLPFC functioning on cognitive resource allocation for emotional processing when naturally responding to emotional stimuli and extend previous findings of inverse lateralized DLPFC effects on emotional attention processes [14]. This study established a basic proof of concept for inverse lateralized DLPFC effects on resource allocation for emotional processing (as measured by pupillary responses) when attending anticipated emotional stimuli. The current findings may shed some light on the outcomes related to right DLPFC hyperactivity observed in depression, and on how left DLPFC tDCS may produce antidepressant effects.

References

  1. 1. Hu T, Zhang D, Wang J, Mistry R, Ran G, Wang X. Relation between Emotion Regulation and Mental Health: A Meta-Analysis Review. Psychological Reports. 2014;114(2):341–62. pmid:24897894
  2. 2. Ochsner KN, Bunge SA, Gross JJ, Gabrieli JDE. Rethinking Feelings: An fMRI Study of the Cognitive Regulation of Emotion. Journal of Cognitive Neuroscience. 2002;14(8):1215–29. pmid:12495527
  3. 3. Ochsner KN, Gross JJ. The cognitive control of emotion. Trends in Cognitive Sciences. 2005;9(5):242–9. pmid:15866151
  4. 4. Ochsner KN, Ray RD, Cooper JC, Robertson ER, Chopra S, Gabrieli JDE, et al. For better or for worse: neural systems supporting the cognitive down- and up-regulation of negative emotion. Neuroimage. 2004;23(2):483–99. pmid:15488398
  5. 5. Banks SJ, Eddy KT, Angstadt M, Nathan PJ, Phan KL. Amygdala–frontal connectivity during emotion regulation. Soc Cogn Affect Neurosci. 2007;2(4):303–12. pmid:18985136
  6. 6. Phillips ML, Ladouceur CD, Drevets WC. A neural model of voluntary and automatic emotion regulation: implications for understanding the pathophysiology and neurodevelopment of bipolar disorder. Molecular psychiatry. 2008;13(9):829–57. pmid:18574483
  7. 7. De Raedt R, Koster EH. Understanding vulnerability for depression from a cognitive neuroscience perspective: A reappraisal of attentional factors and a new conceptual framework. Cognitive, Affective, & Behavioral Neuroscience. 2010;10(1):50–70.
  8. 8. De Raedt R, Vanderhasselt MA, Baeken C. Neurostimulation as an intervention for treatment resistant depression: From research on mechanisms towards targeted neurocognitive strategies. Clin Psychol Rev. 2015;41:61–9. pmid:25468571
  9. 9. Grimm S, Beck J, Schuepbach D, Hell D, Boesiger P, Bermpohl F, et al. Imbalance between Left and Right Dorsolateral Prefrontal Cortex in Major Depression Is Linked to Negative Emotional Judgment: An fMRI Study in Severe Major Depressive Disorder. Biological Psychiatry. 2008;63(4):369–76. pmid:17888408
  10. 10. Baeken C, De Raedt R. Neurobiological mechanisms of repetitive transcranial magnetic stimulation on the underlying neurocircuitry in unipolar depression. Dialogues Clin Neurosci. 2011;13(1):139–45. pmid:21485753
  11. 11. Peña-Gómez C, Vidal-Piñeiro D, Clemente IC, Pascual-Leone Á, Bartrés-Faz D. Down-Regulation of Negative Emotional Processing by Transcranial Direct Current Stimulation: Effects of Personality Characteristics. PLOS ONE. 2011;6(7):e22812. pmid:21829522
  12. 12. Boggio PS, Zaghi S, Fregni F. Modulation of emotions associated with images of human pain using anodal transcranial direct current stimulation (tDCS). Neuropsychologia. 2009;47(1):212–7. pmid:18725237
  13. 13. Brunoni AR, Vanderhasselt MA, Boggio PS, Fregni F, Dantas EM, Mill JG, et al. Polarity- and valence-dependent effects of prefrontal transcranial direct current stimulation on heart rate variability and salivary cortisol. Psychoneuroendocrinology. 2013;38(1):58–66. pmid:22626867
  14. 14. Sanchez A, Vanderhasselt M-A, Allaert J, Baeken C, De Raedt R. Neurocognitive mechanisms behind emotional attention: Inverse effects of anodal tDCS over the left and right DLPFC on gaze disengagement from emotional faces. Cognitive, Affective, and Behavioral Neuroscience. 2018.
  15. 15. Sanchez A, Vanderhasselt MA, Baeken C, De Raedt R. Effects of tDCS over the right DLPFC on attentional disengagement from positive and negative faces: An eye-tracking study. Cognitive, affective & behavioral neuroscience. 2016;16(6):1027–38.
  16. 16. Miller EK, Cohen JD. An integrative theory of prefrontal cortex function. Annual review of neuroscience. 2001;24:167–202. pmid:11283309
  17. 17. Vanderhasselt MA, De Raedt R, Baeken C, Leyman L, Clerinx P, D’Haenen H. The influence of rTMS over the right dorsolateral prefrontal cortex on top-down attentional processes. Brain Res. 2007;1137(1):111–6. pmid:17229406
  18. 18. Vanderhasselt MA, De Raedt R, Baeken C, Leyman L, D’Haenen H. The influence of rTMS over the right dorsolateral prefrontal cortex on intentional set switching. Exp Brain Res. 2006;172(4):561–5. pmid:16724174
  19. 19. Vanderhasselt MA, De Raedt R, Baeken C. Dorsolateral prefrontal cortex and Stroop performance: tackling the lateralization. Psychon Bull Rev. 2009;16(3):609–12. pmid:19451392
  20. 20. Braver TS. The variable nature of cognitive control: a dual mechanisms framework. Trends in Cognitive Sciences. 2012;16(2):106–13. pmid:22245618
  21. 21. Seo D, Olman CA, Haut KM, Sinha R, MacDonald AW, Patrick CJ. Neural correlates of preparatory and regulatory control over positive and negative emotion. Soc Cogn Affect Neurosci. 2014;9(4):494–504. pmid:23887812
  22. 22. Gramer M, Reitbauer C. The influence of social support on cardiovascular responses during stressor anticipation and active coping. Biological psychology. 2010;85(2):268–74. pmid:20673842
  23. 23. Waugh CE, Panage S, Mendes WB, Gotlib IH. Cardiovascular and affective recovery from anticipatory threat. Biological psychology. 2010;84(2):169–75. pmid:20096747
  24. 24. De Raedt R, Hooley JM. The role of expectancy and proactive control in stress regulation: A neurocognitive framework for regulation expectation. Clinical psychology review. 2016;45:45–55. pmid:27064551
  25. 25. Vanderhasselt MA, Remue J, Ng KK, De Raedt R. The interplay between the anticipation and subsequent online processing of emotional stimuli as measured by pupillary dilatation: the role of cognitive reappraisal. Front Psychol. 2014;5:207. pmid:24659976
  26. 26. Loewenfeld IE, Lowenstein O. The pupil: Anatomy, physiology, and clinical applications: Wiley-Blackwell; 1993.
  27. 27. Beatty J, Lucero-Wagoner B. The pupillary system. Handbook of psychophysiology. 2000;2(142–162).
  28. 28. Bradley MM, Miccoli L, Escrig MA, Lang PJ. The pupil as a measure of emotional arousal and autonomic activation. Psychophysiology. 2008;45(4):602–7. pmid:18282202
  29. 29. Partala T, Surakka V. Pupil size variation as an indication of affective processing. International journal of human-computer studies. 2003;59(1):185–98.
  30. 30. Stanners RF, Coulter M, Sweet AW, Murphy P. The pupillary response as an indicator of arousal and cognition. Motiv Emot. 1979;3(4):319–40.
  31. 31. Kahneman D, Beatty J. Pupil diameter and load on memory. Science. 1966;154(3756):1583–5. pmid:5924930
  32. 32. Kahneman D. Attention and effort: Citeseer; 1973.
  33. 33. Iqbal ST, Zheng XS, Bailey BP, editors. Task-evoked pupillary response to mental workload in human-computer interaction. CHI'04 extended abstracts on Human factors in computing systems; 2004: ACM.
  34. 34. Van Steenbergen H, Band G. Pupil dilation in the Simon task as a marker of conflict processing. Frontiers in Human Neuroscience. 2013;7(215).
  35. 35. Kinner VL, Kuchinke L, Dierolf AM, Merz CJ, Otto T, Wolf OT. What our eyes tell us about feelings: Tracking pupillary responses during emotion regulation processes. Psychophysiology. 2017;54(4):508–18. pmid:28072452
  36. 36. Johnstone T, van Reekum CM, Urry HL, Kalin NH, Davidson RJ. Failure to regulate: counterproductive recruitment of top-down prefrontal-subcortical circuitry in major depression. The Journal of neuroscience: the official journal of the Society for Neuroscience. 2007;27(33):8877–84.
  37. 37. Siegle GJ, Steinhauer SR, Stenger VA, Konecky R, Carter CS. Use of concurrent pupil dilation assessment to inform interpretation and analysis of fMRI data. Neuroimage. 2003;20(1):114–24. pmid:14527574
  38. 38. Urry HL, van Reekum CM, Johnstone T, Kalin NH, Thurow ME, Schaefer HS, et al. Amygdala and Ventromedial Prefrontal Cortex Are Inversely Coupled during Regulation of Negative Affect and Predict the Diurnal Pattern of Cortisol Secretion among Older Adults. The Journal of Neuroscience. 2006;26(16):4415–25. pmid:16624961
  39. 39. van Reekum CM, Johnstone T, Urry HL, Thurow ME, Schaefer HS, Alexander AL, et al. Gaze fixations predict brain activation during the voluntary regulation of picture-induced negative affect. Neuroimage. 2007;36(3):1041–55. pmid:17493834
  40. 40. Moresi S, Adam JJ, Rijcken J, Van Gerven PWM, Kuipers H, Jolles J. Pupil dilation in response preparation. International Journal of Psychophysiology. 2008;67(2):124–30. pmid:18067982
  41. 41. d’Alfonso AA, van Honk J, Hermans E, Postma A, de Haan EH. Laterality effects in selective attention to threat after repetitive transcranial magnetic stimulation at the prefrontal cortex in female subjects. Neuroscience letters. 2000;280(3):195–8. pmid:10675794
  42. 42. Sanchez A, Vazquez C, Marker C, LeMoult J, Joormann J. Attentional disengagement predicts stress recovery in depression: an eye-tracking study. Journal of Abnormal Psychology. 2013;122(2):303–13 pmid:23421524
  43. 43. Chen NTM, Basanovic J, Notebaert L, MacLeod C, Clarke PJF. Attentional bias mediates the effect of neurostimulation on emotional vulnerability. Journal of psychiatric research. 2017;93:12–9. pmid:28554079
  44. 44. Faul F, Erdfelder E, Lang A-G, Buchner A. G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods. 2007;39(2):175–91. pmid:17695343
  45. 45. Overbeek T, Schruers K, Griez E. Mini International Neuropsychiatric Interview. Maastricht: University of Maastricht; 1999.
  46. 46. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. The Journal of clinical psychiatry. 1998;59 Suppl 20:22–33;quiz 4–57.
  47. 47. Lang PJ, Bradley MM, Cuthbert BN. International affective picture system (IAPS): Technical manual and affective ratings. NIMH Center for the Study of Emotion and Attention. 1997:39–58.
  48. 48. Nitsche MA, Cohen LG, Wassermann EM, Priori A, Lang N, Antal A, et al. Transcranial direct current stimulation: State of the art 2008. Brain stimulation. 2008;1(3):206–23. pmid:20633386
  49. 49. Dedoncker J, Brunoni AR, Baeken C, Vanderhasselt MA. A Systematic Review and Meta-Analysis of the Effects of Transcranial Direct Current Stimulation (tDCS) Over the Dorsolateral Prefrontal Cortex in Healthy and Neuropsychiatric Samples: Influence of Stimulation Parameters. Brain stimulation. 2016;9(4):501–17. pmid:27160468
  50. 50. McCormack HM, de L. Horne DJ, Sheather S. Clinical applications of visual analogue scales: a critical review. Psychological Medicine. 1988;18(04):1007–19.
  51. 51. Silk JS, Stroud LR, Siegle GJ, Dahl RE, Lee KH, Nelson EE. Peer acceptance and rejection through the eyes of youth: pupillary, eyetracking and ecological data from the Chatroom Interact task. Soc Cogn Affect Neurosci. 2012;7(1):93–105. pmid:21775386
  52. 52. Armstrong RA. When to use the Bonferroni correction. Ophthalmic and Physiological Optics. 2014;34(5):502–8. pmid:24697967
  53. 53. Mondino M, Thiffault F, Fecteau S. Does non-invasive brain stimulation applied over the dorsolateral prefrontal cortex non-specifically influence mood and emotional processing in healthy individuals? Frontiers in Cellular Neuroscience. 2015;9:399. pmid:26528131
  54. 54. Granholm E, Steinhauer SR. Pupillometric measures of cognitive and emotional processes. International journal of psychophysiology: official journal of the International Organization of Psychophysiology. 2004;52(1):1–6.
  55. 55. Siegle GJ, Steinhauer SR, Friedman ES, Thompson WS, Thase ME. Remission Prognosis for Cognitive Therapy for Recurrent Depression Using the Pupil: Utility and Neural Correlates. Biological psychiatry. 2011;69(8):726–33. pmid:21447417
  56. 56. Urry HL, van Reekum CM, Johnstone T, Davidson RJ. Individual differences in some (but not all) medial prefrontal regions reflect cognitive demand while regulating unpleasant emotion. Neuroimage. 2009;47(3):852–63. pmid:19486944
  57. 57. Baeken C, Brunelin J, Duprat R, Vanderhasselt MA. The application of tDCS in psychiatric disorders: a brain imaging view. Socioaffective neuroscience & psychology. 2016;6:29588.
  58. 58. De Raedt R, Leyman L, Baeken C, Van Schuerbeek P, Luypaert R, Vanderhasselt M-A, et al. Neurocognitive effects of HF-rTMS over the dorsolateral prefrontal cortex on the attentional processing of emotional information in healthy women: an event-related fMRI study. Biological psychology. 2010;85(3):487–95. pmid:20923694
  59. 59. Vanderhasselt M-A, Baeken C, Hendricks M, De Raedt R. The effects of high frequency rTMS on negative attentional bias are influenced by baseline state anxiety. Neuropsychologia. 2011;49(7):1824–30. pmid:21414332
  60. 60. Wolkenstein L, Zeiller M, Kanske P, Plewnia C. Induction of a depression-like negativity bias by cathodal transcranial direct current stimulation. Cortex. 2014;59:103–12. pmid:25173954
  61. 61. Sanchez A, Romero N, De Raedt R. Depression-related difficulties disengaging from negative faces are associated with sustained attention to negative feedback during social evaluation and predict stress recovery. PLOS ONE. 2017;12(3):e0175040. pmid:28362826
  62. 62. Koster EHW, De Lissnyder E, Derakshan N, De Raedt R. Understanding depressive rumination from a cognitive science perspective: The impaired disengagement hypothesis. Clinical Psychology Review. 2011;31(1):138–45. pmid:20817334
  63. 63. Fales CL, Barch DM, Rundle MM, Mintun MA, Snyder AZ, Cohen JD, et al. Altered emotional interference processing in affective and cognitive-control brain circuitry in major depression. Biological psychiatry. 2008;63(4):377–84. pmid:17719567
  64. 64. Joormann J, Gotlib IH. Emotion Regulation in Depression: Relation to Cognitive Inhibition. Cognition & emotion. 2010;24(2):281–98.
  65. 65. Baumeister RF, Leary MR. The need to belong: desire for interpersonal attachments as a fundamental human motivation. Psychol Bull. 1995;117(3):497–529. pmid:7777651
  66. 66. Dickerson SS, Kemeny ME. Acute stressors and cortisol responses: a theoretical integration and synthesis of laboratory research. Psychol Bull. 2004;130(3):355 pmid:15122924
  67. 67. DeWall CN, Twenge JM, Koole SL, Baumeister RF, Marquez A, Reid MW. Automatic emotion regulation after social exclusion: tuning to positivity. Emotion. 2011;11(3):623–36 pmid:21668113
  68. 68. Jacobs SC, Friedman R, Parker JD, Tofler GH, Jimenez AH, Muller JE, et al. Use of skin conductance changes during mental stress testing as an index of autonomic arousal in cardiovascular research. American Heart Journal. 1994;128(6):1170–7.
  69. 69. Sims CR, Neth H, Jacobs RA, Gray WD. Melioration as Rational Choice: Sequential Decision Making in Uncertain Environments. Psychol Rev. 2013;120(1):139–54 pmid:23230889
  70. 70. Appelhans BM, Luecken LJ. Heart rate variability as an index of regulated emotional responding. Rev Gen Psychol. 2006;10(3):229–40.
  71. 71. Keeser D, Meindl T, Bor J, Palm U, Pogarell O, Mulert C, et al. Prefrontal transcranial direct current stimulation changes connectivity of resting-state networks during fMRI. Journal of Neuroscience. 2011;31(43):15284–93. pmid:22031874
  72. 72. Stagg CJ, Best JG, Stephenson MC, O’Shea J, Wylezinska M, Kincses ZT, et al. Polarity-sensitive modulation of cortical neurotransmitters by transcranial stimulation. Journal of Neuroscience. 2009;29(16):5202–6. pmid:19386916
  73. 73. Stagg CJ, Lin RL, Mezue M, Segerdahl A, Kong Y, Xie J, et al. Widespread modulation of cerebral perfusion induced during and after transcranial direct current stimulation applied to the left dorsolateral prefrontal cortex. Journal of Neuroscience. 2013;33(28):11425–31. pmid:23843514
  74. 74. Riva P, Gabbiadini A, Romero Lauro LJ, Andrighetto L, Volpato C, Bushman BJ. Neuromodulation can reduce aggressive behavior elicited by violent video games. Cognitive, Affective, & Behavioral Neuroscience. 2017;17(2):452–9.
  75. 75. Riva P, Romero Lauro LJ, Vergallito A, DeWall CN, Bushman BJ. Electrified emotions: Modulatory effects of transcranial direct stimulation on negative emotional reactions to social exclusion. Social Neuroscience. 2015;10(1):46–54. pmid:25139575
  76. 76. Riva P, Romero Lauro LJ, DeWall CN, Bushman BJ. Buffer the Pain Away:Stimulating the Right Ventrolateral Prefrontal Cortex Reduces Pain Following Social Exclusion. Psychol Sci. 2012;23(12):1473–5. pmid:23132013
  77. 77. Vergallito A, Riva P, Pisoni A, Romero Lauro LJ. Modulation of negative emotions through anodal tDCS over the right ventrolateral prefrontal cortex. Neuropsychologia. 2018;119:128–35. pmid:30089234