Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The role of trust in the social heuristics hypothesis

  • Andres Montealegre ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    am2849@cornell.edu

    Affiliation Department of Psychology, Cornell University, Ithaca, NY, United States of America

  • William Jimenez-Leal

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Department of Psychology, Universidad de los Andes, Bogotá, Colombia

Correction

27 Jan 2021: Montealegre A, Jimenez-Leal W (2021) Correction: The role of trust in the social heuristics hypothesis. PLOS ONE 16(1): e0241069. https://doi.org/10.1371/journal.pone.0241069 View correction

Abstract

According to the social heuristics hypothesis, people intuitively cooperate or defect depending on which behavior is beneficial in their interactions. If cooperation is beneficial, people intuitively cooperate, but if defection is beneficial, they intuitively defect. However, deliberation promotes defection. Here, we tested two novel predictions regarding the role of trust in the social heuristics hypothesis. First, whether trust promotes intuitive cooperation. Second, whether preferring to think intuitively or deliberatively moderates the effect of trust on cooperation. In addition, we examined whether deciding intuitively promotes cooperation, compared to deciding deliberatively. To evaluate these predictions, we conducted a lab study in Colombia and an online study in the United Kingdom (N = 1,066; one study was pre-registered). Unexpectedly, higher trust failed to promote intuitive cooperation, though higher trust promoted cooperation. In addition, preferring to think intuitively or deliberatively failed to moderate the effect of trust on cooperation, although preferring to think intuitively increased cooperation. Moreover, deciding intuitively failed to promote cooperation, and equivalence testing confirmed that this null result was explained by the absence of an effect, rather than a lack of statistical power (equivalence bounds: d = -0.26 and 0.26). An intuitive cooperation effect emerged when non-compliant participants were excluded, but this effect could be due to selection biases. Taken together, most results failed to support the social heuristics hypothesis. We conclude by discussing implications, future directions, and limitations. The materials, data, and code are available on the Open Science Framework (https://osf.io/939jv/).

Introduction

Cooperation refers to actions that require an agent to pay a personal cost to benefit another individual or group [1]. Given that cooperating is costly for people and the benefits are distributed between group members, cooperation is puzzling. To understand cooperation, several researchers adopted a dual-process perspective in which decisions to cooperate or defect result from an interaction between intuitive and deliberative processes [2]. On one hand, we may cooperate intuitively but defect after reflection; on the other hand, we may defect intuitively but cooperate after reflection. In support of intuitive cooperation [3], faster decisions are more cooperative [2]. Moreover, promoting intuitive decisions through time constraints (i.e., deciding quickly) [2, 47], induction procedures (i.e., encouraging reliance on intuition) [2, 8], and cognitive load (i.e., engaging in an effortful task while deciding) increases cooperation [9]. Yet, some replication studies have failed to find evidence of intuitive cooperation [10].

To explain these inconsistent results, the social heuristics hypothesis (SHH) proposes that people intuitively cooperate or defect depending on which behavior is beneficial in their interactions [4, 7, 11]. If cooperation is beneficial, people intuitively cooperate, but if defection is beneficial, they intuitively defect. Though intuition is influenced by previous experience, deliberation promotes behaviors that maximize payoffs (here, defection). The SHH also argues that experience with experiments changes people’s intuition towards defection. Therefore, according to the SHH, intuition promotes cooperation, but non-cooperative interactions or experience with experiments reduce this effect. Supporting these predictions, an analysis of 15 studies showed that time pressure increases cooperation, whereas experience with experiments reduces this tendency [4]. A study also found that non-cooperative interactions reduces intuitive cooperation [2]. More generally, a meta-analysis of 67 studies found that promoting intuition, rather than deliberation, increases cooperation in settings in which noncooperation always maximizes payoffs [11]. However, high-powered replications have failed to replicate intuitive cooperation effects. In particular, a registered replication report found no effect of deciding quickly (versus slowly), even when excluding participants who had experience with experiments [12], and another replication attempt found no effect of encouraging intuitive decisions (compared to encouraging deliberative decisions) [13]. Though there are methodological concerns with many of these studies [12, 14, 15], two recent attempts (one pre-registered) that addressed most of these concerns found evidence of intuitive cooperation [16, 17]. Given the mixed evidence, the validity of the SHH remains contested.

Here, we evaluate the predictive power of the SHH by testing its predictions regarding trust and intuitive cooperation. Trust refers to a “a psychological state comprising the intention to accept vulnerability based upon the positive expectations of the intentions or behavior of another (p. 395)” [18]. According to the SHH, cooperative interactions promote trust towards interaction partners, whereas non-cooperative interactions promote distrust towards them [19]. In turn, deciding intuitively promotes cooperation among trusting people, whereas it has less of an effect (or no effect) among distrusting people [7, 20]. As predicted by the SHH, promoting intuition increases cooperation among trusting and naïve participants [7], but not among untrusting and naïve participants [20]. Nonetheless, the evidence is correlational and consistent with multiple possibilities. One possibility is that trust in everyday interactions influences intuitive cooperation (the one favored by the SHH). However, another possibility is that people report that they are trusting after observing themselves cooperating intuitively [21]. Therefore, whether trust has a causal impact on intuitive cooperation remains unclear.

The SHH also suggests that the effect of trust on cooperation depends on people’s reliance on intuition and deliberation (that is, an individual differences approach to the influence of cognitive processes). The SHH predicts that the effect of trust on cooperation is greater among people that tend to rely on intuition or that do not tend to rely on deliberation [19]. As expected by the SHH, exposing people to environments that support or undermine cooperation influences their prosocial behavior in the expected direction (increases or decreases it, respectively), and the effect is more pronounced among those that tend to rely on heuristics [19]. Yet, the evidence is limited, given that the measure of reliance on heuristics (i.e., Cognitive Reflection Test) is a good measure of reflection but not of intuition [22]. Thus, whether trust has a greater impact on cooperation among people that tend to follow their intuitions, tend to avoid deliberating, or both, remains untested.

Present studies

We tested two predictions regarding the role of trust in intuitive cooperation. First, we evaluated the causal effect of trust on intuitive cooperation. Based on the SHH, we expected that promoting high trust, compared to low trust, would increase cooperation to a greater degree when participants decide intuitively rather than deliberatively (hypothesis 1). Second, we tested whether the impact of trust on cooperation is moderated by information processing preferences. We anticipated trust to have a greater effect on cooperation among people that like an intuitive processing style, dislike a deliberative processing style, or both (hypothesis 2). We also examined the main prediction of the SHH: We expected promoting intuition to increase cooperation, relative to promoting deliberation (hypothesis 3).

To evaluate these hypotheses, we ran two studies. Study 1 was conducted in the lab in Colombia, and Study 2 was conducted online in the United Kingdom. In both studies, we manipulated trust (high vs. low) and cognitive processes (intuition vs. deliberation). To manipulate trust, participants recalled an experience in which trusting other people led to either positive or negative outcomes in order to induce high or low trust, respectively. To manipulate cognitive processes, participants decided under time pressure or time delay (Study 1), or were encouraged to decide intuitively or deliberatively (Study 2). Preferences for processing information intuitively or deliberatively were measured using the Rational-Experiential Inventory in Study 1 [23].

Contrary to expectations, the results did not support our predictions. Inducing trust failed to increase intuitive cooperation (hypothesis 1), though trust increased cooperation. Also, preferring to process information intuitively or deliberatively failed to moderate the effect of trust on cooperation (hypothesis 2), although preferring to process information intuitively increased cooperation. Moreover, promoting intuition failed to increase cooperation (hypothesis 3), and equivalence testing confirmed that this null result was due to the absence of an effect, rather than a lack of statistical power. An intuitive cooperation effect appeared when non-compliant participants were excluded, but this result could be due to selection biases [12]. Our findings are limited in various respects: The trust induction was not that robust or strong, and there were issues of non-compliance, non-comprehension, and experience with previous studies. Nonetheless, excluding non-comprehending and experienced participants did not change the results considerably. In all studies, we report how we determined our sample sizes, all data exclusions, all manipulations, and all measures [24]. We conducted another study comparing the predictive power of self-report and behavioral measures of trust on intuitive cooperation that is not included in the paper given that it is underpowered (see S1 Appendix for design and results). All materials, data, and code are available on the Open Science Framework (https://osf.io/939jv/).

Study 1

In Study 1, we tested the causal effect of trust on intuitive cooperation. Participants were exposed to a trust induction (high vs. low) before a one-shot public goods game under time pressure or time delay to promote intuition or deliberation, respectively. We also measured participants’ preferences to process information intuitively or deliberatively. We expected that inducing high trust, relative to low trust, would have a greater effect on cooperation under time pressure than under time delay (hypothesis 1). We anticipated a greater impact of trust on cooperation among people who like an intuitive processing style, dislike a deliberative processing style, or both (hypothesis 2). Finally, we expected that time pressure would increase cooperation, compared to time delay (hypothesis 3).

Methods

287 participants (164 men, 121 women, and 2 other, Mage = 21.89, SD = 3.21) participated in the study in exchange for $6,000 Colombian Pesos. They could gain $4,000 to $20,000 Colombian Pesos more if they were selected in a lottery. We aimed for 300 participants (75 per condition), and ended up with 303 participants. We excluded participants that did not reach the end of the survey or that did not select a contribution in the game. We also excluded the second observation of someone who participated twice and an observation recorded after the study concluded. Studies were approved by the ethics committee of the Psychology Department at Universidad de los Andes. All participants provided their consent in Qualtrics. We conducted the study at a university in Colombia, and not online, to target a population with little experience with similar studies. MTurk participants have become too experienced with similar experiments, and the intuitive cooperation effect has declined such that, if any effect remains, it is difficult to detect [4]. The study was conducted in Spanish.

Participants were exposed to a trust induction and played a one-shot public goods game under time constraints. The study had a 2 (trust induction: high vs. low) × 2 (time constraint manipulation: time pressure vs. time delay) between-subjects design. In the trust induction, adapted from a manipulation of cognitive processes [2, 25], participants wrote a paragraph describing a moment in their lives in which trusting other people led to positive or negative consequences in order to induce high or low trust, respectively. To reduce potential demand effects, we presented it as an exercise to check that participants were concentrated on the task [26]. To check if the induction worked, we asked participants to report their experienced trust in the game, and we introduced questions about emotions to conceal the purpose of the question. Responses were measured on a scale ranging from 0 nothing to 9 very much (coded from 1 to 10). To promote intuition or deliberation, participants decided under time pressure or time delay, respectively [2]. Time pressure participants were asked to answer as fast as possible, in less than 10 seconds (a timer counting from 10 to 0 was presented on the decision screen), whereas time delay participants were asked to carefully consider their decision and wait a minimum of 10 seconds (a timer counting from 0 until participants responded was presented on the decision screen). Decision times were recorded to check if participants complied with the instructions.

To measure cooperation, participants played a four-player one-shot anonymous public goods game. They choose how much to contribute to the common pool from their endowment ($0-$8,000 Colombian Pesos, using a slider that started in the middle). Their contributions were multiplied by two and divided equally among players (i.e., the game had a marginal return of 0.5). We used a one-shot game given that there is no incentive to cooperate under these conditions (i.e., the payoff-maximizing behavior is defection) and, thus, the SHH predicts that deliberation promotes defection [4]. The game involved real monetary incentives, a random payment scheme (one out of every four players in a session was paid the amount won), and no deception. The sessions were conducted in groups of 8 or 12 participants to guarantee that they could not identify others in their group. Decisions were made on a computer in an individual cubicle. After the game, we measured comprehension of the task using two 9-option multiple choice questions. To measure preferences for information processing, we administered the 10-item Rational-Experiential Inventory [23], composed of two scales: Need for Cognition (5-items) and Faith in Intuition (5-items). The Need for Cognition scale measures a tendency to process information through effortful thinking (that is, a preference for deliberative processing), whereas the Faith in Intuition scale measures a tendency to process information by following one’s intuition (that is, a preference for intuitive processing). Responses were measured on a scale from 1 completely false to 5 completely true. We also measured experience with similar studies, age, and gender, among other questions (see S1 Fig for summary of all tasks). At least one-week before the study, participants answered a survey including trust questions along with other filler items. Our protocol and materials were based on the time constraint registered replication report [12].

Results

For all analyses, we adopted a 5% alpha level and, unless otherwise stated, we ran ordinary least squares regressions. We use the term significant to mean statistically significant, not practically important [27]. Regression tables can be found in S1 Table [28]. We also calculated 95% confidence intervals to examine the set of plausible values for estimates [29].

Before testing the hypotheses, we checked the impact of the manipulations, and examined comprehension of the task, preexisting trust, and experience with similar studies. As expected, participants in the high trust condition felt significantly more trust (M = 6.19, SD = 2.54, n = 145) than those in the low trust condition (M = 5.37, SD = 2.55, n = 142), Welch’s t-test: t(284.8) = -2.71, p = .007, Mdiff = -0.81, 95% CI [-1.4, -0.22], suggesting that the induction had the expected effect, though the means of the high and low trust conditions were not particularly high or low, respectively. Also as predicted, participants responded faster under time pressure (M = 15.47, SD = 8.37, Mdn = 12.95, n = 145) than under time delay (M = 33.99, SD = 31.08, Mdn = 26.16, n = 142). Given that decision times were right-skewed, we applied a log10 transformation (see Fig A in S2 Fig) and found significant differences between log10 decision times under time pressure and time delay, Welch’s t-test: t(246.31) = 9.23, p < .001. Nonetheless, the median decision time under time pressure was higher than 10 seconds, and only 26% of participants complied under time pressure, compared to 90% under time delay. Additionally, only 56% of participants passed both comprehension checks. In light of the high non-compliance and non-comprehension, we conducted exploratory analyses excluding these participants. However, these analyses may bias estimates of causal effects given that they condition on posttreatment variables [30]. We examined levels of trust before the study and found relatively high levels, M = 7.09, SD = 1.84, n = 246. Most participants (79%) had no experience with similar studies.

Hypothesis 1.

We expected that promoting high trust, compared to low trust, would have a greater effect on cooperation under time pressure than under time delay (see Table 1 for descriptive statistics and Fig 1 for regression plots). We first entered main effects: high trust (1 = high trust, 0 = low trust) and time pressure (1 = time pressure, 0 = time delay), and then added the interaction along with simple effects. Contrary to our hypothesis, we found no significant interaction between high trust and time pressure (p = .96), even when excluding non-compliant (p = .64) or non-comprehending participants (p = .09). The confidence interval of the sample excluding non-comprehending participants indicated that the majority of plausible values for the interaction were negative (i.e., high trust increases cooperation under time delay, but decreases cooperation under time pressure). We found a significant main effect of high trust (full sample: p = .041), that became non-significant after exclusions (excluding non-compliant: p = .27; excluding non-comprehending: p = .997), and a null main effect of time pressure (full sample: p = .71; excluding non-comprehending: p = .95), that became significant after excluding non-compliant participants (p < .001).

thumbnail
Fig 1. Unstandardized coefficients and 95% confidence intervals of public goods game contributions predicted by high trust and time pressure (with and without interaction and exclusions).

Coefficients of regression with main effects are presented on the left and coefficients of regression with interaction and simple effects are presented on the right (simple effects are not included in the plot).

https://doi.org/10.1371/journal.pone.0216329.g001

thumbnail
Table 1. Public goods game contributions, compliance, and comprehension depending on the condition.

https://doi.org/10.1371/journal.pone.0216329.t001

Hypothesis 2.

We anticipated trust to have a greater effect on cooperation among participants who like an intuitive processing style, dislike a deliberative processing style, or both. The scales had questionable internal consistency: Faith in Intuition (α = 0.62) and Need for Cognition (α = 0.67). We first entered main effects (high trust, time pressure, and Faith in Intuition or Need for Cognition) and then added interactions along with simple effects. Against our hypothesis regarding intuitive processing (see Fig B in S2 Fig), we found no significant interaction between high trust and Faith in Intuition (full sample: p = .31; excluding non-compliant: p = .49; excluding non-comprehending: p = .34). We found a significant main effect of Faith in Intuition (full sample: p = .012), that was not significant after exclusions (excluding non-compliant: p = .057; excluding non-comprehending: p = .069), though the confidence intervals indicated that the majority of plausible values for the effect were positive. We also found a non-significant main effect of high trust (full sample: p = .055; excluding non-compliant: p = .29; excluding non-comprehending: p = .94). Still, the confidence interval of the full sample indicated that the majority of likely values for the effect were positive. Contrary to our hypothesis concerning deliberative processing (see Fig C in S2 Fig), we found no significant interaction between high trust and Need for Cognition (full sample: p = .49; excluding non-compliant: p = .77; excluding non-comprehending: p = .28). We found a significant main effect of high trust (full sample: p = .035), that became non-significant after exclusions (excluding non-compliant: p = .27; excluding non-comprehending: p = .99). We also found no significant main effect of Need for Cognition (full sample: p = .17; excluding non-compliant: p = .72; excluding non-comprehending: p = .49), though the confidence interval of the full sample indicated that the majority of plausible values for the effect were positive. If responses to the scales were affected by the manipulations, then there could be post-treatment bias but, unfortunately, this problem cannot be diagnosed empirically [30].

Hypothesis 3.

We expected that time pressure would increase cooperation, compared to time delay. Unexpectedly, we found no significant effect of time pressure (full sample: p = .65), even when excluding non-comprehending participants (p = .95; see Fig 2 for regression plot). Given that null results can be due to the absence of an effect or lack of statistical power, we tested for the absence of an effect using equivalence tests (in the full sample) [3133]. We ran two one-sided tests to check for equivalence. We determined the smallest effect size of interest using the “small telescopes” approach (i.e., setting the smallest effect size of interest to the effect that a study had 33% power to detect) [31, 34]. We chose the intuitive cooperation effect in Rand and collaborators’ Study 7 from their 2012 paper given the theoretical similitude of the result, d = 0.40, 95% CI [0.06, 0.73], n = 153 (non-compliant participants were excluded) [2]. The study had 33% power to detect an effect of d = 0.26, and we therefore used this effect to determine the equivalence bounds. We used the two one-sided tests procedure to test the null hypothesis that the effect falls outside the equivalence bounds, i.e., smaller than the lower equivalence bound (ΔL = -0.26) or larger than the upper equivalence bound (ΔU = 0.26). If both tests were significant we concluded equivalence, implying that effects as extreme or more extreme than these values can be rejected. Results showed that the equivalence test based on Welch’s t-test was significant, t(283.73) = 1.74, p = .042, and therefore we reject the null hypothesis that the effect is smaller than -0.26 or larger than 0.26 (see Fig D in S2 Fig). Thus, if any intuitive cooperation effect is present, it is too small to be of interest. An intuitive cooperation effect only emerged if non-compliant participants were excluded (p < .001; see Fig 2 for regression plot).

thumbnail
Fig 2. Unstandardized coefficients and 95% confidence intervals of public goods game contributions predicted by time pressure (with and without exclusions).

https://doi.org/10.1371/journal.pone.0216329.g002

Study 2

In Study 2, we examined the influence of inducing trust on intuitive cooperation using a different cognitive process manipulation. Participants were exposed to a trust induction (high vs. low) before a one-shot public goods game in which they were instructed to decide intuitively or deliberatively. We expected that promoting high trust, compared to low trust, would increase cooperation to a greater degree when participants decided intuitively rather than deliberatively (hypothesis 1). We also anticipated greater cooperation when promoting intuition, compared to promoting deliberation (hypothesis 3). The study was pre-registered on AsPredicted (https://aspredicted.org/s6jh2.pdf).

Methods

779 participants (229 men, 545 women, and 5 other, Mage = 37.21, SD = 11.65) participated in exchange for 30 pence and gained an additional 25 pence in the game. We applied the same exclusion criteria as Study 1. We conducted the study online to recruit a large sample and used Prolific (rather than MTurk) to target a population with little experience with similar studies, restricting participation to the United Kingdom.

Participants were exposed to a trust induction, played a one-shot public goods game, and were instructed to decide intuitively or deliberatively. The study had a 2 (trust induction: high vs. low) × 2 (cognitive process manipulation: intuition vs. deliberation) between-subjects design. The design was similar to Study 1. The main difference was that cognitive processes were manipulated through induction procedures rather than time constraints. In the cognitive process manipulation (presented on the decision screen), participants were instructed to rely on intuition or deliberation when making their decision in the public goods game. The manipulation was adapted from another induction that instructed participants to rely on emotion or reason [35]. Though the term “emotion” may be more familiar than “intuition” [35], relying on emotion could mean different things depending on the emotion that comes to mind, whereas relying on intuition more clearly indicates following one’s instinct. Our modified version was the following (changes to the intuition condition are presented in brackets):

Sometimes, people make decisions deliberatively, based on careful calculation. Other times, people make decisions intuitively, based on gut reactions.

[Sometimes, people make decisions intuitively, based on gut reactions.Other times, people make decisions deliberatively, based on careful calculation.]

Many people believe that deliberation [intuition] leads to good decision-making. When we use careful calculation [gut reactions], rather than gut reactions [careful calculation], we make satisfying decisions. Please make your transfer decision by relying on deliberation, rather than intuition [relying on intuition, rather than deliberation].

There were other differences from Study 1. First, we pre-registered the study to distinguish between confirmatory and exploratory analyses. Second, we increased the sample size to raise statistical power. To determine the sample size, we conducted an a priori power analysis in G*Power 3.1 to detect an interaction with a partial eta squared effect size of .02, with 95% power, given a 5% alpha level, and results showed that we needed 639 participants (and we aimed for 800 to increase power further) [36]. Third, we told participants that they were paired with other players (when in fact there was no pairing) to simplify the protocol. Participants were debriefed and paid the maximum amount they could have won in the game (25 pence). Fourth, we reduced the endowment in the game to 10 pence. Though stakes were much lower, online economic experiments using low stakes have found similar results to lab studies [37]. Fifth, the study was done in English rather than in Spanish. Finally, responses to the trust manipulation check were measured on a scale from 1 not at all to 7 a great deal, rather than from 0 nothing to 9 very much.

Participants completed additional measures. Understanding of the game was evaluated using two 6-option multiple choice questions. To check the influence of the cognitive process manipulation, we asked: “How did you make your decision?” from 1 using only intuition to 7 using only deliberation (reverse-scored); “To what extent did you rely on your gut reactions when making your decision?” from 1 not at all to 7 a great deal, and “To what extent did you rely on careful calculation when making your decision?” from 1 not at all to 7 a great deal (reverse-scored). We administered the trust manipulation check (and included questions of emotions), and measured experience with similar studies and demographics (age and gender), among other measures (see S1 Fig for summary of all tasks). We debriefed participants at the end of the study.

Results

Prior to evaluating the hypotheses, we checked the impact of the manipulations, and examined understanding of the task and experience with similar studies. Though participants reported more trust in the high trust condition (M = 4.04, SD = 1.82, n = 391) than in the low trust condition (M = 3.83, SD = 1.83, n = 388), the difference was not significant, Welch’s t-test: t(776.91) = -1.59, p = .11, Mdiff = -0.21, 95% CI [-0.47, 0.05]. However, the confidence interval indicated that the majority of plausible values for the effect were negative (i.e., high trust has a higher value than low trust). As predicted, participants reported making decisions significantly more intuitively (α = 0.75) in the intuition condition (M = 5.07, SD = 1.38, n = 382) than in the deliberation condition (M = 3.81, SD = 1.56, n = 397), Welch’s t-test: t(770.97) = -11.94, p < .001, Mdiff = -1.26, 95% CI [-1.47, -1.05], indicating that the manipulation check succeeded. To rule out demand effects (i.e., participants responding based on perceived expectations without a truthful account of their behavior) we examined decision times (see Fig E in S2 Fig), and found significantly faster responses in the intuition condition (M = 17.39, SD = 11.25, Mdn = 15.35, n = 382) than in the deliberation condition (M = 21.27, SD = 14.52, Mdn = 18.91, n = 397), log10 decision times, Welch’s t-test: t(773.63) = 3.34, p < .001. Still, only 49% of participants answered both comprehension questions correctly and only 46% of participants had no experience with similar studies. Given the rates of experience and non-comprehension, we ran analyses excluding these participants, though these analyses may bias treatment estimates [30].

Pre-registered analyses

Hypothesis 1.

We expected that promoting high trust, compared to low trust, would have a greater effect on cooperation when participants decided intuitively rather than deliberatively (see Table 2 for descriptive statistics and Fig 3 for regression plots). We first included main effects: high trust (1 = high trust, 0 = low trust) and intuition (1 = intuition, 0 = deliberation), and then added the interaction along with simple effects. Contrary to our hypothesis, we found no significant interaction between high trust and intuition (full sample: p = .53), even after exclusions (excluding experienced: p = .24; excluding non-comprehending: p = .67). We found a significant main effect of high trust (full sample: p = .004; excluding experienced: p = .033; excluding non-comprehending: p = .004), suggesting that the induction could have had the intended purpose, in the absence of awareness of changes in trust. We found no significant main effect of intuition (full sample: p = .44; excluding experienced: p = .17; excluding non-comprehending: p = .91). We deviated from the pre-registration given that we did not run regressions with controls (to maintain consistency with Study 1) or compared trust and emotions (we decided that this analysis was no longer meaningful). We also did not pre-register all the exclusion criteria but followed the criteria used in Study 1.

thumbnail
Fig 3. Unstandardized coefficients and 95% confidence intervals of public goods game contributions predicted by high trust and intuition (with and without interaction and exclusions).

Coefficients of regression with main effects are presented on the left and coefficients of regression with interaction and simple effects are presented on the right (simple effects are not included in the plot).

https://doi.org/10.1371/journal.pone.0216329.g003

thumbnail
Table 2. Public goods game contributions, compliance, and comprehension depending on the condition.

https://doi.org/10.1371/journal.pone.0216329.t002

Exploratory analyses

Hypothesis 3.

We anticipated deciding intuitively to increase cooperation, compared to deciding deliberatively. Contrary to expectations, we found no significant effect of intuition (p = .44), even excluding experienced (p = .149) or non-comprehending participants (p = .97; see Fig 4 for regression plot), though the confidence interval of the sample excluding experienced participants indicated that the majority of plausible values for the effect were positive. We conducted equivalence tests (in the full sample) to check if the observed effect falls outside the equivalence bounds of -0.26 and 0.26 (Cohen’s d). We used the same smallest effect size of interest selected in Study 1 (see Study 1 for details on equivalence tests and justification of the smallest effect size of interest). Results showed that the equivalence test based on Welch’s t-test was significant, t(776.26) = -2.86, p = .002. Therefore, we reject the null hypothesis that the effect is smaller than -0.26 or larger than 0.26 (see Fig F in S2 Fig). Thus, if there is an effect, it is too small to be of interest.

thumbnail
Fig 4. Unstandardized coefficients and 95% confidence intervals of public goods game contributions predicted by intuition (with and without exclusions).

https://doi.org/10.1371/journal.pone.0216329.g004

Discussion

In this paper, we examined the relation between trust and intuitive cooperation. Contrary to expectations, higher trust failed to promote intuitive cooperation, challenging correlations between trust and intuitive cooperation [7]. Higher trust increased cooperation regardless of the cognitive process. Also unexpectedly, preferring to process information intuitively or deliberatively failed to moderate the impact of trust on cooperation, contrary to research that found that reflective thinking moderates the effect of interactions on cooperation [19]. However, consistent with the SHH, people who prefer to process information intuitively cooperated more. Finally, intuition failed to increase cooperation compared to deliberation, and equivalence testing confirmed that this null result was due to the lack of an effect, rather than low statistical power. Though the author of an SHH meta-analysis argued that “future work may do well to focus on cognitive-processing manipulations other than time constraints (p. 13)” [11], we found no intuitive cooperation effect using an induction manipulation. Excluding non-comprehending or experienced participants did not alter the results considerably. An intuitive cooperation effect emerged if participants that did not comply with time constraints were excluded, but this result could be due to selection biases (e.g., artificially excluding less cooperative, slow responders from the time pressure condition) [12, 30]. Going beyond p-values and examining confidence intervals revealed considerable uncertainty regarding some conclusions [38]. Overall, most results failed to support the SHH (see Table 3 for unstandardized coefficients and p values).

thumbnail
Table 3. Unstandardized coefficients and p values for each hypothesis in each study.

https://doi.org/10.1371/journal.pone.0216329.t003

Given only limited support for the SHH, future work could clarify basic questions about the nature of intuition. An assumption in the SHH literature is that cognitive process manipulations, such as time constraints and induction procedures, influence intuition. However, as pointed out by critics of dual-process models, features of “intuition”, such as responding quickly or following instincts, may not be aligned, rendering it necessary to test this assumption [39]. In addition, more attention could be devoted to ruling out factors confounded with intuition. For example, promoting faster responses (i.e., time pressure) increases errors, perhaps by lowering the capacity to understand decisions or pay attention [14]. Moreover, the effect of deciding intuitively may depend on features of the game, such as familiarity with the task [16], discriminability of the choice options [40], and complexity of the strategies [41]. For instance, if the task is simple, deliberation may focus on introspection of motives, whereas if the task is complex, deliberation may focus on comparison of the choices. Future studies could examine how features of the game change the role of intuition and deliberation.

Our conclusions are qualified by several limitations. First, the trust induction had multiple weaknesses. The trust induction had a positive impact on cooperation in each study, but the manipulation check failed in Study 2. Though the trust induction could have had the intended effect without participants’ awareness of changes in trust, the result could also be explained by factors other than trust. Also, even when the trust manipulation was effective, the values were not particularly high or low in absolute terms. Future research could incorporate secondary manipulation checks (to provide convergent evidence), use stronger trust inductions (to push the means of the conditions apart), and include a control condition (to examine whether the effect, if found, is driven by high trust or low trust). Second, there was a low rate of compliance under time pressure (26%), which is close to the 34% found in the time constraint registered replication report [12]. Excluding non-compliant participants is not a viable solution given that it biases treatment estimates [12, 30]. Future studies could use procedures that reduce non-compliance, such as providing comprehension training [17], raising the time limit [17], familiarizing participants with the task [16], or incentivizing compliance [16]. Third, high rates of non-comprehension of the game may increase measurement error. Future studies could address this issue by conducting comprehension training [17], or assigning time limits to comprehension questions to correct for asymmetries in understanding [16]. Fourth, half of the Study 2 sample had experience with similar studies. Fifth, though we conducted analyses excluding participants based on posttreatment variables (compliance, comprehension, and experience), these results should be interpreted with caution given that treatment estimates may be biased [30]. Finally, though we tried to adequately justify our smallest effect size of interest, it was specified after results were known, and the interpretation of the equivalence tests hinges on our choice [31].

In sum, across two studies, we found that inducing trust failed to increase intuitive cooperation, processing information intuitively versus deliberatively failed to moderate the effect of trust, and there was little evidence that intuition promoted cooperation. Given the limited support for the SHH observed here, we suggest that future research should devote more attention to basic questions regarding the nature of intuition.

Acknowledgments

We would like to thank Juan Camilo Cardenas and Lance Bush for invaluable support, and David Rand, Kristian Myrseth, David Moss, Gordon Ingram, James LeBreton, Peder Isager, Andres Moya, Samir Cure, Ozan Isler, Stephanie Tepper, Rachel King, and Randy Lee for providing helpful comments and advice. We would also like to thank the editor and two anonymous reviewers for their thoughtful comments and suggestions. We would like to thank Javier Corredor and his lab for assisting with data collection and David Rand, Anthony Evans, and Juan Camilo Cardenas for sharing materials.

References

  1. 1. Jordan JJ, Peysakhovich A, Rand DG. Why we cooperate. In: Decety J, Wheatley T, editors. The Moral Brain: A Multidisciplinary Perspective: MIT Press; 2015.
  2. 2. Rand DG, Greene JD, Nowak MA. Spontaneous giving and calculated greed. Nature. 2012;489(7416):427–30. http://www.nature.com/nature/journal/v489/n7416/abs/nature11467.html-supplementary-information pmid:22996558
  3. 3. Zaki J, Mitchell JP. Intuitive Prosociality. Current Directions in Psychological Science. 2013;22(6):466–70.
  4. 4. Rand DG, Peysakhovich A, Kraft-Todd GT, Newman GE, Wurzbacher O, Nowak MA, et al. Social heuristics shape intuitive cooperation. Nature Communications. 2014;5:3677. http://www.nature.com/articles/ncomms4677-supplementary-information pmid:24751464
  5. 5. Cone J, Rand DG. Time Pressure Increases Cooperation in Competitively Framed Social Dilemmas. PLoS ONE. 2015;9(12):e115756. pmid:25551386
  6. 6. Rand DG, Newman GE, Wurzbacher OM. Social Context and the Dynamics of Cooperative Choice. Journal of Behavioral Decision Making. 2015;28(2):159–66.
  7. 7. Rand DG, Kraft-Todd GT. Reflection does not undermine self-interested prosociality. Frontiers in Behavioral Neuroscience. 2014;8(300). pmid:25232309
  8. 8. Lotz S. Spontaneous Giving under Structural Inequality: Intuition Promotes Cooperation in Asymmetric Social Dilemmas. PLoS ONE. 2015;10(7):e0131562. pmid:26154284
  9. 9. Døssing F, Piovesan M, Wengström E. Cognitive load and cooperation. Review of Behavioral Economics. 2017;4(1):69–81.
  10. 10. Tinghog G, Andersson D, Bonn C, Bottiger H, Josephson C, Lundgren G, et al. Intuition and cooperation reconsidered. Nature. 2013;498(7452):E1–E2. pmid:23739429
  11. 11. Rand DG. Cooperation, Fast and Slow:Meta-Analytic Evidence for a Theory of Social Heuristics and Self-Interested Deliberation. Psychological Science. 2016;27(9):1192–206. pmid:27422875.
  12. 12. Bouwmeester S, Verkoeijen PPJL, Aczel B, Barbosa F, Bègue L, Brañas-Garza P, et al. Registered Replication Report: Rand, Greene, and Nowak (2012). Perspectives on Psychological Science. 2017;12(3):527–42. pmid:28475467.
  13. 13. Camerer CF, Dreber A, Holzmeister F, Ho T-H, Huber J, Johannesson M, et al. Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015. Nature Human Behaviour. 2018;2(9):637–44.
  14. 14. Recalde MP, Riedl A, Vesterlund L. Error-prone inference from response time: The case of intuitive generosity in public-good games. Journal of Public Economics. 2018;160:132–47. https://doi.org/10.1016/j.jpubeco.2018.02.010.
  15. 15. Myrseth KOR, Wollbrant CE. Cognitive foundations of cooperation revisited: Commentary on Rand et al. (2012, 2014). Journal of Behavioral and Experimental Economics. 2017;69:133–8. https://doi.org/10.1016/j.socec.2017.01.005.
  16. 16. Isler O, Maule J, Starmer C. Is intuition really cooperative? Improved tests support the social heuristics hypothesis. PLOS ONE. 2018;13(1):e0190560. pmid:29304055
  17. 17. Everett JAC, Ingbretsen Z, Cushman F, Cikara M. Deliberation erodes cooperative behavior—Even towards competitive out-groups, even when using a control condition, and even when eliminating selection bias. Journal of Experimental Social Psychology. 2017;73:76–81. https://doi.org/10.1016/j.jesp.2017.06.014.
  18. 18. Rousseau DM, Sitkin SB, Burt RS, Camerer C. Not So Different After All: A Cross-Discipline View Of Trust. Academy of Management Review. 1998;23(3):393–404.
  19. 19. Peysakhovich A, Rand DG. Habits of Virtue: Creating Norms of Cooperation and Defection in the Laboratory. Management Science. 2016;62(3):631–47.
  20. 20. Capraro V, Cococcioni G. Social setting, intuition and experience in laboratory experiments interact to shape cooperative decision-making. Proceedings of the Royal Society B: Biological Sciences. 2015;282(1811). pmid:26156762
  21. 21. Bem DJ. Self-Perception Theory. Advances in Experimental Social Psychology. 1972;6:1–62. https://doi.org/10.1016/S0065-2601(08)60024-6.
  22. 22. Pennycook G, Cheyne JA, Koehler DJ, Fugelsang JA. Is the cognitive reflection test a measure of both reflection and intuition? Behavior Research Methods. 2016;48(1):341–8. pmid:25740762
  23. 23. Epstein S, Pacini R, Denes-Raj V, Heier H. Individual differences in intuitive–experiential and analytical–rational thinking styles. Journal of Personality and Social Psychology. 1996;71(2):390–405. pmid:8765488
  24. 24. Simmons J, Nelson L, Simonsohn U. A 21 word solution. 2012.
  25. 25. Shenhav A, Rand DG, Greene JD. Divine intuition: Cognitive style influences belief in God. Journal of Experimental Psychology: General. 2012;141(3):423–8. pmid:21928924
  26. 26. Zizzo DJ. Experimenter demand effects in economic experiments. Experimental Economics. 2010;13(1):75–98.
  27. 27. Greenland S, Senn SJ, Rothman KJ, Carlin JB, Poole C, Goodman SN, et al. Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations. European Journal of Epidemiology. 2016;31(4):337–50. pmid:27209009
  28. 28. Hlavac M. stargazer: Well-Formatted Regression and Summary Statistics Tables. R package version 5.2.1. 2018.
  29. 29. Cumming G. The New Statistics:Why and How. Psychological Science. 2014;25(1):7–29. pmid:24220629.
  30. 30. Montgomery JM, Nyhan B, Torres M. How Conditioning on Posttreatment Variables Can Ruin Your Experiment and What to Do about It. American Journal of Political Science. 2018;62(3):760–75.
  31. 31. Lakens D, Scheel AM, Isager PM. Equivalence testing for psychological research: A tutorial. 2017.
  32. 32. Quintana DS. Revisiting non-significant effects of intranasal oxytocin using equivalence testing. Psychoneuroendocrinology. 2018;87:127–30. pmid:29065361
  33. 33. Lakens D. Equivalence Tests: A Practical Primer for t Tests, Correlations, and Meta-Analyses. Social Psychological and Personality Science. 2017;8(4):355–62. pmid:28736600.
  34. 34. Simonsohn U. Small Telescopes:Detectability and the Evaluation of Replication Results. Psychological Science. 2015;26(5):559–69. pmid:25800521.
  35. 35. Levine E, Barasch A, Rand DG, Berman J, Small DA. Signaling Emotion and Reason in Cooperation. 2017.
  36. 36. Faul F, Erdfelder E, Lang A-G, Buchner A. G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior research methods. 2007;39(2):175–91. pmid:17695343
  37. 37. Amir O, Rand DG, Gal YaK. Economic Games on the Internet: The Effect of $1 Stakes. PLOS ONE. 2012;7(2):e31461. pmid:22363651
  38. 38. Maxwell SE, Lau MY, Howard GS. Is psychology suffering from a replication crisis? What does “failure to replicate” really mean? American Psychologist. 2015;70(6):487–98. pmid:26348332
  39. 39. Melnikoff DE, Bargh JA. The Mythical Number Two. Trends in Cognitive Sciences. 2018;22(4):280–93. https://doi.org/10.1016/j.tics.2018.02.001 pmid:29571664
  40. 40. Krajbich I, Bartling B, Hare T, Fehr E. Rethinking fast and slow based on a critique of reaction-time reverse inference. Nature Communications. 2015;6:7455. pmid:26135809
  41. 41. Brañas-Garza P, Meloso D, Miller L. Strategic risk and response time across games. International Journal of Game Theory. 2017;46(2):511–23.