Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Adaptive and Bounded Investment Returns Promote Cooperation in Spatial Public Goods Games

  • Xiaojie Chen ,

    chenx@iiasa.ac.at (XC) (XC); matjaz.perc@uni-mb.si (MP) (MP)

    Affiliation Evolution and Ecology Program, International Institute for Applied Systems Analysis, Laxenburg, Austria

  • Yongkui Liu,

    Affiliations School of Automation Science and Electrical Engineering, Beihang University, Beijing, China, School of Electronic and Control Engineering, Chang'an University, Xi'an, China, Center for Road Traffic Intelligent Detection and Equipment Engineering, Chang'an University, Xi'an, China

  • Yonghui Zhou,

    Affiliation School of Mathematics and Computer Science, Guizhou Normal University, Guiyang, China

  • Long Wang,

    Affiliation State Key Laboratory for Turbulence and Complex Systems, College of Engineering, Peking University, Beijing, China

  • Matjaž Perc

    chenx@iiasa.ac.at (XC) (XC); matjaz.perc@uni-mb.si (MP) (MP)

    Affiliation Department of Physics, Faculty of Natural Sciences and Mathematics, University of Maribor, Slovenia

Abstract

The public goods game is one of the most famous models for studying the evolution of cooperation in sizable groups. The multiplication factor in this game can characterize the investment return from the public good, which may be variable depending on the interactive environment in realistic situations. Instead of using the same universal value, here we consider that the multiplication factor in each group is updated based on the differences between the local and global interactive environments in the spatial public goods game, but meanwhile limited to within a certain range. We find that the adaptive and bounded investment returns can significantly promote cooperation. In particular, full cooperation can be achieved for high feedback strength when appropriate limitation is set for the investment return. Also, we show that the fraction of cooperators in the whole population can become larger if the lower and upper limits of the multiplication factor are increased. Furthermore, in comparison to the traditionally spatial public goods game where the multiplication factor in each group is identical and fixed, we find that cooperation can be better promoted if the multiplication factor is constrained to adjust between one and the group size in our model. Our results highlight the importance of the locally adaptive and bounded investment returns for the emergence and dominance of cooperative behavior in structured populations.

Introduction

The emergence of cooperation among selfish individuals is an intensively studied problem [1], [2]. Traditionally, the problem of cooperation is investigated by means of the game theoretical models of the prisoner's dilemma for pairwise interactions, and more generally public goods game for groups of interacting individuals. In particular, the public goods game is abundant in human society, e.g., protecting the global climate and avoiding overfishing of the oceans [3][6]. In the classical public goods game (PGG), individuals engage in multiplayer interactions and decide simultaneously whether to contribute (cooperate) or not (defect) to a common pool. Then the accumulated contributions by cooperators are multiplied by a factor large than one, i.e., the so-called multiplication factor, and finally the resulting assets are shared equally among all group members irrespective of their initial decision. From the perspective of each individual, defection is clearly the rational decision to make as it yields the highest income compared to other members. Thus, selfish individuals should decline to contribute and attempt to free ride on the other players' contributions. However, if nobody decides to invest, the group fails to harvest the benefits of a collective investment, which drives the population into the tragedy of the commons [7]. Actually, the group is most successful if everybody cooperates, and hence the dilemma is caused by the selfishness of individual players.

To study the social dilemma in realistic situations, in the last decade the risk PGG [3], [4], the optional PGG [8][12], the threshold PGG [13][17], the continuous PGG [18][20], and the ecological PGG [21], [22] have been developed based on the classical PGG from the viewpoint of realistic societies. On the other hand, several mechanisms for the evolution of cooperation in the PGG, such as punishment [23][33], reward [34][38], reputation [34], [37], network reciprocity [39][55] have been justified. In particular, complex interaction networks provide a natural and reasonable framework for studying the PGG in structured populations. Within this framework, some aforementioned mechanisms, such as punishment and reward have been further studied [28], [31], [32], [36]. Also, some other factors have been incorporated, such as noise [44], social diversity [39], [41], [46], [47], and success-driven distribution [53]. It is found that social diversity associated with the number and the size of the public goods game as well as the individual contribution to each game can greatly promote the emergence of cooperation [41]. Indeed, social diversity by means of the system's other feature information, e.g., game payoffs [47], [56], teaching activity [39] and preferential selection [46] in strategy updating, have been also demonstrated to facilitate cooperation in the PGG.

It is worth mentioning that the inhomogeneities and social diversity about features of the system are widely existent in human society and animal world, which can characterize the asymmetric and different influence of individuals or interacting environments. However, they are introduced artificially in some previous studies mentioned above. Indeed the inhomogeneities or social diversity can emerge spontaneously via the coevolutionary rules, since the values of property should be not invariable, but evolve based on the state of the system. In the context of evolutionary game theory, the adaptive features are often coupled with the strategy evolution. The coevolution of strategies and features of the model, e.g., individual social ties (for example see Refs. [57][65]), noise level [66], [67], payoff matrices [68], [69], capability of strategy transfer [71], [72] and individual learning rules [73], [74], have been investigated in different evolutionary games, especially the prisoner's dilemma game (see [75] for a review). Remarkably, recently Lee et al. further proposed a multiadaptive prisoner's dilemma game where both the payoff matrices and the interaction structure are shaped by the behavior of the agents, and found that such multiadaptive mode can result in the coemergence of hierarchical structure and cooperation [70].

At present, we propose a coevolutionary rule in the PGG. We consider that each interacting group has its own multiplication factor, which evolves based on the local strategy distribution in the group and the global strategy distribution in the whole system. Different from the setting in some previous works [53], [68][70], this adaptive multiplication factor is used to measure the local interacting or cooperative environment in each group, rather than individual's feature or the whole system's interaction conditions. Correspondingly, the multiplication factor represents the feedback return of the local investment to the public good, and a larger value of the multiplication factor enables a better investment return [18]. Structured populations provide a competent framework to describe this local feature, which is updated based on the local and the global level of cooperation. In the present study, in order to focus solely on the effects of the adaptive investment returns, we employ a square lattice where the number of group members is fixed and always the same. Due to the diversity of local strategy distribution, the investing cooperators can get together in some groups, whereas in other groups they are sparse. The inhomogeneous distribution can induce different investment returns in different interacting groups, which may correspond to the phenomenon of uneven regional exploitation of the common resources in a society. For example, in some pastures the herdsmen may over-exploit the pasture resource by adding more and more animals to their herd, which may lead to the gradual desertification of the grassland. Correspondingly, the socioeconomic returns from herding in these grazing areas decrease gradually and finally the economic losses are unavoidable. On the contrary, in other pastures the herdsmen may still use the grassland resources while at the same time considering the conservation of the ecosystem, and in such cases a higher socioeconomic return is likely. We adopt the state of the system, i.e., the global cooperation level, as the criterion to measure whether the local cooperative environment is favorable or not. Since the state of the system is evolving simultaneously, here we prefer the dynamical global cooperation level, instead of the static criterion in Refs. [69], [70]. Moreover, in real situations the investment return is variable, but should be somewhat limited by external adjustment. In general, it should be limited in a certain range [76].

In this study, we assume that the enhancement factor in each group is updated based on the differences between the dynamical local and global cooperation levels, and limited between the lower and the upper limit. We study how the adaptive and bounded investment returns influence the evolution of cooperation in the spatial PGG. We find that this PGG model with the adaptive and bounded investment returns can effectively enhance cooperation in spatially structured populations, and that appropriately bounded limitations of the multiplication factor can result in the best cooperation level. We find further that, in comparison to the traditionally spatial PGG where only one invariable multiplication factor which is larger than one exists in the whole population, our proposed PGG model can produce a higher cooperation level when each multiplication factor is limited to change only between one and the group size.

Results

We start by presenting the results as obtained when the lower limit of the multiplication factor is equal to the opposite number of the upper limit , i.e., . Here is the limit value (for the detailed definitions see the Methods section). Figure 1(a) shows the cooperation level at equilibrium in the population in dependence on the feedback strength for different values of . We find that when cooperation can be promoted for larger . To be specific, when is small, e.g., , full defection is achieved, irrespective of the values of feedback strength. This is because cooperators cannot survive in structured populations if the maximum enhancement factor is not sufficiently large [44]. When becomes larger, e.g., , the cooperation level first increases and then slightly decreases. Subsequently, it holds at about with increasing . While there is no limitation for the multiplication factor, although the cooperation level is very high, but a small amount of defectors can survive in the population even for high feedback strength, e.g., . When moderate values of is set, e.g., , full cooperation can be achieved for high feedback strength, and the cooperation level is very similar for other moderate values of . To further qualify the effects of on the evolution of cooperation, we present as a function of for different in Fig. 1(b). Clearly, we see that for different values of , the cooperation level first increases dramatically from zero until reaching the maximum value at a moderate , then decreases slowly with increasing . Here, we do not show the cooperation level in dependence on for large . In fact, we can still observe the nonmonotonous dependence of on even for large . These results suggest that the PGG model with the adaptive and bounded multiplication factor can effectively enhance cooperation in spatial structures, and higher cooperation level can emerges if an appropriate limitation is considered for the dynamical multiplication factor.

thumbnail
Figure 1. Promotion of cooperation due to adaptive and bounded investment returns.

Panel (a) depicts the fraction of cooperators in dependence on the feedback strength for different values of . Panel (b) depicts the fraction of cooperators in dependence on the boundary value for different values of . It can be observed that cooperation can be promoted for large values of feedback strength, and there exist moderate boundary values warranting the best promotion of cooperation. Here, .

https://doi.org/10.1371/journal.pone.0036895.g001

In order to intuitively understand the evolution of cooperation, we show some typical snapshots of the distribution of strategy and multiplication factor in the whole population in Fig. 2. We find that at the beginning of evolution, cooperators can form many small and isolated patches. But subsequently, some small compact cooperator clusters are embedded in the sea of defectors. As time increases, the cooperator clusters increase gradually, and finally cooperators may expand as a single ever growing cluster [upper row in Fig. 2]. Correspondingly, the multiplication factor in the full cooperation group can reach the upper limit, whereas the multiplication factor in the full defection group can reach the lower limit [bottom row in Fig. 2]. However, the multiplication factor within the groups along the boundary of cooperators and defectors reaches a value between the lower and upper limit.

thumbnail
Figure 2. Characteristic snapshots of strategy and multiplication factor distributions on a

square lattice during the coevolutionary process. Top row depicts the time evolution (from left to right) of typical distributions of cooperators (grey) and defectors (black) on a square lattice, and bottom row depicts the corresponding time evolution (from left to right) of typical distributions of multiplication factor. Results in all panels are obtained for , , and . We have checked that similar results can emerge for other parameter settings.

https://doi.org/10.1371/journal.pone.0036895.g002

In combination with the above investigations, let us now explain the emergent results. Indeed, a feedback mechanism is at work between the strategy distribution and the distribution of multiplication factors in all the groups. Therefore, cooperators form compact clusters, and these clusters can become larger and larger, especially when the global cooperation level is not very high. Meanwhile, the multiplication factor in the cooperators' clusters becomes larger and larger, which provides cooperators, especially the ones on the boundary, with a higher payoff. Whereas defectors also gather together, and the multiplication factor in the defectors' clusters becomes smaller and smaller [bottom row in Fig. 2]. In those interacting groups where the multiplication factor is negative, it is better for the players to choose the defective strategy such that they can have relatively higher payoffs. In a sense, this adaptive mode can induce a double-edged sword effect on the evolution of cooperation. However, under the social learning defectors are inclined to learn from their neighboring cooperators. As a consequence, the evolution of cooperation can be favored by this locally adaptive investment return.

If there is no limitation for the adaptive multiplication factor, due to the continuing negative feedback effects cooperators cannot invade the defectors' clusters, even if the feedback strength is high. In this situation, cooperators can thrive, but cannot dominate the whole population. When the limitation is considered for the dynamical multiplication factor, the feedback mechanism, especially the negative feedback effects, can be effectively weakened. If there is too much restriction for the adaptive multiplication factor, that is, is not very large, e.g., , the multiplication factor in some groups can reach the upper limit from a negative value due to the social learning, but this upper limit cannot warrant the promotion of cooperation in spatial PGG even if the feedback strength is enough high. Whereas for a larger , e.g., , the multiplication factor in the group along the boundary reaching the upper limit can warrant a better promotion of cooperation. Hence, this adaptive and bounded mode for the multiplication factor can provide a better environment for the evolution of cooperation.

However, under this adaptive and bounded mode, the multiplication factor in some groups along the boundary cannot rapidly become a positive and large value from a negative one when the feedback strength is not very high [bottom row in Fig. 2]. Although the average multiplication factor in the whole population can reach an enough high value which can make the cooperation level reach one in the traditionally spatial PGG [44], the average multiplication factor along the boundary of cooperators and defectors becomes negative as time increases [Fig. 3(a)]. This does not provide a favorable environment for players' interactions. Correspondingly, the average payoffs of cooperators and defectors along the boundary are both negative. Moreover, as time increases the average payoff of cooperators along the boundary is just a litter higher than the one of defectors along the boundary, but have larger fluctuations [Fig. 3(b)]. Under the stochastic strategy updating, defectors do not always successfully imitate their neighboring cooperators, but sometimes may spread their strategy to the cooperators. As a result, cooperators cannot defeat those defectors along the boundary, and they can only coexist with defectors for an exceedingly long time. On the contrary, when the feedback strength is high, by means of social learning the multiplication factor in the group along the boundary can have the opportunity to suddenly reach the upper limit, which can warrant the invading of cooperative behavior into the defectors' clusters. Finally, full cooperation can be achieved.

thumbnail
Figure 3. Time evolution of average multiplication factor and payoffs.

Panel (a) depicts the time evolution of average values of multiplication factor in the whole population and in the boundary groups, respectively. Panel (b) depicts the time evolution of average payoffs of cooperators and defectors along the boundary, respectively. It can be observed that although the average value of multiplication factor in the whole population is large enough for the evolution of cooperation [44], the average value along the boundary becomes negative. Correspondingly, the average payoffs of cooperators and defectors along the boundary are both less than zero. As time increases, the average payoff of cooperators along the boundary is a little higher than that of defectors, but has larger fluctuations. Here, , , and .

https://doi.org/10.1371/journal.pone.0036895.g003

In what follows, we study how cooperation evolves if the lower limit is not the opposite number of the upper limit. Figure 4(a) shows the typical time evolution of cooperation for fixed and three different values of . We find that increasing the value of can make the system reach a higher cooperation level, but the cooperation level at equilibrium for is just slightly larger than the one for . In Fig. 4(b) we show the fraction of cooperators as a function of time for fixed and three different values of . We find that increasing the value of can make the system reach a higher cooperation level. Moreover, as time increases the fraction of cooperators first drops and then rapidly increases, but the larger values of or make the cooperation level increases faster. We also find that to have a favorable cooperation level, it is better to set the lower limit higher and it is not necessary to set the upper limit too high.

thumbnail
Figure 4. Cooperation promoted when the values of the lower and upper limits of the investment returns are increased.

Panel (a) depicts the fraction of cooperators in the whole population as a function of time for fixed lower limit and different values of upper limit. Panel (b) depicts the fraction of cooperators in the whole population as a function of time for fixed upper limit and different values of lower limit. Increasing the values of lower and upper limit can provide more positive effects on the evolution of cooperation. Here, and .

https://doi.org/10.1371/journal.pone.0036895.g004

Finally, we study whether cooperation can be better promoted if the adaptive multiplication factor is constrained between and by means of a comparative investigation. Previous work has reported that in the traditional PGG where only one invariable multiplication factor exists in the whole population, defectors outperform cooperators in any given mixed group for [8]. We further find that in the traditionally spatial PGG, for noise value cooperators can dominate the whole population only if , and they can survive in the system only if , as shown in Fig. 5(a). It is worth pointing out that the traditionally spatial PGG corresponds to the situation of in this present model, where the multiplication factor in each interacting group is fixed at . In Fig. 5(b), we set , and show the cooperation level as a function of feedback strength for and different values of . We see that the cooperator density varying with displays two different behaviors: for smaller values of , e.g., , the cooperation level first decreases and then increases until reaching the maximum value. Subsequently, it decreases very slowly with increasing and its value approaches ; for larger values of , e.g., , the cooperation level does not change too much for small values of , then monotonously increases to one with increasing . In addition, for smaller values of just a small amount of () is needed to warrant a better promotion of cooperation in comparison to the traditionally spatial PGG, and the critical amount of becomes smaller if the is increased. For larger values of , the cooperation level for any value of is not less than the one for . In fact, the average multiplication factor in the population for is not larger than the one for , but these results suggest that cooperation can be better promoted in comparison to the traditionally spatial model. In addition, Fig. 5(b) shows that the cooperation level increases with increasing the upper limit of the multiplication factor and the initial value of the multiplication factor. We have also verified that increasing the initial fraction of cooperators is beneficial for the evolution of cooperation in this model.

thumbnail
Figure 5. Cooperation promoted even when the investment return is updated within the interval.

. Panel (a) shows the fraction of cooperators as a function of for . In this situation, the model recovers to the traditionally spatial PGG, where the multiplication factor in each group is fixed at and . For , cooperators can survive only if , and they can dominate the whole population only if . Panel (b) shows the fraction of cooperators as a function of for fixed and different values of . Initially, the multiplication factor in each interacting group is . Dash lines are used to indicate the critical value of for a better promotion of cooperation in this adaptive and bounded mode for the enhancement factor.

https://doi.org/10.1371/journal.pone.0036895.g005

Discussion

In summary, we have presented a coevolutionary rule where the multiplication factor in each interacting group is updated based on the local strategy distribution in the group and the global strategy distribution in the whole population, and studied its impact on the evolution of cooperation in the spatial public goods game. We found that this adaptive rule for the multiplication factor can effectively enhance the evolution of cooperation. When the appropriate bounded limitation for the dynamical multiplication factor is further considered, cooperation can be better promoted. In particular, full cooperation can be achieved in the system when the feedback strength is high enough. Also, increasing the lower and upper limit values of the multiplication factor is favorable for the evolution of cooperation, but high cooperation level can be reached even if the upper limit is not very large. We further found that even if the multiplication factor is constrained to change between one and the group size, cooperation can be better promoted in the adaptive mode, in comparison to the classically spatial public goods game where the payoff parameter in each group is fixed and identical.

The adaptive mode for the investment returns results in that a feedback mechanism is at work, that is, the Matthew effect is introduced. From the viewpoint of this emergent feature, our model is related to the one proposed by Perc [53], who considered that the reproductive success of each individual is updated by means of the enforcement of strategy and the distribution of public goods is driven by the reproductive success of individuals. Under this success-driven mechanism, cooperation can be promoted. However, defectors can have a much higher payoff even in the sea of cooperators, and easily enforce their strategy choice to their neighbors. Correspondingly, the superpersistent defector emergences spontaneously, and cooperators cannot dominate the whole population. The complete dominance of cooperators is elusive even if the limitation factor about the value of reproductive success is considered. Whereas in our model, the multiplication factor in each interacting group is updated based on the local and global strategy distribution, which characterizes the local investment environment for collective interactions, rather than individual's personality. Also, we incorporate the limitation factor for the dynamical multiplication factor. In this framework, cooperators and defectors can form their own compact clusters respectively, and correspondingly cooperators along the boundary can have a higher payoff than the neighboring defectors. Under the social learning, cooperators can easily spread their strategy even if the noise level for strategy updating is large. In particular, when the feedback strength is high, the interacting environment including some defectors can rapidly become favorable. Thus, cooperators can gradually invade defector's clusters, and finally dominate the whole population. It could be concluded that our work further enriches the knowledgeless of coevolutionary rules in PGGs, and importantly our spatial PGG model with adaptive and bounded investment returns not only can promote cooperation, but also make cooperators completely dominate the population.

It is worth emphasizing the bounded values of the multiplication factor play a different role in the evolution of cooperation in our model in comparison to the one in Ref. [70]. It is found that the main results remain qualitatively if the limit value of the payoff parameter in the prisoner's dilemma is large enough. Moreover, it is demonstrated that the final cooperation level strongly depends on the values of initial payoff parameter and feedback strength in Ref. [70]. In particular, with increasing the initial payoff parameter, the probability that the system ends in full cooperation state decreases. Whereas in this work, we find that the introduced limitation factor can weaken the Matthew effect, particularly the negative feedback effect on the unfavorable interacting groups, which makes the limit value a crucial model parameter. The limited negative effects can be overcome via social learning. Hence, appropriate limitation can warrant the best promotion of cooperation. In addition, we show that the finial cooperation level not only depends on the the values of initial payoff parameter and feedback strength, but also depends on the limit values. With increasing the initial payoff parameter and the initial fraction of cooperators, cooperation can be better enhanced when the dynamical multiplication factor is limited. In a sense, this work further explores the effects of adaptive and bounded game payoffs on the evolution of cooperation.

During the coevolutionary process, the investment return in most of interacting groups reaches the upper or lower limit due to the feedback effects. This segregation and polarization of investment returns occurs spontaneously over time, which is different from the distribution in Ref. [47]. In the latter case, the distribution of the multiplication factor is artificially introduced by the authors and does not change during the evolutionary process. Although the emergent values of the multiplication factor in all the interacting groups do not display too much diversity, we find that cooperation can be promoted in this adaptive and bounded mode. Compared with the results in the traditionally spatial PGG model, cooperation can be better promoted even if the multiplication factor can only change between one and the group size.

In the present model, we consider the adaptive mode for the multiplication factor in a group based on the local cooperation level in the classical PGG where players just have two discrete strategy choices or , and correspondingly the local cooperation level only has several finite values. To make the local cooperation level change continuously between zero and one, we also introduce the adaptive and bounded investment returns into the spatial continuous PGG [18][20], and still find that this PGG with adaptive and bounded investment returns promotes cooperation. We also test our model in well-mixed populations as well as on other types of interactions networks, and still find that cooperation can be enhanced by the proposed coevolutionary rule. Moreover, we would like to point out that in this work we fix the value of noise to one. In general, the qualitative behavior of the system remains unchanged for other values of noise, although for pairwise interactions there may exist an optimal value of noise at which the evolution of cooperation is most successful [44]. It could be inferred that if we can choose the optimal noise value for strategy updating, the positive effects from social learning can be amplified. We also believe that, cooperation can be better promoted if we further incorporate the selection of noise level in strategy adoption [66], [67] into this adaptive and bounded mode for the multiplication factor.

Methods

We consider the PGG on a square lattice of size with periodic boundary conditions. Each individual who is a pure strategist can only follow two simple strategies: cooperate () and defect (). Cooperators contribute a fixed amount (here considered to be equal to without loss of generality) to the public good while defectors contribute nothing. The sum of all contributions in each group is multiplied by the factor , and the resulting public goods are distributed among all the group members. Correspondingly, the payoff of player from the group is(1)where denotes the strategy of player , denotes the number of cooperators in the group , and denotes the group size. Here, we consider the square lattice with von Neumann Neighborhood. Accordingly, the interacting group size is fixed at , and each individual belongs to five different groups. The payoff of each player is accumulated from the fixed five interacting groups, and thus player ' total payoff .

After playing the games, the multiplication factor in each group needs to be updated. Specifically, we assume that the multiplication factor of the group centered on player at time is(2)where controls the strength of feedback from the comparison between the local and global cooperative environments, is the multiplication factor of the focal individual 's group at time , is the fraction of cooperators in the whole population at time , and is the local cooperation level in the group centered on at time . Here, , where denotes the number of cooperators in the group where player is the focal individual at time . Moreover, we consider the limitation for the adaptive multiplication factor following previous work [70], that is, letting if and letting if . Here, and respectively represent the upper and lower limits of the multiplication factor in each group, and they satisfy the following inequalities: and . In particular, when , the multiplication factor is constrained in a symmetric interval, which is the same to the setting in Ref. [70]. Moreover, when (no bounded limitation for the multiplication factor) or (no updating for the multiplication factor), the average multiplication factor in all the interacting groups , where is the initial value of the multiplication factor in each group.

Subsequently, each player is allowed to learn from one of its neighbors and update its strategy. Player adopts the randomly chosen neighbor ' strategy with a probability depending on the payoff difference as(3)where denotes the amplitude of noise [77], accounting for imperfect information and errors in decision making. Following previous work [70], we simply set representing that it is very likely that the better performing players will pass their strategy to other players, yet it is possible that players will occasionally learn also from the less successful neighbors.

Simulations of this spatial PGG model are performed by means of a synchronous updating rule, using to system size. Initially, the two strategies of and are randomly distributed among the population with an equal probability, and the multiplication factor in each interacting group has the same value . The key quantity for characterizing the cooperative behavior of the system is the density of cooperators, which is defined as the fraction of cooperators in the whole population. The system can reach a dynamical equilibrium after a suitable transient time [78][80]. Then the density of cooperators reaches its asymptotic value and remains there within small fluctuations (less than ). This asymptotic value is taken to describe the cooperation level in the whole population, and all the simulation results are averaged over different realizations of initial conditions.

Author Contributions

Conceived and designed the experiments: XC YL YZ LW MP. Performed the experiments: XC YL YZ LW MP. Analyzed the data: XC YL YZ LW MP. Contributed reagents/materials/analysis tools: XC YL YZ LW MP. Wrote the paper: XC YL YZ LW MP.

References

  1. 1. Nowak MA (2006) Five rules for the evolution of cooperation. Science 314: 1560–1563.
  2. 2. Szabó G, Fáth G (2007) Evolutionary games on graphs. Phys Rep 446: 97–216.
  3. 3. Milinski M, Sommerfeld RD, Krambeck HJ, Reed FA, Marotzke J (2008) The collective-risk social dilemma and the prevention of simulated dangerous climate change. Proc Natl Acad Sci USA 105: 2291–2294.
  4. 4. Santos FC, Pacheco JM (2011) Risk of collective failure provides an escape from the tragedy of the commons. Proc Natl Acad Sci USA 108: 10421–10425.
  5. 5. Greenwood G (2011) Evolution of strategies for the collective-risk social dilemma relating to climate change. EPL 95: 40006.
  6. 6. Heitzig J, Lessman K, Zou Y (2011) Self-enforcing strategies to deter free-riding in the climate change mitigation game and other repeated public good games. Proc Natl Acad Sci USA 108: 15737–15744.
  7. 7. Hardin G (1968) The tragedy of the commons. Science 162: 1243–1248.
  8. 8. Hauert C, De Monte S, Hofbauer J, Sigmund K (2002) Replicator dynamics for optional public good games. J Theor Biol 218: 187–194.
  9. 9. Szabó G, Hauert C (2002) Phase transitions and volunteering in spatial public goods games. Phys Rev Lett 89: 118101.
  10. 10. Hauert C, De Monte S, Hofbauer J, Sigmund K (2002) Volunteering as red queen mechanism for cooperation in public goods games. Science 296: 1129–1132.
  11. 11. Hauert C, Holmes M, Doebeli M (2006) Evolutionary games and population dynamics: maintenance of cooperation in public goods games. Proc R Soc B 273: 2565–2571.
  12. 12. Sasaki T, Okada I, Unemi T (2007) Probabilistic participation in public goods games. Proc R Soc B 274: 2639–2642.
  13. 13. Wang J, Fu F, Wu T, Wang L (2009) Emergence of social cooperation in threshold public goods games with collective risk. Phys Rev E 80: 016101.
  14. 14. Szolnoki A, Perc M (2010) Impact of critical mass on the evolution of cooperation in spatial public goods games. Phys Rev E 81: 057101.
  15. 15. Boza G, Számadó S (2010) Beneficial laggards: multilevel selection, cooperative polymorphism and division of labour in threshold public good games. BMC Evol Biol 10: 336.
  16. 16. Archetti M, Scheuring I (2011) Coexistence of cooperation and defection in public goods games. Evolution 65: 1140–1148.
  17. 17. Deng K, Chu T (2011) Adaptive evolution of cooperation through darwinian dynamics in public goods games. PLoS ONE 6: e25496.
  18. 18. Janssen MA, Goldstone RL (2006) Dynamic-persistence of cooperation in public good games when group size is dynamics. J Theor Biol 243: 134–142.
  19. 19. Kamimura Y, Abe J, Ito H (2008) The continuous public goods game and the evolution of cooperative sex ratios. J Theor Biol 252: 277–287.
  20. 20. Cressman R, Song JW, Zhang BY, Tao Y (2012) Cooperation and evolutionary dynamics in the public goods game with institutional incentives. J Theor Biol 299: 144–151.
  21. 21. Wakano JY (2007) Evolution of cooperation in spatial public goods games with common resource dynamics. J Theor Biol 247: 616: 622.
  22. 22. Wakano JY, Nowak MA, Hauert C (2009) Spatial dynamics of ecological public goods. Proc Natl Acad Sci USA 106: 7910–7914.
  23. 23. Brandt H, Hauert C, Sigmund K (2003) Punishment and reputation in spatial public goods games. Proc R Soc B 270: 1099–1104.
  24. 24. Fowler JH (2005) Altruistic punishment and the origin of cooperation. Proc Natl Acad Sci USA 102: 7047–7047.
  25. 25. Brandt H, Hauert C, Sigmund K (2006) Punishing and abstaining for public goods. Proc Natl Acad Sci USA 103: 495–497.
  26. 26. Hauert C, Traulsen A, Brandt H, Nowak MA, Sigmund K (2007) Via freedom to coercion: the emergence of costly punishment. Science 316: 1905–1907.
  27. 27. Traulsen A, Hauert C, De Silva H, Nowak MA, Sigmund K (2009) Exploration dynamics in evolutionary games. Proc Natl Acad Sci USA 106: 709–712.
  28. 28. Helbing D, Szolnoki A, Perc M, Szabó G (2010) Evolutionary establishment of moral and double moral standards through spatial interactions. PLoS Comput Biol 6: e1000758.
  29. 29. Short MB, Brantingham PJ, D'Orsogna MR (2010) Cooperation and punishment in an adversarial game: How defectors pave the way to a peaceful society. Phys Rev E 82: 066114.
  30. 30. Sigmund K, De Silva H, Traulsen A, Hauert C (2010) Social learning promotes institutions fro governing the commons. Nature 466: 861–863.
  31. 31. Szolnoki A, Szabó G, Perc M (2011) Phase diagrams for the spatial public goods game with pool punishment. Phys Rev E 83: 036101.
  32. 32. Szolnoki A, Szabó G, Czakó L (2011) Competition of individual and institutional punishments in spatial public goods games. Phys Rev E 84: 046106.
  33. 33. Baldassarri D, Grossman G (2011) Centralized sanctioning and legitimate authority promote cooperation in humans. Proc Natl Acad Sci USA 108: 11023–11027.
  34. 34. Sigmund K, Hauert C, Nowak MA (2001) Reward and punishment. Proc Natl Acad Sci USA 98: 10757–10762.
  35. 35. Rand DG, Dreber A, Ellingsen T, Fudenberg D, Nowak MA (2009) Positive interactions promote public cooperation. Science 325: 1272–1275.
  36. 36. Szolnoki A, Perc M (2010) Reward and cooperation in the spatial public goods game. EPL 92: 38003.
  37. 37. Hauert C (2010) Replicator dynamics of reward & reputation in public goods games. J Theor Biol 267: 22–28.
  38. 38. Sasaki T, Unemi T (2011) Replicator dynamics in public goods games with reward funds. J Theor Biol 287: 109–114.
  39. 39. Guan JY, Wu ZX, Wang YH (2007) Effects of inhomogeneous activity of players and noise on cooperation in spatial public goods games. Phys Rev E 76: 056101.
  40. 40. Huang ZG, Wang SJ, Xu XJ, Wang YH (2008) Promote cooperation by localised small-world communication. EPL 81: 28001.
  41. 41. Santos FC, Santos MD, Pacheco JM (2008) Social diversity promotes the emergence of cooperation in public goods games. Nature 454: 213–216.
  42. 42. Wu T, Fu F, Wang L (2009) Individual's expulsion to nasty environment promotes cooperation in public goods games. EPL 90: 20001.
  43. 43. Rong Z, Wu Z (2009) Effect of the degree correlation in public goods game on scale-free networks. EPL 87: 30001.
  44. 44. Szolnoki A, Perc M, Szabó G (2009) Topology-independent impact of noise on cooperation in spatial public goods games. Phys Rev E 80: 056109.
  45. 45. Wu T, Fu F, Wang L (2009) Partner selections in public goods games with constant group size. Phys Rev E 80: 026121.
  46. 46. Yang HX, Wang WX, Wu ZX, Lai YC, Wang BH (2009) Diversity-optimized cooperation on complex networks. Phys Rev E 79: 056107.
  47. 47. Shi DM, Zhuang Y, Wang BH (2010) Group diversity promotes cooperation in the spatial public goods game. EPL 90: 58003.
  48. 48. Xu Z, Wang Z, Song H, Zhang L (2010) Self-adjusting rule in spatial voluntary public goods games. EPL 88: 30011.
  49. 49. Fowler JH, Christakis NA (2010) Cooperative behavior cascades in human social networks. Proc Natl Acad Sci USA 107: 5334–5338.
  50. 50. Rong Z, Yang HX, Wang WX (2010) Feedback reciprocity mechanism promotes the cooperation of highly clustered scale-free networks. Phys Rev E 82: 047101.
  51. 51. Vukov J, Santos FC, Pacheco JM (2011) Escaping the tragedy of the commons via directed investments. J Theor Biol 287: 37–41.
  52. 52. Szolnoki A, Perc M (2011) Group-size effects on the evolution of cooperation in the spatial public goods game. Phys Rev E 84: 047102.
  53. 53. Perc M (2011) Success-driven distribution of public goods promotes cooperation but preserves defection. Phys Rev E 84: 037102.
  54. 54. Gómez-Gardeňes J, Romance M, Criado R, Vilone D, Sánchez A (2011) Evolutionary games defined at the network mesoscale: The public goods game. Chaos 21: 016113.
  55. 55. Gómez-Gardeňes J, Vilone D, Sánchez A (2011) Disentangling social and group heterogeneities: Public goods games on complex networks. EPL 95: 68003.
  56. 56. Perc M, Szolnoki A (2008) Social diversity and promotion of cooperation in the spatial prisoner's dilemma game. Phys Rev E 77: 011904.
  57. 57. Ebel H, Bornholdt S (2002) Coevolutionary games on networks. Phys Rev E 66: 056118.
  58. 58. Zimmermann MG, Eguíuz VM, San Miguel M (2004) Coevolution of dynamical states and interactions in dynamical networks. Phys Rev E 69: 065102(R).
  59. 59. Zimmermann MG, Eguíluz VM (2005) Cooperation, social networks, and the emergence of leadership in a prisoner's dilemma with adaptive local interactions. Phys Rev E 72: 056118.
  60. 60. Pacheco JM, Traulsen A, Nowak MA (2006) Coevolution of strategy and structure in complex networks with dynamical linking. Phys Rev Lett 97: 258103.
  61. 61. Santos FC, Pacheco JM, Lenaerts T (2006) Cooperation prevails when individuals adjust their social ties. PLoS Comput Biol 2: e140.
  62. 62. Poncela J, Gómez-Gardeňes J, Floría LM, Sanchez A, Moreno Y (2008) Complex Cooperative networks from Evolutionary Preferential Attachment. PLoS ONE 3: e2449.
  63. 63. Evolutionary game dynamics in a growing structured populations Poncela J, Gómez-Gardeňes J, Moreno Y, Traulsen A (2009) New J Phys 11: 083031.
  64. 64. Pestelacci E, Tomassini M (2008) Cooperation in Co-evolving Networks: The Prisoner's Dilemma and Stag-Hunt Games. Lect Notes Comput Sci 5199: 539–548.
  65. 65. Pestelacci E, Tomassini M (2010) Evolution of Conventions and Social Polarization in Dynamical Complex Networks. Lect Notes Comput Sci 6239: 512–522.
  66. 66. Szabó G, Szolnoki A, Vukov J (2009) Selection of dynamical rules in spatial prisoner's dilemma games. EPL 87: 18007.
  67. 67. Szolnoki A, Vukov J, Szabó G (2009) Selection of noise level in strategy adoption for spatial social dilemmas. Phys Rev E 80: 056112.
  68. 68. Fort H (2008) A minimal model for the evolution of cooperation through evolving heterogeneous games. EPL 81: 48008.
  69. 69. Tomochi M, Kono M (2002) Spatial prisoner's dilemma games with dynamic payoff matrices. Phys Rev E 65: 026112.
  70. 70. Lee S, Holme P, Wu ZX (2011) Emergent hierarchical structures in multiadaptive games. Phys Rev Lett 106: 028702.
  71. 71. Wu ZX, Xu XJ, Huang ZG, Wang SJ, Wang YH (2006) Evolutionary prisoner's dilemma game with dynamic preferential selection. Phys Rev E 74: 021107.
  72. 72. Szolnoki A, Perc M (2008) Coevolution of teaching activity promotes cooperation. New J Phys 10: 043036.
  73. 73. Moyano LG, Sánchez A (2009) Evolving learning rules and emergence of coopration in spatial prisoner's dilemma. J Theor Biol 259: 84–95.
  74. 74. Cardillo A, Gómez-Gardeñes J, Vilone D, Sánchez A (2010) Co-evolution of strategies and update rules in the prisoner's dilemma game on complex networks. New J Phys 12: 103034.
  75. 75. Perc M, Szolnoki A (2010) Coevolutionary games–a mini review. BioSystems 99: 109–125.
  76. 76. Kogan L (2004) Asset prices and real investment. Journal of Financial Economics 73: 411–431.
  77. 77. Szabó G, Töke C (1998) Evolutionary prisoner's dilemma game on a square lattice. Phys Rev E 58: 69–73.
  78. 78. Gómez-Gardeňes J, Poncela J, Floría LM, Moreno Y (2008) Natural Selection of cooperation and degree hierarchy in heterogeneous populations. J Theor Biol 253: 296–301.
  79. 79. Vukov J, Szabó , Szolnoki A (2008) Evolutionary prisoner's dilemma game on Newman-Watts networks. Phys Rev E 77: 026109.
  80. 80. Assenza S, Gómez-Gardeňes J, Latora V (2008) Enhancement of cooperation in highly clustered scale-free networks. Phys Rev E 78: 017101.