arxiv: v1 [q-bio.pe] 27 Dec 2018

Transcription

1 Long-range prisoner s dilemma game on a yle Jiwon Bahk, Seung Ki Baek,, and Hyeong-hai Jeong, epartment of Physis and Astronomy, Sejong University, Seoul 56, Korea epartment of Physis, Pukyong National University, Busan 485, Korea arxiv:8.69v [q-bio.pe] 7 e 8 We investigate evolutionary dynamis of altruism with long-range interation on a yle. The interation between individuals is desribed by a simplified version of the prisoner s dilemma (P) game in whih the payoffs are parameterized by, the ost of a ooperative ation. In our model, the probabilities of the game interation and ompetition deay algebraially with r AB, the distane between two players A and B, but with different exponents: That is, the probability to play the P game is proportional to r α AB. If player A is hosen for death, on the other hand, the probability for B to oupy the empty site is proportional to r β AB. In a limiting ase of β, where the ompetition for an empty site ours between its nearest neighbors only, we analytially find the ondition for the proliferation of altruism in terms of th, a threshold of below whih altruism prevails. For finite β, we onjeture a formula for th as a funtion of α and β. We also propose a numerial method to loate th, aording to whih we observe exellent agreement with the onjeture even when the seletion strength is of onsiderable magnitude. I. INTROUTION As harles arwin remarked in On the Origin of Speies, Natural seletion will never produe in a being anything injurious to itself, for natural seletion ats solely by and for the good of eah. The existene of altruism is seemingly at odds with this statement, as far as altruists are defined as those who benefit others at the ost to themselves. For this reason, there have been extensive studies to explain the evolution of altruism. The explanations an be ategorized (arguably) into five rules, i.e., diret reiproity, indiret reiproity, spatial reiproity, kin seletion, and group seletion [, ]. An essential ommon fator in these mehanisms is the assortment of individuals arrying the ooperative phenotype [, 4]. Let us onsider a population of defetors. If there emerges a group within whih the members ooperate themselves, its size will inrease beause the members earn higher fitness than the population average. Furthermore, if the assortment an be maintained while the size of the group grows, the whole population will beome ooperative. On the other hand, if the assortment breaks, making every individual interat with every other, ooperators will disappear beause they earn less than the population average by onstrution. onsidering that the defetors always win in the mean-field regime, one may expet that spatial reiproity beomes weaker as the dimensionality of the spae d inreases. The logi goes as follows: In a population of size N, the average hemial distane between a pair of individuals behaves as N /d and thus dereases dramatially as d grows. Hene, it is reasonable to expet a relatively homogeneous state in a highdimensional struture. In many statistial-physial models, the mean-field theory beomes exat as d exeeds a seungki@pknu.a.kr hj@sejong.a.kr ertain value d [5]. Another way to look at the rossover between a low-dimensional spin system and the meanfield limit is to onsider long-range interations on a onedimensional () lattie struture [6]. For example, when the interation strength deays as r σ between a pair of Ising spins with distane r, the spins show the mean-field-like ritial behaviors for < σ / as those with short range interations in high dimensions d > d = 4 do. For / σ, Ising spin system shows the order-disorder transitions at finite temperatures but its ritial behaviors are different from meanfield transition. For σ >, the interations beome shortranged effetively and they behave as the spins with finite-range interations. The story beomes more ompliated when it omes to evolutionary games: Let us onsider the Prisoner s ilemma (P) game with the death-birth (B) reprodution proess in the weak seletion limit. It has a ertain population struture, and the game is played between players at one step away. On regular strutures, the ondition for ooperation turns out to be determined by the number of nearest neighbors regardless of d [7] (see also Ref. 8 for more general results). Furthermore, spatial reiproity breaks down for any population strutures if we employ the birth-death (B) proess instead. What is the differene between the B and B proesses? The point is that we atually have another kind of interation, that is, ompetition for reprodution. For soial behavior to evolve, these two should have different length sales [4]. Even if the game interation shares the same underlying struture with ompetition for reprodution, the B proess naturally separates the sales beause the ompetition for reprodution effetively ours between players at two steps away. In this paper, we wish to investigate the roles of these two length sales expliitly by onsidering the P game on a yle with long-range interations, whose dynamis is governed by the B proess. The game is parameterized by the ost of ooperation, denoted by. We are interested in its threshold, th, above whih ooperators

2 are outnumbered by defetors in the infinite population with zero mutation limit. The length sale of the game interation is determined by an exponent α, so that the game result between two individuals at distane r has a weighting fator of r α. On the other hand, the length sale of ompetition for reprodution is determined by another exponent β, so the probability for an individual to oupy an empty site at distane r deays algebraially as r β. Our first main result is to derive th for β, where only the nearest neighbors ompete for reprodution. Then, we onsider the ase of α = β, where an analyti result for th is available in the weak-seletion limit [8]. Based on these two speial ases, we onjeture a general form of th (α, β). It agrees well with numerial results. This work is organized as follows: In the next setion, we give a detailed desription of our model. In Se. III, we present th as a funtion of α in ase of β and review the exat th when α = β in the weak-seletion limit. Based on these two results, we onjeture th for general α and β. Setion IV ompares this onjeture with Monte arlo data. The onjetured threshold niely mathes with our numerial alulation, and this holds even if the seletion strength inreases. We disuss this finding and onlude this work in Se. V. II. MOEL The population struture is a yle, i.e., a lattie with the periodi boundary ondition. For the sake of onveniene, the total number of sites is assumed to be an add number in this setion and we set N n +. Of ourse, it will be irrelevant whether N is even or odd if we deal with a suffiiently large system. Every site i is oupied by a player, who is also denoted by i = n, n +,...,,,,..., n, n, and eah player i an hoose an ation s i between ooperation and defetion. The P game is formulated as the donation game, where a ooperator benefits the o-player by an amount of b > with paying ost (, b). The payoff matrix π is thus defined as ( b b ). () Without loss of generality, we will set b = throughout this work. The expeted payoff of player i per game is given by the following weighted sum, Π i = j i r α ij π s is j = j i π sis j r α ij () where ζ n (α) n k= k α is the inomplete Riemann zeta funtion and r α /ζ ij n (α) is the probability that player i play a game with player j where r ij is the distane between them. On a yle, r ij is given by the minimum of i j, i j + N, and i j N. We onsider the expeted payoff per game (rather than the total payoff, j i r α π ij sis j ) to make the average payoff independent of the population size. This normalized payoff is also better to ompare two systems with different α fairly. The systems with smaller α would show effetively more strong seletions without the normalization. Fig. illustrates the way to alulate payoff Π of player for α = and n =. Player at the top plays the P game with every other in the population, k = ±, ±, and k = ±. From Eq. (), we see that π k is for k =, and and b for k =,, and. Π is the weighted sum of these values with the wighting k fators, ζ where ζ () () = [ / + / + / ] = k 6 6. Sine ζ () is for n = ±, 9 for n = ±, and 4 for n = ±, Π is given by π = 7 b. We an alulate the payoffs of the other players similarly. They are Π = 49 b, Π = 58 b, Π = 5 b, Π = 85 b, Π = 54 b, Π = 49 b. Player i s fitness is given by the exponential form of the payoff, f i = e ωπi, () where the seletion strength ω represents how strongly the fitness depends on the payoff. Exponential fitness of Eq. () beomes the usual linear fitness of + ωπ i in the weak seletion limit. It has an advantage over linear fitness in the strong seletion limit. We an interpret the exponential fitness as feundity diretly even when the payoff is negative. Furthermore, B dynamis is invariant under the addition of a onstant to all elements in the pay off matrix whih ertainly preserve the Nash equilibrium. We employ a long-range version of the B proess as a model of reprodution. The first step is to hoose a death site k randomly, irrespetive of fitness, and make it empty. The probability to hoose a partiular site k is therefore inversely proportional to N. The differene from the usual B proess for the nearest-neighbor ompetition is that any player i in the population an produe an offspring at the empty site. For given k, the onditional probability p ik that player i s offspring takes over the site k is proportional to the player s fitness f i but dereases as r β ik where r ik is the distane between them. In other words, p ik is given by p ik = e ωπi, (4) Z k where Z k i k eωπi r β ik is a normalization fator. Note that the player at the death site k annot leave an offspring. In partiular, s k will beome with probability = e ωπi δ si,, (5) Z k P s k i k where δ x,y is the Kroneker delta. To remove trivial absorbing states where every player takes the same ation, we introdue a small mutation probability µ. When r β ik r β ik

3 (-) - 4 (b-) = 7 b 6 (-) 6 (-) 4Z e ω - -? 9Z e ω - 4 (b-) 9 (b-) Z e ω - Z e ω 9Z e ω 4Z e ω FIG.. (olor online) Shemati representation of an example of the model (α = β =, n = ). Payoff of the player. Player plays the P game of Eq. () with player k produing π k = b for k =,, and and π k = for k =, and. Π is the weighted sum of these values k with the weighting fators, 6 ζ. Weighting fators are () 9 4 for n = ±, for n = ±, and for n = ±, and Payoff of the player is Π = 7 b. Payoff Π k of player k an be obtained similarly; Π = b, Π = b, Π = b, Π = b, Π = b, Π = b. ompetition for reprodution. When a player, say, i =, is hosen for death, the other players k ompete to produe their offspring at this empty site. Player k s winning probability is proportional to its fitness f k = e ωπ k and inverse square distane k. Note that /Z is to normalize the total sum of probabilities. The winner s offspring inherits the winner s strategy with probability ( µ) or the opposite one with µ. player i reprodues its offspring at the site k, s k beomes s i with probability µ and by the opposite of s i with probability µ. If we ombine the B proess and mutation together, the atual probability that s k beomes () FIG.. (olor online) omain-wall dynamis in ase of the nearest-neighbor ompetition (β ). Initial onfiguration in whih two domains meet at a wall between the sites k = and. The ompetition for reprodution ours between the players at these sites. If k = is made empty and oupied by an offspring of the player at k =, the domain wall moves right. () On the ontrary, the domain wall moves left if k = is made empty and taken over by an offspring of the player at k =. is given by P sk = ( µ) P s k + µ ( P s k ). (6) It is straightforward to see that the omplementary event s k ours with probability P sk. We demonstrate the reprodution proess in Fig. for β = and n =. When a player, say, i =, is hosen for death, the other players k ompete to produe their offspring at this empty site. Player k s winning probability is given by k Z e ωπ k with Π k given [ in the aption ] of [. Here Z] = e ωπ + e ωπ + 4 e ωπ + e ωπ + 9 e ωπ + e ωπ so that the normalization fator /Z makes the total sum of probabilities be. The winner s offspring inherits the winner s strategy with probability ( µ) or the opposite one with µ. III. ANALYSIS We begin by onsidering how the threshold ost th (α, β) behaves in speial ases. The first one is the ase with the nearest-neighbor ompetition, represented by β. The seond one is when α = β, and th (α, α) in the weak-seletion limit is readily obtained by applying the result of Ref. 8. A. Nearest-neighbor ompetition (β ) If β, only the nearest neighbors of the death site will ompete for reprodution. Let us define a domain as a set of onseutive sites with the same ation, bounded by sites with the opposite ation. When a death site k is piked up inside a domain, therefore, the ation of its neighbors must be the same as s k. If µ is negligibly small, we an say that the onfiguration {s i } will not hange. It implies that the system shows dynamis only at domain

4 4 boundaries. Let us assume that the system is divided into two equally large domains so that { for i =,,,..., n s i = (7) for i =,,..., n, as shown in Fig.. Assume that k = is hosen as for death. Only its neighboring players k = and k = ompete to take over the empty site, and the domain wall will move right if the offspring of player i = wins. The payoffs Π and Π are alulated as Π = = Π = = π ss j r α j j n ( r= j n r= r α π ss j r α j + ) r α, (8) = r α =, (9) and the probability that the wall moves right is given by P s = e ωπ. () e ωπ ωπ + e Similarly, we an alulate the probability that the wall moves left, P s, from Π and Π. The population will beome ooperative when P s > P s. If N, this inequality redues to < and we have th (α, ) = /. B. Analyti solution of α = β () If the game interation and ompetition share the same population struture, strategies seleted by the network reiproity an be obtained on any population struture in the weak-seletion limit of ω using oalesent theory [8]. When we denote the expeted oalesene time [9] from the two ends of an n-step random walk by τ n, ooperation is favored when is smaller than th = τ τ τ () in the weak-seletion limit. In a weighted undireted graph, if site i is onneted to j by an edge, the edge has a weight w ij = w ji. The weighted degree of site i is the sum of its edge weights: w i j w ij. The probability for a random walker to transit from i to j is denoted by p ij w ij /w i. A useful quantity is the Simpson degree ( ), κ i = j p ij a generalization of the topologial degree. For a regular graph, the site index i is unneessary sine every vertex has the same Simpson degree k i = k. Equation () is then rewritten as th = N/κ N. () In our ase, noting that w ij r α ij for i j and w ii =, we find the threshold as a ombination of the zeta funtions [], th (α, α) = ζ n(α) [ζ n (α)], (4) where we have taken into aount N in the sense of the ωn-limit [].. onjeture for th (α, β) To reap, we have two preditions: First, if β and N, the threshold ost is predited to be th (α, ) =, (5) so that ζ n (α) an be interpreted as the effetive number of neighbors to play the game with on one side of the foal player. Seond, when α = β, the threshold ost th has been derived as th (α, α) = ζ n(α + α) (6) ζ n (α) for ω. To inorporate Eqs. (5) and (6), we onjeture a onnetion formula th (α, β) as follows: th (α, β) = ζ n(α + β) ζ n (β). (7) In partiular, for α, the onjeture predits IV. th (, β) = ζ n (β). (8) NUMERIAL ALULATION For Monte arlo simulation, we onstrut a yle of size N with a player at eah site. Initial s i s are randomly hosen between and equally probably. Then, aording to the B proess, we randomly selet a player (say, k) for death and hoose another player i with probability p ik in Eq. (4). One Monte arlo step onsists of N trials to update the onfiguration {s i }. In addition, we introdue mutation with small probability µ so that the system has a unique stationary distribution over onfigurations {s i }. The quantity of interest is ooperator abundane x, the average frequeny of ooperators in the steady state. For eah data point in a sample, we run the Monte arlo simulation for 6 Monte arlo steps, and the time average of x is taken for the last Monte arlo steps, at whih the simulation has already reahed a steady state. The total number of samples amounts to 4.

5 5.5 α= / 5 β=....5 th.5... /[ζ(α)] /[ζ 64 (α)] /α Numerial β= / 5 α=....5 th.5. /α. / [ζ(β)]. / [ζ 64 (β)] Numerial FIG.. (olor online) Threshold estimation in ase of nearest-neighbor ompetition (β ). The parameters for Monte arlo simulation are the total number of sites N = 8, seletion strength ω =., and mutation rate µ =. ooperator abundane x as a funtion of for eah different α. The vertial dotted line means = /, and the horizontal shaded area represents 95 ±., the error-bar range of x ( = /) for α. The error-bars show [ min, max] for different values of α. The solid line depits our analyti threshold in Eq. (5) for N = 8, and the dotted line shows the limit of N..6.5 α=. β=α....5 th.5... ζ(α) / [ζ (α)] ζ 64 (α) / [ζ 64 (α)] /α Numerial FIG. 4. (olor online) Threshold estimation for α = β. The simulation parameters are the same as in Fig.. ooperator abundane x as a funtion of for eah different α. The vertial dotted line means = /, and the horizontal shaded area represents 95 ±., the error-bar range of x ( = /) for α. The error-bars show [ min, max] for different values of α. The solid line depits our analyti threshold in Eq. (6) for N = 8, and the dotted line shows the limit of N. FIG. 5. (olor online) Threshold estimation for α =. The simulation parameters are the same as in Fig.. ooperator abundane x as a funtion of for eah different β. The vertial dotted line means = /, and the horizontal shaded area represents 95 ±., the error-bar range of x ( = /) for β. The error-bars show [ min, max] for different values of β. The solid line depits our onjetured threshold in Eq. (8) for N = 8, and the dotted line shows the limit of N..5. β= / 5 α=β....5 th.5... ζ(β) / [ζ(β) ζ(β)] ζ 64 (β) / [ζ 64 (β) ζ 64 (β)] / [ζ 64 (β)] Numerial /α FIG. 6. (olor online) Threshold estimation for α = β. The simulation parameters are the same as in Fig.. ooperator abundane x as a funtion of for eah different β. The vertial dotted line means = /, and the horizontal shaded area represents 95 ±., the error-bar range of x ( = /) for β. The error-bars show [ min, max] for different values of β. The solid line depits our onjetured threshold in Eq. (7) for N = 8, and the dotted line shows the limit of N. For omparison, we have also plotted /[ζ 64(β)] as in Fig. 5, whih deviates from the numerial data. A. Weak seletion (w =.) Noting that most of the analyti results have been obtained in the weak-seletion limit, we have to hek this limit first and proeed to stronger seletion strengths thereafter. Let us begin by setting β. If α also goes to infinity, the threshold at whih x ( th ) = / is analytially given as th (, ) = / in the ωnlimit []. However, this limit annot be taken exatly in the Monte arlo simulation, and µ annot be infinitesimally small either. For = /, we atually observe x = 95 ±.. We regard this value as a referene point to estimate th (α, ), assuming that it takes into aount all the orretions due to the differene from the ωn-limit as well as the finiteness of µ. The proedure to estimate th (α, ) now goes as follows: For given α, we alulate x as a funtion of, together with the standard error from statistially independent samples. As a lower bound of th (α, ), we pik up min, defined as below whih all the error bars of x () lie above 95 ±.. Likewise, the upper bound of th (α, ) is given by max, defined as above whih all the error bars of x () lie below 95 ±. [Fig. ]. The numerial estimate of th (α, ) is thus represented by an interval [ min, max ] as shown in Fig.. The agreement with Eq. (5) is ompelling. The above proedure an be applied to the ase of α = β as well [Fig. 4]. Here, the estimation is more diffiult beause the slope of x beomes steeper as α dereases. Nevertheless, Fig. 4 shows that our estimates are onsistent with the analyti solution [Eq. (6)]. Let us move on to hek whether the onjeture of Eq. (7) orretly predits the threshold behavior even when no analyti proof is available. One speifi example that we an test is an extreme ase of α, where the onjeture redues to Eq. (8). omparing Fig. 5 with Fig., we see that α and β do not play the same role in determining the ooperator abundane. Nevertheless, Fig. 5 substantiates the onjetured symmetry between α and β in the threshold behavior. To make both α and β finite yet unequal, we onsider another

6 6. α= / β=..5.8 th.5. /β. α=. α=β α=β FIG. 7. (olor online) Threshold estimation for w =. The other simulation parameters are the same as in Fig.. ooperator abundane x as a funtion of for eah different α, while β. The vertial dotted line means = /, and the horizontal shaded area represents.9±.45, the error-bar range of x ( = /) for α. The error-bars show [ min, max] for different values of β. The lines depit our onjetured thresholds in Eq. (7). - - α= / β=α th.5.. /β. α= α=β FIG. 8. (olor online) Threshold estimation for w = 5. The other simulation parameters are the same as in Fig.. ooperator abundane x as a funtion of for eah different α = β. The vertial dotted line means = /, and the horizontal shaded area represents.8 ±.7, the errorbar range of x ( = /) for α. Note the logarithmi sale on the vertial axis. The error-bars show [ min, max] for different values of β. The lines depit our onjetured thresholds in Eq. (7). ase of α = β [Fig. 6]. Again, our numerial results support the onjeture in Eq. (7). The overall behavior might look similar to the previous ase of α =, but a loser look shows that our numerial estimates are sharp enough to distinguish the differene between them [Fig. 6]. B. Stronger seletion (w = and w = 5) The onjetured formula [Eq. (7)] works even beyond the weak-seletion limit. Our numerial estimation proedure hinges on the fat that we an still take = / as the threshold in a double limit of α and β for arbitrary seletion strength []. In this limit, our numerial alulation gives =.9±.45 at = /, provided that we have set w = [Fig. 7]. As we have done above, we will take this value as a referene point to loate the threshold in other ombinations of α and β for whih one an suitably define an extrapolation to α and β : Let us take a look at the results shown in Fig. 7. Here, we demonstrate three ases, α =, α = β, and α = β. Note that the limit an be approahed by taking β for all these ases, so that the abundane levels may be ompared with the referene value in the double limit. Although none of the ases have been solved analytially, the threshold behavior is indeed aptured by Eq. (7) with high preision. As w inreases, the quality of fit deteriorates, however. For w = 5, for example, the referene value is lowered to =.8 ±.7 [Fig. 8]. It is a tiny value, and the slope of x () is steep, whih makes the estimate more hallenging than the previous weakerseletion ases. It is not surprising that deviations from the onjeture beome visible [Fig. 8], but the overall agreement is still remarkable. V. ONLUING REMARKS To summarize, we have studied the P game on a yle, where the probabilities for two players at distane r to play the game and to ompete for reprodution deay algebraially as r α and r β, respetively. When the benefit of ooperation is fixed as unity, there exists a threshold ost th (α, β) below whih the population beomes ooperative. Based on analytially tratable ases [Eqs. (5) and (6)], we have onjetured its funtional form as given in Eq. (7). The apparent symmetry between α and β in Eq. (7) is nontrivial as one sees that Fig. learly differs from 5. Although we are unable to prove our onjeture at the moment, the striking agreement with numerial results suggests that the exat result of (α, α) an be generalized in a simple form, at least in this partiular long-ranged interation model on a yle. The threshold osts in our model do not seem to depend on the seletion strength ω strongly. For the nearest neighbor ompetitions (β ), this independene an be understood easily sine the threshold ost is obtained from the domain boundary dynamis as disussed in III A. For finite β, our onjeture relies on the analyti solution of weak seletion limit. However, the threshold osts are almost independent of seletion strength up to ω 5. Further studies on the robustness of the weak seletion limit as well as the threshold osts for general population strutures are needed. AKNOWLEGMENTS S.K.B. was supported by Basi Siene Researh Program through the National Researh Foundation of Korea (NRF) funded by the Ministry of Siene, IT and Future Planning (NRF-7RAAA548). H..J. was supported by Basi Siene Researh Program through the National Researh Foundation of Korea (NRF) funded by the Ministry of Eduation (NRF- 8RAA86).

7 7 [] M. A. Nowak, Siene 4, 56 (6). [] M. A. Nowak,. E. Tarnita, and E. O. Wilson, Nature 466, 57 (); P. Abbot, J. Abe, J. Alok, S. Alizon, J. A. Alpedrinha, M. Andersson, J.-B. Andre, M. Van Baalen, F. Balloux, S. Balshine, et al., ibid. 47, E (); J. A. Marshall, Trends Eol. Evol. 6, 5 (). [] J. A. Flether and M. oebeli, Pro. Royal So. B 76, (9); S. Park and H.-. Jeong, J. Korean Phys. So. 6, (). [4] F. ébarre,. Hauert, and M. oebeli, Nat. ommun. 5, 49 (4). [5] L.. Landau and E. M. Lifshitz, Statistial Physis, Part (Pergamon Press, Oxford, ). [6]. Thouless, Phys. Rev. 87, 7 (969); M. E. Fisher, S.-k. Ma, and B. Nikel, Phys. Rev. Lett. 9, 97 (97); E. Luijten, in omputer Simulation Studies in ondensed-matter Physis XII (Springer, ) pp [7] H. Ohtsuki,. Hauert, E. Lieberman, and M. A. Nowak, Nature 44, 5 (6). [8] B. Allen, G. Lippner, Y.-T. hen, B. Fotouhi, N. Momeni, S.-T. Yau, and M. A. Nowak, Nature 544, 7 (7). [9] J. Wakeley, oalesent Theory: An Introdution (Roberts & o., Green Village, olorado, 8). [] G. H. Hardy and E. M. Wright, An Introdution to the Theory of Numbers, 5th ed. (Oxford Univ. Press, 979) p. 54. [] H.-. Jeong, S.-Y. Oh, B. Allen, and M. A. Nowak, J. Theor. Biol. 56, (4).