Evolutionary Game Theory and Frequency Dependent Selection

Similar documents
Evolutionary Game Theory

Complexity in social dynamics : from the. micro to the macro. Lecture 4. Franco Bagnoli. Lecture 4. Namur 7-18/4/2008

Understanding and Solving Societal Problems with Modeling and Simulation

Game Theory -- Lecture 4. Patrick Loiseau EURECOM Fall 2016

Computational Evolutionary Game Theory and why I m never using PowerPoint for another presentation involving maths ever again

Living in groups 1. What are three costs and three benefits of living in groups?

Communities and Populations

Evolution of cooperation. Martin Nowak, Harvard University

Graph topology and the evolution of cooperation

Brief history of The Prisoner s Dilemma (From Harman s The Price of Altruism)

Alana Schick , ISCI 330 Apr. 12, The Evolution of Cooperation: Putting gtheory to the Test

Mohammad Hossein Manshaei 1394

Evolution of Cooperation in the Snowdrift Game with Incomplete Information and Heterogeneous Population

MATCHING STRUCTURE AND THE EVOLUTION OF COOPERATION IN THE PRISONER S DILEMMA

Problems on Evolutionary dynamics

Evolution & Learning in Games

Institut für Höhere Studien (IHS), Wien Institute for Advanced Studies, Vienna

ALTRUISM OR JUST SHOWING OFF?

Evolutionary Bargaining Strategies

Prisoner s Dilemma. Veronica Ciocanel. February 25, 2013

Université Libre de Bruxelles

EVOLUTIONARY STABILITY FOR TWO-STAGE HAWK-DOVE GAMES

N-Player Prisoner s Dilemma

Cooperation Achieved by Migration and Evolution in a Multilevel Selection Context

Belief-based Learning

Kalle Parvinen. Department of Mathematics FIN University of Turku, Finland

Costly Signals and Cooperation

On the evolution of reciprocal cooperation

Strategic Games: Social Optima and Nash Equilibria

First Prev Next Last Go Back Full Screen Close Quit. Game Theory. Giorgio Fagiolo

Game Theory. Summary: History:

Other-Regarding Preferences: Theory and Evidence

Stability in negotiation games and the emergence of cooperation

CS 798: Multiagent Systems

VII. Cooperation & Competition

April 29, 2010 CHAPTER 13: EVOLUTIONARY EQUILIBRIUM

Drastic growth effect explains sympatric cannibalistic polymorphism

Iterated Strict Dominance in Pure Strategies

Cooperation. Main points for today. How can altruism evolve? Group living vs. cooperation. Sociality-nocooperation. and cooperationno-sociality

George Price was the biologist who derived this equation.

An Evolutionary Psychology Examination of the 'Tragedy of the Commons' Simon Jonas Hadlich Psychology Dr. Eddy de Bruijn March 8, 2011

Non-zero-sum Game and Nash Equilibarium

Hamilton s Rule Applied to Reciprocal Altruism

Basic Game Theory. Kate Larson. January 7, University of Waterloo. Kate Larson. What is Game Theory? Normal Form Games. Computing Equilibria

The coevolution of recognition and social behavior

Evolution of motivations and behavioral responses! Integrating the proximate and ultimate causes of behavior!

Game Theory and Evolution

Evolutionary game theory different from economic game theory

Introduction to Game Theory. Outline. Topics. Recall how we model rationality. Notes. Notes. Notes. Notes. Tyler Moore.

Game interactions and dynamics on networked populations

Perforce there perished many a stock, unable: By propagation to forge a progeny.

Simpson s Paradox Can Emerge from the N-Player Prisoner s Dilemma: Implications for the Evolution of Altruistic Behavior

Evolution of Cooperation: Combining Kin Selection and Reciprocal Altruism into Matrix Games with Social Dilemmas

The Evolution of Cooperation under Cheap Pseudonyms

Sociobiological Approaches. What We Will Cover in This Section. Overview. Overview Evolutionary Theory Sociobiology Summary

Cooperation Behaviors selected that benefit a recipient. Either altruistic ( -,+) or mutualistic (+,+). Can occur across species.

The Cross Entropy Method for the N-Persons Iterated Prisoner s Dilemma

Outline for today. Stat155 Game Theory Lecture 16: Evolutionary game theory. Evolutionarily stable strategies. Nash equilibrium.

Policing and group cohesion when resources vary

EVOLUTIONARILY STABLE STRATEGIES AND GROUP VERSUS INDIVIDUAL SELECTION

Quantum Games. Quantum Strategies in Classical Games. Presented by Yaniv Carmeli

Chapter 7. Evolutionary Game Theory

Mathematical and statistical models in evolutionary game theory

Darwinian Evolution of Cooperation via Punishment in the Public Goods Game

6. Evolu)on, Co- evolu)on (and Ar)ficial Life) Part 1

Evolution of Social Behavior: Kin Selection & Sociobiology. Goal: Why does altruism exist in nature?

Individualist and Multi-level Perspectives on Selection in Structured Populations

The Continuous Prisoner s Dilemma and the Evolution of Cooperation through Reciprocal Altruism with Variable Investment

Chapter 7. Evolutionary Game Theory

Complex networks and evolutionary games

EVOLUTIONARY GAMES WITH GROUP SELECTION

A (Brief) Introduction to Game Theory

arxiv: v2 [q-bio.pe] 18 Dec 2007

UC Berkeley Haas School of Business Game Theory (EMBA 296 & EWMBA 211) Summer 2016

Emergence of Cooperation and Evolutionary Stability in Finite Populations

Some Thought-ettes on Artificial Agent Modeling and Its Uses

Refinements - change set of equilibria to find "better" set of equilibria by eliminating some that are less plausible

Reciprocity and Trust under an Evolutionary Context

Two Views of Adaptation

Game Theory, Population Dynamics, Social Aggregation. Daniele Vilone (CSDC - Firenze) Namur

Other Equilibrium Notions

ABSTRACT: Dissolving the evolutionary puzzle of human cooperation.

:: Slide 1 :: :: Slide 2 :: :: Slide 3 :: :: Slide 3 continued :: :: Slide 4 :: :: Slide 5 ::

Game Theory. Professor Peter Cramton Economics 300

BELIEFS & EVOLUTIONARY GAME THEORY

Selfishness vs Altruism vs Balance

Biology as Information Dynamics

Evolutionary Game Theory

Collective Evolution of Turn-taking Norm in Dispersion Games

The Paradox of Cooperation Benets

Satisfaction Equilibrium: Achieving Cooperation in Incomplete Information Games

Evolutionary computation

The Stability for Tit-for-Tat

Microevolution Changing Allele Frequencies

Extortion and Evolution in the Iterated Prisoner s Dilemma

Supplementary Information

Quantum Probability in Cognition. Ryan Weiss 11/28/2018

Anthro 101: Human Biological Evolution. Lecture 11: Cooperation, Intelligence, Communication, Culture, & Human Behavior. Prof.

Bounded Rationality Lecture 2. Full (Substantive, Economic) Rationality

Transcription:

Evolutionary Game Theory and Frequency Dependent Selection 1

Game Theory A major component of economics Given a set of rules, predict how would rational beings behave in an interaction Who is in the game? What do they know? What are their options? What are their motives? What are the payoffs?

Biological Context How would evolved beings behave in an interaction Replicator dynamics is added to the model Just a way to calculate the fitness of a strategy Should they fight for a resource? Should they help some other individual? Should they continue investing resources in hopes of a payout? 3

Contextual Example: Hawk-Dove Game Members of the population want a resource with value V Hawk and Dove are names of two possible strategies Hawk: Always fight to get everything 0.5 chance of success Fighting costs energy (v) Dove: Share or run Opponent Player Hawk Hawk V C Dove 0 Dove V V 4

Calculating Payoffs Maximize the payoff of the average encounter h: Frequency of hawks (1-h): Frequency of doves F h, F d : Relative fitness values F h =h ( V C )+(1 h)v F d =h(0)+(1 h)( 1 Opponent Hawk Dove ) Player Hawk V C Dove 0 V V 5

Equilibrium Frequencies Equilize relative fitnesses and solve for h F h =h ( V C )+(1 h)v =F d =h(0)+(1 h)( 1 ) h= V C Yes this is a stable equilibrium since no strategy is inherently better than the other 6

Nash Equilibrium No individual player can benefit from changing tactics. Tragedy of Commons: Why we can't have nice things (e.g. world peace) If V>C: Hawks can invade a dove population and take over Doves can't survive in a hawk population Opponent Player Hawk Hawk V C Dove 0 Dove V V 7

A man who doesn't spend time with his family can never be a real man. 1 1 8 8

Relatives in Hawk-Dove Hawk against a family member is bad Hawk against brother V C + V C 4 Dove against brother V + V 4 Net loss for the hawk 3C 4 Does it worth remembering? p familiarencounter ( 3C 4 M ) (1 p familiarencounter ) M Hamilton will come in a moment. Not really needed here since there is no cost to behaving altruistically in this game This is a toy example, I hoped to expalin this in words. M is the cost of remembering who your brother is per encounter. It represents the energy cost of having high cognitive power Hence in a large dispersed population that you are unlikely to meet your family members there is only the cost 9

Some considerations It is easy to think of alternative strategies But they have their own costs 10

Prisoner's dilemma Opponent Player Cooperate Defect Cooperate b-c -c Defect b 0 In isolation defectors always invade F coop = p coop (b c)+(1 p coop )( c)= p coop b c F defect = p coop (b)+(1 p coop )(0)= p coop b Iteration promotes cooperation ( tit for tat ) Cognitive abilitiy Population size Note that even with iteration, defection would be a stable strategy. But as long as a wide variety of strategies are present, those who are forgiving have an advantage as shown in Axelrod's tournaments. 11

Hamilton's Rule rb>c r: relatedness Opponent Player Cooperate Defect Cooperate b-c -c Defect b 0 B: benefit to the family member C: cost to individual What happens when we add relatives? Direct alturism towards kin F coop = p coop (b c+r(b c))+(1 p coop )( c+br)= p(b rc) c+br F defect = p coop (b+rc)+(1 p coop )(0+0 r)= p(b cr) b (b rc) c+br> p (b cr) br>c 1

Limitations of game theory High rationality requirement Games might lack a solution Modeling becomes unmanagable with complex problems Hard to predict all possible strategies and their mechanisms for evolving Payouts are not clear 13

In the wilds Connection of behavior to genes is not trivial Artificial selection for aggressive behavior in drosophila (Dierick and Greenspan 006) Look at gene expression to find differentially expressed genes in brain Not sequencing but still something... Induce mutations in mice to see what happens. (Brown et al. 1997) Fosb gene was found to be related to nurturing behavior Sequencing would give a direct gene to phenotype link while differential expression is not that helpfull. Just something I wanted to mention 14

Conclusion Behavioral characteristics of replicators are under evolutionary pressure Depending on the population structure this can lead to altruistic strategies and cooperation Though theoretically useful, it is often hard to characterize the exact parameters that effect fitness and phenotype. 15

Side Note Darwinbots: A nice little game to play with behavioral selection Code your bots, have them replicate and mutate Set costs for having more genes This is a nice concept. Physically identical bots fight over resources and reproduce based on their programming and random mutations are introduced to the code with every replication. It is even possible to create cooperating bots solely from an empty script with random mutations 16

References How to Find Hamilton s Rule. The Cultural Niche. N.p., n.d. Web. 17 Nov. 014. Alexander, J. McKenzie. Evolutionary Game Theory. The Stanford Encyclopedia of Philosophy. Ed. Edward N. Zalta. Fall 009. N.p., 009. Stanford Encyclopedia of Philosophy. Web. 17 Nov. 014. Brown, Jennifer R et al. A Defect in Nurturing in Mice Lacking the Immediate Early Gene fosb. Cell 86. (1996): 97 309. ScienceDirect. Web. 17 Nov. 014. Dierick, Herman A., and Ralph J. Greenspan. Molecular Analysis of Flies Selected for Aggressive Behavior. Nature Genetics 38.9 (006): 103 1031. www.nature.com. Web. 17 Nov. 014. 17