10/3/2018. Our main example: SimFlock. Breeding animals Hens & Cocks

Transcription

1 What is simulation? Monte Carlo Simulation I Anders Ringgaard Kristensen Simulation is an attempt to model a real world system in order to: Obtain a better understanding of the system (including interactions) Physiological models Herd models Study the effects of various (complex) decision strategies Herd models Slide 2 Different kinds of simulation Randomness (cf. Chapter 4.3 in textbook) Deterministic forget it in herd management! All calculations based on average values Same input Same output System comprehension Differential equations, physiology (NorFor). Probabilistic models All calculations based on distributions Same input Same output System comprehension, decision strategies Markov chains (earlier this course) Stochastic (Monte Carlo) models All random events are simulated by random number generation Same input Different output i.e. we need many replications System comprehension, decision strategies Herd constraints, complexity Different kinds of simulation Hierarchy (levels) Mechanistic: A system is modeled by its elements (sub-systems) A herd is modeled by its individual animals and their interactions. Empirical Only one level modeled Output direcly modeled from output Time Dynamic Static Slide 3 Slide 4 Our main example: SimFlock SimFlock: An object oriented model A stochastic, mechanistic, dynamic simulation model of a scavenging chicken production system. Smallholder production most often women. A very direct modeling of the real system Breeding animals Hens & Cocks Eggs Chicks Growers Infertile Dead Household consumption Slide 5 Slide 6 Pullets Cockerels Market

2 User interface visible objects Other (Danish) herd simulation models All birds and eggs present in the flock shown. States of the birds can be investigated Demo SimHerd (dairy herds) Jan Tind Sørensen Søren Østergaard Anne Braad Kudahl Jehan Ettema Slide 8 The TV Show once again Earlier we solved the decision problem by use of Bayesian networks and/or decision graphs. Are there any other methods we could apply? Experiment many replications needed Simulation create a simulation model How to model the problem Identify the variables: True placement, True {, 2, 3} First choice, Choice {, 2, 3} Door opened, Opened {, 2, 3} Second choice, Choice 2 {Keep, Change} Reward, Gain {, } Define a decision strategy (2 options): Choice2 = Keep Choice2 = Change Slide What is needed for simulation Simulation procedure: Use dice Coin: Probabilities A random number generator, e.g. A coin A dice A computer,8,6 Dice: Probabilities,2,8,6,8,6 Computer: Density 2 Host must place the reward behind an arbitrarily selected door: Roll the dice: or 2: Door 3 or 4: Door 2 5 or 6: Door 3 Value of variable True determined as, 2 or 3! Participant must choose a door at random Roll the dice: or 2: Door 3 or 4: Door 2 5 or 6: Door 3 Value of variable Choice determined as, 2 or 3! ,6,8 Slide 2 2

3 Simulation procedure II Check whether True = Choice If yes (two options): Roll the dice (or toss a coin), 2 or 3: Open the lowest door number i True 4, 5 or 6: Open the highest door number i True If no (only option): Open door i True and i Choice Value of Opened determined Simulation procedure III Value of Choice 2 determined in accordance with the decision strategy Define new variable Final guess {, 2, 3} If Choice 2 = Keep: Final guess = Choice If Choice 2 = Change: Final guess = i, where i Choice and i Opened Slide 3 Slide 4 Simulation procedure IV Check whether Final guess = True If yes: Gain = If no: Gain = Simulation completed! Evaluation of strategies Define the strategy as Choice 2 = Keep Repeat the simulation many times (e.g. ) and calculate the average gain under the strategy. Define the strategy as Choice 2 = Change Repeat the simulation many times (e.g. ) and calculate the average gain under the strategy. Compare the average gain under the two strategies and select the best. Slide 5 Slide 6 Simulation procedure: Use computer Exactly as before, except: Instead of rolling the dice, we let the computer draw a random number r. Converting to variable value for True is done as follows: If r <.33333: Door If < r <.66667: Door 2 If r >.66667: Door 3 (Similar for other variable values) Let s try! Formalizing the simulation We have (refer to Chapter 4.2 of the textbook) A decision rule Θ: Very simple, just Keep or Change A set of parameters Φ = (Φ, Φ s. ) State of nature Φ we have 4, p t, p t2, p c, p c2 : p t = P(True = ), p t2 = P(True = 2), but P(True = 3) = -p t -p t2 p c = P(Ch= ), p c2 = P(Ch = 2), but P(Ch = 3) = -p c -p c2 State variables, describing the system during simulation: Φ s. : True, Choice, Opened, Gain An output variable Ω: Gain. Notice that Ω Φ s. Model input is (Φ, Θ). Slide 7 Slide 8 3

4 Purpose of simulation The integral expression The purpose of simulation usually is to calculate the expected utility E(U(Θ, Φ)) under a certain decision rule, Θ. In the example it is the expected gain under a specified decision rule (Keep or Change) This may be regarded as solving the numerical integration problem: Horrible that s why we choose to build a simulation model instead! Let us take a look at the elements: Φ = (p t, p t2, p c, p c2, True,Choice, Opened, Gain) is a complete set of parameters. A value could for instance be φ = (/3, /3, /3, /3, 2,, 3, ). Notice that we can easily specify the utility for a given outcome: U(Θ, Φ = φ) = Gain If we wanted to solve the integral directly we should furthermore be able to calculate the combined probability p(φ = φ) for any legal outcome φ of Φ. Almost impossible! Slide 9 Slide 2 The numerical approximation Simulation: Generate (through simulation) e.g. k outcomes φ, φ 2,, φ k under a chosen decision rule Θ: φ = (/3, /3, /3, /3, 2,, 3, ), U(Θ, φ ) = φ 2 = (/3, /3, /3, /3, 3, 3,, ), U(Θ, φ 2 ) = φ k = (/3, /3, /3, /3,, 3, 2, ), U(Θ, φ k ) = Approximate the integral with the average utility: State of nature, I In the example the state of nature has been regarded as fixed and known Φ = (/3, /3, /3, /3). Assume that the host has a favorite door, e.g. door 3. He places the reward behind Door 3 with probability.8 and behind each of the others with probability.. State of nature under those circumstances would be Φ = (.,., /3, /3) if the participant doesn t have a favorite door. Does it change anything? Let s try! Slide 2 Slide 22 State of nature, II Assume further that also the participant has a favorite door, e.g. door 3. He also selects (first choice) Door 3 with probability.8 and each of the others with probability.. State of nature under those circumstances would be Φ = (.,.,.,.) when both have Door 3 as their favorite door. Does it change anything? Let s try! State of nature, III In general, the optimal decision rule as well as the expected result depend on the state of nature. What is the state of nature in a livestock simulation model: Average growth rate Herd mortality rate Average milk yield Is the true state of nature known (with certainty)? Does it matter? Slide 23 Slide 24 4

5 State of nature, livestock models Simple example, I In livestock models we never know the true state of nature. We need to represent the uncertainty of the state of nature. We typically have some ideas a belief in the true values. The belief may be represented as a statistical distribution. Slide 25 Slide 26 Simple example, II Simple example, III Evaluation of expected value of production Deterministic: Stochastic, known state of nature Simulate replications with µ = Average: 435,27; Std. Dev. 8.3 Stochastic, unknown state of nature: Draw random values of µ from N(, ) For each µ, simulate replications Average: 43, Std. Dev Slide 27 Slide 28 Frequency,3, Value of production Know n state of nature Unknow n state of nature Representation of uncertainty of SON Essential, but Most simulation models ignore it Adds uncertainty to the simulation which, therefore, should have an extra step where state-of-natures are drawn at random. Simulation procedure Select a number of alternative decision rules Θ to be tested. Draw n states of nature φ, φ 2,, φ n from the underlying distribution of state of nature p (Φ =φ ) For each decision rule: For each state of nature, i: Run the simulation model m times. Calculate the average result U i over the m simulation results. Calculate the average value of U, U 2,, U n Select the best performing decision rule. Slide 29 Slide 3 5

6 Main problem It is difficult to specify the distribution of the state of nature. For a systematic description of the approach used in the SimFlock model, reference is made to Kristensen & Pedersen (23) link at the homepage. Basic principle: Each parameter of the state of nature is specified through a distribution instead of a value. Such a distribution is called a hyper distribution. The parameters of a hyper distribution are called hyper parameters. Estimated from production data from 3 flocks in Zimbabwe. Easy, if parameters are independent Difficult if they interact Monday we shall take a closer look! Slide 3 6