Macroscopic quasi-stationary distribution and microscopic particle systems

Similar documents
SIMILAR MARKOV CHAINS

Convergence exponentielle uniforme vers la distribution quasi-stationnaire de processus de Markov absorbés

Quasi-stationary distributions

Quasi stationary distributions and Fleming Viot Processes

Problems on Evolutionary dynamics

Convergence exponentielle uniforme vers la distribution quasi-stationnaire en dynamique des populations

The SIS and SIR stochastic epidemic models revisited

Elementary Applications of Probability Theory

arxiv: v1 [math.pr] 29 Sep 2016

Markov Chains CK eqns Classes Hitting times Rec./trans. Strong Markov Stat. distr. Reversibility * Markov Chains

Irregular Birth-Death process: stationarity and quasi-stationarity

STOCHASTIC PROCESSES Basic notions

MATH 56A SPRING 2008 STOCHASTIC PROCESSES 65

Hydrodynamics of the N-BBM process

The fate of beneficial mutations in a range expansion

Quasi-Stationary Distributions in Linear Birth and Death Processes

Statistics 150: Spring 2007

Example: physical systems. If the state space. Example: speech recognition. Context can be. Example: epidemics. Suppose each infected

WXML Final Report: Chinese Restaurant Process

Markov Chains. X(t) is a Markov Process if, for arbitrary times t 1 < t 2 <... < t k < t k+1. If X(t) is discrete-valued. If X(t) is continuous-valued

Markov processes and queueing networks

process on the hierarchical group

A NOTE ON THE ASYMPTOTIC BEHAVIOUR OF A PERIODIC MULTITYPE GALTON-WATSON BRANCHING PROCESS. M. González, R. Martínez, M. Mota

Mouvement brownien branchant avec sélection

The genealogy of branching Brownian motion with absorption. by Jason Schweinsberg University of California at San Diego

Quasi-stationary distributions for discrete-state models

Critical branching Brownian motion with absorption. by Jason Schweinsberg University of California at San Diego

Yaglom-type limit theorems for branching Brownian motion with absorption. by Jason Schweinsberg University of California San Diego

Queueing Networks and Insensitivity

1 Types of stochastic models

Intertwining of Markov processes

Introduction LECTURE 1

Minimal quasi-stationary distribution approximation for a birth and death process

Classification of Countable State Markov Chains

Reaction-Diffusion Equations In Narrow Tubes and Wave Front P

Lectures on Markov Chains

Capacitary inequalities in discrete setting and application to metastable Markov chains. André Schlichting

QUASI-STATIONARITY FOR A NON-CONSERVATIVE EVOLUTION SEMIGROUP

Quasi-stationary distributions

The Λ-Fleming-Viot process and a connection with Wright-Fisher diffusion. Bob Griffiths University of Oxford

A review of Continuous Time MC STA 624, Spring 2015


A. Bovier () Branching Brownian motion: extremal process and ergodic theorems

9.2 Branching random walk and branching Brownian motions

STAT STOCHASTIC PROCESSES. Contents

Finite-time Blowup of Semilinear PDEs via the Feynman-Kac Representation. CENTRO DE INVESTIGACIÓN EN MATEMÁTICAS GUANAJUATO, MEXICO

Stochastic modelling of epidemic spread

14 Branching processes

Markov Chains, Stochastic Processes, and Matrix Decompositions

Lecture Notes 7 Random Processes. Markov Processes Markov Chains. Random Processes

Stochastic processes. MAS275 Probability Modelling. Introduction and Markov chains. Continuous time. Markov property

Stochastic processes and Markov chains (part II)

2 Discrete-Time Markov Chains

Discrete time Markov chains. Discrete Time Markov Chains, Definition and classification. Probability axioms and first results

25.1 Ergodicity and Metric Transitivity

Non-homogeneous random walks on a semi-infinite strip

Birth and Death Processes. Birth and Death Processes. Linear Growth with Immigration. Limiting Behaviour for Birth and Death Processes

2. Transience and Recurrence

CS145: Probability & Computing Lecture 18: Discrete Markov Chains, Equilibrium Distributions

Figure 10.1: Recording when the event E occurs

arxiv: v2 [math.na] 20 Dec 2016

Stochastic modelling of epidemic spread

Introduction to Random Diffusions

CONTINUOUS STATE BRANCHING PROCESSES

Markov Processes Hamid R. Rabiee

Other properties of M M 1

Modelling Complex Queuing Situations with Markov Processes

COMPETITIVE OR WEAK COOPERATIVE STOCHASTIC LOTKA-VOLTERRA SYSTEMS CONDITIONED ON NON-EXTINCTION. Université de Toulouse

3. The Voter Model. David Aldous. June 20, 2012

Local vs. Nonlocal Diffusions A Tale of Two Laplacians

An Introduction to Stochastic Modeling

8. Statistical Equilibrium and Classification of States: Discrete Time Markov Chains

Homework 3 posted, due Tuesday, November 29.

URN MODELS: the Ewens Sampling Lemma

Table of Contents [ntc]

Markov Chains on Countable State Space

1.1 Review of Probability Theory

TMA4265 Stochastic processes ST2101 Stochastic simulation and modelling

Computable bounds for the decay parameter of a birth-death process

Lecture 7: Simulation of Markov Processes. Pasi Lassila Department of Communications and Networking

A NOTE ON QUASI-STATIONARY DISTRIBUTIONS OF BIRTH-DEATH PROCESSES AND THE SIS LOGISTIC EPIDEMIC

Travelling-waves for the FKPP equation via probabilistic arguments

Path integrals for classical Markov processes

Readings: Finish Section 5.2

F n = F n 1 + F n 2. F(z) = n= z z 2. (A.3)

Fleming-Viot processes: two explicit examples

Stochastic Processes. Theory for Applications. Robert G. Gallager CAMBRIDGE UNIVERSITY PRESS

Population growth: Galton-Watson process. Population growth: Galton-Watson process. A simple branching process. A simple branching process

EXTINCTION TIMES FOR A GENERAL BIRTH, DEATH AND CATASTROPHE PROCESS

DISCRETE STOCHASTIC PROCESSES Draft of 2nd Edition

Recent results on branching Brownian motion on the positive real axis. Pascal Maillard (Université Paris-Sud (soon Paris-Saclay))

Some mathematical models from population genetics

The strictly 1/2-stable example

Sharpness of second moment criteria for branching and tree-indexed processes

STA 624 Practice Exam 2 Applied Stochastic Processes Spring, 2008

Lecture 11: Introduction to Markov Chains. Copyright G. Caire (Sample Lectures) 321

Lecture 7. µ(x)f(x). When µ is a probability measure, we say µ is a stationary distribution.

Continuous Time Markov Chains

4 Branching Processes

Discrete solid-on-solid models

Transcription:

Macroscopic quasi-stationary distribution and microscopic particle systems Matthieu Jonckheere, UBA-CONICET, BCAM visiting fellow Coauthors: A. Asselah, P. Ferrari, P. Groisman, J. Martinez, S. Saglietti. BCAM, May 2016

Outline Introduction to quasi-stationary distributions: Macroscopic model Particle systems : Microscopic model Selection principle and traveling waves

Outline Introduction to quasi-stationary distributions: Macroscopic model Particle systems : Microscopic model Selection principle and traveling waves

Outline Introduction to quasi-stationary distributions: Macroscopic model Particle systems : Microscopic model Selection principle and traveling waves

Denying eternity Most phenomena do not last for ever. However most of them might reach some kind of equilibrium before vanishing. What are we observing when considering a macroscopic stochastic evolution (in biology, physics, populations models, telecommunications) that has not vanished for (very) large times?

Denying eternity Most phenomena do not last for ever. However most of them might reach some kind of equilibrium before vanishing. What are we observing when considering a macroscopic stochastic evolution (in biology, physics, populations models, telecommunications) that has not vanished for (very) large times?

Denying eternity Most phenomena do not last for ever. However most of them might reach some kind of equilibrium before vanishing. What are we observing when considering a macroscopic stochastic evolution (in biology, physics, populations models, telecommunications) that has not vanished for (very) large times?

Denying eternity Most phenomena do not last for ever. However most of them might reach some kind of equilibrium before vanishing. What are we observing when considering a macroscopic stochastic evolution (in biology, physics, populations models, telecommunications) that has not vanished for (very) large times? TRANSIENT

Denying eternity Most phenomena do not last for ever. However most of them might reach some kind of equilibrium before vanishing. What are we observing when considering a macroscopic stochastic evolution (in biology, physics, populations models, telecommunications) that has not vanished for (very) large times? TRANSIENT STATIONARY

Denying eternity Most phenomena do not last for ever. However most of them might reach some kind of equilibrium before vanishing. What are we observing when considering a macroscopic stochastic evolution (in biology, physics, populations models, telecommunications) that has not vanished for (very) large times? TRANSIENT QUASI-STATIONARY STATIONARY

2 types of quasi-stationarity If the stochastic evolution has a strong drift towards extinction, this quasi-equilibrium might correspond to a large deviation event. E.g. observing a player winning at a casino for hours, traffic jam more than 10 hours,... If it tends to vanish more slowly, (spend large time in a subset of the state space before vanishing) the quasi-equilibrium corresponds to a metastable state. E.g. a bottle of cold beer just before freezing. In the study of population dynamics, this phenomenon is coined as mortality plateau.

2 types of quasi-stationarity If the stochastic evolution has a strong drift towards extinction, this quasi-equilibrium might correspond to a large deviation event. E.g. observing a player winning at a casino for hours, traffic jam more than 10 hours,... If it tends to vanish more slowly, (spend large time in a subset of the state space before vanishing) the quasi-equilibrium corresponds to a metastable state. E.g. a bottle of cold beer just before freezing. In the study of population dynamics, this phenomenon is coined as mortality plateau.

2 types of quasi-stationarity

Challenges Both cases (large deviation and metastability) are interesting to study theoretically. These quasi-equilibrium are generally difficult to simulate. When there are several quasi-equilibrium (an infinity), which one has a physical meaning?

Markov process conditioned on non-absorption Let X t N, (N = N or R) an irreducible Markov process absorbed in 0. Let T the absorption time of X. Given an initial law µ and a measurable set A: φ µ t (A) = Pµ (X t A T > t). Kolmogorov (1938) proposed to study the long time behavior of processes conditioned not to being absorbed, i.e. the limits (if it exists) of φ µ t ( ).

Markov process conditioned on non-absorption Let X t N, (N = N or R) an irreducible Markov process absorbed in 0. Let T the absorption time of X. Given an initial law µ and a measurable set A: φ µ t (A) = Pµ (X t A T > t). Kolmogorov (1938) proposed to study the long time behavior of processes conditioned not to being absorbed, i.e. the limits (if it exists) of φ µ t ( ).

Quasi-stationary distribution We say that ν is a quasi-stationary distribution (QSD ) if there exists a probability measure µ such that: lim t φµ t ( ) = νµ ( ).

QSD Finite state space: S N : there exists a unique QSD. Spectral point of view: QSD = maximal left eigenvector of Q (infinitesimal generator of the killed process) For countable state space, there are different possible scenarios: 1. No QSD. 2. Unique QSD and convergence from any initial distribution towards this measure. 3. Infinity of QSD : Parametrization of the family of QSD with a parameter θ (eigenvalue of the infinitesimal generator): if ν QSD then P ν (T > t) = exp( θ νt). There might exist a maximal θ corresponding to the so-called minimal QSD.

QSD Finite state space: S N : there exists a unique QSD. Spectral point of view: QSD = maximal left eigenvector of Q (infinitesimal generator of the killed process) For countable state space, there are different possible scenarios: 1. No QSD. 2. Unique QSD and convergence from any initial distribution towards this measure. 3. Infinity of QSD : Parametrization of the family of QSD with a parameter θ (eigenvalue of the infinitesimal generator): if ν QSD then P ν (T > t) = exp( θ νt). There might exist a maximal θ corresponding to the so-called minimal QSD.

Challenges Existence, Simulation, Properties, extremality

Challenges Existence, Simulation, Properties, extremality

Challenges Existence, Simulation, Properties, extremality

Bibliography on QSDs - van Doorn, Ferrari, Martinez, Pollet, Seneta, Vere-Jones,... See P. Pollett bibiliography: http://www.maths.uq.edu.au/ pkp/papers/qsds/qsds.pdf

Outline Particle systems: microscopic models 1. Branching processes 2. Fleming-Viot 3. N- Branching Brownian motion 4. Choose the fittest

Outline Particle systems: microscopic models 1. Branching processes 2. Fleming-Viot 3. N- Branching Brownian motion 4. Choose the fittest

Outline Particle systems: microscopic models 1. Branching processes 2. Fleming-Viot 3. N- Branching Brownian motion 4. Choose the fittest

Traveling waves for PDE An important question in mathematics and physics is the existence of traveling waves solutions to (in particular parabolic, reaction-diffusion) PDEs, i.e., solutions of the form u(x, t) = w(x ct) where c is the speed of the traveling wave. Example: KPP (Kolmogorov-Petrovsky-Piskounov) equation: u t = 1/2u xx + f (u). Links with the maximum of the Branching Brownian motion (McKean, Bramson,...) In general, there may exist an infinity of solutions parametrized by their speed s. Which speed to select?

Traveling waves and QSDs For the KPP equation with f (u) = u 2 u, one can prove that: the equation has the same traveling wave as the free boundary equation obtained for the N-BBM, There exists a traveling wave (for a given eigenvalue λ) if and only if there exists a QSD for an associated Brownian motion with drift. This can be extended to Lévy processes dynamics, i.e. more general equations...

Need for a selection principle: Quoting Fisher (About the velocity of advance for genetic evolutions): Common sense would, I think, lead us to believe that, though the velocity of advance might be temporarily enhanced by this method, yet ultimately, the velocity of advance would adjust itself so as to be the same irrespective of the initial conditions. If this is so, this equation must omit some essential element of the problem, and it is indeed clear that while a coefficient of diffusion may represent the biological conditions adequately in places where large numbers of individuals of both types are available, it cannot do so at the extreme front and back of the advancing wave, where the numbers of the mutant and the parent gene respectively are small, and where their distribution must be largely sporadic.

The missing links: particle systems Macroscopic models (QSDs and traveling waves) forget that a population can be very large but finite. Microscopic models are intrinsically corresponding to finite population. They do select the minimal QSD/traveling wave.

references Simulation of quasi-stationary distributions on countable spaces, P. Groisman, M. J., Markov processes and related fields 2013 Fleming-Viot selects the minimal quasi-stationary distribution: The Galton-Watson case A. Asselah, P. Ferrari, P. Groisman, M. J. Ann Inst H. Poincaré, 2015 Front propagation and quasi-stationary distributions: the same selection principle. P. Groisman, M. J. Kesten-Stigum theorems in L 2 beyond R-positivity. S. Saglietti, M.J.

Thanks

Existence of QSD Very few general result: Proposition (Ferrari et. al. 1995) X t N. If lim x P x (T > t) =, There exists γ > 0 and z N such that E z (exp(γt 0 )) <, then there exists a QSD.

QSD and QLD : examples Birth and death process (non-empty M/M/1 queue): q(x, x + 1) = p1 x>0, q(x, x 1) = q1 x>0. Infinite family of QSD. Minimal QSD : ν (x) = c(x + 1) ( p ) x/2. q Population process with linear drift: q(x, x + 1) = px1 x>0, q(x, x 1) = qx1 x>0. Infinite family of QSD. Minimal QSD : ν (x) = c ( p ) x. q

QSD and QLD : examples Birth and death process (non-empty M/M/1 queue): q(x, x + 1) = p1 x>0, q(x, x 1) = q1 x>0. Infinite family of QSD. Minimal QSD : ν (x) = c(x + 1) ( p ) x/2. q Population process with linear drift: q(x, x + 1) = px1 x>0, q(x, x 1) = qx1 x>0. Infinite family of QSD. Minimal QSD : ν (x) = c ( p ) x. q