Re-entrant transition in a one-dimensional growth model

Size: px
Start display at page:

Download "Re-entrant transition in a one-dimensional growth model"

Transcription

1 Re-entrant transition in a one-dimensional growth model Ostap Hryniv Dept. of Mathematical Sciences Durham University Ostap.Hryniv@durham.ac.uk X International Conference Stochastic and Analytic Methods in Mathematical Physics Yerevan, Armenia, September 4 11, 2016

2 Outline Model Motivation Heuristics Results and Ideas Conclusions (partially based on a joint work with A. Letcher and D. Sheard)

3 The model State space long polymer chains made of and monomers Dynamics: Growth: attachment of a monomer:... =... rate λ +... =... rate λ Conversion: independent transformation : = rate 1 Shrinking: detachment of the extreme monomer:... =... rate µ Want: long term behaviour of the process.

4 Motivation relatively simple growth model, only two types of particle, three parameters a version of a model suggested in [Antal et al PRE 2007] to describe microtubule dynamics wild fluctuation under steady state; rich dynamics within a simple soluble model; various approximations via the Master equation a non-reversible model exhibiting metastable behaviour; interesting phase transition

5 What are microtubules? Microtubules are one of the components of the cytoskeleton. They have a diameter of 25 nm and length varying from 200 nm to 25 µm. [ [Howard & Hyman, Nature 2003]

6 Microtubule structure and dynamics Microtubules are polymers made of protofilaments organised into an imperfect helix. Protofilaments, in their turn, consist of α- and β-tubulin dimers. [Howard & Hyman, Nature 2003]

7 Microtubule dynamics During polymerization, both the α- and β-subunits of the tubulin dimer are bound to a molecule of GTP. While the GTP bound to α-tubulin is stable, the GTP bound to β-tubulin may hydrolyze to GDP after assembly. The GDP-tubulin leads to depolymerization of the tubulin dimers at the microtubule tip: [Howard & Hyman, Nature 2003]

8 Single microtubule dynamics Growth: µm/min (ie., dimers/sec); shrinking about 10 times faster: The model mimics the experimental data [Fygenson et al, PRE 1994] [avi]

9 Heuristics Microtubles long chains made of and monomers (guanosin triphosphate (GTP + ) and guanosin diphosphate (GDP ) tubulin complexes) Microtubules (position, head), ie., a Markov process y t (x t, w t ), t 0 ; The head process (w t ) t 0, is a non-reversible Markov chain in W = { } { w = w, where w is a finite word of and } State is recurrent for w t ; leads to a useful renewal structure. [alternating -cycles and -cycles]

10 Empty-head process Let 0 = τ 0 < τ 1 <... be times of consecutive returns of w t to. def Put ỹ l y τl = (x τl, ) with x l x τl, a CTRW in Z. Key facts: [HM 10, H 12] The space-time increments of x l have exponential moments in a neighbourhood of the origin; [cluster expansion lemma!] Many classical results (SLLN, CLT, LDP,... ) hold; The velocity v of x t is given by x t v lim t t = E x 1/E τ 1 (a.s.) ; it is analytic in λ +, λ and µ. Phase boundary {v = 0} separates the compact phase (v < 0) from the region of indefinite growth (v > 0).

11 Explicit expression for v? w t irreducible, positive recurrent MC in W with stat. dist. π; put π + = π ( {w W : w 0 = } ), π = 1 π +. Write v + λ + > 0 and v λ µ. By the Ergodic theorem, x t v = lim t t = π + v + + π v (a.s.). If λ > µ (ie., v > 0), then v > 0 and x t +. However, no good control of π + (π ), but finite-window approximations for π give v > 0 for µ λ (1 + λ + ). [HM 10] asymptotically correct for small λ ± [Antal et al PRE 2007]

12 Lifetimes (region v < 0) Eventually, every monomer detaches from the microtubule; let T min { t > 0 : y t = ( 1, ) y 0 = (0, ) }, T min { t > 0 : y t = ( 1, ) y 0 = (0, ) }. Clearly, T stochastically dominates T. Can show 1 + µ ET = λ ET ; so that ET < iff ET < ; moreover, for small s > 0, v < 0 E T < E e st <. Actually, in this region, one has v = 1/ET < 0. Can also relate ϕ (s) def = Ee st and ϕ (s) def = Ee st. [HM 10]

13 Further results Regular phase Theorem [H 12] Let λ λ +. Then v is a strictly monotone function of the rates λ +, λ, and µ, with partial derivatives v λ + > 0, v λ > 0, v µ < 0. [natural monotonicity properties] Non-strict monotonicity: via coupling. Strict monotonicity: via large deviations and the Ergodic theorem.

14 Numerics Re-entrant phase transition Microtubule velocity; Lam+ = 10 Lam- = 0.01 Lam- = 0.03 Lam- = 0.05 Lam- = Velocity Mu

15 Microtubule velocity; Lam+ = 10 Lam- = 0.01 Lam- = 0.03 Lam- = 0.05 Lam- = Velocity Mu

16 Re-entrant phase transition Theorem: Fix λ + large and λ small. Then v = v(µ) changes sign three times. For µ small : if µ < 1, the -cycle often stops once the extreme monomer hydrolyzes, ; there is exactly one intersection point (v = 0) with µ = O(λ + ).

17 Re-entrant phase transition Large µ heuristics: if µ = +, x t is an additive functional of the classical birth-and-death process; gives complete control of the asymptotic behaviour; if µ < but still large, use cluster expansions around the µ = case (λ contribution is still small); the argument relies upon the statistical homogeneity of the trajectories of y t at the microscopic level and sharp control of the metastable behaviour of the related birh and death process.

18 Conclusions The model behaves naturally for λ λ + ( regular phase), while for some pairs (λ +, λ ) with λ < λ + a re-entrant transition is observed (faster shrinking rate can increase the velocity); Description of the whole region (λ, λ + ) exhibiting the re-entrant transition still lacking; More advanced models in the spirit of [Piette et al 2009] are of interest (eg., allow the extreme to detach; some results are available);...

19 References T.Antal, P.L.Krapivsky, S.Redner, M.Mailman, and B.Chakraborty. Dynamics of an Idealized Model of Microtubule Growth and Catastrophe. Phys. Rev. E76, (2007). B.M.A.G.Piette, J.Liu, K.Peeters, A.Smertenko, T.Hawkins, M.Deeks, R.Quinlan, W.J.Zakrzewski, and P.J.Hussey. A Thermodynamic Model of Microtubule Assembly and Disassembly. PLoS ONE 4(8): e6378 (2009). OH, M.Menshikov. Long-time behaviour in a model of microtubule growth. Adv. Appl. Prob. 42, (2010). OH. Regular phase in a model of microtubule growth. Markov Processes and Related Fields 18(2): (2012). OH, A. Letcher and D. Sheard. Re-entrant phase transition in a model of microtubule growth. [in preparation]

monomer polymer polymeric network cell

monomer polymer polymeric network cell 3.1 Motivation 3.2 Polymerization The structural stability of the cell is provided by the cytoskeleton. Assembling and disassembling dynamically, the cytoskeleton enables cell movement through a highly

More information

Dynamics of Microtubule Growth & Catastrophe

Dynamics of Microtubule Growth & Catastrophe Dynamics of Microtubule Growth & Catastrophe T. Antal, P. Krapivsky, SR, M. Mailman, B. Chakraborty, q-bio/0703001 U Mass Amherst, March 15, 2007 Basic question: Why do microtubules fluctuate wildly under

More information

Physics of Cellular materials: Filaments

Physics of Cellular materials: Filaments Physics of Cellular materials: Filaments Tom Chou Dept. of Biomathematics, UCLA, Los Angeles, CA 995-766 (Dated: December 6, ) The basic filamentary structures in a cell are reviewed. Their basic structures

More information

arxiv:q-bio/ v2 [q-bio.qm] 22 Apr 2008

arxiv:q-bio/ v2 [q-bio.qm] 22 Apr 2008 Dynamics of an Idealized Model of Microtubule Growth and Catastrophe T. Antal, 1 P. L. Krapivsky, 2 S. Redner, 2 M. Mailman, 3 and B. Chakraborty 3 1 Program for Evolutionary Dynamics, Harvard University,

More information

Recap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks

Recap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks Recap Probability, stochastic processes, Markov chains ELEC-C7210 Modeling and analysis of communication networks 1 Recap: Probability theory important distributions Discrete distributions Geometric distribution

More information

Dynamics of an idealized model of microtubule growth and catastrophe

Dynamics of an idealized model of microtubule growth and catastrophe PHYSICAL REVIEW E 76, 041907 2007 Dynamics of an idealized model of microtubule growth and catastrophe T. Antal, 1 P. L. Krapivsky, 2 S. Redner, 2 M. Mailman, 3 and B. Chakraborty 3 1 Program for Evolutionary

More information

Monte Carlo simulations of rigid biopolymer growth processes

Monte Carlo simulations of rigid biopolymer growth processes THE JOURNAL OF CHEMICAL PHYSICS 123, 124902 2005 Monte Carlo simulations of rigid biopolymer growth processes Jenny Son and G. Orkoulas a Department of Chemical and Biomolecular Engineering, University

More information

Functional Limit theorems for the quadratic variation of a continuous time random walk and for certain stochastic integrals

Functional Limit theorems for the quadratic variation of a continuous time random walk and for certain stochastic integrals Functional Limit theorems for the quadratic variation of a continuous time random walk and for certain stochastic integrals Noèlia Viles Cuadros BCAM- Basque Center of Applied Mathematics with Prof. Enrico

More information

Non-homogeneous random walks on a semi-infinite strip

Non-homogeneous random walks on a semi-infinite strip Non-homogeneous random walks on a semi-infinite strip Chak Hei Lo Joint work with Andrew R. Wade World Congress in Probability and Statistics 11th July, 2016 Outline Motivation: Lamperti s problem Our

More information

Transport of single molecules along the periodic parallel lattices with coupling

Transport of single molecules along the periodic parallel lattices with coupling THE JOURNAL OF CHEMICAL PHYSICS 124 204901 2006 Transport of single molecules along the periodic parallel lattices with coupling Evgeny B. Stukalin The James Franck Institute The University of Chicago

More information

Polymerization and force generation

Polymerization and force generation Polymerization and force generation by Eric Cytrynbaum April 8, 2008 Equilibrium polymer in a box An equilibrium polymer is a polymer has no source of extraneous energy available to it. This does not mean

More information

Stability and Rare Events in Stochastic Models Sergey Foss Heriot-Watt University, Edinburgh and Institute of Mathematics, Novosibirsk

Stability and Rare Events in Stochastic Models Sergey Foss Heriot-Watt University, Edinburgh and Institute of Mathematics, Novosibirsk Stability and Rare Events in Stochastic Models Sergey Foss Heriot-Watt University, Edinburgh and Institute of Mathematics, Novosibirsk ANSAPW University of Queensland 8-11 July, 2013 1 Outline (I) Fluid

More information

Markov Processes Hamid R. Rabiee

Markov Processes Hamid R. Rabiee Markov Processes Hamid R. Rabiee Overview Markov Property Markov Chains Definition Stationary Property Paths in Markov Chains Classification of States Steady States in MCs. 2 Markov Property A discrete

More information

t For l = 1 a monomer cannot be destroyed or created from nothing: = b p(2,t) a p(1,t).

t For l = 1 a monomer cannot be destroyed or created from nothing: = b p(2,t) a p(1,t). IITS: Statistical Physics in Biology Assignment # 5 KU Leuven 5/31/2013 Drift, Diffusion, and Dynamic Instability 1. Treadmilling Actin: Actin filaments are long, asymmetric, polymers involved in a variety

More information

Irreducibility. Irreducible. every state can be reached from every other state For any i,j, exist an m 0, such that. Absorbing state: p jj =1

Irreducibility. Irreducible. every state can be reached from every other state For any i,j, exist an m 0, such that. Absorbing state: p jj =1 Irreducibility Irreducible every state can be reached from every other state For any i,j, exist an m 0, such that i,j are communicate, if the above condition is valid Irreducible: all states are communicate

More information

MARKOV PROCESSES. Valerio Di Valerio

MARKOV PROCESSES. Valerio Di Valerio MARKOV PROCESSES Valerio Di Valerio Stochastic Process Definition: a stochastic process is a collection of random variables {X(t)} indexed by time t T Each X(t) X is a random variable that satisfy some

More information

Markov processes and queueing networks

Markov processes and queueing networks Inria September 22, 2015 Outline Poisson processes Markov jump processes Some queueing networks The Poisson distribution (Siméon-Denis Poisson, 1781-1840) { } e λ λ n n! As prevalent as Gaussian distribution

More information

Matrix analytic methods. Lecture 1: Structured Markov chains and their stationary distribution

Matrix analytic methods. Lecture 1: Structured Markov chains and their stationary distribution 1/29 Matrix analytic methods Lecture 1: Structured Markov chains and their stationary distribution Sophie Hautphenne and David Stanford (with thanks to Guy Latouche, U. Brussels and Peter Taylor, U. Melbourne

More information

Markov Chains CK eqns Classes Hitting times Rec./trans. Strong Markov Stat. distr. Reversibility * Markov Chains

Markov Chains CK eqns Classes Hitting times Rec./trans. Strong Markov Stat. distr. Reversibility * Markov Chains Markov Chains A random process X is a family {X t : t T } of random variables indexed by some set T. When T = {0, 1, 2,... } one speaks about a discrete-time process, for T = R or T = [0, ) one has a continuous-time

More information

A large deviation principle for a RWRC in a box

A large deviation principle for a RWRC in a box A large deviation principle for a RWRC in a box 7th Cornell Probability Summer School Michele Salvi TU Berlin July 12, 2011 Michele Salvi (TU Berlin) An LDP for a RWRC in a nite box July 12, 2011 1 / 15

More information

Stochastic process. X, a series of random variables indexed by t

Stochastic process. X, a series of random variables indexed by t Stochastic process X, a series of random variables indexed by t X={X(t), t 0} is a continuous time stochastic process X={X(t), t=0,1, } is a discrete time stochastic process X(t) is the state at time t,

More information

Chapter 5. Continuous-Time Markov Chains. Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan

Chapter 5. Continuous-Time Markov Chains. Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan Chapter 5. Continuous-Time Markov Chains Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan Continuous-Time Markov Chains Consider a continuous-time stochastic process

More information

Statistics 150: Spring 2007

Statistics 150: Spring 2007 Statistics 150: Spring 2007 April 23, 2008 0-1 1 Limiting Probabilities If the discrete-time Markov chain with transition probabilities p ij is irreducible and positive recurrent; then the limiting probabilities

More information

STOCHASTIC PROCESSES Basic notions

STOCHASTIC PROCESSES Basic notions J. Virtamo 38.3143 Queueing Theory / Stochastic processes 1 STOCHASTIC PROCESSES Basic notions Often the systems we consider evolve in time and we are interested in their dynamic behaviour, usually involving

More information

BME Engineering Molecular Cell Biology. Basics of the Diffusion Theory. The Cytoskeleton (I)

BME Engineering Molecular Cell Biology. Basics of the Diffusion Theory. The Cytoskeleton (I) BME 42-620 Engineering Molecular Cell Biology Lecture 07: Basics of the Diffusion Theory The Cytoskeleton (I) BME42-620 Lecture 07, September 20, 2011 1 Outline Diffusion: microscopic theory Diffusion:

More information

CDA6530: Performance Models of Computers and Networks. Chapter 3: Review of Practical Stochastic Processes

CDA6530: Performance Models of Computers and Networks. Chapter 3: Review of Practical Stochastic Processes CDA6530: Performance Models of Computers and Networks Chapter 3: Review of Practical Stochastic Processes Definition Stochastic process X = {X(t), t2 T} is a collection of random variables (rvs); one rv

More information

Stochastic Processes. Theory for Applications. Robert G. Gallager CAMBRIDGE UNIVERSITY PRESS

Stochastic Processes. Theory for Applications. Robert G. Gallager CAMBRIDGE UNIVERSITY PRESS Stochastic Processes Theory for Applications Robert G. Gallager CAMBRIDGE UNIVERSITY PRESS Contents Preface page xv Swgg&sfzoMj ybr zmjfr%cforj owf fmdy xix Acknowledgements xxi 1 Introduction and review

More information

Multivariate Risk Processes with Interacting Intensities

Multivariate Risk Processes with Interacting Intensities Multivariate Risk Processes with Interacting Intensities Nicole Bäuerle (joint work with Rudolf Grübel) Luminy, April 2010 Outline Multivariate pure birth processes Multivariate Risk Processes Fluid Limits

More information

IEOR 6711, HMWK 5, Professor Sigman

IEOR 6711, HMWK 5, Professor Sigman IEOR 6711, HMWK 5, Professor Sigman 1. Semi-Markov processes: Consider an irreducible positive recurrent discrete-time Markov chain {X n } with transition matrix P (P i,j ), i, j S, and finite state space.

More information

EXTINCTION TIMES FOR A GENERAL BIRTH, DEATH AND CATASTROPHE PROCESS

EXTINCTION TIMES FOR A GENERAL BIRTH, DEATH AND CATASTROPHE PROCESS J. Appl. Prob. 41, 1211 1218 (2004) Printed in Israel Applied Probability Trust 2004 EXTINCTION TIMES FOR A GENERAL BIRTH, DEATH AND CATASTROPHE PROCESS BEN CAIRNS and P. K. POLLETT, University of Queensland

More information

The Role of Multifilament Structures and Lateral Interactions in Dynamics of Cytoskeleton Proteins and Assemblies

The Role of Multifilament Structures and Lateral Interactions in Dynamics of Cytoskeleton Proteins and Assemblies pubs.acs.org/jpcb he Role of Multifilament Structures and Lateral Interactions in Dynamics of Cytoskeleton Proteins and Assemblies Xin Li and Anatoly B. Kolomeisky* Rice niversity, Department of Chemistry

More information

Force-Velocity Relation for Growing Microtubules

Force-Velocity Relation for Growing Microtubules Biophysical Journal Volume 80 January 2001 149 154 149 Force-Velocity Relation for Growing Microtubules Anatoly B. Kolomeisky* and Michael E. Fisher *Department of Chemistry, Rice University, Houston,

More information

Sec. 2.1 Filaments in the cell 21 PART I - RODS AND ROPES

Sec. 2.1 Filaments in the cell 21 PART I - RODS AND ROPES Sec. 2.1 Filaments in the cell 21 PART I - RODS AND ROPES Sec. 2.1 Filaments in the cell 22 CHAPTER 2 - POLYMERS The structural elements of the cell can be broadly classified as filaments or sheets, where

More information

Neurite formation & neuronal polarization. The cytoskeletal components of neurons have characteristic distributions and associations

Neurite formation & neuronal polarization. The cytoskeletal components of neurons have characteristic distributions and associations Mechanisms of neuronal migration & Neurite formation & neuronal polarization Paul Letourneau letou001@umn.edu Chapter 16; The Cytoskeleton; Molecular Biology of the Cell, Alberts et al. 1 The cytoskeletal

More information

Asymptotic properties of the maximum likelihood estimator for a ballistic random walk in a random environment

Asymptotic properties of the maximum likelihood estimator for a ballistic random walk in a random environment Asymptotic properties of the maximum likelihood estimator for a ballistic random walk in a random environment Catherine Matias Joint works with F. Comets, M. Falconnet, D.& O. Loukianov Currently: Laboratoire

More information

Lecture Notes 7 Random Processes. Markov Processes Markov Chains. Random Processes

Lecture Notes 7 Random Processes. Markov Processes Markov Chains. Random Processes Lecture Notes 7 Random Processes Definition IID Processes Bernoulli Process Binomial Counting Process Interarrival Time Process Markov Processes Markov Chains Classification of States Steady State Probabilities

More information

Neurite formation & neuronal polarization

Neurite formation & neuronal polarization Neurite formation & neuronal polarization Paul Letourneau letou001@umn.edu Chapter 16; The Cytoskeleton; Molecular Biology of the Cell, Alberts et al. 1 An immature neuron in cell culture first sprouts

More information

The range of tree-indexed random walk

The range of tree-indexed random walk The range of tree-indexed random walk Jean-François Le Gall, Shen Lin Institut universitaire de France et Université Paris-Sud Orsay Erdös Centennial Conference July 2013 Jean-François Le Gall (Université

More information

Modeling with Itô Stochastic Differential Equations

Modeling with Itô Stochastic Differential Equations Modeling with Itô Stochastic Differential Equations 2.4-2.6 E. Allen presentation by T. Perälä 27.0.2009 Postgraduate seminar on applied mathematics 2009 Outline Hilbert Space of Stochastic Processes (

More information

A theoretical analysis of filament length fluctuations in actin and other polymers

A theoretical analysis of filament length fluctuations in actin and other polymers Journal of Mathematical Biology manuscript No. (will be inserted by the editor) Jifeng Hu Hans G. Othmer A theoretical analysis of filament length fluctuations in actin and other polymers c Springer-Verlag

More information

EXTINCTION TIMES FOR A GENERAL BIRTH, DEATH AND CATASTROPHE PROCESS

EXTINCTION TIMES FOR A GENERAL BIRTH, DEATH AND CATASTROPHE PROCESS (February 25, 2004) EXTINCTION TIMES FOR A GENERAL BIRTH, DEATH AND CATASTROPHE PROCESS BEN CAIRNS, University of Queensland PHIL POLLETT, University of Queensland Abstract The birth, death and catastrophe

More information

On the stall force for growing microtubules

On the stall force for growing microtubules Eur Biophys J (2000) 29: 2±6 Ó Springer-Verlag 2000 ARTICLE G. Sander van Doorn á Catalin Tanase á Bela M. Mulder Marileen Dogterom On the stall force for growing microtubules Received: 27 September 1999

More information

Handbook of Stochastic Methods

Handbook of Stochastic Methods C. W. Gardiner Handbook of Stochastic Methods for Physics, Chemistry and the Natural Sciences Third Edition With 30 Figures Springer Contents 1. A Historical Introduction 1 1.1 Motivation I 1.2 Some Historical

More information

2. Transience and Recurrence

2. Transience and Recurrence Virtual Laboratories > 15. Markov Chains > 1 2 3 4 5 6 7 8 9 10 11 12 2. Transience and Recurrence The study of Markov chains, particularly the limiting behavior, depends critically on the random times

More information

Outlines. Discrete Time Markov Chain (DTMC) Continuous Time Markov Chain (CTMC)

Outlines. Discrete Time Markov Chain (DTMC) Continuous Time Markov Chain (CTMC) Markov Chains (2) Outlines Discrete Time Markov Chain (DTMC) Continuous Time Markov Chain (CTMC) 2 pj ( n) denotes the pmf of the random variable p ( n) P( X j) j We will only be concerned with homogenous

More information

A Method for Evaluating the Distribution of the Total Cost of a Random Process over its Lifetime

A Method for Evaluating the Distribution of the Total Cost of a Random Process over its Lifetime A Method for Evaluating the Distribution of the Total Cost of a Random Process over its Lifetime P.K. Pollett a and V.T. Stefanov b a Department of Mathematics, The University of Queensland Queensland

More information

CDA5530: Performance Models of Computers and Networks. Chapter 3: Review of Practical

CDA5530: Performance Models of Computers and Networks. Chapter 3: Review of Practical CDA5530: Performance Models of Computers and Networks Chapter 3: Review of Practical Stochastic Processes Definition Stochastic ti process X = {X(t), t T} is a collection of random variables (rvs); one

More information

LIMITS FOR QUEUES AS THE WAITING ROOM GROWS. Bell Communications Research AT&T Bell Laboratories Red Bank, NJ Murray Hill, NJ 07974

LIMITS FOR QUEUES AS THE WAITING ROOM GROWS. Bell Communications Research AT&T Bell Laboratories Red Bank, NJ Murray Hill, NJ 07974 LIMITS FOR QUEUES AS THE WAITING ROOM GROWS by Daniel P. Heyman Ward Whitt Bell Communications Research AT&T Bell Laboratories Red Bank, NJ 07701 Murray Hill, NJ 07974 May 11, 1988 ABSTRACT We study the

More information

Markov chains. Randomness and Computation. Markov chains. Markov processes

Markov chains. Randomness and Computation. Markov chains. Markov processes Markov chains Randomness and Computation or, Randomized Algorithms Mary Cryan School of Informatics University of Edinburgh Definition (Definition 7) A discrete-time stochastic process on the state space

More information

A review of Continuous Time MC STA 624, Spring 2015

A review of Continuous Time MC STA 624, Spring 2015 A review of Continuous Time MC STA 624, Spring 2015 Ruriko Yoshida Dept. of Statistics University of Kentucky polytopes.net STA 624 1 Continuous Time Markov chains Definition A continuous time stochastic

More information

8. Statistical Equilibrium and Classification of States: Discrete Time Markov Chains

8. Statistical Equilibrium and Classification of States: Discrete Time Markov Chains 8. Statistical Equilibrium and Classification of States: Discrete Time Markov Chains 8.1 Review 8.2 Statistical Equilibrium 8.3 Two-State Markov Chain 8.4 Existence of P ( ) 8.5 Classification of States

More information

Mean-field dual of cooperative reproduction

Mean-field dual of cooperative reproduction The mean-field dual of systems with cooperative reproduction joint with Tibor Mach (Prague) A. Sturm (Göttingen) Friday, July 6th, 2018 Poisson construction of Markov processes Let (X t ) t 0 be a continuous-time

More information

The fate of beneficial mutations in a range expansion

The fate of beneficial mutations in a range expansion The fate of beneficial mutations in a range expansion R. Lehe (Paris) O. Hallatschek (Göttingen) L. Peliti (Naples) February 19, 2015 / Rutgers Outline Introduction The model Results Analysis Range expansion

More information

Lecture 11: Introduction to Markov Chains. Copyright G. Caire (Sample Lectures) 321

Lecture 11: Introduction to Markov Chains. Copyright G. Caire (Sample Lectures) 321 Lecture 11: Introduction to Markov Chains Copyright G. Caire (Sample Lectures) 321 Discrete-time random processes A sequence of RVs indexed by a variable n 2 {0, 1, 2,...} forms a discretetime random process

More information

Cover Page. The handle holds various files of this Leiden University dissertation

Cover Page. The handle   holds various files of this Leiden University dissertation Cover Page The handle http://hdlhandlenet/1887/39637 holds various files of this Leiden University dissertation Author: Smit, Laurens Title: Steady-state analysis of large scale systems : the successive

More information

Lecture 7. We can regard (p(i, j)) as defining a (maybe infinite) matrix P. Then a basic fact is

Lecture 7. We can regard (p(i, j)) as defining a (maybe infinite) matrix P. Then a basic fact is MARKOV CHAINS What I will talk about in class is pretty close to Durrett Chapter 5 sections 1-5. We stick to the countable state case, except where otherwise mentioned. Lecture 7. We can regard (p(i, j))

More information

DISCRETE STOCHASTIC PROCESSES Draft of 2nd Edition

DISCRETE STOCHASTIC PROCESSES Draft of 2nd Edition DISCRETE STOCHASTIC PROCESSES Draft of 2nd Edition R. G. Gallager January 31, 2011 i ii Preface These notes are a draft of a major rewrite of a text [9] of the same name. The notes and the text are outgrowths

More information

Time Reversibility and Burke s Theorem

Time Reversibility and Burke s Theorem Queuing Analysis: Time Reversibility and Burke s Theorem Hongwei Zhang http://www.cs.wayne.edu/~hzhang Acknowledgement: this lecture is partially based on the slides of Dr. Yannis A. Korilis. Outline Time-Reversal

More information

arxiv: v1 [cond-mat.soft] 12 Sep 2008

arxiv: v1 [cond-mat.soft] 12 Sep 2008 arxiv:0809.2228v1 [cond-mat.soft] 12 Sep 2008 Non-equilibrium self-assembly of a filament coupled to ATP/GTP hydrolysis Padinhateeri Ranjith 1 Physico-Chimie UMR 168 Institut Curie, 26 rue d Ulm 75248

More information

Lecture 20: Reversible Processes and Queues

Lecture 20: Reversible Processes and Queues Lecture 20: Reversible Processes and Queues 1 Examples of reversible processes 11 Birth-death processes We define two non-negative sequences birth and death rates denoted by {λ n : n N 0 } and {µ n : n

More information

Stochastic Models: Markov Chains and their Generalizations

Stochastic Models: Markov Chains and their Generalizations Scuola di Dottorato in Scienza ed Alta Tecnologia Dottorato in Informatica Universita di Torino Stochastic Models: Markov Chains and their Generalizations Gianfranco Balbo e Andras Horvath Outline Introduction

More information

Ben Pence Scott Moura. December 12, 2009

Ben Pence Scott Moura. December 12, 2009 Ben Pence Scott Moura EECS 558 Project December 12, 2009 SLIDE 1of 24 Stochastic system with unknown parameters Want to identify the parameters Adapt the control based on the parameter estimate Identifiability

More information

Let (Ω, F) be a measureable space. A filtration in discrete time is a sequence of. F s F t

Let (Ω, F) be a measureable space. A filtration in discrete time is a sequence of. F s F t 2.2 Filtrations Let (Ω, F) be a measureable space. A filtration in discrete time is a sequence of σ algebras {F t } such that F t F and F t F t+1 for all t = 0, 1,.... In continuous time, the second condition

More information

Outline. Input to state Stability. Nonlinear Realization. Recall: _ Space. _ Space: Space of all piecewise continuous functions

Outline. Input to state Stability. Nonlinear Realization. Recall: _ Space. _ Space: Space of all piecewise continuous functions Outline Input to state Stability Motivation for Input to State Stability (ISS) ISS Lyapunov function. Stability theorems. M. Sami Fadali Professor EBME University of Nevada, Reno 1 2 Recall: _ Space _

More information

Existence, Uniqueness and Stability of Invariant Distributions in Continuous-Time Stochastic Models

Existence, Uniqueness and Stability of Invariant Distributions in Continuous-Time Stochastic Models Existence, Uniqueness and Stability of Invariant Distributions in Continuous-Time Stochastic Models Christian Bayer and Klaus Wälde Weierstrass Institute for Applied Analysis and Stochastics and University

More information

process on the hierarchical group

process on the hierarchical group Intertwining of Markov processes and the contact process on the hierarchical group April 27, 2010 Outline Intertwining of Markov processes Outline Intertwining of Markov processes First passage times of

More information

A limit theorem for the moments in space of Browian local time increments

A limit theorem for the moments in space of Browian local time increments A limit theorem for the moments in space of Browian local time increments Simon Campese LMS EPSRC Durham Symposium July 18, 2017 Motivation Theorem (Marcus, Rosen, 2006) As h 0, L x+h t L x t h q dx a.s.

More information

Population Games and Evolutionary Dynamics

Population Games and Evolutionary Dynamics Population Games and Evolutionary Dynamics William H. Sandholm The MIT Press Cambridge, Massachusetts London, England in Brief Series Foreword Preface xvii xix 1 Introduction 1 1 Population Games 2 Population

More information

25.1 Ergodicity and Metric Transitivity

25.1 Ergodicity and Metric Transitivity Chapter 25 Ergodicity This lecture explains what it means for a process to be ergodic or metrically transitive, gives a few characterizes of these properties (especially for AMS processes), and deduces

More information

Examples of Countable State Markov Chains Thursday, October 16, :12 PM

Examples of Countable State Markov Chains Thursday, October 16, :12 PM stochnotes101608 Page 1 Examples of Countable State Markov Chains Thursday, October 16, 2008 12:12 PM Homework 2 solutions will be posted later today. A couple of quick examples. Queueing model (without

More information

STOCHASTIC CHEMICAL KINETICS

STOCHASTIC CHEMICAL KINETICS STOCHASTIC CHEICAL KINETICS Dan Gillespie GillespieDT@mailaps.org Current Support: Caltech (NIGS) Caltech (NIH) University of California at Santa Barbara (NIH) Past Support: Caltech (DARPA/AFOSR, Beckman/BNC))

More information

Brownian Bridge and Self-Avoiding Random Walk.

Brownian Bridge and Self-Avoiding Random Walk. Brownian Bridge and Self-Avoiding Random Walk. arxiv:math/02050v [math.pr] 9 May 2002 Yevgeniy Kovchegov Email: yevgeniy@math.stanford.edu Fax: -650-725-4066 November 2, 208 Abstract We derive the Brownian

More information

Markov Chains (Part 4)

Markov Chains (Part 4) Markov Chains (Part 4) Steady State Probabilities and First Passage Times Markov Chains - 1 Steady-State Probabilities Remember, for the inventory example we had (8) P &.286 =.286.286 %.286 For an irreducible

More information

Markov Chain Monte Carlo The Metropolis-Hastings Algorithm

Markov Chain Monte Carlo The Metropolis-Hastings Algorithm Markov Chain Monte Carlo The Metropolis-Hastings Algorithm Anthony Trubiano April 11th, 2018 1 Introduction Markov Chain Monte Carlo (MCMC) methods are a class of algorithms for sampling from a probability

More information

Positive and null recurrent-branching Process

Positive and null recurrent-branching Process December 15, 2011 In last discussion we studied the transience and recurrence of Markov chains There are 2 other closely related issues about Markov chains that we address Is there an invariant distribution?

More information

GARCH processes probabilistic properties (Part 1)

GARCH processes probabilistic properties (Part 1) GARCH processes probabilistic properties (Part 1) Alexander Lindner Centre of Mathematical Sciences Technical University of Munich D 85747 Garching Germany lindner@ma.tum.de http://www-m1.ma.tum.de/m4/pers/lindner/

More information

1 Lyapunov theory of stability

1 Lyapunov theory of stability M.Kawski, APM 581 Diff Equns Intro to Lyapunov theory. November 15, 29 1 1 Lyapunov theory of stability Introduction. Lyapunov s second (or direct) method provides tools for studying (asymptotic) stability

More information

Positive Harris Recurrence and Diffusion Scale Analysis of a Push Pull Queueing Network. Haifa Statistics Seminar May 5, 2008

Positive Harris Recurrence and Diffusion Scale Analysis of a Push Pull Queueing Network. Haifa Statistics Seminar May 5, 2008 Positive Harris Recurrence and Diffusion Scale Analysis of a Push Pull Queueing Network Yoni Nazarathy Gideon Weiss Haifa Statistics Seminar May 5, 2008 1 Outline 1 Preview of Results 2 Introduction Queueing

More information

Birth and Death Processes. Birth and Death Processes. Linear Growth with Immigration. Limiting Behaviour for Birth and Death Processes

Birth and Death Processes. Birth and Death Processes. Linear Growth with Immigration. Limiting Behaviour for Birth and Death Processes DTU Informatics 247 Stochastic Processes 6, October 27 Today: Limiting behaviour of birth and death processes Birth and death processes with absorbing states Finite state continuous time Markov chains

More information

Lecture 4a: Continuous-Time Markov Chain Models

Lecture 4a: Continuous-Time Markov Chain Models Lecture 4a: Continuous-Time Markov Chain Models Continuous-time Markov chains are stochastic processes whose time is continuous, t [0, ), but the random variables are discrete. Prominent examples of continuous-time

More information

Session-Based Queueing Systems

Session-Based Queueing Systems Session-Based Queueing Systems Modelling, Simulation, and Approximation Jeroen Horters Supervisor VU: Sandjai Bhulai Executive Summary Companies often offer services that require multiple steps on the

More information

At the boundary states, we take the same rules except we forbid leaving the state space, so,.

At the boundary states, we take the same rules except we forbid leaving the state space, so,. Birth-death chains Monday, October 19, 2015 2:22 PM Example: Birth-Death Chain State space From any state we allow the following transitions: with probability (birth) with probability (death) with probability

More information

Handbook of Stochastic Methods

Handbook of Stochastic Methods Springer Series in Synergetics 13 Handbook of Stochastic Methods for Physics, Chemistry and the Natural Sciences von Crispin W Gardiner Neuausgabe Handbook of Stochastic Methods Gardiner schnell und portofrei

More information

Gillespie s Algorithm and its Approximations. Des Higham Department of Mathematics and Statistics University of Strathclyde

Gillespie s Algorithm and its Approximations. Des Higham Department of Mathematics and Statistics University of Strathclyde Gillespie s Algorithm and its Approximations Des Higham Department of Mathematics and Statistics University of Strathclyde djh@maths.strath.ac.uk The Three Lectures 1 Gillespie s algorithm and its relation

More information

(b) What is the variance of the time until the second customer arrives, starting empty, assuming that we measure time in minutes?

(b) What is the variance of the time until the second customer arrives, starting empty, assuming that we measure time in minutes? IEOR 3106: Introduction to Operations Research: Stochastic Models Fall 2006, Professor Whitt SOLUTIONS to Final Exam Chapters 4-7 and 10 in Ross, Tuesday, December 19, 4:10pm-7:00pm Open Book: but only

More information

arxiv: v2 [math.pr] 4 Sep 2017

arxiv: v2 [math.pr] 4 Sep 2017 arxiv:1708.08576v2 [math.pr] 4 Sep 2017 On the Speed of an Excited Asymmetric Random Walk Mike Cinkoske, Joe Jackson, Claire Plunkett September 5, 2017 Abstract An excited random walk is a non-markovian

More information

Fluctuation theorems. Proseminar in theoretical physics Vincent Beaud ETH Zürich May 11th 2009

Fluctuation theorems. Proseminar in theoretical physics Vincent Beaud ETH Zürich May 11th 2009 Fluctuation theorems Proseminar in theoretical physics Vincent Beaud ETH Zürich May 11th 2009 Outline Introduction Equilibrium systems Theoretical background Non-equilibrium systems Fluctuations and small

More information

Theory of Stochastic Processes 3. Generating functions and their applications

Theory of Stochastic Processes 3. Generating functions and their applications Theory of Stochastic Processes 3. Generating functions and their applications Tomonari Sei sei@mist.i.u-tokyo.ac.jp Department of Mathematical Informatics, University of Tokyo April 20, 2017 http://www.stat.t.u-tokyo.ac.jp/~sei/lec.html

More information

The Minesweeper game: Percolation and Complexity

The Minesweeper game: Percolation and Complexity The Minesweeper game: Percolation and Complexity Elchanan Mossel Hebrew University of Jerusalem and Microsoft Research March 15, 2002 Abstract We study a model motivated by the minesweeper game In this

More information

The SIS and SIR stochastic epidemic models revisited

The SIS and SIR stochastic epidemic models revisited The SIS and SIR stochastic epidemic models revisited Jesús Artalejo Faculty of Mathematics, University Complutense of Madrid Madrid, Spain jesus_artalejomat.ucm.es BCAM Talk, June 16, 2011 Talk Schedule

More information

Rare event simulation for the ruin problem with investments via importance sampling and duality

Rare event simulation for the ruin problem with investments via importance sampling and duality Rare event simulation for the ruin problem with investments via importance sampling and duality Jerey Collamore University of Copenhagen Joint work with Anand Vidyashankar (GMU) and Guoqing Diao (GMU).

More information

MIXING TIMES OF RANDOM WALKS ON DYNAMIC CONFIGURATION MODELS

MIXING TIMES OF RANDOM WALKS ON DYNAMIC CONFIGURATION MODELS MIXING TIMES OF RANDOM WALKS ON DYNAMIC CONFIGURATION MODELS Frank den Hollander Leiden University, The Netherlands New Results and Challenges with RWDRE, 11 13 January 2017, Heilbronn Institute for Mathematical

More information

STAT STOCHASTIC PROCESSES. Contents

STAT STOCHASTIC PROCESSES. Contents STAT 3911 - STOCHASTIC PROCESSES ANDREW TULLOCH Contents 1. Stochastic Processes 2 2. Classification of states 2 3. Limit theorems for Markov chains 4 4. First step analysis 5 5. Branching processes 5

More information

Central limit theorems for ergodic continuous-time Markov chains with applications to single birth processes

Central limit theorems for ergodic continuous-time Markov chains with applications to single birth processes Front. Math. China 215, 1(4): 933 947 DOI 1.17/s11464-15-488-5 Central limit theorems for ergodic continuous-time Markov chains with applications to single birth processes Yuanyuan LIU 1, Yuhui ZHANG 2

More information

Math Homework 5 Solutions

Math Homework 5 Solutions Math 45 - Homework 5 Solutions. Exercise.3., textbook. The stochastic matrix for the gambler problem has the following form, where the states are ordered as (,, 4, 6, 8, ): P = The corresponding diagram

More information

Performance Evaluation of Queuing Systems

Performance Evaluation of Queuing Systems Performance Evaluation of Queuing Systems Introduction to Queuing Systems System Performance Measures & Little s Law Equilibrium Solution of Birth-Death Processes Analysis of Single-Station Queuing Systems

More information

Dynamic modelling of morphology development in multiphase latex particle Elena Akhmatskaya (BCAM) and Jose M. Asua (POLYMAT) June

Dynamic modelling of morphology development in multiphase latex particle Elena Akhmatskaya (BCAM) and Jose M. Asua (POLYMAT) June Dynamic modelling of morphology development in multiphase latex particle Elena Akhmatskaya (BCAM) and Jose M. Asua (POLYMAT) June 7 2012 Publications (background and output) J.M. Asua, E. Akhmatskaya Dynamic

More information

Threshold Parameter for a Random Graph Epidemic Model

Threshold Parameter for a Random Graph Epidemic Model Advances in Applied Mathematical Biosciences. ISSN 2248-9983 Volume 5, Number 1 (2014), pp. 35-41 International Research Publication House http://www.irphouse.com Threshold Parameter for a Random Graph

More information

Readings: Finish Section 5.2

Readings: Finish Section 5.2 LECTURE 19 Readings: Finish Section 5.2 Lecture outline Markov Processes I Checkout counter example. Markov process: definition. -step transition probabilities. Classification of states. Example: Checkout

More information