Re-entrant transition in a one-dimensional growth model
|
|
- Hope Sanders
- 5 years ago
- Views:
Transcription
1 Re-entrant transition in a one-dimensional growth model Ostap Hryniv Dept. of Mathematical Sciences Durham University Ostap.Hryniv@durham.ac.uk X International Conference Stochastic and Analytic Methods in Mathematical Physics Yerevan, Armenia, September 4 11, 2016
2 Outline Model Motivation Heuristics Results and Ideas Conclusions (partially based on a joint work with A. Letcher and D. Sheard)
3 The model State space long polymer chains made of and monomers Dynamics: Growth: attachment of a monomer:... =... rate λ +... =... rate λ Conversion: independent transformation : = rate 1 Shrinking: detachment of the extreme monomer:... =... rate µ Want: long term behaviour of the process.
4 Motivation relatively simple growth model, only two types of particle, three parameters a version of a model suggested in [Antal et al PRE 2007] to describe microtubule dynamics wild fluctuation under steady state; rich dynamics within a simple soluble model; various approximations via the Master equation a non-reversible model exhibiting metastable behaviour; interesting phase transition
5 What are microtubules? Microtubules are one of the components of the cytoskeleton. They have a diameter of 25 nm and length varying from 200 nm to 25 µm. [ [Howard & Hyman, Nature 2003]
6 Microtubule structure and dynamics Microtubules are polymers made of protofilaments organised into an imperfect helix. Protofilaments, in their turn, consist of α- and β-tubulin dimers. [Howard & Hyman, Nature 2003]
7 Microtubule dynamics During polymerization, both the α- and β-subunits of the tubulin dimer are bound to a molecule of GTP. While the GTP bound to α-tubulin is stable, the GTP bound to β-tubulin may hydrolyze to GDP after assembly. The GDP-tubulin leads to depolymerization of the tubulin dimers at the microtubule tip: [Howard & Hyman, Nature 2003]
8 Single microtubule dynamics Growth: µm/min (ie., dimers/sec); shrinking about 10 times faster: The model mimics the experimental data [Fygenson et al, PRE 1994] [avi]
9 Heuristics Microtubles long chains made of and monomers (guanosin triphosphate (GTP + ) and guanosin diphosphate (GDP ) tubulin complexes) Microtubules (position, head), ie., a Markov process y t (x t, w t ), t 0 ; The head process (w t ) t 0, is a non-reversible Markov chain in W = { } { w = w, where w is a finite word of and } State is recurrent for w t ; leads to a useful renewal structure. [alternating -cycles and -cycles]
10 Empty-head process Let 0 = τ 0 < τ 1 <... be times of consecutive returns of w t to. def Put ỹ l y τl = (x τl, ) with x l x τl, a CTRW in Z. Key facts: [HM 10, H 12] The space-time increments of x l have exponential moments in a neighbourhood of the origin; [cluster expansion lemma!] Many classical results (SLLN, CLT, LDP,... ) hold; The velocity v of x t is given by x t v lim t t = E x 1/E τ 1 (a.s.) ; it is analytic in λ +, λ and µ. Phase boundary {v = 0} separates the compact phase (v < 0) from the region of indefinite growth (v > 0).
11 Explicit expression for v? w t irreducible, positive recurrent MC in W with stat. dist. π; put π + = π ( {w W : w 0 = } ), π = 1 π +. Write v + λ + > 0 and v λ µ. By the Ergodic theorem, x t v = lim t t = π + v + + π v (a.s.). If λ > µ (ie., v > 0), then v > 0 and x t +. However, no good control of π + (π ), but finite-window approximations for π give v > 0 for µ λ (1 + λ + ). [HM 10] asymptotically correct for small λ ± [Antal et al PRE 2007]
12 Lifetimes (region v < 0) Eventually, every monomer detaches from the microtubule; let T min { t > 0 : y t = ( 1, ) y 0 = (0, ) }, T min { t > 0 : y t = ( 1, ) y 0 = (0, ) }. Clearly, T stochastically dominates T. Can show 1 + µ ET = λ ET ; so that ET < iff ET < ; moreover, for small s > 0, v < 0 E T < E e st <. Actually, in this region, one has v = 1/ET < 0. Can also relate ϕ (s) def = Ee st and ϕ (s) def = Ee st. [HM 10]
13 Further results Regular phase Theorem [H 12] Let λ λ +. Then v is a strictly monotone function of the rates λ +, λ, and µ, with partial derivatives v λ + > 0, v λ > 0, v µ < 0. [natural monotonicity properties] Non-strict monotonicity: via coupling. Strict monotonicity: via large deviations and the Ergodic theorem.
14 Numerics Re-entrant phase transition Microtubule velocity; Lam+ = 10 Lam- = 0.01 Lam- = 0.03 Lam- = 0.05 Lam- = Velocity Mu
15 Microtubule velocity; Lam+ = 10 Lam- = 0.01 Lam- = 0.03 Lam- = 0.05 Lam- = Velocity Mu
16 Re-entrant phase transition Theorem: Fix λ + large and λ small. Then v = v(µ) changes sign three times. For µ small : if µ < 1, the -cycle often stops once the extreme monomer hydrolyzes, ; there is exactly one intersection point (v = 0) with µ = O(λ + ).
17 Re-entrant phase transition Large µ heuristics: if µ = +, x t is an additive functional of the classical birth-and-death process; gives complete control of the asymptotic behaviour; if µ < but still large, use cluster expansions around the µ = case (λ contribution is still small); the argument relies upon the statistical homogeneity of the trajectories of y t at the microscopic level and sharp control of the metastable behaviour of the related birh and death process.
18 Conclusions The model behaves naturally for λ λ + ( regular phase), while for some pairs (λ +, λ ) with λ < λ + a re-entrant transition is observed (faster shrinking rate can increase the velocity); Description of the whole region (λ, λ + ) exhibiting the re-entrant transition still lacking; More advanced models in the spirit of [Piette et al 2009] are of interest (eg., allow the extreme to detach; some results are available);...
19 References T.Antal, P.L.Krapivsky, S.Redner, M.Mailman, and B.Chakraborty. Dynamics of an Idealized Model of Microtubule Growth and Catastrophe. Phys. Rev. E76, (2007). B.M.A.G.Piette, J.Liu, K.Peeters, A.Smertenko, T.Hawkins, M.Deeks, R.Quinlan, W.J.Zakrzewski, and P.J.Hussey. A Thermodynamic Model of Microtubule Assembly and Disassembly. PLoS ONE 4(8): e6378 (2009). OH, M.Menshikov. Long-time behaviour in a model of microtubule growth. Adv. Appl. Prob. 42, (2010). OH. Regular phase in a model of microtubule growth. Markov Processes and Related Fields 18(2): (2012). OH, A. Letcher and D. Sheard. Re-entrant phase transition in a model of microtubule growth. [in preparation]
monomer polymer polymeric network cell
3.1 Motivation 3.2 Polymerization The structural stability of the cell is provided by the cytoskeleton. Assembling and disassembling dynamically, the cytoskeleton enables cell movement through a highly
More informationDynamics of Microtubule Growth & Catastrophe
Dynamics of Microtubule Growth & Catastrophe T. Antal, P. Krapivsky, SR, M. Mailman, B. Chakraborty, q-bio/0703001 U Mass Amherst, March 15, 2007 Basic question: Why do microtubules fluctuate wildly under
More informationPhysics of Cellular materials: Filaments
Physics of Cellular materials: Filaments Tom Chou Dept. of Biomathematics, UCLA, Los Angeles, CA 995-766 (Dated: December 6, ) The basic filamentary structures in a cell are reviewed. Their basic structures
More informationarxiv:q-bio/ v2 [q-bio.qm] 22 Apr 2008
Dynamics of an Idealized Model of Microtubule Growth and Catastrophe T. Antal, 1 P. L. Krapivsky, 2 S. Redner, 2 M. Mailman, 3 and B. Chakraborty 3 1 Program for Evolutionary Dynamics, Harvard University,
More informationRecap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks
Recap Probability, stochastic processes, Markov chains ELEC-C7210 Modeling and analysis of communication networks 1 Recap: Probability theory important distributions Discrete distributions Geometric distribution
More informationDynamics of an idealized model of microtubule growth and catastrophe
PHYSICAL REVIEW E 76, 041907 2007 Dynamics of an idealized model of microtubule growth and catastrophe T. Antal, 1 P. L. Krapivsky, 2 S. Redner, 2 M. Mailman, 3 and B. Chakraborty 3 1 Program for Evolutionary
More informationMonte Carlo simulations of rigid biopolymer growth processes
THE JOURNAL OF CHEMICAL PHYSICS 123, 124902 2005 Monte Carlo simulations of rigid biopolymer growth processes Jenny Son and G. Orkoulas a Department of Chemical and Biomolecular Engineering, University
More informationMarkov Chains. X(t) is a Markov Process if, for arbitrary times t 1 < t 2 <... < t k < t k+1. If X(t) is discrete-valued. If X(t) is continuous-valued
Markov Chains X(t) is a Markov Process if, for arbitrary times t 1 < t 2
More informationFunctional Limit theorems for the quadratic variation of a continuous time random walk and for certain stochastic integrals
Functional Limit theorems for the quadratic variation of a continuous time random walk and for certain stochastic integrals Noèlia Viles Cuadros BCAM- Basque Center of Applied Mathematics with Prof. Enrico
More informationNon-homogeneous random walks on a semi-infinite strip
Non-homogeneous random walks on a semi-infinite strip Chak Hei Lo Joint work with Andrew R. Wade World Congress in Probability and Statistics 11th July, 2016 Outline Motivation: Lamperti s problem Our
More informationTransport of single molecules along the periodic parallel lattices with coupling
THE JOURNAL OF CHEMICAL PHYSICS 124 204901 2006 Transport of single molecules along the periodic parallel lattices with coupling Evgeny B. Stukalin The James Franck Institute The University of Chicago
More informationPolymerization and force generation
Polymerization and force generation by Eric Cytrynbaum April 8, 2008 Equilibrium polymer in a box An equilibrium polymer is a polymer has no source of extraneous energy available to it. This does not mean
More informationStability and Rare Events in Stochastic Models Sergey Foss Heriot-Watt University, Edinburgh and Institute of Mathematics, Novosibirsk
Stability and Rare Events in Stochastic Models Sergey Foss Heriot-Watt University, Edinburgh and Institute of Mathematics, Novosibirsk ANSAPW University of Queensland 8-11 July, 2013 1 Outline (I) Fluid
More informationMarkov Processes Hamid R. Rabiee
Markov Processes Hamid R. Rabiee Overview Markov Property Markov Chains Definition Stationary Property Paths in Markov Chains Classification of States Steady States in MCs. 2 Markov Property A discrete
More informationt For l = 1 a monomer cannot be destroyed or created from nothing: = b p(2,t) a p(1,t).
IITS: Statistical Physics in Biology Assignment # 5 KU Leuven 5/31/2013 Drift, Diffusion, and Dynamic Instability 1. Treadmilling Actin: Actin filaments are long, asymmetric, polymers involved in a variety
More informationIrreducibility. Irreducible. every state can be reached from every other state For any i,j, exist an m 0, such that. Absorbing state: p jj =1
Irreducibility Irreducible every state can be reached from every other state For any i,j, exist an m 0, such that i,j are communicate, if the above condition is valid Irreducible: all states are communicate
More informationMARKOV PROCESSES. Valerio Di Valerio
MARKOV PROCESSES Valerio Di Valerio Stochastic Process Definition: a stochastic process is a collection of random variables {X(t)} indexed by time t T Each X(t) X is a random variable that satisfy some
More informationMarkov processes and queueing networks
Inria September 22, 2015 Outline Poisson processes Markov jump processes Some queueing networks The Poisson distribution (Siméon-Denis Poisson, 1781-1840) { } e λ λ n n! As prevalent as Gaussian distribution
More informationMatrix analytic methods. Lecture 1: Structured Markov chains and their stationary distribution
1/29 Matrix analytic methods Lecture 1: Structured Markov chains and their stationary distribution Sophie Hautphenne and David Stanford (with thanks to Guy Latouche, U. Brussels and Peter Taylor, U. Melbourne
More informationMarkov Chains CK eqns Classes Hitting times Rec./trans. Strong Markov Stat. distr. Reversibility * Markov Chains
Markov Chains A random process X is a family {X t : t T } of random variables indexed by some set T. When T = {0, 1, 2,... } one speaks about a discrete-time process, for T = R or T = [0, ) one has a continuous-time
More informationA large deviation principle for a RWRC in a box
A large deviation principle for a RWRC in a box 7th Cornell Probability Summer School Michele Salvi TU Berlin July 12, 2011 Michele Salvi (TU Berlin) An LDP for a RWRC in a nite box July 12, 2011 1 / 15
More informationStochastic process. X, a series of random variables indexed by t
Stochastic process X, a series of random variables indexed by t X={X(t), t 0} is a continuous time stochastic process X={X(t), t=0,1, } is a discrete time stochastic process X(t) is the state at time t,
More informationChapter 5. Continuous-Time Markov Chains. Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan
Chapter 5. Continuous-Time Markov Chains Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan Continuous-Time Markov Chains Consider a continuous-time stochastic process
More informationStatistics 150: Spring 2007
Statistics 150: Spring 2007 April 23, 2008 0-1 1 Limiting Probabilities If the discrete-time Markov chain with transition probabilities p ij is irreducible and positive recurrent; then the limiting probabilities
More informationSTOCHASTIC PROCESSES Basic notions
J. Virtamo 38.3143 Queueing Theory / Stochastic processes 1 STOCHASTIC PROCESSES Basic notions Often the systems we consider evolve in time and we are interested in their dynamic behaviour, usually involving
More informationBME Engineering Molecular Cell Biology. Basics of the Diffusion Theory. The Cytoskeleton (I)
BME 42-620 Engineering Molecular Cell Biology Lecture 07: Basics of the Diffusion Theory The Cytoskeleton (I) BME42-620 Lecture 07, September 20, 2011 1 Outline Diffusion: microscopic theory Diffusion:
More informationCDA6530: Performance Models of Computers and Networks. Chapter 3: Review of Practical Stochastic Processes
CDA6530: Performance Models of Computers and Networks Chapter 3: Review of Practical Stochastic Processes Definition Stochastic process X = {X(t), t2 T} is a collection of random variables (rvs); one rv
More informationStochastic Processes. Theory for Applications. Robert G. Gallager CAMBRIDGE UNIVERSITY PRESS
Stochastic Processes Theory for Applications Robert G. Gallager CAMBRIDGE UNIVERSITY PRESS Contents Preface page xv Swgg&sfzoMj ybr zmjfr%cforj owf fmdy xix Acknowledgements xxi 1 Introduction and review
More informationMultivariate Risk Processes with Interacting Intensities
Multivariate Risk Processes with Interacting Intensities Nicole Bäuerle (joint work with Rudolf Grübel) Luminy, April 2010 Outline Multivariate pure birth processes Multivariate Risk Processes Fluid Limits
More informationIEOR 6711, HMWK 5, Professor Sigman
IEOR 6711, HMWK 5, Professor Sigman 1. Semi-Markov processes: Consider an irreducible positive recurrent discrete-time Markov chain {X n } with transition matrix P (P i,j ), i, j S, and finite state space.
More informationEXTINCTION TIMES FOR A GENERAL BIRTH, DEATH AND CATASTROPHE PROCESS
J. Appl. Prob. 41, 1211 1218 (2004) Printed in Israel Applied Probability Trust 2004 EXTINCTION TIMES FOR A GENERAL BIRTH, DEATH AND CATASTROPHE PROCESS BEN CAIRNS and P. K. POLLETT, University of Queensland
More informationThe Role of Multifilament Structures and Lateral Interactions in Dynamics of Cytoskeleton Proteins and Assemblies
pubs.acs.org/jpcb he Role of Multifilament Structures and Lateral Interactions in Dynamics of Cytoskeleton Proteins and Assemblies Xin Li and Anatoly B. Kolomeisky* Rice niversity, Department of Chemistry
More informationForce-Velocity Relation for Growing Microtubules
Biophysical Journal Volume 80 January 2001 149 154 149 Force-Velocity Relation for Growing Microtubules Anatoly B. Kolomeisky* and Michael E. Fisher *Department of Chemistry, Rice University, Houston,
More informationSec. 2.1 Filaments in the cell 21 PART I - RODS AND ROPES
Sec. 2.1 Filaments in the cell 21 PART I - RODS AND ROPES Sec. 2.1 Filaments in the cell 22 CHAPTER 2 - POLYMERS The structural elements of the cell can be broadly classified as filaments or sheets, where
More informationNeurite formation & neuronal polarization. The cytoskeletal components of neurons have characteristic distributions and associations
Mechanisms of neuronal migration & Neurite formation & neuronal polarization Paul Letourneau letou001@umn.edu Chapter 16; The Cytoskeleton; Molecular Biology of the Cell, Alberts et al. 1 The cytoskeletal
More informationAsymptotic properties of the maximum likelihood estimator for a ballistic random walk in a random environment
Asymptotic properties of the maximum likelihood estimator for a ballistic random walk in a random environment Catherine Matias Joint works with F. Comets, M. Falconnet, D.& O. Loukianov Currently: Laboratoire
More informationLecture Notes 7 Random Processes. Markov Processes Markov Chains. Random Processes
Lecture Notes 7 Random Processes Definition IID Processes Bernoulli Process Binomial Counting Process Interarrival Time Process Markov Processes Markov Chains Classification of States Steady State Probabilities
More informationNeurite formation & neuronal polarization
Neurite formation & neuronal polarization Paul Letourneau letou001@umn.edu Chapter 16; The Cytoskeleton; Molecular Biology of the Cell, Alberts et al. 1 An immature neuron in cell culture first sprouts
More informationThe range of tree-indexed random walk
The range of tree-indexed random walk Jean-François Le Gall, Shen Lin Institut universitaire de France et Université Paris-Sud Orsay Erdös Centennial Conference July 2013 Jean-François Le Gall (Université
More informationModeling with Itô Stochastic Differential Equations
Modeling with Itô Stochastic Differential Equations 2.4-2.6 E. Allen presentation by T. Perälä 27.0.2009 Postgraduate seminar on applied mathematics 2009 Outline Hilbert Space of Stochastic Processes (
More informationA theoretical analysis of filament length fluctuations in actin and other polymers
Journal of Mathematical Biology manuscript No. (will be inserted by the editor) Jifeng Hu Hans G. Othmer A theoretical analysis of filament length fluctuations in actin and other polymers c Springer-Verlag
More informationEXTINCTION TIMES FOR A GENERAL BIRTH, DEATH AND CATASTROPHE PROCESS
(February 25, 2004) EXTINCTION TIMES FOR A GENERAL BIRTH, DEATH AND CATASTROPHE PROCESS BEN CAIRNS, University of Queensland PHIL POLLETT, University of Queensland Abstract The birth, death and catastrophe
More informationOn the stall force for growing microtubules
Eur Biophys J (2000) 29: 2±6 Ó Springer-Verlag 2000 ARTICLE G. Sander van Doorn á Catalin Tanase á Bela M. Mulder Marileen Dogterom On the stall force for growing microtubules Received: 27 September 1999
More informationHandbook of Stochastic Methods
C. W. Gardiner Handbook of Stochastic Methods for Physics, Chemistry and the Natural Sciences Third Edition With 30 Figures Springer Contents 1. A Historical Introduction 1 1.1 Motivation I 1.2 Some Historical
More information2. Transience and Recurrence
Virtual Laboratories > 15. Markov Chains > 1 2 3 4 5 6 7 8 9 10 11 12 2. Transience and Recurrence The study of Markov chains, particularly the limiting behavior, depends critically on the random times
More informationOutlines. Discrete Time Markov Chain (DTMC) Continuous Time Markov Chain (CTMC)
Markov Chains (2) Outlines Discrete Time Markov Chain (DTMC) Continuous Time Markov Chain (CTMC) 2 pj ( n) denotes the pmf of the random variable p ( n) P( X j) j We will only be concerned with homogenous
More informationA Method for Evaluating the Distribution of the Total Cost of a Random Process over its Lifetime
A Method for Evaluating the Distribution of the Total Cost of a Random Process over its Lifetime P.K. Pollett a and V.T. Stefanov b a Department of Mathematics, The University of Queensland Queensland
More informationCDA5530: Performance Models of Computers and Networks. Chapter 3: Review of Practical
CDA5530: Performance Models of Computers and Networks Chapter 3: Review of Practical Stochastic Processes Definition Stochastic ti process X = {X(t), t T} is a collection of random variables (rvs); one
More informationLIMITS FOR QUEUES AS THE WAITING ROOM GROWS. Bell Communications Research AT&T Bell Laboratories Red Bank, NJ Murray Hill, NJ 07974
LIMITS FOR QUEUES AS THE WAITING ROOM GROWS by Daniel P. Heyman Ward Whitt Bell Communications Research AT&T Bell Laboratories Red Bank, NJ 07701 Murray Hill, NJ 07974 May 11, 1988 ABSTRACT We study the
More informationMarkov chains. Randomness and Computation. Markov chains. Markov processes
Markov chains Randomness and Computation or, Randomized Algorithms Mary Cryan School of Informatics University of Edinburgh Definition (Definition 7) A discrete-time stochastic process on the state space
More informationA review of Continuous Time MC STA 624, Spring 2015
A review of Continuous Time MC STA 624, Spring 2015 Ruriko Yoshida Dept. of Statistics University of Kentucky polytopes.net STA 624 1 Continuous Time Markov chains Definition A continuous time stochastic
More information8. Statistical Equilibrium and Classification of States: Discrete Time Markov Chains
8. Statistical Equilibrium and Classification of States: Discrete Time Markov Chains 8.1 Review 8.2 Statistical Equilibrium 8.3 Two-State Markov Chain 8.4 Existence of P ( ) 8.5 Classification of States
More informationMean-field dual of cooperative reproduction
The mean-field dual of systems with cooperative reproduction joint with Tibor Mach (Prague) A. Sturm (Göttingen) Friday, July 6th, 2018 Poisson construction of Markov processes Let (X t ) t 0 be a continuous-time
More informationThe fate of beneficial mutations in a range expansion
The fate of beneficial mutations in a range expansion R. Lehe (Paris) O. Hallatschek (Göttingen) L. Peliti (Naples) February 19, 2015 / Rutgers Outline Introduction The model Results Analysis Range expansion
More informationLecture 11: Introduction to Markov Chains. Copyright G. Caire (Sample Lectures) 321
Lecture 11: Introduction to Markov Chains Copyright G. Caire (Sample Lectures) 321 Discrete-time random processes A sequence of RVs indexed by a variable n 2 {0, 1, 2,...} forms a discretetime random process
More informationCover Page. The handle holds various files of this Leiden University dissertation
Cover Page The handle http://hdlhandlenet/1887/39637 holds various files of this Leiden University dissertation Author: Smit, Laurens Title: Steady-state analysis of large scale systems : the successive
More informationLecture 7. We can regard (p(i, j)) as defining a (maybe infinite) matrix P. Then a basic fact is
MARKOV CHAINS What I will talk about in class is pretty close to Durrett Chapter 5 sections 1-5. We stick to the countable state case, except where otherwise mentioned. Lecture 7. We can regard (p(i, j))
More informationDISCRETE STOCHASTIC PROCESSES Draft of 2nd Edition
DISCRETE STOCHASTIC PROCESSES Draft of 2nd Edition R. G. Gallager January 31, 2011 i ii Preface These notes are a draft of a major rewrite of a text [9] of the same name. The notes and the text are outgrowths
More informationTime Reversibility and Burke s Theorem
Queuing Analysis: Time Reversibility and Burke s Theorem Hongwei Zhang http://www.cs.wayne.edu/~hzhang Acknowledgement: this lecture is partially based on the slides of Dr. Yannis A. Korilis. Outline Time-Reversal
More informationarxiv: v1 [cond-mat.soft] 12 Sep 2008
arxiv:0809.2228v1 [cond-mat.soft] 12 Sep 2008 Non-equilibrium self-assembly of a filament coupled to ATP/GTP hydrolysis Padinhateeri Ranjith 1 Physico-Chimie UMR 168 Institut Curie, 26 rue d Ulm 75248
More informationLecture 20: Reversible Processes and Queues
Lecture 20: Reversible Processes and Queues 1 Examples of reversible processes 11 Birth-death processes We define two non-negative sequences birth and death rates denoted by {λ n : n N 0 } and {µ n : n
More informationStochastic Models: Markov Chains and their Generalizations
Scuola di Dottorato in Scienza ed Alta Tecnologia Dottorato in Informatica Universita di Torino Stochastic Models: Markov Chains and their Generalizations Gianfranco Balbo e Andras Horvath Outline Introduction
More informationBen Pence Scott Moura. December 12, 2009
Ben Pence Scott Moura EECS 558 Project December 12, 2009 SLIDE 1of 24 Stochastic system with unknown parameters Want to identify the parameters Adapt the control based on the parameter estimate Identifiability
More informationLet (Ω, F) be a measureable space. A filtration in discrete time is a sequence of. F s F t
2.2 Filtrations Let (Ω, F) be a measureable space. A filtration in discrete time is a sequence of σ algebras {F t } such that F t F and F t F t+1 for all t = 0, 1,.... In continuous time, the second condition
More informationOutline. Input to state Stability. Nonlinear Realization. Recall: _ Space. _ Space: Space of all piecewise continuous functions
Outline Input to state Stability Motivation for Input to State Stability (ISS) ISS Lyapunov function. Stability theorems. M. Sami Fadali Professor EBME University of Nevada, Reno 1 2 Recall: _ Space _
More informationExistence, Uniqueness and Stability of Invariant Distributions in Continuous-Time Stochastic Models
Existence, Uniqueness and Stability of Invariant Distributions in Continuous-Time Stochastic Models Christian Bayer and Klaus Wälde Weierstrass Institute for Applied Analysis and Stochastics and University
More informationprocess on the hierarchical group
Intertwining of Markov processes and the contact process on the hierarchical group April 27, 2010 Outline Intertwining of Markov processes Outline Intertwining of Markov processes First passage times of
More informationA limit theorem for the moments in space of Browian local time increments
A limit theorem for the moments in space of Browian local time increments Simon Campese LMS EPSRC Durham Symposium July 18, 2017 Motivation Theorem (Marcus, Rosen, 2006) As h 0, L x+h t L x t h q dx a.s.
More informationPopulation Games and Evolutionary Dynamics
Population Games and Evolutionary Dynamics William H. Sandholm The MIT Press Cambridge, Massachusetts London, England in Brief Series Foreword Preface xvii xix 1 Introduction 1 1 Population Games 2 Population
More information25.1 Ergodicity and Metric Transitivity
Chapter 25 Ergodicity This lecture explains what it means for a process to be ergodic or metrically transitive, gives a few characterizes of these properties (especially for AMS processes), and deduces
More informationExamples of Countable State Markov Chains Thursday, October 16, :12 PM
stochnotes101608 Page 1 Examples of Countable State Markov Chains Thursday, October 16, 2008 12:12 PM Homework 2 solutions will be posted later today. A couple of quick examples. Queueing model (without
More informationSTOCHASTIC CHEMICAL KINETICS
STOCHASTIC CHEICAL KINETICS Dan Gillespie GillespieDT@mailaps.org Current Support: Caltech (NIGS) Caltech (NIH) University of California at Santa Barbara (NIH) Past Support: Caltech (DARPA/AFOSR, Beckman/BNC))
More informationBrownian Bridge and Self-Avoiding Random Walk.
Brownian Bridge and Self-Avoiding Random Walk. arxiv:math/02050v [math.pr] 9 May 2002 Yevgeniy Kovchegov Email: yevgeniy@math.stanford.edu Fax: -650-725-4066 November 2, 208 Abstract We derive the Brownian
More informationMarkov Chains (Part 4)
Markov Chains (Part 4) Steady State Probabilities and First Passage Times Markov Chains - 1 Steady-State Probabilities Remember, for the inventory example we had (8) P &.286 =.286.286 %.286 For an irreducible
More informationMarkov Chain Monte Carlo The Metropolis-Hastings Algorithm
Markov Chain Monte Carlo The Metropolis-Hastings Algorithm Anthony Trubiano April 11th, 2018 1 Introduction Markov Chain Monte Carlo (MCMC) methods are a class of algorithms for sampling from a probability
More informationPositive and null recurrent-branching Process
December 15, 2011 In last discussion we studied the transience and recurrence of Markov chains There are 2 other closely related issues about Markov chains that we address Is there an invariant distribution?
More informationGARCH processes probabilistic properties (Part 1)
GARCH processes probabilistic properties (Part 1) Alexander Lindner Centre of Mathematical Sciences Technical University of Munich D 85747 Garching Germany lindner@ma.tum.de http://www-m1.ma.tum.de/m4/pers/lindner/
More information1 Lyapunov theory of stability
M.Kawski, APM 581 Diff Equns Intro to Lyapunov theory. November 15, 29 1 1 Lyapunov theory of stability Introduction. Lyapunov s second (or direct) method provides tools for studying (asymptotic) stability
More informationPositive Harris Recurrence and Diffusion Scale Analysis of a Push Pull Queueing Network. Haifa Statistics Seminar May 5, 2008
Positive Harris Recurrence and Diffusion Scale Analysis of a Push Pull Queueing Network Yoni Nazarathy Gideon Weiss Haifa Statistics Seminar May 5, 2008 1 Outline 1 Preview of Results 2 Introduction Queueing
More informationBirth and Death Processes. Birth and Death Processes. Linear Growth with Immigration. Limiting Behaviour for Birth and Death Processes
DTU Informatics 247 Stochastic Processes 6, October 27 Today: Limiting behaviour of birth and death processes Birth and death processes with absorbing states Finite state continuous time Markov chains
More informationLecture 4a: Continuous-Time Markov Chain Models
Lecture 4a: Continuous-Time Markov Chain Models Continuous-time Markov chains are stochastic processes whose time is continuous, t [0, ), but the random variables are discrete. Prominent examples of continuous-time
More informationSession-Based Queueing Systems
Session-Based Queueing Systems Modelling, Simulation, and Approximation Jeroen Horters Supervisor VU: Sandjai Bhulai Executive Summary Companies often offer services that require multiple steps on the
More informationAt the boundary states, we take the same rules except we forbid leaving the state space, so,.
Birth-death chains Monday, October 19, 2015 2:22 PM Example: Birth-Death Chain State space From any state we allow the following transitions: with probability (birth) with probability (death) with probability
More informationHandbook of Stochastic Methods
Springer Series in Synergetics 13 Handbook of Stochastic Methods for Physics, Chemistry and the Natural Sciences von Crispin W Gardiner Neuausgabe Handbook of Stochastic Methods Gardiner schnell und portofrei
More informationGillespie s Algorithm and its Approximations. Des Higham Department of Mathematics and Statistics University of Strathclyde
Gillespie s Algorithm and its Approximations Des Higham Department of Mathematics and Statistics University of Strathclyde djh@maths.strath.ac.uk The Three Lectures 1 Gillespie s algorithm and its relation
More information(b) What is the variance of the time until the second customer arrives, starting empty, assuming that we measure time in minutes?
IEOR 3106: Introduction to Operations Research: Stochastic Models Fall 2006, Professor Whitt SOLUTIONS to Final Exam Chapters 4-7 and 10 in Ross, Tuesday, December 19, 4:10pm-7:00pm Open Book: but only
More informationarxiv: v2 [math.pr] 4 Sep 2017
arxiv:1708.08576v2 [math.pr] 4 Sep 2017 On the Speed of an Excited Asymmetric Random Walk Mike Cinkoske, Joe Jackson, Claire Plunkett September 5, 2017 Abstract An excited random walk is a non-markovian
More informationFluctuation theorems. Proseminar in theoretical physics Vincent Beaud ETH Zürich May 11th 2009
Fluctuation theorems Proseminar in theoretical physics Vincent Beaud ETH Zürich May 11th 2009 Outline Introduction Equilibrium systems Theoretical background Non-equilibrium systems Fluctuations and small
More informationTheory of Stochastic Processes 3. Generating functions and their applications
Theory of Stochastic Processes 3. Generating functions and their applications Tomonari Sei sei@mist.i.u-tokyo.ac.jp Department of Mathematical Informatics, University of Tokyo April 20, 2017 http://www.stat.t.u-tokyo.ac.jp/~sei/lec.html
More informationThe Minesweeper game: Percolation and Complexity
The Minesweeper game: Percolation and Complexity Elchanan Mossel Hebrew University of Jerusalem and Microsoft Research March 15, 2002 Abstract We study a model motivated by the minesweeper game In this
More informationThe SIS and SIR stochastic epidemic models revisited
The SIS and SIR stochastic epidemic models revisited Jesús Artalejo Faculty of Mathematics, University Complutense of Madrid Madrid, Spain jesus_artalejomat.ucm.es BCAM Talk, June 16, 2011 Talk Schedule
More informationRare event simulation for the ruin problem with investments via importance sampling and duality
Rare event simulation for the ruin problem with investments via importance sampling and duality Jerey Collamore University of Copenhagen Joint work with Anand Vidyashankar (GMU) and Guoqing Diao (GMU).
More informationMIXING TIMES OF RANDOM WALKS ON DYNAMIC CONFIGURATION MODELS
MIXING TIMES OF RANDOM WALKS ON DYNAMIC CONFIGURATION MODELS Frank den Hollander Leiden University, The Netherlands New Results and Challenges with RWDRE, 11 13 January 2017, Heilbronn Institute for Mathematical
More informationSTAT STOCHASTIC PROCESSES. Contents
STAT 3911 - STOCHASTIC PROCESSES ANDREW TULLOCH Contents 1. Stochastic Processes 2 2. Classification of states 2 3. Limit theorems for Markov chains 4 4. First step analysis 5 5. Branching processes 5
More informationCentral limit theorems for ergodic continuous-time Markov chains with applications to single birth processes
Front. Math. China 215, 1(4): 933 947 DOI 1.17/s11464-15-488-5 Central limit theorems for ergodic continuous-time Markov chains with applications to single birth processes Yuanyuan LIU 1, Yuhui ZHANG 2
More informationMath Homework 5 Solutions
Math 45 - Homework 5 Solutions. Exercise.3., textbook. The stochastic matrix for the gambler problem has the following form, where the states are ordered as (,, 4, 6, 8, ): P = The corresponding diagram
More informationPerformance Evaluation of Queuing Systems
Performance Evaluation of Queuing Systems Introduction to Queuing Systems System Performance Measures & Little s Law Equilibrium Solution of Birth-Death Processes Analysis of Single-Station Queuing Systems
More informationDynamic modelling of morphology development in multiphase latex particle Elena Akhmatskaya (BCAM) and Jose M. Asua (POLYMAT) June
Dynamic modelling of morphology development in multiphase latex particle Elena Akhmatskaya (BCAM) and Jose M. Asua (POLYMAT) June 7 2012 Publications (background and output) J.M. Asua, E. Akhmatskaya Dynamic
More informationThreshold Parameter for a Random Graph Epidemic Model
Advances in Applied Mathematical Biosciences. ISSN 2248-9983 Volume 5, Number 1 (2014), pp. 35-41 International Research Publication House http://www.irphouse.com Threshold Parameter for a Random Graph
More informationReadings: Finish Section 5.2
LECTURE 19 Readings: Finish Section 5.2 Lecture outline Markov Processes I Checkout counter example. Markov process: definition. -step transition probabilities. Classification of states. Example: Checkout
More information