Lecture 10. Theorem 1.1 [Ergodicity and extremality] A probability measure µ on (Ω, F) is ergodic for T if and only if it is an extremal point in M.
|
|
- Darrell Stokes
- 5 years ago
- Views:
Transcription
1 Lecture 10 1 Ergodic decomposition of invariant measures Let T : (Ω, F) (Ω, F) be measurable, and let M denote the space of T -invariant probability measures on (Ω, F). Then M is a convex set, although it might be empty. We will show that any measure µ M can be decomposed as mixtures of extremal elements of M, which are exactly the ergodic measures for T. Theorem 1.1 [Ergodicity and extremality] A probability measure µ on (Ω, F) is ergodic for T if and only if it is an extremal point in M. Proof. If µ M is not ergodic, then there exists A F with µ(a) (0, 1) and A is an invariant set for T. Let µ A (resp. µ A c) denote the restriction of µ to A (resp. A c ) and normalized to be a probability measure, i.e., µ A ( ) = µ(a ). µ(a) Then µ A and µ A c are distinct invariant probability measures for T, and µ = αµ A + (1 α)µ A c, where α = µ(a) (0, 1), which shows that µ is not extremal. Conversely, if µ M is not extremal, then µ = αµ 1 + (1 α)µ 2 for some α (0, 1) and distinct µ 1, µ 2 M. If µ was ergodic, then by the ergodic theorem, for any bounded measurable f on (Ω, F), A n f(ω) = f(ω) + f(t ω) + + f(t n 1 ω) n E µ [f] µ a.s. and in L 1 (Ω, F, µ). In particular, A n f(ω) also converges to E µ [f] almost surely w.r.t. µ 1 (resp. µ 2 ), and hence E µ1 [f] = E µ2 [f] = E µ [f]. Since f is any bounded measurable function, this implies that µ 1 = µ 2 = µ, a contradiction. Therefore given that µ is non-extremal, it cannot be ergodic. By applying the ergodic theorem to suitable test functions, one can prove: Lemma 1.1 [Singularity of ergodic measures] Distinct ergodic measures µ 1, µ 2 M are mutually singular. More specifically, there exists A I s.t. µ 1 (A) = µ 2 (A c ) = 1. Choquet s Theorem (see Lax [2, Section 13.4]) provides a decomposition of a metrizable compact convex subset K of a locally convex topological vector space in terms of the extremal points of K. Since the set of invariant probability measures M in general may not be compact, we will not appeal to Choquet s theorem. Instead, we will assume that (Ω, F) is a complete separable metric space with Borel σ-algebra, and appeal to the existence of regular conditional probability distributions. 1
2 Theorem 1.2 [Ergodic decomposition] Let Ω be a complete separable metric space with Borel σ-algebra F. Let T be a measurable transformation on (Ω, F) and let M denote the set of probability measures on (Ω, F) invariant w.r.t. T. Then for any µ M, there exists a probability measure ρ µ on the set of ergodic measures such that µ = ν ρ µ (dν). (1.1) Remark. The σ-algebra we use for defining ρ µ on M is the Borel σ-algebra induced by the weak topology on M, i.e., µ n µ in M w.r.t. the weak topology if and only if for all bounded continuous functions f : Ω R, we have fdµ n fdµ. Such a convergence of probability measures on (Ω, F) is called weak convergence. Proof. Since (Ω, F) is Polish, there exists a regular conditional probability µ ω of µ conditional on the invariant σ-field I. Provided we can show that µ ω almost surely, we can regard µ ω as a map from Ω to, and denote the distribution of µ ω by ρ µ. The decomposition (1.1) then follows readily. We now verify that µ ω ( ) := µ( I) is ergodic µ a.s. First we show invariance, i.e., µ a.s., µ ω (A) = µ ω (T 1 A) A F. (1.2) A priori, there are uncountable number of sets in F, and the exceptional sets may pile up. However, by our assumption that (Ω, F) is Polish, F can be generated by a countable collection of sets F 0, and hence it suffices to verify (1.2) for A F 0 since µ ω is a probability measure a.s. Since µ ω ( ) = µ( I), given A F 0, µ ω (A) = µ ω (T 1 A) a.s. (i.e., µ(a I) = µ(t 1 A I) a.s.) if and only if µ(a E) = µ(t 1 A E) E I, which holds since E I implies that µ(e T 1 E) = 0, and µ(a E) = µ(t 1 (A E)). This proves the a.s. invariance of µ ω for T. For the a.s. ergodicity of µ ω, it suffices to show that for µ a.s. every µ ω, A F, A n 1 A (ω) := 1 A(ω) + 1 A (T ω) A (T n 1 ω) n µ ω (A) a.s. w.r.t. µ ω. (1.3) Approximating A F by sets that are finitely generated from F 0, it suffices to verify (1.3) for A F 0. For such an A, the ergodic theorem applied to 1 A w.r.t. µ implies that A n 1 A (ω) µ(a I) = µ ω (A) a.s. w.r.t. µ. Since µ ω is the regular conditional probability of µ given I, (1.3) must hold. 2 Structure of stationary Markov chains We now apply the ergodic decomposition theorem for stationary measures to stationary Markov chains. Let Π(x, dy) be a transition probability kernel on the state space (S, S). In this section, we will consider a general Polish space (S, S). A Markov process (X n ) n N is stationary if and only if its marginal distribution µ is stationary for Π. More precisely, µ M := {ν : ν(s) = 1, ν(a) = Π(x, A)ν(dx) A S}. Given marginal law µ M, we can embed the stationary Markov process (X n ) n N in a doubly infinite stationary sequence (X n ) n Z. The process (X n ) n Z can be regarded as a random 2 S
3 variable taking values in the sequence space (S Z, S Z ) where S Z denotes the product σ-algebra on the product space S Z. Given marginal law µ M, let P µ denote the law of (X n ) n Z on (S Z, S Z ). Let T denote the coordinate shift map on S Z. Then each µ M determines a P µ M, where M is the family of probability measures on (S Z, S Z ) invariant for the shift map T. Our goal is to show that the ergodic components of a stationary Markov process P µ are stationary Markov processes P ν with ν M, where ν are the extremal components of µ in M. (Note that in general, ergodic decomposition a stationary process gives ergodic processes which need not be Markov). Theorem 2.1 [Ergodic decomposition of stationary Markov processes] Given µ M, P µ is ergodic for the shift map T if and only if µ, i.e., µ is extremal in the family of invariant measures M for the Markov chain. Furthermore, for any µ M, there exists a probability measure ρ µ on such that µ = νρ µ (dν) and P µ = P ν ρ µ (dν). (2.1) The extremal elements of M are called the extremal or ergodic invariant measures. When M is a singleton, we say the Markov chain is ergodic. Proof. If µ M is not extremal, then neither is P µ extremal in M, which is equivalent to P µ not being ergodic. The key to proving the converse is the following result. Lemma 2.1 Let µ M, and let I be the invariant σ-field on (S Z, S Z ) for the shift map T and the measure P µ (note that we defined I modulo sets of P µ measure 0). Then within sets of P µ measure 0, I F 0 0, where F n m = σ(x m, x m+1,, x n ) on S Z = {(x i ) i Z : x i S}. Proof. The lemma shows that, for any E I, there exists A S such that E = {(x n ) n Z : x 0 A} modulo sets of P µ measure zero. The proof relies on the fact that invariant sets lie both in the infinite future F := n Fn, as well as the infinite past F := nf, n and the past and the future of a Markov process are independent conditioned on the present. Thus for E I, P µ [E F0 0 ] = P µ [E E F0 0 ] = P µ [E F0 0 ] 2. Therefore P µ [E F0 0] = 0 or 1 µ a.s. Let A S be the set on which P µ[e F0 0 ] = 1 a.s. Then by the invariance of E under the shift T, we have E = A Z := {(x n ) n Z S Z : x n A n Z} modulo sets of P µ measure zero, while E c = (A c ) Z. In particular, for µ almost all x S, if x A (resp. x A c ), then the Markov chain starting at x never leaves A (resp. A c ). Therefore, E = {(x n ) n Z S Z : x 0 A} modulo sets of P µ measure zero, which proves the lemma. With Lemma 2.1, we can conclude the proof of Theorem 2.1. Suppose that P µ is not ergodic, then P µ is a mixture of P µ [ I], which are ergodic measures on (S Z, S Z ). Since I F0 0 by Lemma 2.1, P µ[ I] are almost surely mixtures of P µ [ F0 0 ], which are measures of the Markov chain with specified values at time 0. Hence P µ [ I] are stationary Markov processes with marginal laws in M, and µ is a mixture of these marginal laws, which means that µ is not extremal in M. The same reasoning also allows us to deduce (2.1) from the ergodic decomposition of P µ. Remark. Note that extremal measures in M must be singular w.r.t. each other, since the associated ergodic Markov processes are singular w.r.t. each other by Theorem
4 Remark. A sufficient condition to guarantee the uniqueness of a stationary distribution (if it exists) for a Markov chain is to have some form of irreducibility. If M is not a singleton, then we can find two extremal invariant measure with disjoint support U 1 and U 2 in the state space, such that the Markov chain makes no transitions between U 1 and U 2. Any irreducibility condition that breaks such a partition of the state space will guarantee the existence of at most one stationary distribution. One such condition is if Π(x, dy) has a positive density p(x, y) w.r.t. a common reference measure α(dy) for all x in the state space. 3 Harris chains So far we have studied mostly countable state Markov chains, although the ergodic decomposition of stationary Markov chains was developed for a general Polish space. We now discuss briefly the theory of general state space Markov chains. One class of Markov chains that admit a similar treatment as the countable state space case is the so-called Harris chains. Definition 3.1 (Harris Chains) A Markov chain (X n ) n 0 with state space (S, S) and transition kernel Π(, ) is called a Harris chain, if there exist A, B S, ɛ > 0, and a probability measure ρ with ρ(b) = 1 such that: (i) If τ A := inf{n 0 : X n A}, then P z (τ A < ) > 0 for all z S. (ii) If x A, then Π(x, C) ɛρ(c) for all C S with C B. The conditions of a Harris chain allow us to construct an equivalent Markov chain X with state space S := S {α} and σ-algebra S := {B, B {α} : B S}, where α is an artificial atom that the chain X will visit. More precisely, define X with transition probability kernels Π, such that If x S\A, Π(x, C) = Π(x, C) for C S, If x A, Π(x, {α}) = ɛ, and Π(x, C) = Π(x, C) ɛρ(c) for C S, If x = α, Π(α, D) = ρ(dx) Π(x, D) for D S. X n being in the state α corresponds to X n being distributed as ρ on B. This correspondence allows us to go from the distribution of X to X and vice versa. Having a macroscopic atom α allows us to define transience, recurrence, periodicity, and use the cycle trick to construct stationary measures for recurrent Harris chains, and use coupling to prove convergence of positive recurrent Harris chains to its unique stationary distribution. Definition 3.2 (Recurrence, transience, and periodicity) Let τ α := inf{n 1 : Xn = α}. X is called a recurrent Harris chain if P α (τ α < ) = 1, and transient otherwise. The gcd of D := {n 1 : P α ( X n = α) > 0} is called the period of the Harris chain, with d = 1 corresponding to aperiodicity. Note that Definition 3.1 (i) guarantees that P x (τ α < ) > 0 for all x S, which is a form of irreducibility for the chain X. The theory we developed for countable state Markov chains can be adapted to Harris chains. See e.g. [1] for more details. 4
5 Theorem 3.1 (Stationary measures) If X is a recurrent Harris chain, then there exists a unique (modulo constant multiple) stationary measure. If X is furthermore aperiodic with stationary distribution π, then for any x S with P x (τ α < ) = 1, we have Π n (x, ) π( ) 0, where denotes the total variation norm of a signed measure. We next give some sufficient conditions for a Harris chain to be positive recurrent, i.e., E α [τ α ] <, which is based on the existence of certain Lyapunov functions. Theorem 3.2 (Sufficient conditions for positive recurrence) Let X be a Harris chain satisfying the conditions in Definition 3.1, where we further assume that A = B. Assume that there exists a function g : S [0, ) with sup x A E x [g(x 1 )] <, such that (i) either g : S [1, ) and there exists r (0, 1) s.t. E x [g(x 1 )] rg(x) for all x A c, (ii) or E x [g(x 1 )] g(x) ɛ for all x A c, then E α [τ α ] < and X is a positive recurrent Harris chain. Proof. Since every time the Markov chain X enters the set A = B, there is probability ɛ of entering the state α in the next step, to show E α [τ α ] <, it suffices to show that sup E x [τ A ] <, where τ A := min{n 1 : X n A}. (3.1) x A Note that condition (i) implies that g(x n τa )r n τ A Letting n then gives g(x) E x [g(x n τa )r n τ A ] E x [r n τ A ]. is a super-martingale. Therefore E x [r τ A ] g(x) x A c. (3.2) By the Markov inequality, this further implies that E x [τ A ] = P x (τ A n) r n g(x) < g(x) 1 r n=1 n=1 x A c. (3.3) Similarly, condition (ii) implies that g(x n τa ) + (n τ A )ɛ is a super-martingale. Therefore Letting n then gives g(x) E x [g(x n τa ) + (n τ A )ɛ] ɛe x [n τ A ]. E x [τ A ] 1 ɛ g(x) x Ac. (3.4) Using (3.3) or (3.4), we note that for x A, E x [τ A ] = 1 + Π(x, dy)e y [τ A ] Π(x, dy)g(y) A c c A c c E x[g(x 1 )], where c = 1 r under assumption (i) and c = ɛ under assumption (ii). Taking sup x A on both sides then yields (3.1) by the assumption that sup x A E x [g(x 1 )] <. References [1] R. Durrett, Probability: Theory and Examples, 2nd edition, Duxbury Press, Belmont, California, [2] P. Lax. Functional analysis, John Wiley & Sons Inc.,
Lecture 5. If we interpret the index n 0 as time, then a Markov chain simply requires that the future depends only on the present and not on the past.
1 Markov chain: definition Lecture 5 Definition 1.1 Markov chain] A sequence of random variables (X n ) n 0 taking values in a measurable state space (S, S) is called a (discrete time) Markov chain, if
More informationLecture 7. µ(x)f(x). When µ is a probability measure, we say µ is a stationary distribution.
Lecture 7 1 Stationary measures of a Markov chain We now study the long time behavior of a Markov Chain: in particular, the existence and uniqueness of stationary measures, and the convergence of the distribution
More informationLecture 12. F o s, (1.1) F t := s>t
Lecture 12 1 Brownian motion: the Markov property Let C := C(0, ), R) be the space of continuous functions mapping from 0, ) to R, in which a Brownian motion (B t ) t 0 almost surely takes its value. Let
More information25.1 Ergodicity and Metric Transitivity
Chapter 25 Ergodicity This lecture explains what it means for a process to be ergodic or metrically transitive, gives a few characterizes of these properties (especially for AMS processes), and deduces
More informationErgodic Theorems. Samy Tindel. Purdue University. Probability Theory 2 - MA 539. Taken from Probability: Theory and examples by R.
Ergodic Theorems Samy Tindel Purdue University Probability Theory 2 - MA 539 Taken from Probability: Theory and examples by R. Durrett Samy T. Ergodic theorems Probability Theory 1 / 92 Outline 1 Definitions
More informationChapter 8. General Countably Additive Set Functions. 8.1 Hahn Decomposition Theorem
Chapter 8 General Countably dditive Set Functions In Theorem 5.2.2 the reader saw that if f : X R is integrable on the measure space (X,, µ) then we can define a countably additive set function ν on by
More informationMarkov Chains (Part 3)
Markov Chains (Part 3) State Classification Markov Chains - State Classification Accessibility State j is accessible from state i if p ij (n) > for some n>=, meaning that starting at state i, there is
More informationProbability and Random Processes
Probability and Random Processes Lecture 7 Conditional probability and expectation Decomposition of measures Mikael Skoglund, Probability and random processes 1/13 Conditional Probability A probability
More informationErgodic Theory. Constantine Caramanis. May 6, 1999
Ergodic Theory Constantine Caramanis ay 6, 1999 1 Introduction Ergodic theory involves the study of transformations on measure spaces. Interchanging the words measurable function and probability density
More informationThe Lebesgue Integral
The Lebesgue Integral Brent Nelson In these notes we give an introduction to the Lebesgue integral, assuming only a knowledge of metric spaces and the iemann integral. For more details see [1, Chapters
More informationSection Signed Measures: The Hahn and Jordan Decompositions
17.2. Signed Measures 1 Section 17.2. Signed Measures: The Hahn and Jordan Decompositions Note. If measure space (X, M) admits measures µ 1 and µ 2, then for any α,β R where α 0,β 0, µ 3 = αµ 1 + βµ 2
More informationLecture 6. 2 Recurrence/transience, harmonic functions and martingales
Lecture 6 Classification of states We have shown that all states of an irreducible countable state Markov chain must of the same tye. This gives rise to the following classification. Definition. [Classification
More informationLecture 7. We can regard (p(i, j)) as defining a (maybe infinite) matrix P. Then a basic fact is
MARKOV CHAINS What I will talk about in class is pretty close to Durrett Chapter 5 sections 1-5. We stick to the countable state case, except where otherwise mentioned. Lecture 7. We can regard (p(i, j))
More informationClassification of Countable State Markov Chains
Classification of Countable State Markov Chains Friday, March 21, 2014 2:01 PM How can we determine whether a communication class in a countable state Markov chain is: transient null recurrent positive
More informationSUPPLEMENT TO PAPER CONVERGENCE OF ADAPTIVE AND INTERACTING MARKOV CHAIN MONTE CARLO ALGORITHMS
Submitted to the Annals of Statistics SUPPLEMENT TO PAPER CONERGENCE OF ADAPTIE AND INTERACTING MARKO CHAIN MONTE CARLO ALGORITHMS By G Fort,, E Moulines and P Priouret LTCI, CNRS - TELECOM ParisTech,
More informationMATHS 730 FC Lecture Notes March 5, Introduction
1 INTRODUCTION MATHS 730 FC Lecture Notes March 5, 2014 1 Introduction Definition. If A, B are sets and there exists a bijection A B, they have the same cardinality, which we write as A, #A. If there exists
More information1 Topology Definition of a topology Basis (Base) of a topology The subspace topology & the product topology on X Y 3
Index Page 1 Topology 2 1.1 Definition of a topology 2 1.2 Basis (Base) of a topology 2 1.3 The subspace topology & the product topology on X Y 3 1.4 Basic topology concepts: limit points, closed sets,
More informationSigned Measures and Complex Measures
Chapter 8 Signed Measures Complex Measures As opposed to the measures we have considered so far, a signed measure is allowed to take on both positive negative values. To be precise, if M is a σ-algebra
More informationDOMINO TILINGS INVARIANT GIBBS MEASURES
DOMINO TILINGS and their INVARIANT GIBBS MEASURES Scott Sheffield 1 References on arxiv.org 1. Random Surfaces, to appear in Asterisque. 2. Dimers and amoebae, joint with Kenyon and Okounkov, to appear
More informationLecture 11: Introduction to Markov Chains. Copyright G. Caire (Sample Lectures) 321
Lecture 11: Introduction to Markov Chains Copyright G. Caire (Sample Lectures) 321 Discrete-time random processes A sequence of RVs indexed by a variable n 2 {0, 1, 2,...} forms a discretetime random process
More informationA Note on the Convergence of Random Riemann and Riemann-Stieltjes Sums to the Integral
Gen. Math. Notes, Vol. 22, No. 2, June 2014, pp.1-6 ISSN 2219-7184; Copyright c ICSRS Publication, 2014 www.i-csrs.org Available free online at http://www.geman.in A Note on the Convergence of Random Riemann
More informationLecture Notes Introduction to Ergodic Theory
Lecture Notes Introduction to Ergodic Theory Tiago Pereira Department of Mathematics Imperial College London Our course consists of five introductory lectures on probabilistic aspects of dynamical systems,
More informationA List of Problems in Real Analysis
A List of Problems in Real Analysis W.Yessen & T.Ma December 3, 218 This document was first created by Will Yessen, who was a graduate student at UCI. Timmy Ma, who was also a graduate student at UCI,
More informationLecture 2. We now introduce some fundamental tools in martingale theory, which are useful in controlling the fluctuation of martingales.
Lecture 2 1 Martingales We now introduce some fundamental tools in martingale theory, which are useful in controlling the fluctuation of martingales. 1.1 Doob s inequality We have the following maximal
More informationRandom Process Lecture 1. Fundamentals of Probability
Random Process Lecture 1. Fundamentals of Probability Husheng Li Min Kao Department of Electrical Engineering and Computer Science University of Tennessee, Knoxville Spring, 2016 1/43 Outline 2/43 1 Syllabus
More informationRecall that if X is a compact metric space, C(X), the space of continuous (real-valued) functions on X, is a Banach space with the norm
Chapter 13 Radon Measures Recall that if X is a compact metric space, C(X), the space of continuous (real-valued) functions on X, is a Banach space with the norm (13.1) f = sup x X f(x). We want to identify
More information(1) Consider the space S consisting of all continuous real-valued functions on the closed interval [0, 1]. For f, g S, define
Homework, Real Analysis I, Fall, 2010. (1) Consider the space S consisting of all continuous real-valued functions on the closed interval [0, 1]. For f, g S, define ρ(f, g) = 1 0 f(x) g(x) dx. Show that
More informationAliprantis, Border: Infinite-dimensional Analysis A Hitchhiker s Guide
aliprantis.tex May 10, 2011 Aliprantis, Border: Infinite-dimensional Analysis A Hitchhiker s Guide Notes from [AB2]. 1 Odds and Ends 2 Topology 2.1 Topological spaces Example. (2.2) A semimetric = triangle
More informationLebesgue-Radon-Nikodym Theorem
Lebesgue-Radon-Nikodym Theorem Matt Rosenzweig 1 Lebesgue-Radon-Nikodym Theorem In what follows, (, A) will denote a measurable space. We begin with a review of signed measures. 1.1 Signed Measures Definition
More informationCHAPTER V DUAL SPACES
CHAPTER V DUAL SPACES DEFINITION Let (X, T ) be a (real) locally convex topological vector space. By the dual space X, or (X, T ), of X we mean the set of all continuous linear functionals on X. By the
More informationAdvanced Computer Networks Lecture 2. Markov Processes
Advanced Computer Networks Lecture 2. Markov Processes Husheng Li Min Kao Department of Electrical Engineering and Computer Science University of Tennessee, Knoxville Spring, 2016 1/28 Outline 2/28 1 Definition
More informationChapter 7. Markov chain background. 7.1 Finite state space
Chapter 7 Markov chain background A stochastic process is a family of random variables {X t } indexed by a varaible t which we will think of as time. Time can be discrete or continuous. We will only consider
More informationII - REAL ANALYSIS. This property gives us a way to extend the notion of content to finite unions of rectangles: we define
1 Measures 1.1 Jordan content in R N II - REAL ANALYSIS Let I be an interval in R. Then its 1-content is defined as c 1 (I) := b a if I is bounded with endpoints a, b. If I is unbounded, we define c 1
More informationDynkin (λ-) and π-systems; monotone classes of sets, and of functions with some examples of application (mainly of a probabilistic flavor)
Dynkin (λ-) and π-systems; monotone classes of sets, and of functions with some examples of application (mainly of a probabilistic flavor) Matija Vidmar February 7, 2018 1 Dynkin and π-systems Some basic
More informationDisintegration into conditional measures: Rokhlin s theorem
Disintegration into conditional measures: Rokhlin s theorem Let Z be a compact metric space, µ be a Borel probability measure on Z, and P be a partition of Z into measurable subsets. Let π : Z P be the
More informationNote that in the example in Lecture 1, the state Home is recurrent (and even absorbing), but all other states are transient. f ii (n) f ii = n=1 < +
Random Walks: WEEK 2 Recurrence and transience Consider the event {X n = i for some n > 0} by which we mean {X = i}or{x 2 = i,x i}or{x 3 = i,x 2 i,x i},. Definition.. A state i S is recurrent if P(X n
More informationHitting Probabilities
Stat25B: Probability Theory (Spring 23) Lecture: 2 Hitting Probabilities Lecturer: James W. Pitman Scribe: Brian Milch 2. Hitting probabilities Consider a Markov chain with a countable state space S and
More informationProblem Set 2: Solutions Math 201A: Fall 2016
Problem Set 2: s Math 201A: Fall 2016 Problem 1. (a) Prove that a closed subset of a complete metric space is complete. (b) Prove that a closed subset of a compact metric space is compact. (c) Prove that
More informationProbability and Measure
Part II Year 2018 2017 2016 2015 2014 2013 2012 2011 2010 2009 2008 2007 2006 2005 2018 84 Paper 4, Section II 26J Let (X, A) be a measurable space. Let T : X X be a measurable map, and µ a probability
More informationCONDITIONAL ERGODICITY IN INFINITE DIMENSION. By Xin Thomson Tong and Ramon van Handel Princeton University
CONDITIONAL ERGODICITY IN INFINITE DIMENSION By Xin Thomson Tong and Ramon van Handel Princeton University The goal of this paper is to develop a general method to establish conditional ergodicity of infinite-dimensional
More informationActa Universitatis Carolinae. Mathematica et Physica
Acta Universitatis Carolinae. Mathematica et Physica František Žák Representation form of de Finetti theorem and application to convexity Acta Universitatis Carolinae. Mathematica et Physica, Vol. 52 (2011),
More informationMAT 571 REAL ANALYSIS II LECTURE NOTES. Contents. 2. Product measures Iterated integrals Complete products Differentiation 17
MAT 57 REAL ANALSIS II LECTURE NOTES PROFESSOR: JOHN QUIGG SEMESTER: SPRING 205 Contents. Convergence in measure 2. Product measures 3 3. Iterated integrals 4 4. Complete products 9 5. Signed measures
More informationAnalysis of Probabilistic Systems
Analysis of Probabilistic Systems Bootcamp Lecture 2: Measure and Integration Prakash Panangaden 1 1 School of Computer Science McGill University Fall 2016, Simons Institute Panangaden (McGill) Analysis
More information2. Transience and Recurrence
Virtual Laboratories > 15. Markov Chains > 1 2 3 4 5 6 7 8 9 10 11 12 2. Transience and Recurrence The study of Markov chains, particularly the limiting behavior, depends critically on the random times
More informationNecessary and sufficient conditions for strong R-positivity
Necessary and sufficient conditions for strong R-positivity Wednesday, November 29th, 2017 The Perron-Frobenius theorem Let A = (A(x, y)) x,y S be a nonnegative matrix indexed by a countable set S. We
More informationPositive and null recurrent-branching Process
December 15, 2011 In last discussion we studied the transience and recurrence of Markov chains There are 2 other closely related issues about Markov chains that we address Is there an invariant distribution?
More informationMeasure Theory on Topological Spaces. Course: Prof. Tony Dorlas 2010 Typset: Cathal Ormond
Measure Theory on Topological Spaces Course: Prof. Tony Dorlas 2010 Typset: Cathal Ormond May 22, 2011 Contents 1 Introduction 2 1.1 The Riemann Integral........................................ 2 1.2 Measurable..............................................
More information215 Problem 1. (a) Define the total variation distance µ ν tv for probability distributions µ, ν on a finite set S. Show that
15 Problem 1. (a) Define the total variation distance µ ν tv for probability distributions µ, ν on a finite set S. Show that µ ν tv = (1/) x S µ(x) ν(x) = x S(µ(x) ν(x)) + where a + = max(a, 0). Show that
More informationn [ F (b j ) F (a j ) ], n j=1(a j, b j ] E (4.1)
1.4. CONSTRUCTION OF LEBESGUE-STIELTJES MEASURES In this section we shall put to use the Carathéodory-Hahn theory, in order to construct measures with certain desirable properties first on the real line
More informationINTRODUCTION TO MEASURE THEORY AND LEBESGUE INTEGRATION
1 INTRODUCTION TO MEASURE THEORY AND LEBESGUE INTEGRATION Eduard EMELYANOV Ankara TURKEY 2007 2 FOREWORD This book grew out of a one-semester course for graduate students that the author have taught at
More informationWHY SATURATED PROBABILITY SPACES ARE NECESSARY
WHY SATURATED PROBABILITY SPACES ARE NECESSARY H. JEROME KEISLER AND YENENG SUN Abstract. An atomless probability space (Ω, A, P ) is said to have the saturation property for a probability measure µ on
More informationLebesgue Measure on R n
CHAPTER 2 Lebesgue Measure on R n Our goal is to construct a notion of the volume, or Lebesgue measure, of rather general subsets of R n that reduces to the usual volume of elementary geometrical sets
More informationFragmentability and σ-fragmentability
F U N D A M E N T A MATHEMATICAE 143 (1993) Fragmentability and σ-fragmentability by J. E. J a y n e (London), I. N a m i o k a (Seattle) and C. A. R o g e r s (London) Abstract. Recent work has studied
More informationErgodic Theory for Semigroups of Markov Kernels
Ergodic Theory for Semigroups of Markov Kernels Julian Newman Original version 3rd Jan 205, current version 5th July 205 The evolution of a homogeneous Markov process may be described statistically by
More informationThe Kolmogorov extension theorem
The Kolmogorov extension theorem Jordan Bell jordan.bell@gmail.com Department of Mathematics, University of Toronto June 21, 2014 1 σ-algebras and semirings If X is a nonempty set, an algebra of sets on
More informationAn Introduction to Entropy and Subshifts of. Finite Type
An Introduction to Entropy and Subshifts of Finite Type Abby Pekoske Department of Mathematics Oregon State University pekoskea@math.oregonstate.edu August 4, 2015 Abstract This work gives an overview
More informationMarkov processes Course note 2. Martingale problems, recurrence properties of discrete time chains.
Institute for Applied Mathematics WS17/18 Massimiliano Gubinelli Markov processes Course note 2. Martingale problems, recurrence properties of discrete time chains. [version 1, 2017.11.1] We introduce
More informationCountable Borel equivalence relations. Konstantin Slutsky
Countable Borel equivalence relations Konstantin Slutsky Chapter 1 First contact 1.1 Hi, my name is Cber. Definition 1.1.1. An equivalence relation on a set X is a set E X X such that for all x, y, z X
More informationMarkov Chains for Everybody
Markov Chains for Everybody An Introduction to the theory of discrete time Markov chains on countable state spaces. Wilhelm Huisinga, & Eike Meerbach Fachbereich Mathematik und Informatik Freien Universität
More informationLebesgue Measure on R n
8 CHAPTER 2 Lebesgue Measure on R n Our goal is to construct a notion of the volume, or Lebesgue measure, of rather general subsets of R n that reduces to the usual volume of elementary geometrical sets
More informationABSTRACT INTEGRATION CHAPTER ONE
CHAPTER ONE ABSTRACT INTEGRATION Version 1.1 No rights reserved. Any part of this work can be reproduced or transmitted in any form or by any means. Suggestions and errors are invited and can be mailed
More information2 Probability, random elements, random sets
Tel Aviv University, 2012 Measurability and continuity 25 2 Probability, random elements, random sets 2a Probability space, measure algebra........ 25 2b Standard models................... 30 2c Random
More informationA topological semigroup structure on the space of actions modulo weak equivalence.
A topological semigroup structure on the space of actions modulo wea equivalence. Peter Burton January 8, 08 Abstract We introduce a topology on the space of actions modulo wea equivalence finer than the
More informationLet (Ω, F) be a measureable space. A filtration in discrete time is a sequence of. F s F t
2.2 Filtrations Let (Ω, F) be a measureable space. A filtration in discrete time is a sequence of σ algebras {F t } such that F t F and F t F t+1 for all t = 0, 1,.... In continuous time, the second condition
More informationMeasures and Measure Spaces
Chapter 2 Measures and Measure Spaces In summarizing the flaws of the Riemann integral we can focus on two main points: 1) Many nice functions are not Riemann integrable. 2) The Riemann integral does not
More information02. Measure and integral. 1. Borel-measurable functions and pointwise limits
(October 3, 2017) 02. Measure and integral Paul Garrett garrett@math.umn.edu http://www.math.umn.edu/ garrett/ [This document is http://www.math.umn.edu/ garrett/m/real/notes 2017-18/02 measure and integral.pdf]
More informationSpring 2014 Advanced Probability Overview. Lecture Notes Set 1: Course Overview, σ-fields, and Measures
36-752 Spring 2014 Advanced Probability Overview Lecture Notes Set 1: Course Overview, σ-fields, and Measures Instructor: Jing Lei Associated reading: Sec 1.1-1.4 of Ash and Doléans-Dade; Sec 1.1 and A.1
More informationMeasures. 1 Introduction. These preliminary lecture notes are partly based on textbooks by Athreya and Lahiri, Capinski and Kopp, and Folland.
Measures These preliminary lecture notes are partly based on textbooks by Athreya and Lahiri, Capinski and Kopp, and Folland. 1 Introduction Our motivation for studying measure theory is to lay a foundation
More informationDefinable Graphs and Dominating Reals
May 13, 2016 Graphs A graph on X is a symmetric, irreflexive G X 2. A graph G on a Polish space X is Borel if it is a Borel subset of X 2 \ {(x, x) : x X }. A X is an anticlique (G-free, independent) if
More informationNon-homogeneous random walks on a semi-infinite strip
Non-homogeneous random walks on a semi-infinite strip Chak Hei Lo Joint work with Andrew R. Wade World Congress in Probability and Statistics 11th July, 2016 Outline Motivation: Lamperti s problem Our
More informationDual Space of L 1. C = {E P(I) : one of E or I \ E is countable}.
Dual Space of L 1 Note. The main theorem of this note is on page 5. The secondary theorem, describing the dual of L (µ) is on page 8. Let (X, M, µ) be a measure space. We consider the subsets of X which
More informationMean-field dual of cooperative reproduction
The mean-field dual of systems with cooperative reproduction joint with Tibor Mach (Prague) A. Sturm (Göttingen) Friday, July 6th, 2018 Poisson construction of Markov processes Let (X t ) t 0 be a continuous-time
More information18.175: Lecture 3 Integration
18.175: Lecture 3 Scott Sheffield MIT Outline Outline Recall definitions Probability space is triple (Ω, F, P) where Ω is sample space, F is set of events (the σ-algebra) and P : F [0, 1] is the probability
More informationPROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS
PROBABILITY: LIMIT THEOREMS II, SPRING 218. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please
More informationPoint-Map Probabilities of a Point Process
Point-Map Probabilities of a Point Process F. Baccelli, UT AUSTIN Joint work with M.O. Haji-Mirsadeghi TexAMP, Austin, November 23, 24 Structure of the talk Point processes Palm probabilities Mecke s invariant
More informationMATH 202B - Problem Set 5
MATH 202B - Problem Set 5 Walid Krichene (23265217) March 6, 2013 (5.1) Show that there exists a continuous function F : [0, 1] R which is monotonic on no interval of positive length. proof We know there
More informationErgodic Properties of Markov Processes
Ergodic Properties of Markov Processes March 9, 2006 Martin Hairer Lecture given at The University of Warwick in Spring 2006 1 Introduction Markov processes describe the time-evolution of random systems
More informationInvariant measures for iterated function systems
ANNALES POLONICI MATHEMATICI LXXV.1(2000) Invariant measures for iterated function systems by Tomasz Szarek (Katowice and Rzeszów) Abstract. A new criterion for the existence of an invariant distribution
More informationMeasurability Problems for Boolean Algebras
Measurability Problems for Boolean Algebras Stevo Todorcevic Berkeley, March 31, 2014 Outline 1. Problems about the existence of measure 2. Quests for algebraic characterizations 3. The weak law of distributivity
More information3 (Due ). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure?
MA 645-4A (Real Analysis), Dr. Chernov Homework assignment 1 (Due ). Show that the open disk x 2 + y 2 < 1 is a countable union of planar elementary sets. Show that the closed disk x 2 + y 2 1 is a countable
More informationA mathematical framework for Exact Milestoning
A mathematical framework for Exact Milestoning David Aristoff (joint work with Juan M. Bello-Rivas and Ron Elber) Colorado State University July 2015 D. Aristoff (Colorado State University) July 2015 1
More informationTHEOREMS, ETC., FOR MATH 516
THEOREMS, ETC., FOR MATH 516 Results labeled Theorem Ea.b.c (or Proposition Ea.b.c, etc.) refer to Theorem c from section a.b of Evans book (Partial Differential Equations). Proposition 1 (=Proposition
More informationLectures 22-23: Conditional Expectations
Lectures 22-23: Conditional Expectations 1.) Definitions Let X be an integrable random variable defined on a probability space (Ω, F 0, P ) and let F be a sub-σ-algebra of F 0. Then the conditional expectation
More informationInformation Theory and Statistics Lecture 3: Stationary ergodic processes
Information Theory and Statistics Lecture 3: Stationary ergodic processes Łukasz Dębowski ldebowsk@ipipan.waw.pl Ph. D. Programme 2013/2014 Measurable space Definition (measurable space) Measurable space
More informationMTH 404: Measure and Integration
MTH 404: Measure and Integration Semester 2, 2012-2013 Dr. Prahlad Vaidyanathan Contents I. Introduction....................................... 3 1. Motivation................................... 3 2. The
More informationChapter 1. Measure Spaces. 1.1 Algebras and σ algebras of sets Notation and preliminaries
Chapter 1 Measure Spaces 1.1 Algebras and σ algebras of sets 1.1.1 Notation and preliminaries We shall denote by X a nonempty set, by P(X) the set of all parts (i.e., subsets) of X, and by the empty set.
More informationReal Analysis, 2nd Edition, G.B.Folland Signed Measures and Differentiation
Real Analysis, 2nd dition, G.B.Folland Chapter 3 Signed Measures and Differentiation Yung-Hsiang Huang 3. Signed Measures. Proof. The first part is proved by using addivitiy and consider F j = j j, 0 =.
More information4th Preparation Sheet - Solutions
Prof. Dr. Rainer Dahlhaus Probability Theory Summer term 017 4th Preparation Sheet - Solutions Remark: Throughout the exercise sheet we use the two equivalent definitions of separability of a metric space
More informationThe Caratheodory Construction of Measures
Chapter 5 The Caratheodory Construction of Measures Recall how our construction of Lebesgue measure in Chapter 2 proceeded from an initial notion of the size of a very restricted class of subsets of R,
More informationMarkov Chains and Stochastic Sampling
Part I Markov Chains and Stochastic Sampling 1 Markov Chains and Random Walks on Graphs 1.1 Structure of Finite Markov Chains We shall only consider Markov chains with a finite, but usually very large,
More information2 (Bonus). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure?
MA 645-4A (Real Analysis), Dr. Chernov Homework assignment 1 (Due 9/5). Prove that every countable set A is measurable and µ(a) = 0. 2 (Bonus). Let A consist of points (x, y) such that either x or y is
More informationP i [B k ] = lim. n=1 p(n) ii <. n=1. V i :=
2.7. Recurrence and transience Consider a Markov chain {X n : n N 0 } on state space E with transition matrix P. Definition 2.7.1. A state i E is called recurrent if P i [X n = i for infinitely many n]
More information1 Inner Product Space
Ch - Hilbert Space 1 4 Hilbert Space 1 Inner Product Space Let E be a complex vector space, a mapping (, ) : E E C is called an inner product on E if i) (x, x) 0 x E and (x, x) = 0 if and only if x = 0;
More informationGeneralized metric properties of spheres and renorming of Banach spaces
arxiv:1605.08175v2 [math.fa] 5 Nov 2018 Generalized metric properties of spheres and renorming of Banach spaces 1 Introduction S. Ferrari, J. Orihuela, M. Raja November 6, 2018 Throughout this paper X
More informationA Study of Probability and Ergodic theory with applications to Dynamical Systems
A Study of Probability and Ergodic theory with applications to Dynamical Systems James Polsinelli, Advisors: Prof. Barry James and Bruce Peckham May 0, 010 Contents 1 Introduction I began this project
More informationMH 7500 THEOREMS. (iii) A = A; (iv) A B = A B. Theorem 5. If {A α : α Λ} is any collection of subsets of a space X, then
MH 7500 THEOREMS Definition. A topological space is an ordered pair (X, T ), where X is a set and T is a collection of subsets of X such that (i) T and X T ; (ii) U V T whenever U, V T ; (iii) U T whenever
More informationINVARIANT MEASURES ON LOCALLY COMPACT GROUPS
INVARIANT MEASURES ON LOCALLY COMPACT GROUPS JENS GERLACH CHRISTENSEN Abstract. This is a survey about invariant integration on locally compact groups and its uses. The existence of a left invariant regular
More information(2) E M = E C = X\E M
10 RICHARD B. MELROSE 2. Measures and σ-algebras An outer measure such as µ is a rather crude object since, even if the A i are disjoint, there is generally strict inequality in (1.14). It turns out to
More informationA note on adiabatic theorem for Markov chains and adiabatic quantum computation. Yevgeniy Kovchegov Oregon State University
A note on adiabatic theorem for Markov chains and adiabatic quantum computation Yevgeniy Kovchegov Oregon State University Introduction Max Born and Vladimir Fock in 1928: a physical system remains in
More information5 Measure theory II. (or. lim. Prove the proposition. 5. For fixed F A and φ M define the restriction of φ on F by writing.
5 Measure theory II 1. Charges (signed measures). Let (Ω, A) be a σ -algebra. A map φ: A R is called a charge, (or signed measure or σ -additive set function) if φ = φ(a j ) (5.1) A j for any disjoint
More information