Central Limit Theorem for Non-stationary Markov Chains
|
|
- Jesse Flynn
- 5 years ago
- Views:
Transcription
1 Central Limit Theorem for Non-stationary Markov Chains Magda Peligrad University of Cincinnati April 2011 (Institute) April / 30
2 Plan of talk Markov processes with Nonhomogeneous transition probabilities -Contraction coe cient. Dobrushin central limit theorem for Markov chains. -Maximum coe cient of correlation. New central limit theorem for Markov chains. -Nonstationary martingale approximation. (Institute) April / 30
3 Dobrushin s contraction coe cient Dobrushin s contraction coe cient as a measure of degeneracy Let Q be a Markov transition probability on (X, B(X)) Dobrushin s contraction coe cient Q(x, A) = P(ξ 1 2 Ajξ 0 = x) Z (Qu)(x) = u(y)q(x, dy). X δ(q) = sup jq(x 1, A) x 1,x 2,A Q(x 2, A)j δ(q) = sup sup j(qu)(x 1 ) (Qu)(x 2 )j, u2u x 1,x 2 where U = fu, Osc(u) = sup x1,x 2 ju(x 1 ) u(x 2 )j 1g. Dobrushin s coe cient of independence α(q) = 1 δ(q) (Institute) April / 30
4 Properties of Dobrushin s coe cients Properties of Dobrushin s coe cients 0 δ(q) 1 δ(q) = 0 if and only if Q(x, A) does not depend on x Q is called nondegenerate if 0 δ(q) < 1 δ(q 1 Q 2 ) δ(q 1 )δ(q 2 ) For a matrix Q = (q i,j ) α(q) = 1 δ(q) = inf min(q i,k, q j,k ) i,j2i k2i (Institute) April / 30
5 Non-homogeneous transitions Markov chain with nonstationary transitions. - (ξ i ) 1in non-homogeneous Markov chain of length n with values in (X, B(X )) P(ξ i+1 2 Ajξ i = x) = Q i,i+1 (x, A) Q i,j = Q i,i+1 Q i+1,i+2...q j 1,j δ 1 = sup δ(q i,i+1 ) and δ k = 1i n 1 sup 1i n k δ(q i,i+k ). δ k δ k 1 (Institute) April / 30
6 Array of non-homogeneous Markov chains -Let (ξ n,i ) 1in be an array of non-homogeneous Markov chains with values in (X, B(X )) and X n,i = f n,i (ξ n,i ) and S n = EX n,i = 0, EX 2 n,i < n X n,i, i=1 and denote by σ 2 n = var S n and b 2 n = δ n,1, α n = 1 δ n,1. n var X n,i, i=1 (Institute) April / 30
7 Dobrushin s CLT Dobrushin s CLT Theorem Under the assumptions max jx n,i j C n a.s. and 1in C 2 n α 3 nb 2 n! 0 as n!, we have n i=1 X n,i σ n D! N(0, 1) as n!. Corollary When jx n,i j C < a.s. and var X n,i c > 0, then the CLT holds provided α 3 nn! as n!. (Institute) April / 30
8 Sharpness of Dobrushin s Theorem Sharpness of Dobrushin s Theorem Theorem There is a Markov chain with jx n,i j C < a.s. and var X n,i c > 0, and lim sup α 3 nn < which does not satisfy the CLT. Example 0 < p < 1 1 p p Q = p 1 p, π(1) = π(2) = 1, α(q) = 2p 2 T n = n 1 f1g (X i ) i=1 - For p = 1/n, T n /n ) G and lim n! n 2 var(t n ) = V 1 < - For p = 1 1/n, T n n/2 ) F and lim n! var(t n ) = V 2 < (Institute) April / 30
9 Sharpness of Dobrushin s Theorem continue Blocking argument: α n! 0, n 1/3 α n 1 and make about nα n blocks of size αn 1, I 1, I 2,..., I nαn. De ne: Q i,i+1 = Q(α n ) for 1 i αn 1 = Q(1/2) for i = jαn 1, 1 j nα n = Q(1 α n ) in rest T n = j 1 f1g (X i ) = i2i j j T n,j vart n,1 αn 2 V 1 var( T n,j ) nα n V 2 j2 If n 1/3 α n! then CLT. If n 1/3 α n = 1 the limiting distribution is a convolution X N, where X is non-normal nondegenerate. (Institute) April / 30
10 Maximal coe cient of correlation Maximal coe cient of correlation A, B be two sub σ-algebras ρ(a, B) = sup jcorr (f, g)j, f 2L 2 (A),g 2L 2 (B) For a vector of random variables (Y k ) 1kn we de ne ρ k = max ρ(σ(y i, i s), σ(y j, j s + k)). 1s,s+kn For a nonhomogeneous Markov chain of length n, (ξ i ) 1in, ρ k = max ρ(σ(ξ s ), σ(ξ s+k )). 1s,s+kn if the joint distribution of (ξ s, ξ s+k ) is bivariate normal ρ k = max jcorr(ξ s, ξ s+k )j. 1s,s+kn (Institute) April / 30
11 Relation to Dobrushin s coe cient Relation to Dobrushin s coe cient (Bradley 2011) For any 0 < a < b < 1 there is a Markov chain with ρ 1 = a and δ 1 = b. Therefore, for a triangular array, λ n = 1 ρ n,1 and α n = 1 δ n,1 can converge to 0 at di erent rates. Sethuraman and Varadhan (2005) ρ 1 δ 1/2 1. For a Markov chain ρ k ρ k 1. (Institute) April / 30
12 Relation to operator norm Relation with operator norm in L 2 ρ 1 (X, Y ) = supf jje(g(y )jx )jj 2 ; jjg(y )jj 2 < and Eg(Y ) = 0g, g jjg(y )jj 2 For stationary Markov chains with values in (X, B(X )) and transition probability Q(x, A) = P(ξ 1 2 Ajξ 0 = x), de ne the operator Q Z (Qu)(x) = X u(y)q(x, dy), u 2 L 2 (X, B(X ), π) Denote L 0 2 (π) = fg 2 L 2(X, B(X ), π) with R gdπ = 0g. The coe cient ρ 1 is simply the norm operator of Q : L 0 2 (π)! L0 2 (π), ρ 1 = jjqjj L 0 2 (π) = sup jjq(g)jj 2. g 2L 0 2 (π) jjgjj 2 (Institute) April / 30
13 Some history Some history on the maximal coe cient of correlation Conditions imposed to the maximal coe cient of correlation make possible to study the asymptotic behavior of many dependent structures including classes of Markov chains and Gaussian sequences. This coe cient was used by Kolmogorov and Rozanov and further studied by Rosenblatt, Ibragimov, Shao among many others. An introduction to this topic, mostly in the stationary setting, can be found in the Chapters 9 and 11 in Bradley. Application to the central limit theorem (CLT) for various stationary Markov chains with ρ 1 < 1 are surveyed in Jones. In the nonstationary setting and general triangular arrays a central limit theorem was obtained by Utev, assuming ρ mixing coe cients converging to 0 uniformly at a logarithmic rate. (Institute) April / 30
14 CLT under conditions on the maximal coe cient of correlation Theorem (P-2010) Suppose that (X n,i ) 1in are Markov chains and max jx n,i j C n a.s. and C n(1 + j log(λ n )j)! 1in λ 3/2 0 as n!. n b n Then n i=1 X n,i σ n D! N(0, 1) as n!. Corollary Assume that max 1in jx n,i j C a.s. and also var X n,i c > 0 for all n 1 and 1 i n. Then CLT holds provided λ 3 nn(1 + j log(λ n )j) 2!. (Institute) April / 30
15 Integral form Integral form 1 λ 2 nb 2 n n EXn,i 2 I (jx n,i j > εh(λ n )b n )! 0 as n! i=1 where h(λ n ) = λ 3/2 n (1 + j log(λ n )j) 1. Uniformly bounded ρ n,1 mixing coe cients. There is a positive number ρ such that sup n ρ n,1 < ρ < 1. Then, the CLT holds provided that for every ε > 0 1 b 2 n n EXn,i 2 I (jx n,i j > εb n )! 0. i=1 (Institute) April / 30
16 Tools: Martingale related central limit theorem Tools: Martingale related central limit theorem Assume (X n,j ) 1jn is an array of centered random variables that are square integrable and adapted to an increasing array of sigma elds (F n,j ) 1jn. Theorem Assume ES 2 n = 1. De ne the projector operator P n,j Y = E(Y jf n,j ) E(Y jf n,j 1 ). Assume and Then the CLT holds. max jp n,js n j! P 0 as n!. 1jn n j=1 (P n,j S n ) 2! P 1 as n!. (Institute) April / 30
17 Tools: CLT for general triangular arrays Tools: CLT for general triangular arrays For 0 j n denote where S n,j = j i=1 X n,i Theorem Assume ES 2 n = 1. Also assume that and A n,j = E(S n S n,j jf n,j ), max (jx n,j j + ja n,j j)! P 0 as n! 1jn n (Xn,j 2 + 2X n,j A n,j )! P 1 as n!. j=1 Then S n converges in distribution to N(0, 1). (Institute) April / 30
18 Bounds for the variance of partial sums of Markov chains Bounds for the variance of partial sums of Markov chains Sharp upper and lower bounds for the variance of partial sums of a Markov chain in function of the maximal coe cient of correlation 1 ρ ρ 1 n EXi 2 ESn ρ 1 i=1 1 ρ 1 and in function of Dobrushin s coe cient 1 δ 1 (1 + p δ 1 ) 2 n EXi 2. i=1 n EXi 2 ESn 2 (1 + p δ 1 ) 2 i=1 1 δ 1 n EXi 2. i=1 (Institute) April / 30
19 Quenched Invariance principle for Stationary processes and Markov chains Markov processes with homogeneous transitions that do not start from equilibrium. -Quenched Central Limit Theorem for stochastic processes -Quenched Central Limit theorem for Reversible Markov processes -Stationary Martingale Approximation (Institute) April / 30
20 Stationary Sequences Stationary sequence as a functional of a Markov chain with a general state space. - (ξ n ) n2z is a stationary ergodic Markov chain de ned on a probability space (Ω, F, P) with values in a measurable space. - The marginal distribution is denoted by π(a) = P(ξ 0 2 A). -S n = S n (g) = n k=1 g(ξ k ) - Any stationary sequence (Y k ) k2z can be viewed as a function of a Markov process ξ k = (Y j ; j k) with the function g(ξ k ) = Y k. (Institute) April / 30
21 Central limit theorem started at a point Central limit theorem started at a point For any continuous and bounded f E x (f (S n / p n))! E (f (cn)), a.s. where N is standard normal. Equivalently, E(f (S n / p n)jf 0 )! E (f (cn)), a.s. For t 2 [0, 1] de ne W n (t) = S [nt] / p n, where [x] denotes the integer part of x. By quenched functional CLT we mean that for any function f continuous and bounded on D(0, 1) E(f (W n )jf 0 )! E (cf (W )) a.s. where W is the standard Brownian motion on [0, 1]. (Institute) April / 30
22 Almost sure martingale approximations Almost sure martingale approximations Martingales with stationary and ergodic di erences have both almost sure CLT and invariance principle started at a point. Type of approximations needed to transport the Quenched CLT from martingale to the stationary sequence. E((S n M n ) 2 jf 0 )/n! 0 a.s. E( max 1in (S i M i ) 2 jf 0 )/n! 0 a.s. (S n M n ) 2 /n! 0 a.s. (Institute) April / 30
23 Quenched functional CLT under projective criteria Quenched functional CLT under projective criteria Here is a short history of the quenched CLT under projective criteria. - A result in Borodin and Ibragimov (1994) states that if jje(s n jf 0 )jj 2 is bounded, then the CLT in its functional form started at a point holds. - Later work by Derriennic and Lin (2001) improved on this result imposing the condition jje(s n jf 0 )jj 2 = O(n 1/2 ɛ ) with ɛ > 0. - Improvements by Wu and Woodroofe (2004); Zhao and Woodroofe (2008). - A step forward was made by Cuny (2009) who improved the condition to jje(s n jf 0 )jj 2 = O(n 1/2 (log n) 2 (log log n) 1+δ ) by using sharp results on ergodic transforms in Gaposhkin (1996). -Peligrad and Cuny (2011) under the condition jje(x k jf 0 )jj p 2 k1 k jjq = k f jj p 2 <. k1 k (Institute) April / 30
24 Additive functionals of reversible Markov chains Additive functionals of reversible Markov chains. Theorem Let (ξ i ) i2z be a stationary and ergodic reversible Markov chain, f 2 L 2 0 (π) with the property var(s n ) lim! σ 2 jje(s n jf 0 )jj n! f < (equivalently n 2 2 n n 2 < ). Then E max 1jn (S j M j ) 2 /n! 0 and the functional CLT holds. Kipnis and Varadhan (1986), Gordin Peligrad (2011). -Q = Q where Q is the adjoint operator de ned by < Qf, g >=< f, Q g >, for every f and g in L 2 (π). (Institute) April / 30
25 Quenched Invariance principle for Reversible Markov chains Quenched Invariance principle for Reversible Markov chains Conjecture: Kipnis and Varadhan. For any square integrable function of stationary, ergodic, reversible Markov chains under centering and normalization p n, the functional central limit theorem started from a point holds under the condition lim n! var(s n )/n! σ 2 f < jje(s (equivalently n jf 0 )jj 2 2 n < ). The same question for continuous time n 2 reversible Markov chains. (Institute) April / 30
26 Quenched CLT for Reversible Markov chains Quenched CLT for Reversible Markov chains Cuny Peligrad (2011). Theorem For a stationary reversible Markov chain satisfying n (log log n) 2 jje(s n jf 0 )jj 2 2 n 2 <. the central limit theorem started at a point holds. (Institute) April / 30
27 Method of proof Method of proof: Construction of approximating martingale - E(S n jf 1 ) E(S n jf 0 )! D 0 in L 2 and a.s. -Then one estimates S n n k=1 D k in L 2 - almost sure-type martingale approximation based on maximal inequalities -spectral calculus (Institute) April / 30
28 Fourier series Application of martingale approximation to Fourier Series S n (θ) = n X j exp(jiθ) where i 2 = 1, j=1 periodogram I n (θ) = 2πn 1 js n (θ)j 2 Wiener and Wintner (1941), Lacey and Terwilleger (2008): For all stationary sequences (X j ) j2z in L 1 there is a set Ω 0 of probability 1 such that S n (θ) converges for all θ and ϖ 2 Ω 0 n (Institute) April / 30
29 Almost sure central limit theorem for Fourier series Almost sure central limit theorem for Fourier series Theorem (X k ) k2z is a stationary ergodic sequence and E(X 0 jf ) = 0 almost surely. Then for λ almost all θ 2 (0, 2π) lim EjS n(θ)j 2 /n = σ 2 (θ) n! and 1 p n (Re(S n (θ)), Im(S n (θ)))! d (N 1 (θ), N 2 (θ)) where N 1 (θ) and N 2 (θ) are independent identically distributed normal random variables mean 0 and variance 1 2 σ2 (θ). MP-Wei Biao Wu (2009) (*) Regularity can be replaced by jje 0 (S n (θ))jj 2 = o( p n). (Institute) April / 30
30 Method of proof of central limit theorem for Fourier series Method of proof of central limit theorem for Fourier series Carleson and Hunt theorems imply for almost all θ in [0, 2π] E 1 (S n (θ)) E 0 (S n (θ))! D 0 in L 2 Martingale approximation. Spectral density theory. (Institute) April / 30
BERNOULLI DYNAMICAL SYSTEMS AND LIMIT THEOREMS. Dalibor Volný Université de Rouen
BERNOULLI DYNAMICAL SYSTEMS AND LIMIT THEOREMS Dalibor Volný Université de Rouen Dynamical system (Ω,A,µ,T) : (Ω,A,µ) is a probablity space, T : Ω Ω a bijective, bimeasurable, and measure preserving mapping.
More informationA CLT FOR MULTI-DIMENSIONAL MARTINGALE DIFFERENCES IN A LEXICOGRAPHIC ORDER GUY COHEN. Dedicated to the memory of Mikhail Gordin
A CLT FOR MULTI-DIMENSIONAL MARTINGALE DIFFERENCES IN A LEXICOGRAPHIC ORDER GUY COHEN Dedicated to the memory of Mikhail Gordin Abstract. We prove a central limit theorem for a square-integrable ergodic
More informationFOURIER TRANSFORMS OF STATIONARY PROCESSES 1. k=1
FOURIER TRANSFORMS OF STATIONARY PROCESSES WEI BIAO WU September 8, 003 Abstract. We consider the asymptotic behavior of Fourier transforms of stationary and ergodic sequences. Under sufficiently mild
More informationHan-Ying Liang, Dong-Xia Zhang, and Jong-Il Baek
J. Korean Math. Soc. 41 (2004), No. 5, pp. 883 894 CONVERGENCE OF WEIGHTED SUMS FOR DEPENDENT RANDOM VARIABLES Han-Ying Liang, Dong-Xia Zhang, and Jong-Il Baek Abstract. We discuss in this paper the strong
More informationAn almost sure invariance principle for additive functionals of Markov chains
Statistics and Probability Letters 78 2008 854 860 www.elsevier.com/locate/stapro An almost sure invariance principle for additive functionals of Markov chains F. Rassoul-Agha a, T. Seppäläinen b, a Department
More informationMartingale approximations for random fields
Electron. Commun. Probab. 23 (208), no. 28, 9. https://doi.org/0.24/8-ecp28 ISSN: 083-589X ELECTRONIC COMMUNICATIONS in PROBABILITY Martingale approximations for random fields Peligrad Magda * Na Zhang
More informationStrong approximation for additive functionals of geometrically ergodic Markov chains
Strong approximation for additive functionals of geometrically ergodic Markov chains Florence Merlevède Joint work with E. Rio Université Paris-Est-Marne-La-Vallée (UPEM) Cincinnati Symposium on Probability
More informationLecture 9. d N(0, 1). Now we fix n and think of a SRW on [0,1]. We take the k th step at time k n. and our increments are ± 1
Random Walks and Brownian Motion Tel Aviv University Spring 011 Lecture date: May 0, 011 Lecture 9 Instructor: Ron Peled Scribe: Jonathan Hermon In today s lecture we present the Brownian motion (BM).
More informationMakarov s LIL for SLE
Makarov s LIL for SLE Nam-Gyu Kang Department of Mathematics, M.I.T. Workshop at IPAM, 2007 Nam-Gyu Kang (M.I.T.) Makarov s LIL for SLE Workshop at IPAM, 2007 1 / 24 Outline 1 Introduction and Preliminaries
More informationAdditive functionals of infinite-variance moving averages. Wei Biao Wu The University of Chicago TECHNICAL REPORT NO. 535
Additive functionals of infinite-variance moving averages Wei Biao Wu The University of Chicago TECHNICAL REPORT NO. 535 Departments of Statistics The University of Chicago Chicago, Illinois 60637 June
More informationComplete Moment Convergence for Sung s Type Weighted Sums of ρ -Mixing Random Variables
Filomat 32:4 (208), 447 453 https://doi.org/0.2298/fil804447l Published by Faculty of Sciences and Mathematics, Uversity of Niš, Serbia Available at: http://www.pmf..ac.rs/filomat Complete Moment Convergence
More informationMi-Hwa Ko. t=1 Z t is true. j=0
Commun. Korean Math. Soc. 21 (2006), No. 4, pp. 779 786 FUNCTIONAL CENTRAL LIMIT THEOREMS FOR MULTIVARIATE LINEAR PROCESSES GENERATED BY DEPENDENT RANDOM VECTORS Mi-Hwa Ko Abstract. Let X t be an m-dimensional
More informationThe central limit theorem for stationary Markov chains under invariant splittings
The central limit theorem for stationary Markov chains under invariant splittings Mikhail Gordin 1 and Hajo Holzmann 1 St. Petersburg Division of V.A. Steklov Mathematical Institute Fontanka 7, 19103 St.
More informationSome functional (Hölderian) limit theorems and their applications (II)
Some functional (Hölderian) limit theorems and their applications (II) Alfredas Račkauskas Vilnius University Outils Statistiques et Probabilistes pour la Finance Université de Rouen June 1 5, Rouen (Rouen
More informationStein s method and weak convergence on Wiener space
Stein s method and weak convergence on Wiener space Giovanni PECCATI (LSTA Paris VI) January 14, 2008 Main subject: two joint papers with I. Nourdin (Paris VI) Stein s method on Wiener chaos (ArXiv, December
More informationBrownian motion. Samy Tindel. Purdue University. Probability Theory 2 - MA 539
Brownian motion Samy Tindel Purdue University Probability Theory 2 - MA 539 Mostly taken from Brownian Motion and Stochastic Calculus by I. Karatzas and S. Shreve Samy T. Brownian motion Probability Theory
More informationSTA205 Probability: Week 8 R. Wolpert
INFINITE COIN-TOSS AND THE LAWS OF LARGE NUMBERS The traditional interpretation of the probability of an event E is its asymptotic frequency: the limit as n of the fraction of n repeated, similar, and
More informationA Martingale Central Limit Theorem
A Martingale Central Limit Theorem Sunder Sethuraman We present a proof of a martingale central limit theorem (Theorem 2) due to McLeish (974). Then, an application to Markov chains is given. Lemma. For
More informationConsistency of the maximum likelihood estimator for general hidden Markov models
Consistency of the maximum likelihood estimator for general hidden Markov models Jimmy Olsson Centre for Mathematical Sciences Lund University Nordstat 2012 Umeå, Sweden Collaborators Hidden Markov models
More informationUniversity of Toronto Department of Statistics
Norm Comparisons for Data Augmentation by James P. Hobert Department of Statistics University of Florida and Jeffrey S. Rosenthal Department of Statistics University of Toronto Technical Report No. 0704
More informationSTATIONARY RANDOM WALKS AND ISOTONIC REGRESSION
STATIONARY RANDOM WALKS AND ISOTONIC REGRESSION by Ou Zhao A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy (Statistics) in The University of Michigan
More informationStochastic Processes
Stochastic Processes A very simple introduction Péter Medvegyev 2009, January Medvegyev (CEU) Stochastic Processes 2009, January 1 / 54 Summary from measure theory De nition (X, A) is a measurable space
More informationPROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS
PROBABILITY: LIMIT THEOREMS II, SPRING 15. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please
More informationA regeneration proof of the central limit theorem for uniformly ergodic Markov chains
A regeneration proof of the central limit theorem for uniformly ergodic Markov chains By AJAY JASRA Department of Mathematics, Imperial College London, SW7 2AZ, London, UK and CHAO YANG Department of Mathematics,
More informationModeling and testing long memory in random fields
Modeling and testing long memory in random fields Frédéric Lavancier lavancier@math.univ-lille1.fr Université Lille 1 LS-CREST Paris 24 janvier 6 1 Introduction Long memory random fields Motivations Previous
More informationErgodic Theorems. Samy Tindel. Purdue University. Probability Theory 2 - MA 539. Taken from Probability: Theory and examples by R.
Ergodic Theorems Samy Tindel Purdue University Probability Theory 2 - MA 539 Taken from Probability: Theory and examples by R. Durrett Samy T. Ergodic theorems Probability Theory 1 / 92 Outline 1 Definitions
More informationPROBABILITY AND MOMENT INEQUALITIES UNDER DEPENDENCE
Statistica Sinica 23 2013, 1257-1272 doi:http://dx.doi.org/10.5705/ss.2011.287 PROBABILITY AND MOMENT INEQUALITIES UNDER DEPENDENCE Weidong Liu, Han Xiao and Wei Biao Wu Shanghai Jiao Tong University,
More informationA note on the growth rate in the Fazekas Klesov general law of large numbers and on the weak law of large numbers for tail series
Publ. Math. Debrecen 73/1-2 2008), 1 10 A note on the growth rate in the Fazekas Klesov general law of large numbers and on the weak law of large numbers for tail series By SOO HAK SUNG Taejon), TIEN-CHUNG
More informationPROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS
PROBABILITY: LIMIT THEOREMS II, SPRING 218. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please
More informationResearch Article Exponential Inequalities for Positively Associated Random Variables and Applications
Hindawi Publishing Corporation Journal of Inequalities and Applications Volume 008, Article ID 38536, 11 pages doi:10.1155/008/38536 Research Article Exponential Inequalities for Positively Associated
More informationStochastic process for macro
Stochastic process for macro Tianxiao Zheng SAIF 1. Stochastic process The state of a system {X t } evolves probabilistically in time. The joint probability distribution is given by Pr(X t1, t 1 ; X t2,
More informationSection 27. The Central Limit Theorem. Po-Ning Chen, Professor. Institute of Communications Engineering. National Chiao Tung University
Section 27 The Central Limit Theorem Po-Ning Chen, Professor Institute of Communications Engineering National Chiao Tung University Hsin Chu, Taiwan 3000, R.O.C. Identically distributed summands 27- Central
More informationp 1 ( Y p dp) 1/p ( X p dp) 1 1 p
Doob s inequality Let X(t) be a right continuous submartingale with respect to F(t), t 1 P(sup s t X(s) λ) 1 λ {sup s t X(s) λ} X + (t)dp 2 For 1 < p
More informationSelected Exercises on Expectations and Some Probability Inequalities
Selected Exercises on Expectations and Some Probability Inequalities # If E(X 2 ) = and E X a > 0, then P( X λa) ( λ) 2 a 2 for 0 < λ
More informationP (A G) dp G P (A G)
First homework assignment. Due at 12:15 on 22 September 2016. Homework 1. We roll two dices. X is the result of one of them and Z the sum of the results. Find E [X Z. Homework 2. Let X be a r.v.. Assume
More informationOn the Set of Limit Points of Normed Sums of Geometrically Weighted I.I.D. Bounded Random Variables
On the Set of Limit Points of Normed Sums of Geometrically Weighted I.I.D. Bounded Random Variables Deli Li 1, Yongcheng Qi, and Andrew Rosalsky 3 1 Department of Mathematical Sciences, Lakehead University,
More informationUNIT ROOT TESTING FOR FUNCTIONALS OF LINEAR PROCESSES
Econometric Theory, 22, 2006, 1 14+ Printed in the United States of America+ DOI: 10+10170S0266466606060014 UNIT ROOT TESTING FOR FUNCTIONALS OF LINEAR PROCESSES WEI BIAO WU University of Chicago We consider
More informationAlmost sure invariance principle for sequential and non-stationary dynamical systems (see arxiv )
Almost sure invariance principle for sequential and non-stationary dynamical systems (see paper @ arxiv ) Nicolai Haydn, University of Southern California Matthew Nicol, University of Houston Andrew Török,
More informationLECTURE 12 UNIT ROOT, WEAK CONVERGENCE, FUNCTIONAL CLT
MARCH 29, 26 LECTURE 2 UNIT ROOT, WEAK CONVERGENCE, FUNCTIONAL CLT (Davidson (2), Chapter 4; Phillips Lectures on Unit Roots, Cointegration and Nonstationarity; White (999), Chapter 7) Unit root processes
More informationConditional moment representations for dependent random variables
Conditional moment representations for dependent random variables W lodzimierz Bryc Department of Mathematics University of Cincinnati Cincinnati, OH 45 22-0025 bryc@ucbeh.san.uc.edu November 9, 995 Abstract
More informationResidual Bootstrap for estimation in autoregressive processes
Chapter 7 Residual Bootstrap for estimation in autoregressive processes In Chapter 6 we consider the asymptotic sampling properties of the several estimators including the least squares estimator of the
More informationGradient Estimation for Attractor Networks
Gradient Estimation for Attractor Networks Thomas Flynn Department of Computer Science Graduate Center of CUNY July 2017 1 Outline Motivations Deterministic attractor networks Stochastic attractor networks
More informationRandom Bernstein-Markov factors
Random Bernstein-Markov factors Igor Pritsker and Koushik Ramachandran October 20, 208 Abstract For a polynomial P n of degree n, Bernstein s inequality states that P n n P n for all L p norms on the unit
More informationMixing time for a random walk on a ring
Mixing time for a random walk on a ring Stephen Connor Joint work with Michael Bate Paris, September 2013 Introduction Let X be a discrete time Markov chain on a finite state space S, with transition matrix
More informationConditional independence, conditional mixing and conditional association
Ann Inst Stat Math (2009) 61:441 460 DOI 10.1007/s10463-007-0152-2 Conditional independence, conditional mixing and conditional association B. L. S. Prakasa Rao Received: 25 July 2006 / Revised: 14 May
More information1. Aufgabenblatt zur Vorlesung Probability Theory
24.10.17 1. Aufgabenblatt zur Vorlesung By (Ω, A, P ) we always enote the unerlying probability space, unless state otherwise. 1. Let r > 0, an efine f(x) = 1 [0, [ (x) exp( r x), x R. a) Show that p f
More informationGoodness-of-Fit Tests for Time Series Models: A Score-Marked Empirical Process Approach
Goodness-of-Fit Tests for Time Series Models: A Score-Marked Empirical Process Approach By Shiqing Ling Department of Mathematics Hong Kong University of Science and Technology Let {y t : t = 0, ±1, ±2,
More informationBrownian Motion. 1 Definition Brownian Motion Wiener measure... 3
Brownian Motion Contents 1 Definition 2 1.1 Brownian Motion................................. 2 1.2 Wiener measure.................................. 3 2 Construction 4 2.1 Gaussian process.................................
More informationProbability and Measure
Part II Year 2018 2017 2016 2015 2014 2013 2012 2011 2010 2009 2008 2007 2006 2005 2018 84 Paper 4, Section II 26J Let (X, A) be a measurable space. Let T : X X be a measurable map, and µ a probability
More informationERRATA: Probabilistic Techniques in Analysis
ERRATA: Probabilistic Techniques in Analysis ERRATA 1 Updated April 25, 26 Page 3, line 13. A 1,..., A n are independent if P(A i1 A ij ) = P(A 1 ) P(A ij ) for every subset {i 1,..., i j } of {1,...,
More informationChapter 2. Some basic tools. 2.1 Time series: Theory Stochastic processes
Chapter 2 Some basic tools 2.1 Time series: Theory 2.1.1 Stochastic processes A stochastic process is a sequence of random variables..., x 0, x 1, x 2,.... In this class, the subscript always means time.
More informationLimit Theorems for Exchangeable Random Variables via Martingales
Limit Theorems for Exchangeable Random Variables via Martingales Neville Weber, University of Sydney. May 15, 2006 Probabilistic Symmetries and Their Applications A sequence of random variables {X 1, X
More informationThe Central Limit Theorem: More of the Story
The Central Limit Theorem: More of the Story Steven Janke November 2015 Steven Janke (Seminar) The Central Limit Theorem:More of the Story November 2015 1 / 33 Central Limit Theorem Theorem (Central Limit
More informationZdzis law Brzeźniak and Tomasz Zastawniak
Basic Stochastic Processes by Zdzis law Brzeźniak and Tomasz Zastawniak Springer-Verlag, London 1999 Corrections in the 2nd printing Version: 21 May 2005 Page and line numbers refer to the 2nd printing
More information5 Birkhoff s Ergodic Theorem
5 Birkhoff s Ergodic Theorem Birkhoff s Ergodic Theorem extends the validity of Kolmogorov s strong law to the class of stationary sequences of random variables. Stationary sequences occur naturally even
More informationDeterministic. Deterministic data are those can be described by an explicit mathematical relationship
Random data Deterministic Deterministic data are those can be described by an explicit mathematical relationship Deterministic x(t) =X cos r! k m t Non deterministic There is no way to predict an exact
More information215 Problem 1. (a) Define the total variation distance µ ν tv for probability distributions µ, ν on a finite set S. Show that
15 Problem 1. (a) Define the total variation distance µ ν tv for probability distributions µ, ν on a finite set S. Show that µ ν tv = (1/) x S µ(x) ν(x) = x S(µ(x) ν(x)) + where a + = max(a, 0). Show that
More informationSimultaneous drift conditions for Adaptive Markov Chain Monte Carlo algorithms
Simultaneous drift conditions for Adaptive Markov Chain Monte Carlo algorithms Yan Bai Feb 2009; Revised Nov 2009 Abstract In the paper, we mainly study ergodicity of adaptive MCMC algorithms. Assume that
More informationOn complete convergence and complete moment convergence for weighted sums of ρ -mixing random variables
Chen and Sung Journal of Inequalities and Applications 2018) 2018:121 https://doi.org/10.1186/s13660-018-1710-2 RESEARCH Open Access On complete convergence and complete moment convergence for weighted
More informationProbability and Measure
Chapter 4 Probability and Measure 4.1 Introduction In this chapter we will examine probability theory from the measure theoretic perspective. The realisation that measure theory is the foundation of probability
More informationA central limit theorem for randomly indexed m-dependent random variables
Filomat 26:4 (2012), 71 717 DOI 10.2298/FIL120471S ublished by Faculty of Sciences and Mathematics, University of Niš, Serbia Available at: http://www.pmf.ni.ac.rs/filomat A central limit theorem for randomly
More informationEntropy and Ergodic Theory Notes 21: The entropy rate of a stationary process
Entropy and Ergodic Theory Notes 21: The entropy rate of a stationary process 1 Sources with memory In information theory, a stationary stochastic processes pξ n q npz taking values in some finite alphabet
More informationOn the Kolmogorov exponential inequality for negatively dependent random variables
On the Kolmogorov exponential inequality for negatively dependent random variables Andrei Volodin Department of Mathematics and Statistics, University of Regina, Regina, SK, S4S 0A, Canada e-mail: volodin@math.uregina.ca
More informationStrong Mixing Conditions. Richard C. Bradley Department of Mathematics, Indiana University, Bloomington, Indiana, USA
Strong Mixing Conditions Richard C. Bradley Department of Mathematics, Indiana University, Bloomington, Indiana, USA There has been much research on stochastic models that have a well defined, specific
More informationP i [B k ] = lim. n=1 p(n) ii <. n=1. V i :=
2.7. Recurrence and transience Consider a Markov chain {X n : n N 0 } on state space E with transition matrix P. Definition 2.7.1. A state i E is called recurrent if P i [X n = i for infinitely many n]
More informationµ X (A) = P ( X 1 (A) )
1 STOCHASTIC PROCESSES This appendix provides a very basic introduction to the language of probability theory and stochastic processes. We assume the reader is familiar with the general measure and integration
More informationStochastic Differential Equations.
Chapter 3 Stochastic Differential Equations. 3.1 Existence and Uniqueness. One of the ways of constructing a Diffusion process is to solve the stochastic differential equation dx(t) = σ(t, x(t)) dβ(t)
More informationAsymptotic Statistics-III. Changliang Zou
Asymptotic Statistics-III Changliang Zou The multivariate central limit theorem Theorem (Multivariate CLT for iid case) Let X i be iid random p-vectors with mean µ and and covariance matrix Σ. Then n (
More informationExtremogram and Ex-Periodogram for heavy-tailed time series
Extremogram and Ex-Periodogram for heavy-tailed time series 1 Thomas Mikosch University of Copenhagen Joint work with Richard A. Davis (Columbia) and Yuwei Zhao (Ulm) 1 Jussieu, April 9, 2014 1 2 Extremal
More informationSpectral representations and ergodic theorems for stationary stochastic processes
AMS 263 Stochastic Processes (Fall 2005) Instructor: Athanasios Kottas Spectral representations and ergodic theorems for stationary stochastic processes Stationary stochastic processes Theory and methods
More informationCOVARIANCE IDENTITIES AND MIXING OF RANDOM TRANSFORMATIONS ON THE WIENER SPACE
Communications on Stochastic Analysis Vol. 4, No. 3 (21) 299-39 Serials Publications www.serialspublications.com COVARIANCE IDENTITIES AND MIXING OF RANDOM TRANSFORMATIONS ON THE WIENER SPACE NICOLAS PRIVAULT
More informationWeak convergence and Brownian Motion. (telegram style notes) P.J.C. Spreij
Weak convergence and Brownian Motion (telegram style notes) P.J.C. Spreij this version: December 8, 2006 1 The space C[0, ) In this section we summarize some facts concerning the space C[0, ) of real
More informationA Short Introduction to Diffusion Processes and Ito Calculus
A Short Introduction to Diffusion Processes and Ito Calculus Cédric Archambeau University College, London Center for Computational Statistics and Machine Learning c.archambeau@cs.ucl.ac.uk January 24,
More informationMarkov Chain Monte Carlo (MCMC)
Markov Chain Monte Carlo (MCMC Dependent Sampling Suppose we wish to sample from a density π, and we can evaluate π as a function but have no means to directly generate a sample. Rejection sampling can
More informationStochastic integral. Introduction. Ito integral. References. Appendices Stochastic Calculus I. Geneviève Gauthier.
Ito 8-646-8 Calculus I Geneviève Gauthier HEC Montréal Riemann Ito The Ito The theories of stochastic and stochastic di erential equations have initially been developed by Kiyosi Ito around 194 (one of
More informationSize properties of wavelet packets generated using finite filters
Rev. Mat. Iberoamericana, 18 (2002, 249 265 Size properties of wavelet packets generated using finite filters Morten Nielsen Abstract We show that asymptotic estimates for the growth in L p (R- norm of
More informationLecture 10: Semi-Markov Type Processes
Lecture 1: Semi-Markov Type Processes 1. Semi-Markov processes (SMP) 1.1 Definition of SMP 1.2 Transition probabilities for SMP 1.3 Hitting times and semi-markov renewal equations 2. Processes with semi-markov
More informationTreball final de grau GRAU DE MATEMÀTIQUES Facultat de Matemàtiques Universitat de Barcelona MARKOV CHAINS
Treball final de grau GRAU DE MATEMÀTIQUES Facultat de Matemàtiques Universitat de Barcelona MARKOV CHAINS Autor: Anna Areny Satorra Director: Dr. David Márquez Carreras Realitzat a: Departament de probabilitat,
More informationON THE COMPLETE CONVERGENCE FOR WEIGHTED SUMS OF DEPENDENT RANDOM VARIABLES UNDER CONDITION OF WEIGHTED INTEGRABILITY
J. Korean Math. Soc. 45 (2008), No. 4, pp. 1101 1111 ON THE COMPLETE CONVERGENCE FOR WEIGHTED SUMS OF DEPENDENT RANDOM VARIABLES UNDER CONDITION OF WEIGHTED INTEGRABILITY Jong-Il Baek, Mi-Hwa Ko, and Tae-Sung
More informationDistance-Divergence Inequalities
Distance-Divergence Inequalities Katalin Marton Alfréd Rényi Institute of Mathematics of the Hungarian Academy of Sciences Motivation To find a simple proof of the Blowing-up Lemma, proved by Ahlswede,
More information. Find E(V ) and var(v ).
Math 6382/6383: Probability Models and Mathematical Statistics Sample Preliminary Exam Questions 1. A person tosses a fair coin until she obtains 2 heads in a row. She then tosses a fair die the same number
More informationis well-defined, and is distributed according to a Cauchy law If t 0, compute P( X t Y ).
MA 539 - PROBLEM LIST DISCRETE TIME PROCESSES AND BROWNIAN MOTION Problem 1. Let γ a,b be the function: 1. Gaussian vectors and CLT γ a,b (x) = 1 Γ(a)b a xa 1 e x/b 1 {x>}, where a, b > and Γ(x) = e t
More informationChp 4. Expectation and Variance
Chp 4. Expectation and Variance 1 Expectation In this chapter, we will introduce two objectives to directly reflect the properties of a random variable or vector, which are the Expectation and Variance.
More information1 Introduction This work follows a paper by P. Shields [1] concerned with a problem of a relation between the entropy rate of a nite-valued stationary
Prexes and the Entropy Rate for Long-Range Sources Ioannis Kontoyiannis Information Systems Laboratory, Electrical Engineering, Stanford University. Yurii M. Suhov Statistical Laboratory, Pure Math. &
More informationSPECTRAL THEOREM FOR COMPACT SELF-ADJOINT OPERATORS
SPECTRAL THEOREM FOR COMPACT SELF-ADJOINT OPERATORS G. RAMESH Contents Introduction 1 1. Bounded Operators 1 1.3. Examples 3 2. Compact Operators 5 2.1. Properties 6 3. The Spectral Theorem 9 3.3. Self-adjoint
More informationQED. Queen s Economics Department Working Paper No. 1244
QED Queen s Economics Department Working Paper No. 1244 A necessary moment condition for the fractional functional central limit theorem Søren Johansen University of Copenhagen and CREATES Morten Ørregaard
More informationGaussian Random Fields: Excursion Probabilities
Gaussian Random Fields: Excursion Probabilities Yimin Xiao Michigan State University Lecture 5 Excursion Probabilities 1 Some classical results on excursion probabilities A large deviation result Upper
More informationLecture 12: Detailed balance and Eigenfunction methods
Miranda Holmes-Cerfon Applied Stochastic Analysis, Spring 2015 Lecture 12: Detailed balance and Eigenfunction methods Readings Recommended: Pavliotis [2014] 4.5-4.7 (eigenfunction methods and reversibility),
More informationarxiv: v1 [math.ap] 17 May 2017
ON A HOMOGENIZATION PROBLEM arxiv:1705.06174v1 [math.ap] 17 May 2017 J. BOURGAIN Abstract. We study a homogenization question for a stochastic divergence type operator. 1. Introduction and Statement Let
More information1. Stochastic Processes and filtrations
1. Stochastic Processes and 1. Stoch. pr., A stochastic process (X t ) t T is a collection of random variables on (Ω, F) with values in a measurable space (S, S), i.e., for all t, In our case X t : Ω S
More informationAn introduction to quantum stochastic calculus
An introduction to quantum stochastic calculus Robin L Hudson Loughborough University July 21, 214 (Institute) July 21, 214 1 / 31 What is Quantum Probability? Quantum probability is the generalisation
More informationWhat Makes Expectations Great? MDPs with Bonuses in the Bargain
What Makes Expectations Great? MDPs with Bonuses in the Bargain J. Michael Steele 1 Wharton School University of Pennsylvania April 6, 2017 1 including joint work with A. Arlotto (Duke) and N. Gans (Wharton)
More information9 Brownian Motion: Construction
9 Brownian Motion: Construction 9.1 Definition and Heuristics The central limit theorem states that the standard Gaussian distribution arises as the weak limit of the rescaled partial sums S n / p n of
More informationStochastic Dynamic Programming: The One Sector Growth Model
Stochastic Dynamic Programming: The One Sector Growth Model Esteban Rossi-Hansberg Princeton University March 26, 2012 Esteban Rossi-Hansberg () Stochastic Dynamic Programming March 26, 2012 1 / 31 References
More informationParametric Inference on Strong Dependence
Parametric Inference on Strong Dependence Peter M. Robinson London School of Economics Based on joint work with Javier Hualde: Javier Hualde and Peter M. Robinson: Gaussian Pseudo-Maximum Likelihood Estimation
More informationFFTs in Graphics and Vision. Homogenous Polynomials and Irreducible Representations
FFTs in Graphics and Vision Homogenous Polynomials and Irreducible Representations 1 Outline The 2π Term in Assignment 1 Homogenous Polynomials Representations of Functions on the Unit-Circle Sub-Representations
More informationQuenched central limit theorem for random walk on percolation clusters
Quenched central limit theorem for random walk on percolation clusters Noam Berger UCLA Joint work with Marek Biskup(UCLA) Bond-percolation in Z d Fix some parameter 0 < p < 1, and for every edge e in
More informationLecture 2. We now introduce some fundamental tools in martingale theory, which are useful in controlling the fluctuation of martingales.
Lecture 2 1 Martingales We now introduce some fundamental tools in martingale theory, which are useful in controlling the fluctuation of martingales. 1.1 Doob s inequality We have the following maximal
More informationA Type of Shannon-McMillan Approximation Theorems for Second-Order Nonhomogeneous Markov Chains Indexed by a Double Rooted Tree
Caspian Journal of Applied Mathematics, Ecology and Economics V. 2, No, 204, July ISSN 560-4055 A Type of Shannon-McMillan Approximation Theorems for Second-Order Nonhomogeneous Markov Chains Indexed by
More informationarxiv: v2 [math.pr] 4 Sep 2017
arxiv:1708.08576v2 [math.pr] 4 Sep 2017 On the Speed of an Excited Asymmetric Random Walk Mike Cinkoske, Joe Jackson, Claire Plunkett September 5, 2017 Abstract An excited random walk is a non-markovian
More information