Prime numbers and Gaussian random walks

Size: px
Start display at page:

Download "Prime numbers and Gaussian random walks"

Transcription

1 Prime numbers and Gaussian random walks K. Bruce Erickson Department of Mathematics University of Washington Seattle, WA March 24, 205 Introduction Consider a symmetric aperiodic random walk W = {W r } = (W r, W 2 s, W 3 r ), r = 0,,..., on the integer lattice Z 3 starting at W 0 = 0. This means that the steps or increments {W r+ W r } r 0 are independent with a common distribution that is invariant under reflection through the origin and that the support of this distribution generates the entire lattice Z 3. We shall also assume that its one-step displacement has a finite second moment: E W r+ W r 2 < () The symmetry and () implies E (W r+ W r ) = 0 (the vector). (We call describe any walk on Z 3 satisfying all of the preceeding as Gaussian.) The walk induces a non-defective walk on the z-axis. More precisely put T = min{r > 0 : W r = W 2 r = 0} T n = min(r > T n : W r = W 2 r = 0}, n 2, S 0 = 0, and S n = W 3 T(n), n. The two dimensional walk {(W r, W 2 r )} r 0 returns to the origin infinitely often, a.s., so that P{T n < n} =. The Markov property and the linear structure of the z-axis imply that the sequence of increments {X n } {S n S n } is stationary and mutually totally independent. Therefore the sequence S = {S n } n 0, defines a (symmetric)

2 random walk on the one-dimensional lattice Z. (With a slight abuse of terminology, we will call this sequence the walk induced by W on the z-axis.) The well known transience of W implies the transience of S which means that S cannot visit any finite set of integer points more than a finite number of times if at all. Many infinite subsets of lattice points also have this transience property. For example, S will not hit the set of perfect squares, {, 4, 9,... }, infinitely often. Let us denote the set of prime numbers by Q, and by Q the set {0} {0} Q. P. Erdös, H. P. Mckean, C. Stone, and B. Kochen established the interesting result that if W is the simple random walk, then, W returns to the set Q infinitely often. In terms of the induced walk S, P{S n Q i. o.} =. From this result and an important invariance principle due to F. Spitzer, [6], one then gets the recurrence of Q for any aperiodic walk in Z 3 with mean 0 displacement and finite second moments (wether or not the step distribution is symmetric). Although these Gaussian walks W do hit Q infinitely often, it comes as a surprise that for some walks the set Q is transient for the sequence of successive high points on the z-axis. More precisely, let M n = max{s j : j n}, then we prove,under various additional assumptions, that P{M n Q i.o.} = 0. For these random walks, with probability, there is a finite time such that the knowledge that W has reached a new prime point on the z-axis after that time implies that S has already hit a (non-prime) point higher up. (For the exact statement, see Theorem in section 4.) One can certainly conjecture that this assertion remains valid for all Gaussian walks. 2 Characteristic function of the induced walk Let {p n } denote the common distribution of the steps of S and let ϕ(t) denote the characteristic function of X = S, i.e., ϕ(t) = E e its = n p n e int. Our first item is the asymptotic formula ϕ(t) log(/ t ), t 0, 2 (2) The common distribution of the X k is very heavy tailed ; E X q = for any q > 0. 2

3 I do not have a complete proof of the transience of Q for the z-axis ladders for general Gaussian walks. In order to make progress I need to impose some additional restrictions. The first one is not as serious as the second. (See the statement of Theorem below.) Our first additional condition is to assume that the two processes {(W n, W 2 n)} r 0 and {W 3 s } s 0 are independent. (3) Let γ(t) = E exp ( itw 3 ). Then ϕ(t) = E e its = j P{T = j}e e itw3 j = E γ(t) T (4) because T and W 3 are independent by (3). However, it is well known that P{T > n} log n, n (5) (For the simple walk case, see [6], page 67. This result does not depend on the asumption (3). A proof will be given in Appendix 2.) The formula (5) and an Abelian theorem, [2], page 447, ρ = in (5.24)/(5.26), imply that By Taylor s formula E s T s ( s)log ( ), s. (6) s γ(t) = 2 m 2t 2[ + o() ], for t 0. (7) This and (6) and (4) (and the reality of γ by symmetry) imply that ϕ(t) = ( γ(t) ) E γ(t) T γ(t), t 0. log(/ t ) This completes the proof of (2) in this case. 2 We use the notation a(t) b(t), t t 0, to mean that the lim t t0 a(t)/b(t) is finite and strictly positive. The notation a(t) b(t), t t 0, means the ratio of a(t) to b(t) is bounded strictly away from 0 and in a neighborhood of t 0. 3

4 3 Renewal function for the ladders Let N, N, S N, and S N denote the first strict ascending/descending ladder epochs and positions. For example, N + = min{n : S n > 0}. Then, see [2], Chapter XVIII, sϕ(t) = c(s) [ E {s N e its N } ][ E {s N e its N } ] (8) where log c(s) = (s n /n)p(s n = 0). But S N has the same distribution as S N so that on setting s = we find that ϕ(t) = c() χ(t) 2 where χ is the characteristic funcion of S N. From (2) it follows that χ(t) log(/ t ) t 0. (9) Now let f(z) = χ( i logz) = f n z n, n= (f n = P{S N = n}), so that χ(t) = f(e it ), and consider the function log {[ f(z)] 2log( } z), for z, z D(z) = z log C2 2 for z =. (0) The distribution {f n } is aperiodic, that is, χ(t) = if and only if t is a multiple of 2π. This implies that f(z) = and z if and only if z =. (Note that the coefficients of f are non-negative and sum to.) The function log( z) z = n=0 z n n +, is also analytic in z < and has positive derivatives at 0 of all orders. It is also continuous and non-zero at the boundary z = except of course at the point z =. Finally, it never vanishes in z. It follows that D is 4

5 analytic in z <, is continuous on z, and is real valued for z real and positive. Moreover R{D(z)} = log z) [ f(z)]2log( z () Hence D(z) = 2π π π e it + z ( e it z log χ(t) 2 log( e it ) e it ) dt, z <. (2) It follows from this formula, an integral splitting argument, and the asymptotic formula (e it log( e it ) log(/ t ) for t 0, that and consequently lim[ f(s)] 2 log( s) = lime D(s) = C2 2 (3) s s f(s) s C 2 ( s){log( s) } /2, s. (4) Karmata s Tauberian theorem, [2], equation (5.26) on page 447 (with ρ = ), shows that (4) implies q n = coefficient on s n in LHS (4) = k>n f k = P{L = S N > n} log n, n 3 (5) Now consider the sequence {N k } of strict ascending ladder times of the walk S defined inductively by N k+ = min{n > N k : S n > S Nk } (6) This coincides with the sequence of times of occurrence of new maximums of S. Anway if we put L 0 = 0 and L k = S N(k), we get the strict ascending ladder process. Its increments {L k L k } k are mutually independent and have the same distribution {f n } defined earlier. Let ψ n = P{L j = n} = P [ n {L 0, L,..., } ] (7) j=0 3 I want to thank Professor Don Marshall for suggesting the possibility of going from the formula (9) to the formula (3) via the integral (2). 5

6 This is the renewal function for {L k } and its generating function satisfies: ψ n s n = n 0 f(s) Therefore, by (5) and Karamata Tauberians, (8) ψ 0 + ψ + + ψ n log n (9) Conjecture For the sequence {ψ n } as defined above in connection with a given Gaussian walk, we have ( ) ψ n = O n (20) log n Unfortunately, neither (5) nor (9) is sufficient to establish (20). On the other hand the renewal sequence {ψ n } has additional useful properties. In particular let g(w) be the expected number of hits of W at the point w = (w, w 2, w 3 ) and let v n be the expected number of hits by S at n. Then v n = g(0, 0, n). But for general aperiodic random walks on Z 3 with mean 0 and finite second moments we know that g(w) / w for large w. See [6], P, page 308. Therefore v n n, n (2) A sequence {ψ n } is asymptotically decreasing if there are finite positive constants C, n 0 such that ψ m Cψ n for all n and m with m > n n 0 (22) (A bounded increasing sequence is asymptotically decreasing by this definition!) Lemma. If the renewal sequence {ψ n } is asymptotically decreasing, then (20) holds. Proof. For n 0 we will prove in an appendix that for some number c > 0, v n = c ψ k+n ψ k. (23) k=0 6

7 It follows from (23) and (2) and (9) that for some constants C, C 2, etc., and all k sufficiently large, we have C k v k C 2 C 3 ψ 2k k ψ j+k ψ j j=0 k ψ j C 4 ψ 2k log k j=0 And this imples (20) for even n because ρ n = n log n is a regularly varying sequence (with exponent ) so that ρ 2k 2ρ k as k. Applying (22) again gives ψ 2k+ Cψ 2k = O(k log k) ). Thus (20) holds for odd n also. Conjecture 2 The sequence {ψ n } as defined above in connection with a given Gaussian walk is asymptotically decreasing. I have no example for which I can actually verify this. 4 Transience of the primes for the maxima Clearly the random point sets determined by the sequences {L k } and {M n } coincide; the transience of the primes for {M n } is equivalent to the transience of the primes for the ascending ladder height process {L n }. Theorem. Let W = {W r } be a Gaussian walk which satisfies (3) and for which the renewal function for the ladder process {L k } of the induced walk {S n } satisfies (20). If {M n } denotes the sequence of succesive maximum values of {S n }, then P{M n is prime i. o. } = 0. The proof is almost trivial. Let x k = x(k) denote the k-th prime. Then x k k log k as k. Hence if (20) is correct, then ( ) ψ x(k) = O k log k k log(k log k) k=2 k=2 ( ) = O < (24) k (log k) 3/2 k=2 7

8 Clearly (24) is more than enough to imply P{L n is prime i. o.} = 0 which, as noted above, is equivalent to the assertion of the theorem. 5 Appendix : Proof of (23) Write χ(s, t) = E ( ) s N e its N χ (s, t) = E ( s N e its N ) where N is the epoch of the first strict descending ladder height (i.e., the first entrance time to (, 0) of {S n }, when S 0 = 0). Then because S is symmetric, (N, S N ) has the same distribution as (N, S N ), so that χ (s, t) = χ(s, t) = χ(s, t). The Wiener-Hopf facorization (8) then gives sϕ(t) = c(s) [ χ(s, t)][ χ (s, t)] = c(s) χ(s, t) 2 (25) where c(s) = exp[ n (sn /n)p{s n = 0}]. See [2] page 605, formula (3.7). All terms in (25) are continuous 2π-periodic functions of t for s <. Denote the Fourier coefficients of { sϕ(t)} by v n (s) and those of χ(s, t) and χ (s, t) by ψ (s) k and ψ (s) k, and by N j the j-th strict ascending ladder epoch with N 0 = S 0 = 0. Recall that {(N j N j, L j L j )} j= are i.i.d. random vectors, where L j = S N(j). v (s) n = ψ (s) k = ψ (s), k s k P{S k = n}, n = 0 ± ± 2,... k=0 { 0 if k 0 j=0 E { s N j ; L j = k } for k > 0 = ψ (s) k, for all k. From this we see that all of these coefficients are non-negative and form absolutely convergent Fourier series (for fixed 0 s < ). Expanding both sides of (25) in Fourier series and equating coeffiecents on like powers of e it 8

9 and using symmetry of v n, we get, for n > 0, v (s) n = v (s) n = c(s) = c(s) k=0 k= ψ (s) k ψ(s) k+n ψ (s) k ψ(s), n k Also from the formulas for the coefficients, it is clear that ψ (s) k ψ k and v n as s. Therefore, from the last formula and ordinary monotone v (s) n convergence for sums, we obtain v n = limv n (s) = limc(s) s s = c ψ k ψ n+k k=0 k=0 ψ (s) k ψ(s) n+k where c = c() = exp( n (/n)p{s n = 0}) which is non-zero and finite. This completes the proof of (23). The formula (23) does not appear explicitly in either [2] or [6], nor in one other book I consulted. But it must be well known to workers in the field considering the elementary nature of the proof. 6 Appendix 2: Proof of (5) Let h = min[r : P{W r = W 2 r = 0} > 0]. Then for each k the values of T k (the epoch of the k-th return to the z-axis of W) must be integer multiples of h. Moreover the sub-walk { ( W rh, W 2 rh) }r 0 is strongly aperiodic on Z 2 and has mean 0 and finite second moments. See [6], P, page 42. From P9 page 75 of [6] it follows that u n P{T k = nh for some k } = P{W nh = W 2 nh = 0} n so n=0 u ns n log( s) as s. On the other hand u n s n = n=0 E s T /h 9

10 Hence P{T /h > n} = E st /h s n=0 ( s)log( s) as s Karamata s Tauberian theorem now yields P{T > nh} (log n) which certainly implies (5). See [2] equation (5.26), page 447. References [] Benjamini, I., Pemantle, R., and Peres, Y. (995) Martin capacity for markov chains. Annals of Probab [2] Feller, William. (97). An Introduction to Probability Theory and Its Applications, II, 2nd ed. John Wiley & Sons, New York. [3] Kochen, S. and Stone, C. (964). A note on the Borel-Cantelli lemma. Illinois J. Math [4] McKean, H. P. Jr. (96). A problem about prime numbers and the random walk I. Illinois J. Math [5] Ruzsa, I. Z. and Székely, G. J. (982). Intersections of traces of random walks with fixed sets. Annals of Probab., [6] Spitzer, Frank. (976). Principles of Random Walk, 2nd ed. Graduate Texts in Mathematics 34. Springer-Verlag, New York. 0

MARTIN CAPACITY FOR MARKOV CHAINS

MARTIN CAPACITY FOR MARKOV CHAINS MARTIN CAPACITY FOR MARKOV CHAINS Itai Benjamini 1, Robin Pemantle 2 and Yuval Peres 3 Cornell University, University of Wisconsin and University of California Abstract The probability that a transient

More information

An Introduction to Probability Theory and Its Applications

An Introduction to Probability Theory and Its Applications An Introduction to Probability Theory and Its Applications WILLIAM FELLER (1906-1970) Eugene Higgins Professor of Mathematics Princeton University VOLUME II SECOND EDITION JOHN WILEY & SONS Contents I

More information

On the Borel-Cantelli Lemma

On the Borel-Cantelli Lemma On the Borel-Cantelli Lemma Alexei Stepanov, Izmir University of Economics, Turkey In the present note, we propose a new form of the Borel-Cantelli lemma. Keywords and Phrases: the Borel-Cantelli lemma,

More information

Recurrence of Simple Random Walk on Z 2 is Dynamically Sensitive

Recurrence of Simple Random Walk on Z 2 is Dynamically Sensitive arxiv:math/5365v [math.pr] 3 Mar 25 Recurrence of Simple Random Walk on Z 2 is Dynamically Sensitive Christopher Hoffman August 27, 28 Abstract Benjamini, Häggström, Peres and Steif [2] introduced the

More information

P i [B k ] = lim. n=1 p(n) ii <. n=1. V i :=

P i [B k ] = lim. n=1 p(n) ii <. n=1. V i := 2.7. Recurrence and transience Consider a Markov chain {X n : n N 0 } on state space E with transition matrix P. Definition 2.7.1. A state i E is called recurrent if P i [X n = i for infinitely many n]

More information

Lecture 12. F o s, (1.1) F t := s>t

Lecture 12. F o s, (1.1) F t := s>t Lecture 12 1 Brownian motion: the Markov property Let C := C(0, ), R) be the space of continuous functions mapping from 0, ) to R, in which a Brownian motion (B t ) t 0 almost surely takes its value. Let

More information

Multiple points of the Brownian sheet in critical dimensions

Multiple points of the Brownian sheet in critical dimensions Multiple points of the Brownian sheet in critical dimensions Robert C. Dalang Ecole Polytechnique Fédérale de Lausanne Based on joint work with: Carl Mueller Multiple points of the Brownian sheet in critical

More information

The range of tree-indexed random walk

The range of tree-indexed random walk The range of tree-indexed random walk Jean-François Le Gall, Shen Lin Institut universitaire de France et Université Paris-Sud Orsay Erdös Centennial Conference July 2013 Jean-François Le Gall (Université

More information

Convergence Rates for Renewal Sequences

Convergence Rates for Renewal Sequences Convergence Rates for Renewal Sequences M. C. Spruill School of Mathematics Georgia Institute of Technology Atlanta, Ga. USA January 2002 ABSTRACT The precise rate of geometric convergence of nonhomogeneous

More information

MATH 564/STAT 555 Applied Stochastic Processes Homework 2, September 18, 2015 Due September 30, 2015

MATH 564/STAT 555 Applied Stochastic Processes Homework 2, September 18, 2015 Due September 30, 2015 ID NAME SCORE MATH 56/STAT 555 Applied Stochastic Processes Homework 2, September 8, 205 Due September 30, 205 The generating function of a sequence a n n 0 is defined as As : a ns n for all s 0 for which

More information

Lecture 11: Introduction to Markov Chains. Copyright G. Caire (Sample Lectures) 321

Lecture 11: Introduction to Markov Chains. Copyright G. Caire (Sample Lectures) 321 Lecture 11: Introduction to Markov Chains Copyright G. Caire (Sample Lectures) 321 Discrete-time random processes A sequence of RVs indexed by a variable n 2 {0, 1, 2,...} forms a discretetime random process

More information

The Codimension of the Zeros of a Stable Process in Random Scenery

The Codimension of the Zeros of a Stable Process in Random Scenery The Codimension of the Zeros of a Stable Process in Random Scenery Davar Khoshnevisan The University of Utah, Department of Mathematics Salt Lake City, UT 84105 0090, U.S.A. davar@math.utah.edu http://www.math.utah.edu/~davar

More information

1 Sequences of events and their limits

1 Sequences of events and their limits O.H. Probability II (MATH 2647 M15 1 Sequences of events and their limits 1.1 Monotone sequences of events Sequences of events arise naturally when a probabilistic experiment is repeated many times. For

More information

Universal examples. Chapter The Bernoulli process

Universal examples. Chapter The Bernoulli process Chapter 1 Universal examples 1.1 The Bernoulli process First description: Bernoulli random variables Y i for i = 1, 2, 3,... independent with P [Y i = 1] = p and P [Y i = ] = 1 p. Second description: Binomial

More information

Lecture Notes: Markov chains Tuesday, September 16 Dannie Durand

Lecture Notes: Markov chains Tuesday, September 16 Dannie Durand Computational Genomics and Molecular Biology, Lecture Notes: Markov chains Tuesday, September 6 Dannie Durand In the last lecture, we introduced Markov chains, a mathematical formalism for modeling how

More information

arxiv: v2 [math.pr] 4 Sep 2017

arxiv: v2 [math.pr] 4 Sep 2017 arxiv:1708.08576v2 [math.pr] 4 Sep 2017 On the Speed of an Excited Asymmetric Random Walk Mike Cinkoske, Joe Jackson, Claire Plunkett September 5, 2017 Abstract An excited random walk is a non-markovian

More information

Biased random walk on percolation clusters. Noam Berger, Nina Gantert and Yuval Peres

Biased random walk on percolation clusters. Noam Berger, Nina Gantert and Yuval Peres Biased random walk on percolation clusters Noam Berger, Nina Gantert and Yuval Peres Related paper: [Berger, Gantert & Peres] (Prob. Theory related fields, Vol 126,2, 221 242) 1 The Model Percolation on

More information

Ergodic Theorems. Samy Tindel. Purdue University. Probability Theory 2 - MA 539. Taken from Probability: Theory and examples by R.

Ergodic Theorems. Samy Tindel. Purdue University. Probability Theory 2 - MA 539. Taken from Probability: Theory and examples by R. Ergodic Theorems Samy Tindel Purdue University Probability Theory 2 - MA 539 Taken from Probability: Theory and examples by R. Durrett Samy T. Ergodic theorems Probability Theory 1 / 92 Outline 1 Definitions

More information

Markov Chains and Stochastic Sampling

Markov Chains and Stochastic Sampling Part I Markov Chains and Stochastic Sampling 1 Markov Chains and Random Walks on Graphs 1.1 Structure of Finite Markov Chains We shall only consider Markov chains with a finite, but usually very large,

More information

Lecture 5. If we interpret the index n 0 as time, then a Markov chain simply requires that the future depends only on the present and not on the past.

Lecture 5. If we interpret the index n 0 as time, then a Markov chain simply requires that the future depends only on the present and not on the past. 1 Markov chain: definition Lecture 5 Definition 1.1 Markov chain] A sequence of random variables (X n ) n 0 taking values in a measurable state space (S, S) is called a (discrete time) Markov chain, if

More information

Math 456: Mathematical Modeling. Tuesday, March 6th, 2018

Math 456: Mathematical Modeling. Tuesday, March 6th, 2018 Math 456: Mathematical Modeling Tuesday, March 6th, 2018 Markov Chains: Exit distributions and the Strong Markov Property Tuesday, March 6th, 2018 Last time 1. Weighted graphs. 2. Existence of stationary

More information

Lecture 9. d N(0, 1). Now we fix n and think of a SRW on [0,1]. We take the k th step at time k n. and our increments are ± 1

Lecture 9. d N(0, 1). Now we fix n and think of a SRW on [0,1]. We take the k th step at time k n. and our increments are ± 1 Random Walks and Brownian Motion Tel Aviv University Spring 011 Lecture date: May 0, 011 Lecture 9 Instructor: Ron Peled Scribe: Jonathan Hermon In today s lecture we present the Brownian motion (BM).

More information

Math Homework 5 Solutions

Math Homework 5 Solutions Math 45 - Homework 5 Solutions. Exercise.3., textbook. The stochastic matrix for the gambler problem has the following form, where the states are ordered as (,, 4, 6, 8, ): P = The corresponding diagram

More information

6 Markov Chain Monte Carlo (MCMC)

6 Markov Chain Monte Carlo (MCMC) 6 Markov Chain Monte Carlo (MCMC) The underlying idea in MCMC is to replace the iid samples of basic MC methods, with dependent samples from an ergodic Markov chain, whose limiting (stationary) distribution

More information

Chapter 2: Markov Chains and Queues in Discrete Time

Chapter 2: Markov Chains and Queues in Discrete Time Chapter 2: Markov Chains and Queues in Discrete Time L. Breuer University of Kent 1 Definition Let X n with n N 0 denote random variables on a discrete space E. The sequence X = (X n : n N 0 ) is called

More information

Harmonic Functions and Brownian motion

Harmonic Functions and Brownian motion Harmonic Functions and Brownian motion Steven P. Lalley April 25, 211 1 Dynkin s Formula Denote by W t = (W 1 t, W 2 t,..., W d t ) a standard d dimensional Wiener process on (Ω, F, P ), and let F = (F

More information

IEOR 6711: Stochastic Models I Fall 2013, Professor Whitt Lecture Notes, Thursday, September 5 Modes of Convergence

IEOR 6711: Stochastic Models I Fall 2013, Professor Whitt Lecture Notes, Thursday, September 5 Modes of Convergence IEOR 6711: Stochastic Models I Fall 2013, Professor Whitt Lecture Notes, Thursday, September 5 Modes of Convergence 1 Overview We started by stating the two principal laws of large numbers: the strong

More information

Non-Essential Uses of Probability in Analysis Part IV Efficient Markovian Couplings. Krzysztof Burdzy University of Washington

Non-Essential Uses of Probability in Analysis Part IV Efficient Markovian Couplings. Krzysztof Burdzy University of Washington Non-Essential Uses of Probability in Analysis Part IV Efficient Markovian Couplings Krzysztof Burdzy University of Washington 1 Review See B and Kendall (2000) for more details. See also the unpublished

More information

On Bank-Laine functions

On Bank-Laine functions Computational Methods and Function Theory Volume 00 0000), No. 0, 000 000 XXYYYZZ On Bank-Laine functions Alastair Fletcher Keywords. Bank-Laine functions, zeros. 2000 MSC. 30D35, 34M05. Abstract. In this

More information

The Borel-Cantelli Group

The Borel-Cantelli Group The Borel-Cantelli Group Dorothy Baumer Rong Li Glenn Stark November 14, 007 1 Borel-Cantelli Lemma Exercise 16 is the introduction of the Borel-Cantelli Lemma using Lebesue measure. An approach using

More information

Krzysztof Burdzy University of Washington. = X(Y (t)), t 0}

Krzysztof Burdzy University of Washington. = X(Y (t)), t 0} VARIATION OF ITERATED BROWNIAN MOTION Krzysztof Burdzy University of Washington 1. Introduction and main results. Suppose that X 1, X 2 and Y are independent standard Brownian motions starting from 0 and

More information

Modern Discrete Probability Branching processes

Modern Discrete Probability Branching processes Modern Discrete Probability IV - Branching processes Review Sébastien Roch UW Madison Mathematics November 15, 2014 1 Basic definitions 2 3 4 Galton-Watson branching processes I Definition A Galton-Watson

More information

MATH 56A: STOCHASTIC PROCESSES CHAPTER 2

MATH 56A: STOCHASTIC PROCESSES CHAPTER 2 MATH 56A: STOCHASTIC PROCESSES CHAPTER 2 2. Countable Markov Chains I started Chapter 2 which talks about Markov chains with a countably infinite number of states. I did my favorite example which is on

More information

INTRODUCTION TO MARKOV CHAINS AND MARKOV CHAIN MIXING

INTRODUCTION TO MARKOV CHAINS AND MARKOV CHAIN MIXING INTRODUCTION TO MARKOV CHAINS AND MARKOV CHAIN MIXING ERIC SHANG Abstract. This paper provides an introduction to Markov chains and their basic classifications and interesting properties. After establishing

More information

Analysis of the ruin probability using Laplace transforms and Karamata Tauberian theorems

Analysis of the ruin probability using Laplace transforms and Karamata Tauberian theorems Analysis of the ruin probability using Laplace transforms and Karamata Tauberian theorems Corina Constantinescu and Enrique Thomann Abstract The classical result of Cramer-Lundberg states that if the rate

More information

TAUBERIAN THEOREM FOR HARMONIC MEAN OF STIELTJES TRANSFORMS AND ITS APPLICATIONS TO LINEAR DIFFUSIONS

TAUBERIAN THEOREM FOR HARMONIC MEAN OF STIELTJES TRANSFORMS AND ITS APPLICATIONS TO LINEAR DIFFUSIONS Kasahara, Y. and Kotani, S. Osaka J. Math. 53 (26), 22 249 TAUBERIAN THEOREM FOR HARMONIC MEAN OF STIELTJES TRANSFORMS AND ITS APPLICATIONS TO LINEAR DIFFUSIONS YUJI KASAHARA and SHIN ICHI KOTANI (Received

More information

Directionally Reinforced Random Walks

Directionally Reinforced Random Walks advances in mathematics 117, 239252 (1996) article no. 0011 Directionally Reinforced Random Walks R. Daniel Mauldin*, - and Michael Monticino - Department of Mathematics, University of North Texas, P.O.

More information

HOPF S DECOMPOSITION AND RECURRENT SEMIGROUPS. Josef Teichmann

HOPF S DECOMPOSITION AND RECURRENT SEMIGROUPS. Josef Teichmann HOPF S DECOMPOSITION AND RECURRENT SEMIGROUPS Josef Teichmann Abstract. Some results of ergodic theory are generalized in the setting of Banach lattices, namely Hopf s maximal ergodic inequality and the

More information

Quenched Limit Laws for Transient, One-Dimensional Random Walk in Random Environment

Quenched Limit Laws for Transient, One-Dimensional Random Walk in Random Environment Quenched Limit Laws for Transient, One-Dimensional Random Walk in Random Environment Jonathon Peterson School of Mathematics University of Minnesota April 8, 2008 Jonathon Peterson 4/8/2008 1 / 19 Background

More information

A Detailed Look at a Discrete Randomw Walk with Spatially Dependent Moments and Its Continuum Limit

A Detailed Look at a Discrete Randomw Walk with Spatially Dependent Moments and Its Continuum Limit A Detailed Look at a Discrete Randomw Walk with Spatially Dependent Moments and Its Continuum Limit David Vener Department of Mathematics, MIT May 5, 3 Introduction In 8.366, we discussed the relationship

More information

Francesco Caravenna 1 and Loïc Chaumont 2

Francesco Caravenna 1 and Loïc Chaumont 2 INVARIANCE PRINCIPLES FOR RANDOM WALKS CONDITIONED TO STAY POSITIVE Francesco Caravenna 1 and Loïc Chaumont 2 Abstract. Let {S n } be a random walk in the domain of attraction of a stable law Y, i.e. there

More information

Markov Chains CK eqns Classes Hitting times Rec./trans. Strong Markov Stat. distr. Reversibility * Markov Chains

Markov Chains CK eqns Classes Hitting times Rec./trans. Strong Markov Stat. distr. Reversibility * Markov Chains Markov Chains A random process X is a family {X t : t T } of random variables indexed by some set T. When T = {0, 1, 2,... } one speaks about a discrete-time process, for T = R or T = [0, ) one has a continuous-time

More information

2. Transience and Recurrence

2. Transience and Recurrence Virtual Laboratories > 15. Markov Chains > 1 2 3 4 5 6 7 8 9 10 11 12 2. Transience and Recurrence The study of Markov chains, particularly the limiting behavior, depends critically on the random times

More information

Lecture 8. Here we show the Asymptotics for Green s funcion and application for exiting annuli in dimension d 3 Reminders: P(S n = x) 2 ( d

Lecture 8. Here we show the Asymptotics for Green s funcion and application for exiting annuli in dimension d 3 Reminders: P(S n = x) 2 ( d Random Walks and Brownian Motion Tel Aviv University Spring 0 Lecture date: Apr 9, 0 Lecture 8 Instructor: Ron Peled Scribe: Uri Grupel In this lecture we compute asumptotics estimates for the Green s

More information

#A69 INTEGERS 13 (2013) OPTIMAL PRIMITIVE SETS WITH RESTRICTED PRIMES

#A69 INTEGERS 13 (2013) OPTIMAL PRIMITIVE SETS WITH RESTRICTED PRIMES #A69 INTEGERS 3 (203) OPTIMAL PRIMITIVE SETS WITH RESTRICTED PRIMES William D. Banks Department of Mathematics, University of Missouri, Columbia, Missouri bankswd@missouri.edu Greg Martin Department of

More information

Countable state discrete time Markov Chains

Countable state discrete time Markov Chains Countable state discrete time Markov Chains Tuesday, March 18, 2014 2:12 PM Readings: Lawler Ch. 2 Karlin & Taylor Chs. 2 & 3 Resnick Ch. 1 Countably infinite state spaces are of practical utility in situations

More information

25.1 Ergodicity and Metric Transitivity

25.1 Ergodicity and Metric Transitivity Chapter 25 Ergodicity This lecture explains what it means for a process to be ergodic or metrically transitive, gives a few characterizes of these properties (especially for AMS processes), and deduces

More information

arxiv:math/ v2 [math.nt] 3 Dec 2003

arxiv:math/ v2 [math.nt] 3 Dec 2003 arxiv:math/0302091v2 [math.nt] 3 Dec 2003 Every function is the representation function of an additive basis for the integers Melvyn B. Nathanson Department of Mathematics Lehman College (CUNY) Bronx,

More information

MS&E 321 Spring Stochastic Systems June 1, 2013 Prof. Peter W. Glynn Page 1 of 7

MS&E 321 Spring Stochastic Systems June 1, 2013 Prof. Peter W. Glynn Page 1 of 7 MS&E 321 Spring 12-13 Stochastic Systems June 1, 213 Prof. Peter W. Glynn Page 1 of 7 Section 9: Renewal Theory Contents 9.1 Renewal Equations..................................... 1 9.2 Solving the Renewal

More information

On an uniqueness theorem for characteristic functions

On an uniqueness theorem for characteristic functions ISSN 392-53 Nonlinear Analysis: Modelling and Control, 207, Vol. 22, No. 3, 42 420 https://doi.org/0.5388/na.207.3.9 On an uniqueness theorem for characteristic functions Saulius Norvidas Institute of

More information

MATH 56A: STOCHASTIC PROCESSES CHAPTER 1

MATH 56A: STOCHASTIC PROCESSES CHAPTER 1 MATH 56A: STOCHASTIC PROCESSES CHAPTER. Finite Markov chains For the sake of completeness of these notes I decided to write a summary of the basic concepts of finite Markov chains. The topics in this chapter

More information

Monotone Point-to-Set Vector Fields

Monotone Point-to-Set Vector Fields Monotone Point-to-Set Vector Fields J.X. da Cruz Neto, O.P.Ferreira and L.R. Lucambio Pérez Dedicated to Prof.Dr. Constantin UDRIŞTE on the occasion of his sixtieth birthday Abstract We introduce the concept

More information

Asymptotics and Simulation of Heavy-Tailed Processes

Asymptotics and Simulation of Heavy-Tailed Processes Asymptotics and Simulation of Heavy-Tailed Processes Department of Mathematics Stockholm, Sweden Workshop on Heavy-tailed Distributions and Extreme Value Theory ISI Kolkata January 14-17, 2013 Outline

More information

MATH 590: Meshfree Methods

MATH 590: Meshfree Methods MATH 590: Meshfree Methods Chapter 5: Completely Monotone and Multiply Monotone Functions Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2010 fasshauer@iit.edu MATH

More information

Logarithmic scaling of planar random walk s local times

Logarithmic scaling of planar random walk s local times Logarithmic scaling of planar random walk s local times Péter Nándori * and Zeyu Shen ** * Department of Mathematics, University of Maryland ** Courant Institute, New York University October 9, 2015 Abstract

More information

RENEWAL THEORY STEVEN P. LALLEY UNIVERSITY OF CHICAGO. X i

RENEWAL THEORY STEVEN P. LALLEY UNIVERSITY OF CHICAGO. X i RENEWAL THEORY STEVEN P. LALLEY UNIVERSITY OF CHICAGO 1. RENEWAL PROCESSES A renewal process is the increasing sequence of random nonnegative numbers S 0,S 1,S 2,... gotten by adding i.i.d. positive random

More information

The Geometry of Cubic Maps

The Geometry of Cubic Maps The Geometry of Cubic Maps John Milnor Stony Brook University (www.math.sunysb.edu) work with Araceli Bonifant and Jan Kiwi Conformal Dynamics and Hyperbolic Geometry CUNY Graduate Center, October 23,

More information

COMPOSITION SEMIGROUPS AND RANDOM STABILITY. By John Bunge Cornell University

COMPOSITION SEMIGROUPS AND RANDOM STABILITY. By John Bunge Cornell University The Annals of Probability 1996, Vol. 24, No. 3, 1476 1489 COMPOSITION SEMIGROUPS AND RANDOM STABILITY By John Bunge Cornell University A random variable X is N-divisible if it can be decomposed into a

More information

Sums of exponentials of random walks

Sums of exponentials of random walks Sums of exponentials of random walks Robert de Jong Ohio State University August 27, 2009 Abstract This paper shows that the sum of the exponential of an oscillating random walk converges in distribution,

More information

Positive and null recurrent-branching Process

Positive and null recurrent-branching Process December 15, 2011 In last discussion we studied the transience and recurrence of Markov chains There are 2 other closely related issues about Markov chains that we address Is there an invariant distribution?

More information

Transience: Whereas a finite closed communication class must be recurrent, an infinite closed communication class can be transient:

Transience: Whereas a finite closed communication class must be recurrent, an infinite closed communication class can be transient: Stochastic2010 Page 1 Long-Time Properties of Countable-State Markov Chains Tuesday, March 23, 2010 2:14 PM Homework 2: if you turn it in by 5 PM on 03/25, I'll grade it by 03/26, but you can turn it in

More information

Geometric ρ-mixing property of the interarrival times of a stationary Markovian Arrival Process

Geometric ρ-mixing property of the interarrival times of a stationary Markovian Arrival Process Author manuscript, published in "Journal of Applied Probability 50, 2 (2013) 598-601" Geometric ρ-mixing property of the interarrival times of a stationary Markovian Arrival Process L. Hervé and J. Ledoux

More information

4 Sums of Independent Random Variables

4 Sums of Independent Random Variables 4 Sums of Independent Random Variables Standing Assumptions: Assume throughout this section that (,F,P) is a fixed probability space and that X 1, X 2, X 3,... are independent real-valued random variables

More information

LIMITS FOR QUEUES AS THE WAITING ROOM GROWS. Bell Communications Research AT&T Bell Laboratories Red Bank, NJ Murray Hill, NJ 07974

LIMITS FOR QUEUES AS THE WAITING ROOM GROWS. Bell Communications Research AT&T Bell Laboratories Red Bank, NJ Murray Hill, NJ 07974 LIMITS FOR QUEUES AS THE WAITING ROOM GROWS by Daniel P. Heyman Ward Whitt Bell Communications Research AT&T Bell Laboratories Red Bank, NJ 07701 Murray Hill, NJ 07974 May 11, 1988 ABSTRACT We study the

More information

Department of Applied Mathematics Faculty of EEMCS. University of Twente. Memorandum No Birth-death processes with killing

Department of Applied Mathematics Faculty of EEMCS. University of Twente. Memorandum No Birth-death processes with killing Department of Applied Mathematics Faculty of EEMCS t University of Twente The Netherlands P.O. Box 27 75 AE Enschede The Netherlands Phone: +3-53-48934 Fax: +3-53-48934 Email: memo@math.utwente.nl www.math.utwente.nl/publications

More information

ELEMENTS OF PROBABILITY THEORY

ELEMENTS OF PROBABILITY THEORY ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable

More information

Szemerédi-Trotter theorem and applications

Szemerédi-Trotter theorem and applications Szemerédi-Trotter theorem and applications M. Rudnev December 6, 2004 The theorem Abstract These notes cover the material of two Applied post-graduate lectures in Bristol, 2004. Szemerédi-Trotter theorem

More information

BRANCHING PROCESSES 1. GALTON-WATSON PROCESSES

BRANCHING PROCESSES 1. GALTON-WATSON PROCESSES BRANCHING PROCESSES 1. GALTON-WATSON PROCESSES Galton-Watson processes were introduced by Francis Galton in 1889 as a simple mathematical model for the propagation of family names. They were reinvented

More information

ON THE REGULARITY OF SAMPLE PATHS OF SUB-ELLIPTIC DIFFUSIONS ON MANIFOLDS

ON THE REGULARITY OF SAMPLE PATHS OF SUB-ELLIPTIC DIFFUSIONS ON MANIFOLDS Bendikov, A. and Saloff-Coste, L. Osaka J. Math. 4 (5), 677 7 ON THE REGULARITY OF SAMPLE PATHS OF SUB-ELLIPTIC DIFFUSIONS ON MANIFOLDS ALEXANDER BENDIKOV and LAURENT SALOFF-COSTE (Received March 4, 4)

More information

Brownian Bridge and Self-Avoiding Random Walk.

Brownian Bridge and Self-Avoiding Random Walk. Brownian Bridge and Self-Avoiding Random Walk. arxiv:math/02050v [math.pr] 9 May 2002 Yevgeniy Kovchegov Email: yevgeniy@math.stanford.edu Fax: -650-725-4066 November 2, 208 Abstract We derive the Brownian

More information

Lecture 25: Large Steps and Long Waiting Times

Lecture 25: Large Steps and Long Waiting Times Lecture 25: Large Steps and Long Waiting Times Scribe: Geraint Jones (and Martin Z. Bazant) Department of Economics, MIT Proofreader: Sahand Jamal Rahi Department of Physics, MIT scribed: May 10, 2005,

More information

Examples of Countable State Markov Chains Thursday, October 16, :12 PM

Examples of Countable State Markov Chains Thursday, October 16, :12 PM stochnotes101608 Page 1 Examples of Countable State Markov Chains Thursday, October 16, 2008 12:12 PM Homework 2 solutions will be posted later today. A couple of quick examples. Queueing model (without

More information

µ n 1 (v )z n P (v, )

µ n 1 (v )z n P (v, ) Plan More Examples (Countable-state case). Questions 1. Extended Examples 2. Ideas and Results Next Time: General-state Markov Chains Homework 4 typo Unless otherwise noted, let X be an irreducible, aperiodic

More information

Let (Ω, F) be a measureable space. A filtration in discrete time is a sequence of. F s F t

Let (Ω, F) be a measureable space. A filtration in discrete time is a sequence of. F s F t 2.2 Filtrations Let (Ω, F) be a measureable space. A filtration in discrete time is a sequence of σ algebras {F t } such that F t F and F t F t+1 for all t = 0, 1,.... In continuous time, the second condition

More information

5 Birkhoff s Ergodic Theorem

5 Birkhoff s Ergodic Theorem 5 Birkhoff s Ergodic Theorem Birkhoff s Ergodic Theorem extends the validity of Kolmogorov s strong law to the class of stationary sequences of random variables. Stationary sequences occur naturally even

More information

PRIME NUMBER THEOREM

PRIME NUMBER THEOREM PRIME NUMBER THEOREM RYAN LIU Abstract. Prime numbers have always been seen as the building blocks of all integers, but their behavior and distribution are often puzzling. The prime number theorem gives

More information

Brownian Motion. 1 Definition Brownian Motion Wiener measure... 3

Brownian Motion. 1 Definition Brownian Motion Wiener measure... 3 Brownian Motion Contents 1 Definition 2 1.1 Brownian Motion................................. 2 1.2 Wiener measure.................................. 3 2 Construction 4 2.1 Gaussian process.................................

More information

SMSTC (2007/08) Probability.

SMSTC (2007/08) Probability. SMSTC (27/8) Probability www.smstc.ac.uk Contents 12 Markov chains in continuous time 12 1 12.1 Markov property and the Kolmogorov equations.................... 12 2 12.1.1 Finite state space.................................

More information

Adventures in Stochastic Processes

Adventures in Stochastic Processes Sidney Resnick Adventures in Stochastic Processes with Illustrations Birkhäuser Boston Basel Berlin Table of Contents Preface ix CHAPTER 1. PRELIMINARIES: DISCRETE INDEX SETS AND/OR DISCRETE STATE SPACES

More information

Resistance Growth of Branching Random Networks

Resistance Growth of Branching Random Networks Peking University Oct.25, 2018, Chengdu Joint work with Yueyun Hu (U. Paris 13) and Shen Lin (U. Paris 6), supported by NSFC Grant No. 11528101 (2016-2017) for Research Cooperation with Oversea Investigators

More information

RENEWAL THEORY STEVEN P. LALLEY UNIVERSITY OF CHICAGO. X i

RENEWAL THEORY STEVEN P. LALLEY UNIVERSITY OF CHICAGO. X i RENEWAL THEORY STEVEN P. LALLEY UNIVERSITY OF CHICAGO 1. RENEWAL PROCESSES A renewal process is the increasing sequence of random nonnegative numbers S 0,S 1,S 2,... gotten by adding i.i.d. positive random

More information

arxiv: v1 [math.pr] 6 Jan 2014

arxiv: v1 [math.pr] 6 Jan 2014 Recurrence for vertex-reinforced random walks on Z with weak reinforcements. Arvind Singh arxiv:40.034v [math.pr] 6 Jan 04 Abstract We prove that any vertex-reinforced random walk on the integer lattice

More information

Asymptotics for Polling Models with Limited Service Policies

Asymptotics for Polling Models with Limited Service Policies Asymptotics for Polling Models with Limited Service Policies Woojin Chang School of Industrial and Systems Engineering Georgia Institute of Technology Atlanta, GA 30332-0205 USA Douglas G. Down Department

More information

RENEWAL THEORY STEVEN P. LALLEY UNIVERSITY OF CHICAGO. X i

RENEWAL THEORY STEVEN P. LALLEY UNIVERSITY OF CHICAGO. X i RENEWAL THEORY STEVEN P. LALLEY UNIVERSITY OF CHICAGO 1. RENEWAL PROCESSES A renewal process is the increasing sequence of random nonnegative numbers S 0,S 1,S 2,... gotten by adding i.i.d. positive random

More information

Graphs with large maximum degree containing no odd cycles of a given length

Graphs with large maximum degree containing no odd cycles of a given length Graphs with large maximum degree containing no odd cycles of a given length Paul Balister Béla Bollobás Oliver Riordan Richard H. Schelp October 7, 2002 Abstract Let us write f(n, ; C 2k+1 ) for the maximal

More information

Classification of Countable State Markov Chains

Classification of Countable State Markov Chains Classification of Countable State Markov Chains Friday, March 21, 2014 2:01 PM How can we determine whether a communication class in a countable state Markov chain is: transient null recurrent positive

More information

Lecture 2. 1 Wald Identities For General Random Walks. Tel Aviv University Spring 2011

Lecture 2. 1 Wald Identities For General Random Walks. Tel Aviv University Spring 2011 Random Walks and Brownian Motion Tel Aviv University Spring 20 Lecture date: Feb 2, 20 Lecture 2 Instructor: Ron Peled Scribe: David Lagziel The following lecture will consider mainly the simple random

More information

Pólya s Random Walk Theorem

Pólya s Random Walk Theorem Pólya s Random Walk Theorem Jonathan ovak Abstract. This note presents a proof of Pólya s random walk theorem using classical methods from special function theory and asymptotic analysis. 1. ITRODUCTIO.

More information

A generalization of Strassen s functional LIL

A generalization of Strassen s functional LIL A generalization of Strassen s functional LIL Uwe Einmahl Departement Wiskunde Vrije Universiteit Brussel Pleinlaan 2 B-1050 Brussel, Belgium E-mail: ueinmahl@vub.ac.be Abstract Let X 1, X 2,... be a sequence

More information

Exact Simulation of the Stationary Distribution of M/G/c Queues

Exact Simulation of the Stationary Distribution of M/G/c Queues 1/36 Exact Simulation of the Stationary Distribution of M/G/c Queues Professor Karl Sigman Columbia University New York City USA Conference in Honor of Søren Asmussen Monday, August 1, 2011 Sandbjerg Estate

More information

Arithmetic progressions in sumsets

Arithmetic progressions in sumsets ACTA ARITHMETICA LX.2 (1991) Arithmetic progressions in sumsets by Imre Z. Ruzsa* (Budapest) 1. Introduction. Let A, B [1, N] be sets of integers, A = B = cn. Bourgain [2] proved that A + B always contains

More information

Math 324 Summer 2012 Elementary Number Theory Notes on Mathematical Induction

Math 324 Summer 2012 Elementary Number Theory Notes on Mathematical Induction Math 4 Summer 01 Elementary Number Theory Notes on Mathematical Induction Principle of Mathematical Induction Recall the following axiom for the set of integers. Well-Ordering Axiom for the Integers If

More information

* 8 Groups, with Appendix containing Rings and Fields.

* 8 Groups, with Appendix containing Rings and Fields. * 8 Groups, with Appendix containing Rings and Fields Binary Operations Definition We say that is a binary operation on a set S if, and only if, a, b, a b S Implicit in this definition is the idea that

More information

On the Set of Limit Points of Normed Sums of Geometrically Weighted I.I.D. Bounded Random Variables

On the Set of Limit Points of Normed Sums of Geometrically Weighted I.I.D. Bounded Random Variables On the Set of Limit Points of Normed Sums of Geometrically Weighted I.I.D. Bounded Random Variables Deli Li 1, Yongcheng Qi, and Andrew Rosalsky 3 1 Department of Mathematical Sciences, Lakehead University,

More information

Large Sample Theory. Consider a sequence of random variables Z 1, Z 2,..., Z n. Convergence in probability: Z n

Large Sample Theory. Consider a sequence of random variables Z 1, Z 2,..., Z n. Convergence in probability: Z n Large Sample Theory In statistics, we are interested in the properties of particular random variables (or estimators ), which are functions of our data. In ymptotic analysis, we focus on describing the

More information

Note that in the example in Lecture 1, the state Home is recurrent (and even absorbing), but all other states are transient. f ii (n) f ii = n=1 < +

Note that in the example in Lecture 1, the state Home is recurrent (and even absorbing), but all other states are transient. f ii (n) f ii = n=1 < + Random Walks: WEEK 2 Recurrence and transience Consider the event {X n = i for some n > 0} by which we mean {X = i}or{x 2 = i,x i}or{x 3 = i,x 2 i,x i},. Definition.. A state i S is recurrent if P(X n

More information

Tail Decay Rates in Double QBD Processes and Related Reflected Random Walks

Tail Decay Rates in Double QBD Processes and Related Reflected Random Walks Tail Decay Rates in Double QBD Processes and Related Reflected Random Walks Masakiyo Miyazawa Department of Information Sciences, Tokyo University of Sciences, Noda, Chiba 278-8510, Japan email: miyazawa@is.noda.tus.ac.jp

More information

Joshua N. Cooper Department of Mathematics, Courant Institute of Mathematics, New York University, New York, NY 10012, USA.

Joshua N. Cooper Department of Mathematics, Courant Institute of Mathematics, New York University, New York, NY 10012, USA. CONTINUED FRACTIONS WITH PARTIAL QUOTIENTS BOUNDED IN AVERAGE Joshua N. Cooper Department of Mathematics, Courant Institute of Mathematics, New York University, New York, NY 10012, USA cooper@cims.nyu.edu

More information

SZEMERÉDI-TROTTER INCIDENCE THEOREM AND APPLICATIONS

SZEMERÉDI-TROTTER INCIDENCE THEOREM AND APPLICATIONS SZEMERÉDI-TROTTER INCIDENCE THEOREM AND APPLICATIONS PAUL H. KOESTER Given a finite set of points P R 2 and a finite family of lines L, we define the set of incidences of P and L by I(P, L) = {(p, l) P

More information