PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS

Size: px
Start display at page:

Download "PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS"

Transcription

1 PROBABILITY: LIMIT THEOREMS II, SPRING 218. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please give complete solutions, all claims need to be justified. Late homework will not be accepted. Please let me know if you find any misprints or mistakes. 1. Due by Feb 21, 11:am 1. Let (X n ) n N be an i.i.d. positive sequence, and S n = X X n. Let N t = sup{n : S n t}. Prove that (N t ) t R+ is a stochastic process. 2. Prove that every Borel set B in R d is regular, i.e., for every probability Borel measure µ, every ε >, there is a compact set K and open set U such that K B U and µ(u \ K) < ε. 3. Prove that cylinders C(t 1,..., t n, B), B B(R n ), t 1,..., t n, n N form an algebra. 4. We can define the cylindrical σ-algebra as the σ-algebra generated by elementary cylinders or by cylinders. Prove that these definitions are equivalent. 5. Let F T = σ{c(t 1,..., t n, B) : t 1,..., t n T } for T T. Prove that B(R T ) = F T. countable T T 6. Use characteristic functions to prove the existence of a Wiener process (up to continuity of paths). 7. Let (X t ) t [,1] be an (uncountable) family of i.i.d. r.v. s with nondegenerate distribution. Prove that no modification of this process can be continuous. 8. A multidimensional version of the Kolmogorov Chentsov theorem. Suppose d 1, and there is a stochastic field X : [, 1] d Ω R that satisfies E X(s) X(t) α C s t d+β for some α, β, C > and all t, s [, 1] d. Prove that there is a continuous modification of X on [, 1] d. 9. Show that the Kolmogorov Chentsov theorem cannot be relaxed: inequality E X t X s C t s is not sufficient for existence of a continuous modification. Hint: consider the following process: let τ be a r.v. with exponential distribution, and define X t = 1 {τ t}. 1. Prove that there exists a Poisson process (a process with independent increments that have Poisson distribution with parameter proportional to the length of time increments) such that: 1

2 2 PROF. YURI BAKHTIN (a) its realizations are nondecreasing, taking only whole values a.s. (b) its realizations are continuous on the right a.s. (c) all the jumps of the realizations are equal to 1 a.s. 11. Give an example of a non-gaussian 2-dimensional random vector with Gaussian marginal distributions. 12. Let Y N (a, C) be a d-dimensional random vector. Let Z = AY where A is an n d matrix. Prove that Z is Gaussian and find its mean and covariance matrix. 13. Prove that an R d -valued random vector X is Gaussian iff for every vector b R d, the r.v. b, X is Gaussian. 14. Prove that (s, t) t s defined for s, t is positive semi-definite. Hint: 1 [,t], 1 [,s] L 2 (R + ) = t s. 15. Prove that (s, t) e t s is positive semi-definite. 16. Prove that if X is a Gaussian vector in R d with parameters (a, C) and C is non-degenerate, then the distribution of X is absolutely continuous w.r.t. Lebesgue measure and the density is 1 p X (x) = det(c) 1/2 (2π) d/2 e 1 2 C 1(x a),(x a). 17. Find a condition on the mean a(t) and covariance function r(s, t) that guarantees existence of a continuous Gaussian process with these parameters. 18. Suppose (X, X 1,..., X n ) is a (not necessarily centered) Gaussian vector. Show that there are constants c, c 1,..., c n such that E(X X 1,..., X n ) = c + c 1 X c n X n. Your proof should be valid even if the covariance matrix of (X 1,..., X n ) is degenerate. 19. Consider the standard Ornstein Uhlenbeck process X (Gaussian process with mean and covariance function c(s, t) = e t s ). (a) Prove that X has a continuous modification. (b) Find E(X 4 X 1, X 2, X 3 ). 2. Prove that for every centered Gaussian process X with independent increments on R + = [, ) (X(t) X(s) is required to be independent of σ(x(r), r [, s]) for t s ), there is a nondecreasing nonrandom function f : R + R + such that X has the same f.d.d. s as Y defined by Y (t) = W (f(t)), for a Wiener process W. 21. Let µ be a σ-finite Borel measure on R d. Prove existence of Poisson point process and (Gaussian) white noise with leading measure µ. In both cases, the process X we are interested in is indexed by Borel sets A with µ(a) <, with independent values on disjoint sets, with finite additivity property for disjoint sets and such that (a) X(B) is Poisson with parameter µ(b) (for Poisson process). (b) X(B) is centered Gaussian with variance µ(b) (for white noise).

3 PROBABILITY: LIMIT THEOREMS II, SPRING 218. HOMEWORK PROBLEMS 3 2. Due by March 28, 11:am 1. Suppose the process X t is a stationary Gaussian process, and let H be the Hilbert space generated by (X t ) t R, i.e., the space consisting of L 2 -limits of linear combinations of values of X t. Prove that every element in H is a Gaussian r.v. 2. Let A, η be random variables, let a r.v. φ be independent of (A, η) and uniform on [, 2π]. Prove that X t = A cos(ηt + φ), t R, is a strictly stationary process. 3. Suppose the process X t is a stationary Gaussian process, and let H be the Hilbert space generated by (X t ) t R, i.e., the space consisting of L 2 -limits of linear combinations of values of X t. Prove that every element in H is a Gaussian r.v. 4. Find the covariance function of a stationary process such that its spectral dx 1+x 2. measure is ρ(dx) = 5. Give an example of a weakly stationary stochastic process (X n ) n N such that (X X n )/n converges in L 2 to a limit that is not a constant. 6. Let (X n ) n Z be a weakly stationary process. Prove that for any K N and any numbers a K, a K+1,..., a K 1, a K, the process (Y n ) n Z defined by Y n = K k= K a k X n+k is weakly stationary. Express the spectral measure of Y in terms of the spectral measure for X. 7. Describe the stationary sequence X n = 2π cos(nλ)z(dλ), n Z, where Z( ) is the standard white noise on [, 2π). 8. Let stationary process (X n ) n Z satisfy E X <. Prove that with probability 1, lim n (X n /n) =. 9. Find the spectral measure and spectral representation for stationary process (X t ) t R given by X t = A cos(t + φ), t R, where A and φ are independent, A L 2 and φ is uniform on [, 2π]. 1. Consider a map θ : Ω Ω. A set A is called (backward) invariant if θ 1 A = A, forward invariant if θa = A. Prove that the collection of backward invariant sets forms a σ-algebra. Give an example of Ω and θ such that the collection of forward invariant sets does not form a σ- algebra. 11. Consider the transformation θ : ω {ω + λ} on Ω = [, 1) equipped with Lebesgue measure. Here {...} denotes the fractional part of a number. This map can be interpreted as rotation of the circle (seen as [, 1) with endpoints and 1 identified).

4 4 PROF. YURI BAKHTIN A. Prove that this dynamical system is ergodic (i.e., there are no backward invariant Borel sets besides and Ω) if and only if λ / Q. Hint: for λ Q construct a backward invariant subset, for λ / Q take the indicator of an invariant set and write down the Fourier series for it (w.r.t. e 2πinx ). What happens to this expansion under θ? B. Using the Birkhoff ergodic theorem and Part A, describe the limiting behavior of (f(ω) + f(θ 1 ω) f(θ n 1 ω))/n as n, where f is any L 1 function on [, 1]. 12. Prove that every Gaussian martingale is a process with independent increments. 13. Prove that if W t is a standard Brownian motion, then Wt 2 t is a martingale. 14. Show that the function 1 P (s, x, t, Γ) = P (t s, x, Γ) = e (x y) 2 2(t s) dy 2π(t s) is a Markov transition probability function for the standard Wiener process. 15. Let (X t ) t be a stochastic process. We define F t = σ(x s, s t) and F t = σ(x s, s t). Prove that the following two versions of the Markov property are, in fact, equivalent: 1. For all A F t, B F t, P(AB X t ) = P(A X t )P(B X t ). 2. For all B F t, P(B F t ) = P(B X t ). 16. Let W be a Wiener process. The previous problem shows that the process X t = W t, t (, ] is Markov. Find the transition probability function for X t. 17. Prove that the process (X t ) given by X t = W t is Markov. Find its transition probability function. 18. Let (N t ) t be the standard Poisson process. Let X t = ( 1) Nt. Prove that (X t ) is a Markov process and find the transition probability function. 19. For a Wiener process W and b >, compute the density of τ b = inf{t : W t = b} and find Eτ b. 2. We say that a r.v. τ is a stopping time w.r.t. a filtration (F t ) t if for every t, {τ t} F t. Let (X t, F t ) t be a continuous process such that X =. Suppose a > and let τ = inf{t : X(t) > a} and ν = inf{t : X(t) a}. Show that ν is a stopping time w.r.t. (F t ) t and τ is a stopping time w.r.t (F t+ ) t, where F t+ = ε> F t+ε. 21. Show that if τ 1 τ 2... are stopping times w.r.t. to a filtration (F t ), then τ = lim n τ n is also a stopping time w.r.t. to (F t ). 22. Let F τ = {A : A {τ t} F t } for a filtration (F t ) and a stopping time τ. Show that F τ is a σ-algebra. Γ

5 PROBABILITY: LIMIT THEOREMS II, SPRING 218. HOMEWORK PROBLEMS Give an example of the following: a random variable τ is not a stopping time, F τ is not a σ-algebra. 24. Suppose τ is a stopping time w.r.t. (F t+ ). Let us define τ n = [2n τ] n = k 2 n 1 {τ [ k 1 k N 2 n, k 2 n )}, n N. Prove that for every n N, τ n is a stopping time w.r.t. (F t ) t, F τn F τ+, and τ n τ. 3. Due by May 2, 11:am 1. Prove: if (X t, F t ) t is a continuous process, then for any stopping time τ, X τ is a r.v. measurable w.r.t. F τ. 2. Let (X t, F t ) be a continuous martingale and let τ be a stopping time w.r.t. F t. Prove that the stopped process (X τ t, F t ) t, where X τ t = X τ t, is also a martingale. 3. Prove the following theorem (Kolmogorov, 1931) using Taylor expansions of test functions: Suppose (P x ) x R d is a (homogeneous) Markov family on R d with transition probabilities P (,, ). Suppose there are continuous functions a ij (x), b i (x), i, j = 1,..., d, such that for every ε >, the following relations hold uniformly in x: B ε(x) B ε(x) P (t, x, B c ε(x)) = o(t), t, (y i x i )P (t, x, dy) = b i (x)t + o(t), t, (y i x i )(y j x j )P (t, x, dy) = a ij (x)t + o(t), t. where B ε (x) is the Euclidean ball of radius ε centered at x. Then the infinitesimal generator A of the Markov semigroup associated to the Markov family is defined on all functions f such that f itself and all its partial derivatives of first and second order are bounded and uniformly continuous. For such functions Af = 1 a ij ij f + b i i f. 2 ij i 4. Consider a Markov process X in R 2 given by X 1 (t) = X 1 () + W (t), X 2 (t) = X 2 () + t X 1 (s)ds. Find its generator on C 2 -functions with compact support.

6 6 PROF. YURI BAKHTIN 5. Consider the Poisson transition probabilities, i.e., fix a number λ > and for i Z and t, let P (i, t, ) be the distribution of i + π λt, where π s denotes a random variable with Poisson distribution with parameter s >. In other words, λt (λt)j i P (i, t, {j}) = e, i Z, j {i, i + 1,..., }, t >. (j i)! Find the generator of the Markov semigroup on all bounded test functions f : Z R. 6. Find the transition probabilities and generator associated to the Ornstein- Uhlenbeck process. 7. Let W 1 and W 2 be two independent Wiener processes w.r.t. a filtration (F t ) t, and let X be a bounded process adapted to (F t ) t. For a partition t of time interval [, T ] (i.e., a sequence of times t = (t, t 1,..., t n ) such that = t < t 1 < t 2 <... < t n = T ), we define Q(t) = j X tj (W 1 t j+1 W 1 t j )(W 2 t j+1 W 2 t j ). Prove: lim Q(t) = in max(t j+1 t j ) L2. 8. Let (F t ) be a filtration. Suppose that = A (t) + A 1 (t)w (t) for all t, where (A, F t ) and (A 1, F t ) are processes with C 1 trajectories, and W (t) is a Wiener process w.r.t. (F t ). Prove that A and A Suppose f L 2 ([, T ], B, Leb). For all h >, we define, t < h; f h (t) = 1 kh f(s)ds, kh t < (k + 1)h T. h (k 1)h L Prove that f 2 h f and f h L 2 f. Hint: do not work with generic L 2 functions right away; consider a smaller supply of functions f that behave nicely under this kind of averaging. 1. Compute T W 2 (t)dw (t) directly as the limit of W 2 (t k )(W (t k+1 ) W (t k )) 11. The so-called Stratonovich stochastic integral may be defined for a broad class of adapted processes X t via T def X tj+1 + X tj X t dw t = lim (W tj+1 W tj ) in L 2. max(t j+1 t j ) 2 j Impose any conditions you need on X and express the difference between the Itô and Stratotovich integrals in terms of quadratic covariation between X and W. Compute T W t dw t. Is the answer a martingale?

7 PROBABILITY: LIMIT THEOREMS II, SPRING 218. HOMEWORK PROBLEMS Let M 2 c = {square-integrable martingales with continuous paths}. Prove that if (M t, F t ) M 2 c, then E[(M t M s ) 2 F s ] = E[M 2 t M 2 s F s ] = E[ M t M s F s ], s < t. 13. Suppose (M t, F t ) M 2 c, X is a simple process, and (X M) t = t X sdm s. Prove that [ t ] E[((X M) t (X M) s ) 2 F s ] = E Xr 2 d M r F s, s < t. 14. Let M M 2 c. Prove that Y (X M) = (Y X) M for simple processes X, Y. Find reasonable weaker conditions on X and Y guaranteeing the correctness of this identity in the sense of square integrable martingales. 15. Suppose (M t, F t ) M 2 c, and X, Y are bounded processes. Prove that X M, Y M t = t s X s Y s d M s. Here, for two processes M, N M 2 c the cross-variation M, N t is defined by M, N t = M + N t M N t Let us define the process X by t X t = e λt X + εe λt e λs dw s, t. Here λ R, ε >, W is a standard Wiener process, and X is a squareintegrable r.v., independent of W. Prove that dx t = λx t dt + εdw t. 17. Prove that if f : [, ) is a deterministic function, bounded on any interval [, t], then X t = t f(s)dw s, t, is a Gaussian process. Find its mean and covariance function. 18. In the context of Problem 16, find all the values of λ with the following property: there are a and σ 2 such that if X N (a, σ 2 ), then (X t ) is a stationary process. 19. [Feynman Kac formula.] Suppose u : R [, ) and φ : [, ) R R are smooth bounded functions. Suppose that u : [, ) R R is a smooth function solving the Cauchy problem for the following equation: t u(t, x) = 1 2 xxu(t, x) + φ(t, x)u(t, x), u(, x) = u (x).

8 8 PROF. YURI BAKHTIN Using the Itô formula and martingales, prove that u(t, x) = Ee t φ(t s,x+ws)ds u (x + W t ), t >, x R, where W is a standard Wiener process. (If you need further assumptions on u and/or its derivatives, use PDE theory or just impose assumptions you need.) 2. Let D be an open bounded of R d with smooth boundary D. Let g : D R and f : D R be continuous functions. Suppose that u C( D) C 2 (D) and 1 u(x) = g(x), x D, 2 u(x) = f(x), x D. Let W be a standard 2-dimensional Wiener process (a process with independent components each of which is a standard 1-dimensional Wiwner process) Prove that if τ = inf{t : x + W t D}, then [ τ ] u(x) = E f(x + W τ ) + g(x + W t )dt. 21. Suppose a R, σ >, x >, and W is the standard Wiener process. Find constants A, B R such that the process S defined for all t by S t = x exp(at + σw t ) (and often called the geometric Brownian motion ) satisfies the following stochastic equation ds t = AS t dt + BS t dw t, t. Find necessary and sufficient conditions on a and σ for (S t ) to be a martingale. 22. [The Girsanov density.] Suppose (W t, F t ) is a Wiener process and (X t, F t ) is a bounded process. Use the Itô formula to prove that [ t Z t = exp X s dw s 1 t ] Xs 2 ds, t, 2 is a local martingale w.r.t. (F t ). (In fact, it is a true martingale)

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS PROBABILITY: LIMIT THEOREMS II, SPRING 15. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please

More information

Brownian Motion. 1 Definition Brownian Motion Wiener measure... 3

Brownian Motion. 1 Definition Brownian Motion Wiener measure... 3 Brownian Motion Contents 1 Definition 2 1.1 Brownian Motion................................. 2 1.2 Wiener measure.................................. 3 2 Construction 4 2.1 Gaussian process.................................

More information

{σ x >t}p x. (σ x >t)=e at.

{σ x >t}p x. (σ x >t)=e at. 3.11. EXERCISES 121 3.11 Exercises Exercise 3.1 Consider the Ornstein Uhlenbeck process in example 3.1.7(B). Show that the defined process is a Markov process which converges in distribution to an N(0,σ

More information

ELEMENTS OF PROBABILITY THEORY

ELEMENTS OF PROBABILITY THEORY ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable

More information

A Short Introduction to Diffusion Processes and Ito Calculus

A Short Introduction to Diffusion Processes and Ito Calculus A Short Introduction to Diffusion Processes and Ito Calculus Cédric Archambeau University College, London Center for Computational Statistics and Machine Learning c.archambeau@cs.ucl.ac.uk January 24,

More information

Exercises. T 2T. e ita φ(t)dt.

Exercises. T 2T. e ita φ(t)dt. Exercises. Set #. Construct an example of a sequence of probability measures P n on R which converge weakly to a probability measure P but so that the first moments m,n = xdp n do not converge to m = xdp.

More information

The concentration of a drug in blood. Exponential decay. Different realizations. Exponential decay with noise. dc(t) dt.

The concentration of a drug in blood. Exponential decay. Different realizations. Exponential decay with noise. dc(t) dt. The concentration of a drug in blood Exponential decay C12 concentration 2 4 6 8 1 C12 concentration 2 4 6 8 1 dc(t) dt = µc(t) C(t) = C()e µt 2 4 6 8 1 12 time in minutes 2 4 6 8 1 12 time in minutes

More information

p 1 ( Y p dp) 1/p ( X p dp) 1 1 p

p 1 ( Y p dp) 1/p ( X p dp) 1 1 p Doob s inequality Let X(t) be a right continuous submartingale with respect to F(t), t 1 P(sup s t X(s) λ) 1 λ {sup s t X(s) λ} X + (t)dp 2 For 1 < p

More information

GAUSSIAN PROCESSES; KOLMOGOROV-CHENTSOV THEOREM

GAUSSIAN PROCESSES; KOLMOGOROV-CHENTSOV THEOREM GAUSSIAN PROCESSES; KOLMOGOROV-CHENTSOV THEOREM STEVEN P. LALLEY 1. GAUSSIAN PROCESSES: DEFINITIONS AND EXAMPLES Definition 1.1. A standard (one-dimensional) Wiener process (also called Brownian motion)

More information

Brownian motion. Samy Tindel. Purdue University. Probability Theory 2 - MA 539

Brownian motion. Samy Tindel. Purdue University. Probability Theory 2 - MA 539 Brownian motion Samy Tindel Purdue University Probability Theory 2 - MA 539 Mostly taken from Brownian Motion and Stochastic Calculus by I. Karatzas and S. Shreve Samy T. Brownian motion Probability Theory

More information

µ X (A) = P ( X 1 (A) )

µ X (A) = P ( X 1 (A) ) 1 STOCHASTIC PROCESSES This appendix provides a very basic introduction to the language of probability theory and stochastic processes. We assume the reader is familiar with the general measure and integration

More information

Verona Course April Lecture 1. Review of probability

Verona Course April Lecture 1. Review of probability Verona Course April 215. Lecture 1. Review of probability Viorel Barbu Al.I. Cuza University of Iaşi and the Romanian Academy A probability space is a triple (Ω, F, P) where Ω is an abstract set, F is

More information

A Concise Course on Stochastic Partial Differential Equations

A Concise Course on Stochastic Partial Differential Equations A Concise Course on Stochastic Partial Differential Equations Michael Röckner Reference: C. Prevot, M. Röckner: Springer LN in Math. 1905, Berlin (2007) And see the references therein for the original

More information

1. Stochastic Processes and filtrations

1. Stochastic Processes and filtrations 1. Stochastic Processes and 1. Stoch. pr., A stochastic process (X t ) t T is a collection of random variables on (Ω, F) with values in a measurable space (S, S), i.e., for all t, In our case X t : Ω S

More information

Lecture 4: Introduction to stochastic processes and stochastic calculus

Lecture 4: Introduction to stochastic processes and stochastic calculus Lecture 4: Introduction to stochastic processes and stochastic calculus Cédric Archambeau Centre for Computational Statistics and Machine Learning Department of Computer Science University College London

More information

6. Brownian Motion. Q(A) = P [ ω : x(, ω) A )

6. Brownian Motion. Q(A) = P [ ω : x(, ω) A ) 6. Brownian Motion. stochastic process can be thought of in one of many equivalent ways. We can begin with an underlying probability space (Ω, Σ, P) and a real valued stochastic process can be defined

More information

Exercises in stochastic analysis

Exercises in stochastic analysis Exercises in stochastic analysis Franco Flandoli, Mario Maurelli, Dario Trevisan The exercises with a P are those which have been done totally or partially) in the previous lectures; the exercises with

More information

Lecture 17 Brownian motion as a Markov process

Lecture 17 Brownian motion as a Markov process Lecture 17: Brownian motion as a Markov process 1 of 14 Course: Theory of Probability II Term: Spring 2015 Instructor: Gordan Zitkovic Lecture 17 Brownian motion as a Markov process Brownian motion is

More information

Stochastic Calculus February 11, / 33

Stochastic Calculus February 11, / 33 Martingale Transform M n martingale with respect to F n, n =, 1, 2,... σ n F n (σ M) n = n 1 i= σ i(m i+1 M i ) is a Martingale E[(σ M) n F n 1 ] n 1 = E[ σ i (M i+1 M i ) F n 1 ] i= n 2 = σ i (M i+1 M

More information

In terms of measures: Exercise 1. Existence of a Gaussian process: Theorem 2. Remark 3.

In terms of measures: Exercise 1. Existence of a Gaussian process: Theorem 2. Remark 3. 1. GAUSSIAN PROCESSES A Gaussian process on a set T is a collection of random variables X =(X t ) t T on a common probability space such that for any n 1 and any t 1,...,t n T, the vector (X(t 1 ),...,X(t

More information

1. Stochastic Process

1. Stochastic Process HETERGENEITY IN QUANTITATIVE MACROECONOMICS @ TSE OCTOBER 17, 216 STOCHASTIC CALCULUS BASICS SANG YOON (TIM) LEE Very simple notes (need to add references). It is NOT meant to be a substitute for a real

More information

MATH 6605: SUMMARY LECTURE NOTES

MATH 6605: SUMMARY LECTURE NOTES MATH 6605: SUMMARY LECTURE NOTES These notes summarize the lectures on weak convergence of stochastic processes. If you see any typos, please let me know. 1. Construction of Stochastic rocesses A stochastic

More information

Probability and Measure

Probability and Measure Part II Year 2018 2017 2016 2015 2014 2013 2012 2011 2010 2009 2008 2007 2006 2005 2018 84 Paper 4, Section II 26J Let (X, A) be a measurable space. Let T : X X be a measurable map, and µ a probability

More information

Universal examples. Chapter The Bernoulli process

Universal examples. Chapter The Bernoulli process Chapter 1 Universal examples 1.1 The Bernoulli process First description: Bernoulli random variables Y i for i = 1, 2, 3,... independent with P [Y i = 1] = p and P [Y i = ] = 1 p. Second description: Binomial

More information

Selected Exercises on Expectations and Some Probability Inequalities

Selected Exercises on Expectations and Some Probability Inequalities Selected Exercises on Expectations and Some Probability Inequalities # If E(X 2 ) = and E X a > 0, then P( X λa) ( λ) 2 a 2 for 0 < λ

More information

Filtrations, Markov Processes and Martingales. Lectures on Lévy Processes and Stochastic Calculus, Braunschweig, Lecture 3: The Lévy-Itô Decomposition

Filtrations, Markov Processes and Martingales. Lectures on Lévy Processes and Stochastic Calculus, Braunschweig, Lecture 3: The Lévy-Itô Decomposition Filtrations, Markov Processes and Martingales Lectures on Lévy Processes and Stochastic Calculus, Braunschweig, Lecture 3: The Lévy-Itô Decomposition David pplebaum Probability and Statistics Department,

More information

Interest Rate Models:

Interest Rate Models: 1/17 Interest Rate Models: from Parametric Statistics to Infinite Dimensional Stochastic Analysis René Carmona Bendheim Center for Finance ORFE & PACM, Princeton University email: rcarmna@princeton.edu

More information

Controlled Diffusions and Hamilton-Jacobi Bellman Equations

Controlled Diffusions and Hamilton-Jacobi Bellman Equations Controlled Diffusions and Hamilton-Jacobi Bellman Equations Emo Todorov Applied Mathematics and Computer Science & Engineering University of Washington Winter 2014 Emo Todorov (UW) AMATH/CSE 579, Winter

More information

Lecture 12. F o s, (1.1) F t := s>t

Lecture 12. F o s, (1.1) F t := s>t Lecture 12 1 Brownian motion: the Markov property Let C := C(0, ), R) be the space of continuous functions mapping from 0, ) to R, in which a Brownian motion (B t ) t 0 almost surely takes its value. Let

More information

Tools of stochastic calculus

Tools of stochastic calculus slides for the course Interest rate theory, University of Ljubljana, 212-13/I, part III József Gáll University of Debrecen Nov. 212 Jan. 213, Ljubljana Itô integral, summary of main facts Notations, basic

More information

Topics in fractional Brownian motion

Topics in fractional Brownian motion Topics in fractional Brownian motion Esko Valkeila Spring School, Jena 25.3. 2011 We plan to discuss the following items during these lectures: Fractional Brownian motion and its properties. Topics in

More information

Stochastic Processes. Winter Term Paolo Di Tella Technische Universität Dresden Institut für Stochastik

Stochastic Processes. Winter Term Paolo Di Tella Technische Universität Dresden Institut für Stochastik Stochastic Processes Winter Term 2016-2017 Paolo Di Tella Technische Universität Dresden Institut für Stochastik Contents 1 Preliminaries 5 1.1 Uniform integrability.............................. 5 1.2

More information

Solution for Problem 7.1. We argue by contradiction. If the limit were not infinite, then since τ M (ω) is nondecreasing we would have

Solution for Problem 7.1. We argue by contradiction. If the limit were not infinite, then since τ M (ω) is nondecreasing we would have 362 Problem Hints and Solutions sup g n (ω, t) g(ω, t) sup g(ω, s) g(ω, t) µ n (ω). t T s,t: s t 1/n By the uniform continuity of t g(ω, t) on [, T], one has for each ω that µ n (ω) as n. Two applications

More information

Random Process Lecture 1. Fundamentals of Probability

Random Process Lecture 1. Fundamentals of Probability Random Process Lecture 1. Fundamentals of Probability Husheng Li Min Kao Department of Electrical Engineering and Computer Science University of Tennessee, Knoxville Spring, 2016 1/43 Outline 2/43 1 Syllabus

More information

Functional Limit theorems for the quadratic variation of a continuous time random walk and for certain stochastic integrals

Functional Limit theorems for the quadratic variation of a continuous time random walk and for certain stochastic integrals Functional Limit theorems for the quadratic variation of a continuous time random walk and for certain stochastic integrals Noèlia Viles Cuadros BCAM- Basque Center of Applied Mathematics with Prof. Enrico

More information

Reflected Brownian Motion

Reflected Brownian Motion Chapter 6 Reflected Brownian Motion Often we encounter Diffusions in regions with boundary. If the process can reach the boundary from the interior in finite time with positive probability we need to decide

More information

Introduction to Random Diffusions

Introduction to Random Diffusions Introduction to Random Diffusions The main reason to study random diffusions is that this class of processes combines two key features of modern probability theory. On the one hand they are semi-martingales

More information

Feller Processes and Semigroups

Feller Processes and Semigroups Stat25B: Probability Theory (Spring 23) Lecture: 27 Feller Processes and Semigroups Lecturer: Rui Dong Scribe: Rui Dong ruidong@stat.berkeley.edu For convenience, we can have a look at the list of materials

More information

Stochastic Integration.

Stochastic Integration. Chapter Stochastic Integration..1 Brownian Motion as a Martingale P is the Wiener measure on (Ω, B) where Ω = C, T B is the Borel σ-field on Ω. In addition we denote by B t the σ-field generated by x(s)

More information

Some Tools From Stochastic Analysis

Some Tools From Stochastic Analysis W H I T E Some Tools From Stochastic Analysis J. Potthoff Lehrstuhl für Mathematik V Universität Mannheim email: potthoff@math.uni-mannheim.de url: http://ls5.math.uni-mannheim.de To close the file, click

More information

Lecture 21 Representations of Martingales

Lecture 21 Representations of Martingales Lecture 21: Representations of Martingales 1 of 11 Course: Theory of Probability II Term: Spring 215 Instructor: Gordan Zitkovic Lecture 21 Representations of Martingales Right-continuous inverses Let

More information

1 Stat 605. Homework I. Due Feb. 1, 2011

1 Stat 605. Homework I. Due Feb. 1, 2011 The first part is homework which you need to turn in. The second part is exercises that will not be graded, but you need to turn it in together with the take-home final exam. 1 Stat 605. Homework I. Due

More information

Kolmogorov Equations and Markov Processes

Kolmogorov Equations and Markov Processes Kolmogorov Equations and Markov Processes May 3, 013 1 Transition measures and functions Consider a stochastic process {X(t)} t 0 whose state space is a product of intervals contained in R n. We define

More information

Mathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio ( )

Mathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio ( ) Mathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio (2014-2015) Etienne Tanré - Olivier Faugeras INRIA - Team Tosca November 26th, 2014 E. Tanré (INRIA - Team Tosca) Mathematical

More information

Applications of Ito s Formula

Applications of Ito s Formula CHAPTER 4 Applications of Ito s Formula In this chapter, we discuss several basic theorems in stochastic analysis. Their proofs are good examples of applications of Itô s formula. 1. Lévy s martingale

More information

Backward Stochastic Differential Equations with Infinite Time Horizon

Backward Stochastic Differential Equations with Infinite Time Horizon Backward Stochastic Differential Equations with Infinite Time Horizon Holger Metzler PhD advisor: Prof. G. Tessitore Università di Milano-Bicocca Spring School Stochastic Control in Finance Roscoff, March

More information

Stochastic Differential Equations.

Stochastic Differential Equations. Chapter 3 Stochastic Differential Equations. 3.1 Existence and Uniqueness. One of the ways of constructing a Diffusion process is to solve the stochastic differential equation dx(t) = σ(t, x(t)) dβ(t)

More information

Lecture 22 Girsanov s Theorem

Lecture 22 Girsanov s Theorem Lecture 22: Girsanov s Theorem of 8 Course: Theory of Probability II Term: Spring 25 Instructor: Gordan Zitkovic Lecture 22 Girsanov s Theorem An example Consider a finite Gaussian random walk X n = n

More information

I forgot to mention last time: in the Ito formula for two standard processes, putting

I forgot to mention last time: in the Ito formula for two standard processes, putting I forgot to mention last time: in the Ito formula for two standard processes, putting dx t = a t dt + b t db t dy t = α t dt + β t db t, and taking f(x, y = xy, one has f x = y, f y = x, and f xx = f yy

More information

Stochastic integration. P.J.C. Spreij

Stochastic integration. P.J.C. Spreij Stochastic integration P.J.C. Spreij this version: April 22, 29 Contents 1 Stochastic processes 1 1.1 General theory............................... 1 1.2 Stopping times...............................

More information

On pathwise stochastic integration

On pathwise stochastic integration On pathwise stochastic integration Rafa l Marcin Lochowski Afican Institute for Mathematical Sciences, Warsaw School of Economics UWC seminar Rafa l Marcin Lochowski (AIMS, WSE) On pathwise stochastic

More information

Hardy-Stein identity and Square functions

Hardy-Stein identity and Square functions Hardy-Stein identity and Square functions Daesung Kim (joint work with Rodrigo Bañuelos) Department of Mathematics Purdue University March 28, 217 Daesung Kim (Purdue) Hardy-Stein identity UIUC 217 1 /

More information

Lecture 12: Detailed balance and Eigenfunction methods

Lecture 12: Detailed balance and Eigenfunction methods Miranda Holmes-Cerfon Applied Stochastic Analysis, Spring 2015 Lecture 12: Detailed balance and Eigenfunction methods Readings Recommended: Pavliotis [2014] 4.5-4.7 (eigenfunction methods and reversibility),

More information

Preliminary Exam: Probability 9:00am 2:00pm, Friday, January 6, 2012

Preliminary Exam: Probability 9:00am 2:00pm, Friday, January 6, 2012 Preliminary Exam: Probability 9:00am 2:00pm, Friday, January 6, 202 The exam lasts from 9:00am until 2:00pm, with a walking break every hour. Your goal on this exam should be to demonstrate mastery of

More information

Lecture 4: Stochastic Processes (I)

Lecture 4: Stochastic Processes (I) Miranda Holmes-Cerfon Applied Stochastic Analysis, Spring 215 Lecture 4: Stochastic Processes (I) Readings Recommended: Pavliotis [214], sections 1.1, 1.2 Grimmett and Stirzaker [21], section 9.4 (spectral

More information

The strictly 1/2-stable example

The strictly 1/2-stable example The strictly 1/2-stable example 1 Direct approach: building a Lévy pure jump process on R Bert Fristedt provided key mathematical facts for this example. A pure jump Lévy process X is a Lévy process such

More information

E. Vitali Lecture 6. Brownian motion

E. Vitali Lecture 6. Brownian motion Markov chains, presented in the previous chapter, belong to a wide class of mathematical objects, the stochastic processes, which will introduced in the present chapter. Stochastic processes form the basis

More information

LAN property for sde s with additive fractional noise and continuous time observation

LAN property for sde s with additive fractional noise and continuous time observation LAN property for sde s with additive fractional noise and continuous time observation Eulalia Nualart (Universitat Pompeu Fabra, Barcelona) joint work with Samy Tindel (Purdue University) Vlad s 6th birthday,

More information

3 hours UNIVERSITY OF MANCHESTER. 22nd May and. Electronic calculators may be used, provided that they cannot store text.

3 hours UNIVERSITY OF MANCHESTER. 22nd May and. Electronic calculators may be used, provided that they cannot store text. 3 hours MATH40512 UNIVERSITY OF MANCHESTER DYNAMICAL SYSTEMS AND ERGODIC THEORY 22nd May 2007 9.45 12.45 Answer ALL four questions in SECTION A (40 marks in total) and THREE of the four questions in SECTION

More information

Stochastic Processes

Stochastic Processes Stochastic Processes A very simple introduction Péter Medvegyev 2009, January Medvegyev (CEU) Stochastic Processes 2009, January 1 / 54 Summary from measure theory De nition (X, A) is a measurable space

More information

Stochastic Integration and Continuous Time Models

Stochastic Integration and Continuous Time Models Chapter 3 Stochastic Integration and Continuous Time Models 3.1 Brownian Motion The single most important continuous time process in the construction of financial models is the Brownian motion process.

More information

Brownian Motion and Stochastic Calculus

Brownian Motion and Stochastic Calculus ETHZ, Spring 17 D-MATH Prof Dr Martin Larsson Coordinator A Sepúlveda Brownian Motion and Stochastic Calculus Exercise sheet 6 Please hand in your solutions during exercise class or in your assistant s

More information

Stochastic differential equation models in biology Susanne Ditlevsen

Stochastic differential equation models in biology Susanne Ditlevsen Stochastic differential equation models in biology Susanne Ditlevsen Introduction This chapter is concerned with continuous time processes, which are often modeled as a system of ordinary differential

More information

Ergodic Theorems. Samy Tindel. Purdue University. Probability Theory 2 - MA 539. Taken from Probability: Theory and examples by R.

Ergodic Theorems. Samy Tindel. Purdue University. Probability Theory 2 - MA 539. Taken from Probability: Theory and examples by R. Ergodic Theorems Samy Tindel Purdue University Probability Theory 2 - MA 539 Taken from Probability: Theory and examples by R. Durrett Samy T. Ergodic theorems Probability Theory 1 / 92 Outline 1 Definitions

More information

Stochastic Analysis. King s College London Version 1.4 October Markus Riedle

Stochastic Analysis. King s College London Version 1.4 October Markus Riedle Stochastic Analysis King s College London Version 1.4 October 215 Markus Riedle Preface These notes are for a course on Stochastic Analysis at King s College London. Given the limited time and diverse

More information

1. Aufgabenblatt zur Vorlesung Probability Theory

1. Aufgabenblatt zur Vorlesung Probability Theory 24.10.17 1. Aufgabenblatt zur Vorlesung By (Ω, A, P ) we always enote the unerlying probability space, unless state otherwise. 1. Let r > 0, an efine f(x) = 1 [0, [ (x) exp( r x), x R. a) Show that p f

More information

Contents. 1 Preliminaries 3. Martingales

Contents. 1 Preliminaries 3. Martingales Table of Preface PART I THE FUNDAMENTAL PRINCIPLES page xv 1 Preliminaries 3 2 Martingales 9 2.1 Martingales and examples 9 2.2 Stopping times 12 2.3 The maximum inequality 13 2.4 Doob s inequality 14

More information

2 (Bonus). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure?

2 (Bonus). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure? MA 645-4A (Real Analysis), Dr. Chernov Homework assignment 1 (Due 9/5). Prove that every countable set A is measurable and µ(a) = 0. 2 (Bonus). Let A consist of points (x, y) such that either x or y is

More information

Fast-slow systems with chaotic noise

Fast-slow systems with chaotic noise Fast-slow systems with chaotic noise David Kelly Ian Melbourne Courant Institute New York University New York NY www.dtbkelly.com May 12, 215 Averaging and homogenization workshop, Luminy. Fast-slow systems

More information

STATISTICS 385: STOCHASTIC CALCULUS HOMEWORK ASSIGNMENT 4 DUE NOVEMBER 23, = (2n 1)(2n 3) 3 1.

STATISTICS 385: STOCHASTIC CALCULUS HOMEWORK ASSIGNMENT 4 DUE NOVEMBER 23, = (2n 1)(2n 3) 3 1. STATISTICS 385: STOCHASTIC CALCULUS HOMEWORK ASSIGNMENT 4 DUE NOVEMBER 23, 26 Problem Normal Moments (A) Use the Itô formula and Brownian scaling to check that the even moments of the normal distribution

More information

Gaussian Random Fields: Geometric Properties and Extremes

Gaussian Random Fields: Geometric Properties and Extremes Gaussian Random Fields: Geometric Properties and Extremes Yimin Xiao Michigan State University Outline Lecture 1: Gaussian random fields and their regularity Lecture 2: Hausdorff dimension results and

More information

State Space Representation of Gaussian Processes

State Space Representation of Gaussian Processes State Space Representation of Gaussian Processes Simo Särkkä Department of Biomedical Engineering and Computational Science (BECS) Aalto University, Espoo, Finland June 12th, 2013 Simo Särkkä (Aalto University)

More information

Lecture 5. If we interpret the index n 0 as time, then a Markov chain simply requires that the future depends only on the present and not on the past.

Lecture 5. If we interpret the index n 0 as time, then a Markov chain simply requires that the future depends only on the present and not on the past. 1 Markov chain: definition Lecture 5 Definition 1.1 Markov chain] A sequence of random variables (X n ) n 0 taking values in a measurable state space (S, S) is called a (discrete time) Markov chain, if

More information

Strong uniqueness for stochastic evolution equations with possibly unbounded measurable drift term

Strong uniqueness for stochastic evolution equations with possibly unbounded measurable drift term 1 Strong uniqueness for stochastic evolution equations with possibly unbounded measurable drift term Enrico Priola Torino (Italy) Joint work with G. Da Prato, F. Flandoli and M. Röckner Stochastic Processes

More information

Convergence of Feller Processes

Convergence of Feller Processes Chapter 15 Convergence of Feller Processes This chapter looks at the convergence of sequences of Feller processes to a iting process. Section 15.1 lays some ground work concerning weak convergence of processes

More information

Markov processes and queueing networks

Markov processes and queueing networks Inria September 22, 2015 Outline Poisson processes Markov jump processes Some queueing networks The Poisson distribution (Siméon-Denis Poisson, 1781-1840) { } e λ λ n n! As prevalent as Gaussian distribution

More information

Homogenization for chaotic dynamical systems

Homogenization for chaotic dynamical systems Homogenization for chaotic dynamical systems David Kelly Ian Melbourne Department of Mathematics / Renci UNC Chapel Hill Mathematics Institute University of Warwick November 3, 2013 Duke/UNC Probability

More information

Solutions to the Exercises in Stochastic Analysis

Solutions to the Exercises in Stochastic Analysis Solutions to the Exercises in Stochastic Analysis Lecturer: Xue-Mei Li 1 Problem Sheet 1 In these solution I avoid using conditional expectations. But do try to give alternative proofs once we learnt conditional

More information

Wiener Measure and Brownian Motion

Wiener Measure and Brownian Motion Chapter 16 Wiener Measure and Brownian Motion Diffusion of particles is a product of their apparently random motion. The density u(t, x) of diffusing particles satisfies the diffusion equation (16.1) u

More information

Lecture 19 L 2 -Stochastic integration

Lecture 19 L 2 -Stochastic integration Lecture 19: L 2 -Stochastic integration 1 of 12 Course: Theory of Probability II Term: Spring 215 Instructor: Gordan Zitkovic Lecture 19 L 2 -Stochastic integration The stochastic integral for processes

More information

Stochastic differential equations in neuroscience

Stochastic differential equations in neuroscience Stochastic differential equations in neuroscience Nils Berglund MAPMO, Orléans (CNRS, UMR 6628) http://www.univ-orleans.fr/mapmo/membres/berglund/ Barbara Gentz, Universität Bielefeld Damien Landon, MAPMO-Orléans

More information

Basic Definitions: Indexed Collections and Random Functions

Basic Definitions: Indexed Collections and Random Functions Chapter 1 Basic Definitions: Indexed Collections and Random Functions Section 1.1 introduces stochastic processes as indexed collections of random variables. Section 1.2 builds the necessary machinery

More information

Convoluted Brownian motions: a class of remarkable Gaussian processes

Convoluted Brownian motions: a class of remarkable Gaussian processes Convoluted Brownian motions: a class of remarkable Gaussian processes Sylvie Roelly Random models with applications in the natural sciences Bogotá, December 11-15, 217 S. Roelly (Universität Potsdam) 1

More information

Three hours THE UNIVERSITY OF MANCHESTER. 31st May :00 17:00

Three hours THE UNIVERSITY OF MANCHESTER. 31st May :00 17:00 Three hours MATH41112 THE UNIVERSITY OF MANCHESTER ERGODIC THEORY 31st May 2016 14:00 17:00 Answer FOUR of the FIVE questions. If more than four questions are attempted, then credit will be given for the

More information

Product measure and Fubini s theorem

Product measure and Fubini s theorem Chapter 7 Product measure and Fubini s theorem This is based on [Billingsley, Section 18]. 1. Product spaces Suppose (Ω 1, F 1 ) and (Ω 2, F 2 ) are two probability spaces. In a product space Ω = Ω 1 Ω

More information

An Introduction to Stochastic Processes in Continuous Time

An Introduction to Stochastic Processes in Continuous Time An Introduction to Stochastic Processes in Continuous Time Flora Spieksma adaptation of the text by Harry van Zanten to be used at your own expense May 22, 212 Contents 1 Stochastic Processes 1 1.1 Introduction......................................

More information

Partial Differential Equations with Applications to Finance Seminar 1: Proving and applying Dynkin s formula

Partial Differential Equations with Applications to Finance Seminar 1: Proving and applying Dynkin s formula Partial Differential Equations with Applications to Finance Seminar 1: Proving and applying Dynkin s formula Group 4: Bertan Yilmaz, Richard Oti-Aboagye and Di Liu May, 15 Chapter 1 Proving Dynkin s formula

More information

Stochastic Calculus. Michael R. Tehranchi

Stochastic Calculus. Michael R. Tehranchi Stochastic Calculus Michael R. Tehranchi Contents Chapter 1. A possible motivation: diffusions 5 1. Markov chains 5 2. Continuous-time Markov processes 6 3. Stochastic differential equations 6 4. Markov

More information

Jump Processes. Richard F. Bass

Jump Processes. Richard F. Bass Jump Processes Richard F. Bass ii c Copyright 214 Richard F. Bass Contents 1 Poisson processes 1 1.1 Definitions............................. 1 1.2 Stopping times.......................... 3 1.3 Markov

More information

Part II Probability and Measure

Part II Probability and Measure Part II Probability and Measure Theorems Based on lectures by J. Miller Notes taken by Dexter Chua Michaelmas 2016 These notes are not endorsed by the lecturers, and I have modified them (often significantly)

More information

Poisson random measure: motivation

Poisson random measure: motivation : motivation The Lévy measure provides the expected number of jumps by time unit, i.e. in a time interval of the form: [t, t + 1], and of a certain size Example: ν([1, )) is the expected number of jumps

More information

Stochastic Differential Equations

Stochastic Differential Equations CHAPTER 1 Stochastic Differential Equations Consider a stochastic process X t satisfying dx t = bt, X t,w t dt + σt, X t,w t dw t. 1.1 Question. 1 Can we obtain the existence and uniqueness theorem for

More information

Stochastic Differential Equations

Stochastic Differential Equations Chapter 5 Stochastic Differential Equations We would like to introduce stochastic ODE s without going first through the machinery of stochastic integrals. 5.1 Itô Integrals and Itô Differential Equations

More information

Some Terminology and Concepts that We will Use, But Not Emphasize (Section 6.2)

Some Terminology and Concepts that We will Use, But Not Emphasize (Section 6.2) Some Terminology and Concepts that We will Use, But Not Emphasize (Section 6.2) Statistical analysis is based on probability theory. The fundamental object in probability theory is a probability space,

More information

The Wiener Itô Chaos Expansion

The Wiener Itô Chaos Expansion 1 The Wiener Itô Chaos Expansion The celebrated Wiener Itô chaos expansion is fundamental in stochastic analysis. In particular, it plays a crucial role in the Malliavin calculus as it is presented in

More information

Regular Variation and Extreme Events for Stochastic Processes

Regular Variation and Extreme Events for Stochastic Processes 1 Regular Variation and Extreme Events for Stochastic Processes FILIP LINDSKOG Royal Institute of Technology, Stockholm 2005 based on joint work with Henrik Hult www.math.kth.se/ lindskog 2 Extremes for

More information

9 Brownian Motion: Construction

9 Brownian Motion: Construction 9 Brownian Motion: Construction 9.1 Definition and Heuristics The central limit theorem states that the standard Gaussian distribution arises as the weak limit of the rescaled partial sums S n / p n of

More information

Some Properties of NSFDEs

Some Properties of NSFDEs Chenggui Yuan (Swansea University) Some Properties of NSFDEs 1 / 41 Some Properties of NSFDEs Chenggui Yuan Swansea University Chenggui Yuan (Swansea University) Some Properties of NSFDEs 2 / 41 Outline

More information

Harmonic Functions and Brownian Motion in Several Dimensions

Harmonic Functions and Brownian Motion in Several Dimensions Harmonic Functions and Brownian Motion in Several Dimensions Steven P. Lalley October 11, 2016 1 d -Dimensional Brownian Motion Definition 1. A standard d dimensional Brownian motion is an R d valued continuous-time

More information

Stochastic Processes II/ Wahrscheinlichkeitstheorie III. Lecture Notes

Stochastic Processes II/ Wahrscheinlichkeitstheorie III. Lecture Notes BMS Basic Course Stochastic Processes II/ Wahrscheinlichkeitstheorie III Michael Scheutzow Lecture Notes Technische Universität Berlin Sommersemester 218 preliminary version October 12th 218 Contents

More information