Lecture 4: Introduction to stochastic processes and stochastic calculus
|
|
- Emery Stevens
- 5 years ago
- Views:
Transcription
1 Lecture 4: Introduction to stochastic processes and stochastic calculus Cédric Archambeau Centre for Computational Statistics and Machine Learning Department of Computer Science University College London Advanced Topics in Machine Learning (MSc in Intelligent Systems) January 2008
2 Discrete-time vs continuous-time? Real systems are continuous. Can we gain something? Physical model. Can we exploit this information? !0.5!1!1.5!
3 Outline Some definitions Stochastic processes Lévy processes Markov processes Diffusion processes Itô s formula Variational inference for Diffusion processes
4 Elements of probability theory A collection A of subsets of the sample space Ω is a σ-algebra if A contains Ω: Ω A. A is closed under the operation of complementation: Ω\A A if A A. A is closed under the operation of countable unions: [ A n A if A 1, A 2,..., A n,... A. n This implies that A is closed under countable intersections. We say that (Ω, A) is a measurable space if Ω is a non-empty set and A is a σ-algebra of Ω.
5 Elements of probability theory (continued) A measure H( ) on (Ω, A) is a nonnegative valued set function on A satisfying H( ) = 0, H [! A n = X n n H(A n) if A i A j =, for any sequence A 1, A 2,..., A n,... A. If A B, it follows that H(A) H(B). If H(Ω) is finite, i.e. 0 H(Ω), then H( ) can be normalized to obtain a probability measure P( ): for all A A. P(A) = H(A), P(A) [0, 1], H(Ω) We say that (Ω, A, P) is a probability space if P is a probability measure on the measurable space (Ω, A).
6 Elements of probability theory (continued) Let (Ω 1, A 1) and (Ω 2, A 2) be two measurable spaces. The function f : Ω 1 Ω 2 is measurable if the pre-image of any A 2 A 2 is in A 1: for all A 2 A 2. f 1 (A 2) = {ω 1 Ω 1 : f (ω 1) A 2} A 1, Let (Ω, A, P) be a probability space.. We call the measurable function X : Ω R D a continuous random variable.
7 Stochastic process Let T be the time index set and (Ω, A, P) the underlying probability space. The function X : T Ω R D is a stochastic process, such that X t = X (t, ) : Ω R D is a random variable for each t T, X ω = X (, ω) : T R D is a realization or sample path for each ω Ω. When considering continuous time systems, T will often be equal to R +. In practice, we call stochastic process a collections of random variables X = {X t, t 0}, which are defined on a common probability space. We can think of X t as the position of a particle at time t, changing as t varies. The particle moves continuously or has jumps for some t 0: X t = X t+ X t = lim ɛ 0 X t+ɛ lim ɛ 0 X t ɛ. In general, we will assume that the process is right-continuous, i.e. X t+ = X t.
8 Independence Let {Y 1,..., Y n} be a collection of random variables, with Y i R D i. They are independent if for all A i R D i. P(Y 1 A 1,..., Y n A n) = ny P(Y i A i ), An infinite collection is said to be independent if every finite subcollection is independent. A stochastic process X = {X t, t 0} has independent increments if the random variables X t0, X t1 X t0,..., X tn X tn 1 are independent for all n 1 and t 0 < t 1 <... < t n. i=1
9 Stationarity A stochastic process is (strictly) stationary if all the joint marginals are invariant under time displacement h 0, that is for all t 1,..., t n. p(x t1 +h, X t2 +h,..., X tn+h) = p(x t1, X t2,..., X tn ) The stochastic process X = {X t, t 0} is wide-sense stationary if there exists a constant m R D and a function C : R + R D, such that for all s, t R +. µ t X t = m, Σ t (X t µ t )(X t µ t ) = C(0), V s,t (X t µ t )(X s µ s ) = C(t s), We call V s,t the two-time covariance. The stochastic process X = {X t, t 0} has stationary increments if X t+s X t has the same distribution as X s for all s, t 0.
10 Example: Poisson process The Poisson process with intensity parameter λ > 0 is a continuous time stochastic process X = {X t, t R + } with independent, stationary increments: for all 0 s t. X t X s P(λ(t s)), X 0 = 0, 10 The Poisson process is not wide-sense stationary: µ t = λt, σt 2 = λt, v s,t = λ min{s, t}. X t t The Poisson process is right-continuous and, in fact, it is Lévy process (see later) consisting only of jumps.
11 The Poisson distribution (or law of rare events) is defined as n P(λ) = λn n! e λ, n N, where λ > 0. The mean and the variance are given by n = λ, (n n ) 2 = λ.
12 Lévy process A stochastic process X = {X t, t 0} is a Lévy process if The increments on disjoint time intervals are independent. The increments are stationary: increments with equally long time intervals are identically distributed. The sample paths are right-continuous with left limit, i.e. lim X t+ɛ = X t, ɛ 0 lim X t ɛ = X t. ɛ 0 Lévy processes are usually described in terms of the Lévy-Khintchine representation. A Lévy process can have three types of components: a determinisitic drift, a random diffusion component and a random jump component. It is implicitly assumed that a Lévy process starts at X 0 = 0 with probability 1. Applications: Financial stock prices: Black-Scholes Population models: birth-and-death processes...
13 Interpretation of Lévy processes Lévy processes are the continuous time equivalent of random walks. A random walk over over n time units is a sum of n independent and identically distributed random variables: S n = X n 1 x n, where x n are iid random variables. Random walks have independent and stationary increments state time Figure: Example of a Gaussian random walk with S 0 = 1.
14 Interpretation of Lévy processes (continued) A random variable X has an infinitely divisible distribution if for every m 1 we can write mx X X (m) j, where {X (m) j } j are iid. j=1 For example the Normal, Poisson or Gamma distribution are infinitely divisible. The Bernouilli is not infinitely divisible. Lévy processes are infinitely divisible since the increments for non-overlapping time intervals are independent and stationary: X s = mx (X js/m X (j 1)s/m ), j=1 for all m 1. In fact, it can be shown that there is a Lévy process for each infinitely divisible probability distribution.
15 Markov process The stochastic process X = {X t, t 0} is a (continuous time continuous-state) Markov process if for all 0 r 1... r n s t. p(x t X s) = p(x t X r1,..., X rn, X s), We call p(x t X s) the transition density. It can be time depenent. The Chapman-Kolmogorov equation follows from the Markov property: Z p(x t X s) = p(x t X τ )p(x τ X s)dx τ, for all s τ t. The Chapman-Kolmogorov played already an important role in (discrete time) dynamical systems. Lévy processes satisfy the Markov property.
16 Markov process (continued) A Markov process is homogeneous if its transition density depends only on the time difference: for all 0 h. p(x t+h X t) = p(x h X 0), The Poisson process is homogeneous a discrete state Markov process: P(n t+h n t) = P(λ(t + h t)) = P(n h n 0). Let f ( ) be a bounded function. A Markov process is ergodic if the time average limit coincides with the spatial average, i.e. 1 lim T T Z T 0 f (X t)dt = f where the expectation is taken wrt the stationary probability density.
17 Martingale (fair game) A martingale is a stochastic process such that the expectation of some future event given the past and the present is the same as if given only the present: for all t. X t {X τ, 0 τ s} = X s More formally, let (Ω, A, P) be a probability space and {A t, t 0} a filtration 1 of A. The stochastic process X = {X t, t 0} is a martingale if with probability 1, for all 0 s < t. X t A s = X s, When the process X t satisfies the Markov property, we have X t A s = X t X s. 1 A filtration {A t, t 0} of A is an increasing family of σ-algebras on the measurable space (Ω, A), that is A s A t A for any 0 s t. This means that more information becomes available with increasing time.
18 Diffusion process A Markov process X = {X t, t 0} is a diffusion process if the following limits exist for all ɛ > 0: Z 1 lim p(x t X s)dx t = 0, t s t s X t X s >ɛ Z 1 lim (X t X s) p(x t X s)dx t = α(s, X s), t s t s X t X s <ɛ Z 1 lim (X t X s)(x t X s) p(x t X s)dx t = β(s, X s)β (s, X s), t s t s where 0 s t. X t X s <ɛ We call vector α(s, x) the drift and matrix β(s, x) the diffusion coefficient at time s and state X s = x. The first condition prevents the diffusion process from having instantaneous jumps. The drift α is the instantaneous rate of change of the mean, given that X s = x at time s. The diffusion matrix D = ββ is the instantaneous rate of change of the squared fluctuations of the process, given that X s = x at time s.
19 Diffusion process (continued) Diffusion processes are almost surely continuous functions of time, but they need not to be differentiable. Diffusion processes are Lévy processes (without the jump component). The time evolution of the transition density p(y, t x, s) with s t, given some initial condition or target constraint was described by Kolmogorov: The forward evolution of the transition density is given by the Kolmogorov forward equation (also known as the Fokker-Planck equation): p t = X i {α i (t, y)p} + 1 X 2 {D ij (t, y)p}, y i 2 y i,j i y j for a fixed initial state (s, x). The backward evolution of the transition density is given by the Kolmogorov backward equation (or adjoint equation): p s = X i for a fixed final state (t, y). α i (s, x) p x i X D i,j (s, x) 2 p, x i,j i x j
20 Wiener process The Wiener process was proposed by Wiener as mathematical description of Brownian motion. It characterizes the erratic motion (i.e. diffusion) of a grain pollen on a water surface due to it continually be bombarded by water molecules. It can be viewed as a scaling limit of a random walk on any finite time interval (Donsker s Theorem). It is also commonly used to model stock market fluctuations W t!0.2!0.4!0.6! t
21 Wiener process (continued) A standard Wiener process is a continuous time Gaussian Markov process W = {W t, t 0} with (non-overlapping) independent increments for which W 0 = 0, The sample path W ω is almost surely continuous for all ω Ω, W t W s N (0, t s), for all 0 s t. The sample paths of W ω are almost surely nowhere differentiable. The expectation W t is equal to 0 for all t. W is not wide-sense stationary as v s,t = min{s, t}, but has stationary increments. W is homogeneous since p(w t+h W t) = p(w h W 0). W is a diffusion process with drift α = 0 and diffusion coefficient β = 1, such that Kolmogorov s forward and backward equation are given by p t 1 2 p 2 y = 0, 2 p s p 2 x = 0. 2
22 Informal proof that a Wiener process is not differentiable: Consider the partition of a bounded time interval [s, t] into subintervals [τ (n) k, τ (n) k+1 ] of equal length, such that τ (n) k = s + k t s 2 n, k = 0, 1,..., 2 n 1. Consider a sample path W ω(τ) of the standard Wiener process W = {W τ, τ [s, t]}. It can be shown (Kloeden and Platen, p. 72) that lim n 2X n 1 k=0 W (τ (n) (n) 2 k+1, ω) W (τ k ), ω = t s. Hence, taking the limit superior, i.e. the supremum 2 of all the limit points, we get t s lim sup n (n) max W (τ k k+1 (n), ω) W (τ k, ω) 2X n 1 k=0 (n) W (τ k+1 (n), ω) W (τ k, ω). From the sample path continuity, we have max k W (τ (n) (n) k+1, ω) W (τ k, ω) 0 with probability 1 when n and therefore 2X n 1 k=0 (n) W (τ k+1, ω) W (τ (n) k, ω). As a consequence, the sample paths do almost surely not have bounded variation on [s, t] and cannot be differentiated. 2 For S T, the supremum of S is the least element of T, which is greater or equal to all elements of S.
23 Let s t. The two-time covariance is then given by v s,t = W tw s = (W t W s + W s)w s = W t W s W s + W 2 s = s. The transition density of W is given by p(w t W s) = N (W s, t s). Hence, the drift and the diffusion coefficient for a standard Wiener process are W t W s α(s, W s) = lim = 0, t s t s β(s, W s) = lim t s 2 Wt 2 Wt W s + Ws 2 = lim t s t s 2 Wt W 2 s t s = lim t s t s t s. The same results are found by directly differentiating the transition density as required in the Kolmogorov s equations.
24 Brownian bridge A Brownian bridge is a Wiener process pinned at both ends, i.e. the sample paths all go through an initial state at time t = 0 and a given state at a later time t = T. Let W = {W t, 0 t} be a standard Wiener process. The Brownian bridge B(x 0, y T ) = {B t(x 0, y T ), 0 t T } is a stochastic process, such that B t(x 0, y T ) = x 0 + W t t T (x0 + W T y T ). A Brownian bridge B t(x 0, y T ) is a Gaussian process with mean function and two-time covariance given by for 0 s, t T. B t = x 0 t T (x0 y T ), v s,t = min{s, t} st T,
25 Brownian bridge (continued) B t 0 B t 1!1 0!2!1! t! t Figure: Sample path examples of a Brownian bridge for different initial and final states.
26 Diffusion processes revisited Let W = {W t, t 0} be a standard Wiener process. The time evolution of a diffusion process can be described by a stochastic differential equation (SDE): dx t = α(t, X t)dt + β(t, X t)dw t, dw t N (0, dti D ), where X = {X t, t 0} is a stochastic process with drift α R D and diffusion coefficient β R D D. This representation corresponds to the state-space representation of discrete-time dynamical systems. An SDE is be interpretted as a (stochastic) integral equation along a sample path ω, that is X (t, ω) X (s, ω) = Z t s α(τ, X (τ, ω))dτ + Z t s β(τ, X (τ, ω)) dw (τ, ω) dτ. dτ This representation is symbolic as a Wiener process is almost surely not differentiable, but the limiting process corresponds to Gaussian white noise: W (τ + h, ω) W (τ, ω) lim N (0, 1). h 0 h This means that Gaussian white noise cannot be realized physically!
27 Construction of Itô s stochastic integral The central question is how to compute a stochastic integral of the form Z t s β(τ, X (τ, ω))dw (τ, ω) =? K. Itô s starting point is the following: Consider the standard Wiener process W = {W t, t 0} and a (scalar) constant diffusion coefficient β(t, X t) = β for all t. The integral along the sample path ω is equal to Z t with probability 1. s s βdw (τ, ω) = β {W (t, ω) W (s, ω)} The expected integral and the expected squared integral are thus given by fiz t fl * Z t «+ 2 βdw (τ, ω) = 0, βdw (τ, ω) = β 2 (t s). s
28 Construction of Itô s stochastic integral (continued) Consider the integral of the random function f : T Ω R: I [f ](ω) = Z t It is assumed f is mean square integrable. s f (τ, ω)dw (τ, ω). 1 If f is a random step function, that is f (t, ω) = f j (ω) on [t j, t j+1 [, then Xn 1 I [f ](ω) = f j (ω){w (t j+1, ω) W (t j, ω)}, j=1 with probability 1 for all ω. Since f j (ω) is constant on [t j, t j+1 [, we get I [f ] = 0, I 2 [f ] = P j f 2 j (t j+1 t j ). 2 If f (n) is a sequence of random n-step functions converging to the general random function f, such that f (n) (t, ω) = f (t (n) j, ω) on [t (n) j, t (n) j+1 [, then Xn 1 I [f (n) ](ω) = f (t (n) j j=1, ω){w (t (n) j+1 with probability 1 for all ω. The same results follow., ω) W (t(n) j, ω)},
29 The Itô stochastic integral Theorem: The Itô stochastic integral I [f ] of a random function f : T Ω R is the (unique) mean square limit of sequences of stochastic integrals I [f (n) ] for any sequence of random n-step functions f (n) converging to f : I [f ](ω) = m.s. lim n Xn 1 f (t (n) j j=1, ω){w (t (n) j+1, ω) W (t(n) j, ω)} with probability 1 and s = t (n) 1 <... < t (n) n 1 < t. The Itô integral of f with respect to W is a zero mean random variable. Since the Itô integral is constructed from the sequence f (n) evaluated at t j s, it defines a stochastic process which is a martingale. The chain rule from classical calculus does not apply (see later)! The Stratonivich construction preserves the classical chain rule, but not the martingale property. We call I 2 [f ] = R t s f 2 dt the Itô isomery.
30 Itô s stochastic integral follows from the fact that D E Xn 1 I 2 [f (n) ] = f 2 (t (n) j, ω) (t (n) j=1 is a proper Riemann integral for t (n) j+1 t(n) j 0. j+1 t(n) j ),
31 Itô formula Let Y t = U(t, X t) and consider the process X = {X t, t 0} described by the following SDE: dx t = α(t, X t)dt + β(t, X t)dw t. The stochastic chain rule is given by j U dy t = t + α U x + 1 ff 2 U 2 β2 dt + β U x 2 x dwt with probability 1. The additional term comes from the fact that The symbolic SDE is to be interpreted as an Itô stochastic integral, i.e. with equality in the mean square sense. dw 2 t is of O(dt).
32 Chain rule for classical calculus: Consider y = u(t, x). Discarding the second and higher order terms in the Taylor expansion of u leads to Chain rule for stochastic calculus: dy = u(t + dt, x + dx) u(t, x) = u u dt + t x dx. For Y t = U(t, X t), the Taylor expansion of U leads to dy t = U(t + dt, X t + dx t) U(t, X t) where = U U dt + t x dxt j 2 U t 2 (dt) U t x dt dxt + 2 U x 2 (dxt)2 (dx t) 2 = α 2 (dt) 2 + 2αβdt dw t+β 2 (dw t) 2. Hence, we need to keep the additional term of O(dt), such that j U dy t = t + 1 ff 2 β2 2 U x 2 dt + U x dxt. Substituting dx t leads to the desired results. ff +...,
33 Application: Black-Scholes option-pricing model Assume the evolution of a stock price X t is described by a geometric Wiener process: dx t = ρx tdt + σx tdw t, where ρ is called the risk-free rate (or drift) and σ the volatility. Consider the change of variable Y t = log X t. Applying the stochastic chain rule leads to Black-Scholes formula: «dy t = ρ σ2 dt + σdw t. 2 This leads to the following solution for the stock price at time t: «ff X t = X 0 exp j ρ σ2 t + σw t. 2 Assumptions: No dividends or charges European exercise terms Markets are efficient Interest rates are known Returns are log-normal
34 Ornstein-Uhlenbeck (OU) process The Ornstein-Uhlenbeck process with drift γ > 0 and mean µ is defined as follows: dx t = γ(x t µ)dt + σdw t. The OU process is known as the mean reverting process. It is a Gaussian process covariance function: It is wide-sense stationary. It is a homogeneous Markov process. It process is a diffusion process. v s,t = σ2 2γ e γ t s, s t. It is the continuous equivalent of the discrete AR(1) process.
35 OU process (continued) 2 1 0!1 X t!2!3!4!5! t Figure: Sample path examples of a OU process with different drift and diffusion coefficient. The same mean µ and initial condition were used.
36 References Crispin W. Gardiner: Handbook of Stochastic Methods. Springer, 2004 (3rd edition). Peter E. Kloeden and Eckhard Platen: Numerical Solution of Stochastic Differential Equations. Springer, Bernt Øksendal: Stochastic Differential Equations. An Introduction with Applications. Springer, 2000 (5th edition). A Tutorial Introduction to Stochastic Differential Equations: Continuous time Gaussian Markov Processes by Christopher K. I. Williams at NIPS workshop on Dynamical Systems, Stochastic Processes and Bayesian Inference, Lévy processes and Finance by Matthias Winkel.
A Short Introduction to Diffusion Processes and Ito Calculus
A Short Introduction to Diffusion Processes and Ito Calculus Cédric Archambeau University College, London Center for Computational Statistics and Machine Learning c.archambeau@cs.ucl.ac.uk January 24,
More informationPROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS
PROBABILITY: LIMIT THEOREMS II, SPRING 218. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please
More informationPROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS
PROBABILITY: LIMIT THEOREMS II, SPRING 15. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please
More information1. Stochastic Process
HETERGENEITY IN QUANTITATIVE MACROECONOMICS @ TSE OCTOBER 17, 216 STOCHASTIC CALCULUS BASICS SANG YOON (TIM) LEE Very simple notes (need to add references). It is NOT meant to be a substitute for a real
More informationStochastic differential equation models in biology Susanne Ditlevsen
Stochastic differential equation models in biology Susanne Ditlevsen Introduction This chapter is concerned with continuous time processes, which are often modeled as a system of ordinary differential
More informationM4A42 APPLIED STOCHASTIC PROCESSES
M4A42 APPLIED STOCHASTIC PROCESSES G.A. Pavliotis Department of Mathematics Imperial College London, UK LECTURE 1 12/10/2009 Lectures: Mondays 09:00-11:00, Huxley 139, Tuesdays 09:00-10:00, Huxley 144.
More informationThe concentration of a drug in blood. Exponential decay. Different realizations. Exponential decay with noise. dc(t) dt.
The concentration of a drug in blood Exponential decay C12 concentration 2 4 6 8 1 C12 concentration 2 4 6 8 1 dc(t) dt = µc(t) C(t) = C()e µt 2 4 6 8 1 12 time in minutes 2 4 6 8 1 12 time in minutes
More informationMathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio ( )
Mathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio (2014-2015) Etienne Tanré - Olivier Faugeras INRIA - Team Tosca November 26th, 2014 E. Tanré (INRIA - Team Tosca) Mathematical
More informationHandbook of Stochastic Methods
C. W. Gardiner Handbook of Stochastic Methods for Physics, Chemistry and the Natural Sciences Third Edition With 30 Figures Springer Contents 1. A Historical Introduction 1 1.1 Motivation I 1.2 Some Historical
More informationELEMENTS OF PROBABILITY THEORY
ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable
More informationNumerical methods for solving stochastic differential equations
Mathematical Communications 4(1999), 251-256 251 Numerical methods for solving stochastic differential equations Rózsa Horváth Bokor Abstract. This paper provides an introduction to stochastic calculus
More informationHandbook of Stochastic Methods
Springer Series in Synergetics 13 Handbook of Stochastic Methods for Physics, Chemistry and the Natural Sciences von Crispin W Gardiner Neuausgabe Handbook of Stochastic Methods Gardiner schnell und portofrei
More informationBrownian Motion. 1 Definition Brownian Motion Wiener measure... 3
Brownian Motion Contents 1 Definition 2 1.1 Brownian Motion................................. 2 1.2 Wiener measure.................................. 3 2 Construction 4 2.1 Gaussian process.................................
More informationFiltrations, Markov Processes and Martingales. Lectures on Lévy Processes and Stochastic Calculus, Braunschweig, Lecture 3: The Lévy-Itô Decomposition
Filtrations, Markov Processes and Martingales Lectures on Lévy Processes and Stochastic Calculus, Braunschweig, Lecture 3: The Lévy-Itô Decomposition David pplebaum Probability and Statistics Department,
More informationIntroduction to Diffusion Processes.
Introduction to Diffusion Processes. Arka P. Ghosh Department of Statistics Iowa State University Ames, IA 511-121 apghosh@iastate.edu (515) 294-7851. February 1, 21 Abstract In this section we describe
More informationSome Terminology and Concepts that We will Use, But Not Emphasize (Section 6.2)
Some Terminology and Concepts that We will Use, But Not Emphasize (Section 6.2) Statistical analysis is based on probability theory. The fundamental object in probability theory is a probability space,
More informationExample 4.1 Let X be a random variable and f(t) a given function of time. Then. Y (t) = f(t)x. Y (t) = X sin(ωt + δ)
Chapter 4 Stochastic Processes 4. Definition In the previous chapter we studied random variables as functions on a sample space X(ω), ω Ω, without regard to how these might depend on parameters. We now
More informationHJB equations. Seminar in Stochastic Modelling in Economics and Finance January 10, 2011
Department of Probability and Mathematical Statistics Faculty of Mathematics and Physics, Charles University in Prague petrasek@karlin.mff.cuni.cz Seminar in Stochastic Modelling in Economics and Finance
More informationp 1 ( Y p dp) 1/p ( X p dp) 1 1 p
Doob s inequality Let X(t) be a right continuous submartingale with respect to F(t), t 1 P(sup s t X(s) λ) 1 λ {sup s t X(s) λ} X + (t)dp 2 For 1 < p
More informationThe Smoluchowski-Kramers Approximation: What model describes a Brownian particle?
The Smoluchowski-Kramers Approximation: What model describes a Brownian particle? Scott Hottovy shottovy@math.arizona.edu University of Arizona Applied Mathematics October 7, 2011 Brown observes a particle
More informationGaussian Process Approximations of Stochastic Differential Equations
Gaussian Process Approximations of Stochastic Differential Equations Cédric Archambeau Centre for Computational Statistics and Machine Learning University College London c.archambeau@cs.ucl.ac.uk CSML
More informationStochastic Volatility and Correction to the Heat Equation
Stochastic Volatility and Correction to the Heat Equation Jean-Pierre Fouque, George Papanicolaou and Ronnie Sircar Abstract. From a probabilist s point of view the Twentieth Century has been a century
More informationStochastic process for macro
Stochastic process for macro Tianxiao Zheng SAIF 1. Stochastic process The state of a system {X t } evolves probabilistically in time. The joint probability distribution is given by Pr(X t1, t 1 ; X t2,
More informationLecture 4: Ito s Stochastic Calculus and SDE. Seung Yeal Ha Dept of Mathematical Sciences Seoul National University
Lecture 4: Ito s Stochastic Calculus and SDE Seung Yeal Ha Dept of Mathematical Sciences Seoul National University 1 Preliminaries What is Calculus? Integral, Differentiation. Differentiation 2 Integral
More informationNumerical Integration of SDEs: A Short Tutorial
Numerical Integration of SDEs: A Short Tutorial Thomas Schaffter January 19, 010 1 Introduction 1.1 Itô and Stratonovich SDEs 1-dimensional stochastic differentiable equation (SDE) is given by [6, 7] dx
More informationFE 5204 Stochastic Differential Equations
Instructor: Jim Zhu e-mail:zhu@wmich.edu http://homepages.wmich.edu/ zhu/ January 20, 2009 Preliminaries for dealing with continuous random processes. Brownian motions. Our main reference for this lecture
More information1 Introduction. 2 Diffusion equation and central limit theorem. The content of these notes is also covered by chapter 3 section B of [1].
1 Introduction The content of these notes is also covered by chapter 3 section B of [1]. Diffusion equation and central limit theorem Consider a sequence {ξ i } i=1 i.i.d. ξ i = d ξ with ξ : Ω { Dx, 0,
More informationKolmogorov Equations and Markov Processes
Kolmogorov Equations and Markov Processes May 3, 013 1 Transition measures and functions Consider a stochastic process {X(t)} t 0 whose state space is a product of intervals contained in R n. We define
More informationIntroduction. Stochastic Processes. Will Penny. Stochastic Differential Equations. Stochastic Chain Rule. Expectations.
19th May 2011 Chain Introduction We will Show the relation between stochastic differential equations, Gaussian processes and methods This gives us a formal way of deriving equations for the activity of
More informationJump-type Levy Processes
Jump-type Levy Processes Ernst Eberlein Handbook of Financial Time Series Outline Table of contents Probabilistic Structure of Levy Processes Levy process Levy-Ito decomposition Jump part Probabilistic
More information1. Stochastic Processes and filtrations
1. Stochastic Processes and 1. Stoch. pr., A stochastic process (X t ) t T is a collection of random variables on (Ω, F) with values in a measurable space (S, S), i.e., for all t, In our case X t : Ω S
More informationBrownian motion. Samy Tindel. Purdue University. Probability Theory 2 - MA 539
Brownian motion Samy Tindel Purdue University Probability Theory 2 - MA 539 Mostly taken from Brownian Motion and Stochastic Calculus by I. Karatzas and S. Shreve Samy T. Brownian motion Probability Theory
More informationErnesto Mordecki 1. Lecture III. PASI - Guanajuato - June 2010
Optimal stopping for Hunt and Lévy processes Ernesto Mordecki 1 Lecture III. PASI - Guanajuato - June 2010 1Joint work with Paavo Salminen (Åbo, Finland) 1 Plan of the talk 1. Motivation: from Finance
More informationExercises in stochastic analysis
Exercises in stochastic analysis Franco Flandoli, Mario Maurelli, Dario Trevisan The exercises with a P are those which have been done totally or partially) in the previous lectures; the exercises with
More informationStochastic Differential Equations
Chapter 5 Stochastic Differential Equations We would like to introduce stochastic ODE s without going first through the machinery of stochastic integrals. 5.1 Itô Integrals and Itô Differential Equations
More informationStochastic Integration and Stochastic Differential Equations: a gentle introduction
Stochastic Integration and Stochastic Differential Equations: a gentle introduction Oleg Makhnin New Mexico Tech Dept. of Mathematics October 26, 27 Intro: why Stochastic? Brownian Motion/ Wiener process
More informationStochastic Calculus. Kevin Sinclair. August 2, 2016
Stochastic Calculus Kevin Sinclair August, 16 1 Background Suppose we have a Brownian motion W. This is a process, and the value of W at a particular time T (which we write W T ) is a normally distributed
More informationBrownian Motion and Poisson Process
and Poisson Process She: What is white noise? He: It is the best model of a totally unpredictable process. She: Are you implying, I am white noise? He: No, it does not exist. Dialogue of an unknown couple.
More informationSimulation and Parametric Estimation of SDEs
Simulation and Parametric Estimation of SDEs Jhonny Gonzalez School of Mathematics The University of Manchester Magical books project August 23, 2012 Motivation The problem Simulation of SDEs SDEs driven
More informationMarkov processes and queueing networks
Inria September 22, 2015 Outline Poisson processes Markov jump processes Some queueing networks The Poisson distribution (Siméon-Denis Poisson, 1781-1840) { } e λ λ n n! As prevalent as Gaussian distribution
More informationLecture 1a: Basic Concepts and Recaps
Lecture 1a: Basic Concepts and Recaps Cédric Archambeau Centre for Computational Statistics and Machine Learning Department of Computer Science University College London c.archambeau@cs.ucl.ac.uk Advanced
More informationPoisson Jumps in Credit Risk Modeling: a Partial Integro-differential Equation Formulation
Poisson Jumps in Credit Risk Modeling: a Partial Integro-differential Equation Formulation Jingyi Zhu Department of Mathematics University of Utah zhu@math.utah.edu Collaborator: Marco Avellaneda (Courant
More informationM5A42 APPLIED STOCHASTIC PROCESSES
M5A42 APPLIED STOCHASTIC PROCESSES Professor G.A. Pavliotis Department of Mathematics Imperial College London, UK LECTURE 1 06/10/2016 Lectures: Thursdays 14:00-15:00, Huxley 140, Fridays 10:00-12:00,
More informationA variational radial basis function approximation for diffusion processes
A variational radial basis function approximation for diffusion processes Michail D. Vrettas, Dan Cornford and Yuan Shen Aston University - Neural Computing Research Group Aston Triangle, Birmingham B4
More informationAn introduction to Lévy processes
with financial modelling in mind Department of Statistics, University of Oxford 27 May 2008 1 Motivation 2 3 General modelling with Lévy processes Modelling financial price processes Quadratic variation
More informationThe Wiener Itô Chaos Expansion
1 The Wiener Itô Chaos Expansion The celebrated Wiener Itô chaos expansion is fundamental in stochastic analysis. In particular, it plays a crucial role in the Malliavin calculus as it is presented in
More informationHomogenization with stochastic differential equations
Homogenization with stochastic differential equations Scott Hottovy shottovy@math.arizona.edu University of Arizona Program in Applied Mathematics October 12, 2011 Modeling with SDE Use SDE to model system
More informationIntroduction to nonequilibrium physics
Introduction to nonequilibrium physics Jae Dong Noh December 18, 2016 Preface This is a note for the lecture given in the 2016 KIAS-SNU Physics Winter Camp which is held at KIAS in December 17 23, 2016.
More informationRegular Variation and Extreme Events for Stochastic Processes
1 Regular Variation and Extreme Events for Stochastic Processes FILIP LINDSKOG Royal Institute of Technology, Stockholm 2005 based on joint work with Henrik Hult www.math.kth.se/ lindskog 2 Extremes for
More informationHigher order weak approximations of stochastic differential equations with and without jumps
Higher order weak approximations of stochastic differential equations with and without jumps Hideyuki TANAKA Graduate School of Science and Engineering, Ritsumeikan University Rough Path Analysis and Related
More informationLecture 12: Detailed balance and Eigenfunction methods
Miranda Holmes-Cerfon Applied Stochastic Analysis, Spring 2015 Lecture 12: Detailed balance and Eigenfunction methods Readings Recommended: Pavliotis [2014] 4.5-4.7 (eigenfunction methods and reversibility),
More informationInterest Rate Models:
1/17 Interest Rate Models: from Parametric Statistics to Infinite Dimensional Stochastic Analysis René Carmona Bendheim Center for Finance ORFE & PACM, Princeton University email: rcarmna@princeton.edu
More informationElementary Applications of Probability Theory
Elementary Applications of Probability Theory With an introduction to stochastic differential equations Second edition Henry C. Tuckwell Senior Research Fellow Stochastic Analysis Group of the Centre for
More information{σ x >t}p x. (σ x >t)=e at.
3.11. EXERCISES 121 3.11 Exercises Exercise 3.1 Consider the Ornstein Uhlenbeck process in example 3.1.7(B). Show that the defined process is a Markov process which converges in distribution to an N(0,σ
More informationFunctional Limit theorems for the quadratic variation of a continuous time random walk and for certain stochastic integrals
Functional Limit theorems for the quadratic variation of a continuous time random walk and for certain stochastic integrals Noèlia Viles Cuadros BCAM- Basque Center of Applied Mathematics with Prof. Enrico
More informationLecture 4 An Introduction to Stochastic Processes
Lecture 4 An Introduction to Stochastic Processes Prof. Massimo Guidolin Prep Course in Quantitative Methods for Finance August-September 2017 Plan of the lecture Motivation and definitions Filtrations
More informationMATH4210 Financial Mathematics ( ) Tutorial 7
MATH40 Financial Mathematics (05-06) Tutorial 7 Review of some basic Probability: The triple (Ω, F, P) is called a probability space, where Ω denotes the sample space and F is the set of event (σ algebra
More informationFE610 Stochastic Calculus for Financial Engineers. Stevens Institute of Technology
FE610 Stochastic Calculus for Financial Engineers Lecture 3. Calculaus in Deterministic and Stochastic Environments Steve Yang Stevens Institute of Technology 01/31/2012 Outline 1 Modeling Random Behavior
More informationMFE6516 Stochastic Calculus for Finance
MFE6516 Stochastic Calculus for Finance William C. H. Leon Nanyang Business School December 11, 2017 1 / 51 William C. H. Leon MFE6516 Stochastic Calculus for Finance 1 Symmetric Random Walks Scaled Symmetric
More informationExercises. T 2T. e ita φ(t)dt.
Exercises. Set #. Construct an example of a sequence of probability measures P n on R which converge weakly to a probability measure P but so that the first moments m,n = xdp n do not converge to m = xdp.
More informationGaussian processes for inference in stochastic differential equations
Gaussian processes for inference in stochastic differential equations Manfred Opper, AI group, TU Berlin November 6, 2017 Manfred Opper, AI group, TU Berlin (TU Berlin) inference in SDE November 6, 2017
More informationI forgot to mention last time: in the Ito formula for two standard processes, putting
I forgot to mention last time: in the Ito formula for two standard processes, putting dx t = a t dt + b t db t dy t = α t dt + β t db t, and taking f(x, y = xy, one has f x = y, f y = x, and f xx = f yy
More informationContinuous and Discrete random process
Continuous and Discrete random and Discrete stochastic es. Continuous stochastic taking values in R. Many real data falls into the continuous category: Meteorological data, molecular motion, traffic data...
More informationLocal vs. Nonlocal Diffusions A Tale of Two Laplacians
Local vs. Nonlocal Diffusions A Tale of Two Laplacians Jinqiao Duan Dept of Applied Mathematics Illinois Institute of Technology Chicago duan@iit.edu Outline 1 Einstein & Wiener: The Local diffusion 2
More informationShort-time expansions for close-to-the-money options under a Lévy jump model with stochastic volatility
Short-time expansions for close-to-the-money options under a Lévy jump model with stochastic volatility José Enrique Figueroa-López 1 1 Department of Statistics Purdue University Statistics, Jump Processes,
More informationBrownian Motion. An Undergraduate Introduction to Financial Mathematics. J. Robert Buchanan. J. Robert Buchanan Brownian Motion
Brownian Motion An Undergraduate Introduction to Financial Mathematics J. Robert Buchanan 2010 Background We have already seen that the limiting behavior of a discrete random walk yields a derivation of
More informationContinuous Time Finance
Continuous Time Finance Lisbon 2013 Tomas Björk Stockholm School of Economics Tomas Björk, 2013 Contents Stochastic Calculus (Ch 4-5). Black-Scholes (Ch 6-7. Completeness and hedging (Ch 8-9. The martingale
More informationMulti-Factor Lévy Models I: Symmetric alpha-stable (SαS) Lévy Processes
Multi-Factor Lévy Models I: Symmetric alpha-stable (SαS) Lévy Processes Anatoliy Swishchuk Department of Mathematics and Statistics University of Calgary Calgary, Alberta, Canada Lunch at the Lab Talk
More informationMalliavin Calculus in Finance
Malliavin Calculus in Finance Peter K. Friz 1 Greeks and the logarithmic derivative trick Model an underlying assent by a Markov process with values in R m with dynamics described by the SDE dx t = b(x
More information6. Brownian Motion. Q(A) = P [ ω : x(, ω) A )
6. Brownian Motion. stochastic process can be thought of in one of many equivalent ways. We can begin with an underlying probability space (Ω, Σ, P) and a real valued stochastic process can be defined
More informationNonparametric Bayesian Methods - Lecture I
Nonparametric Bayesian Methods - Lecture I Harry van Zanten Korteweg-de Vries Institute for Mathematics CRiSM Masterclass, April 4-6, 2016 Overview of the lectures I Intro to nonparametric Bayesian statistics
More informationSMSTC (2007/08) Probability.
SMSTC (27/8) Probability www.smstc.ac.uk Contents 12 Markov chains in continuous time 12 1 12.1 Markov property and the Kolmogorov equations.................... 12 2 12.1.1 Finite state space.................................
More information1.1 Review of Probability Theory
1.1 Review of Probability Theory Angela Peace Biomathemtics II MATH 5355 Spring 2017 Lecture notes follow: Allen, Linda JS. An introduction to stochastic processes with applications to biology. CRC Press,
More informationDiscretization of SDEs: Euler Methods and Beyond
Discretization of SDEs: Euler Methods and Beyond 09-26-2006 / PRisMa 2006 Workshop Outline Introduction 1 Introduction Motivation Stochastic Differential Equations 2 The Time Discretization of SDEs Monte-Carlo
More informationVerona Course April Lecture 1. Review of probability
Verona Course April 215. Lecture 1. Review of probability Viorel Barbu Al.I. Cuza University of Iaşi and the Romanian Academy A probability space is a triple (Ω, F, P) where Ω is an abstract set, F is
More informationA numerical method for solving uncertain differential equations
Journal of Intelligent & Fuzzy Systems 25 (213 825 832 DOI:1.3233/IFS-12688 IOS Press 825 A numerical method for solving uncertain differential equations Kai Yao a and Xiaowei Chen b, a Department of Mathematical
More informationStochastic Calculus for Finance II - some Solutions to Chapter VII
Stochastic Calculus for Finance II - some Solutions to Chapter VII Matthias hul Last Update: June 9, 25 Exercise 7 Black-Scholes-Merton Equation for the up-and-out Call) i) We have ii) We first compute
More informationStochastic Calculus February 11, / 33
Martingale Transform M n martingale with respect to F n, n =, 1, 2,... σ n F n (σ M) n = n 1 i= σ i(m i+1 M i ) is a Martingale E[(σ M) n F n 1 ] n 1 = E[ σ i (M i+1 M i ) F n 1 ] i= n 2 = σ i (M i+1 M
More informationInfinitely divisible distributions and the Lévy-Khintchine formula
Infinitely divisible distributions and the Cornell University May 1, 2015 Some definitions Let X be a real-valued random variable with law µ X. Recall that X is said to be infinitely divisible if for every
More informationLecture 12: Detailed balance and Eigenfunction methods
Lecture 12: Detailed balance and Eigenfunction methods Readings Recommended: Pavliotis [2014] 4.5-4.7 (eigenfunction methods and reversibility), 4.2-4.4 (explicit examples of eigenfunction methods) Gardiner
More informationSome Tools From Stochastic Analysis
W H I T E Some Tools From Stochastic Analysis J. Potthoff Lehrstuhl für Mathematik V Universität Mannheim email: potthoff@math.uni-mannheim.de url: http://ls5.math.uni-mannheim.de To close the file, click
More informationGAUSSIAN PROCESSES; KOLMOGOROV-CHENTSOV THEOREM
GAUSSIAN PROCESSES; KOLMOGOROV-CHENTSOV THEOREM STEVEN P. LALLEY 1. GAUSSIAN PROCESSES: DEFINITIONS AND EXAMPLES Definition 1.1. A standard (one-dimensional) Wiener process (also called Brownian motion)
More informationBernardo D Auria Stochastic Processes /10. Notes. Abril 13 th, 2010
1 Stochastic Calculus Notes Abril 13 th, 1 As we have seen in previous lessons, the stochastic integral with respect to the Brownian motion shows a behavior different from the classical Riemann-Stieltjes
More informationWeek 1 Quantitative Analysis of Financial Markets Distributions A
Week 1 Quantitative Analysis of Financial Markets Distributions A Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036 October
More informationSDE Coefficients. March 4, 2008
SDE Coefficients March 4, 2008 The following is a summary of GARD sections 3.3 and 6., mainly as an overview of the two main approaches to creating a SDE model. Stochastic Differential Equations (SDE)
More informationNumerical Methods with Lévy Processes
Numerical Methods with Lévy Processes 1 Objective: i) Find models of asset returns, etc ii) Get numbers out of them. Why? VaR and risk management Valuing and hedging derivatives Why not? Usual assumption:
More informationState Space Representation of Gaussian Processes
State Space Representation of Gaussian Processes Simo Särkkä Department of Biomedical Engineering and Computational Science (BECS) Aalto University, Espoo, Finland June 12th, 2013 Simo Särkkä (Aalto University)
More informationThis is a Gaussian probability centered around m = 0 (the most probable and mean position is the origin) and the mean square displacement m 2 = n,or
Physics 7b: Statistical Mechanics Brownian Motion Brownian motion is the motion of a particle due to the buffeting by the molecules in a gas or liquid. The particle must be small enough that the effects
More informationAPM 541: Stochastic Modelling in Biology Diffusion Processes. Jay Taylor Fall Jay Taylor (ASU) APM 541 Fall / 61
APM 541: Stochastic Modelling in Biology Diffusion Processes Jay Taylor Fall 2013 Jay Taylor (ASU) APM 541 Fall 2013 1 / 61 Brownian Motion Brownian Motion and Random Walks Let (ξ n : n 0) be a collection
More informationLecture 12: Diffusion Processes and Stochastic Differential Equations
Lecture 12: Diffusion Processes and Stochastic Differential Equations 1. Diffusion Processes 1.1 Definition of a diffusion process 1.2 Examples 2. Stochastic Differential Equations SDE) 2.1 Stochastic
More informationGaussian, Markov and stationary processes
Gaussian, Markov and stationary processes Gonzalo Mateos Dept. of ECE and Goergen Institute for Data Science University of Rochester gmateosb@ece.rochester.edu http://www.ece.rochester.edu/~gmateosb/ November
More informationStochastic Modelling Unit 1: Markov chain models
Stochastic Modelling Unit 1: Markov chain models Russell Gerrard and Douglas Wright Cass Business School, City University, London June 2004 Contents of Unit 1 1 Stochastic Processes 2 Markov Chains 3 Poisson
More informationSTAT 331. Martingale Central Limit Theorem and Related Results
STAT 331 Martingale Central Limit Theorem and Related Results In this unit we discuss a version of the martingale central limit theorem, which states that under certain conditions, a sum of orthogonal
More informationInformation Theory and Statistics Lecture 3: Stationary ergodic processes
Information Theory and Statistics Lecture 3: Stationary ergodic processes Łukasz Dębowski ldebowsk@ipipan.waw.pl Ph. D. Programme 2013/2014 Measurable space Definition (measurable space) Measurable space
More informationBrownian Motion. Chapter Definition of Brownian motion
Chapter 5 Brownian Motion Brownian motion originated as a model proposed by Robert Brown in 1828 for the phenomenon of continual swarming motion of pollen grains suspended in water. In 1900, Bachelier
More informationStochastic Differential Equations.
Chapter 3 Stochastic Differential Equations. 3.1 Existence and Uniqueness. One of the ways of constructing a Diffusion process is to solve the stochastic differential equation dx(t) = σ(t, x(t)) dβ(t)
More informationWeek 9 Generators, duality, change of measure
Week 9 Generators, duality, change of measure Jonathan Goodman November 18, 013 1 Generators This section describes a common abstract way to describe many of the differential equations related to Markov
More informationLecture 5. If we interpret the index n 0 as time, then a Markov chain simply requires that the future depends only on the present and not on the past.
1 Markov chain: definition Lecture 5 Definition 1.1 Markov chain] A sequence of random variables (X n ) n 0 taking values in a measurable state space (S, S) is called a (discrete time) Markov chain, if
More informationRandom Process Lecture 1. Fundamentals of Probability
Random Process Lecture 1. Fundamentals of Probability Husheng Li Min Kao Department of Electrical Engineering and Computer Science University of Tennessee, Knoxville Spring, 2016 1/43 Outline 2/43 1 Syllabus
More informationLecture Notes 7 Random Processes. Markov Processes Markov Chains. Random Processes
Lecture Notes 7 Random Processes Definition IID Processes Bernoulli Process Binomial Counting Process Interarrival Time Process Markov Processes Markov Chains Classification of States Steady State Probabilities
More information