Markov processes and the Kolmogorov equations

Similar documents
Quantum Mechanics for Scientists and Engineers. David Miller

MATH Midterm Examination Victor Matveev October 26, 2016

Chapter 3.1: Polynomial Functions

D.S.G. POLLOCK: TOPICS IN TIME-SERIES ANALYSIS STATISTICAL FOURIER ANALYSIS

5.1 Two-Step Conditional Density Estimator

are specified , are linearly independent Otherwise, they are linearly dependent, and one is expressed by a linear combination of the others

Solutions. Definitions pertaining to solutions

Study of Energy Eigenvalues of Three Dimensional. Quantum Wires with Variable Cross Section

Intermediate Division Solutions

x 2 x 3 x b 0, then a, b, c log x 1 log z log x log y 1 logb log a dy 4. dx As tangent is perpendicular to the x axis, slope

K [f(t)] 2 [ (st) /2 K A GENERALIZED MEIJER TRANSFORMATION. Ku(z) ()x) t -)-I e. K(z) r( + ) () (t 2 I) -1/2 e -zt dt, G. L. N. RAO L.

ENGI 4421 Central Limit Theorem Page Central Limit Theorem [Navidi, section 4.11; Devore sections ]

UNIVERSITY OF TECHNOLOGY. Department of Mathematics PROBABILITY THEORY, STATISTICS AND OPERATIONS RESEARCH GROUP. Memorandum COSOR 76-10

Identical Particles. We would like to move from the quantum theory of hydrogen to that for the rest of the periodic table

ENGI 4421 Central Limit Theorem Page Central Limit Theorem [Navidi, section 4.11; Devore sections ]

Examination No. 3 - Tuesday, Nov. 15

1. Itrducti Let X fx(t) t 0g be a symmetric stable prcess f idex, with X(0) 0. That is, X has idepedet ad statiary icremets, with characteristic fucti

The multidimensional Ito Integral and the multidimensional Ito Formula. Eric Mu ller June 1, 2015 Seminar on Stochastic Geometry and its applications

Ch. 1 Introduction to Estimation 1/15

BIO752: Advanced Methods in Biostatistics, II TERM 2, 2010 T. A. Louis. BIO 752: MIDTERM EXAMINATION: ANSWERS 30 November 2010

A New Method for Finding an Optimal Solution. of Fully Interval Integer Transportation Problems

Lecture 21: Signal Subspaces and Sparsity

Mean residual life of coherent systems consisting of multiple types of dependent components

Multi-objective Programming Approach for. Fuzzy Linear Programming Problems

E o and the equilibrium constant, K

ALE 26. Equilibria for Cell Reactions. What happens to the cell potential as the reaction proceeds over time?

Solutions to Midterm II. of the following equation consistent with the boundary condition stated u. y u x y

Fourier Method for Solving Transportation. Problems with Mixed Constraints

18.01 Calculus Jason Starr Fall 2005

Bernardo D Auria Stochastic Processes /10. Notes. Abril 13 th, 2010

1 Approximating Integrals using Taylor Polynomials

Active redundancy allocation in systems. R. Romera; J. Valdés; R. Zequeira*

Math 21B-B - Homework Set 2

Lecture 4: Ito s Stochastic Calculus and SDE. Seung Yeal Ha Dept of Mathematical Sciences Seoul National University

The Excel FFT Function v1.1 P. T. Debevec February 12, The discrete Fourier transform may be used to identify periodic structures in time ht.

Stochastic Calculus for Finance II - some Solutions to Chapter VII

, the random variable. and a sample size over the y-values 0:1:10.

Math 2784 (or 2794W) University of Connecticut

Control Systems. Controllability and Observability (Chapter 6)

An outside barrier option

Claude Elysée Lobry Université de Nice, Faculté des Sciences, parc Valrose, NICE, France.

Partial match queries: a limit process

5.80 Small-Molecule Spectroscopy and Dynamics

IJISET - International Journal of Innovative Science, Engineering & Technology, Vol. 2 Issue 12, December

Every gas consists of a large number of small particles called molecules moving with very high velocities in all possible directions.

Chapter 6 Principles of Data Reduction

Axial Temperature Distribution in W-Tailored Optical Fibers

Bernardo D Auria Stochastic Processes /12. Notes. March 29 th, 2012

Grade 3 Mathematics Course Syllabus Prince George s County Public Schools

Notes 27 : Brownian motion: path properties

STAT Homework 2 - Solutions

RMO Sample Paper 1 Solutions :

Copyright 1978, by the author(s). All rights reserved.

A Study on Estimation of Lifetime Distribution with Covariates Under Misspecification

Honors Calculus Homework 13 Solutions, due 12/8/5

Study in Cylindrical Coordinates of the Heat Transfer Through a Tow Material-Thermal Impedance

Unit -2 THEORY OF DILUTE SOLUTIONS

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT

Notes 5 : More on the a.s. convergence of sums

A Hartree-Fock Calculation of the Water Molecule

Convergence of random variables. (telegram style notes) P.J.C. Spreij

WEST VIRGINIA UNIVERSITY

The Simple Linear Regression Model: Theory

MATHEMATICS 9740/01 Paper 1 14 Sep hours

Kolmogorov Equations and Markov Processes

LECTURE 11 LINEAR PROCESSES III: ASYMPTOTIC RESULTS

Lecture 7: Channel coding theorem for discrete-time continuous memoryless channel

Stochastic Integrals and Itô s formula.

1 Introduction to reducing variance in Monte Carlo simulations

Lecture 18. MSMPR Crystallization Model

2 f(x) dx = 1, 0. 2f(x 1) dx d) 1 4t t6 t. t 2 dt i)

Review of Important Concepts

Deterministic Dynamic Programming

Weak solutions of mean-field stochastic differential equations

Chapter 4. Problem Solutions

Abstract: The asympttically ptimal hypthesis testig prblem with the geeral surces as the ull ad alterative hyptheses is studied uder expetial-type err

MATH 31B: MIDTERM 2 REVIEW

Tail Probabilities and Almost Sure Bounds for Martingales. W.L. Steiger

Homogenization with stochastic differential equations

ON THE ABSOLUTE CONVERGENCE OF A SERIES ASSOCIATED WITH A FOURIER SERIES. R. MOHANTY and s. mohapatra

Source Coding and Compression

Electrostatics. . where,.(1.1) Maxwell Eqn. Total Charge. Two point charges r 12 distance apart in space

THE ASYMPTOTIC PERFORMANCE OF THE LOG LIKELIHOOD RATIO STATISTIC FOR THE MIXTURE MODEL AND RELATED RESULTS

Section Let A =. Then A has characteristic equation λ. 2 4λ + 3 = 0 or (λ 3)(λ 1) = 0. Hence the eigenvalues of A are λ 1 = 3 and λ 2 = 1.

s = and t = with C ij = A i B j F. (i) Note that cs = M and so ca i µ(a i ) I E (cs) = = c a i µ(a i ) = ci E (s). (ii) Note that s + t = M and so

Solving First Order PDEs

STAT 516 Answers Homework 6 April 2, 2008 Solutions by Mark Daniel Ward PROBLEMS

BC Calculus Review Sheet. converges. Use the integral: L 1

Strong Solutions and a Bismut-Elworthy-Li Formula for Mean-F. Formula for Mean-Field SDE s with Irregular Drift

A LIMITED ARITHMETIC ON SIMPLE CONTINUED FRACTIONS - II 1. INTRODUCTION

AN INTERMITTENTLY USED SYSTEM WITH PREVENTIVE MAINTENANCE

Lecture 7: Properties of Random Samples

[1 & α(t & T 1. ' ρ 1

6.3 Testing Series With Positive Terms

The minimum value and the L 1 norm of the Dirichlet kernel

Lecture 18: Sampling distributions

Lecture two. January 17, 2019

Lecture 12: Diffusion Processes and Stochastic Differential Equations

6.3: Volumes by Cylindrical Shells

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT

Transcription:

Chapter 6 Markv prcesses ad the Klmgrv equatis 6. Stchastic Differetial Equatis Csider the stchastic differetial equati: dx(t) =a(t X(t)) dt + (t X(t)) db(t): (SDE) Here a(t x) ad (t x) are give fuctis, usually assumed t be ctiuus i (t x) ad Lipschitz ctiuus i x,i.e., there is a cstat L such that ja(t x) a(t y)j Ljx yj j(t x) (t y)j Ljx yj fr all t x y. Let (t 0 x) be give. A sluti t (SDE) with the iitial cditi (t 0 x) is a prcess fx(t)g tt0 satisfyig X(t 0 )=x X(t) =X(t 0 )+ t t 0 a(s X(s)) ds + t t 0 (s X(s)) db(s) t t 0 The sluti prcess fx(t)g tt0 will be adapted t the filtrati ff(t)g t0 geerated by the Brwia mti. If yu kw the path f the Brwia mti up t time t, the yu ca evaluate X(t). Example 6. (Drifted Brwia mti) Let a be a cstat ad =,s dx(t) =adt+ db(t): If (t 0 x) is give ad we start with the iitial cditi X(t 0 )=x 77

78 the X(t) =x + a(t t 0 )+(B(t) B(t 0 )) t t 0 : T cmpute the differetial w.r.t. t, treat t 0 ad B(t 0 ) as cstats: dx(t) =adt+ db(t): Example 6. (Gemetric Brwia mti) Let r ad be cstats. Csider dx(t) = rx(t) dt + X(t) db(t): Give the iitial cditi X(t 0 )=x the sluti is X(t) =x exp (B(t) B(t0 )) + (r )(t t 0 ) : Agai, t cmpute the differetial w.r.t. t, treat t 0 ad B(t 0 ) as cstats: dx(t) =(r )X(t) dt + X(t) db(t) + X(t) dt = rx(t) dt + X(t) db(t): 6. Markv Prperty Let 0 t 0 <t be give ad let h(y) be a fucti. Dete by IE t 0 x h(x(t )) the expectati f h(x(t )), give that X(t 0 )=x. Nw let IR be give, ad start with iitial cditi We have the Markv prperty X(0) = : IE h(x(t 0 )) F (t 0) = IE t 0 X(t 0 ) h(x(t )): I ther wrds, if yu bserve the path f the drivig Brwia mti frm time 0 t time t 0, ad based this ifrmati, yu wat t estimate h(x(t )), the ly relevat ifrmati is the value f X(t 0 ). Yu imagie startig the (SDE) at time t 0 at value X(t 0 ), ad cmpute the expected value f h(x(t )).

CHAPTER 6. Markv prcesses ad the Klmgrv equatis 79 6.3 Trasiti desity Dete by p(t 0 t x y) the desity (i the y variable) f X(t ), cditied X(t 0 )=x. I ther wrds, IE t 0 x h(x(t )) = h(y)p(t 0 t x y) dy: IR The Markv prperty says that fr 0 t 0 t ad fr every, IE h(x(t 0 )) F(t 0) = h(y)p(t 0 t X(t 0 ) y) dy: IR Example 6.3 (Drifted Brwia mti) Csider the SDE dx(t) =adt+ db(t): Cditied X(t 0 ) =x, the radm variable X(t ) is rmal with mea x + a(t t 0 ) ad variace (t t 0 ), i.e., p(t 0 t x y) = p (t t 0 ) exp (y (x + a(t t 0 ))) (t t 0 ) Nte that p depeds t 0 ad t ly thrugh their differece t t 0. This is always the case whe a(t x) ad (t x) d t deped t. : Example 6.4 (Gemetric Brwia mti) Recall that the sluti t the SDE dx(t) =rx(t) dt + X(t) db(t) with iitial cditi X(t 0 )=x, is Gemetric Brwia mti: X(t )=xexp (B(t ) B(t 0 )) + (r )(t t 0 ) : The radm variable B(t ) B(t 0 ) has desity IP fb(t ) B(t 0 ) dbg = p exp (t t 0 ) b (t t 0 ) db ad we are makig the chage f variable y = x exp b +(r )(t t 0 ) r equivaletly, The derivative is dy db b = h lg y i x (r )(t t 0 ) : = y r equivaletly, db = dy y :

80 Therefre, p(t 0 t x y) dy = IP fx(t ) dyg h = p exp y (t t 0 ) (t t 0 ) lg y i x (r )(t t 0 ) dy: Usig the trasiti desity ad a fair amut f calculus, e ca cmpute the expected payff frm a Eurpea call: where Therefre, IE t x (X(T ) K) + = (y K) + p(t T x y) dy 0 IE 0 e r(tt) (X(T ) K) + F(t) = e r(tt) xn KN N () = p p T t p T t e x dx = p h x i lg K + r(t t) + (T t) h lg x K + r(t t) (T t) e x dx: = e r(tt) IE t X(t) (X(T ) K) + = X(t)N p lg X(t) T t K + r(t t) + (T t) e r(tt) KN p lg X(t) T t K + r(t t) (T t) i 6.4 The Klmgrv Backward Equati Csider dx(t) =a(t X(t)) dt + (t X(t)) db(t) ad let p(t 0 t x y) be the trasiti desity. The the Klmgrv Backward Equati is: @ p(t 0 t x y) =a(t 0 x) @ @t 0 @x p(t 0 t x y) + (t 0 x) @ @x p(t 0 t x y): (KBE) The variables t 0 ad x i (KBE) are called the backward variables. I the case that a ad are fuctis f x ale, p(t 0 t x y) depeds t 0 ad t ly thrugh their differece = t t 0. We the write p( x y) rather tha p(t 0 t x y), ad (KBE) becmes @ @ p( x y) =a(x) @ @x p( x y) + (x) @ p( x y): @x (KBE )

CHAPTER 6. Markv prcesses ad the Klmgrv equatis 8 Example 6.5 (Drifted Brwia mti) dx(t) =adt+ db(t) p( x y) = p exp (y (x + a )) : @ @ @ p = p (y x a ) = p exp @ @ (y x a ) @ p exp (y x a ) = a(y x a ) (y x a ) + + p: @ @x p = p x = y x a p: @ @ @x p = p y x a xx = p + y x a p x @x = (y x a ) p + p: Therefre, ap x + p xx = a(y x a ) = p : (y x a ) + p This is the Klmgrv backward equati. Example 6.6 (Gemetric Brwia mti) dx(t) = rx(t) dt + X(t) db(t): p( x y) = y p exp h lg y i x (r ) : It is true but very tedius t verify that p satisfies the KBE p = rxp x + x p xx : 6.5 Cecti betwee stchastic calculus ad KBE Csider dx(t) = a(x(t)) dt + (X(t)) db(t): (5.) Let h(y) be a fucti, ad defie v(t x) =IE t x h(x(t ))

8 where 0 t T. The v(t x) = h(y) p(t t x y) dy v t (t x) = h(y) p (T t x y) dy v x (t x) = h(y) p x (T t x y) dy v xx (t x) = h(y) p xx (T t x y) dy: Therefre, the Klmgrv backward equati implies v t (t x) +a(x)v x (t x) + (x)v xx (t x) = h i h(y) p (T t x y) +a(x)p x (T t x y) + (x)p xx (T t x y) dy =0 Let (0 ) be a iitial cditi fr the SDE (5.). We simplify tati by writig IE rather tha IE 0. Therem 5.50 Startig at X(0) =, the prcess v(t X(t)) satisfies the martigale prperty: IE v(t X(t)) F(s) = v(s X(s)) 0 s t T: Prf: Accrdig t the Markv prperty, IE h(x(t )) F(t) = IE t X(t) h(x(t )) = v(t X(t)) s IE [v(t X(t))jF(s)] = IE IE h(x(t )) F(t) F(s) = IE h(x(t )) F(s) = IE s X(s) h(x(t )) (Markv prperty) = v(s X(s)): Itô s frmula implies dv(t X(t)) = v t dt + v x dx + v xxdx dx = v t dt + av x dt + v x db + v xx dt:

CHAPTER 6. Markv prcesses ad the Klmgrv equatis 83 I itegral frm, we have v(t X(t)) = v(0 X(0)) t h i + v t (u X(u)) + a(x(u))v x (u X(u)) + (X(u))v xx (u X(u)) du 0 t + (X(u))v x (u X(u)) db(u): 0 i hv t + av x + v xx We kw that v(t X(t)) is a martigale, s the itegral R t 0 fr all t. This implies that the itegrad is zer hece v t + av x + v xx =0: du must be zer Thus by tw differet argumets, e based the Klmgrv backward equati, ad the ther based Itô s frmula, we have cme t the same cclusi. Therem 5.5 (Feyma-Kac) Defie v(t x) =IE t x h(x(t )) 0 t T where The dx(t) = a(x(t)) dt + (X(t)) db(t): v t (t x) +a(x)v x (t x) + (x)v xx (t x) =0 (FK) ad v(t x)=h(x): The Black-Schles equati is a special case f this therem, as we shw i the ext secti. Remark 6. (Derivati f KBE) We pluked dw the Klmgrv backward equati withut ay justificati. I fact, e ca use Itô s frmula t prve the Feyma-Kac Therem, ad use the Feyma-Kac Therem t derive the Klmgrv backward equati. 6.6 Black-Schles Csider the SDE With iitial cditi the sluti is ds(t) = rs(t) dt + S(t) db(t): S(t) =x S(u) =x exp (B(u) B(t)) + (r )(u t) u t:

84 Defie v(t x) =IE t x h(s(t )) = IEh x exp (B(T ) B(t)) + (r )(T t) where h is a fucti t be specified later. Recall the Idepedece Lemma: IfG is a -field, X is G-measurable, ad Y is idepedet f G, the IE h(x Y ) G = (X) where (x) =IEh(x Y ): With gemetric Brwia mti, fr 0 t T, we have We thus have S(t) =S(0) exp B(t) +(r )t S(T )=S(0) exp B(T )+(r )T = S(t) exp (B(T ) B(t)) + (r {z} )(T t) {z } F(t)-measurable idepedet f F (t) where S(T )=XY Nw X = S(t) Y =exp (B(T ) B(t)) + (r )(T t) : IEh(xY )=v(t x): The idepedece lemma implies IE h(s(t )) F (t) = IE [h(xy )jf(t)] = v(t X) = v(t S(t)):

CHAPTER 6. Markv prcesses ad the Klmgrv equatis 85 We have shw that v(t S(t)) = IE h(s(t )) F(t) 0 t T: Nte that the radm variable h(s(t )) whse cditial expectati is beig cmputed des t deped t. Because f this, the twer prperty implies that v(t S(t)) 0 t T, is a martigale: Fr 0 s t T, IE v(t S(t)) F(s) = IE IE h(s(t )) F (t) F(s) = IE h(s(t )) F(s) = v(s S(s)): This is a special case f Therem 5.5. Because v(t S(t)) is a martigale, the sum f the dt terms i dv(t S(t)) must be 0. By Itô s frmula, h i v t (t S(t)) dt + rs(t)v x (t S(t)) + S (t)v xx (t S(t)) dt dv(t S(t)) = This leads us t the equati + S(t)v x (t S(t)) db(t): v t (t x) +rxv x (t x) + x v xx (t x) =0 0 t<t x 0: This is a special case f Therem 5.5 (Feyma-Kac). Alg with the abve partial differetial equati, we have the termial cditi v(t x)=h(x) x 0: Furthermre, if S(t) = 0fr sme t [0 T], the als S(T ) = 0. This gives us the budary cditi v(t 0) = h(0) 0 t T: Fially, we shall evetually see that the value at time t f a ctiget claim payig h(s(t )) is at time t if S(t) =x. Therefre, u(t x) =e r(t t) IE t x h(s(t )) = e r(t t) v(t x) v(t x) =e r(t t) u(t x) v t (t x) =re r(t t) u(t x) +e r(t t) u t (t x) v x (t x) =e r(t t) u x (t x) v xx (t x) =e r(t t) u xx (t x):

86 Pluggig these frmulas it the partial differetial equati fr v ad cacellig the e r(t t) appearig i every term, we btai the Black-Schles partial differetial equati: ru(t x) +u t (t x) +rxu x (t x) + x u xx (t x) =0 0 t<t x 0: (BS) Cmpare this with the earlier derivati f the Black-Schles PDE i Secti 5.6. I terms f the trasiti desity ( p(t T x y) = y p (T t) exp y ) (T t) lg x (r )(T t) fr gemetric Brwia mti (See Example 6.4), we have the stchastic represetati u(t x) =e r(t t) IE t x h(s(t )) = e r(t t) h(y)p(t T x y) dy: 0 (SR) I the case f a call, h(y) =(y K) + ad u(t x) =xn p T t x lg K + r(t t) + (T t) e r(t t) KN p x lg T t K + r(t t) (T t) Eve if h(y) is sme ther fucti (e.g., h(y) =(K y) +, a put), u(t x) is still give by ad satisfies the Black-Schles PDE (BS) derived abve. 6.7 Black-Schles with price-depedet vlatility ds(t) =rs(t) dt + (S(t)) db(t) v(t x) =e r(t t) IE t x (S(T ) K) + : The Feyma-Kac Therem w implies that rv(t x)+v t (t x) +rxv x (t x) + (x)v xx (t x) =0 0 t<t x>0: v als satisfies the termial cditi v(t x)=(x K) + x 0

CHAPTER 6. Markv prcesses ad the Klmgrv equatis 87 ad the budary cditi v(t 0) = 0 0 t T: A example f such a prcess is the fllwig frm J.C. Cx, Ntes ptis pricig I: Cstat elasticity f variace diffusis, Wrkig Paper, Stafrd Uiversity, 975: ds(t) =rs(t) dt + S (t) db(t) where 0 <. The vlatility S (t) decreases with icreasig stck price. The crrespdig Black-Schles equati is rv + v t + rxv x + x v xx =0 0 t<t x>0 v(t 0) = 0 0 t T v(t x)=(x K) + x 0: