Stochastic Integration and Ito s Formula

Size: px
Start display at page:

Download "Stochastic Integration and Ito s Formula"

Transcription

1 CHAPTER 3 Stochastic Itegratio ad Ito s Formula I this chapter we discuss Itô s theory of stochastic itegratio. This is a vast subject. However, our goal is rather modest: we will develop this theory oly geerally eough for later applicatios. We will discuss stochastic itegrals with respect to a Browia motio ad more geerally with respect to a cotiuous local martigale. Istead of attemptig to describe the largest possible class of itegrad processes, we will oly sigle out a class of itegrad processes sufficietly large for our later applicatios. For example, i the case of a cotiuous local martigale as a itegrator, we oly restrict ourselves to cotiuous adapted itegrad processes, a class of processes sufficietly large for most applicatios. This of course does ot mea that itegrads which are ot cotiuous caot be itegrated with respect to a cotiuous martigale. It is usually the case that whe dealig with a discotiuous itegrad, we ca quickly decide the ad there whether the itegral has a meaig. Sice may excellet textbooks o stochastic itegratio are available (McKea [8, Ikeda ad Wataabe [6, Chug ad Williams [3, Oksedal [1, Karatzas ad Shreve [7, to cite just a few), there is little motivatio o the part of the author to go beyod what will be preseted i this chapter. 1. Itroductio If A is a process of bouded variatio ad f : R R is fuctio such that s f (s, ω) is Borel measurable fuctio, the f (s) da s ca be iterpreted as a pathwise itegral if proper itegrability coditios are assumed ad its value at ω Ω is the usual Lebesques Stieljes itegral f (s, ω) da s (ω). I theoretical ad applied problems, there is a obvious eed to make sese out of a itegral of the form f (s) db s, where B is a Browia motio. As we kow, Browia motio sample paths are ot fuctios of bouded variatio (see REMARK 7.2). For this 43

2 44 3. STOCHASTIC INTEGRATION AND ITO S FORMULA reaso i geeral there is o easy ad direct pathwise iterpretatio of the above itegral. However, i some special situatio, a simple iterpretatio is possible. For example, if s f (s, ω) itself has bouded variatio for each ω, we ca defie the above itegral by itegratio by parts: f (s) db s = f (t)b t B s d f (s). Such stochastic itegrals are rather limited i its scope of applicatio. Itô s theory of stochastic itegratio greatly expads the class of itegrad processes, thus makig the theory ito a powerful tool i pure ad applied mathematics. We first defie the itegratio of a step (ad determiistic) process with respect to a Browia motio. Let : = t < t 1 < t = t be a partitio of [, t. If f is a step process: f (s) = f j 1, t j 1 t < t j, the the atural defiitio of its stochastic itegral with respect to Browia motio B is 1 [ f (s) db s = f j 1 B tj B tj 1. Usig the property of idepedet icremets for Browia motio, its secod momet is give by [ 2 [ (Bti ) ( ) E f (s) db s = f i1 f j 1 E B ti 1 B tj B tj 1 This gives (1.1) E 1 = = f (s) db s 2 = i, If f ad g are two step fuctios, the E f (s) db s f j 1 2 E [ ( B tj B tj 1 f j 1 2 ( t j t j 1 ). ) 2 f j 1 2 (t j t j 1 ) = f (s) 2 ds. g(s) db s 2 = f (s) g(s) 2 ds = f g 2 2. For a arbitrary fuctio f : [, t R, it is ow clear that as log as there is a sequece of step fuctios f such that f f 2, we ca defie

3 the stochastic itegral as the limit f (s) db s = lim 1. INTRODUCTION 45 f (s) db s. It is well kow from real aalysis that this approximatio property is shared by all Borel measurable fuctios f such that f 2 <. We have thus greatly elarged the space of determiistic fuctios which ca be itegrated with respect to a Browia motio. The key observatio i Itô s theory of stochastic itegratio is that we ca pass to a radom step process as log as f j F tj. Note that ow the itegrad has the form f (s) = f j 1, t j 1 s < t j, f j 1 F tj 1, Namely, i the time iterval [t j 1, t j, the itegrad is measurable with respect to the σ-algebra at the left edpoit of the time iterval. For this reaso above argumet still applies as log as we replace the equality (1.1) by the more geeral equality E 1 f (s) db s 2 = E f j 1 2 (t j t j 1 ) = E f (s) 2 ds. The key step i establishig this equality is the vaishig of the off diagoal term [ E f i 1 f j 1 (B ti B ti1 )(B tj B tj 1 ) =. This holds because if i < j, the by coditioig o F tj 1, we have [ E f i 1 f j 1 (B ti B ti1 )(B tj B tj 1 ) F tj 1 = f i 1 f j 1 (B ti B ti1 )E [B tj B tj 1 F tj 1 =. For the diagoal term, by coditioig o F tj 1 agai, we have E [ f i 1 2 (B ti B ti 1 ) 2 = E f i 1 2 (t i t i 1 ). A importat property of stochastic itegrals is that M t = f (s) db s is a cotiuous martigale. Let us see why this is so if the itegrad process is a step process We ca write f (s) = f j 1, t j 1 < s t j, f j 1 L 2 (Ω, F tj 1, P). M t = f (s) db s = f j 1 (Bt j t B tj 1 t ).

4 46 3. STOCHASTIC INTEGRATION AND ITO S FORMULA Note that sum has oly fiitely may terms for each fixed t. The process M has cotiuous sample paths because Browia motio does. Suppose that s < t. If s ad t are ot amog the poits t j we may simply isert them ito the sequece. Now s ad t are amog the sequece we have M t M s = s t j 1 t ( ) f j 1 B tj B tj 1. The geeral term i the sum vaishes after we coditio it o F tj 1, hece it also vaishes after we coditio o F s because F s F tj 1. It follows that E [M t M s F s = ad M t is a cotiuous martigale. We ow calculate the quadratic variatio process for the cotiuous martigale We claim that M t = M, M t = f (s) db s. f (s) 2 ds. We agai verify this for a step process f. As before, we assume that s < t are amog the poits t j. We have M 2 t M 2 s = f i 1 f j 1 (B ti B ti 1 )(B tj B tj 1 ), where the sum is over those i ad j such that t i t, t j t ad at least oe of t i 1 ad t j 1 is greater or equal o s. For a off-diagoal term, say, i < j, the term vaishes after coditioig o F tj 1, hece also vaishes after coditioig o F s. For a diagoal term i = j, sice t j 1 s, by first coditioig o F tj 1 ad the coditioig o F s we have E [ f j 1 2 (B tj B tj 1 ) 2 F s = E [ f j 1 2 (t j t j 1 ) F s. It follows that This shows that is a martigale. E [ [ Mt 2 Ms 2 F s = E f (s) 2 ds F s. Mt 2 f (s) 2 ds s

5 2. STOCHASTIC INTEGRALS WITH RESPECT TO BROWNIAN MOTION Stochastic itegrals with respect to Browia motio The geeral settig is as follow. We have a Browia motio B with respect to a filtratio F defied o a filtered probability space (Ω, F, P). We assume that the filtratio F satisfies the usual coditios. DEFINITION 2.1. A real-valued fuctio f : R + Ω R is called a step process if there exists a odecreasig sequece = t < t 1 < t 2 < icreasig to ifiity ad a sequece of square-itegrable radom variables f j 1 F tj 1 such that f t = f j 1, t j 1 t < t j. The space of step processes is deoted by S. The space of step processes o [, t is deoted by S t. Note that o a iterval [t j 1, t j ) where f is costat, it is measurable with respect to the σ-algebra o the left edpoit of the iterval, i.e., f = f j 1 F tj 1. Let f be a step process as above. The stochastic itegral of f with respect to Browia motio B is the process I( f ) t = f (s) db s = ) f j 1 (B tj t B tj 1 t. Of course this is a fiite sum for each fixed t. If t i t < t i+1, the I( f ) t = i f j 1 (B tj B tj 1 ) + f i (B t B ti ). It is easy to see that the defiitio of I( f ) t is idepedet of the partitio { tj }. As we have show i the last sectio I( f ) is a cotiuous martigale with the quadratic variatio I particular we have I( f ), I( f ) t = f (s) 2 ds. [ E I( f ) t 2 = E f (s) 2 ds. This relatio allows us to exted the defiitio of stochastic itegrals to more geeral itegrads by a limit procedure. Sice the quadratic variatio process of a Browia motio correspods to the Lebesgue measure o R +, a very wide class of processes ca be used as itegrad processes. DEFINITION 2.2. A fuctio f : R + Ω R is called progressively measurable with respect to the filtratio F if for each fixed t the restrictio f : [, t Ω R is measurable with respect to the product σ-algebra B[, t F t.

6 48 3. STOCHASTIC INTEGRATION AND ITO S FORMULA EXAMPLE 2.3. Here are some examples of progressively measurable processes: (1) A step process is progressively measurable. (2) A cotiuous ad adapted process is progressively measurable. (3) Let τ be a fiite stoppig time. The the process f (t, ω) = I [,τ(ω) (s) is progressively measurable. For a discrete τ, this ca be verified directly. For a geeral τ, let τ = ([2 τ + 1)/2. The τ τ ad I [,τ (ω)(s) I [,τ(ω) (s) for all (s, ω) R + Ω. For a progressively measurable process f, we defie for each fixed T, [ T f 2 2,T = E f (s) 2 ds. The progressive measurability assures that the itegral o the right side has a meaig. We use LT 2 to deote the space of progressively measurable processes f o [, T Ω with f 2,T <. The orm 2,T makes LT 2 ito a complete Hilbert space. We use L 2 to deote the space of progressively measurable processes f such that f 2,T is fiite for all T. It ca be made ito a metric space by itroducig the distace fuctio d( f, g) = =1 f g 2, 1 + f g 2,. Note that S T L 2 ad S L 2, ad there is a obvious restrictio map L 2 Lt 2. We ow show how to defie the stochastic itegral I( f ) t = f (s) db s for every process i L 2. We eed the followig approximatio result. LEMMA 2.4. S T is dese i LT 2. I other words, for ay square itegrable progressively measurable process f LT 2, there exists a sequece { f } of step processes such that f f 2,T. PROOF. First ote that the set of uiformly bouded elemets i LT 2 is dese. Suppose that f is a progressively measurable process uiformly bouded o [, T Ω. Defie f h (t, ω) = 1 h t h f (s, ω) ds. Each f h is cotiuous ad adapted. From real aalysis we also kow that T lim h f h (t, ω) f (t, ω) 2 ds =.

7 2. STOCHASTIC INTEGRALS WITH RESPECT TO BROWNIAN MOTION 49 It follows that f h f 2,T as h. This shows that the set of uiformly bouded cotiuous ad adapted processes is dese i LT 2. Fially for a cotiuous, adapted, ad uiformly bouded process f o [, T we defie ( j 1 f (t) = f ), j 1 t < j. Each f S T ad f (t, ω) f (t, ω) for all (t, ω) [, T Ω by cotiuity. Hece f f 2,T by the domiated covergece theorem. The lemma is proved. We are ow ready to defie the stochastic itegral of a progressively measurable ad square itegrable process with respect to a Browia motio. Suppose that f L 2. By restrictig to [, t we ca regard it as a elemet i Lt 2 for ay t. Let f be a sequece of step processes o [, T such that f f 2,T. The stochastic itegral I( f ) t is well defied for t T as a Riemaa sum ad is a square itegrable martigale. We have I( f m ) t I( f ) t = [ f m (s) f (s) db s. By Doob s martigale iequality, [ E max I( f m) t I( f ) t 2 4E I( f m f ) T 2 t T [ T = 4E f m (s) f (s) 2 ds = 4 f m f 2 2,T. This shows that I( f ) t is a Cauchy sequece i L 2 (Ω, P). By the completeess of L 2 (Ω, P), the limit I( f ) t = lim I( f ) t exists ad we defie f (s) db s = lim f (s) db s. Sice f f 2,T1 implies f f 2,T2 for T 2 T 1, it is easy to see that I( f ) t thus defied is idepedet of T ad the choice of the approximatig sequece { f }. We have oly defied {I( f ) t, t } as a collectio of radom variables. We ca do more. THEOREM 2.5. Suppose that f L 2 is a square itegrable, progressively measurable process. The the stochastic itegral I( f ) t = f (s) db s is a cotiuous martigale. Its quadratic variatio process is I( f ), I( f ) t = f (s) 2 ds.

8 5 3. STOCHASTIC INTEGRATION AND ITO S FORMULA PROOF. The martigale property of I( f ) is iherited from the same property of I( f ) because this property is preserved whe passig to the limit i L 2 (Ω, F, P) as. We show that it has cotiuous sample paths. From [ E max I( f m) t I( f ) t 2 4 f m f 2 2,T t T we have by Chebyshev s iequality, [ P max I( f m) t I( f ) t ɛ 4 t T ɛ 2 f m f 2 2,t. Sice f m f 2,T as m,, by choosig a subsequece if ecessary, we may assume that f f +1 2,T 1/ 3, hece { P max I( f ) t I( f +1 ) t 1 } t T By the Borel Catelli lemma, there is a set Ω with P {Ω } = 1 with the followig property: for ay ω Ω, there is a (ω) such that max t T I( f ) t (ω) I( f +1 ) t (ω) 1 2 for all (ω). It follows that I( f ) t (ω) coverges uiformly o [, T. Sice each I( f ) t (ω) is cotiuous i t, the limit, which ecessarily coicide with I( f ) t (ω) with probability 1 for all t, must also be cotiuous. We therefore have show that the stochastic itegral I( f ) t has a versio with cotiuous sample paths. We have show before that for the step process f the process I( f ) 2 t f (s) 2 ds is a martigale. For each fixed t, as, the above radom variable coverges i L 1 (Ω, P) to I( f ) 2 t f (s) 2 ds. Therefore the martigale property ca be passed to the limitig process, which idetifies the quadratic variatio process of the stochastic itegral as stated i the propositio. COROLLARY 2.6. Suppose that f, g L 2. The I( f ), I(g) t = PROOF. This follows from the equality f (s)g(s) ds. M, N t = M + N, M + N t M N, M N t 4 for two cotiuous martigales M ad N.

9 2. STOCHASTIC INTEGRALS WITH RESPECT TO BROWNIAN MOTION 51 If Z F s, we have Z f u db u = Z f u db u. s s This ca be cosidered to be self-evidet, eve though it requires a approximatio argumet to verify. The same remark ca be said of the idetity s f u db u = s f u db u f u db u. Either we defie the left side by the right side or we cosider the left side as the stochastic itegral with respect to {B s+u, u }, which is a Browia motio with respect to the filtratio F s+ = {F s+u, u }, the ed result is the same. However, if we replace s or t by a radom time, the meaig of the two ad other similar equalities may become ambiguous, especially whe the radom time is ot a stoppig time. I this respect, if we restrict ourselves to stoppig times, the followig results may help us clarify the situatio. PROPOSITION 2.7. Suppose that f LT 2 (1) We have ad τ T a stoppig time. τ f s db s = T I [,τ (s) f s db s. (2) If Z F τ is a bouded bouded radom variable, the T T Z f db s = ZI [τ, ) (s) f s db s. τ PROOF. We will verify the equalities for discrete stoppig times ad step processes. I geeral we ca approximate the stoppig times σ ad τ by discrete stoppig times from above ad the itegrad process f by step processes i the 2,T orm. The equalities are clearly preserved whe passig to the limit uder such approximatios. Let = t < t 1 < < t = T be a partitio such that f = f j 1 F tj 1 for t j 1 t < t j ad τ takes values oly i the sequece { t j }.

10 52 3. STOCHASTIC INTEGRATION AND ITO S FORMULA (1) Note that I {s<τ} is a step process. We have I( f ) τ = = = = = I {τ=ti } T I {τ=tj} i f s db s i f j 1 (B tj B tj 1 ) f j 1 (B tj B tj 1 ) I {τ=ti } i=j I {tj 1 <τ} f j 1(B tj B tj 1 ) I [,τ) (s) f s db s. (2) Note that ZI {τ s} is a step process ad belogs to F s for fixed s. We have T i Z f s db s Z ZI {τ=ti } f s db s σ = = = = T I {τ=ti } Z f j 1 (B tj B tj 1 ) j=i+1 j 1 Z f j 1 (B tj B tj 1 ) I {τ=ti } ZI {τ tj 1} f j 1(B tj B tj 1 ) ZI [τ, ) (s) f s db s. EXAMPLE 2.8. Cosider the stochastic itegral B s db s = lim B tj 1 (B tj B tj 1 ). Usig the idetity 2a(b a) = b 2 a 2 + (b a) 2 we have 2 B tj 1 (B tj B tj 1 ) = B 2 t + (B tj B tj 1 ) 2. The last sum coverges to the quadratic variatio B, B t = t. Hece we have 2 B s db s = Bt 2 t, which is ideed a martigale.

11 3. EXTENSION TO MORE GENERAL INTEGRANDS 53 EXAMPLE 2.9. Oe may woder what will happe if i the approximatig sum of a stochastic itegral we do ot take the value of the itegrad at the left edpoit of a partitio iterval. For example, what is the sum B tj (B tj B tj 1 )? This is ot hard to figure out. The differece betwee this sum ad the usual sum takig the left edpoit value of the itegrad is just the quadratic variatio alog the partitio hece we ave lim (B tj B tj 1 ) 2, B tj (B tj B tj 1 ) = B s db s + t. This example shows where to take the value of the itegrad o each partitio iterval really matters. 3. Extesio to more geeral itegrads We have defied stochastic itegral with respect to a Browia motio for itegrad process f L 2. These are progressively measurable processes f such that [ E fs 2 ds < for all t. This itegrability is too restrictive. Without too much effort we ca defie a much wider class of itegrad processes. DEFINITION 3.1. We use L 2 to deote the space of progressively measurable processes f such that [ P fs 2 ds < = 1 for all t. This is a class of process wider tha L 2 ad is sufficiet for our applicatios. For example, all adapted cotiuous processes belog to Lloc 2. We will exted the defiitio of stochastic itegrals to processes i Lloc 2. The resultig stochastic itegral process is o loger a square itegrable martigale but a local martigale. Recall the defiitio of a local martigale. DEFINITION 3.2. We say that M = {M t, t } is a local martigale if there exists a sequece of stoppig times τ such that the stopped processes M τ = {M t τ, t } are martigales.

12 54 3. STOCHASTIC INTEGRATION AND ITO S FORMULA For cotiuous local martigale M with M =, we ca always take τ = if {t : M t }. Suppose that f Lloc 2. Defie the stoppig time { } τ = if t > : f (s) 2 ds. the assumptio that f L 2 loc implies that τ (with probability oe, if oe wats to be very precise). Now cosider the process f (s) = f (s)i {s τ }. It is clear that f L 2, i fact f 2,T for all T. The stochastic itegral I( f ) is well-defied ad is a square itegrable cotiuous martigale. We ow defie the stochastic itegral I( f ) t as follows: I( f ) t = I( f ) t, t τ. I order that this defiitio make sese, we have to verify the cosistecy: if m, the I( f ) t = I( f m ) t, t τ m. This is immediate. Ideed, I( f ) t τm = From defiitio we have f I {s τm } db s = I( f ) t τ = I( f ) t, f m db s = I( f m ) t. which shows that I( f ) is a cotiuous local martigale. [ EXAMPLE 3.3. The process Be B2 L 2 because E B t 2 e B2 t is ifiite for t 1/2. However, sice it is cotiuous it belogs to Lloc 2 ad its stochastic itegral with respect to Browia motio is well defied. I fact, Itô s formula will show that [ 2 B s e B2 s db s = e B2 t 1 + 2B 2 s e Bs 2 ds. 4. Stochastic itegratio with respect to cotiuous local martigales We have discussed stochastic itegratio with respect to Browia motio so that oly the martigale properties of Browia motio is used. For this reaso ot much eeds to be chaged if we replace Browia motio by a geeral cotiuous martigale. All we eed to do is to replace the quadratic variatio process of Browia motio B, B t = t by M.M t, which is a cotiuous icreasig process. More specifically, the theory of stochastic itegratio with respect to Browia motio is based o several properties of Browia motio: (1) B is a cotiuous square itegrable martigale; (2) The quadratic variatio process is B, B t = t.

13 4. STOCHASTIC INTEGRATION WITH RESPECT TO CONTINUOUS LOCAL MARTINGALES55 (3) If f is a step process, the [ ( ) 2 [ E f db s = E f s 2 ds. (4) The space of step processes S T is dese i the space of progressively measurable ad square itegrable processes LT 2. For a theory of stochastic itegratio with respect to a geeral cotiuous martigale M, we make the followig observatios: (1) By the usual stoppig time argumet, we ca restrict ourselves iitially to uiformly bouded cotiuous martigales. (2) The quadratic variatio process M, M t is cotiuous, adapted, ad icreasig. Therefore itegratio of a progressively measurable process with respect to M, M is well defied. (3) For a bouded step process f we have 2 [ E f s dm s = E f 2 s d M, M s. (4) We ca itroduce the orm [ f 2,T;M = E fs 2 d M, M s. There does ot seem to be a good descriptio of the closure of the space of S T uder this orm that is good for all M, but at least all progressively measurable ad cotiuous processes with fiite orm ca be approximated by step processes. It is also possible develop a theory of stochastic itegratio with respect to a geeral, ot ecessarily cotiuous martigale. Sice we will mostly oly deal with cotiuous martigales, we will restrict ourselves to cotiuous local martigales. Suppose that M is a cotiuous local martigale ad f S is a step process. The stochastic itegral of f with respect to the martigale M is I( f ) t = f dm s = j f j 1 (M tj 1 t M tj t Just as i the case of Browia motio we have 2 [ E f s dm s = E f s 2 d M, M. Let L 2 (M) be the space of progressively measurable processes f such that [ T f 2 2,T;M = E f s 2 d M, M s < for all t. It ca be show that S T is dese i L 2 (M) T (see Karatzas ad Shreve [7). Thus by the usual approximatio argumet, we see that ).

14 56 3. STOCHASTIC INTEGRATION AND ITO S FORMULA the stochastic itegral I( f ) t = f s dm s is well defied for all f L 2 (M) ad the quadratic variatio process is I( f ), I( f ) t = f s 2 d M, M s. Although it is ot easy to fid a good descriptio of L 2 (M) that fits all cotiuous martigales, it does cotai all cotiuous adapted processes such that f 2,T;M is fiite for all T. By the stadard stoppig time argumet we have used i the case of Browia motio, the stochastic itegral I( f ) t = f s dm s ca be defied for a cotiuous local martigale M ad a progressively measurable process f such that [ P f s 2 d M, M s < = 1 for all t. Uder these coditios, the stochastic itegral I( f ) is a cotiuous local martigale. EXAMPLE 4.1. Let M be a uiformly bouded cotiuous martigale. As i the case of Browia motio we have M 2 t M 2 = 2 M tj 1 (M tj M tj 1 ) + (M tj M tj 1 ) 2. The sum after the equal sig coverges to the stochastic itegral M s dm s. Therefore the secod sum must also coverge. It is clear that the limit of the secod sum is a cotiuous, icreasig, ad adapted process. Hece by the Doob-Meyer decompositio theorem, the limit must be the quadratic variatio process, i.e., ad lim (M tj M tj 1 ) 2 = M, M t Mt 2 = M M s dm s + M, M t. The covergece of the quadratic variatio process takes place i L 2 (Ω, P). For a geeral local martigale, it ca be show by routie argumet that the covergece takes place at least i probability.

15 5. ITÔ S FORMULA Itô s formula Itô s formula is the fudametal theorem for stochastic calculus. Let us recall that the fudametal theorem of calculus states that if F is a cotiuously differetiable fuctio the F(t) F() = F (s) ds. Let = t < t 1 < < t = t be a partitio of the iterval [a, b. We have F(t) F() = [ F(tj ) F(t j 1 ). Sice F is cotiuous, by the mea value theorem, there is a poit ξ i [t j 1, t j such that F(t j ) F(t j 1 ) = F(ξ j )(t j t j 1 ). Hece, by the defiitio of Riema itegrals we have as, F(b) F(a) = F (ξ j )(t j t j 1 ) F (s) ds. What happes to this proof if we replace t by B t. I this case ξ j will be a poit betwee B tj 1 ad B tj. We have to deal with the sum F (ξ j )(B tj B tj 1 ). Here the argumet has to depart from what we have doe above. As EX- AMPLE 2.9 shows, the place where we take the value of the itegrad o each partitio iterval ca chage the limit of the Riema sum. Therefore we should ot expect that the above sum will coverges to the stochastic itegral F (B s ) db s, for which the left edpoit value of the itegrad is used i each partitio iterval. The method to remedy this situatio is to take oe more term of the Taylor expasio F(B tj ) F(B tj 1 ) = F (B tj 1 )(B tj B tj 1 ) F (ξ j )(B tj B tj 1 ) 2. The sum of the first term o the right side will coverge to the stochastic itegral as usual. The crucial observatio is that because Browia motio has fiite quadratic variatio, the sum of the secod term o the right side F (ξ j )(B tj B tj 1 ) 2 F (B s ) ds as. The fial result is the well kow Itô s formula F(B t ) = F(B ) + F (B s ) db s F (B s ) ds.

16 58 3. STOCHASTIC INTEGRATION AND ITO S FORMULA O the right side, the first term is a cotiuous martigale, ad the secod term is a process of bouded variatio. Thus if F is cotiuous ad uiformly bouded together with its first ad secod derivatives, the the compositio F(B t ) is a semimartigale ad Itô s formula gives a explicit expressio for its Doob-Meyer decompositio. The proof of Itô s formula for for a geeral semimartigale Z will ot be a lot more difficult tha the case of Browia motio. For this reaso, i this sectio we will prove it i this geerality. THEOREM 5.1. Suppose that F C 2 (R) ad Z is a semimartigale. The (5.1) F(Z t ) = F(Z ) + F (Z s ) dz s + 1 F (Z s ) d Z, Z s. 2 Recall that a semimartigale has the form Z t = M t + A t, where M is a local martigale ad A a process of bouded variatio. We first use a stoppig time argumet to reduce the proof to the case where Z, M, M, M, ad A are all uiformly bouded ad F together with its first ad secod derivatives are uiformly bouded ad uiformly cotiuous. First of all, let Ω N = { Z N} ad defie P N (C) = P(C Ω N). P(Ω ) It is clear that uder the P N, the process Z is still a semimartigale with the same decompositio Z = M + A ad P N { Z N} = 1, i.e., Z is bouded. Next, defie the stoppig time τ N = if {t : M t M + M, M t + A t N}. The stopped processes Z τ N = M τ N + A τ N ad M τ N, M τ N t = M, M τ N t have the bouded properties we desired. Defie a fuctio F N C 2 (R) such that it coicides with F o [ 2N, 2N ad vaishes outside [ 3N, 3N. O the probability space (Ω N, F Ω N, P N ) suppose that we have the formula F N (Z τ N ) = F N (Z τ N ) + F N(Z τ N s ) dz s Replacig t there by t τ N we see that F(Z t τn ) = F(Z ) + τn F (Z s ) dz s F N(Z τ N s ) d Z τ N, Z τ N s. τn F (Z s ) d Z, Z s. Here we have used the defiitio of stochastic itegral with respect to a local martigale. This shows that the formula (5.1) holds o Ω N ad t < τ N. Fially from P {Ω N } 1 ad P {τ N } = 1, we see that Itô s formula holds without ay extra coditios.

17 5. ITÔ S FORMULA 59 After these reductios, we start the proof of Itô s formula itself. By Taylor s formula with remaider we have F(Z tj ) F(Z tj 1 ) = F (Z tj 1 )(Z tj Z tj 1 ) F (ξ i )(Z tj Z tj 1 ) 2, where ξ is a poit betwee Z tj 1 ad Z tj. For simplicity let us deote Z j = Z tj Z tj 1, M j = M tj M tj 1, M j = M tj M tj 1. With these otatios we ca write F(Z t ) F(Z ) = F (Z tj 1 ) Z j F (ξ i )( Z j ) 2. The first sum coverges to the stochastic itegral i L 2 (Ω, P): F (Z tj 1 ) Z j The real work starts with the proof of (5.2) F (ξ i )( Z j ) 2 F (Z s ) dz s. F (Z s ) d Z, Z s. We will prove this through a series of three replacemets F (ξ i )( Z j ) 2 F (ξ i )( M j ) 2 F (Z tj 1 )( M j ) 2 F (Z tj 1 ) M j. We will show that each replacemet produces a error which will vaish i probability as the mesh of the partitio. After these replacemets we will have F (Z tj 1 ) M j F (Z s ) d M, M s, which will complete the proof. (1) From ( Z j ) 2 ( M j ) 2 = A j ( Z j + M j ) we have F (ξ i ) { ( Z j ) 2 ( M j ) 2} F A t max 1 i Z j + M j. By sample path cotiuity we have lim max Z j + M j = 1 i almost surely. Hece the error produced by the first replacemet vaishes i probability as. (2) We have [ F (ξ i ) F (Z tj 1 ) ( M j ) 2 max F (ξ i ) F (Z tj 1 ) ( M j ) 2. 1 i

18 6 3. STOCHASTIC INTEGRATION AND ITO S FORMULA Agai by sample path cotiuity we have max F (ξ i ) F (Z tj 1 ) 1 i almost surely. O the other had, by EXAMPLE 4.1, lim ( M j ) 2 = M, M t i L 2 (Ω, P). Therefore the error produced by this replacemet vaishes i probability as. (3) This is the most delicate replacemet of the three. The error is E = F (Z tj 1 ) { ( M j ) 2 } M j. The square E 2 is a sum of 2 terms. From EXAMPLE 4.1 ( M j ) 2 M j = 2 j t j 1 (M s M tj 1 ) dm s. This is a stochastic itegral with respect to a martigale, hece the coditioal expectatio of this expressio with respect to F tj 1 is clearly zero. For a off-diagoal term, say i < j, i E 2, its coditioal expectatio with respect to F tj 1 is therefore zero. Hece all off-diagoal term has expectatio value zero. For the diagoal term we have [ ( tj ) 2 [ j E (M s M tj 1 ) dm s F tj 1 = E (M s M tj 1 ) 2 d M, M s. t j 1 t j 1 Therefore the expected value of this off-diagoal term is bouded by [ F 2 E M j max M s M tj 1. t j 1 s t j Addig the diagoal terms together we obtai [ E E 2 F 2 E M t max max M s M tj 1. t j 1 s t j 1 j Note that uder our assumptio, the expressio uder the expectatio is uiformly bouded. This expectatio coverges to zero by sample path cotiuity ad the domiated covergece theorem. With this fial replacemet, we have completed the proof of (5.2) ad also the proof of Itô s formula. We ed this sectio with the statemet of Itô s formula for multidimesioal semimartigales. The basic igrediets of its proof have already explaied i great detail i the proof of the oe dimesioal case. Sice othig will be leared from its tedious proof, we will justifiably omit it.

19 6. DIFFERENTIAL NOTATION AND STRATONOVICH INTEGRALS 61 THEOREM 5.2. Suppose that Z = (Z 1,..., Z ) be a R valued semimartigale. The for ay F C 2 (R ). F(Z t ) = F(Z ) + F xi (Z s ) dz i s F xi x j (Z s ) d Z i, Z j s. i, 6. Differetial otatio ad Stratoovich itegrals This sectio does ot cotai ew results. We itroduce differetial otatio for stochastic calculus ad Stratoovich itegrals, a form of stochastic itegral more restrictive tha Itô itegrals. We ofte work with the followig classes of processes: M = the space of cotiuous local martigales; A = the space of cotiuous processes of bouded variatio; I = the space of icreasig processes; Q= the space of semimartigales H = the space of itegrad processes. Every process of bouded variatio is the differece of two icreasig processes: A = I I. A semimartigale is the sum of a local cotiuous martigale ad a process of bouded variatio: Q = M + A It is ofte coveiet to write equalities amog these processes i a d- ifferetial form. We have defied the meaig of a expressio such as H s dx s for H H ad X Q. What exactly is the meaig a differetial expressio such as dx? We should cosider dx as a symbol for the equivalece class of semimartigales Y such that X t X s = Y t Y s for all s t. The equivalet classes of semimartigale differetials is deoted by dq. We ca carry out some purely symbolic calculatios. To start with we ca set dx u = X t X s. We ca defie a multiplicatio i Q by settig s dx dy = d X, Y. We also defie the multiplicatio of a elemet from Q by a elemet from H : HdX is the equivalece class cotaiig the semimartigale Here are some properties of these operatios: (1) dq dq da ; (2) dq da = ; (3) H(dX dy) = (H dx) dy; (4) H 1 (H 2 dx) = (H 1 H 2 )dx. H s dx t s.

20 62 3. STOCHASTIC INTEGRATION AND ITO S FORMULA With these formal symbolic otatios, the multi-dimesioal Itô s formula ca be writte as d { f (Z t )} = f xi (Z t ) dzt i f xi x j (Z t ) dx i dx j. i, If we are willig to adopt Eistei s summatio covetio, we may eve drop the two summatio sigs. Suppose that X ad Y are two semimartigales. We defie a ew semimartigale differetial by This meas that X dy = X dy + 1 dx dy. 2 X s dy s = X s dy s X, Y t. This is called the Stratoovich itegral. Ulike Itô itegral, the Stratoovich itegral requires that the itegrad process is also a cotiuous semimartigale, for i its defiitio we eed the quadratic covariatio of X ad Y. I this sese Stratoovich itegral is a weaker form of stochastic itegral ad its use is much more limited tha Itô itegrals. The mai advatage of S- tratoovich itegrals is that Itô s formula takes a form similar to that of the fudametal theorem of calculus. PROPOSITION 6.1. Let F C 3 (R ) ad Z = (Z 1,..., Z ) a -dimesioal semimartigale. The d { f (Z t )} = PROOF. The right side is equal to F xi (Z t ) dzt. i (6.1) F xi (Z t ) dz j t F x i x j (Z t ) dz j t. Usig It&o s formula we have df xi (Z t ) = F xi x j (Z t ) dz i t F x i x j x k (Z t ) dz j dz k. Thus the last term i (6.1) becomes 1 2 F x i x j (Z t ) dz i t dz j t F x i x j x k (Z t ) dz i t dz j t dzk t. The last triple sum is equal to zero because dzt i dzj t dzk t =. Therefore the equality we wated to prove is just Itô s formula. Fially we metio that Stratoovich itegral ca also be approximated by a Riema sums. It is istructive to compare this Riema sum with the oe that approximates the correspodig Itô itegral. The differece is subtle but crucial i makig Itô itegratio such a successful theory.

21 7. THIRD ASSIGNMENT 63 THEOREM 6.2. Let X ad Y be cotiuous semimartigales. The X tj 1 + X tj X s dy s = lim [Y tj Y tj 1, where the covergece is i probability. PROOF. Rewrite the summatio as [ X tj 1 Y tj Y tj [X tj X tj 1 [Y tj Y tj 1. 2 The limit of the first term is the Itô itegral 2 term is exactly the quadratic covariatio X, Y t /2. 7. Third Assigmet X s dy s, that of the secod EXERCISE 3.1. Let f be a (oradom) fuctio of boud variatio. Show that f s db s = f t B t B s d f s, where the last itegral is uderstood to be a Lebesgue-Stieljes itegral. EXERCISE 3.2. Let F be a etire fuctio i the complex plae C ad Z = X + iy be the complex Browia motio (meaig that X ad Y are idepedet stadard Browia motio). We have F (Z s ) dz s = F (Z s ) dz s = F(Z t ) F(Z ). EXERCISE 3.3. The price S t of a stock with average rate of retur µ ad volatility σ is usually described by the stochastic differetial equatio ds t = S t (µ dt + σ db t ). Usig Itô s formula to show that the solutio of the above stochastic differetial equatio is [ ) S t = S exp σb t + (µ σ2 t. 2 EXERCISE 3.4. Let B = (B 1, B 2, B 3 ) be a 3-dimesioal Browia motio which does ot start from zero. Usig Itô s formula to show that 1/ B t is a local martigale. EXERCISE 3.5. Let B be a -dimesioal Browia motio startig from zero ad X t = B t = Bt i 2

22 64 3. STOCHASTIC INTEGRATION AND ITO S FORMULA be the radial process. Show that X satisfies the followig Itô type stochastic differetial equatio: X t = W t + 1 ds, 2 X s where W is a oe-dimesioal Browia motio. EXERCISE 3.6. Let M ad N be two cotiuous local martigales. Show that M, N t M t N t. EXERCISE 3.7. Suppose that X, Y ad Z be three semimartigales. Are the followig relatios true? (1) X(Y dz) = (XY) dz; (2) X (Y Z) = (XY) dz. EXERCISE 3.8. A Browia bridge is defied by dx t = db t X t dt 1 t, X =. Show that X is a Gaussia process with mea zero ad E [X s X t = mi {s, t} st. Show that {X t, t 1} ad the reversed process {X 1 t, t 1} have the same law. EXERCISE 3.9. Suppose that M ad N are two bouded cotiuous martigales which are idepedet. Show that MN is a cotiuous martigale with respect to the filtratio F M,N = σ {M s, N s ; s t} geerated by M ad N. EXERCISE 3.1. Suppose that M is a strictly positive local martigale. Show that there is a local martigale N such that [ M t = M exp N t 1 2 N, N t.

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014. Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Lecture 3 The Lebesgue Integral

Lecture 3 The Lebesgue Integral Lecture 3: The Lebesgue Itegral 1 of 14 Course: Theory of Probability I Term: Fall 2013 Istructor: Gorda Zitkovic Lecture 3 The Lebesgue Itegral The costructio of the itegral Uless expressly specified

More information

Solutions to HW Assignment 1

Solutions to HW Assignment 1 Solutios to HW: 1 Course: Theory of Probability II Page: 1 of 6 Uiversity of Texas at Austi Solutios to HW Assigmet 1 Problem 1.1. Let Ω, F, {F } 0, P) be a filtered probability space ad T a stoppig time.

More information

An alternative proof of a theorem of Aldous. concerning convergence in distribution for martingales.

An alternative proof of a theorem of Aldous. concerning convergence in distribution for martingales. A alterative proof of a theorem of Aldous cocerig covergece i distributio for martigales. Maurizio Pratelli Dipartimeto di Matematica, Uiversità di Pisa. Via Buoarroti 2. I-56127 Pisa, Italy e-mail: pratelli@dm.uipi.it

More information

Math 113, Calculus II Winter 2007 Final Exam Solutions

Math 113, Calculus II Winter 2007 Final Exam Solutions Math, Calculus II Witer 7 Fial Exam Solutios (5 poits) Use the limit defiitio of the defiite itegral ad the sum formulas to compute x x + dx The check your aswer usig the Evaluatio Theorem Solutio: I this

More information

Ma 4121: Introduction to Lebesgue Integration Solutions to Homework Assignment 5

Ma 4121: Introduction to Lebesgue Integration Solutions to Homework Assignment 5 Ma 42: Itroductio to Lebesgue Itegratio Solutios to Homework Assigmet 5 Prof. Wickerhauser Due Thursday, April th, 23 Please retur your solutios to the istructor by the ed of class o the due date. You

More information

Mathematical Methods for Physics and Engineering

Mathematical Methods for Physics and Engineering Mathematical Methods for Physics ad Egieerig Lecture otes Sergei V. Shabaov Departmet of Mathematics, Uiversity of Florida, Gaiesville, FL 326 USA CHAPTER The theory of covergece. Numerical sequeces..

More information

Fall 2013 MTH431/531 Real analysis Section Notes

Fall 2013 MTH431/531 Real analysis Section Notes Fall 013 MTH431/531 Real aalysis Sectio 8.1-8. Notes Yi Su 013.11.1 1. Defiitio of uiform covergece. We look at a sequece of fuctios f (x) ad study the coverget property. Notice we have two parameters

More information

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4. 4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad

More information

Advanced Stochastic Processes.

Advanced Stochastic Processes. Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.

More information

Sequences and Series of Functions

Sequences and Series of Functions Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

More information

1 Approximating Integrals using Taylor Polynomials

1 Approximating Integrals using Taylor Polynomials Seughee Ye Ma 8: Week 7 Nov Week 7 Summary This week, we will lear how we ca approximate itegrals usig Taylor series ad umerical methods. Topics Page Approximatig Itegrals usig Taylor Polyomials. Defiitios................................................

More information

1 Convergence in Probability and the Weak Law of Large Numbers

1 Convergence in Probability and the Weak Law of Large Numbers 36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec

More information

6a Time change b Quadratic variation c Planar Brownian motion d Conformal local martingales e Hints to exercises...

6a Time change b Quadratic variation c Planar Brownian motion d Conformal local martingales e Hints to exercises... Tel Aviv Uiversity, 28 Browia motio 59 6 Time chage 6a Time chage..................... 59 6b Quadratic variatio................. 61 6c Plaar Browia motio.............. 64 6d Coformal local martigales............

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

lim za n n = z lim a n n.

lim za n n = z lim a n n. Lecture 6 Sequeces ad Series Defiitio 1 By a sequece i a set A, we mea a mappig f : N A. It is customary to deote a sequece f by {s } where, s := f(). A sequece {z } of (complex) umbers is said to be coverget

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

A Proof of Birkhoff s Ergodic Theorem

A Proof of Birkhoff s Ergodic Theorem A Proof of Birkhoff s Ergodic Theorem Joseph Hora September 2, 205 Itroductio I Fall 203, I was learig the basics of ergodic theory, ad I came across this theorem. Oe of my supervisors, Athoy Quas, showed

More information

The Boolean Ring of Intervals

The Boolean Ring of Intervals MATH 532 Lebesgue Measure Dr. Neal, WKU We ow shall apply the results obtaied about outer measure to the legth measure o the real lie. Throughout, our space X will be the set of real umbers R. Whe ecessary,

More information

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3 MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

Notes 27 : Brownian motion: path properties

Notes 27 : Brownian motion: path properties Notes 27 : Browia motio: path properties Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces:[Dur10, Sectio 8.1], [MP10, Sectio 1.1, 1.2, 1.3]. Recall: DEF 27.1 (Covariace) Let X = (X

More information

Integrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number

Integrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number MATH 532 Itegrable Fuctios Dr. Neal, WKU We ow shall defie what it meas for a measurable fuctio to be itegrable, show that all itegral properties of simple fuctios still hold, ad the give some coditios

More information

1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series.

1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series. .3 Covergece Theorems of Fourier Series I this sectio, we preset the covergece of Fourier series. A ifiite sum is, by defiitio, a limit of partial sums, that is, a cos( kx) b si( kx) lim a cos( kx) b si(

More information

If a subset E of R contains no open interval, is it of zero measure? For instance, is the set of irrationals in [0, 1] is of measure zero?

If a subset E of R contains no open interval, is it of zero measure? For instance, is the set of irrationals in [0, 1] is of measure zero? 2 Lebesgue Measure I Chapter 1 we defied the cocept of a set of measure zero, ad we have observed that every coutable set is of measure zero. Here are some atural questios: If a subset E of R cotais a

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 6 9/23/203 Browia motio. Itroductio Cotet.. A heuristic costructio of a Browia motio from a radom walk. 2. Defiitio ad basic properties

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

Singular Continuous Measures by Michael Pejic 5/14/10

Singular Continuous Measures by Michael Pejic 5/14/10 Sigular Cotiuous Measures by Michael Peic 5/4/0 Prelimiaries Give a set X, a σ-algebra o X is a collectio of subsets of X that cotais X ad ad is closed uder complemetatio ad coutable uios hece, coutable

More information

Math 2784 (or 2794W) University of Connecticut

Math 2784 (or 2794W) University of Connecticut ORDERS OF GROWTH PAT SMITH Math 2784 (or 2794W) Uiversity of Coecticut Date: Mar. 2, 22. ORDERS OF GROWTH. Itroductio Gaiig a ituitive feel for the relative growth of fuctios is importat if you really

More information

PRELIM PROBLEM SOLUTIONS

PRELIM PROBLEM SOLUTIONS PRELIM PROBLEM SOLUTIONS THE GRAD STUDENTS + KEN Cotets. Complex Aalysis Practice Problems 2. 2. Real Aalysis Practice Problems 2. 4 3. Algebra Practice Problems 2. 8. Complex Aalysis Practice Problems

More information

Lecture Notes for Analysis Class

Lecture Notes for Analysis Class Lecture Notes for Aalysis Class Topological Spaces A topology for a set X is a collectio T of subsets of X such that: (a) X ad the empty set are i T (b) Uios of elemets of T are i T (c) Fiite itersectios

More information

b i u x i U a i j u x i u x j

b i u x i U a i j u x i u x j M ath 5 2 7 Fall 2 0 0 9 L ecture 1 9 N ov. 1 6, 2 0 0 9 ) S ecod- Order Elliptic Equatios: Weak S olutios 1. Defiitios. I this ad the followig two lectures we will study the boudary value problem Here

More information

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT TR/46 OCTOBER 974 THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION by A. TALBOT .. Itroductio. A problem i approximatio theory o which I have recetly worked [] required for its solutio a proof that the

More information

MATH4822E FOURIER ANALYSIS AND ITS APPLICATIONS

MATH4822E FOURIER ANALYSIS AND ITS APPLICATIONS MATH48E FOURIER ANALYSIS AND ITS APPLICATIONS 7.. Cesàro summability. 7. Summability methods Arithmetic meas. The followig idea is due to the Italia geometer Eresto Cesàro (859-96). He shows that eve if

More information

Metric Space Properties

Metric Space Properties Metric Space Properties Math 40 Fial Project Preseted by: Michael Brow, Alex Cordova, ad Alyssa Sachez We have already poited out ad will recogize throughout this book the importace of compact sets. All

More information

MAT1026 Calculus II Basic Convergence Tests for Series

MAT1026 Calculus II Basic Convergence Tests for Series MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real

More information

Advanced Analysis. Min Yan Department of Mathematics Hong Kong University of Science and Technology

Advanced Analysis. Min Yan Department of Mathematics Hong Kong University of Science and Technology Advaced Aalysis Mi Ya Departmet of Mathematics Hog Kog Uiversity of Sciece ad Techology September 3, 009 Cotets Limit ad Cotiuity 7 Limit of Sequece 8 Defiitio 8 Property 3 3 Ifiity ad Ifiitesimal 8 4

More information

Sequences. Notation. Convergence of a Sequence

Sequences. Notation. Convergence of a Sequence Sequeces A sequece is essetially just a list. Defiitio (Sequece of Real Numbers). A sequece of real umbers is a fuctio Z (, ) R for some real umber. Do t let the descriptio of the domai cofuse you; it

More information

Lecture 3 : Random variables and their distributions

Lecture 3 : Random variables and their distributions Lecture 3 : Radom variables ad their distributios 3.1 Radom variables Let (Ω, F) ad (S, S) be two measurable spaces. A map X : Ω S is measurable or a radom variable (deoted r.v.) if X 1 (A) {ω : X(ω) A}

More information

MAS111 Convergence and Continuity

MAS111 Convergence and Continuity MAS Covergece ad Cotiuity Key Objectives At the ed of the course, studets should kow the followig topics ad be able to apply the basic priciples ad theorems therei to solvig various problems cocerig covergece

More information

Ma 530 Introduction to Power Series

Ma 530 Introduction to Power Series Ma 530 Itroductio to Power Series Please ote that there is material o power series at Visual Calculus. Some of this material was used as part of the presetatio of the topics that follow. What is a Power

More information

Probability for mathematicians INDEPENDENCE TAU

Probability for mathematicians INDEPENDENCE TAU Probability for mathematicias INDEPENDENCE TAU 2013 28 Cotets 3 Ifiite idepedet sequeces 28 3a Idepedet evets........................ 28 3b Idepedet radom variables.................. 33 3 Ifiite idepedet

More information

REAL ANALYSIS II: PROBLEM SET 1 - SOLUTIONS

REAL ANALYSIS II: PROBLEM SET 1 - SOLUTIONS REAL ANALYSIS II: PROBLEM SET 1 - SOLUTIONS 18th Feb, 016 Defiitio (Lipschitz fuctio). A fuctio f : R R is said to be Lipschitz if there exists a positive real umber c such that for ay x, y i the domai

More information

STAT331. Example of Martingale CLT with Cox s Model

STAT331. Example of Martingale CLT with Cox s Model STAT33 Example of Martigale CLT with Cox s Model I this uit we illustrate the Martigale Cetral Limit Theorem by applyig it to the partial likelihood score fuctio from Cox s model. For simplicity of presetatio

More information

LECTURE 8: ASYMPTOTICS I

LECTURE 8: ASYMPTOTICS I LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece

More information

1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1

1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1 8. The cetral limit theorems 8.1. The cetral limit theorem for i.i.d. sequeces. ecall that C ( is N -separatig. Theorem 8.1. Let X 1, X,... be i.i.d. radom variables with EX 1 = ad EX 1 = σ (,. Suppose

More information

y X F n (y), To see this, let y Y and apply property (ii) to find a sequence {y n } X such that y n y and lim sup F n (y n ) F (y).

y X F n (y), To see this, let y Y and apply property (ii) to find a sequence {y n } X such that y n y and lim sup F n (y n ) F (y). Modica Mortola Fuctioal 2 Γ-Covergece Let X, d) be a metric space ad cosider a sequece {F } of fuctioals F : X [, ]. We say that {F } Γ-coverges to a fuctioal F : X [, ] if the followig properties hold:

More information

s = and t = with C ij = A i B j F. (i) Note that cs = M and so ca i µ(a i ) I E (cs) = = c a i µ(a i ) = ci E (s). (ii) Note that s + t = M and so

s = and t = with C ij = A i B j F. (i) Note that cs = M and so ca i µ(a i ) I E (cs) = = c a i µ(a i ) = ci E (s). (ii) Note that s + t = M and so 3 From the otes we see that the parts of Theorem 4. that cocer us are: Let s ad t be two simple o-egative F-measurable fuctios o X, F, µ ad E, F F. The i I E cs ci E s for all c R, ii I E s + t I E s +

More information

Notes 19 : Martingale CLT

Notes 19 : Martingale CLT Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall

More information

sin(n) + 2 cos(2n) n 3/2 3 sin(n) 2cos(2n) n 3/2 a n =

sin(n) + 2 cos(2n) n 3/2 3 sin(n) 2cos(2n) n 3/2 a n = 60. Ratio ad root tests 60.1. Absolutely coverget series. Defiitio 13. (Absolute covergece) A series a is called absolutely coverget if the series of absolute values a is coverget. The absolute covergece

More information

1+x 1 + α+x. x = 2(α x2 ) 1+x

1+x 1 + α+x. x = 2(α x2 ) 1+x Math 2030 Homework 6 Solutios # [Problem 5] For coveiece we let α lim sup a ad β lim sup b. Without loss of geerality let us assume that α β. If α the by assumptio β < so i this case α + β. By Theorem

More information

Measure and Measurable Functions

Measure and Measurable Functions 3 Measure ad Measurable Fuctios 3.1 Measure o a Arbitrary σ-algebra Recall from Chapter 2 that the set M of all Lebesgue measurable sets has the followig properties: R M, E M implies E c M, E M for N implies

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer.

6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer. 6 Itegers Modulo I Example 2.3(e), we have defied the cogruece of two itegers a,b with respect to a modulus. Let us recall that a b (mod ) meas a b. We have proved that cogruece is a equivalece relatio

More information

7 Sequences of real numbers

7 Sequences of real numbers 40 7 Sequeces of real umbers 7. Defiitios ad examples Defiitio 7... A sequece of real umbers is a real fuctio whose domai is the set N of atural umbers. Let s : N R be a sequece. The the values of s are

More information

Chapter 7 Isoperimetric problem

Chapter 7 Isoperimetric problem Chapter 7 Isoperimetric problem Recall that the isoperimetric problem (see the itroductio its coectio with ido s proble) is oe of the most classical problem of a shape optimizatio. It ca be formulated

More information

Math 299 Supplement: Real Analysis Nov 2013

Math 299 Supplement: Real Analysis Nov 2013 Math 299 Supplemet: Real Aalysis Nov 203 Algebra Axioms. I Real Aalysis, we work withi the axiomatic system of real umbers: the set R alog with the additio ad multiplicatio operatios +,, ad the iequality

More information

The Wasserstein distances

The Wasserstein distances The Wasserstei distaces March 20, 2011 This documet presets the proof of the mai results we proved o Wasserstei distaces themselves (ad ot o curves i the Wasserstei space). I particular, triagle iequality

More information

FUNDAMENTALS OF REAL ANALYSIS by

FUNDAMENTALS OF REAL ANALYSIS by FUNDAMENTALS OF REAL ANALYSIS by Doğa Çömez Backgroud: All of Math 450/1 material. Namely: basic set theory, relatios ad PMI, structure of N, Z, Q ad R, basic properties of (cotiuous ad differetiable)

More information

18.01 Calculus Jason Starr Fall 2005

18.01 Calculus Jason Starr Fall 2005 Lecture 18. October 5, 005 Homework. Problem Set 5 Part I: (c). Practice Problems. Course Reader: 3G 1, 3G, 3G 4, 3G 5. 1. Approximatig Riema itegrals. Ofte, there is o simpler expressio for the atiderivative

More information

We are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n

We are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n Review of Power Series, Power Series Solutios A power series i x - a is a ifiite series of the form c (x a) =c +c (x a)+(x a) +... We also call this a power series cetered at a. Ex. (x+) is cetered at

More information

MA131 - Analysis 1. Workbook 3 Sequences II

MA131 - Analysis 1. Workbook 3 Sequences II MA3 - Aalysis Workbook 3 Sequeces II Autum 2004 Cotets 2.8 Coverget Sequeces........................ 2.9 Algebra of Limits......................... 2 2.0 Further Useful Results........................

More information

It is often useful to approximate complicated functions using simpler ones. We consider the task of approximating a function by a polynomial.

It is often useful to approximate complicated functions using simpler ones. We consider the task of approximating a function by a polynomial. Taylor Polyomials ad Taylor Series It is ofte useful to approximate complicated fuctios usig simpler oes We cosider the task of approximatig a fuctio by a polyomial If f is at least -times differetiable

More information

Math Solutions to homework 6

Math Solutions to homework 6 Math 175 - Solutios to homework 6 Cédric De Groote November 16, 2017 Problem 1 (8.11 i the book): Let K be a compact Hermitia operator o a Hilbert space H ad let the kerel of K be {0}. Show that there

More information

ENGI Series Page 6-01

ENGI Series Page 6-01 ENGI 3425 6 Series Page 6-01 6. Series Cotets: 6.01 Sequeces; geeral term, limits, covergece 6.02 Series; summatio otatio, covergece, divergece test 6.03 Stadard Series; telescopig series, geometric series,

More information

MATH 413 FINAL EXAM. f(x) f(y) M x y. x + 1 n

MATH 413 FINAL EXAM. f(x) f(y) M x y. x + 1 n MATH 43 FINAL EXAM Math 43 fial exam, 3 May 28. The exam starts at 9: am ad you have 5 miutes. No textbooks or calculators may be used durig the exam. This exam is prited o both sides of the paper. Good

More information

The Growth of Functions. Theoretical Supplement

The Growth of Functions. Theoretical Supplement The Growth of Fuctios Theoretical Supplemet The Triagle Iequality The triagle iequality is a algebraic tool that is ofte useful i maipulatig absolute values of fuctios. The triagle iequality says that

More information

Entropy Rates and Asymptotic Equipartition

Entropy Rates and Asymptotic Equipartition Chapter 29 Etropy Rates ad Asymptotic Equipartitio Sectio 29. itroduces the etropy rate the asymptotic etropy per time-step of a stochastic process ad shows that it is well-defied; ad similarly for iformatio,

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013 Large Deviatios for i.i.d. Radom Variables Cotet. Cheroff boud usig expoetial momet geeratig fuctios. Properties of a momet

More information

MIDTERM 3 CALCULUS 2. Monday, December 3, :15 PM to 6:45 PM. Name PRACTICE EXAM SOLUTIONS

MIDTERM 3 CALCULUS 2. Monday, December 3, :15 PM to 6:45 PM. Name PRACTICE EXAM SOLUTIONS MIDTERM 3 CALCULUS MATH 300 FALL 08 Moday, December 3, 08 5:5 PM to 6:45 PM Name PRACTICE EXAM S Please aswer all of the questios, ad show your work. You must explai your aswers to get credit. You will

More information

Lesson 10: Limits and Continuity

Lesson 10: Limits and Continuity www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals

More information

Notes on Snell Envelops and Examples

Notes on Snell Envelops and Examples Notes o Sell Evelops ad Examples Example (Secretary Problem): Coside a pool of N cadidates whose qualificatios are represeted by ukow umbers {a > a 2 > > a N } from best to last. They are iterviewed sequetially

More information

1 The Haar functions and the Brownian motion

1 The Haar functions and the Brownian motion 1 The Haar fuctios ad the Browia motio 1.1 The Haar fuctios ad their completeess The Haar fuctios The basic Haar fuctio is 1 if x < 1/2, ψx) = 1 if 1/2 x < 1, otherwise. 1.1) It has mea zero 1 ψx)dx =,

More information

Seunghee Ye Ma 8: Week 5 Oct 28

Seunghee Ye Ma 8: Week 5 Oct 28 Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information

Solutions to home assignments (sketches)

Solutions to home assignments (sketches) Matematiska Istitutioe Peter Kumli 26th May 2004 TMA401 Fuctioal Aalysis MAN670 Applied Fuctioal Aalysis 4th quarter 2003/2004 All documet cocerig the course ca be foud o the course home page: http://www.math.chalmers.se/math/grudutb/cth/tma401/

More information

Lecture 8: Convergence of transformations and law of large numbers

Lecture 8: Convergence of transformations and law of large numbers Lecture 8: Covergece of trasformatios ad law of large umbers Trasformatio ad covergece Trasformatio is a importat tool i statistics. If X coverges to X i some sese, we ofte eed to check whether g(x ) coverges

More information

Math 220A Fall 2007 Homework #2. Will Garner A

Math 220A Fall 2007 Homework #2. Will Garner A Math 0A Fall 007 Homewor # Will Garer Pg 3 #: Show that {cis : a o-egative iteger} is dese i T = {z œ : z = }. For which values of q is {cis(q): a o-egative iteger} dese i T? To show that {cis : a o-egative

More information

2.2. Central limit theorem.

2.2. Central limit theorem. 36.. Cetral limit theorem. The most ideal case of the CLT is that the radom variables are iid with fiite variace. Although it is a special case of the more geeral Lideberg-Feller CLT, it is most stadard

More information

Lecture 6: Integration and the Mean Value Theorem. slope =

Lecture 6: Integration and the Mean Value Theorem. slope = Math 8 Istructor: Padraic Bartlett Lecture 6: Itegratio ad the Mea Value Theorem Week 6 Caltech 202 The Mea Value Theorem The Mea Value Theorem abbreviated MVT is the followig result: Theorem. Suppose

More information

Law of the sum of Bernoulli random variables

Law of the sum of Bernoulli random variables Law of the sum of Beroulli radom variables Nicolas Chevallier Uiversité de Haute Alsace, 4, rue des frères Lumière 68093 Mulhouse icolas.chevallier@uha.fr December 006 Abstract Let be the set of all possible

More information

2 Banach spaces and Hilbert spaces

2 Banach spaces and Hilbert spaces 2 Baach spaces ad Hilbert spaces Tryig to do aalysis i the ratioal umbers is difficult for example cosider the set {x Q : x 2 2}. This set is o-empty ad bouded above but does ot have a least upper boud

More information

HOMEWORK #10 SOLUTIONS

HOMEWORK #10 SOLUTIONS Math 33 - Aalysis I Sprig 29 HOMEWORK # SOLUTIONS () Prove that the fuctio f(x) = x 3 is (Riema) itegrable o [, ] ad show that x 3 dx = 4. (Without usig formulae for itegratio that you leart i previous

More information

McGill University Math 354: Honors Analysis 3 Fall 2012 Solutions to selected problems

McGill University Math 354: Honors Analysis 3 Fall 2012 Solutions to selected problems McGill Uiversity Math 354: Hoors Aalysis 3 Fall 212 Assigmet 3 Solutios to selected problems Problem 1. Lipschitz fuctios. Let Lip K be the set of all fuctios cotiuous fuctios o [, 1] satisfyig a Lipschitz

More information

Axioms of Measure Theory

Axioms of Measure Theory MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that

More information

Archimedes - numbers for counting, otherwise lengths, areas, etc. Kepler - geometry for planetary motion

Archimedes - numbers for counting, otherwise lengths, areas, etc. Kepler - geometry for planetary motion Topics i Aalysis 3460:589 Summer 007 Itroductio Ree descartes - aalysis (breaig dow) ad sythesis Sciece as models of ature : explaatory, parsimoious, predictive Most predictios require umerical values,

More information

Stochastic Integrals and Itô s formula.

Stochastic Integrals and Itô s formula. Chapter 5 Stochastic Itegrals ad Itô s formula. We will call a Itô process a progressively measurable almost surely cotiuous process x(t, ω) with values i R d, defied o some (Ω, F t, P) that is related

More information

An introduction to stochastic integration with respect to continuous semimartingales

An introduction to stochastic integration with respect to continuous semimartingales A itroductio to stochastic itegratio with respect to cotiuous semimartigales Alexader Sool Departmet of Mathematical Scieces Uiversity of Copehage Departmet of Mathematical Scieces Uiversity of Copehage

More information

MA131 - Analysis 1. Workbook 9 Series III

MA131 - Analysis 1. Workbook 9 Series III MA3 - Aalysis Workbook 9 Series III Autum 004 Cotets 4.4 Series with Positive ad Negative Terms.............. 4.5 Alteratig Series.......................... 4.6 Geeral Series.............................

More information

Introductory Analysis I Fall 2014 Homework #7 Solutions

Introductory Analysis I Fall 2014 Homework #7 Solutions Itroductory Aalysis I Fall 214 Homework #7 Solutios Note: There were a couple of typos/omissios i the formulatio of this homework. Some of them were, I believe, quite obvious. The fact that the statemet

More information

} is said to be a Cauchy sequence provided the following condition is true.

} is said to be a Cauchy sequence provided the following condition is true. Math 4200, Fial Exam Review I. Itroductio to Proofs 1. Prove the Pythagorea theorem. 2. Show that 43 is a irratioal umber. II. Itroductio to Logic 1. Costruct a truth table for the statemet ( p ad ~ r

More information

x a x a Lecture 2 Series (See Chapter 1 in Boas)

x a x a Lecture 2 Series (See Chapter 1 in Boas) Lecture Series (See Chapter i Boas) A basic ad very powerful (if pedestria, recall we are lazy AD smart) way to solve ay differetial (or itegral) equatio is via a series expasio of the correspodig solutio

More information

Introduction to Functional Analysis

Introduction to Functional Analysis MIT OpeCourseWare http://ocw.mit.edu 18.10 Itroductio to Fuctioal Aalysis Sprig 009 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. LECTURE OTES FOR 18.10,

More information

The Gamma function Michael Taylor. Abstract. This material is excerpted from 18 and Appendix J of [T].

The Gamma function Michael Taylor. Abstract. This material is excerpted from 18 and Appendix J of [T]. The Gamma fuctio Michael Taylor Abstract. This material is excerpted from 8 ad Appedix J of [T]. The Gamma fuctio has bee previewed i 5.7 5.8, arisig i the computatio of a atural Laplace trasform: 8. ft

More information