Stochastic Integration and Ito s Formula
|
|
- Corey Melton
- 5 years ago
- Views:
Transcription
1 CHAPTER 3 Stochastic Itegratio ad Ito s Formula I this chapter we discuss Itô s theory of stochastic itegratio. This is a vast subject. However, our goal is rather modest: we will develop this theory oly geerally eough for later applicatios. We will discuss stochastic itegrals with respect to a Browia motio ad more geerally with respect to a cotiuous local martigale. Istead of attemptig to describe the largest possible class of itegrad processes, we will oly sigle out a class of itegrad processes sufficietly large for our later applicatios. For example, i the case of a cotiuous local martigale as a itegrator, we oly restrict ourselves to cotiuous adapted itegrad processes, a class of processes sufficietly large for most applicatios. This of course does ot mea that itegrads which are ot cotiuous caot be itegrated with respect to a cotiuous martigale. It is usually the case that whe dealig with a discotiuous itegrad, we ca quickly decide the ad there whether the itegral has a meaig. Sice may excellet textbooks o stochastic itegratio are available (McKea [8, Ikeda ad Wataabe [6, Chug ad Williams [3, Oksedal [1, Karatzas ad Shreve [7, to cite just a few), there is little motivatio o the part of the author to go beyod what will be preseted i this chapter. 1. Itroductio If A is a process of bouded variatio ad f : R R is fuctio such that s f (s, ω) is Borel measurable fuctio, the f (s) da s ca be iterpreted as a pathwise itegral if proper itegrability coditios are assumed ad its value at ω Ω is the usual Lebesques Stieljes itegral f (s, ω) da s (ω). I theoretical ad applied problems, there is a obvious eed to make sese out of a itegral of the form f (s) db s, where B is a Browia motio. As we kow, Browia motio sample paths are ot fuctios of bouded variatio (see REMARK 7.2). For this 43
2 44 3. STOCHASTIC INTEGRATION AND ITO S FORMULA reaso i geeral there is o easy ad direct pathwise iterpretatio of the above itegral. However, i some special situatio, a simple iterpretatio is possible. For example, if s f (s, ω) itself has bouded variatio for each ω, we ca defie the above itegral by itegratio by parts: f (s) db s = f (t)b t B s d f (s). Such stochastic itegrals are rather limited i its scope of applicatio. Itô s theory of stochastic itegratio greatly expads the class of itegrad processes, thus makig the theory ito a powerful tool i pure ad applied mathematics. We first defie the itegratio of a step (ad determiistic) process with respect to a Browia motio. Let : = t < t 1 < t = t be a partitio of [, t. If f is a step process: f (s) = f j 1, t j 1 t < t j, the the atural defiitio of its stochastic itegral with respect to Browia motio B is 1 [ f (s) db s = f j 1 B tj B tj 1. Usig the property of idepedet icremets for Browia motio, its secod momet is give by [ 2 [ (Bti ) ( ) E f (s) db s = f i1 f j 1 E B ti 1 B tj B tj 1 This gives (1.1) E 1 = = f (s) db s 2 = i, If f ad g are two step fuctios, the E f (s) db s f j 1 2 E [ ( B tj B tj 1 f j 1 2 ( t j t j 1 ). ) 2 f j 1 2 (t j t j 1 ) = f (s) 2 ds. g(s) db s 2 = f (s) g(s) 2 ds = f g 2 2. For a arbitrary fuctio f : [, t R, it is ow clear that as log as there is a sequece of step fuctios f such that f f 2, we ca defie
3 the stochastic itegral as the limit f (s) db s = lim 1. INTRODUCTION 45 f (s) db s. It is well kow from real aalysis that this approximatio property is shared by all Borel measurable fuctios f such that f 2 <. We have thus greatly elarged the space of determiistic fuctios which ca be itegrated with respect to a Browia motio. The key observatio i Itô s theory of stochastic itegratio is that we ca pass to a radom step process as log as f j F tj. Note that ow the itegrad has the form f (s) = f j 1, t j 1 s < t j, f j 1 F tj 1, Namely, i the time iterval [t j 1, t j, the itegrad is measurable with respect to the σ-algebra at the left edpoit of the time iterval. For this reaso above argumet still applies as log as we replace the equality (1.1) by the more geeral equality E 1 f (s) db s 2 = E f j 1 2 (t j t j 1 ) = E f (s) 2 ds. The key step i establishig this equality is the vaishig of the off diagoal term [ E f i 1 f j 1 (B ti B ti1 )(B tj B tj 1 ) =. This holds because if i < j, the by coditioig o F tj 1, we have [ E f i 1 f j 1 (B ti B ti1 )(B tj B tj 1 ) F tj 1 = f i 1 f j 1 (B ti B ti1 )E [B tj B tj 1 F tj 1 =. For the diagoal term, by coditioig o F tj 1 agai, we have E [ f i 1 2 (B ti B ti 1 ) 2 = E f i 1 2 (t i t i 1 ). A importat property of stochastic itegrals is that M t = f (s) db s is a cotiuous martigale. Let us see why this is so if the itegrad process is a step process We ca write f (s) = f j 1, t j 1 < s t j, f j 1 L 2 (Ω, F tj 1, P). M t = f (s) db s = f j 1 (Bt j t B tj 1 t ).
4 46 3. STOCHASTIC INTEGRATION AND ITO S FORMULA Note that sum has oly fiitely may terms for each fixed t. The process M has cotiuous sample paths because Browia motio does. Suppose that s < t. If s ad t are ot amog the poits t j we may simply isert them ito the sequece. Now s ad t are amog the sequece we have M t M s = s t j 1 t ( ) f j 1 B tj B tj 1. The geeral term i the sum vaishes after we coditio it o F tj 1, hece it also vaishes after we coditio o F s because F s F tj 1. It follows that E [M t M s F s = ad M t is a cotiuous martigale. We ow calculate the quadratic variatio process for the cotiuous martigale We claim that M t = M, M t = f (s) db s. f (s) 2 ds. We agai verify this for a step process f. As before, we assume that s < t are amog the poits t j. We have M 2 t M 2 s = f i 1 f j 1 (B ti B ti 1 )(B tj B tj 1 ), where the sum is over those i ad j such that t i t, t j t ad at least oe of t i 1 ad t j 1 is greater or equal o s. For a off-diagoal term, say, i < j, the term vaishes after coditioig o F tj 1, hece also vaishes after coditioig o F s. For a diagoal term i = j, sice t j 1 s, by first coditioig o F tj 1 ad the coditioig o F s we have E [ f j 1 2 (B tj B tj 1 ) 2 F s = E [ f j 1 2 (t j t j 1 ) F s. It follows that This shows that is a martigale. E [ [ Mt 2 Ms 2 F s = E f (s) 2 ds F s. Mt 2 f (s) 2 ds s
5 2. STOCHASTIC INTEGRALS WITH RESPECT TO BROWNIAN MOTION Stochastic itegrals with respect to Browia motio The geeral settig is as follow. We have a Browia motio B with respect to a filtratio F defied o a filtered probability space (Ω, F, P). We assume that the filtratio F satisfies the usual coditios. DEFINITION 2.1. A real-valued fuctio f : R + Ω R is called a step process if there exists a odecreasig sequece = t < t 1 < t 2 < icreasig to ifiity ad a sequece of square-itegrable radom variables f j 1 F tj 1 such that f t = f j 1, t j 1 t < t j. The space of step processes is deoted by S. The space of step processes o [, t is deoted by S t. Note that o a iterval [t j 1, t j ) where f is costat, it is measurable with respect to the σ-algebra o the left edpoit of the iterval, i.e., f = f j 1 F tj 1. Let f be a step process as above. The stochastic itegral of f with respect to Browia motio B is the process I( f ) t = f (s) db s = ) f j 1 (B tj t B tj 1 t. Of course this is a fiite sum for each fixed t. If t i t < t i+1, the I( f ) t = i f j 1 (B tj B tj 1 ) + f i (B t B ti ). It is easy to see that the defiitio of I( f ) t is idepedet of the partitio { tj }. As we have show i the last sectio I( f ) is a cotiuous martigale with the quadratic variatio I particular we have I( f ), I( f ) t = f (s) 2 ds. [ E I( f ) t 2 = E f (s) 2 ds. This relatio allows us to exted the defiitio of stochastic itegrals to more geeral itegrads by a limit procedure. Sice the quadratic variatio process of a Browia motio correspods to the Lebesgue measure o R +, a very wide class of processes ca be used as itegrad processes. DEFINITION 2.2. A fuctio f : R + Ω R is called progressively measurable with respect to the filtratio F if for each fixed t the restrictio f : [, t Ω R is measurable with respect to the product σ-algebra B[, t F t.
6 48 3. STOCHASTIC INTEGRATION AND ITO S FORMULA EXAMPLE 2.3. Here are some examples of progressively measurable processes: (1) A step process is progressively measurable. (2) A cotiuous ad adapted process is progressively measurable. (3) Let τ be a fiite stoppig time. The the process f (t, ω) = I [,τ(ω) (s) is progressively measurable. For a discrete τ, this ca be verified directly. For a geeral τ, let τ = ([2 τ + 1)/2. The τ τ ad I [,τ (ω)(s) I [,τ(ω) (s) for all (s, ω) R + Ω. For a progressively measurable process f, we defie for each fixed T, [ T f 2 2,T = E f (s) 2 ds. The progressive measurability assures that the itegral o the right side has a meaig. We use LT 2 to deote the space of progressively measurable processes f o [, T Ω with f 2,T <. The orm 2,T makes LT 2 ito a complete Hilbert space. We use L 2 to deote the space of progressively measurable processes f such that f 2,T is fiite for all T. It ca be made ito a metric space by itroducig the distace fuctio d( f, g) = =1 f g 2, 1 + f g 2,. Note that S T L 2 ad S L 2, ad there is a obvious restrictio map L 2 Lt 2. We ow show how to defie the stochastic itegral I( f ) t = f (s) db s for every process i L 2. We eed the followig approximatio result. LEMMA 2.4. S T is dese i LT 2. I other words, for ay square itegrable progressively measurable process f LT 2, there exists a sequece { f } of step processes such that f f 2,T. PROOF. First ote that the set of uiformly bouded elemets i LT 2 is dese. Suppose that f is a progressively measurable process uiformly bouded o [, T Ω. Defie f h (t, ω) = 1 h t h f (s, ω) ds. Each f h is cotiuous ad adapted. From real aalysis we also kow that T lim h f h (t, ω) f (t, ω) 2 ds =.
7 2. STOCHASTIC INTEGRALS WITH RESPECT TO BROWNIAN MOTION 49 It follows that f h f 2,T as h. This shows that the set of uiformly bouded cotiuous ad adapted processes is dese i LT 2. Fially for a cotiuous, adapted, ad uiformly bouded process f o [, T we defie ( j 1 f (t) = f ), j 1 t < j. Each f S T ad f (t, ω) f (t, ω) for all (t, ω) [, T Ω by cotiuity. Hece f f 2,T by the domiated covergece theorem. The lemma is proved. We are ow ready to defie the stochastic itegral of a progressively measurable ad square itegrable process with respect to a Browia motio. Suppose that f L 2. By restrictig to [, t we ca regard it as a elemet i Lt 2 for ay t. Let f be a sequece of step processes o [, T such that f f 2,T. The stochastic itegral I( f ) t is well defied for t T as a Riemaa sum ad is a square itegrable martigale. We have I( f m ) t I( f ) t = [ f m (s) f (s) db s. By Doob s martigale iequality, [ E max I( f m) t I( f ) t 2 4E I( f m f ) T 2 t T [ T = 4E f m (s) f (s) 2 ds = 4 f m f 2 2,T. This shows that I( f ) t is a Cauchy sequece i L 2 (Ω, P). By the completeess of L 2 (Ω, P), the limit I( f ) t = lim I( f ) t exists ad we defie f (s) db s = lim f (s) db s. Sice f f 2,T1 implies f f 2,T2 for T 2 T 1, it is easy to see that I( f ) t thus defied is idepedet of T ad the choice of the approximatig sequece { f }. We have oly defied {I( f ) t, t } as a collectio of radom variables. We ca do more. THEOREM 2.5. Suppose that f L 2 is a square itegrable, progressively measurable process. The the stochastic itegral I( f ) t = f (s) db s is a cotiuous martigale. Its quadratic variatio process is I( f ), I( f ) t = f (s) 2 ds.
8 5 3. STOCHASTIC INTEGRATION AND ITO S FORMULA PROOF. The martigale property of I( f ) is iherited from the same property of I( f ) because this property is preserved whe passig to the limit i L 2 (Ω, F, P) as. We show that it has cotiuous sample paths. From [ E max I( f m) t I( f ) t 2 4 f m f 2 2,T t T we have by Chebyshev s iequality, [ P max I( f m) t I( f ) t ɛ 4 t T ɛ 2 f m f 2 2,t. Sice f m f 2,T as m,, by choosig a subsequece if ecessary, we may assume that f f +1 2,T 1/ 3, hece { P max I( f ) t I( f +1 ) t 1 } t T By the Borel Catelli lemma, there is a set Ω with P {Ω } = 1 with the followig property: for ay ω Ω, there is a (ω) such that max t T I( f ) t (ω) I( f +1 ) t (ω) 1 2 for all (ω). It follows that I( f ) t (ω) coverges uiformly o [, T. Sice each I( f ) t (ω) is cotiuous i t, the limit, which ecessarily coicide with I( f ) t (ω) with probability 1 for all t, must also be cotiuous. We therefore have show that the stochastic itegral I( f ) t has a versio with cotiuous sample paths. We have show before that for the step process f the process I( f ) 2 t f (s) 2 ds is a martigale. For each fixed t, as, the above radom variable coverges i L 1 (Ω, P) to I( f ) 2 t f (s) 2 ds. Therefore the martigale property ca be passed to the limitig process, which idetifies the quadratic variatio process of the stochastic itegral as stated i the propositio. COROLLARY 2.6. Suppose that f, g L 2. The I( f ), I(g) t = PROOF. This follows from the equality f (s)g(s) ds. M, N t = M + N, M + N t M N, M N t 4 for two cotiuous martigales M ad N.
9 2. STOCHASTIC INTEGRALS WITH RESPECT TO BROWNIAN MOTION 51 If Z F s, we have Z f u db u = Z f u db u. s s This ca be cosidered to be self-evidet, eve though it requires a approximatio argumet to verify. The same remark ca be said of the idetity s f u db u = s f u db u f u db u. Either we defie the left side by the right side or we cosider the left side as the stochastic itegral with respect to {B s+u, u }, which is a Browia motio with respect to the filtratio F s+ = {F s+u, u }, the ed result is the same. However, if we replace s or t by a radom time, the meaig of the two ad other similar equalities may become ambiguous, especially whe the radom time is ot a stoppig time. I this respect, if we restrict ourselves to stoppig times, the followig results may help us clarify the situatio. PROPOSITION 2.7. Suppose that f LT 2 (1) We have ad τ T a stoppig time. τ f s db s = T I [,τ (s) f s db s. (2) If Z F τ is a bouded bouded radom variable, the T T Z f db s = ZI [τ, ) (s) f s db s. τ PROOF. We will verify the equalities for discrete stoppig times ad step processes. I geeral we ca approximate the stoppig times σ ad τ by discrete stoppig times from above ad the itegrad process f by step processes i the 2,T orm. The equalities are clearly preserved whe passig to the limit uder such approximatios. Let = t < t 1 < < t = T be a partitio such that f = f j 1 F tj 1 for t j 1 t < t j ad τ takes values oly i the sequece { t j }.
10 52 3. STOCHASTIC INTEGRATION AND ITO S FORMULA (1) Note that I {s<τ} is a step process. We have I( f ) τ = = = = = I {τ=ti } T I {τ=tj} i f s db s i f j 1 (B tj B tj 1 ) f j 1 (B tj B tj 1 ) I {τ=ti } i=j I {tj 1 <τ} f j 1(B tj B tj 1 ) I [,τ) (s) f s db s. (2) Note that ZI {τ s} is a step process ad belogs to F s for fixed s. We have T i Z f s db s Z ZI {τ=ti } f s db s σ = = = = T I {τ=ti } Z f j 1 (B tj B tj 1 ) j=i+1 j 1 Z f j 1 (B tj B tj 1 ) I {τ=ti } ZI {τ tj 1} f j 1(B tj B tj 1 ) ZI [τ, ) (s) f s db s. EXAMPLE 2.8. Cosider the stochastic itegral B s db s = lim B tj 1 (B tj B tj 1 ). Usig the idetity 2a(b a) = b 2 a 2 + (b a) 2 we have 2 B tj 1 (B tj B tj 1 ) = B 2 t + (B tj B tj 1 ) 2. The last sum coverges to the quadratic variatio B, B t = t. Hece we have 2 B s db s = Bt 2 t, which is ideed a martigale.
11 3. EXTENSION TO MORE GENERAL INTEGRANDS 53 EXAMPLE 2.9. Oe may woder what will happe if i the approximatig sum of a stochastic itegral we do ot take the value of the itegrad at the left edpoit of a partitio iterval. For example, what is the sum B tj (B tj B tj 1 )? This is ot hard to figure out. The differece betwee this sum ad the usual sum takig the left edpoit value of the itegrad is just the quadratic variatio alog the partitio hece we ave lim (B tj B tj 1 ) 2, B tj (B tj B tj 1 ) = B s db s + t. This example shows where to take the value of the itegrad o each partitio iterval really matters. 3. Extesio to more geeral itegrads We have defied stochastic itegral with respect to a Browia motio for itegrad process f L 2. These are progressively measurable processes f such that [ E fs 2 ds < for all t. This itegrability is too restrictive. Without too much effort we ca defie a much wider class of itegrad processes. DEFINITION 3.1. We use L 2 to deote the space of progressively measurable processes f such that [ P fs 2 ds < = 1 for all t. This is a class of process wider tha L 2 ad is sufficiet for our applicatios. For example, all adapted cotiuous processes belog to Lloc 2. We will exted the defiitio of stochastic itegrals to processes i Lloc 2. The resultig stochastic itegral process is o loger a square itegrable martigale but a local martigale. Recall the defiitio of a local martigale. DEFINITION 3.2. We say that M = {M t, t } is a local martigale if there exists a sequece of stoppig times τ such that the stopped processes M τ = {M t τ, t } are martigales.
12 54 3. STOCHASTIC INTEGRATION AND ITO S FORMULA For cotiuous local martigale M with M =, we ca always take τ = if {t : M t }. Suppose that f Lloc 2. Defie the stoppig time { } τ = if t > : f (s) 2 ds. the assumptio that f L 2 loc implies that τ (with probability oe, if oe wats to be very precise). Now cosider the process f (s) = f (s)i {s τ }. It is clear that f L 2, i fact f 2,T for all T. The stochastic itegral I( f ) is well-defied ad is a square itegrable cotiuous martigale. We ow defie the stochastic itegral I( f ) t as follows: I( f ) t = I( f ) t, t τ. I order that this defiitio make sese, we have to verify the cosistecy: if m, the I( f ) t = I( f m ) t, t τ m. This is immediate. Ideed, I( f ) t τm = From defiitio we have f I {s τm } db s = I( f ) t τ = I( f ) t, f m db s = I( f m ) t. which shows that I( f ) is a cotiuous local martigale. [ EXAMPLE 3.3. The process Be B2 L 2 because E B t 2 e B2 t is ifiite for t 1/2. However, sice it is cotiuous it belogs to Lloc 2 ad its stochastic itegral with respect to Browia motio is well defied. I fact, Itô s formula will show that [ 2 B s e B2 s db s = e B2 t 1 + 2B 2 s e Bs 2 ds. 4. Stochastic itegratio with respect to cotiuous local martigales We have discussed stochastic itegratio with respect to Browia motio so that oly the martigale properties of Browia motio is used. For this reaso ot much eeds to be chaged if we replace Browia motio by a geeral cotiuous martigale. All we eed to do is to replace the quadratic variatio process of Browia motio B, B t = t by M.M t, which is a cotiuous icreasig process. More specifically, the theory of stochastic itegratio with respect to Browia motio is based o several properties of Browia motio: (1) B is a cotiuous square itegrable martigale; (2) The quadratic variatio process is B, B t = t.
13 4. STOCHASTIC INTEGRATION WITH RESPECT TO CONTINUOUS LOCAL MARTINGALES55 (3) If f is a step process, the [ ( ) 2 [ E f db s = E f s 2 ds. (4) The space of step processes S T is dese i the space of progressively measurable ad square itegrable processes LT 2. For a theory of stochastic itegratio with respect to a geeral cotiuous martigale M, we make the followig observatios: (1) By the usual stoppig time argumet, we ca restrict ourselves iitially to uiformly bouded cotiuous martigales. (2) The quadratic variatio process M, M t is cotiuous, adapted, ad icreasig. Therefore itegratio of a progressively measurable process with respect to M, M is well defied. (3) For a bouded step process f we have 2 [ E f s dm s = E f 2 s d M, M s. (4) We ca itroduce the orm [ f 2,T;M = E fs 2 d M, M s. There does ot seem to be a good descriptio of the closure of the space of S T uder this orm that is good for all M, but at least all progressively measurable ad cotiuous processes with fiite orm ca be approximated by step processes. It is also possible develop a theory of stochastic itegratio with respect to a geeral, ot ecessarily cotiuous martigale. Sice we will mostly oly deal with cotiuous martigales, we will restrict ourselves to cotiuous local martigales. Suppose that M is a cotiuous local martigale ad f S is a step process. The stochastic itegral of f with respect to the martigale M is I( f ) t = f dm s = j f j 1 (M tj 1 t M tj t Just as i the case of Browia motio we have 2 [ E f s dm s = E f s 2 d M, M. Let L 2 (M) be the space of progressively measurable processes f such that [ T f 2 2,T;M = E f s 2 d M, M s < for all t. It ca be show that S T is dese i L 2 (M) T (see Karatzas ad Shreve [7). Thus by the usual approximatio argumet, we see that ).
14 56 3. STOCHASTIC INTEGRATION AND ITO S FORMULA the stochastic itegral I( f ) t = f s dm s is well defied for all f L 2 (M) ad the quadratic variatio process is I( f ), I( f ) t = f s 2 d M, M s. Although it is ot easy to fid a good descriptio of L 2 (M) that fits all cotiuous martigales, it does cotai all cotiuous adapted processes such that f 2,T;M is fiite for all T. By the stadard stoppig time argumet we have used i the case of Browia motio, the stochastic itegral I( f ) t = f s dm s ca be defied for a cotiuous local martigale M ad a progressively measurable process f such that [ P f s 2 d M, M s < = 1 for all t. Uder these coditios, the stochastic itegral I( f ) is a cotiuous local martigale. EXAMPLE 4.1. Let M be a uiformly bouded cotiuous martigale. As i the case of Browia motio we have M 2 t M 2 = 2 M tj 1 (M tj M tj 1 ) + (M tj M tj 1 ) 2. The sum after the equal sig coverges to the stochastic itegral M s dm s. Therefore the secod sum must also coverge. It is clear that the limit of the secod sum is a cotiuous, icreasig, ad adapted process. Hece by the Doob-Meyer decompositio theorem, the limit must be the quadratic variatio process, i.e., ad lim (M tj M tj 1 ) 2 = M, M t Mt 2 = M M s dm s + M, M t. The covergece of the quadratic variatio process takes place i L 2 (Ω, P). For a geeral local martigale, it ca be show by routie argumet that the covergece takes place at least i probability.
15 5. ITÔ S FORMULA Itô s formula Itô s formula is the fudametal theorem for stochastic calculus. Let us recall that the fudametal theorem of calculus states that if F is a cotiuously differetiable fuctio the F(t) F() = F (s) ds. Let = t < t 1 < < t = t be a partitio of the iterval [a, b. We have F(t) F() = [ F(tj ) F(t j 1 ). Sice F is cotiuous, by the mea value theorem, there is a poit ξ i [t j 1, t j such that F(t j ) F(t j 1 ) = F(ξ j )(t j t j 1 ). Hece, by the defiitio of Riema itegrals we have as, F(b) F(a) = F (ξ j )(t j t j 1 ) F (s) ds. What happes to this proof if we replace t by B t. I this case ξ j will be a poit betwee B tj 1 ad B tj. We have to deal with the sum F (ξ j )(B tj B tj 1 ). Here the argumet has to depart from what we have doe above. As EX- AMPLE 2.9 shows, the place where we take the value of the itegrad o each partitio iterval ca chage the limit of the Riema sum. Therefore we should ot expect that the above sum will coverges to the stochastic itegral F (B s ) db s, for which the left edpoit value of the itegrad is used i each partitio iterval. The method to remedy this situatio is to take oe more term of the Taylor expasio F(B tj ) F(B tj 1 ) = F (B tj 1 )(B tj B tj 1 ) F (ξ j )(B tj B tj 1 ) 2. The sum of the first term o the right side will coverge to the stochastic itegral as usual. The crucial observatio is that because Browia motio has fiite quadratic variatio, the sum of the secod term o the right side F (ξ j )(B tj B tj 1 ) 2 F (B s ) ds as. The fial result is the well kow Itô s formula F(B t ) = F(B ) + F (B s ) db s F (B s ) ds.
16 58 3. STOCHASTIC INTEGRATION AND ITO S FORMULA O the right side, the first term is a cotiuous martigale, ad the secod term is a process of bouded variatio. Thus if F is cotiuous ad uiformly bouded together with its first ad secod derivatives, the the compositio F(B t ) is a semimartigale ad Itô s formula gives a explicit expressio for its Doob-Meyer decompositio. The proof of Itô s formula for for a geeral semimartigale Z will ot be a lot more difficult tha the case of Browia motio. For this reaso, i this sectio we will prove it i this geerality. THEOREM 5.1. Suppose that F C 2 (R) ad Z is a semimartigale. The (5.1) F(Z t ) = F(Z ) + F (Z s ) dz s + 1 F (Z s ) d Z, Z s. 2 Recall that a semimartigale has the form Z t = M t + A t, where M is a local martigale ad A a process of bouded variatio. We first use a stoppig time argumet to reduce the proof to the case where Z, M, M, M, ad A are all uiformly bouded ad F together with its first ad secod derivatives are uiformly bouded ad uiformly cotiuous. First of all, let Ω N = { Z N} ad defie P N (C) = P(C Ω N). P(Ω ) It is clear that uder the P N, the process Z is still a semimartigale with the same decompositio Z = M + A ad P N { Z N} = 1, i.e., Z is bouded. Next, defie the stoppig time τ N = if {t : M t M + M, M t + A t N}. The stopped processes Z τ N = M τ N + A τ N ad M τ N, M τ N t = M, M τ N t have the bouded properties we desired. Defie a fuctio F N C 2 (R) such that it coicides with F o [ 2N, 2N ad vaishes outside [ 3N, 3N. O the probability space (Ω N, F Ω N, P N ) suppose that we have the formula F N (Z τ N ) = F N (Z τ N ) + F N(Z τ N s ) dz s Replacig t there by t τ N we see that F(Z t τn ) = F(Z ) + τn F (Z s ) dz s F N(Z τ N s ) d Z τ N, Z τ N s. τn F (Z s ) d Z, Z s. Here we have used the defiitio of stochastic itegral with respect to a local martigale. This shows that the formula (5.1) holds o Ω N ad t < τ N. Fially from P {Ω N } 1 ad P {τ N } = 1, we see that Itô s formula holds without ay extra coditios.
17 5. ITÔ S FORMULA 59 After these reductios, we start the proof of Itô s formula itself. By Taylor s formula with remaider we have F(Z tj ) F(Z tj 1 ) = F (Z tj 1 )(Z tj Z tj 1 ) F (ξ i )(Z tj Z tj 1 ) 2, where ξ is a poit betwee Z tj 1 ad Z tj. For simplicity let us deote Z j = Z tj Z tj 1, M j = M tj M tj 1, M j = M tj M tj 1. With these otatios we ca write F(Z t ) F(Z ) = F (Z tj 1 ) Z j F (ξ i )( Z j ) 2. The first sum coverges to the stochastic itegral i L 2 (Ω, P): F (Z tj 1 ) Z j The real work starts with the proof of (5.2) F (ξ i )( Z j ) 2 F (Z s ) dz s. F (Z s ) d Z, Z s. We will prove this through a series of three replacemets F (ξ i )( Z j ) 2 F (ξ i )( M j ) 2 F (Z tj 1 )( M j ) 2 F (Z tj 1 ) M j. We will show that each replacemet produces a error which will vaish i probability as the mesh of the partitio. After these replacemets we will have F (Z tj 1 ) M j F (Z s ) d M, M s, which will complete the proof. (1) From ( Z j ) 2 ( M j ) 2 = A j ( Z j + M j ) we have F (ξ i ) { ( Z j ) 2 ( M j ) 2} F A t max 1 i Z j + M j. By sample path cotiuity we have lim max Z j + M j = 1 i almost surely. Hece the error produced by the first replacemet vaishes i probability as. (2) We have [ F (ξ i ) F (Z tj 1 ) ( M j ) 2 max F (ξ i ) F (Z tj 1 ) ( M j ) 2. 1 i
18 6 3. STOCHASTIC INTEGRATION AND ITO S FORMULA Agai by sample path cotiuity we have max F (ξ i ) F (Z tj 1 ) 1 i almost surely. O the other had, by EXAMPLE 4.1, lim ( M j ) 2 = M, M t i L 2 (Ω, P). Therefore the error produced by this replacemet vaishes i probability as. (3) This is the most delicate replacemet of the three. The error is E = F (Z tj 1 ) { ( M j ) 2 } M j. The square E 2 is a sum of 2 terms. From EXAMPLE 4.1 ( M j ) 2 M j = 2 j t j 1 (M s M tj 1 ) dm s. This is a stochastic itegral with respect to a martigale, hece the coditioal expectatio of this expressio with respect to F tj 1 is clearly zero. For a off-diagoal term, say i < j, i E 2, its coditioal expectatio with respect to F tj 1 is therefore zero. Hece all off-diagoal term has expectatio value zero. For the diagoal term we have [ ( tj ) 2 [ j E (M s M tj 1 ) dm s F tj 1 = E (M s M tj 1 ) 2 d M, M s. t j 1 t j 1 Therefore the expected value of this off-diagoal term is bouded by [ F 2 E M j max M s M tj 1. t j 1 s t j Addig the diagoal terms together we obtai [ E E 2 F 2 E M t max max M s M tj 1. t j 1 s t j 1 j Note that uder our assumptio, the expressio uder the expectatio is uiformly bouded. This expectatio coverges to zero by sample path cotiuity ad the domiated covergece theorem. With this fial replacemet, we have completed the proof of (5.2) ad also the proof of Itô s formula. We ed this sectio with the statemet of Itô s formula for multidimesioal semimartigales. The basic igrediets of its proof have already explaied i great detail i the proof of the oe dimesioal case. Sice othig will be leared from its tedious proof, we will justifiably omit it.
19 6. DIFFERENTIAL NOTATION AND STRATONOVICH INTEGRALS 61 THEOREM 5.2. Suppose that Z = (Z 1,..., Z ) be a R valued semimartigale. The for ay F C 2 (R ). F(Z t ) = F(Z ) + F xi (Z s ) dz i s F xi x j (Z s ) d Z i, Z j s. i, 6. Differetial otatio ad Stratoovich itegrals This sectio does ot cotai ew results. We itroduce differetial otatio for stochastic calculus ad Stratoovich itegrals, a form of stochastic itegral more restrictive tha Itô itegrals. We ofte work with the followig classes of processes: M = the space of cotiuous local martigales; A = the space of cotiuous processes of bouded variatio; I = the space of icreasig processes; Q= the space of semimartigales H = the space of itegrad processes. Every process of bouded variatio is the differece of two icreasig processes: A = I I. A semimartigale is the sum of a local cotiuous martigale ad a process of bouded variatio: Q = M + A It is ofte coveiet to write equalities amog these processes i a d- ifferetial form. We have defied the meaig of a expressio such as H s dx s for H H ad X Q. What exactly is the meaig a differetial expressio such as dx? We should cosider dx as a symbol for the equivalece class of semimartigales Y such that X t X s = Y t Y s for all s t. The equivalet classes of semimartigale differetials is deoted by dq. We ca carry out some purely symbolic calculatios. To start with we ca set dx u = X t X s. We ca defie a multiplicatio i Q by settig s dx dy = d X, Y. We also defie the multiplicatio of a elemet from Q by a elemet from H : HdX is the equivalece class cotaiig the semimartigale Here are some properties of these operatios: (1) dq dq da ; (2) dq da = ; (3) H(dX dy) = (H dx) dy; (4) H 1 (H 2 dx) = (H 1 H 2 )dx. H s dx t s.
20 62 3. STOCHASTIC INTEGRATION AND ITO S FORMULA With these formal symbolic otatios, the multi-dimesioal Itô s formula ca be writte as d { f (Z t )} = f xi (Z t ) dzt i f xi x j (Z t ) dx i dx j. i, If we are willig to adopt Eistei s summatio covetio, we may eve drop the two summatio sigs. Suppose that X ad Y are two semimartigales. We defie a ew semimartigale differetial by This meas that X dy = X dy + 1 dx dy. 2 X s dy s = X s dy s X, Y t. This is called the Stratoovich itegral. Ulike Itô itegral, the Stratoovich itegral requires that the itegrad process is also a cotiuous semimartigale, for i its defiitio we eed the quadratic covariatio of X ad Y. I this sese Stratoovich itegral is a weaker form of stochastic itegral ad its use is much more limited tha Itô itegrals. The mai advatage of S- tratoovich itegrals is that Itô s formula takes a form similar to that of the fudametal theorem of calculus. PROPOSITION 6.1. Let F C 3 (R ) ad Z = (Z 1,..., Z ) a -dimesioal semimartigale. The d { f (Z t )} = PROOF. The right side is equal to F xi (Z t ) dzt. i (6.1) F xi (Z t ) dz j t F x i x j (Z t ) dz j t. Usig It&o s formula we have df xi (Z t ) = F xi x j (Z t ) dz i t F x i x j x k (Z t ) dz j dz k. Thus the last term i (6.1) becomes 1 2 F x i x j (Z t ) dz i t dz j t F x i x j x k (Z t ) dz i t dz j t dzk t. The last triple sum is equal to zero because dzt i dzj t dzk t =. Therefore the equality we wated to prove is just Itô s formula. Fially we metio that Stratoovich itegral ca also be approximated by a Riema sums. It is istructive to compare this Riema sum with the oe that approximates the correspodig Itô itegral. The differece is subtle but crucial i makig Itô itegratio such a successful theory.
21 7. THIRD ASSIGNMENT 63 THEOREM 6.2. Let X ad Y be cotiuous semimartigales. The X tj 1 + X tj X s dy s = lim [Y tj Y tj 1, where the covergece is i probability. PROOF. Rewrite the summatio as [ X tj 1 Y tj Y tj [X tj X tj 1 [Y tj Y tj 1. 2 The limit of the first term is the Itô itegral 2 term is exactly the quadratic covariatio X, Y t /2. 7. Third Assigmet X s dy s, that of the secod EXERCISE 3.1. Let f be a (oradom) fuctio of boud variatio. Show that f s db s = f t B t B s d f s, where the last itegral is uderstood to be a Lebesgue-Stieljes itegral. EXERCISE 3.2. Let F be a etire fuctio i the complex plae C ad Z = X + iy be the complex Browia motio (meaig that X ad Y are idepedet stadard Browia motio). We have F (Z s ) dz s = F (Z s ) dz s = F(Z t ) F(Z ). EXERCISE 3.3. The price S t of a stock with average rate of retur µ ad volatility σ is usually described by the stochastic differetial equatio ds t = S t (µ dt + σ db t ). Usig Itô s formula to show that the solutio of the above stochastic differetial equatio is [ ) S t = S exp σb t + (µ σ2 t. 2 EXERCISE 3.4. Let B = (B 1, B 2, B 3 ) be a 3-dimesioal Browia motio which does ot start from zero. Usig Itô s formula to show that 1/ B t is a local martigale. EXERCISE 3.5. Let B be a -dimesioal Browia motio startig from zero ad X t = B t = Bt i 2
22 64 3. STOCHASTIC INTEGRATION AND ITO S FORMULA be the radial process. Show that X satisfies the followig Itô type stochastic differetial equatio: X t = W t + 1 ds, 2 X s where W is a oe-dimesioal Browia motio. EXERCISE 3.6. Let M ad N be two cotiuous local martigales. Show that M, N t M t N t. EXERCISE 3.7. Suppose that X, Y ad Z be three semimartigales. Are the followig relatios true? (1) X(Y dz) = (XY) dz; (2) X (Y Z) = (XY) dz. EXERCISE 3.8. A Browia bridge is defied by dx t = db t X t dt 1 t, X =. Show that X is a Gaussia process with mea zero ad E [X s X t = mi {s, t} st. Show that {X t, t 1} ad the reversed process {X 1 t, t 1} have the same law. EXERCISE 3.9. Suppose that M ad N are two bouded cotiuous martigales which are idepedet. Show that MN is a cotiuous martigale with respect to the filtratio F M,N = σ {M s, N s ; s t} geerated by M ad N. EXERCISE 3.1. Suppose that M is a strictly positive local martigale. Show that there is a local martigale N such that [ M t = M exp N t 1 2 N, N t.
Convergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationChapter 3. Strong convergence. 3.1 Definition of almost sure convergence
Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationProduct measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.
Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationLecture 3 The Lebesgue Integral
Lecture 3: The Lebesgue Itegral 1 of 14 Course: Theory of Probability I Term: Fall 2013 Istructor: Gorda Zitkovic Lecture 3 The Lebesgue Itegral The costructio of the itegral Uless expressly specified
More informationSolutions to HW Assignment 1
Solutios to HW: 1 Course: Theory of Probability II Page: 1 of 6 Uiversity of Texas at Austi Solutios to HW Assigmet 1 Problem 1.1. Let Ω, F, {F } 0, P) be a filtered probability space ad T a stoppig time.
More informationAn alternative proof of a theorem of Aldous. concerning convergence in distribution for martingales.
A alterative proof of a theorem of Aldous cocerig covergece i distributio for martigales. Maurizio Pratelli Dipartimeto di Matematica, Uiversità di Pisa. Via Buoarroti 2. I-56127 Pisa, Italy e-mail: pratelli@dm.uipi.it
More informationMath 113, Calculus II Winter 2007 Final Exam Solutions
Math, Calculus II Witer 7 Fial Exam Solutios (5 poits) Use the limit defiitio of the defiite itegral ad the sum formulas to compute x x + dx The check your aswer usig the Evaluatio Theorem Solutio: I this
More informationMa 4121: Introduction to Lebesgue Integration Solutions to Homework Assignment 5
Ma 42: Itroductio to Lebesgue Itegratio Solutios to Homework Assigmet 5 Prof. Wickerhauser Due Thursday, April th, 23 Please retur your solutios to the istructor by the ed of class o the due date. You
More informationMathematical Methods for Physics and Engineering
Mathematical Methods for Physics ad Egieerig Lecture otes Sergei V. Shabaov Departmet of Mathematics, Uiversity of Florida, Gaiesville, FL 326 USA CHAPTER The theory of covergece. Numerical sequeces..
More informationFall 2013 MTH431/531 Real analysis Section Notes
Fall 013 MTH431/531 Real aalysis Sectio 8.1-8. Notes Yi Su 013.11.1 1. Defiitio of uiform covergece. We look at a sequece of fuctios f (x) ad study the coverget property. Notice we have two parameters
More informationDefinition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.
4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad
More informationAdvanced Stochastic Processes.
Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.
More informationSequences and Series of Functions
Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More information1 Approximating Integrals using Taylor Polynomials
Seughee Ye Ma 8: Week 7 Nov Week 7 Summary This week, we will lear how we ca approximate itegrals usig Taylor series ad umerical methods. Topics Page Approximatig Itegrals usig Taylor Polyomials. Defiitios................................................
More information1 Convergence in Probability and the Weak Law of Large Numbers
36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec
More information6a Time change b Quadratic variation c Planar Brownian motion d Conformal local martingales e Hints to exercises...
Tel Aviv Uiversity, 28 Browia motio 59 6 Time chage 6a Time chage..................... 59 6b Quadratic variatio................. 61 6c Plaar Browia motio.............. 64 6d Coformal local martigales............
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationlim za n n = z lim a n n.
Lecture 6 Sequeces ad Series Defiitio 1 By a sequece i a set A, we mea a mappig f : N A. It is customary to deote a sequece f by {s } where, s := f(). A sequece {z } of (complex) umbers is said to be coverget
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece
More informationChapter 6 Infinite Series
Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat
More informationA Proof of Birkhoff s Ergodic Theorem
A Proof of Birkhoff s Ergodic Theorem Joseph Hora September 2, 205 Itroductio I Fall 203, I was learig the basics of ergodic theory, ad I came across this theorem. Oe of my supervisors, Athoy Quas, showed
More informationThe Boolean Ring of Intervals
MATH 532 Lebesgue Measure Dr. Neal, WKU We ow shall apply the results obtaied about outer measure to the legth measure o the real lie. Throughout, our space X will be the set of real umbers R. Whe ecessary,
More information(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3
MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationNotes 27 : Brownian motion: path properties
Notes 27 : Browia motio: path properties Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces:[Dur10, Sectio 8.1], [MP10, Sectio 1.1, 1.2, 1.3]. Recall: DEF 27.1 (Covariace) Let X = (X
More informationIntegrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number
MATH 532 Itegrable Fuctios Dr. Neal, WKU We ow shall defie what it meas for a measurable fuctio to be itegrable, show that all itegral properties of simple fuctios still hold, ad the give some coditios
More information1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series.
.3 Covergece Theorems of Fourier Series I this sectio, we preset the covergece of Fourier series. A ifiite sum is, by defiitio, a limit of partial sums, that is, a cos( kx) b si( kx) lim a cos( kx) b si(
More informationIf a subset E of R contains no open interval, is it of zero measure? For instance, is the set of irrationals in [0, 1] is of measure zero?
2 Lebesgue Measure I Chapter 1 we defied the cocept of a set of measure zero, ad we have observed that every coutable set is of measure zero. Here are some atural questios: If a subset E of R cotais a
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 6 9/23/203 Browia motio. Itroductio Cotet.. A heuristic costructio of a Browia motio from a radom walk. 2. Defiitio ad basic properties
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationSingular Continuous Measures by Michael Pejic 5/14/10
Sigular Cotiuous Measures by Michael Peic 5/4/0 Prelimiaries Give a set X, a σ-algebra o X is a collectio of subsets of X that cotais X ad ad is closed uder complemetatio ad coutable uios hece, coutable
More informationMath 2784 (or 2794W) University of Connecticut
ORDERS OF GROWTH PAT SMITH Math 2784 (or 2794W) Uiversity of Coecticut Date: Mar. 2, 22. ORDERS OF GROWTH. Itroductio Gaiig a ituitive feel for the relative growth of fuctios is importat if you really
More informationPRELIM PROBLEM SOLUTIONS
PRELIM PROBLEM SOLUTIONS THE GRAD STUDENTS + KEN Cotets. Complex Aalysis Practice Problems 2. 2. Real Aalysis Practice Problems 2. 4 3. Algebra Practice Problems 2. 8. Complex Aalysis Practice Problems
More informationLecture Notes for Analysis Class
Lecture Notes for Aalysis Class Topological Spaces A topology for a set X is a collectio T of subsets of X such that: (a) X ad the empty set are i T (b) Uios of elemets of T are i T (c) Fiite itersectios
More informationb i u x i U a i j u x i u x j
M ath 5 2 7 Fall 2 0 0 9 L ecture 1 9 N ov. 1 6, 2 0 0 9 ) S ecod- Order Elliptic Equatios: Weak S olutios 1. Defiitios. I this ad the followig two lectures we will study the boudary value problem Here
More informationTR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT
TR/46 OCTOBER 974 THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION by A. TALBOT .. Itroductio. A problem i approximatio theory o which I have recetly worked [] required for its solutio a proof that the
More informationMATH4822E FOURIER ANALYSIS AND ITS APPLICATIONS
MATH48E FOURIER ANALYSIS AND ITS APPLICATIONS 7.. Cesàro summability. 7. Summability methods Arithmetic meas. The followig idea is due to the Italia geometer Eresto Cesàro (859-96). He shows that eve if
More informationMetric Space Properties
Metric Space Properties Math 40 Fial Project Preseted by: Michael Brow, Alex Cordova, ad Alyssa Sachez We have already poited out ad will recogize throughout this book the importace of compact sets. All
More informationMAT1026 Calculus II Basic Convergence Tests for Series
MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real
More informationAdvanced Analysis. Min Yan Department of Mathematics Hong Kong University of Science and Technology
Advaced Aalysis Mi Ya Departmet of Mathematics Hog Kog Uiversity of Sciece ad Techology September 3, 009 Cotets Limit ad Cotiuity 7 Limit of Sequece 8 Defiitio 8 Property 3 3 Ifiity ad Ifiitesimal 8 4
More informationSequences. Notation. Convergence of a Sequence
Sequeces A sequece is essetially just a list. Defiitio (Sequece of Real Numbers). A sequece of real umbers is a fuctio Z (, ) R for some real umber. Do t let the descriptio of the domai cofuse you; it
More informationLecture 3 : Random variables and their distributions
Lecture 3 : Radom variables ad their distributios 3.1 Radom variables Let (Ω, F) ad (S, S) be two measurable spaces. A map X : Ω S is measurable or a radom variable (deoted r.v.) if X 1 (A) {ω : X(ω) A}
More informationMAS111 Convergence and Continuity
MAS Covergece ad Cotiuity Key Objectives At the ed of the course, studets should kow the followig topics ad be able to apply the basic priciples ad theorems therei to solvig various problems cocerig covergece
More informationMa 530 Introduction to Power Series
Ma 530 Itroductio to Power Series Please ote that there is material o power series at Visual Calculus. Some of this material was used as part of the presetatio of the topics that follow. What is a Power
More informationProbability for mathematicians INDEPENDENCE TAU
Probability for mathematicias INDEPENDENCE TAU 2013 28 Cotets 3 Ifiite idepedet sequeces 28 3a Idepedet evets........................ 28 3b Idepedet radom variables.................. 33 3 Ifiite idepedet
More informationREAL ANALYSIS II: PROBLEM SET 1 - SOLUTIONS
REAL ANALYSIS II: PROBLEM SET 1 - SOLUTIONS 18th Feb, 016 Defiitio (Lipschitz fuctio). A fuctio f : R R is said to be Lipschitz if there exists a positive real umber c such that for ay x, y i the domai
More informationSTAT331. Example of Martingale CLT with Cox s Model
STAT33 Example of Martigale CLT with Cox s Model I this uit we illustrate the Martigale Cetral Limit Theorem by applyig it to the partial likelihood score fuctio from Cox s model. For simplicity of presetatio
More informationLECTURE 8: ASYMPTOTICS I
LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece
More information1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1
8. The cetral limit theorems 8.1. The cetral limit theorem for i.i.d. sequeces. ecall that C ( is N -separatig. Theorem 8.1. Let X 1, X,... be i.i.d. radom variables with EX 1 = ad EX 1 = σ (,. Suppose
More informationy X F n (y), To see this, let y Y and apply property (ii) to find a sequence {y n } X such that y n y and lim sup F n (y n ) F (y).
Modica Mortola Fuctioal 2 Γ-Covergece Let X, d) be a metric space ad cosider a sequece {F } of fuctioals F : X [, ]. We say that {F } Γ-coverges to a fuctioal F : X [, ] if the followig properties hold:
More informations = and t = with C ij = A i B j F. (i) Note that cs = M and so ca i µ(a i ) I E (cs) = = c a i µ(a i ) = ci E (s). (ii) Note that s + t = M and so
3 From the otes we see that the parts of Theorem 4. that cocer us are: Let s ad t be two simple o-egative F-measurable fuctios o X, F, µ ad E, F F. The i I E cs ci E s for all c R, ii I E s + t I E s +
More informationNotes 19 : Martingale CLT
Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall
More informationsin(n) + 2 cos(2n) n 3/2 3 sin(n) 2cos(2n) n 3/2 a n =
60. Ratio ad root tests 60.1. Absolutely coverget series. Defiitio 13. (Absolute covergece) A series a is called absolutely coverget if the series of absolute values a is coverget. The absolute covergece
More information1+x 1 + α+x. x = 2(α x2 ) 1+x
Math 2030 Homework 6 Solutios # [Problem 5] For coveiece we let α lim sup a ad β lim sup b. Without loss of geerality let us assume that α β. If α the by assumptio β < so i this case α + β. By Theorem
More informationMeasure and Measurable Functions
3 Measure ad Measurable Fuctios 3.1 Measure o a Arbitrary σ-algebra Recall from Chapter 2 that the set M of all Lebesgue measurable sets has the followig properties: R M, E M implies E c M, E M for N implies
More information62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +
62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of
More information6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer.
6 Itegers Modulo I Example 2.3(e), we have defied the cogruece of two itegers a,b with respect to a modulus. Let us recall that a b (mod ) meas a b. We have proved that cogruece is a equivalece relatio
More information7 Sequences of real numbers
40 7 Sequeces of real umbers 7. Defiitios ad examples Defiitio 7... A sequece of real umbers is a real fuctio whose domai is the set N of atural umbers. Let s : N R be a sequece. The the values of s are
More informationChapter 7 Isoperimetric problem
Chapter 7 Isoperimetric problem Recall that the isoperimetric problem (see the itroductio its coectio with ido s proble) is oe of the most classical problem of a shape optimizatio. It ca be formulated
More informationMath 299 Supplement: Real Analysis Nov 2013
Math 299 Supplemet: Real Aalysis Nov 203 Algebra Axioms. I Real Aalysis, we work withi the axiomatic system of real umbers: the set R alog with the additio ad multiplicatio operatios +,, ad the iequality
More informationThe Wasserstein distances
The Wasserstei distaces March 20, 2011 This documet presets the proof of the mai results we proved o Wasserstei distaces themselves (ad ot o curves i the Wasserstei space). I particular, triagle iequality
More informationFUNDAMENTALS OF REAL ANALYSIS by
FUNDAMENTALS OF REAL ANALYSIS by Doğa Çömez Backgroud: All of Math 450/1 material. Namely: basic set theory, relatios ad PMI, structure of N, Z, Q ad R, basic properties of (cotiuous ad differetiable)
More information18.01 Calculus Jason Starr Fall 2005
Lecture 18. October 5, 005 Homework. Problem Set 5 Part I: (c). Practice Problems. Course Reader: 3G 1, 3G, 3G 4, 3G 5. 1. Approximatig Riema itegrals. Ofte, there is o simpler expressio for the atiderivative
More informationWe are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n
Review of Power Series, Power Series Solutios A power series i x - a is a ifiite series of the form c (x a) =c +c (x a)+(x a) +... We also call this a power series cetered at a. Ex. (x+) is cetered at
More informationMA131 - Analysis 1. Workbook 3 Sequences II
MA3 - Aalysis Workbook 3 Sequeces II Autum 2004 Cotets 2.8 Coverget Sequeces........................ 2.9 Algebra of Limits......................... 2 2.0 Further Useful Results........................
More informationIt is often useful to approximate complicated functions using simpler ones. We consider the task of approximating a function by a polynomial.
Taylor Polyomials ad Taylor Series It is ofte useful to approximate complicated fuctios usig simpler oes We cosider the task of approximatig a fuctio by a polyomial If f is at least -times differetiable
More informationMath Solutions to homework 6
Math 175 - Solutios to homework 6 Cédric De Groote November 16, 2017 Problem 1 (8.11 i the book): Let K be a compact Hermitia operator o a Hilbert space H ad let the kerel of K be {0}. Show that there
More informationENGI Series Page 6-01
ENGI 3425 6 Series Page 6-01 6. Series Cotets: 6.01 Sequeces; geeral term, limits, covergece 6.02 Series; summatio otatio, covergece, divergece test 6.03 Stadard Series; telescopig series, geometric series,
More informationMATH 413 FINAL EXAM. f(x) f(y) M x y. x + 1 n
MATH 43 FINAL EXAM Math 43 fial exam, 3 May 28. The exam starts at 9: am ad you have 5 miutes. No textbooks or calculators may be used durig the exam. This exam is prited o both sides of the paper. Good
More informationThe Growth of Functions. Theoretical Supplement
The Growth of Fuctios Theoretical Supplemet The Triagle Iequality The triagle iequality is a algebraic tool that is ofte useful i maipulatig absolute values of fuctios. The triagle iequality says that
More informationEntropy Rates and Asymptotic Equipartition
Chapter 29 Etropy Rates ad Asymptotic Equipartitio Sectio 29. itroduces the etropy rate the asymptotic etropy per time-step of a stochastic process ad shows that it is well-defied; ad similarly for iformatio,
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013 Large Deviatios for i.i.d. Radom Variables Cotet. Cheroff boud usig expoetial momet geeratig fuctios. Properties of a momet
More informationMIDTERM 3 CALCULUS 2. Monday, December 3, :15 PM to 6:45 PM. Name PRACTICE EXAM SOLUTIONS
MIDTERM 3 CALCULUS MATH 300 FALL 08 Moday, December 3, 08 5:5 PM to 6:45 PM Name PRACTICE EXAM S Please aswer all of the questios, ad show your work. You must explai your aswers to get credit. You will
More informationLesson 10: Limits and Continuity
www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals
More informationNotes on Snell Envelops and Examples
Notes o Sell Evelops ad Examples Example (Secretary Problem): Coside a pool of N cadidates whose qualificatios are represeted by ukow umbers {a > a 2 > > a N } from best to last. They are iterviewed sequetially
More information1 The Haar functions and the Brownian motion
1 The Haar fuctios ad the Browia motio 1.1 The Haar fuctios ad their completeess The Haar fuctios The basic Haar fuctio is 1 if x < 1/2, ψx) = 1 if 1/2 x < 1, otherwise. 1.1) It has mea zero 1 ψx)dx =,
More informationSeunghee Ye Ma 8: Week 5 Oct 28
Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More informationSolutions to home assignments (sketches)
Matematiska Istitutioe Peter Kumli 26th May 2004 TMA401 Fuctioal Aalysis MAN670 Applied Fuctioal Aalysis 4th quarter 2003/2004 All documet cocerig the course ca be foud o the course home page: http://www.math.chalmers.se/math/grudutb/cth/tma401/
More informationLecture 8: Convergence of transformations and law of large numbers
Lecture 8: Covergece of trasformatios ad law of large umbers Trasformatio ad covergece Trasformatio is a importat tool i statistics. If X coverges to X i some sese, we ofte eed to check whether g(x ) coverges
More informationMath 220A Fall 2007 Homework #2. Will Garner A
Math 0A Fall 007 Homewor # Will Garer Pg 3 #: Show that {cis : a o-egative iteger} is dese i T = {z œ : z = }. For which values of q is {cis(q): a o-egative iteger} dese i T? To show that {cis : a o-egative
More information2.2. Central limit theorem.
36.. Cetral limit theorem. The most ideal case of the CLT is that the radom variables are iid with fiite variace. Although it is a special case of the more geeral Lideberg-Feller CLT, it is most stadard
More informationLecture 6: Integration and the Mean Value Theorem. slope =
Math 8 Istructor: Padraic Bartlett Lecture 6: Itegratio ad the Mea Value Theorem Week 6 Caltech 202 The Mea Value Theorem The Mea Value Theorem abbreviated MVT is the followig result: Theorem. Suppose
More informationLaw of the sum of Bernoulli random variables
Law of the sum of Beroulli radom variables Nicolas Chevallier Uiversité de Haute Alsace, 4, rue des frères Lumière 68093 Mulhouse icolas.chevallier@uha.fr December 006 Abstract Let be the set of all possible
More information2 Banach spaces and Hilbert spaces
2 Baach spaces ad Hilbert spaces Tryig to do aalysis i the ratioal umbers is difficult for example cosider the set {x Q : x 2 2}. This set is o-empty ad bouded above but does ot have a least upper boud
More informationHOMEWORK #10 SOLUTIONS
Math 33 - Aalysis I Sprig 29 HOMEWORK # SOLUTIONS () Prove that the fuctio f(x) = x 3 is (Riema) itegrable o [, ] ad show that x 3 dx = 4. (Without usig formulae for itegratio that you leart i previous
More informationMcGill University Math 354: Honors Analysis 3 Fall 2012 Solutions to selected problems
McGill Uiversity Math 354: Hoors Aalysis 3 Fall 212 Assigmet 3 Solutios to selected problems Problem 1. Lipschitz fuctios. Let Lip K be the set of all fuctios cotiuous fuctios o [, 1] satisfyig a Lipschitz
More informationAxioms of Measure Theory
MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that
More informationArchimedes - numbers for counting, otherwise lengths, areas, etc. Kepler - geometry for planetary motion
Topics i Aalysis 3460:589 Summer 007 Itroductio Ree descartes - aalysis (breaig dow) ad sythesis Sciece as models of ature : explaatory, parsimoious, predictive Most predictios require umerical values,
More informationStochastic Integrals and Itô s formula.
Chapter 5 Stochastic Itegrals ad Itô s formula. We will call a Itô process a progressively measurable almost surely cotiuous process x(t, ω) with values i R d, defied o some (Ω, F t, P) that is related
More informationAn introduction to stochastic integration with respect to continuous semimartingales
A itroductio to stochastic itegratio with respect to cotiuous semimartigales Alexader Sool Departmet of Mathematical Scieces Uiversity of Copehage Departmet of Mathematical Scieces Uiversity of Copehage
More informationMA131 - Analysis 1. Workbook 9 Series III
MA3 - Aalysis Workbook 9 Series III Autum 004 Cotets 4.4 Series with Positive ad Negative Terms.............. 4.5 Alteratig Series.......................... 4.6 Geeral Series.............................
More informationIntroductory Analysis I Fall 2014 Homework #7 Solutions
Itroductory Aalysis I Fall 214 Homework #7 Solutios Note: There were a couple of typos/omissios i the formulatio of this homework. Some of them were, I believe, quite obvious. The fact that the statemet
More information} is said to be a Cauchy sequence provided the following condition is true.
Math 4200, Fial Exam Review I. Itroductio to Proofs 1. Prove the Pythagorea theorem. 2. Show that 43 is a irratioal umber. II. Itroductio to Logic 1. Costruct a truth table for the statemet ( p ad ~ r
More informationx a x a Lecture 2 Series (See Chapter 1 in Boas)
Lecture Series (See Chapter i Boas) A basic ad very powerful (if pedestria, recall we are lazy AD smart) way to solve ay differetial (or itegral) equatio is via a series expasio of the correspodig solutio
More informationIntroduction to Functional Analysis
MIT OpeCourseWare http://ocw.mit.edu 18.10 Itroductio to Fuctioal Aalysis Sprig 009 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. LECTURE OTES FOR 18.10,
More informationThe Gamma function Michael Taylor. Abstract. This material is excerpted from 18 and Appendix J of [T].
The Gamma fuctio Michael Taylor Abstract. This material is excerpted from 8 ad Appedix J of [T]. The Gamma fuctio has bee previewed i 5.7 5.8, arisig i the computatio of a atural Laplace trasform: 8. ft
More information