Ito s Stochastic Calculus

Size: px
Start display at page:

Download "Ito s Stochastic Calculus"

Transcription

1 Chapter 6 Ito s Stochastc Calculus 6.1 Itroducto I Bacheler s frst applcatos of the Weer process o the modelg the fluctuato of asset prces, the prce of a asset at tme t, X t, has a ftesmal prce cremet dx t that s proportoal to the cremet dw t of the Weer process, dx t σ dw t, where σ s a postve costat. As a result, a asset wth tal prce X( x worths X t x + σw t at tme t. Ths model suffers from oe serous flaw: for ay t > the prce X t ca be egatve wth o-zero probablty (but actual stock prce are ever egatve. To tackle ths problem, later researchers assumed that the relatve prce dx t /X t of a asset s proportoal to dw t,.e., dx t σx t dw t. Formally, ths equato looks lke a dfferetal equato, but ths leads to a dffculty because the paths of W t are ot dfferetable (Theorem 5.. A way aroud the obstacle was foud by Ito the 194s. I hs theory of stochastc tegral ad stochastc dfferetal equatos (SDEs. Ito gave a rgorous meag to equatos such as the above, by wrtg them as equatos volvg a ew kd of tegrals. I partcular, the above equato ca be wrtte as t X t x + σ X s dw s, (6.1 where the tegral wth respect to W t o the rght-had sde s called the Ito stochastc tegral to be defed the ext secto. 99

2 1 6 Ito s Stochastc Calculus 6. Ito Stochastc Itegral 6..1 Motvato Motvated by (6.1, we costruct the Ito stochastc tegral the form t f s dw s for some stochastc process/radom fucto f (s ( f (s,ω, to be precse. We follow a approach smlar to costructg Rema tegral,.e., defe the tegral by the lmt of the dscretzed verso f (s (W t+1 W t, (6. where s [t,t +1 ]. The major dffereces betwee Rema ad Ito tegrato are 1. Rema tegrato results a real umber, but Ito tegrato results a radom varable (sce W t s radom. Thus, whle defg Rema tegral t volves covergece of real umbers, defg Ito tegral t requres the covergece of radom varables (6., whch s cosderably more dffcult.. If a Rema tegral exsts, the s ca be a arbtrary pot [t,t +1 sce the upper ad lower Rema sum coverges. However, Ito tegral, the lmt wll be dfferet depedg o the choce of s. Ths s due to the o-zero quadratc varato of the Browa moto W t. See Exercse 6.1. To avod the ambguty, the defto of stochastc tegrals wll fx the choce s t for each the approxmatg sum (6.. The choce s t s atural f we regard f (t as the tradg strategy ad W t s the stock prce: For the + 1-th perod, the tradg strategy should oly deped o the formato up to tme t. Hece, f (t s vested to the stock, yeldg a proft of f (t (W t+1 W t. Therefore, f (t (W t+1 W t represets the total proft. Remark 6.1. (Prevsble To be precse, defg stochastc tegral we requre the Itegrad f (t to be prevsble or predctable,.e., f (t s F t for all t where F t s<t F s. However, t ca be show that f f (t s cotuous ad adapted to F t, the f (t s automatcally prevsble. Sce we maly deal wth cotuous tegrad, we do ot dstgush betwee prevsble ad adapted process. 6.. Ito Itegral The Ito tegral s a radom varable sce W t ad the tegrad f (t are radom. To esure regularty of the Ito tegral (such as the exstece of the frst ad the secod momets, we restrct f (t to the followg class of stochastc processes. Defto 6.1. (M Stochastc Process Deote MT to be the class of stochastc processes f (t, t, such that

3 6. Ito Stochastc Itegral 11 ( E f (t dt <. Let M be the class of stochastc processes f (t such that f (t M for ay T >. Recall that we say a radom varable X s L, or X L, f E X <. Both M ad L are related to the exstece of secod momet, but M s for a stochastc process ad L s for a radom varable. Sce the Ito tegral s a radom varable ad the tegrad s a radom fucto (stochastc process, we eed to defe the measure of legth ad the mode of covergece defg the tegral by a lmt of a dscretzato (6.. Defto 6.. (L ad MT Norm For a radom varable X ad a stochastc process f f (t, the L ad MT Norm are gve respectvely by ( X L E(X ad f M E f (t dt. (6.3 T Defto 6.3. (L ad MT {X } coverges L to X f Covergece A sequece of radom varables X X L E( X X. A sequece of radom fuctos / stochastc processes { f (t} coverges MT to f f for ay T, ( f f M E f (t f (t dt. T Smlarly, { f (t} coverges M to f f { f (t} coverges to f MT for all T. Wth defto 6.1 ad 6.3, we defe the Ito Itegral o the class of stochastc process M as follows: Defto 6.4. (Ito Itegral For ay T > ad ay stochastc process f M, the stochastc tegral of f o [,T ] s defed by I T ( f lm j f (t j ( W(t j+1 W(t j, where ( t < t 1 < < t < t T s ay partto of (,T wth max j t j t j 1 as. We wrte I( f as I T ( f f (tdw t, ( or f dw.

4 1 6 Ito s Stochastc Calculus The followg theorem justfes the above defto of Ito tegral. Theorem 6.1. (Exstece ad Uqueess of Ito Itegral Suppose that a fucto f M satsfes the followg assumptos A1 f (t s almost surely cotuous,.e., P(lm ε f (t + ε f (t 1, A f (t s adapted to the fltrato {F t }, where F t σ({w s,s < t}. The, for ay T >, the Ito tegral exsts ad s uque almost everywhere. Proof. The proof proceeds three steps: I T ( f f (tdw t 1 Costruct a sequece of adapted stochastc processes f such that f f M. Show that I T ( f I T ( f L. 3 Show the a.s. uqueess of the lmt I T ( f. To beg, 1 Frst we fd a sequece of M T fuctos f 1, f,... such that f f M T E( f (t f (t dt. Defe f (t { k k 1 f s ds f t [ k, k+1 for k 1,,...,[T ] 1, otherwse. The by costructo f (t s adapted to F t ad s a step fucto for each ω. (Fucto of ths kd s called radom step fucto. Sce t s radom, to be precse, t has to be deoted by f (t f (t,ω. Note that k+1 k f (t dt k k 1 f (tdt k f (t dt,a.s. (6.4 k 1 by Cauchy Schwartz (CS equalty. The above equalty holds almost surely as CS s appled for each ω f (t,ω. Next we show f f M T E( f (t f (t dt. By the a.s. cotuty of f (t, we have lm f (t f (t dt a.s. (6.5 Let Y f (t f (t a.s. dt. Note that (6.5 meas that lm Y. Note also that ( Y f (t + f (t T dt 4 f (t dt Ȳ,

5 6. Ito Stochastc Itegral 13 where the secod equalty follows from summg over all k (6.4. Sce a.s. Y ad Y Ȳ a.s., we ca apply Domat Covergece Theorem (DCT to obta E(Y,.e., f f M E( T f (t f (t dt. (6.6 To show the exstece of Ito Itegral, we eed to show that I T ( f f (tdw t coverges to a elemet L. Sce f (t s a step fucto takg costat values [ k, k+1, we ca wrte Note that ( k ( I T ( f f Wk+1 Wk. k 1 E E I T ( f L ( k 1 ( k 1 j 1 f ( k ( Wk+1 f ( k ( k f E( k 1E ( ( k E f E k 1 f (t dt Wk f ( j ( Wk+1 Wk+1 1 Wk Wk (W j+1 W j (Idepedet Icremet ad f ( k (sce E(W t t F k f M T. (6.7 Smlarly, t ca be show that I T ( f I T ( f m L f f m M T. (6.8 From (6.6, for ay ε >, there s a N such that f f M < ε T for all > N. Thus for,m > N, I T ( f I T ( f m L f f m M T f f M T + f m f M T (Tragular Iequalty ε + ε ε.

6 14 6 Ito s Stochastc Calculus The sequece {I T ( f } 1 wth the property I T ( f I T ( f m L for,m s called a (Cauchy sequece. It s well kow Mathematcal Aalyss that ay Cauchy Sequece L has a lmt. Call the lmt I T ( f. 3 Fally, we show the uqueess of the lmt. Suppose that there are sequeces of processes { f (1 } 1 ad { f ( } 1 satsfyg E( ( j f (t f dt for j 1,. We eed to show that I T ( f ( j coverge to the same lmt for j 1,. Itroduce a ew sequece {g } { f (1 1, f ( 1, f (1, f (, f (1 3,...}. The {g } satsfes E( f (t g dt. Therefore, the above proof shows that I(g coverges to some lmt. Note that f a sequece coverges, the every subsequece coverges to the same lmt (Exercse 6.. Thus I T ( f (1 ad I T ( f ( do coverge to the same lmt, completg the proof of uqueess. Note that the above uqueess s proved L sese,.e., I T ( f (1 I T ( f ( L, sce I T ( f (1 I T ( f ( L I T ( f (1 I T (g L + I T (g I T ( f ( L for all ad the quatty o the rght s arbtrarly small. However, I T ( f (1 I T ( f ( L mples that I T ( f (1 I T ( f ( almost surely (See Exercse Thus the defto of Ito s tegral s uque a.s.. Example 6.1. To show the exstece of W t dw t, we eed to show that the Weer process W t belogs to M. Sce for all T ( E W t dt E( W t dt t dt <. Thus W t belogs to M. Also, we have see from Chapter 5 that W t satsfes Assumptos A1 ad A of Theorem 6.1. Hece the exstece of the Ito tegral W t dw t s justfed. Example 6.. We derve the formula W t dw t 1 W t 1 T drectly from the defto,.e. by approxmatg the tegrad by radom step fuctos. Fx T > ad t T, set f W t 1 [t,t +1. The the sequece f 1, f, MT approxmates f, sce

7 6.3 Propertes of the Stochastc Itegral 15 ( E f t f (t dt t +1 t t +1 t E ( W t W(t dt (t t dt 1 ( t +1 t 1 T as. From Theorem 6.1, lm I T ( f exsts L sese. To fd a explct formula of the lmt, ote from the equato a(b a 1 (b a 1 (b a that I T ( f 1 W t ( W t +1 W t [ 1 W T 1 ( Wt +1 W t (W t +1 W t ] (W t +1 W t 1 W T 1 T L as. The last covergece follows from the fact that the quadratc varato of Weer process s T. Therefore, we coclude that W t dw t I T ( f 1 W T 1 T. 6.3 Propertes of the Stochastc Itegral The basc propertes of the Ito tegral are summarzed the theorem below: Theorem 6.. The followgs propertes hold for ay f,g M, ay α,β R ad ay s < t: 1. Learty: t. Isometry: t t (α f (r + βg(r dw(r α f (rdw(r + β g(rdw(r; (6.9 t E( ( t f (rdw(r E f (r dr ; (6.1

8 16 6 Ito s Stochastc Calculus 3. Martgale Property: ( t E f (rdw(r F s I partcular, E ( t f (rdw(r. s f (rdw(r. Proof. 1. If f ad g belog to M, the from the proof of Theorem 6.1, they ca be approxmated by some sequeces f 1, f, ad g 1,g,. From Defto 6.4, t s clear that, for each, I(α f + βg j ( f (t j + g(t j (W t j+1 W t j αi( f + βi(g, where {t j } j1,... s the grd where both f ad g are costat each terval (t j 1,t j. Takg lmt o both sdes of ths equalty as, we obta I(α f + βg αi( f + βi(g. whch s (6.9.. The word Isometry meas a equalty uder dfferet metrcs. Note that (6.1 ca be wrtte as I t ( f L f M T, whch meas the Ito tegral coects the two metrcs L ad M. The proof of (6.1 follows by observg that I t ( f I t ( f L, f f M ad (6.7 the proof of Theorem Followg the proof of Theorem 6.1, we ca fd a radom step fucto f approxmatg f such that I t ( f I t ( f L. W.L.O.G., we ca assume s t k for some k. (addg a extra pot stll gves a step fucto. Thus E E(I t ( f F s ( j f (t j 1 (W t j W t j 1 F s k f (t j 1 (W t j W t j 1 + E( f (t j 1 (W t j W t j 1 F s j jk+1 k f (t j 1 (W t j W t j 1 (by depedet cremet ad t k s j I s ( f. (6.11 The same argumet the proof of Theorem 6.1 yelds I s ( f I s ( f L. O the other had, we have E(I t ( f F s L E(I t ( f F s, sce

9 6.4 Ito s Lemma 17 E [ (E(I t ( f F s E(I t ( f F s ] E [ (E(I t ( f I t ( f F s ] E ( E((I t ( f I t ( f F s (Jese s Iequalty E((I t ( f I t ( f (Tower Property. By takg lmt o both sdes of Equato (6.11, we have completg the proof. E(I t ( f F s I s ( f, ( Ito s Lemma I ths secto we prove the Ito s Lemma whch s the foudato of mathematcal face ad stochastc calculus The case F(t,W t Theorem 6.3. (Ito s Lemma Suppose that F(t, x s a real valued fucto wth cotuous partal dervatves F t (t,x, F x (t,x ad F xx (t,x for all t ad x R. Assume also that the process F x (t,w t belogs to M. The F(t,W t satsfes F(T,W t F(,W( [ F t (t,w t + 1 ] F xx(t,w t dt + F x (t,w t dw t, a.s. (6.13 I dfferetal otato, (6.13 ca be wrtte as [ df(t,w t F t (t,w t + 1 ] F xx(t,w t dt + F x (t,w t dw t. (6.14 Remark Compare (6.14 wth the usual cha rule df(t,x t F t (t,x t dt + F x (t,x t dx t for a dfferetable fucto x t. The addtoal term 1 F xx(t,w t dt (6.14 s called the Ito correcto.. Equato (6.14 s ofte wrtte the abbrevated form

10 18 6 Ito s Stochastc Calculus ( df F t + 1 F xx dt + F x dw t. (6.15 Strctly speakg, the dfferetal otato (6.14 does ot make sese due to the o-dfferetablty of Browa Moto (dw t s udefed. Proof. We frst prove oly the case where F, F x, F xx are all bouded by some C >. Cosder a partto of [,T ], t < t 1 < < t T, where t T. Deote W t by W ; the cremets W +1 W by W; ad t +1 t by t. Usg Taylor s expaso, there s a pot W each terval [W,W +1 ] ad a pot t each terval [t,t +1 ] such that F(T,W t F(,W( [ F(t +1,W+1 F(t,W ] [ F(t +1,W+1 F(t,W+1 ] + F( t,w +1 t + F( t,w+1 t + 1 F x (t,w W + 1 F xx (t,w [ F(t,W +1 F(t,W ] t + F xx (t, W ( W F x (t,w W + 1 [ ] F xx (t,w ( W t + 1 [ ] F xx (t, W F xx (t,w ( W. A 1, + A, + A 3, + A 4, + A 5,, (6.16 say. Note that as F t,f x, F xx ad W t are cotuous ad bouded fuctos, we have lm sup 1,..., lm sup 1,..., lm sup F t ( t t [t,t +1 ],W F t (t,w t a.s., (6.17 sup F xx (t t [t,t +1 ],W F xx (t,w t, a.s., (6.18 sup 1,..., Now we deal separately wth each sum (6.16: F xx (t, W F xx (t,w a.s.. ( From the cotuty of the F t ad F xx (6.17 ad (6.18, we have the covergece of the Rema tegral lm A 1, lm lm A, lm F t ( t,w+1 t F t (t,w t dt F xx (t,w t F xx (t,w t dt a.s., ad a.s.

11 6.4 Ito s Lemma 19. From the assumpto F x M, we have lm A 3, lm F x (t,w W F x (t,w t dw t L from Theorem We show the L covergece E(A 4,. To be specfc, E(A 4, E ( [ ] F xx (t,w ( W t EF xx (t,w [ ] ( W t (cross term has expectato E F xx (t,w E( W t (depedet cremet C E( W t (boudedess of F xx C ( t C T T C as. 4. Note that ( W t L ad thus probablty (See Exercse 6.13 sce the left quatty s the quadratc varato of Browa Moto. Together wth the cotuty result (6.18, we have the followg covergece ( probablty: A 5, sup [ ] F xx (t, W F xx (t,w ( W F xx (t, W +1 F xx(t,w+1 ( W P. Note that the covergece of A,, 1,...,5 volve dfferet modes: A 1, ad A, coverge almost surely, A 3,, A 4, coverge L, ad A 5, coverges probablty. To combe the results, ote from Exercse 6.13 that coverget L mples coverget probablty. Thus all A 3,, A 4, ad A 5, coverge probablty. Note also from Exercse 6.14 that there s a subsequece { k } k1,,... such that {A 3,k } k1,,... coverge a.s. Alog ths subsequece, we ca fd a further subsequece kl such that A 4,kl coverges a.s., ad so forth. Fally, all A j,, j 1,...,5 coverge a.s. wth respect to some subsequece m 1 < m <, say. The

12 11 6 Ito s Stochastc Calculus F(T,W t F(,W( { mk 1 lm k F( t m k,w m k +1 m k t + 1 m k m k 1 m k 1 F xx (t m k,w m k + 1 F xx (t m k [ F t (t,w t + 1 F xx(t,w t [, W m k ] [ ( m k F xx (t m k,w m k m m k 1 k t + W ] m k t ] F xx (t m k,w m k ( m k W }. dt + F x (t,w t dw t, completg the proof. The geeral case where F deferred to Exercse 6.6. t,f a.s., F x (t m k,w m k m k W x ad F xx are ot bouded s Example 6.3. For F(t,x x, we have F t (t,x, F x (t,x x ad F xx (t,x. Ito formula gves dwt dt + W t dw t, provded that W t M (whch has bee verfed Example Geeral Case Note that, Ito s Lemma ams at provdg a frst order approxmato for df(t,w t usg the term dt ad dw t. I the Taylor s seres expaso of F(t,W t up to the terms wth partal dervatves of order two, dt,dw t,dtdw t,(dt,(dw t,... are volved. Sce the quadratc varato of W t s [W] t t, t follows that the term (dw t cotrbuto to a addtoal dt term. Other terms such as dtdw t,(dt,(dw t 3 wth order smaller tha dt ca thus be omtted. It s coveet to remember the results usg the so-called Ito multplcato table (Table 6.1: dt dw t dt dw t dt Table 6.1 Ito multplcato table. Lookg closely to the proof of Theorem 6.3, t ca be see that Ito s Lemma ca be exteded from F(t,W t to F(t,X t where X t s a arbtrary process wth quadratc varato [X] t satsfyg d[x] t g(tdt, for some g(t M. For example, f X t s a Ito Process gve by dx t a t dt + b t dw t, (6.

13 6.4 Ito s Lemma 111 where a t L 1 ad b t M, the t ca be checked (Exercse 6.15 that d[x] t b t dt. (Iformally, we ca use Table 6.1 to see that d[x] t (dx (a t dt +b t dw a t (dt +a t b t (dt(dw+b t (dw b t dt. The followg Theorem gves the geeral case of Ito s Lemma for F(t,X t, where X t s a arbtrarly process stead of Browa moto. Theorem 6.5. (Ito formula, geeral case Let X t be a stochastc process wth quadratc varato [X] t satsfyg d[x] t g(tdt where g(t M. Suppose that F(t,x, F t (t,x, F x (t,x ad F xx (t,x are cotuous for all t ad x R. Also the process g t F x (t,x t M. The F(t,X t s ca be expressed as df(t,x t F t (t,x t dt + F x (t,x t dx t + 1 F xx(t,x t d[x] t. (6.1 Example 6.4. If X t s a Ito process satsfyg (6., the (6.1 reduces to (wrtg F(t,X t as F df F t dt + F x dx + 1 F xx d[x] t F t dt + F x (a t dt + b t dw + 1 F xxbt dt ( F t + F x a t + 1 F xxbt dt + F x b t dw. We ed ths secto wth the aalog of the product rule d f (xg(x f (xdg(x+ g(xd f (x stochastc calculus. Aga, there s a addtoal term of dt cotrbuted by the quadratc varato process. Corollary 6.1. (Product Rule If X t ad Y t are process satsfyg dx t a x (tdt + b x (tdw t ad dy t a y (tdt + b y (tdw t, the Proof. For a small t, dx t Y t X t dy t +Y t dx t + b x (tb y (tdt. X t+ t Y t+ t X t Y t X t (Y t+ t Y t +Y t (X t+ t X t + (Y t+ t Y t (X t+ t X t As, by defto, X t+ t Y t+ t X t Y t dx t Y t, X t+ t X t dx t ad Y t+ t Y t dy t. Thus Corollary 6.1 follows by otg from Table 6.1 that (Y t+ t Y t (X t+ t X t (a y (tdt + b y (tdw t (a x (tdt + b x (tdw t b x (tb y (tdt. Note that the formal proof ca be obtaed by smlar argumet as Theorem 6.1.

14 11 6 Ito s Stochastc Calculus 6.5 Stochastc Dfferetal Equatos I ths secto, we cosder stochastc dfferetal equato of the form dx t f (X t dt + g(x t dw t wth the tal codto X x. The goal s to obta a explct formula for X t. Example 6.5. Cosder the tal value problem { dxt αx t dt + σ dw t, X x R, Take F(t,x e αt x, wth F(,X, by Ito s Lemma we have df(t,x t [ αe αt X t αe αt X t ] dt + σe αt dw t σe αt dw t. It s easy to see that e αt M. It follows that F(t,X t x + σ t eαs dw s ad t X t e αt F(t,X t e αt x + σe αt e αs dw s. Example 6.6. Suppose X t x e at+bw t for t. By Ito formula, ( dx t d x e at+bw t (ax e at+bw t + b x e at+bw t dt + bx e at+bw t dw t (a + b X t dt + bx t dw t. The problem of checkg that bx t M for all T > s left to the reader Exercse Ths mples the soluto of the tal value problem { ( dx t a + b X t dt + bx t dw t, X x s X t x e at+bw t. From the above examples, to solve a SDE, we eed to guess a soluto ad use Ito s Lemma to verfy that the soluto satsfes the SDE. The below table summarzes some examples ad solutos of SDE. I the table, c stads for a costat ad sh (e x e x /.

15 6.5 Stochastc Dfferetal Equatos 113 Name SDE Soluto Orste-Uhlebeck(OU process dx t αx t dt + σw t c + σe αt t eαs dw s Mea revertg OU dx t (m αx t dt + σw t m (c me t + σ t es t db s Geometrc Browa Moto dx t ax t dt + bx t dw t ce (a b /t+bw t Browa Brdge dx t b X t 1 t dt +W t a(1 t + bt + (1 t t dw s ( 1 s dx t 1 + X t + 1 X t dt Xt dw t sh(c +t +W t dx t Xt 3 dt + Xt 1 dw t 1 W t dx t 1 X tdt + 1 Xt dw t s(c +W t dx t 1+t 1 X tdt + 1+t 1 dw t W t /(1 +t dx t rdt + αx t dw t ce αw t 1 αt + r t eα(b t B s 1 α (t s ds

16 14 6 Ito s Stochastc Calculus 6.9 Exercses Exercse 6.1. Let t < t 1 < < t T, where t j jt, be a partto of the terval [,T ] to equal parts. Usg the detty a(b a 1 ( b a 1 (a b ad Theorem 5.14, show that lm j Usg the detty b(b a 1 Fd the lmt for p (,1. lm j lm j W(t j ( W(t j+1 W(t j 1 W t T. (6.44 ( b a + 1 (a b ad Theorem 5.14, show that W(t j+1 ( W(t j+1 W(t j 1 W t + T. (6.45 W(pt j+1 + (1 pt j ( W(t j+1 W(t j (6.46 Exercse 6.. Show that f a sequece coverges to some lmt, the every subsequece coverges to the same lmt. Exercse 6.3. Show that W t Exercse 6.4. Verfy the equaltes ad belogs to M, where W t s a Weer process. t dw t TW t W t dt, (6.47 Wt dw t 1 3 W t 3 W t dt. (6.48 Note that the tegral o the rght-had sde s a Rema tegral defed path-wse,.e. separately for each ω Ω. Exercse 6.5. Suppose that g(x s a cotuous, ad wth t T /, t < t 1 < < t T s a partto of [,T ]. Show that lm sup 1,..., sup t [t,t +1 ] g(t g(t. If T, does the covergece hold? Prove t or gve a couter example. Therefore the Ito s Lemma ca be appled to F. Exercse 6.6. (Geeral Case of Ito s Lemma Suppose that ψ (x s a smooth fucto satsfyg ψ (x 1 for ay x [,] ad ψ (x for x / [ 1, + 1]. Let F (t,x ψ (xf(t,x, show that F (t,x satsfes the codtos of Theorem 6.3 ad has bouded partal dervatves (F x ad (F xx for each.

17 6.9 Exercses 15 Sce F(t,x F (t,x for every t [,T ] ad x [,], the Ito s Lemma holds for F o the set A {sup t [,T ] W t < }. By show that lm P(A 1, deduce that Ito s Lemma holds for F almost surely. Exercse 6.7. For F(t,x x 3 we have F t (t,x, F x (t,x 3x ad F xx (t,x 6x. Verfy that 3Wt MT ad use Ito s Lemma to show the equalty d ( Wt 3 3Wt dt + 3Wt dw t. Exercse 6.8. Show that the expoetal martgale X t exp { W t t } s satsfes dx t X t dw t. Exercse 6.9. Show that the tal value problem { dxt ax t dt + bx t dw t, X( x {( has a soluto gve by X t x exp Exercse 6.1. Show Equato 6.3. a b t + bw t }. Exercse Show that for ay two radom varables X ad Y, X Y L mples X Y a.s.. Cosder a sequece of radom varables X. If X X L, does t mply X X a.s.? Prove or gve couter examples. Exercse 6.1. Use Ito s Lemma to compute E(W 6 t. Exercse Let X ad {X (ω} 1 be radom varables o a probablty space (Ω,F,P. Recall the three mode of covergece of a sequece of radom varables {X } to X. (Almost Surely, a.s.: P(ω : lm X (ω X(ω 1. (Probablty: For each ε >, lm P( X (ω X(ω > ε. (L : lm E( X X. Show that 1. By rewrtg the lmt otato as uo/tersect operato, show that coverget a.s. mples coverget probablty.. By cosderg the equalty 1 { Y >a} Y 1 a { Y >a} Y a.s., show that coverget L mples coverget probablty. a 3. Fd a example where X coverges to X a.s. but ot L. Hts: X (ω takes o-zero values a decreasg porto of Ω, but the value s huge whe o-zero. 4. Fd a example where X coverges to X L but ot a.s.. Hts: X (ω takes o-zero values a decreasg porto of Ω. The value s bouded whe X (ω s o-zero. But the subset of Ω where X (ω s o-zero s movg aroud so that for each ω there are fte may such that X (ω s o-zero.

18 16 6 Ito s Stochastc Calculus Exercse Use the otato Exercse Recall the Frst Borel-Catell Lemma that P( 1 j A j f 1 P(A <. 1. Let A j { X j X > j }. Show that P( 1 j A j mples X j a.s. X.. Suppose that X p X. Show that there s a subsequece X j of X such that P( X j X > j < j alog the subsequece. 3. Show that, f X coverges to X probablty, the there s some subsequece such that X j coverges to X a.s.. Exercse Fd the quadratc varato of X t where X t s a Ito s process satsfyg (6.. Show that d[x] t b(tdt. Exercse Gve X t x e at+bw t, where a,b R, verfy that X t M. Exercse Let S t follows the Geometrc Browa Moto model (6.4, prove that 1. the desty fucto f (x of S t S s gve by 1 f (x exp πtσx [ ( lx µ σ σ t t ] 1 R +(x.. ES t S exp{µt}. 3. Var(S t S exp{µt}( exp { σ t } 1.

X ε ) = 0, or equivalently, lim

X ε ) = 0, or equivalently, lim Revew for the prevous lecture Cocepts: order statstcs Theorems: Dstrbutos of order statstcs Examples: How to get the dstrbuto of order statstcs Chapter 5 Propertes of a Radom Sample Secto 55 Covergece

More information

Chapter 5 Properties of a Random Sample

Chapter 5 Properties of a Random Sample Lecture 6 o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for the prevous lecture Cocepts: t-dstrbuto, F-dstrbuto Theorems: Dstrbutos of sample mea ad sample varace, relatoshp betwee sample mea ad sample

More information

. The set of these sums. be a partition of [ ab, ]. Consider the sum f( x) f( x 1)

. The set of these sums. be a partition of [ ab, ]. Consider the sum f( x) f( x 1) Chapter 7 Fuctos o Bouded Varato. Subject: Real Aalyss Level: M.Sc. Source: Syed Gul Shah (Charma, Departmet o Mathematcs, US Sargodha Collected & Composed by: Atq ur Rehma (atq@mathcty.org, http://www.mathcty.org

More information

Mu Sequences/Series Solutions National Convention 2014

Mu Sequences/Series Solutions National Convention 2014 Mu Sequeces/Seres Solutos Natoal Coveto 04 C 6 E A 6C A 6 B B 7 A D 7 D C 7 A B 8 A B 8 A C 8 E 4 B 9 B 4 E 9 B 4 C 9 E C 0 A A 0 D B 0 C C Usg basc propertes of arthmetc sequeces, we fd a ad bm m We eed

More information

The Mathematical Appendix

The Mathematical Appendix The Mathematcal Appedx Defto A: If ( Λ, Ω, where ( λ λ λ whch the probablty dstrbutos,,..., Defto A. uppose that ( Λ,,..., s a expermet type, the σ-algebra o λ λ λ are defed s deoted by ( (,,...,, σ Ω.

More information

Complete Convergence and Some Maximal Inequalities for Weighted Sums of Random Variables

Complete Convergence and Some Maximal Inequalities for Weighted Sums of Random Variables Joural of Sceces, Islamc Republc of Ira 8(4): -6 (007) Uversty of Tehra, ISSN 06-04 http://sceces.ut.ac.r Complete Covergece ad Some Maxmal Iequaltes for Weghted Sums of Radom Varables M. Am,,* H.R. Nl

More information

Discrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b

Discrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b CS 70 Dscrete Mathematcs ad Probablty Theory Fall 206 Sesha ad Walrad DIS 0b. Wll I Get My Package? Seaky delvery guy of some compay s out delverg packages to customers. Not oly does he had a radom package

More information

Extreme Value Theory: An Introduction

Extreme Value Theory: An Introduction (correcto d Extreme Value Theory: A Itroducto by Laures de Haa ad Aa Ferrera Wth ths webpage the authors ted to form the readers of errors or mstakes foud the book after publcato. We also gve extesos for

More information

Lecture 9: Tolerant Testing

Lecture 9: Tolerant Testing Lecture 9: Tolerat Testg Dael Kae Scrbe: Sakeerth Rao Aprl 4, 07 Abstract I ths lecture we prove a quas lear lower boud o the umber of samples eeded to do tolerat testg for L dstace. Tolerat Testg We have

More information

5 Short Proofs of Simplified Stirling s Approximation

5 Short Proofs of Simplified Stirling s Approximation 5 Short Proofs of Smplfed Strlg s Approxmato Ofr Gorodetsky, drtymaths.wordpress.com Jue, 20 0 Itroducto Strlg s approxmato s the followg (somewhat surprsg) approxmato of the factoral,, usg elemetary fuctos:

More information

Functions of Random Variables

Functions of Random Variables Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,

More information

Point Estimation: definition of estimators

Point Estimation: definition of estimators Pot Estmato: defto of estmators Pot estmator: ay fucto W (X,..., X ) of a data sample. The exercse of pot estmato s to use partcular fuctos of the data order to estmate certa ukow populato parameters.

More information

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers

More information

Chapter 4 Multiple Random Variables

Chapter 4 Multiple Random Variables Revew for the prevous lecture: Theorems ad Examples: How to obta the pmf (pdf) of U = g (, Y) ad V = g (, Y) Chapter 4 Multple Radom Varables Chapter 44 Herarchcal Models ad Mxture Dstrbutos Examples:

More information

Laboratory I.10 It All Adds Up

Laboratory I.10 It All Adds Up Laboratory I. It All Adds Up Goals The studet wll work wth Rema sums ad evaluate them usg Derve. The studet wll see applcatos of tegrals as accumulatos of chages. The studet wll revew curve fttg sklls.

More information

CHAPTER 4 RADICAL EXPRESSIONS

CHAPTER 4 RADICAL EXPRESSIONS 6 CHAPTER RADICAL EXPRESSIONS. The th Root of a Real Number A real umber a s called the th root of a real umber b f Thus, for example: s a square root of sce. s also a square root of sce ( ). s a cube

More information

Bounds on the expected entropy and KL-divergence of sampled multinomial distributions. Brandon C. Roy

Bounds on the expected entropy and KL-divergence of sampled multinomial distributions. Brandon C. Roy Bouds o the expected etropy ad KL-dvergece of sampled multomal dstrbutos Brado C. Roy bcroy@meda.mt.edu Orgal: May 18, 2011 Revsed: Jue 6, 2011 Abstract Iformato theoretc quattes calculated from a sampled

More information

1 Lyapunov Stability Theory

1 Lyapunov Stability Theory Lyapuov Stablty heory I ths secto we cosder proofs of stablty of equlbra of autoomous systems. hs s stadard theory for olear systems, ad oe of the most mportat tools the aalyss of olear systems. It may

More information

A Remark on the Uniform Convergence of Some Sequences of Functions

A Remark on the Uniform Convergence of Some Sequences of Functions Advaces Pure Mathematcs 05 5 57-533 Publshed Ole July 05 ScRes. http://www.scrp.org/joural/apm http://dx.do.org/0.436/apm.05.59048 A Remark o the Uform Covergece of Some Sequeces of Fuctos Guy Degla Isttut

More information

Lecture 3 Probability review (cont d)

Lecture 3 Probability review (cont d) STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto

More information

CS286.2 Lecture 4: Dinur s Proof of the PCP Theorem

CS286.2 Lecture 4: Dinur s Proof of the PCP Theorem CS86. Lecture 4: Dur s Proof of the PCP Theorem Scrbe: Thom Bohdaowcz Prevously, we have prove a weak verso of the PCP theorem: NP PCP 1,1/ (r = poly, q = O(1)). Wth ths result we have the desred costat

More information

Lecture Note to Rice Chapter 8

Lecture Note to Rice Chapter 8 ECON 430 HG revsed Nov 06 Lecture Note to Rce Chapter 8 Radom matrces Let Y, =,,, m, =,,, be radom varables (r.v. s). The matrx Y Y Y Y Y Y Y Y Y Y = m m m s called a radom matrx ( wth a ot m-dmesoal dstrbuto,

More information

Law of Large Numbers

Law of Large Numbers Toss a co tmes. Law of Large Numbers Suppose 0 f f th th toss came up H toss came up T s are Beroull radom varables wth p ½ ad E( ) ½. The proporto of heads s. Itutvely approaches ½ as. week 2 Markov s

More information

1 Solution to Problem 6.40

1 Solution to Problem 6.40 1 Soluto to Problem 6.40 (a We wll wrte T τ (X 1,...,X where the X s are..d. wth PDF f(x µ, σ 1 ( x µ σ g, σ where the locato parameter µ s ay real umber ad the scale parameter σ s > 0. Lettg Z X µ σ we

More information

Part 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971))

Part 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971)) art 4b Asymptotc Results for MRR usg RESS Recall that the RESS statstc s a specal type of cross valdato procedure (see Alle (97)) partcular to the regresso problem ad volves fdg Y $,, the estmate at the

More information

Strong Convergence of Weighted Averaged Approximants of Asymptotically Nonexpansive Mappings in Banach Spaces without Uniform Convexity

Strong Convergence of Weighted Averaged Approximants of Asymptotically Nonexpansive Mappings in Banach Spaces without Uniform Convexity BULLETIN of the MALAYSIAN MATHEMATICAL SCIENCES SOCIETY Bull. Malays. Math. Sc. Soc. () 7 (004), 5 35 Strog Covergece of Weghted Averaged Appromats of Asymptotcally Noepasve Mappgs Baach Spaces wthout

More information

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution: Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed

More information

= lim. (x 1 x 2... x n ) 1 n. = log. x i. = M, n

= lim. (x 1 x 2... x n ) 1 n. = log. x i. = M, n .. Soluto of Problem. M s obvously cotuous o ], [ ad ], [. Observe that M x,..., x ) M x,..., x ) )..) We ext show that M s odecreasg o ], [. Of course.) mles that M s odecreasg o ], [ as well. To show

More information

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions.

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions. Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos

More information

Lecture 02: Bounding tail distributions of a random variable

Lecture 02: Bounding tail distributions of a random variable CSCI-B609: A Theorst s Toolkt, Fall 206 Aug 25 Lecture 02: Boudg tal dstrbutos of a radom varable Lecturer: Yua Zhou Scrbe: Yua Xe & Yua Zhou Let us cosder the ubased co flps aga. I.e. let the outcome

More information

A tighter lower bound on the circuit size of the hardest Boolean functions

A tighter lower bound on the circuit size of the hardest Boolean functions Electroc Colloquum o Computatoal Complexty, Report No. 86 2011) A tghter lower boud o the crcut sze of the hardest Boolea fuctos Masak Yamamoto Abstract I [IPL2005], Fradse ad Mlterse mproved bouds o the

More information

9 U-STATISTICS. Eh =(m!) 1 Eh(X (1),..., X (m ) ) i.i.d

9 U-STATISTICS. Eh =(m!) 1 Eh(X (1),..., X (m ) ) i.i.d 9 U-STATISTICS Suppose,,..., are P P..d. wth CDF F. Our goal s to estmate the expectato t (P)=Eh(,,..., m ). Note that ths expectato requres more tha oe cotrast to E, E, or Eh( ). Oe example s E or P((,

More information

Special Instructions / Useful Data

Special Instructions / Useful Data JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth

More information

Chapter 2 - Free Vibration of Multi-Degree-of-Freedom Systems - II

Chapter 2 - Free Vibration of Multi-Degree-of-Freedom Systems - II CEE49b Chapter - Free Vbrato of Mult-Degree-of-Freedom Systems - II We ca obta a approxmate soluto to the fudametal atural frequecy through a approxmate formula developed usg eergy prcples by Lord Raylegh

More information

18.657: Mathematics of Machine Learning

18.657: Mathematics of Machine Learning 8.657: Mathematcs of Mache Learg Lecturer: Phlppe Rgollet Lecture 3 Scrbe: James Hrst Sep. 6, 205.5 Learg wth a fte dctoary Recall from the ed of last lecture our setup: We are workg wth a fte dctoary

More information

Chapter 3 Sampling For Proportions and Percentages

Chapter 3 Sampling For Proportions and Percentages Chapter 3 Samplg For Proportos ad Percetages I may stuatos, the characterstc uder study o whch the observatos are collected are qualtatve ature For example, the resposes of customers may marketg surveys

More information

Homework 1: Solutions Sid Banerjee Problem 1: (Practice with Asymptotic Notation) ORIE 4520: Stochastics at Scale Fall 2015

Homework 1: Solutions Sid Banerjee Problem 1: (Practice with Asymptotic Notation) ORIE 4520: Stochastics at Scale Fall 2015 Fall 05 Homework : Solutos Problem : (Practce wth Asymptotc Notato) A essetal requremet for uderstadg scalg behavor s comfort wth asymptotc (or bg-o ) otato. I ths problem, you wll prove some basc facts

More information

Research Article A New Iterative Method for Common Fixed Points of a Finite Family of Nonexpansive Mappings

Research Article A New Iterative Method for Common Fixed Points of a Finite Family of Nonexpansive Mappings Hdaw Publshg Corporato Iteratoal Joural of Mathematcs ad Mathematcal Sceces Volume 009, Artcle ID 391839, 9 pages do:10.1155/009/391839 Research Artcle A New Iteratve Method for Commo Fxed Pots of a Fte

More information

4 Inner Product Spaces

4 Inner Product Spaces 11.MH1 LINEAR ALGEBRA Summary Notes 4 Ier Product Spaces Ier product s the abstracto to geeral vector spaces of the famlar dea of the scalar product of two vectors or 3. I what follows, keep these key

More information

Econometric Methods. Review of Estimation

Econometric Methods. Review of Estimation Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators

More information

THE PROBABILISTIC STABILITY FOR THE GAMMA FUNCTIONAL EQUATION

THE PROBABILISTIC STABILITY FOR THE GAMMA FUNCTIONAL EQUATION Joural of Scece ad Arts Year 12, No. 3(2), pp. 297-32, 212 ORIGINAL AER THE ROBABILISTIC STABILITY FOR THE GAMMA FUNCTIONAL EQUATION DOREL MIHET 1, CLAUDIA ZAHARIA 1 Mauscrpt receved: 3.6.212; Accepted

More information

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted

More information

Simulation Output Analysis

Simulation Output Analysis Smulato Output Aalyss Summary Examples Parameter Estmato Sample Mea ad Varace Pot ad Iterval Estmato ermatg ad o-ermatg Smulato Mea Square Errors Example: Sgle Server Queueg System x(t) S 4 S 4 S 3 S 5

More information

Parameter, Statistic and Random Samples

Parameter, Statistic and Random Samples Parameter, Statstc ad Radom Samples A parameter s a umber that descrbes the populato. It s a fxed umber, but practce we do ot kow ts value. A statstc s a fucto of the sample data,.e., t s a quatty whose

More information

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The

More information

Lebesgue Measure of Generalized Cantor Set

Lebesgue Measure of Generalized Cantor Set Aals of Pure ad Appled Mathematcs Vol., No.,, -8 ISSN: -8X P), -888ole) Publshed o 8 May www.researchmathsc.org Aals of Lebesgue Measure of Geeralzed ator Set Md. Jahurul Islam ad Md. Shahdul Islam Departmet

More information

STK4011 and STK9011 Autumn 2016

STK4011 and STK9011 Autumn 2016 STK4 ad STK9 Autum 6 Pot estmato Covers (most of the followg materal from chapter 7: Secto 7.: pages 3-3 Secto 7..: pages 3-33 Secto 7..: pages 35-3 Secto 7..3: pages 34-35 Secto 7.3.: pages 33-33 Secto

More information

Lecture 07: Poles and Zeros

Lecture 07: Poles and Zeros Lecture 07: Poles ad Zeros Defto of poles ad zeros The trasfer fucto provdes a bass for determg mportat system respose characterstcs wthout solvg the complete dfferetal equato. As defed, the trasfer fucto

More information

Class 13,14 June 17, 19, 2015

Class 13,14 June 17, 19, 2015 Class 3,4 Jue 7, 9, 05 Pla for Class3,4:. Samplg dstrbuto of sample mea. The Cetral Lmt Theorem (CLT). Cofdece terval for ukow mea.. Samplg Dstrbuto for Sample mea. Methods used are based o CLT ( Cetral

More information

å 1 13 Practice Final Examination Solutions - = CS109 Dec 5, 2018

å 1 13 Practice Final Examination Solutions - = CS109 Dec 5, 2018 Chrs Pech Fal Practce CS09 Dec 5, 08 Practce Fal Examato Solutos. Aswer: 4/5 8/7. There are multle ways to obta ths aswer; here are two: The frst commo method s to sum over all ossbltes for the rak of

More information

Lecture Notes Types of economic variables

Lecture Notes Types of economic variables Lecture Notes 3 1. Types of ecoomc varables () Cotuous varable takes o a cotuum the sample space, such as all pots o a le or all real umbers Example: GDP, Polluto cocetrato, etc. () Dscrete varables fte

More information

F. Inequalities. HKAL Pure Mathematics. 進佳數學團隊 Dr. Herbert Lam 林康榮博士. [Solution] Example Basic properties

F. Inequalities. HKAL Pure Mathematics. 進佳數學團隊 Dr. Herbert Lam 林康榮博士. [Solution] Example Basic properties 進佳數學團隊 Dr. Herbert Lam 林康榮博士 HKAL Pure Mathematcs F. Ieualtes. Basc propertes Theorem Let a, b, c be real umbers. () If a b ad b c, the a c. () If a b ad c 0, the ac bc, but f a b ad c 0, the ac bc. Theorem

More information

Summary of the lecture in Biostatistics

Summary of the lecture in Biostatistics Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the

More information

The Arithmetic-Geometric mean inequality in an external formula. Yuki Seo. October 23, 2012

The Arithmetic-Geometric mean inequality in an external formula. Yuki Seo. October 23, 2012 Sc. Math. Japocae Vol. 00, No. 0 0000, 000 000 1 The Arthmetc-Geometrc mea equalty a exteral formula Yuk Seo October 23, 2012 Abstract. The classcal Jese equalty ad ts reverse are dscussed by meas of terally

More information

M2S1 - EXERCISES 8: SOLUTIONS

M2S1 - EXERCISES 8: SOLUTIONS MS - EXERCISES 8: SOLUTIONS. As X,..., X P ossoλ, a gve that T ˉX, the usg elemetary propertes of expectatos, we have E ft [T E fx [X λ λ, so that T s a ubase estmator of λ. T X X X Furthermore X X X From

More information

STRONG CONSISTENCY OF LEAST SQUARES ESTIMATE IN MULTIPLE REGRESSION WHEN THE ERROR VARIANCE IS INFINITE

STRONG CONSISTENCY OF LEAST SQUARES ESTIMATE IN MULTIPLE REGRESSION WHEN THE ERROR VARIANCE IS INFINITE Statstca Sca 9(1999), 289-296 STRONG CONSISTENCY OF LEAST SQUARES ESTIMATE IN MULTIPLE REGRESSION WHEN THE ERROR VARIANCE IS INFINITE J Mgzhog ad Che Xru GuZhou Natoal College ad Graduate School, Chese

More information

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model Chapter 3 Asmptotc Theor ad Stochastc Regressors The ature of eplaator varable s assumed to be o-stochastc or fed repeated samples a regresso aalss Such a assumpto s approprate for those epermets whch

More information

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions Iteratoal Joural of Computatoal Egeerg Research Vol, 0 Issue, Estmato of Stress- Stregth Relablty model usg fte mxture of expoetal dstrbutos K.Sadhya, T.S.Umamaheswar Departmet of Mathematcs, Lal Bhadur

More information

CIS 800/002 The Algorithmic Foundations of Data Privacy October 13, Lecture 9. Database Update Algorithms: Multiplicative Weights

CIS 800/002 The Algorithmic Foundations of Data Privacy October 13, Lecture 9. Database Update Algorithms: Multiplicative Weights CIS 800/002 The Algorthmc Foudatos of Data Prvacy October 13, 2011 Lecturer: Aaro Roth Lecture 9 Scrbe: Aaro Roth Database Update Algorthms: Multplcatve Weghts We ll recall aga) some deftos from last tme:

More information

Beam Warming Second-Order Upwind Method

Beam Warming Second-Order Upwind Method Beam Warmg Secod-Order Upwd Method Petr Valeta Jauary 6, 015 Ths documet s a part of the assessmet work for the subject 1DRP Dfferetal Equatos o Computer lectured o FNSPE CTU Prague. Abstract Ths documet

More information

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA THE ROYAL STATISTICAL SOCIETY 3 EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA PAPER I STATISTICAL THEORY & METHODS The Socety provdes these solutos to assst caddates preparg for the examatos future years ad

More information

ON THE LOGARITHMIC INTEGRAL

ON THE LOGARITHMIC INTEGRAL Hacettepe Joural of Mathematcs ad Statstcs Volume 39(3) (21), 393 41 ON THE LOGARITHMIC INTEGRAL Bra Fsher ad Bljaa Jolevska-Tueska Receved 29:9 :29 : Accepted 2 :3 :21 Abstract The logarthmc tegral l(x)

More information

Complete Convergence for Weighted Sums of Arrays of Rowwise Asymptotically Almost Negative Associated Random Variables

Complete Convergence for Weighted Sums of Arrays of Rowwise Asymptotically Almost Negative Associated Random Variables A^VÇÚO 1 32 ò 1 5 Ï 2016 c 10 Chese Joural of Appled Probablty ad Statstcs Oct., 2016, Vol. 32, No. 5, pp. 489-498 do: 10.3969/j.ss.1001-4268.2016.05.005 Complete Covergece for Weghted Sums of Arrays of

More information

TESTS BASED ON MAXIMUM LIKELIHOOD

TESTS BASED ON MAXIMUM LIKELIHOOD ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal

More information

Large and Moderate Deviation Principles for Kernel Distribution Estimator

Large and Moderate Deviation Principles for Kernel Distribution Estimator Iteratoal Mathematcal Forum, Vol. 9, 2014, o. 18, 871-890 HIKARI Ltd, www.m-hkar.com http://dx.do.org/10.12988/mf.2014.4488 Large ad Moderate Devato Prcples for Kerel Dstrbuto Estmator Yousr Slaou Uversté

More information

CHAPTER 3 POSTERIOR DISTRIBUTIONS

CHAPTER 3 POSTERIOR DISTRIBUTIONS CHAPTER 3 POSTERIOR DISTRIBUTIONS If scece caot measure the degree of probablt volved, so much the worse for scece. The practcal ma wll stck to hs apprecatve methods utl t does, or wll accept the results

More information

A Primer on Summation Notation George H Olson, Ph. D. Doctoral Program in Educational Leadership Appalachian State University Spring 2010

A Primer on Summation Notation George H Olson, Ph. D. Doctoral Program in Educational Leadership Appalachian State University Spring 2010 Summato Operator A Prmer o Summato otato George H Olso Ph D Doctoral Program Educatoal Leadershp Appalacha State Uversty Sprg 00 The summato operator ( ) {Greek letter captal sgma} s a structo to sum over

More information

UNIT 2 SOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQUATIONS

UNIT 2 SOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQUATIONS Numercal Computg -I UNIT SOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQUATIONS Structure Page Nos..0 Itroducto 6. Objectves 7. Ital Approxmato to a Root 7. Bsecto Method 8.. Error Aalyss 9.4 Regula Fals Method

More information

Lecture 3. Sampling, sampling distributions, and parameter estimation

Lecture 3. Sampling, sampling distributions, and parameter estimation Lecture 3 Samplg, samplg dstrbutos, ad parameter estmato Samplg Defto Populato s defed as the collecto of all the possble observatos of terest. The collecto of observatos we take from the populato s called

More information

ρ < 1 be five real numbers. The

ρ < 1 be five real numbers. The Lecture o BST 63: Statstcal Theory I Ku Zhag, /0/006 Revew for the prevous lecture Deftos: covarace, correlato Examples: How to calculate covarace ad correlato Theorems: propertes of correlato ad covarace

More information

means the first term, a2 means the term, etc. Infinite Sequences: follow the same pattern forever.

means the first term, a2 means the term, etc. Infinite Sequences: follow the same pattern forever. 9.4 Sequeces ad Seres Pre Calculus 9.4 SEQUENCES AND SERIES Learg Targets:. Wrte the terms of a explctly defed sequece.. Wrte the terms of a recursvely defed sequece. 3. Determe whether a sequece s arthmetc,

More information

Assignment 5/MATH 247/Winter Due: Friday, February 19 in class (!) (answers will be posted right after class)

Assignment 5/MATH 247/Winter Due: Friday, February 19 in class (!) (answers will be posted right after class) Assgmet 5/MATH 7/Wter 00 Due: Frday, February 9 class (!) (aswers wll be posted rght after class) As usual, there are peces of text, before the questos [], [], themselves. Recall: For the quadratc form

More information

EVALUATION OF FUNCTIONAL INTEGRALS BY MEANS OF A SERIES AND THE METHOD OF BOREL TRANSFORM

EVALUATION OF FUNCTIONAL INTEGRALS BY MEANS OF A SERIES AND THE METHOD OF BOREL TRANSFORM EVALUATION OF FUNCTIONAL INTEGRALS BY MEANS OF A SERIES AND THE METHOD OF BOREL TRANSFORM Jose Javer Garca Moreta Ph. D research studet at the UPV/EHU (Uversty of Basque coutry) Departmet of Theoretcal

More information

Qualifying Exam Statistical Theory Problem Solutions August 2005

Qualifying Exam Statistical Theory Problem Solutions August 2005 Qualfyg Exam Statstcal Theory Problem Solutos August 5. Let X, X,..., X be d uform U(,),

More information

International Journal of Mathematical Archive-5(8), 2014, Available online through ISSN

International Journal of Mathematical Archive-5(8), 2014, Available online through   ISSN Iteratoal Joural of Mathematcal Archve-5(8) 204 25-29 Avalable ole through www.jma.fo ISSN 2229 5046 COMMON FIXED POINT OF GENERALIZED CONTRACTION MAPPING IN FUZZY METRIC SPACES Hamd Mottagh Golsha* ad

More information

MA 524 Homework 6 Solutions

MA 524 Homework 6 Solutions MA 524 Homework 6 Solutos. Sce S(, s the umber of ways to partto [] to k oempty blocks, ad c(, s the umber of ways to partto to k oempty blocks ad also the arrage each block to a cycle, we must have S(,

More information

best estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best

best estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best Error Aalyss Preamble Wheever a measuremet s made, the result followg from that measuremet s always subject to ucertaty The ucertaty ca be reduced by makg several measuremets of the same quatty or by mprovg

More information

PTAS for Bin-Packing

PTAS for Bin-Packing CS 663: Patter Matchg Algorthms Scrbe: Che Jag /9/00. Itroducto PTAS for B-Packg The B-Packg problem s NP-hard. If we use approxmato algorthms, the B-Packg problem could be solved polyomal tme. For example,

More information

D KL (P Q) := p i ln p i q i

D KL (P Q) := p i ln p i q i Cheroff-Bouds 1 The Geeral Boud Let P 1,, m ) ad Q q 1,, q m ) be two dstrbutos o m elemets, e,, q 0, for 1,, m, ad m 1 m 1 q 1 The Kullback-Lebler dvergece or relatve etroy of P ad Q s defed as m D KL

More information

Lecture Notes to Rice Chapter 5

Lecture Notes to Rice Chapter 5 ECON 430 Revsed Sept. 06 Lecture Notes to Rce Chapter 5 By H. Goldste. Chapter 5 gves a troducto to probablstc approxmato methods, but s suffcet for the eeds of a adequate study of ecoometrcs. The commo

More information

Rademacher Complexity. Examples

Rademacher Complexity. Examples Algorthmc Foudatos of Learg Lecture 3 Rademacher Complexty. Examples Lecturer: Patrck Rebesch Verso: October 16th 018 3.1 Itroducto I the last lecture we troduced the oto of Rademacher complexty ad showed

More information

MATH 247/Winter Notes on the adjoint and on normal operators.

MATH 247/Winter Notes on the adjoint and on normal operators. MATH 47/Wter 00 Notes o the adjot ad o ormal operators I these otes, V s a fte dmesoal er product space over, wth gve er * product uv, T, S, T, are lear operators o V U, W are subspaces of V Whe we say

More information

MEASURES OF DISPERSION

MEASURES OF DISPERSION MEASURES OF DISPERSION Measure of Cetral Tedecy: Measures of Cetral Tedecy ad Dsperso ) Mathematcal Average: a) Arthmetc mea (A.M.) b) Geometrc mea (G.M.) c) Harmoc mea (H.M.) ) Averages of Posto: a) Meda

More information

Lecture 3: Randomly Stopped Processes

Lecture 3: Randomly Stopped Processes STAT 498: Selected Topcs Stochastc Processes Wter 2018 Lecture 3: Radomly Stopped Processes Lecturer: Fag Ha Ja 29 Dsclamer: These otes have ot bee subjected to the usual scruty reserved for formal publcatos.

More information

Lecture 12 APPROXIMATION OF FIRST ORDER DERIVATIVES

Lecture 12 APPROXIMATION OF FIRST ORDER DERIVATIVES FDM: Appromato of Frst Order Dervatves Lecture APPROXIMATION OF FIRST ORDER DERIVATIVES. INTRODUCTION Covectve term coservato equatos volve frst order dervatves. The smplest possble approach for dscretzato

More information

arxiv:math/ v1 [math.gm] 8 Dec 2005

arxiv:math/ v1 [math.gm] 8 Dec 2005 arxv:math/05272v [math.gm] 8 Dec 2005 A GENERALIZATION OF AN INEQUALITY FROM IMO 2005 NIKOLAI NIKOLOV The preset paper was spred by the thrd problem from the IMO 2005. A specal award was gve to Yure Boreko

More information

Chapter 14 Logistic Regression Models

Chapter 14 Logistic Regression Models Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as

More information

Chapter 9 Jordan Block Matrices

Chapter 9 Jordan Block Matrices Chapter 9 Jorda Block atrces I ths chapter we wll solve the followg problem. Gve a lear operator T fd a bass R of F such that the matrx R (T) s as smple as possble. f course smple s a matter of taste.

More information

Journal of Mathematical Analysis and Applications

Journal of Mathematical Analysis and Applications J. Math. Aal. Appl. 365 200) 358 362 Cotets lsts avalable at SceceDrect Joural of Mathematcal Aalyss ad Applcatos www.elsever.com/locate/maa Asymptotc behavor of termedate pots the dfferetal mea value

More information

1 0, x? x x. 1 Root finding. 1.1 Introduction. Solve[x^2-1 0,x] {{x -1},{x 1}} Plot[x^2-1,{x,-2,2}] 3

1 0, x? x x. 1 Root finding. 1.1 Introduction. Solve[x^2-1 0,x] {{x -1},{x 1}} Plot[x^2-1,{x,-2,2}] 3 Adrew Powuk - http://www.powuk.com- Math 49 (Numercal Aalyss) Root fdg. Itroducto f ( ),?,? Solve[^-,] {{-},{}} Plot[^-,{,-,}] Cubc equato https://e.wkpeda.org/wk/cubc_fucto Quartc equato https://e.wkpeda.org/wk/quartc_fucto

More information

Unit 9. The Tangent Bundle

Unit 9. The Tangent Bundle Ut 9. The Taget Budle ========================================================================================== ---------- The taget sace of a submafold of R, detfcato of taget vectors wth dervatos at

More information

MOLECULAR VIBRATIONS

MOLECULAR VIBRATIONS MOLECULAR VIBRATIONS Here we wsh to vestgate molecular vbratos ad draw a smlarty betwee the theory of molecular vbratos ad Hückel theory. 1. Smple Harmoc Oscllator Recall that the eergy of a oe-dmesoal

More information

Extend the Borel-Cantelli Lemma to Sequences of. Non-Independent Random Variables

Extend the Borel-Cantelli Lemma to Sequences of. Non-Independent Random Variables ppled Mathematcal Sceces, Vol 4, 00, o 3, 637-64 xted the Borel-Catell Lemma to Sequeces of No-Idepedet Radom Varables olah Der Departmet of Statstc, Scece ad Research Campus zad Uversty of Tehra-Ira der53@gmalcom

More information

AN EULER-MC LAURIN FORMULA FOR INFINITE DIMENSIONAL SPACES

AN EULER-MC LAURIN FORMULA FOR INFINITE DIMENSIONAL SPACES AN EULER-MC LAURIN FORMULA FOR INFINITE DIMENSIONAL SPACES Jose Javer Garca Moreta Graduate Studet of Physcs ( Sold State ) at UPV/EHU Address: P.O 6 890 Portugalete, Vzcaya (Spa) Phoe: (00) 3 685 77 16

More information

Research Article Some Strong Limit Theorems for Weighted Product Sums of ρ-mixing Sequences of Random Variables

Research Article Some Strong Limit Theorems for Weighted Product Sums of ρ-mixing Sequences of Random Variables Hdaw Publshg Corporato Joural of Iequaltes ad Applcatos Volume 2009, Artcle ID 174768, 10 pages do:10.1155/2009/174768 Research Artcle Some Strog Lmt Theorems for Weghted Product Sums of ρ-mxg Sequeces

More information

Lecture 4 Sep 9, 2015

Lecture 4 Sep 9, 2015 CS 388R: Radomzed Algorthms Fall 205 Prof. Erc Prce Lecture 4 Sep 9, 205 Scrbe: Xagru Huag & Chad Voegele Overvew I prevous lectures, we troduced some basc probablty, the Cheroff boud, the coupo collector

More information

THE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE

THE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE THE ROYAL STATISTICAL SOCIETY 00 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE PAPER I STATISTICAL THEORY The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for the

More information

Numerical Analysis Formulae Booklet

Numerical Analysis Formulae Booklet Numercal Aalyss Formulae Booklet. Iteratve Scemes for Systems of Lear Algebrac Equatos:.... Taylor Seres... 3. Fte Dfferece Approxmatos... 3 4. Egevalues ad Egevectors of Matrces.... 3 5. Vector ad Matrx

More information

Department of Agricultural Economics. PhD Qualifier Examination. August 2011

Department of Agricultural Economics. PhD Qualifier Examination. August 2011 Departmet of Agrcultural Ecoomcs PhD Qualfer Examato August 0 Istructos: The exam cossts of sx questos You must aswer all questos If you eed a assumpto to complete a questo, state the assumpto clearly

More information

Chapter 4 Multiple Random Variables

Chapter 4 Multiple Random Variables Revew o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for Chapter 4-5 Notes: Although all deftos ad theorems troduced our lectures ad ths ote are mportat ad you should be famlar wth, but I put those

More information