Pointwise and uniform asymptotics of the Vervaat error process

Size: px
Start display at page:

Download "Pointwise and uniform asymptotics of the Vervaat error process"

Transcription

1 Poitwise ad uiform asymptotics of the Vervaat error process Edre Csáki 1 Alfréd Réyi Istitute of Mathematics, Hugaria Academy of Scieces, Budapest, P.O.B. 127, H-1364, Hugary. csaki@reyi.hu Miklós Csörgő 2 School of Mathematics ad Statistics, Carleto Uiversity, Ottawa, Otario, Caada K1S 5B6. mcsorgo@math.carleto.ca Atóia Földes 3 City Uiversity of New York, 28 Victory BLVD., State Islad, New York 1314, U.S.A. afoldes@gc.cuy.edu Zha Shi Laboratoire de Probabilités UMR 7599, Uiversité Paris VI, 4 Place Jussieu, F Paris Cedex 5, Frace. zha@proba.jussieu.fr Ričardas Zitikis 4 Departmet of Statistics, Uiversity of Maitoba, 327 Machray Hall, Wiipeg, Maitoba, Caada R3T 2N2. Ricardas Zitikis@umaitoba.ca Abstract. It is well kow that, asymptotically, the appropriately ormalized uiform Vervaat process, i.e., the itegrated uiform Bahadur Kiefer process properly ormalized, behaves like the square of the uiform empirical process. We give a complete descriptio of the strog ad weak asymptotic behaviour i -orm of this represetatio of the Vervaat process ad, likewise, we study also its poitwise asymptotic behaviour. Keywords. Empirical process, quatile process, Bahadur Kiefer process, Vervaat process, Vervaat error process, Kiefer process, Browia bridge, Wieer process, strog approximatio, law of the iterated logarithm, covergece i distributio. 2 Mathematics Subject Classificatio. Primary 6F15; Secodary 6F5, 6F17. 1 Research ported by the Hugaria Natioal Foudatio for Scietific Research, Grat No. T Research ported by a NSERC Caada Grat at Carleto Uiversity, Ottawa. 3 Research ported by a PSC CUNY grat, No Research ported by a grat of the Uiversity of Maitoba, Wiipeg, ad by the NSERC Caada Collaborative Grat at the Laboratory for Research i Statistics ad Probability, Carleto Uiversity ad Uiversity of Ottawa, Ottawa. 1

2 1 Itroductio ad prelimiary results Let U 1, U 2,... be idepedet copies of a radom variable U uiformly distributed over the iterval [, 1]. Let F t := 1 1{U k t}, t 1, k=1 deote the empirical distributio fuctio based o U 1, U 2,..., U, where 1 is the idicator fuctio. Let F 1 be the left-cotiuous iverse of F. We deote the empirical ad quatile processes over the iterval [, 1] by respectively. The sum α t := F t t, t 1, β t := F 1 t t, t 1, R t := α t + β t, t 1, of the empirical ad quatile processes is kow i the literature as the Bahadur Kiefer process cf. Bahadur, 1966, Kiefer, 1967, 197. The Bahadur Kiefer process ejoys some remarkable asymptotic properties, which are of iterest i statistical quatile data aalysis cf., e.g., Csörgő, 1983, Shorack ad Weller, We summarize the most relevat results of Kiefer 1967, 197 i this regard i the followig theorem. Throughout the paper, we use the otatio log x := log maxx, e ad log 2 x := log log x. Theorem A For every fixed t, 1, we have lim 1/4 R t d t1 t 1/4 N Ñ,, 1.1 1/4 R t 1/4 25/4 = t1 t a.s., 1.2 log 2 3/4 3 3/4 where N ad Ñ are idepedet stadard ormal variables ad d deotes covergece i distributio. Also, lim 1/4 log R = 1 a.s., 1.3 α where f := t 1 ft deotes the uiform -orm of f. Theorem A is due to Kiefer 1967, 197, except for 1.3 for which he oly proved the covergece i probability. The upper boud for the almost sure covergece i 1.3 was proved by Shorack 1982, ad the lower boud by Deheuvels ad Maso 199. For a review of these results ad for further developmets alog these lies we refer to Deheuvels ad Maso 1992, Eimahl 1996, Csörgő ad Szyszkowicz Via usig the usual ad the other laws of the iterated logarithm for α, 1.3 immediately implies lim 1/4 log log 2 1/4 R = 2 1/4 a.s., 1.4 lim if 1/4 log log 2 1/4 R = π 8 1/4 a.s., 1.5 2

3 while a direct applicatio of 1.3 together with the weak covergece of α to a Browia bridge B gives 1/4 log R d B,. 1.6 Nevertheless, the followig result, which oe ca immediately coclude also by combiig 1.1 with 1.6, is true, ad it was first formulated ad proved directly by Vervaat 1972b. Theorem B Vervaat, 1972b The statemet a R d Y,, caot hold true i the space D[, 1] edowed with the Skorohod topology for ay sequece {a } of positive real umbers ad ay o-degeerate radom elemet Y of D[, 1]. I view of Theorems A ad B ow, it is of iterest to see the asymptotic behaviour of the Bahadur Kiefer process possibly i other orms as well. I this regard we quote Theorem C Csörgő ad Shi, 1998 For ay p [2,, we have where lim 1/4 R p α p/2 = c p a.s., 1.7 c p := E N p 1/p = 2 Γp + π 1/p, 1.8 N stads as before for a stadard ormal variable, ad f p := 1 ft p dt 1/p, the Lp orm of f. I particular, 1.7 yields L p versios of the laws of the iterated logarithm LIL s for the Bahadur Kiefer process R. We also ote that 1.7 combied with the weak covergece of α to a Browia bridge B implies that, for p [2,, 1/4 R p d c p B q,. This, i combiatio with 1.6, yields Theorem B agai. Vervaat s 1972b proof of Theorem B was based, i a most crucial ad elegat way, o the followig itegrated Bahadur Kiefer process I t := t R sds, t 1. Cocerig the latter process, he established the weak covergece of V t := 2 I t 1.9 to B 2, the square of a Browia bridge, as well as a fuctioal LIL for V, via provig the followig theorem for a discussio of related details we refer to Csörgő ad Zitikis, 1999a, b. 3

4 Theorem D Vervaat, 1972a, b We have I particular, i the space C[, 1], lim 2 1 V α 2 = a.s. 1.1 lim α 2 = i probability V d B 2, For use of termiology, we call the process V of 1.9 the uiform Vervaat process. For further refereces ad elaboratio o this termiology we refer to Sectio 1 of Zitikis As a cosequece of 1.12, Vervaat 1972b cocluded Theorem B. We also ote that 1.1 yields the LIL for V, see Corollary 1.1 Vervaat 1972a, b i Csörgő ad Zitikis 1999a, b. 2 The Vervaat error process, mai results Bahadur 1966 itroduced R as the remaider term i the represetatio β = α + R of the quatile process β i terms of the empirical process α. As we have see i Theorems A ad C, the remaider term R, i.e., the Bahadur Kiefer process, is asymptotically smaller tha the mai term α, i.e., the empirical process, i both the L p ad -orm topologies. I a similar vei, we ca thik of the process Q t := V t α 2 t, t 1, 2.1 that appears i both statemets 1.1 ad 1.11 of Theorem D as the remaider term Q i the followig represetatio V = α 2 + Q 2.2 of the uiform Vervaat process V i terms of the square of the empirical process. It is well-kow cf. Zitikis, 1998, for details ad refereces that the remaider term Q i 2.2 is asymptotically smaller tha the mai term α 2. Thus, just like i the case of R, oe may like to kow how small the remaider term Q is. I view of Theorems A ad C, oe suspects that there should be substatial differeces betwee the asymptotic poitwise, - ad L p -orms behaviour of the process Q. Ideed, Csörgő ad Zitikis 1999a established the followig strog covergece result for Q p. Theorem E Csörgő ad Zitikis, 1999a For ay p [1,, we have lim 1/4 Q p α 3p/2 = 1 c 3/2 p a.s.,

5 where c p is defied i 1.8. For a compariso of this result to that of Theorem C, as well as for that of their cosequeces, we refer to Csörgő ad Zitikis 1999a, who have also cojectured that i -orm the aalogue statemet of 2.3 should be of the followig form: lim b 1/4 Q = c a.s., 2.4 α 3/2 where b is a slowly varyig fuctio covergig to ad c is a positive costat. Oe of the aims of this expositio is to prove that this cojecture is true with b = log. I additio, we also study the poitwise behaviour of the Vervaat error process Q. We summarize our results i the followig theorem, which parallels Theorem A of Kiefer 1967, 197 cocerig the process R. Theorem 2.1 For every fixed t, 1, we have lim 1/4 Q t d 4/3 t1 t 3/4 N Ñ 3/2,, 2.5 1/4 Q t log 2 5/4 = t1 t 3/4 211/4 3 1/4 5 5/4 a.s., 2.6 where N ad Ñ are idepedet stadard ormal variables. Also, lim 1/4 log Q α = 3/2 4/3 a.s. 2.7 As a cosequece of this theorem, as well as that of Theorem E combied with 2.7, we have the followig corollary, which cofirms Cojecture 2.1 of Csörgő ad Zitikis 1999a. Corollary 2.1 The statemet a Q d Y,, caot hold true i the space D[, 1] for ay sequece {a } of positive real umbers ad for ay o-degeerate radom elemet Y of the space D[, 1]. Aother cosequece of 2.7 is the followig corollary. Corollary 2.2 We have lim 1/4 log log 2 3/4 Q = 21/4 3 a.s., 2.8 lim if 1/4 log log 2 3/4 π 3/2 Q = 3 2 5/4 a.s., 2.9 1/4 log Q d 4/3 B 3/2,, 2.1 where B is a stadard Browia bridge. 5

6 We ote that 2.8 ad 2.9 follow from 2.7 by meas of the usual ad the other LIL s for α. As to 2.1, it results from a direct applicatio of 2.7 together with the weak covergece of α to the Browia bridge B. Remark 2.1 I the literature we also fid geeral forms of the Vervaat process that are based o radom variables X 1, X 2,... replacig the uiform [,1] radom variables U 1, U 2,... I particular, such a geeral Vervaat process first appeared ad was put to good use i Csörgő ad Zitikis We refer to Zitikis 1998 for a detailed survey o this subject. For related though rather differet limit theorems for the geeral Vervaat process, we refer to Csörgő ad Zitikis It is obvious that the results of this paper ca be geeralized i such a way that they would cover geeral forms of the Vervaat process as well. However, a solutio of this problem uder reasoably optimal assumptios may costitute a rather challegig mathematical task which is defiitely ot withi the scope of the preset paper. For a recet review of Vervaat ad Vervaat error processes we refer to Csörgő ad Zitikis 1999b. 3 The Vervaat error process i terms of a Kiefer process We itroduce some two-parameter Gaussia processes. Let {W x, y, x, y } be a Wieer Browia sheet, i.e., a two-parameter Gaussia process with EW x, y = ad covariace fuctio EW x 1, y 1 W x 2, y 2 = x 1 x 2 y 1 y 2. Next we defie a Kiefer process {Kx, y, x 1, y } by Kx, y := W x, y xw 1, y, where W x, y is a Wieer sheet. A Kiefer process Kx, y ca be characterized as a mea zero Gaussia process with covariace fuctio EKx 1, y 1 Kx 2, y 2 = x 1 x 2 x 1 x 2 y 1 y 2. Remark 3.1 I this paper we defie, without loss of geerality, all Kiefer processes Kx, y ad Browia bridges Bx to be equal to zero if x < or x > 1. Cocerig the uiform empirical process α, Komlós et al. followig fudametal embeddig theorem established the Theorem F Komlós, Major ad Tusády, 1975 O a suitable probability space, the uiform empirical process {α k x, x 1, k = 1, 2,... } ad a Kiefer process {Kx, k, x 1, k = 1, 2,... } ca be so costructed that, as, max 1 k x 1 α k x Kx, k = O log 2 Combiig 1.4 with Theorem F, we arrive at cf. Csörgő ad Révész, 1975: a.s. 6

7 Propositio A O the probability space of Theorem F for the uiform quatile process {β k x, x 1, k = 1, 2,... } with the Kiefer process {Kx, k, x 1, k = 1, 2,... } of Theorem F, as, we have max 1 k x 1 β k x + Kx, k = O log log 2 1/4 1/4 a.s. 3.1 We ote i passig cf. Deheuvels, 1998 ad refereces therei that the almost sure rate of covergece i 3.1 caot be improved eve whe approximatig the uiform quatile process by ay other Kiefer process. For further use we quote the followig two results of A.H.C. Cha 1977 cf. Theorem ad Theorem S , respectively, i Csörgő ad Révész, Theorem G Cha, 1977 Let K, be a Kiefer process, ad let {h } be a o-icreasig sequece of positive umbers such that lim log 1 h / log 2 =. The lim t 1 h Kt + s, Kt, = 1 a.s. s h 2h log1/h Theorem H Cha, 1977 Let < ε T < 1, < a 2 T T be fuctios of T such that ε T ad a T /T are o-icreasig ad a T is o-decreasig. Defie K x 1, x 2 ], t = Kx 2, t Kx 1, t x 1 < x 2 1. The almost surely, where lim T = lim T t T a T t T a T β T = x 1 ε T β T Kx, x + s], t + a T Kx, x + s], t s ε T β T Kx, x + ε T ], t + a T Kx, x + ε T ], t = 1, x 1 ε T 2a T ε T 1 ε T log T + log ε T a 2 T. T If i additio, lim T log T ε T a T / log 2 T =, the lim ca be replaced by lim. T T The mai result of this sectio is the followig strog approximatio of the Vervaat error process Q t defied i 2.1 via a Kiefer process. Theorem 3.1 O the probability space of Theorem F, usig the there costructed Kiefer process K,, Q ca be approximated as follows. As we have Q t Z t = O 3/8 log 3/4 log 2 5/8 a.s., 3.2 <t<1 where {Z t, < t < 1, = 1, 2,... } is defied by Kt, Z t := 2 1 K t s Kt,, Kt, ds. 3.3 The proof of this theorem is based o the ext two lemmas, which are of iterest o their ow. 7

8 Lemma 3.1 Let The A t := 2 t ad, cosequetly, as, F 1 t α u α t du, < t < 1, = 1, 2, Q t = A t R 2 t, 3.5 Q t A t = O log log 2 a.s. 3.6 <t<1 Proof. We have the followig easy-to-check represetatio V t = α tβ t + A t α t + β tβ t for all t, 1 ad = 1, 2,... cf., Vervaat, 1972a, Shorack ad Weller, 1986, Zitikis, By 2.1, Q t = V t αt 2 = A t Rt, 2 yieldig 3.5. The idetity 3.6 follows from 3.5 ad 1.4. Lemma 3.2 O the probability space of Theorem F, usig the there costructed Kiefer process K,, the stochastic process A t of Lemma 3.1 ca be approximated such that whe, A t Z t = O 3/8 log 3/4 log 2 3/8 a.s., <t<1 where Z t is as i Theorem 3.1. Proof. By a chage of variables u = t st F 1 t = t + s β t i 3.4, we have 1 A t = 2β t α t + s β t α t ds. The usual LIL for β cofirms that β = Olog 2 almost surely whe. Therefore, by Theorem F, whe, 1 A t = 2 β t K t + s β t, Kt, ds + O log 2 log 2, a.s., 3.7 uiformly i t, 1. For all t, s, 1, we have K t + s β t, Kt, K t s, := Ku + v, Ku, u 1 Ku + v, Ku,, v h 8

9 where u = t s Kt, β t Kt,, v = s + ad, o accout of Propositio A, h = O 3/4 log log 2 1/4, almost surely. Thus, accordig to Theorem G, almost surely, whe, K t + s β t, Kt, K t s, = O 1/8 log 3/4 log 2 1/8, uiformly i t, s, 1. Pluggig this ito 3.7 ad usig agai the LIL for β, we arrive at: 1 A t = 2 Kt, β t K t s, Kt, ds Accordig to Propositio A, +O 3/8 log 3/4 log 2 5/8 a.s Kt, β t = 2 + O log log 2 1/4, a.s., 3.9 almost surely ad uiformly i t, 1. O the other had, applyig Theorem G to the itegrad i 3.9 with h = O log 2, we obtai: 1 Kt, K t s, Kt, ds = O 1/4 log log 2 1/4, almost surely ad uiformly i t, 1. Pluggig this ad 3.9 ito 3.8 yields that almost surely, whe, log log2 A t = Z t + O + O 3/8 log 3/4 log 2 5/8, 3/4 uiformly i t, 1. This yields Lemma 3.2. Proof of Theorem 3.1. Follows from Lemmas 3.1 ad 3.2. We metio that the process Z t was put to use i Csörgő ad Zitikis 1999a i their study of Q t i L p orm. Moreover, they also remarked that their cojecture as stated i 2.4 is equivalet to statig it i terms of Z istead of Q. Likewise, i view of Theorem 3.1 ow, the proof of Theorem 2.1 ca, ad will, be based o provig the statemets with the process Z t replacig Q t i all of them. The latter goal i tur will be achieved via usig the ext simple, though essetial, observatio that is borrowed from Eimahl Propositio B Let {Kx, y, x 1, y } be a Kiefer process. For ay fixed u < v 1, the process { } Ku + v ux, y xkv, y 1 xku, y, x [, 1], y v u 9

10 is a Kiefer process, idepedet of {Ks, y, s [, u], y } ad {Ks, y, s [v, 1], y }. Based o Theorem 3.1 ad this crucial observatio, the respective proofs of the poitwise statemets of ad the proof of the uiform property as i 2.7 of the process Q will take differet routes. Hece, our ext Sectio 4 is devoted to provig , while Sectio 5 will be o establishig the almost sure ratio statemet of Poitwise behaviour of the Vervaat error process This sectio is devoted to the proof of 2.5 ad 2.6 of Theorem 2.1, cocerig the poitwise asymptotics of Q t. We first establish a strog approximatio of Z t of 3.3 for ay fixed t, 1 by a process i, which is a itegral of a Wieer sheet i its first parameter over a radom iterval that is idepedet of this Wieer sheet i had. Lemma 4.1 Give Z t as i 3.3, the for ay fixed t, 1 oe ca defie a Wieer sheet W, such that, as, we have Kt, / Z t = 2 W y, dy + O log log 2 where {W y,, y, = 1, 2,... } is idepedet of {Kt,, = 1, 2,... }. a.s., 4.1 Proof. Usig Propositio B with u =, v = t, ad writig 1 x istead of x, we see that K 1x, := Kt1 x, 1 xkt, t, x 1, 4.2 is a Kiefer process, idepedet of Kt,. Likewise, lettig u = t, v = 1, we see that K 2x, := Kt + 1 tx, 1 xkt, 1 t, x 1, is also a Kiefer process, idepedet of Kt,. Moreover, K 1, ad K 2, are idepedet. Cosequetly, the compoets of the vector are idepedet processes. Defiig x via Kt,, K 1,, K 2, 4.3 Kt, 1 xt = t s Kt, t + 1 tx = t s if Kt, >, if Kt, <, i the itegral i the defiitio of Z t of 3.3, we arrive at the followig represetatio of the latter process for each fixed t: Z t = I 1 1{Kt, > } I 2 1{Kt, < }, 4.4 1

11 where Kt,/t I 1 := 2t Kt1 x, Kt, dx, I 2 := 21 t Kt,/1 t Kt + 1 tx, Kt, dx. Cosiderig I 1, ad rememberig that this is the case whe Kt, >, usig the defiitio 4.2 of K 1,, we obtai: almost surely as, I 1 = 2t 3/2 Kt,/t = 2t 3/2 Kt,/t = 2t 3/2 Kt,/t Kt,/t K1x, dx 2tKt, x dx K1x, tkt, 3 dx 2 t 2 K1x, log2 3/2 dx + O, 4.5 the last lie followig from the LIL for the Kiefer process with fixed t. Sice K 1, is a Kiefer process idepedet of Kt,, we ca use the represetatio K 1x, = W 1 x, xw 1 1,, where W 1, is a Wieer sheet, idepedet of Kt,. This idepedece property will be crucial i our use later o. Observe that Kt,/t K 1x, dx = Kt,/t W 1 x, dx K2 t, W 1 1, 2t 2 2. By the LIL for the Kiefer process K ad the Wieer process W1 1,, we have, whe, K 2 t, W1 1, = O 3/2 log 2 3/2 almost surely. Goig back to 4.5, we obtai: as, almost surely Kt,/t I 1 = 2t 3/2 W1 log2 3/2 x, dx + O Kt,/ = 2 t W1 y t, dy + O log2 3/ Similarly, i the case Kt, <, we ca show that as, for I 2 of 4.4 we have, almost surely, Kt,/ I 2 = 2 1 t W2 y log2 3/2, dy + O, t where, just like W 1, of 4.6, the Wieer sheet W 2, of 4.7 is also idepedet of Kt, cf Combiig 4.6 ad 4.7 with 4.4 yields that, for each fixed t, 1, as, Kt, / Z t = 2 W y, dy + O 11 log2 log a.s.,

12 where W y, := t W1 y t, 1{Kt, > } 1 t W2 y, 1{Kt, < }. 1 t Sice W, is a Wieer sheet, idepedet of Kt,, this yields Lemma 4.1. The rest of this sectio is devoted to the proof of 2.5 ad 2.6 i Theorem 2.1. For the sake of clarity, they are proved separately. 3 Proof of 2.5. For each fixed ad T, T T 3/2 W y, dy is a stadard ormal variable. Thus, by coditioig, if T is a radom variable idepedet of W,, the 3 T T 3/2 W y, dy is a stadard ormal variable, idepedet of T. I view of the idepedece of Kt, ad W,, we have, for each fixed ad t, takig T := Kt, / = Kt, / 2 W y, dy 4 t1 t 3 3/4 T 1/4 t1 t 3/2 3 T 3/2 T W y, dy = d 4 3 t1 t 3/4 1/4 Ñ 3/2 N, where = d deotes idetity i distributio, ad N ad Ñ are idepedet stadard ormal radom variables. This, i light of 3.2 ad 4.1, yields 2.5. Proof of 2.6. Fix agai t, 1. Defie W t := Kt,, 1, t1 t W t x, y := t1 t 1/4 W x t1 t, y, x, y. Clearly, W t is a Wieer process restricted o N, ad W t, is a Wieer sheet, idepedet of {Kt,, = 1, 2,... }, thus of W t. We also observe that Kt, / W y, dy = t1 t 3/4 2 log 2 5/4 1/4 Wt /2 log 2 Wt u 2 log 2, du. 1/4 2 log 2 3/4 By Theorem 1.1 of Deheuvels ad Maso 1992, as, the set of limit poits of is almost surely equal to W t 2 log 2, W t u 2 log 2,, u [, 1] 1/4 2 log 2 3/4 D := {c, f : f absolutely cotiuous with respect to the Lebesgue measure, c, 1, f =, c 2 + c f u 2 du 1}

13 Cosequetly, with probability oe, lim 1/4 Kt, / log 2 5/4 W y, dy = 2 5/4 t1 t 3/4 c,f D c fu du. We ow determie the value of the expressio o the right had side. Itegratig by parts, usig the Cauchy Schwarz iequality ad 4.8, we get, for each c, f D, c c fu du = c c u 2 du c uf u du c c f u du c 2. 3 Sice c 3 1 c /2 /5 5/2 for ay c [ 1, 1], this yields Choosig c fu du 2 3 1/ c,f D 5 5/4 c = 3/5, fu = 2 3 1/4 u 51/4 5 1/ /4 u2, it is see that i 4.9 we have, i fact, a equality. Accordigly, with probability oe, lim 1/4 Kt, / W y, dy = t1 t 3/4 27/4 3 1/4. log 2 5/4 5 5/4 This yields 2.6 i view of 4.1 ad Uiform behaviour of the Vervaat error process This sectio is devoted to establishig the uiform property 2.7 i Theorem 2.1. I view of Theorems 3.1 ad F it suffices to show that lim lim if log log Z K, 3/2 Z K, 3/2 where Z := t 1 Z t ad K, := t 1 Kt,. Proof of 5.1. Recall that cf. 3.3, by defiitio, Kt, Z t = 2 = 2 Kt,/ 1 K t s 4 3 a.s., a.s., 5.2 Kt,, Kt, ds Kt z, Kt, dz

14 Let N = N := log 2 4, 5.4 ad let t i = t i := i/n for i N. Defie, for u [, 1], Bi,u := N K t i + u N, ukt i+1, 1 ukt i,. It follows from Propositio B that for each fixed, {B i,, i =, 1,..., N 1} are idepedet Browia bridges, ad idepedet of {Kt i,, i =, 1,..., N 1}. Let t [t i, t i+1 ]. The Kti,/ Kt,/ Z t = 2 + Kt z, Kt, dz. Kt i,/ By Theorem G, whe, Kt, Kt i, log max = O i N 1 t i t t i+1 N O the other had, by the LIL for the Kiefer process ad Theorem G, Kt z Kt, = O 1/4 log log 2 1/4, uiformly i i N 1, t [t i, t i+1 ] ad z [Kt i, /, Kt, /]. Therefore, Kt,/ log log2 1/4 Kt z, Kt, dz = O a.s. Kt i,/ N 1/4 As a cosequece, for t [t i, t i+1 ], we have, almost surely whe, Kti,/ log log2 1/4 Z t = 2 Kt z, Kt, dz + O, 5.5 N 1/4 where O is uiform i i =, 1,..., N 1. Let i be such that Kt i,. If t [t i, t i+1 ], the t = t i + v/n for some v [, 1]. Accordigly, by writig A i := N Kt i, /, Kti,/ = N 3/2 Kt z, Kt, dz B i,v + y B i,v dy Kt i+1, Kt i, N Sice A i y dy = N 2 K 2 t i, /2 2, a applicatio of the LIL for the Kiefer process ad Theorem G yields that with probability oe, Kti,/ Kt z, Kt, dz = N 3/2 a.s. a.s., y dy. N Bi,v + y Bi,v log log dy + O 2,

15 uiformly i i =, 1,..., N 1. Note that B i, ca be represeted as B i,u := W i,u + uw i,1, where for each fixed {W i,, i =, 1,..., N 1} are idepedet Wieer processes which are also idepedet of {Kt i,, i =, 1,..., N 1}. Hece, almost surely, = = B i,v + y B i,v dy W i,v + y W i,v dy + W W i,v + y W i,v dy + O i,1 y dy N 2 log log 2, 5.7 the last equality followig from the LIL for the Kiefer process ad the fact that almost surely, i N 1 Wi,1 = Olog. This last fact ca be easily checked usig the usual estimate for Gaussia tails ad the Borel Catelli lemma, regardless of the depedecy structure of the stadard ormal variables {Wi,1, i =, 1,..., N 1; = 1, 2,... }. Puttig 5.5, 5.6 ad 5.7 together, ad takig ito accout the defiitio of N i 5.4, we obtai: Z t = 2 N 3/2 W i,v + y W i,v dy + O log, 5.8 1/4 log 2 for t = t i + v/n, v 1, Kt i,. If Kt i, >, the by itroducig the Kiefer process K t, := K1 t,, we ca write Kti,/ 2 Kt z, Kt, dz = 2 Kti,/ K 1 t + z, K 1 t, dz, ad, similarly to the argumet leadig to 5.8, we ca fid idepedet Wieer processes {Wi,, i =, 1,..., N 1} which are also idepedet of {Kt i,, i =, 1,..., N 1}, such that almost surely, Z t = 2 N 3/2 W i,v + y W i,v dy + O log, 5.9 1/4 log 2 for t = t i + v/n, v 1, Kt i, >. Combiig 5.8 ad 5.9, we see that with probability oe, for t = t i + v/n, v [, 1], Z t = 2 N 3/2 log W i, v + y W i, v dy + O, 5.1 1/4 log 2 where W i, := W i, 1{Kt i, } + W i, 1{Kt i, > }, 15

16 i =, 1,..., N 1, are Wieer processes, idepedet of {Kt i,, i =, 1,..., N 1}. Note that we do ot claim that the Wieer processes {W i,, i =, 1,..., N 1} are idepedet betwee themselves. For each, we split {, 1,..., N 1} ito two radom parts: J 1 = J 1 := {i : Kt i, log 2 1, i N 1}, J 2 = J 2 := {i : Kt i, > log 2 1, i N 1}. If i J 1, the applyig the LIL for the Kiefer process ad Theorem G implies that Kti,/ Kt z, Kt, dz = O log 1/4 log 2 3/2 a.s. uiformly i i J 1. I view of 5.5, we obtai: whe, max i J 1 t [t i,t i+1 ] Z t = O log 1/4 log 2 3/2 a.s For i J 2, we cosider the variables X i, := 3 A 3/2 i v 1 Accordig to 5.1, almost surely whe, max i J 2 t [t i,t i+1 ] Z t 2 K, 3/2 3 W i, v + y W i, v dy. max i J 2 X i, + O log, 1/4 log 2 which, combied with 5.11, yields Z 2 K, 3/2 3 max i J 2 X i, + O log 1/4 log 2 a.s We ow show that the variables X i,, i J 2 have Gaussia-like tails. To this ed, we fix A > ad itroduce the mea zero Gaussia process Xv := 3 A W v + y W v dy, v [, 1]. A 3/2 It is straightforward to compute its covariace: EXuXv = { 1 3 v u + v u 3 if v u A, 2A 2A 3 if v u > A, 5.13 ad therefore E Xv Xu 2 = { 3 v u A v u 3 if v u A, A 3 2 if v u > A

17 Accordig to a well-kow iequality of Ferique 1964, for ay x >, P Xv x σ ϕp s2 ds 4p 2 e s2 /2 ds, v 1 1 x where p 2 is arbitrary, ad σ ad ϕ are such that EXv 2 σ 2, E Xv Xu 2 ϕ 2 v u. I view of 5.13 ad 5.14, we ca choose σ = 1 ad ϕh = 3h/A. Sice 3 ϕp s2 ds e s log p/2 2 3 ds =, A pa log p this leads to: P 1 Xv x v pa log p 4p 2 e s2 /2 ds Recall that W i, is idepedet of Kt i,. Therefore, applyig 5.15 to W = W i, ad A = A i for i J 2 we obtai: P X i, x log 2 3 4p 2 e s2 /2 ds, p log p where, with N as i 5.4, we used the fact that A i log 2 6 for all i J 2. Let ε, 1. We choose p = ε 2 log 2 6 ad = ε such that for all, 8 3 log 2 3 / p log p ε. Thus for ay x > ad, which yields PX i, 1 + εx 4log 2 12 ε 4 P max X i, 1 + εx 4Nlog 2 12 e x2 /2 i J 2 ε 4 x Takig x := 1 + εlog, ad we obtai: P max X i, 1 + ε 2 log i J 2 x e s2 /2 ds 4log 2 12 x x ε 4 e x2/2 x, 4 log 2 8 e x2 /2. ε 4 x 4log 2 8 ε εlog ε. Let k = k 2/ε. By the Borel Catelli lemma ad 5.12, almost surely whe k, Z k 21 + ε2 log k K, k 3/2 log k + O k 1/4 k log 2 k Let k < k+1. Note that k+1 k = O 1 ε/2 k, k. By 5.3, Kt,/ Z t Z k t 2 k,,t z dz Kt,/ +2 Kt z, k Kt, k dz Kt, k / k, 17

18 where k,,t z := Kt z, Kt z, k Kt, + Kt, k. Accordig to Theorem H ad the LIL for the Kiefer process, whe k, k,,t z = O 1 ε/4 k log k log 2 k 1/4 a.s., uiformly i t, 1, z [, Kt, /] ad k < k+1. Thus, by the LIL for the Kiefer process, Kt,/ k,,t z dz = O 1+ε/4 k log k log 2 k 3/4 a.s., uiformly i t, 1 ad k < k+1. O the other had, by the LIL for the Kiefer process ad Theorem G, Kt z, k Kt, k = O 1/4 k log k log 2 k 1/4 a.s., uiformly i t, 1, z [Kt, k / k, Kt, /] ad k < k+1. Sice xxxx I eed a referece for this; Edre has a trick to prove it by meas of Theorem H, he is goig to isert a proof here Kt, Kt, k = O ε/4 k log k a.s., 5.17 t 1 uiformly i k < k+1, it follows that Kt, max Kt, k k < k+1 t [,1] k = O ε/4 k log k a.s. Therefore, almost surely whe k, Kt,/ Kt, k / k Kt z, k Kt, k dz = O 1+ε/4 k log k log 2 k 1/4, uiformly i t [, 1] ad k < k+1. We have therefore proved that max Z Z k = O 1+ε/4 k < k log k log 2 k 1/4, a.s. k+1 Goig back to 5.16 ad takig 5.17 ito accout, we obtai, whe, Z 21 + ε2 log log K, 3/2 + O 3 1/4 log 2 = 1 + o ε2 log K, 3/2, 3 We used i the last lie the other LIL for the Kiefer process Kuelbs, 1979, Mogulskii 1979: K, 1 = O log2 a.s. a.s The proof of 5.1 is complete. 18

19 Proof of 5.2. Let N ad t i, i =, 1,..., N be as before cf Combiig Theorem G with 1 log Kt, = O a.s t 1 cf. Csáki ad Shi, 1998, we coclude max i N 1 Kt i, lim t 1 Kt, = 1 a.s. 5.2 Let t + = t + ω, be such that Kt +, = max i N 1 Kt i, ad cosider the set of idices I := {i : t + h t i t + + h }, where h = log 4. Fix ε, 1. For i I, we obtai from Theorem G, 5.19 ad 5.2 that whe is sufficietly large, Kt i, Kt +, O h log1/h 1 εkt +, >, 5.21 Hece, for i I, we ca apply 5.9 to t = t i ad v = to see that whe, Z t i = 2 NKti,/ log W N i,y dy + O 3/2 1/4 log 2 2 log = 3 Kt i, 3/2 Y i, + O, /4 log 2 where, for each, {Wi,, i =, 1,..., N 1} are idepedet Wieer processes which are also idepedet of {Kt i,, i =, 1,..., N 1}, ad Y i, := 3 3/2 N 3/2 1 Kt i, 3/2 NKti,/ W i,y dy, i I. For each, {Y i,, i I } are idepedet stadard ormal variables. Sice #I N/log 4, we have, by the usual estimate for Gaussia tails, P max Y i, < 1 ε log i I 2 N/log 4 + o ε π log 1 ε/2 2 + o1 N/log 4 exp 1 ε π log 1 ε/2 = exp 2 + o1 ε/2, 1 ε π log 9/2 log 2 4 which sums. By the Borel Catelli lemma, almost surely for all large, max i I Y i, 1 ε log. Pluggig this ito 5.22 ad 5.21 yields that, almost surely, Z max Z t i i I 21 ε3/2 log log Kt + 3, 3/2 + O 1/4 log 2 21 ε2 log 3/2 log Kt, + O. 3 t 1 1/4 log 2 19

20 We used 5.2 i the last iequality. This also holds true for if t 1 Kt, i place of t 1 Kt,, by meas of a similar argumet with Kt +, replaced by Kt, = mi i N 1 Kt i,. Cosequetly, Z 21 ε2 log log K, 3/2 + O 3 1/4 log 2 a.s. I light of 5.18, this yields 5.2. Refereces [1] Bahadur, R.R A ote o quatiles i large samples. A. Math. Statist [2] Cha, A.H.C O the Icremets of Multiparameter Gaussia Processes. Ph.D. Thesis, Carleto Uiversity. [3] Csáki, E. ad Shi, Z Some limif results for two-parameter processes. Stoch. Process. Appl [4] Csörgő, M Quatile Processes with Statistical Applicatios. SIAM, Philadelphia. [5] Csörgő, M. ad Révész, P Some otes o the empirical distributio fuctio ad the quatile process. I: Coll. Math. Soc. J. Bolyai 11 Limit Theorems of Probability Theory, Keszthely, Hugary, pp North Hollad, Amsterdam. [6] Csörgő, M. ad Révész, P Strog Approximatios i Probability ad Statistics. Academic Press, New York. [7] Csörgő, M. ad Shi, Z A L p -view of the Bahadur Kiefer theorem. Tech. Report No. 324 of the Laboratory for Research i Statistics ad Probability, Carleto Uiversity ad Uiversity of Ottawa, Ottawa. [8] Csörgő, M. ad Szyszkowicz, B Sequetial quatile ad Bahadur Kiefer processes. I: Order Statistics: Theory & Methods eds. N. Balakrisha ad C.R. Rao pp Elsevier Sciece B.V., Amsterdam. [9] Csörgő, M. ad Zitikis, R Strasse s LIL for the Lorez curve. J. Multivariate Aalysis [1] Csörgő, M. ad Zitikis, R O the geeral Bahadur Kiefer, quatile, ad Vervaat processes: old ad ew. Tech. Report No. 323 of the Laboratory for Research i Statistics ad Probability, Carleto Uiversity ad Uiversity of Ottawa, Ottawa. To appear i: Bolyai Society Mathematical Studies: A Volume i Hoour of Pál Révész. [11] Csörgő, M. ad Zitikis, R. 1999a. The Vervaat process i L p -spaces. Tech. Report No. 328 of the Laboratory for Research i Statistics ad Probability, Carleto Uiversity ad Uiversity of Ottawa, Ottawa. [12] Csörgő, M. ad Zitikis, R. 1999b. O the Vervaat ad Vervaat-error processes. Acta Applicadae Mathematicae [13] Deheuvels, P O the local oscillatios of empirical ad quatile processes. I: Asymptotic Methods i Probability ad Statistics a Volume i Hoour of Miklós Csörgő ed. B. Szyszkowicz pp Elsevier Sciece B.V., Amsterdam. 2

21 [14] Deheuvels, P. ad Maso, D.M Bahadur Kiefer-type processes. A. Probab [15] Deheuvels, P. ad Maso, D.M A fuctioal LIL approach to poitwise Bahadur Kiefer theorems. I: Probability i Baach Spaces R.M. Dudley et al., eds. pp Birkhäuser, Bosto. [16] Eimahl, J.H.J A short ad elemetary proof of the mai Bahadur Kiefer theorem. A. Probab [17] Ferique, X Cotiuité des processus gaussies. C. R. Acad. Sci. Paris [18] Kiefer, J O Bahadur s represetatio of sample quatiles, A. Math. Statist [19] Kiefer, J Deviatios betwee the sample quatile process ad the sample df. I: Noparametric Techiques i Statistical Iferece ed. M.L. Puri pp Cambridge Uiversity Press, Cambridge. [2] Komlós, J., Major, P. ad Tusády, G A approximatio of partial sums of idepedet R.V. s ad the sample DF. I. Z. Wahrsch. verw. Gebiete [21] Kuelbs, J Rates of growth for Baach space valued idepedet icremet processes. Lecture Notes i Mathematics 79 pp Spriger, New York. [22] Mogulskii, A.A O the law of the iterated logarithm i Chug s form for fuctioal spaces. Th. Probab. Appl [23] Shorack, G.R Kiefer s theorem via the Hugaria costructio. Z. Wahrsch. Verw. Gebiete [24] Shorack, G.R. ad Weller, J.A Empirical Processes with Applicatios to Statistics. Wiley, New York. [25] Vervaat, W. 1972a. Fuctioal cetral limit theorems for processes with positive drift ad their iverses. Z. Wahrsch. Verw. Gebiete [26] Vervaat, W. 1972b. Success Epochs i Beroulli Trials: with Applicatios to Number Theory. Mathematical Cetre Tracts 42 secod editio i Matematisch Cetrum, Amsterdam. [27] Zitikis, R The Vervaat process. I: Asymptotic Methods i Probability ad Statistics a Volume i Hoour of Miklós Csörgő ed. B. Szyszkowicz pp Elsevier Sciece B.V., Amsterdam. 21

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

ON THE RATE Of CONVERGENCE for SOME STRONG APPROXIMATION THEOREMS IN EXTREMAL STATISTICS. Dietma:r Pfe;i.fer

ON THE RATE Of CONVERGENCE for SOME STRONG APPROXIMATION THEOREMS IN EXTREMAL STATISTICS. Dietma:r Pfe;i.fer ON THE RATE Of CONVERGENCE for SOME STRONG APPROXIMATION THEOREMS IN EXTREMAL STATISTICS Dietma:r Pfe;i.fer Abstract. Strog approximatio theorems for the logarithms of record ad iter-record times of a

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

More information

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014. Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the

More information

1 Approximating Integrals using Taylor Polynomials

1 Approximating Integrals using Taylor Polynomials Seughee Ye Ma 8: Week 7 Nov Week 7 Summary This week, we will lear how we ca approximate itegrals usig Taylor series ad umerical methods. Topics Page Approximatig Itegrals usig Taylor Polyomials. Defiitios................................................

More information

Introduction to Probability. Ariel Yadin

Introduction to Probability. Ariel Yadin Itroductio to robability Ariel Yadi Lecture 2 *** Ja. 7 ***. Covergece of Radom Variables As i the case of sequeces of umbers, we would like to talk about covergece of radom variables. There are may ways

More information

LECTURE 8: ASYMPTOTICS I

LECTURE 8: ASYMPTOTICS I LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece

More information

Integrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number

Integrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number MATH 532 Itegrable Fuctios Dr. Neal, WKU We ow shall defie what it meas for a measurable fuctio to be itegrable, show that all itegral properties of simple fuctios still hold, ad the give some coditios

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

Advanced Stochastic Processes.

Advanced Stochastic Processes. Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.

More information

Mi-Hwa Ko and Tae-Sung Kim

Mi-Hwa Ko and Tae-Sung Kim J. Korea Math. Soc. 42 2005), No. 5, pp. 949 957 ALMOST SURE CONVERGENCE FOR WEIGHTED SUMS OF NEGATIVELY ORTHANT DEPENDENT RANDOM VARIABLES Mi-Hwa Ko ad Tae-Sug Kim Abstract. For weighted sum of a sequece

More information

The random version of Dvoretzky s theorem in l n

The random version of Dvoretzky s theorem in l n The radom versio of Dvoretzky s theorem i l Gideo Schechtma Abstract We show that with high probability a sectio of the l ball of dimesio k cε log c > 0 a uiversal costat) is ε close to a multiple of the

More information

Notes 19 : Martingale CLT

Notes 19 : Martingale CLT Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall

More information

An almost sure invariance principle for trimmed sums of random vectors

An almost sure invariance principle for trimmed sums of random vectors Proc. Idia Acad. Sci. Math. Sci. Vol. 20, No. 5, November 200, pp. 6 68. Idia Academy of Scieces A almost sure ivariace priciple for trimmed sums of radom vectors KE-ANG FU School of Statistics ad Mathematics,

More information

Journal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula

Journal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula Joural of Multivariate Aalysis 102 (2011) 1315 1319 Cotets lists available at ScieceDirect Joural of Multivariate Aalysis joural homepage: www.elsevier.com/locate/jmva Superefficiet estimatio of the margials

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 6 9/23/203 Browia motio. Itroductio Cotet.. A heuristic costructio of a Browia motio from a radom walk. 2. Defiitio ad basic properties

More information

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4. 4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad

More information

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality

More information

Notes 5 : More on the a.s. convergence of sums

Notes 5 : More on the a.s. convergence of sums Notes 5 : More o the a.s. covergece of sums Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: Dur0, Sectios.5; Wil9, Sectio 4.7, Shi96, Sectio IV.4, Dur0, Sectio.. Radom series. Three-series

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

Lesson 10: Limits and Continuity

Lesson 10: Limits and Continuity www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals

More information

Limit distributions for products of sums

Limit distributions for products of sums Statistics & Probability Letters 62 (23) 93 Limit distributios for products of sums Yogcheg Qi Departmet of Mathematics ad Statistics, Uiversity of Miesota-Duluth, Campus Ceter 4, 7 Uiversity Drive, Duluth,

More information

A Hadamard-type lower bound for symmetric diagonally dominant positive matrices

A Hadamard-type lower bound for symmetric diagonally dominant positive matrices A Hadamard-type lower boud for symmetric diagoally domiat positive matrices Christopher J. Hillar, Adre Wibisoo Uiversity of Califoria, Berkeley Jauary 7, 205 Abstract We prove a ew lower-boud form of

More information

MAT1026 Calculus II Basic Convergence Tests for Series

MAT1026 Calculus II Basic Convergence Tests for Series MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece

More information

Notes 27 : Brownian motion: path properties

Notes 27 : Brownian motion: path properties Notes 27 : Browia motio: path properties Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces:[Dur10, Sectio 8.1], [MP10, Sectio 1.1, 1.2, 1.3]. Recall: DEF 27.1 (Covariace) Let X = (X

More information

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo

More information

Generalized Law of the Iterated Logarithm and Its Convergence Rate

Generalized Law of the Iterated Logarithm and Its Convergence Rate Stochastic Aalysis ad Applicatios, 25: 89 03, 2007 Copyright Taylor & Fracis Group, LLC ISSN 0736-2994 prit/532-9356 olie DOI: 0.080/073629906005997 Geeralized Law of the Iterated Logarithm ad Its Covergece

More information

Asymptotic distribution of products of sums of independent random variables

Asymptotic distribution of products of sums of independent random variables Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege

More information

1+x 1 + α+x. x = 2(α x2 ) 1+x

1+x 1 + α+x. x = 2(α x2 ) 1+x Math 2030 Homework 6 Solutios # [Problem 5] For coveiece we let α lim sup a ad β lim sup b. Without loss of geerality let us assume that α β. If α the by assumptio β < so i this case α + β. By Theorem

More information

A NOTE ON BOUNDARY BLOW-UP PROBLEM OF u = u p

A NOTE ON BOUNDARY BLOW-UP PROBLEM OF u = u p A NOTE ON BOUNDARY BLOW-UP PROBLEM OF u = u p SEICK KIM Abstract. Assume that Ω is a bouded domai i R with 2. We study positive solutios to the problem, u = u p i Ω, u(x) as x Ω, where p > 1. Such solutios

More information

Distribution of Random Samples & Limit theorems

Distribution of Random Samples & Limit theorems STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

Berry-Esseen bounds for self-normalized martingales

Berry-Esseen bounds for self-normalized martingales Berry-Essee bouds for self-ormalized martigales Xiequa Fa a, Qi-Ma Shao b a Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji 30007, Chia b Departmet of Statistics, The Chiese Uiversity of Hog Kog,

More information

Mathematics 170B Selected HW Solutions.

Mathematics 170B Selected HW Solutions. Mathematics 17B Selected HW Solutios. F 4. Suppose X is B(,p). (a)fidthemometgeeratigfuctiom (s)of(x p)/ p(1 p). Write q = 1 p. The MGF of X is (pe s + q), sice X ca be writte as the sum of idepedet Beroulli

More information

Entropy Rates and Asymptotic Equipartition

Entropy Rates and Asymptotic Equipartition Chapter 29 Etropy Rates ad Asymptotic Equipartitio Sectio 29. itroduces the etropy rate the asymptotic etropy per time-step of a stochastic process ad shows that it is well-defied; ad similarly for iformatio,

More information

Self-normalized deviation inequalities with application to t-statistic

Self-normalized deviation inequalities with application to t-statistic Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric

More information

Random Models. Tusheng Zhang. February 14, 2013

Random Models. Tusheng Zhang. February 14, 2013 Radom Models Tusheg Zhag February 14, 013 1 Radom Walks Let me describe the model. Radom walks are used to describe the motio of a movig particle (object). Suppose that a particle (object) moves alog the

More information

Sequences and Series of Functions

Sequences and Series of Functions Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges

More information

NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE

NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE UPB Sci Bull, Series A, Vol 79, Iss, 207 ISSN 22-7027 NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE Gabriel Bercu We itroduce two ew sequeces of Euler-Mascheroi type which have fast covergece

More information

An alternative proof of a theorem of Aldous. concerning convergence in distribution for martingales.

An alternative proof of a theorem of Aldous. concerning convergence in distribution for martingales. A alterative proof of a theorem of Aldous cocerig covergece i distributio for martigales. Maurizio Pratelli Dipartimeto di Matematica, Uiversità di Pisa. Via Buoarroti 2. I-56127 Pisa, Italy e-mail: pratelli@dm.uipi.it

More information

The log-behavior of n p(n) and n p(n)/n

The log-behavior of n p(n) and n p(n)/n Ramauja J. 44 017, 81-99 The log-behavior of p ad p/ William Y.C. Che 1 ad Ke Y. Zheg 1 Ceter for Applied Mathematics Tiaji Uiversity Tiaji 0007, P. R. Chia Ceter for Combiatorics, LPMC Nakai Uivercity

More information

Frequentist Inference

Frequentist Inference Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for

More information

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1. Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio

More information

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A.

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A. Radom Walks o Discrete ad Cotiuous Circles by Jeffrey S. Rosethal School of Mathematics, Uiversity of Miesota, Mieapolis, MN, U.S.A. 55455 (Appeared i Joural of Applied Probability 30 (1993), 780 789.)

More information

1 The Haar functions and the Brownian motion

1 The Haar functions and the Brownian motion 1 The Haar fuctios ad the Browia motio 1.1 The Haar fuctios ad their completeess The Haar fuctios The basic Haar fuctio is 1 if x < 1/2, ψx) = 1 if 1/2 x < 1, otherwise. 1.1) It has mea zero 1 ψx)dx =,

More information

Solution. 1 Solutions of Homework 1. Sangchul Lee. October 27, Problem 1.1

Solution. 1 Solutions of Homework 1. Sangchul Lee. October 27, Problem 1.1 Solutio Sagchul Lee October 7, 017 1 Solutios of Homework 1 Problem 1.1 Let Ω,F,P) be a probability space. Show that if {A : N} F such that A := lim A exists, the PA) = lim PA ). Proof. Usig the cotiuity

More information

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3 MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special

More information

Lecture 2 Long paths in random graphs

Lecture 2 Long paths in random graphs Lecture Log paths i radom graphs 1 Itroductio I this lecture we treat the appearace of log paths ad cycles i sparse radom graphs. will wor with the probability space G(, p) of biomial radom graphs, aalogous

More information

On the convergence rates of Gladyshev s Hurst index estimator

On the convergence rates of Gladyshev s Hurst index estimator Noliear Aalysis: Modellig ad Cotrol, 2010, Vol 15, No 4, 445 450 O the covergece rates of Gladyshev s Hurst idex estimator K Kubilius 1, D Melichov 2 1 Istitute of Mathematics ad Iformatics, Vilius Uiversity

More information

Lecture 3 The Lebesgue Integral

Lecture 3 The Lebesgue Integral Lecture 3: The Lebesgue Itegral 1 of 14 Course: Theory of Probability I Term: Fall 2013 Istructor: Gorda Zitkovic Lecture 3 The Lebesgue Itegral The costructio of the itegral Uless expressly specified

More information

32 estimating the cumulative distribution function

32 estimating the cumulative distribution function 32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio

More information

7 Sequences of real numbers

7 Sequences of real numbers 40 7 Sequeces of real umbers 7. Defiitios ad examples Defiitio 7... A sequece of real umbers is a real fuctio whose domai is the set N of atural umbers. Let s : N R be a sequece. The the values of s are

More information

Math 2784 (or 2794W) University of Connecticut

Math 2784 (or 2794W) University of Connecticut ORDERS OF GROWTH PAT SMITH Math 2784 (or 2794W) Uiversity of Coecticut Date: Mar. 2, 22. ORDERS OF GROWTH. Itroductio Gaiig a ituitive feel for the relative growth of fuctios is importat if you really

More information

Math 113, Calculus II Winter 2007 Final Exam Solutions

Math 113, Calculus II Winter 2007 Final Exam Solutions Math, Calculus II Witer 7 Fial Exam Solutios (5 poits) Use the limit defiitio of the defiite itegral ad the sum formulas to compute x x + dx The check your aswer usig the Evaluatio Theorem Solutio: I this

More information

The natural exponential function

The natural exponential function The atural expoetial fuctio Attila Máté Brookly College of the City Uiversity of New York December, 205 Cotets The atural expoetial fuctio for real x. Beroulli s iequality.....................................2

More information

Math Solutions to homework 6

Math Solutions to homework 6 Math 175 - Solutios to homework 6 Cédric De Groote November 16, 2017 Problem 1 (8.11 i the book): Let K be a compact Hermitia operator o a Hilbert space H ad let the kerel of K be {0}. Show that there

More information

MA131 - Analysis 1. Workbook 2 Sequences I

MA131 - Analysis 1. Workbook 2 Sequences I MA3 - Aalysis Workbook 2 Sequeces I Autum 203 Cotets 2 Sequeces I 2. Itroductio.............................. 2.2 Icreasig ad Decreasig Sequeces................ 2 2.3 Bouded Sequeces..........................

More information

Measure and Measurable Functions

Measure and Measurable Functions 3 Measure ad Measurable Fuctios 3.1 Measure o a Arbitrary σ-algebra Recall from Chapter 2 that the set M of all Lebesgue measurable sets has the followig properties: R M, E M implies E c M, E M for N implies

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 3 9//203 Large deviatios Theory. Cramér s Theorem Cotet.. Cramér s Theorem. 2. Rate fuctio ad properties. 3. Chage of measure techique.

More information

Assignment 5: Solutions

Assignment 5: Solutions McGill Uiversity Departmet of Mathematics ad Statistics MATH 54 Aalysis, Fall 05 Assigmet 5: Solutios. Let y be a ubouded sequece of positive umbers satisfyig y + > y for all N. Let x be aother sequece

More information

Regression with an Evaporating Logarithmic Trend

Regression with an Evaporating Logarithmic Trend Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,

More information

Kolmogorov-Smirnov type Tests for Local Gaussianity in High-Frequency Data

Kolmogorov-Smirnov type Tests for Local Gaussianity in High-Frequency Data Proceedigs 59th ISI World Statistics Cogress, 5-30 August 013, Hog Kog (Sessio STS046) p.09 Kolmogorov-Smirov type Tests for Local Gaussiaity i High-Frequecy Data George Tauche, Duke Uiversity Viktor Todorov,

More information

ECE 330:541, Stochastic Signals and Systems Lecture Notes on Limit Theorems from Probability Fall 2002

ECE 330:541, Stochastic Signals and Systems Lecture Notes on Limit Theorems from Probability Fall 2002 ECE 330:541, Stochastic Sigals ad Systems Lecture Notes o Limit Theorems from robability Fall 00 I practice, there are two ways we ca costruct a ew sequece of radom variables from a old sequece of radom

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT Itroductio to Extreme Value Theory Laures de Haa, ISM Japa, 202 Itroductio to Extreme Value Theory Laures de Haa Erasmus Uiversity Rotterdam, NL Uiversity of Lisbo, PT Itroductio to Extreme Value Theory

More information

A Note on the Kolmogorov-Feller Weak Law of Large Numbers

A Note on the Kolmogorov-Feller Weak Law of Large Numbers Joural of Mathematical Research with Applicatios Mar., 015, Vol. 35, No., pp. 3 8 DOI:10.3770/j.iss:095-651.015.0.013 Http://jmre.dlut.edu.c A Note o the Kolmogorov-Feller Weak Law of Large Numbers Yachu

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information

MATH301 Real Analysis (2008 Fall) Tutorial Note #7. k=1 f k (x) converges pointwise to S(x) on E if and

MATH301 Real Analysis (2008 Fall) Tutorial Note #7. k=1 f k (x) converges pointwise to S(x) on E if and MATH01 Real Aalysis (2008 Fall) Tutorial Note #7 Sequece ad Series of fuctio 1: Poitwise Covergece ad Uiform Covergece Part I: Poitwise Covergece Defiitio of poitwise covergece: A sequece of fuctios f

More information

Kernel density estimator

Kernel density estimator Jauary, 07 NONPARAMETRIC ERNEL DENSITY ESTIMATION I this lecture, we discuss kerel estimatio of probability desity fuctios PDF Noparametric desity estimatio is oe of the cetral problems i statistics I

More information

On the optimality of McLeish s conditions for the central limit theorem

On the optimality of McLeish s conditions for the central limit theorem O the optimality of McLeish s coditios for the cetral limit theorem Jérôme Dedecker a a Laboratoire MAP5, CNRS UMR 845, Uiversité Paris-Descartes, Sorboe Paris Cité, 45 rue des Saits Pères, 7570 Paris

More information

Singular Continuous Measures by Michael Pejic 5/14/10

Singular Continuous Measures by Michael Pejic 5/14/10 Sigular Cotiuous Measures by Michael Peic 5/4/0 Prelimiaries Give a set X, a σ-algebra o X is a collectio of subsets of X that cotais X ad ad is closed uder complemetatio ad coutable uios hece, coutable

More information

Math 113 Exam 3 Practice

Math 113 Exam 3 Practice Math Exam Practice Exam will cover.-.9. This sheet has three sectios. The first sectio will remid you about techiques ad formulas that you should kow. The secod gives a umber of practice questios for you

More information

Chapter 10: Power Series

Chapter 10: Power Series Chapter : Power Series 57 Chapter Overview: Power Series The reaso series are part of a Calculus course is that there are fuctios which caot be itegrated. All power series, though, ca be itegrated because

More information

LECTURES 5 AND 6: CONVERGENCE TESTS

LECTURES 5 AND 6: CONVERGENCE TESTS LECTURES 5 AND 6: CONVERGENCE TESTS I the previous lecture we saw a very basic test for covergece - the compariso test. Here we develop slightly more sophisticated machiery for determiig the covergece

More information

1 Convergence in Probability and the Weak Law of Large Numbers

1 Convergence in Probability and the Weak Law of Large Numbers 36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec

More information

EFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS

EFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS EFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS Ryszard Zieliński Ist Math Polish Acad Sc POBox 21, 00-956 Warszawa 10, Polad e-mail: rziel@impagovpl ABSTRACT Weak laws of large umbers (W LLN), strog

More information

1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1

1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1 8. The cetral limit theorems 8.1. The cetral limit theorem for i.i.d. sequeces. ecall that C ( is N -separatig. Theorem 8.1. Let X 1, X,... be i.i.d. radom variables with EX 1 = ad EX 1 = σ (,. Suppose

More information

Rademacher Complexity

Rademacher Complexity EECS 598: Statistical Learig Theory, Witer 204 Topic 0 Rademacher Complexity Lecturer: Clayto Scott Scribe: Ya Deg, Kevi Moo Disclaimer: These otes have ot bee subjected to the usual scrutiy reserved for

More information

Probability for mathematicians INDEPENDENCE TAU

Probability for mathematicians INDEPENDENCE TAU Probability for mathematicias INDEPENDENCE TAU 2013 28 Cotets 3 Ifiite idepedet sequeces 28 3a Idepedet evets........................ 28 3b Idepedet radom variables.................. 33 3 Ifiite idepedet

More information

ON MEAN ERGODIC CONVERGENCE IN THE CALKIN ALGEBRAS

ON MEAN ERGODIC CONVERGENCE IN THE CALKIN ALGEBRAS PROCEEDINGS OF THE AMERICAN MATHEMATICAL SOCIETY Volume 00, Number 0, Pages 000 000 S 0002-9939(XX0000-0 ON MEAN ERGODIC CONVERGENCE IN THE CALKIN ALGEBRAS MARCH T. BOEDIHARDJO AND WILLIAM B. JOHNSON 2

More information

Chapter 7 Isoperimetric problem

Chapter 7 Isoperimetric problem Chapter 7 Isoperimetric problem Recall that the isoperimetric problem (see the itroductio its coectio with ido s proble) is oe of the most classical problem of a shape optimizatio. It ca be formulated

More information

THE STRONG LAW OF LARGE NUMBERS FOR STATIONARY SEQUENCES

THE STRONG LAW OF LARGE NUMBERS FOR STATIONARY SEQUENCES THE STRONG LAW OF LARGE NUMBERS FOR STATIONARY SEQUENCES Debdeep Pati Idia Statistical Istitute, Kolkata Jue 26, 2006 Abstract The traditioal proof of the strog law of large umbers usig idepedet ad idetically

More information

Gamma Distribution and Gamma Approximation

Gamma Distribution and Gamma Approximation Gamma Distributio ad Gamma Approimatio Xiaomig Zeg a Fuhua (Frak Cheg b a Xiame Uiversity, Xiame 365, Chia mzeg@jigia.mu.edu.c b Uiversity of Ketucky, Leigto, Ketucky 456-46, USA cheg@cs.uky.edu Abstract

More information

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a

More information

Math 113 Exam 3 Practice

Math 113 Exam 3 Practice Math Exam Practice Exam 4 will cover.-., 0. ad 0.. Note that eve though. was tested i exam, questios from that sectios may also be o this exam. For practice problems o., refer to the last review. This

More information

Hoggatt and King [lo] defined a complete sequence of natural numbers

Hoggatt and King [lo] defined a complete sequence of natural numbers REPRESENTATIONS OF N AS A SUM OF DISTINCT ELEMENTS FROM SPECIAL SEQUENCES DAVID A. KLARNER, Uiversity of Alberta, Edmoto, Caada 1. INTRODUCTION Let a, I deote a sequece of atural umbers which satisfies

More information

Dimension-free PAC-Bayesian bounds for the estimation of the mean of a random vector

Dimension-free PAC-Bayesian bounds for the estimation of the mean of a random vector Dimesio-free PAC-Bayesia bouds for the estimatio of the mea of a radom vector Olivier Catoi CREST CNRS UMR 9194 Uiversité Paris Saclay olivier.catoi@esae.fr Ilaria Giulii Laboratoire de Probabilités et

More information

Fall 2013 MTH431/531 Real analysis Section Notes

Fall 2013 MTH431/531 Real analysis Section Notes Fall 013 MTH431/531 Real aalysis Sectio 8.1-8. Notes Yi Su 013.11.1 1. Defiitio of uiform covergece. We look at a sequece of fuctios f (x) ad study the coverget property. Notice we have two parameters

More information

AN EXTENSION OF SIMONS INEQUALITY AND APPLICATIONS. Robert DEVILLE and Catherine FINET

AN EXTENSION OF SIMONS INEQUALITY AND APPLICATIONS. Robert DEVILLE and Catherine FINET 2001 vol. XIV, um. 1, 95-104 ISSN 1139-1138 AN EXTENSION OF SIMONS INEQUALITY AND APPLICATIONS Robert DEVILLE ad Catherie FINET Abstract This article is devoted to a extesio of Simos iequality. As a cosequece,

More information

<, if ε > 0 2nloglogn. =, if ε < 0.

<, if ε > 0 2nloglogn. =, if ε < 0. GLASNIK MATEMATIČKI Vol. 52(72)(207), 35 360 THE DAVIS-GUT LAW FOR INDEPENDENT AND IDENTICALLY DISTRIBUTED BANACH SPACE VALUED RANDOM ELEMENTS Pigya Che, Migyag Zhag ad Adrew Rosalsky Jia Uversity, P.

More information

Sequences I. Chapter Introduction

Sequences I. Chapter Introduction Chapter 2 Sequeces I 2. Itroductio A sequece is a list of umbers i a defiite order so that we kow which umber is i the first place, which umber is i the secod place ad, for ay atural umber, we kow which

More information

This section is optional.

This section is optional. 4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore

More information

Linear Regression Demystified

Linear Regression Demystified Liear Regressio Demystified Liear regressio is a importat subject i statistics. I elemetary statistics courses, formulae related to liear regressio are ofte stated without derivatio. This ote iteds to

More information

Estimation of the essential supremum of a regression function

Estimation of the essential supremum of a regression function Estimatio of the essetial supremum of a regressio fuctio Michael ohler, Adam rzyżak 2, ad Harro Walk 3 Fachbereich Mathematik, Techische Uiversität Darmstadt, Schlossgartestr. 7, 64289 Darmstadt, Germay,

More information

Advanced Analysis. Min Yan Department of Mathematics Hong Kong University of Science and Technology

Advanced Analysis. Min Yan Department of Mathematics Hong Kong University of Science and Technology Advaced Aalysis Mi Ya Departmet of Mathematics Hog Kog Uiversity of Sciece ad Techology September 3, 009 Cotets Limit ad Cotiuity 7 Limit of Sequece 8 Defiitio 8 Property 3 3 Ifiity ad Ifiitesimal 8 4

More information