Sharp large deviations for sums of bounded from above random variables

Size: px
Start display at page:

Download "Sharp large deviations for sums of bounded from above random variables"

Transcription

1 Noame mauscript No. will be iserted by the editor Sharp large deviatios for sums of bouded from above radom variables Xiequa Fa Received: date / Accepted: date Abstract We show large deviatio epasios for sums of idepedet ad bouded from above radom variables. Our moderate deviatio epasios are similar to those of Cramér 1938, Bahadur ad Raga Rao 196, ad Sakhaeko I particular, our results eted Talagrad s iequality from bouded radom variables to radom variables havig fiite +δth momets, where δ, 1]. As a cosequece, we obtai a improvemet of Hoeffdig s iequality. Applicatios to liear regressio, self-ormalized large deviatios ad t-statistic are also discussed. Keywords sharp large deviatios Cramér large deviatios Talagrad s iequality Hoeffdig s iequality sums of idepedet radom variables Mathematics Subject Classificatio 6F1 6F5 6E15 6G5 1 Itroductio Let ξ i i 1 be a sequece of idepedet o-degeerate radom variables r.v.s satisfyig Eξ i =. The study of sharp large deviatios has a log history. May iterestig asymptotic epasios have bee established i Cramér [8], Bahadur ad Raga Rao [1], Petrov [17, 18], Saulis ad Statulevičius [1], Sakhaeko [], Nagaev [16], Bercu ad Rouault [5], Borovkov ad Mogulskii [6], Petrov ad Robiso [19] ad [1]. See also Grama ad Haeusler [13] ad [11] for martigales. For self-ormalized sums, we refer to Shao [3] ad Jig, Shao ad Wag [15], where the authors have established Cramér type large deviatios for self-ormalized r.v.s uder fiite +δth momets, where δ,1]. I this paper, we cosider the sharp large deviatios for sums of bouded from above r.v.s ξ i A for all i, where A is a positive costat. Without loss of geerality, we take A = 1, otherwise we cosider ξ i /A istead of ξ i. Thus ξ i 1 for all i. Let S = ξ i. Deote i = Eξ i ad = i. X. Fa Ceter for Applied Mathematics, Tiaji Uiversity, 37 Tiaji, Chia; Regularity Team, INRIA Saclay, Palaiseau, 911, Frace faiequa@hotmail.com

2 Xiequa Fa The celebrated Beett iequality [] states that: If ξ i 1 for all 1 i, the for all >, + PS B, := e. 1 However, Beett s iequality is ot tight eough. Oe of the improvemets o Beett s iequality is Hoeffdig s iequality cf..8 of [14], which states that for all >, PS H, + } + := 1 + } B,, 3 where ad hereafter by covetio = 1 applied whe =. Cosiderig the followig distributio law Pη i = 1 = / 1+ / ad Pη i = / = 1 1+ /, 4 Hoeffdig showed that is the best that ca be obtaied from the followig epoetial Markov iequality PS if λ EeλS,. Ideed, it is easy to see that Eη i =,η i 1, Eη i = / ad if Eep λ λ } η i = H, for all. Notice that lim PS > = 1 Φ ad lim H, = e /, where Φ = 1 π e t dt is the stadard ormal distributio fuctio. The cetral limit theorem CLT suggests that Hoeffdig s iequality ca be substatially refied by addig a missig factor Θ as, where Θ = The factor Θ satisfies 1 Φ ep } = O 1, Θ,, 6 π1+ π1+ ad πθ is kow as Mill s ratio. For sums of bouded r.v.s B ξ i 1 for some costat B 1 ad all 1 i, Talagrad [4] proved the followig iequalities: For all C B, PS if Θ+C B Θ+C B λ EeλS 7 H,, 8

3 Sharp large deviatios for sums 3 wherec > isaabsolutecostat.seealsosakhaeko[]foraresultsimilarto7butθ isreplacedbyθα, whereα = sup λ [λ logee λs ]} 1/.By6,Talagrad siequality 1 8 improves Hoeffdig s iequality by addig a factor Θ[1 + o1] of order 1+ i the rage = o B as B. I the i.i.d. case, this rage reduces to = o,. I this paper, we eted Talagrad s iequality 7 from bouded r.v.s to r.v.s havig fiite +δth momets, δ,1]. I particular, we improve Talagrad s iequality to a equality, which will imply simple large deviatio epasios. Moreover, a improvemet of Hoeffdig s iequality uder fiite +δth momets is also give. The paper is orgaized as follows. I Sectio, we preset the etesio of Talagrad s iequality. I Sectio 3, we apply our result to liear regressio. I Sectio 4, we give two lower bouds for self-ormalized moderate deviatios ad t-statistic. I Sectio 5, we prepare some auiliary results. I Sectios 6 ad 7, we prove the mai theorems. A etesio of Talagrad s iequality Throughout the paper, we make use of the followig otatios: a b = mia,b}, a b = maa,b}, a + = a, ad θ stads for some values satisfyig θ 1. Moreover, we deote C ad C δ, probably supplied with some idices, a geeric positive absolute costat ad a geeric positive costat depedig oly o δ, respectively. Our mai result is the followig theorem, which eteds Talagrad s iequality 7 from bouded r.v.s to r.v.s havig fiite +δth momets, δ,1]. Theorem 1 Assume that ξ i 1, ad that there eist two costats B 1 ad δ,1] such that The for all C δ B, PS = E ξ i +δ B δ Eξi, i 1. 9 B δ Θ+θC if λ EeλS. 1 I particular, i the i.i.d.case, it implies that for all = o δ/, as. PS = 1+o1 11 Θif λ EeλS By ispectig the proof of Theorem 1, we ca see that Theorem 1 holds true for C δ = 3 61/δ ad C = To show the tightess of equality 1, let S = ε ε be the sums of idepedet Rademacher r.v.s, i.e. Pε i = ±1 = 1 for all i. We display the tail probabilities ad the simulatio of PS R, = Θif λ Ee = PS λs ΘH, i Figure 1, which shows that R, is very close to 1 for large s. I the followig corollary, we give a improvemet o Hoeffdig s iequality.

4 4 Xiequa Fa Approimatio for = 49 Compariso for = 49 Probabilities PS ΘH, Ratios R, Approimatio for = 1 Compariso for = 1 Probabilities PS ΘH, Ratios R, Approimatio for = 1 Compariso for = 1 Probabilities PS ΘH, Ratios Fig. 1 Tail probabilities ad ratios R, are displayed as a fuctio of ad various. Corollary 1 Assume coditio of Theorem 1. The for all C δ B, B δ PS Θ+C 1 H,. 1 It is clear that iequality 1 improves Hoeffdig s boud H, by addig a missig factor Θ+C B δ 1. By 6, this factor is of order of Θ[1+o1] i the rage = o /B δ as B/. I the i.i.d. case, this rage reduces to = o δ/ as. For r.v.s ξ i without momets of order larger tha, some improvemets of Hoeffdig s iequality ca be foud i Betkus [3] ad Betkus, Kalosha ad va Zuijle [4]. See also Pielis [] for a improvemets of Beett-Hoeffdig s iequality 3 which is larger tha

5 Sharp large deviatios for sums 5 Hoeffdig s iequality. I particular, whe ξ i 1 for all 1 i, Betkus [3] showed that PS e Po η i, 13 whereη i arei.i.d.withdistributio4adp o η i isthelog-cocavehullofp η i,i.e.p o isthemiimumlog-cocavefuctiosuchthatp o P.Applyig1toP η i with B = ma1, } ad δ = 1, we have for all 1 C mi,}, 1 P η i = Θ+O1ma, } H,. 14 By the iequalities 13 ad 14, we fid that 1 refies Betkus costat e to 1+o1 for all = o ma 1 δ, } as. Iequality 1 implies the followig Cramér type large deviatios. Corollary Assume coditio of Theorem 1. The for all where ˇ = 1+ 3 PS ad satisfies C δ B, 1 Φˇ [ B ] δ 1+C1+ ˇ, 15 ˇ = 1 6 +o as. I particular, i the i.i.d. case, it implies that for all = o δ/, [ ] PS 1 Φˇ 1+o1. 16 The iterestig feature of the boud 16 is that it closely recoversthe shape of the stadard ormal tail for all = o δ/ as. 3 Applicatio to liear regressio The liear regressio model is give by X k = θφ k +ε k, k 1, 17 where X k,φ k ad ε k are, respectively, the respose variable, the positive covariate ad the oise. Let ε k k 1 be a sequece of i.i.d. radom variables, with fiite variace Eε k = 1 >. Our iterest is to estimate the ukow parameter θ, based o the radom variables X k k 1 ad φ k k 1. The well-kow least squares estimator θ is give by θ = k=1 φ kx k. 18 k=1 φ k Cosider the self-ormalized approimatio θ θ Σk=1 φ k. I the real-world applicatios, for istace cosiderig the impact of the footprit size φ k o the height X k, it is plausible that a φ k b for two positive absolute costats a ad b. If X k, the we also have ε k = X k θϕ k θb c for a positive absolute costat c. By Theorem 1 ad Corollary 1, we have the followig result.

6 6 Xiequa Fa Theorem Assume that there eist three positive absolute costats a, b ad c such that for all k 1, a φ k b, ε k c. We also assume that E ε k +δ < for a absolute costat δ,1]. The for all = o, P θ θ Σk=1 φ k 1 = Θ+θC 1 if Eep φ k ε } k λ δ/ λ + 1 k=1 φ k Θ+C 1 δ/ Proof. From 17 ad 18, it is easy to see that Set H, a1. bc θ θ Σ k=1 φk = φ k ε k. 19 k=1 φ k ξ i = φ kε k a bc. k=1 φ k The it is easy to verify that ξ i 1, Eξi = a 1 a b c ad θ θ Σk=1 φ k bc k=1 = ξ i. By Theorem 1 ad Corollary 1, it follows that for all = o, P θ θ Σk=1 φ k 1 = Θ+θC 1 if Eep a1 } λ ξ δ/ i λ bc = Θ+θC 1 if Eep φ k ε } k λ δ/ λ + 1 k=1 φ k which completes the proof of theorem. Θ+C 1 δ/ H, a1, bc 4 Applicatios to self-ormalized deviatios ad t-statistic Limit theorems for self-ormalized sums S /V, V = ξ i, put a totally ew couteace o classical limit theorems. It is well kow that self-ormalized limit theorems require much fewer momet coditios tha that of ormalized limit theorems. For eample, uder fiite +δth momets, δ,1], Jig, Shao ad Wag [15] showed that PS /V > 1 Φ uiformly for all = omiε 1, κ 1 }, where ε δ = E ξ i / +δ = ep O 1 } 1+ +δ ε δ ad κ = ma 1 i Eξ i/.

7 Sharp large deviatios for sums 7 The proof of lower boud for self-ormalized Cramér type large deviatios is based o the followig observatio: For ay,λ >, } S /V S +λ V } = λ } ζ i λ, where ζ i λ = λξ i 1 λ ξi. Thus P S /V P ζ iλ. Notice that λξi 1 λ ξi i 1 is also a sequece of idepedet radomvariablesadsatisfiesλξ i 1 λ ξi 1.Byaargumetsimilartothe proof of Theorem 1, we have the followig lower boud o the tail probabilities of self-ormalized sums. Theorem 3 Assume that there eist two costats B > ad δ,1] such that The for all = o B, where P S /V P E ξ i +δ B δ Eξ i, i 1. = ep Ψ λ = ζ i λ +Ψ λ } B δ Θ+θC, 1 logee ζiλ ad λ is defied by the followig equatio Eζ i λe ζiλ Ee ζiλ =. Moreover, it holds for all = o B, Ψ λ = O1 +δ B δ, 3 where O1 is bouded by a absolute costat. The self-ormalized sums are closely related to Studet s t-statistic. Studet s t-statistic T is defied by the followig formula T = ξ /, where ξ = S It is kow that for all, P T ad = = P S /V ξ i ξ /. See Efro [9]. By the last equality, oce we have a estimatio for the tail probabilities of self-ormalized sums S /V, we have a similar estimatio for the tail probabilities of T. So Theorem 3 implies the followig lower boud o tail probabilities of T.

8 8 Xiequa Fa Theorem 4 Assume the coditio of Theorem 3. The for all = o B, P T ep B + +Ψ λ} Θ +θc / where Ψ λ is defied by ad λ is defied by the followig equatio Eζ i λe ζiλ Ee ζiλ = + 1. δ, 5 Auiliary Results Cosider the positive radom variable Z λ = e λξi Eeλξi, λ, so that EZ λ = 1 the Esscher trasformatio. Itroduce the cojugate probability measure P λ defied by dp λ = Z λdp. 4 Deote by E λ the epectatio with respect to P λ. Settig ad we obtai the followig decompositio: where B k λ = b i λ = E λ ξ i = Eξ ie λξi Ee λξi, i = 1,...,, η i λ = ξ i b i λ, i = 1,...,, S k = B k λ+y k λ, k = 1,...,, 5 k b i λ ad Y k λ = k η i λ. I the proof of our mai result, we shall eed a two-sided boud of B λ. To this ed, we eed some techical lemmas. For a radom variable bouded from above, the followig iequality is well-kow. Lemma 1 Assume ξ 1. Deote by the stadard variace of ξ. The for all λ, where Ee λξ Beλ,, Beλ,t = t 1+t epλ}+ 1 1+t ep λt}. A proof of the iequality ca be foud i Beett []. This iequality is sharp, ad it attais to equality whe ξ has the distributio law: Pξ = 1 = 1+ ad Pξ = = 1 1+.

9 Sharp large deviatios for sums 9 Lemma Assume E ξ +δ B δ Eξ for some costats B ad δ,1]. The Eξ B. 6 Proof. Usig Jese s iequality, we deduce that Eξ +δ/ E ξ +δ B δ Eξ, which implies 6. Lemma 3 Assume E ξ +δ B δ Eξ for some costats B ad δ,1]. The for all λ, Eξ e λξ 1 B δ λ δ Eξ. 7 Proof. Usig the followig iequality t e t t 1 t δ,t R, we deduce that for all λ, Eλξ e λξ Eλξ E λξ +δ λ Eξ λb δ Eξ, 8 which gives the desired iequality. I the followig lemma, we give a two-sided boud for B λ. Lemma 4 Assume ξ i 1 for all i. The for all λ, B λ e λ 1. If ξ i satisfies E ξ i +δ B δ Eξi for some costats B ad δ,1] for all i, the for all λ, B λ 1 Bδ λ δ λ e λ. 1+δ Proof. By Jese s iequality, we have for all λ, Ee λξi e λeξi = 1. Notice that Eξ i e λξi = Eξ i e λξi 1 for λ. The by the fact ξ i 1, we obtai the upper boud of B λ : For all λ, B λ Eξ i e λξi = λ i et dt = e λ 1. λ Eξ ie tξi dt If ξ i satisfies E ξ i +δ B δ Eξi, by Lemma 3, it follows that for all λ, λ Eξ i e λξi = Eξie tξi dt λ 1 B δ t δ dt = 1 Bδ λ δ λ. 1+δ Therefore, we get the lower boud of B λ: For all λ, Eξ i e λξi B λ = 1 Bδ λ δ λ e λ, Ee λξi 1+δ Eξ i

10 1 Xiequa Fa which completes the proof of Lemma 4. Net, we give a upper boud for the cumulat fuctio Ψ λ = logee λξi, λ. 9 Lemma 5 Assume ξ i 1 for all i. The for all λ, 1 Ψ λ log 1+ / ep λ / } + / 1+ / epλ}. Proof. Sice the fuctio fλ,t = log 1 1+t ep λt}+ t 1+t epλ}, λ,t, has a egative secod derivative i t >, the for ay fied λ, fλ,t is cove i t. Therefore, by Lemma 1 ad Jese s iequality, we get for all λ, Ψ λ fλ,i fλ, / 1 = log 1+ / ep λ / } + / 1+ / epλ}. This completes the proof of Lemma 5. Deote the variace of Y λ by λ = E λ Yλ, λ. By the relatio betwee E ad E λ, it is obvious that Eξ λ = i e λξi Eξ ie λξi Ee λξi Ee λξi, λ. The followig lemma gives some estimatios of λ. Lemma 6 Assume ξ i 1, ad that E ξ i +δ B δ Eξi i. The for all λ, for some costats B, δ,1] ad all e λ 1 B δ λ δ B e λ 1 λ eλ. 3 Moreover, if B 1, it holds λ 1 5B δ λ δ Proof. Sice Ee λξi 1,λ, ad ξ i 1, we get for all λ, λ Eξi Eξ eλξi i eλ = e λ. This gives the upper boud of λ. Net, we cosider the lower boud of λ. It is easy to see that for all λ, Eξ i e λξi = λ Eξ ie tξi dt λ e t Eξ idt = e λ 1 Eξ i, 3

11 Sharp large deviatios for sums 11 Usig Lemma 3 ad 3, we obtai for all λ, Eξi Eξ λ eλξi i e λξi e λ 1 Bδ λ δ e λ 1 Eξ i e λ e λ 1 B δ λ δ B e λ 1, which gives the first lower boud of λ. Notig that λ ad B 1, by a simple calculatio, we obtai 31. Forthe radomvariabley λ, λ,wehavethefollowigresultothe rateofcovergece to the stadard ormal law. Lemma 7 Assume that ξ i 1, ad that E ξ i +δ B δ Eξi for some costats B, δ,1] ad all i. The for all λ, sup P Y λ λ y R λ y Φy +δ Cδ e λ +δ λ E ξ i +δ. Proof. Notice that Y λ = η iλ is the sum of idepedet r.v.s η i λ ad E λ η i λ =. Usig the well-kow rate of covergece i the cetral limit theorem cf. e.g. [17], p. 115, we get for all λ, sup P λ y R Y λ λ y Φy Cδ +δ λ E λ η i +δ. 33 Usig the iequality a+b 1+q q a 1+q +b 1+q for a,b,q, we deduce that for all λ, E λ η i +δ 1+δ E λ ξ i +δ + E λ ξ i +δ +δ E λ ξ i +δ +δ E ξ i +δ e λξi +δ e λ E ξ i +δ. Therefore, we obtai for all λ, sup P Y λ λ λ y Φy +δ Cδ e λ +δ λ y R E ξ i +δ. This completes the proof of Lemma 7. We are ow ready to prove the mai techical result of this sectio. Theorem 5 Assume that ξ i 1, ad that E ξ i +δ B δ Eξi for some costats B ad δ,1] for all i. For a, if there eists a positive λ such that Ψ λ =, the PS = Θ λλ +θε if λ EeλS, 34 where ε = 3+δ Cδ e λ +δ λ E ξ i +δ.

12 1 Xiequa Fa Proof. Accordig to the defiitio of the cojugate probability measure cf. 4, we have the followig represetatio of PS : For give,λ, PS = E λ Z λ 1 1 S } = E λ e λs+ψλ 1 S } = E λ e λ+ψλ λyλ λbλ+λ 1 Yλ+B λ } = e λ+ψλ E λ e λ[yλ+bλ ] 1 Yλ+B λ }. Settig U λ = λy λ+b λ, we get PS = e λ+ψλ e t P λ < U λ tdt. 35 For a, if there eists a λ = λ such that Ψ λ =, the the epoetial fuctio e λ+ψλ i 35 attais its miimum at λ = λ. Sice B λ = Ψ λ =, we have U λ = λy λ ad Usig Lemma 7, we deduce that e λ+ψλ = if λ e λ+ψλ = if λ EeλS. 36 e t P λ < U λ tdt = = = e λyλ P λ < U λ λyλ λλdy e λyλ P < N,1 yλλdy +θε e λyλ dφy+θε = Θ λλ +θε, 37 where N,1 stads for the stadard ormal r.v. Therefore, from 35 ad 36, it follows that PS = Θ λλ +θε if λ EeλS. This completes the proof of Theorem 5. 6 Proof of Theorem 1 I the spirit of Talagrad [4], we would like to make use of Θ to approimate Θλλ i Theorem 5. The proof of Theorem 1 is a cotiuatio of the proof of Theorem 5. Proof of Theorem 1. Sice Θ 1 π, we deduce that 1 Θ λλ Θ 1 λλ π λ λ Usig Lemma 4, we have for all λ 1 B, 1 Bδ λ δ e λ λ B λ = e λ δ

13 Sharp large deviatios for sums 13 By the estimatio of λ i Lemma 6, it follows that for all λb 6 1/δ, ad [ e λλ λ 1 λ 1 5B δ λ δ e λ 1 Bδ λ δ e λ] λ 1+δ [ λ 1+ 1 λbeλb 1 4B δ λ δ 3 λb λ B e λb +λ δ B δ e λb] [ λ 4B δ λ δ + 1 e 1 6 λb 3 λb e 1 1 λb +λ δ B δ ] 4.6λB δ λ 4 λ λ λ 1 5B δ λ δ 1 5 λ 6 λ e λ 1 Bδ λ δ 1+δ e λ 1 6 λ. 41 Hece, iequality 38 implies that for all λ 1 6 1/δ B, Θ λλ Θ 7.6 B πλ 1 δ δ1λ 6} λ 1+δ B π δ1λ< 6} 7.6 π B δ. 4 Therefore, by Lemma 6 ad coditio 9, it is easy to see that for all λ 1 6 1/δ B, e λ +δ λ E ξ i +δ e 1/6 E ξ i +δ B δ. 5/6 1+δ/ +δ By 39 ad the iequality e 1 for all, it follows that ad 1 B δ λ δ λ λ 1 6 1/δ B for all B 3 6 1/δ. 44 Combiig 34, 4 ad 43 together, we have for all 3 6 1/δ B, PS = Θ+θ 7.6 B δ C δ if π λ EeλS, where C δ is the smallest costat such that 33 holds. By Theorem.1 of Che ad Shao [7], we have C δ 4.1. Thus 7.6 π C δ This completes the proof of Theorem 1.

14 14 Xiequa Fa Proof of Corollary 1. Usig 36 ad Lemma 5, we get for all, if λ EeλS = if λ Ee λ+ψλ if ep λ +log λ = H, / ep λ / } } + / 1+ / epλ} 45 Notice that if λ Ee λs Ee S = 1. Thus, the desired iequality follows from Theorem 1 ad 45. Proof of Corollary. Sice Θ is decreasig i, we deduce that Θ Θˇ where ˇ =. Notice that Hoeffdig s boud is less tha Berstei s boud, i.e H, ep ˇ } cf. Remark.1 of [1]. Therefore, from 1, we have for all PS Usig 6, we obtai for all C δ B, PS B δ Θˇ+C ep = 1 Φˇ+C ˇ } B δep ˇ }. 1 Φˇ [ B ] δ 1+C1+ ˇ. C δ B, This completes the proof of Corollary. 7 Proof of Theorem 3 Cosider the positive radom variable H λ = e ζiλ Eeζiλ, λ, so that EH λ = 1. Itroduce the followig ew cojugate probability measure P λ defied by dp λ = H λdp. 46 I this sectio, deote by E λ the epectatio with respect to P λ defied by 46. Accordig to 46, we have the followig represetatio: For all = o B, ] P ζ i λ = E λ [H λ 1 1 ζiλ } = E λ [ep ] η i λ B λ+ψ λ }1 ζiλ }

15 Sharp large deviatios for sums 15 where ad = E λ [ep = E λ [ep B λ = ] η i λ B λ+ψ λ }1 ζiλ } ] η i λ B λ+ψ λ }1 ηiλ Bλ},47 η i λ = ζ i λ E λ ζ i λ E λ ζ i λ = Eζ i λe ζiλ Ee ζiλ Let λ = λ be the smallest positive solutio of the followig equatio Recall From 47, we obtai P ζ i λ = ep = ep B λ =. Y λ = η i λ. } +Ψ λ E λ [e Yλ 1 ] Yλ } } +Ψ λ e y P λ Y λ ydy. 48 Set F y = P λ Y λ y. Recall Cδ 4.1 see Theorem.1 of Che ad Shao [7]. By a argumet similar to the proof of Lemma 7, we have for all = o B, B δ. sup F y Φy/λ C 1 y R Hece, for all = o B, e y P λ Y λ ydy e y P N,1 y/λdy B δ, 1 C where N,1 is the stadard ormal r.v. By a simple calculatio, it follows that e y P N,1 y/λdy = Θλ. From 48, we have for all = o B, P ζ i λ = ep +Ψ λ } B Θλ+θC δ. 49 Net, we would like to substitute for λ i the item Θλ. By a argumet similar to the proof of 4, we get for all = o B, B δ. Θλ Θ C 3 5

16 16 Xiequa Fa So we have for all = o B, } P ζ i λ = ep B δ +Ψ λ Θ+θC, 51 which gives the desired epasio of tail probabilities. I the sequel we shall give a estimatio for Ψ λ. To this ed, we eed the followig useful lemma cf. Lemma 6. of Jig, Shao ad Wag [15]. Lemma 8 Let X be a radom variable with EX = ad EX <. For λ >, let ζ = λx 1 λx. The for λ >, Ee ζ = 1+O1ε λ, 5 Eζe ζ = 1 λ EX +O1ε λ, 53 where ε λ = λ E[X 1 λx >1} ]+λ 3 E[ X 3 1 λx 1} ]. Notice that ε λ E λx +δ = λ +δ E X +δ. Sice E ξ i +δ B δ Eξi, by Lemmas ad 8, for ay λ = ob 1, Ψ λ = O1 λ +δ E ξ i +δ = O1λ +δ B δ 54 ad Eζ i λe ζiλ = 1 Ee ζiλ λ +O1λ +δ B δ. Recall that λ = λ > is the smallest positive solutio of the followig equatio Eζ i λe ζiλ Ee ζiλ =, we have for all = o B, Thus, from 54, it holds λ = O1. Ψ λ = O1 +δ B δ, which gives the estimatio of Ψ λ. This completes the proof of Theorem 3 Ackowledgemets We would like to thak the aoymous referee ad editor for their helpful commets ad suggestios. The work has bee partially supported by the Natioal Natural Sciece Foudatio of Chia Grat os ad

17 Sharp large deviatios for sums 17 Refereces 1. Bahadur R, Raga Rao R. O deviatios of the sample mea. A Math Statist, 196, 31: Beett G. Probability iequalities for sum of idepedet radom variables. J Amer Statist Assoc, 196, 57: Betkus V. O Hoeffdig s iequality. A Probab, 4, 3: Betkus V, Kalosha N, va Zuijle M. O domiatio of tail probabilities of supermartigales: eplicit bouds. Lithuaia Math J, 6, 46: Bercu B, Rouault A. Sharp large deviatios for the Orstei-Uhlebeck process. Theory Probab Appl, 6, 46: Borovkov A A, Mogulskii A A. O large ad superlarge deviatios of sums of idepedet radom vectors uder Cramer s coditio. Theory Probab Appl, 7, 51: Che L H Y, Shao Q M. A o-uiform BerryCEssee boud via Stei s method. Probab Theory Relat Fields, 1, 1: Cramér H. Sur u ouveau théorème-limite de la théorie des probabilités. Actualite s Sci Idust, 1938, 736: Efro B. Studet s t-test uder symmetry coditios. J Amer Statist Assoc, 1969, 6438: Fa X, Grama I, Liu Q. Hoeffdig s iequality for supermartigales. Stochastic Process Appl, 1, 1: Fa X, Grama I, Liu Q. Cramér large deviatio epasios for martigales uder Berstei s coditio. Stochastic Process Appl, 13, 13: Fa X, Grama I, Liu, Q. Sharp large deviatio results for sums of idepedet radom variables. Sci Chia Math, 15, 58: Grama I, Haeusler E. Large deviatios for martigales via Cramer s method. Stochastic Process Appl,, 85: Hoeffdig W. Probability iequalities for sums of bouded radom variables. J Amer Statist Assoc, 1963, 58: Jig B Y, Shao Q M, Wag Q. Self-ormalized Cramér-type large deviatios for idepedet radom variables. A Probab, 3, 31: Nagaev S V. Lower bouds for the probabilities of large deviatios of sums of idepedet radom variables. Theory Probab Appl,, 46: Petrov V V. Sums of Idepedet Radom Variables. Berli: Spriger-Verlag, Petrov V V. Limit Theorems of Probability Theory. Oford: Oford Uiversity Press, Petrov V V, Robiso J. Large deviatios for sums of idepedet o idetically distributed radom variables. Comm Statist Theory Methods, 8, 37: Pielis I. O the Beett-Hoeffdig iequality. A Ist H Poicaré Probab Statist, 14, 5: Saulis L, Statulevičius V A. Limit theorems for large deviatios. Netherlads: Spriger, Sakhaeko A I. Berry-Essee type bouds for large deviatio probabilities. Siberia Math J, 1991, 3: Shao Q M. A Cramér type large deviatio result for Studet s t-statistic. J Theoret Probab, 1999, 1: Talagrad M. The missig factor i Hoeffdig s iequalities. A Ist H Poicaré Probab Statist, 1995, 31: 689-7

Self-normalized deviation inequalities with application to t-statistic

Self-normalized deviation inequalities with application to t-statistic Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric

More information

Berry-Esseen bounds for self-normalized martingales

Berry-Esseen bounds for self-normalized martingales Berry-Essee bouds for self-ormalized martigales Xiequa Fa a, Qi-Ma Shao b a Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji 30007, Chia b Departmet of Statistics, The Chiese Uiversity of Hog Kog,

More information

Gamma Distribution and Gamma Approximation

Gamma Distribution and Gamma Approximation Gamma Distributio ad Gamma Approimatio Xiaomig Zeg a Fuhua (Frak Cheg b a Xiame Uiversity, Xiame 365, Chia mzeg@jigia.mu.edu.c b Uiversity of Ketucky, Leigto, Ketucky 456-46, USA cheg@cs.uky.edu Abstract

More information

Approximation theorems for localized szász Mirakjan operators

Approximation theorems for localized szász Mirakjan operators Joural of Approximatio Theory 152 (2008) 125 134 www.elsevier.com/locate/jat Approximatio theorems for localized szász Miraja operators Lise Xie a,,1, Tigfa Xie b a Departmet of Mathematics, Lishui Uiversity,

More information

Asymptotic distribution of products of sums of independent random variables

Asymptotic distribution of products of sums of independent random variables Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege

More information

An almost sure invariance principle for trimmed sums of random vectors

An almost sure invariance principle for trimmed sums of random vectors Proc. Idia Acad. Sci. Math. Sci. Vol. 20, No. 5, November 200, pp. 6 68. Idia Academy of Scieces A almost sure ivariace priciple for trimmed sums of radom vectors KE-ANG FU School of Statistics ad Mathematics,

More information

The log-behavior of n p(n) and n p(n)/n

The log-behavior of n p(n) and n p(n)/n Ramauja J. 44 017, 81-99 The log-behavior of p ad p/ William Y.C. Che 1 ad Ke Y. Zheg 1 Ceter for Applied Mathematics Tiaji Uiversity Tiaji 0007, P. R. Chia Ceter for Combiatorics, LPMC Nakai Uivercity

More information

h(x i,x j ). (1.1) 1 i<j n

h(x i,x j ). (1.1) 1 i<j n ESAIM: PS 15 2011 168 179 DOI: 10.1051/ps/2009014 ESAIM: Probability ad Statistics www.esaim-ps.org CRAMÉR TYPE MODERATE DEVIATIONS FOR STUDENTIZED U-STATISTICS,, Tze Leg Lai 1, Qi-Ma Shao 2 ad Qiyig Wag

More information

Self-normalized Cramér type Moderate Deviations for the Maximum of Sums

Self-normalized Cramér type Moderate Deviations for the Maximum of Sums Self-ormalized Cramér type Moderate Deviatios for the Maximum of Sums Weidog Liu 1, Qi-Ma Shao ad Qiyig Wag 3 Abstract Let X 1, X,... be idepedet radom variables with zero meas ad fiite variaces, ad let

More information

Weak Laws of Large Numbers for Sequences or Arrays of Correlated Random Variables

Weak Laws of Large Numbers for Sequences or Arrays of Correlated Random Variables Iteratioal Mathematical Forum, Vol., 5, o. 4, 65-73 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.988/imf.5.5 Weak Laws of Large Numers for Sequeces or Arrays of Correlated Radom Variales Yutig Lu School

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

Central limit theorem and almost sure central limit theorem for the product of some partial sums

Central limit theorem and almost sure central limit theorem for the product of some partial sums Proc. Idia Acad. Sci. Math. Sci. Vol. 8, No. 2, May 2008, pp. 289 294. Prited i Idia Cetral it theorem ad almost sure cetral it theorem for the product of some partial sums YU MIAO College of Mathematics

More information

Mi-Hwa Ko and Tae-Sung Kim

Mi-Hwa Ko and Tae-Sung Kim J. Korea Math. Soc. 42 2005), No. 5, pp. 949 957 ALMOST SURE CONVERGENCE FOR WEIGHTED SUMS OF NEGATIVELY ORTHANT DEPENDENT RANDOM VARIABLES Mi-Hwa Ko ad Tae-Sug Kim Abstract. For weighted sum of a sequece

More information

Regression with an Evaporating Logarithmic Trend

Regression with an Evaporating Logarithmic Trend Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,

More information

This section is optional.

This section is optional. 4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore

More information

COMPLETE CONVERGENCE AND COMPLETE MOMENT CONVERGENCE FOR ARRAYS OF ROWWISE END RANDOM VARIABLES

COMPLETE CONVERGENCE AND COMPLETE MOMENT CONVERGENCE FOR ARRAYS OF ROWWISE END RANDOM VARIABLES GLASNIK MATEMATIČKI Vol. 4969)2014), 449 468 COMPLETE CONVERGENCE AND COMPLETE MOMENT CONVERGENCE FOR ARRAYS OF ROWWISE END RANDOM VARIABLES Yogfeg Wu, Mauel Ordóñez Cabrera ad Adrei Volodi Toglig Uiversity

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Lecture 15: Learning Theory: Concentration Inequalities

Lecture 15: Learning Theory: Concentration Inequalities STAT 425: Itroductio to Noparametric Statistics Witer 208 Lecture 5: Learig Theory: Cocetratio Iequalities Istructor: Ye-Chi Che 5. Itroductio Recall that i the lecture o classificatio, we have see that

More information

<, if ε > 0 2nloglogn. =, if ε < 0.

<, if ε > 0 2nloglogn. =, if ε < 0. GLASNIK MATEMATIČKI Vol. 52(72)(207), 35 360 THE DAVIS-GUT LAW FOR INDEPENDENT AND IDENTICALLY DISTRIBUTED BANACH SPACE VALUED RANDOM ELEMENTS Pigya Che, Migyag Zhag ad Adrew Rosalsky Jia Uversity, P.

More information

MAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES

MAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES Commu Korea Math Soc 26 20, No, pp 5 6 DOI 0434/CKMS20265 MAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES Wag Xueju, Hu Shuhe, Li Xiaoqi, ad Yag Wezhi Abstract Let {X, } be a sequece

More information

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT Itroductio to Extreme Value Theory Laures de Haa, ISM Japa, 202 Itroductio to Extreme Value Theory Laures de Haa Erasmus Uiversity Rotterdam, NL Uiversity of Lisbo, PT Itroductio to Extreme Value Theory

More information

On the convergence rates of Gladyshev s Hurst index estimator

On the convergence rates of Gladyshev s Hurst index estimator Noliear Aalysis: Modellig ad Cotrol, 2010, Vol 15, No 4, 445 450 O the covergece rates of Gladyshev s Hurst idex estimator K Kubilius 1, D Melichov 2 1 Istitute of Mathematics ad Iformatics, Vilius Uiversity

More information

Research Article Moment Inequality for ϕ-mixing Sequences and Its Applications

Research Article Moment Inequality for ϕ-mixing Sequences and Its Applications Hidawi Publishig Corporatio Joural of Iequalities ad Applicatios Volume 2009, Article ID 379743, 2 pages doi:0.55/2009/379743 Research Article Momet Iequality for ϕ-mixig Sequeces ad Its Applicatios Wag

More information

32 estimating the cumulative distribution function

32 estimating the cumulative distribution function 32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio

More information

A note on self-normalized Dickey-Fuller test for unit root in autoregressive time series with GARCH errors

A note on self-normalized Dickey-Fuller test for unit root in autoregressive time series with GARCH errors Appl. Math. J. Chiese Uiv. 008, 3(): 97-0 A ote o self-ormalized Dickey-Fuller test for uit root i autoregressive time series with GARCH errors YANG Xiao-rog ZHANG Li-xi Abstract. I this article, the uit

More information

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality

More information

o f P r o b a b i l i t y Vol. 10 (2005), Paper no. 38, pages Journal URL ejpecp/

o f P r o b a b i l i t y Vol. 10 (2005), Paper no. 38, pages Journal URL   ejpecp/ E l e c t r o i c J o u r a l o f P r o b a b i l i t y Vol. 10 005, Paper o. 38, pages 160-185. Joural URL http://www.math.washigto.edu/ ejpecp/ Limit Theorems for Self-ormalized Large Deviatio 1 Qiyig

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

More information

EFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS

EFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS EFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS Ryszard Zieliński Ist Math Polish Acad Sc POBox 21, 00-956 Warszawa 10, Polad e-mail: rziel@impagovpl ABSTRACT Weak laws of large umbers (W LLN), strog

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

REGRESSION WITH QUADRATIC LOSS

REGRESSION WITH QUADRATIC LOSS REGRESSION WITH QUADRATIC LOSS MAXIM RAGINSKY Regressio with quadratic loss is aother basic problem studied i statistical learig theory. We have a radom couple Z = X, Y ), where, as before, X is a R d

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 3 9//203 Large deviatios Theory. Cramér s Theorem Cotet.. Cramér s Theorem. 2. Rate fuctio ad properties. 3. Chage of measure techique.

More information

Notes 19 : Martingale CLT

Notes 19 : Martingale CLT Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

Appendix to Quicksort Asymptotics

Appendix to Quicksort Asymptotics Appedix to Quicksort Asymptotics James Alle Fill Departmet of Mathematical Scieces The Johs Hopkis Uiversity jimfill@jhu.edu ad http://www.mts.jhu.edu/~fill/ ad Svate Jaso Departmet of Mathematics Uppsala

More information

Estimation for Complete Data

Estimation for Complete Data Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of

More information

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

2.2. Central limit theorem.

2.2. Central limit theorem. 36.. Cetral limit theorem. The most ideal case of the CLT is that the radom variables are iid with fiite variace. Although it is a special case of the more geeral Lideberg-Feller CLT, it is most stadard

More information

An alternative proof of a theorem of Aldous. concerning convergence in distribution for martingales.

An alternative proof of a theorem of Aldous. concerning convergence in distribution for martingales. A alterative proof of a theorem of Aldous cocerig covergece i distributio for martigales. Maurizio Pratelli Dipartimeto di Matematica, Uiversità di Pisa. Via Buoarroti 2. I-56127 Pisa, Italy e-mail: pratelli@dm.uipi.it

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece

More information

Lecture Chapter 6: Convergence of Random Sequences

Lecture Chapter 6: Convergence of Random Sequences ECE5: Aalysis of Radom Sigals Fall 6 Lecture Chapter 6: Covergece of Radom Sequeces Dr Salim El Rouayheb Scribe: Abhay Ashutosh Doel, Qibo Zhag, Peiwe Tia, Pegzhe Wag, Lu Liu Radom sequece Defiitio A ifiite

More information

arxiv: v1 [math.pr] 13 Oct 2011

arxiv: v1 [math.pr] 13 Oct 2011 A tail iequality for quadratic forms of subgaussia radom vectors Daiel Hsu, Sham M. Kakade,, ad Tog Zhag 3 arxiv:0.84v math.pr] 3 Oct 0 Microsoft Research New Eglad Departmet of Statistics, Wharto School,

More information

Solutions to HW Assignment 1

Solutions to HW Assignment 1 Solutios to HW: 1 Course: Theory of Probability II Page: 1 of 6 Uiversity of Texas at Austi Solutios to HW Assigmet 1 Problem 1.1. Let Ω, F, {F } 0, P) be a filtered probability space ad T a stoppig time.

More information

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f. Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,

More information

Notes 5 : More on the a.s. convergence of sums

Notes 5 : More on the a.s. convergence of sums Notes 5 : More o the a.s. covergece of sums Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: Dur0, Sectios.5; Wil9, Sectio 4.7, Shi96, Sectio IV.4, Dur0, Sectio.. Radom series. Three-series

More information

1 Convergence in Probability and the Weak Law of Large Numbers

1 Convergence in Probability and the Weak Law of Large Numbers 36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec

More information

Unbiased Estimation. February 7-12, 2008

Unbiased Estimation. February 7-12, 2008 Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom

More information

Lecture 01: the Central Limit Theorem. 1 Central Limit Theorem for i.i.d. random variables

Lecture 01: the Central Limit Theorem. 1 Central Limit Theorem for i.i.d. random variables CSCI-B609: A Theorist s Toolkit, Fall 06 Aug 3 Lecture 0: the Cetral Limit Theorem Lecturer: Yua Zhou Scribe: Yua Xie & Yua Zhou Cetral Limit Theorem for iid radom variables Let us say that we wat to aalyze

More information

Diagonal approximations by martingales

Diagonal approximations by martingales Alea 7, 257 276 200 Diagoal approximatios by martigales Jaa Klicarová ad Dalibor Volý Faculty of Ecoomics, Uiversity of South Bohemia, Studetsa 3, 370 05, Cese Budejovice, Czech Republic E-mail address:

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

On forward improvement iteration for stopping problems

On forward improvement iteration for stopping problems O forward improvemet iteratio for stoppig problems Mathematical Istitute, Uiversity of Kiel, Ludewig-Mey-Str. 4, D-24098 Kiel, Germay irle@math.ui-iel.de Albrecht Irle Abstract. We cosider the optimal

More information

ASYMPTOTIC CONSTANTS FOR MINIMAL DISTANCE IN THE CEN- TRAL LIMIT THEOREM

ASYMPTOTIC CONSTANTS FOR MINIMAL DISTANCE IN THE CEN- TRAL LIMIT THEOREM Elect. Comm. i Probab. 1 (211), 9 13 ELECTRONIC COMMUNICATIONS i PROBABILITY ASYMPTOTIC CONSTANTS FOR MINIMAL DISTANCE IN THE CEN- TRAL LIMIT THEOREM EMMANUEL RIO UMR 81 CNRS, Uiversité de Versailles Sait

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

Periodic solutions for a class of second-order Hamiltonian systems of prescribed energy

Periodic solutions for a class of second-order Hamiltonian systems of prescribed energy Electroic Joural of Qualitative Theory of Differetial Equatios 215, No. 77, 1 1; doi: 1.14232/ejqtde.215.1.77 http://www.math.u-szeged.hu/ejqtde/ Periodic solutios for a class of secod-order Hamiltoia

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013 Large Deviatios for i.i.d. Radom Variables Cotet. Cheroff boud usig expoetial momet geeratig fuctios. Properties of a momet

More information

Equivalent Conditions of Complete Convergence and Complete Moment Convergence for END Random Variables

Equivalent Conditions of Complete Convergence and Complete Moment Convergence for END Random Variables Chi. A. Math. Ser. B 391, 2018, 83 96 DOI: 10.1007/s11401-018-1053-9 Chiese Aals of Mathematics, Series B c The Editorial Office of CAM ad Spriger-Verlag Berli Heidelberg 2018 Equivalet Coditios of Complete

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Application to Random Graphs

Application to Random Graphs A Applicatio to Radom Graphs Brachig processes have a umber of iterestig ad importat applicatios. We shall cosider oe of the most famous of them, the Erdős-Réyi radom graph theory. 1 Defiitio A.1. Let

More information

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1

1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1 8. The cetral limit theorems 8.1. The cetral limit theorem for i.i.d. sequeces. ecall that C ( is N -separatig. Theorem 8.1. Let X 1, X,... be i.i.d. radom variables with EX 1 = ad EX 1 = σ (,. Suppose

More information

A Note on the Kolmogorov-Feller Weak Law of Large Numbers

A Note on the Kolmogorov-Feller Weak Law of Large Numbers Joural of Mathematical Research with Applicatios Mar., 015, Vol. 35, No., pp. 3 8 DOI:10.3770/j.iss:095-651.015.0.013 Http://jmre.dlut.edu.c A Note o the Kolmogorov-Feller Weak Law of Large Numbers Yachu

More information

Regression with quadratic loss

Regression with quadratic loss Regressio with quadratic loss Maxim Ragisky October 13, 2015 Regressio with quadratic loss is aother basic problem studied i statistical learig theory. We have a radom couple Z = X,Y, where, as before,

More information

Generalization of Samuelson s inequality and location of eigenvalues

Generalization of Samuelson s inequality and location of eigenvalues Proc. Idia Acad. Sci. Math. Sci.) Vol. 5, No., February 05, pp. 03. c Idia Academy of Scieces Geeralizatio of Samuelso s iequality ad locatio of eigevalues R SHARMA ad R SAINI Departmet of Mathematics,

More information

A survey on penalized empirical risk minimization Sara A. van de Geer

A survey on penalized empirical risk minimization Sara A. van de Geer A survey o pealized empirical risk miimizatio Sara A. va de Geer We address the questio how to choose the pealty i empirical risk miimizatio. Roughly speakig, this pealty should be a good boud for the

More information

A central limit theorem for moving average process with negatively associated innovation

A central limit theorem for moving average process with negatively associated innovation Iteratioal Mathematical Forum, 1, 2006, o. 10, 495-502 A cetral limit theorem for movig average process with egatively associated iovatio MI-HWA KO Statistical Research Ceter for Complex Systems Seoul

More information

Hyun-Chull Kim and Tae-Sung Kim

Hyun-Chull Kim and Tae-Sung Kim Commu. Korea Math. Soc. 20 2005), No. 3, pp. 531 538 A CENTRAL LIMIT THEOREM FOR GENERAL WEIGHTED SUM OF LNQD RANDOM VARIABLES AND ITS APPLICATION Hyu-Chull Kim ad Tae-Sug Kim Abstract. I this paper we

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y

More information

Distribution of Random Samples & Limit theorems

Distribution of Random Samples & Limit theorems STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to

More information

Some Tauberian theorems for weighted means of bounded double sequences

Some Tauberian theorems for weighted means of bounded double sequences A. Ştiiţ. Uiv. Al. I. Cuza Iaşi. Mat. N.S. Tomul LXIII, 207, f. Some Tauberia theorems for weighted meas of bouded double sequeces Cemal Bele Received: 22.XII.202 / Revised: 24.VII.203/ Accepted: 3.VII.203

More information

Topic 5 [434 marks] (i) Find the range of values of n for which. (ii) Write down the value of x dx in terms of n, when it does exist.

Topic 5 [434 marks] (i) Find the range of values of n for which. (ii) Write down the value of x dx in terms of n, when it does exist. Topic 5 [44 marks] 1a (i) Fid the rage of values of for which eists 1 Write dow the value of i terms of 1, whe it does eist Fid the solutio to the differetial equatio 1b give that y = 1 whe = π (cos si

More information

Chapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities

Chapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities Chapter 5 Iequalities 5.1 The Markov ad Chebyshev iequalities As you have probably see o today s frot page: every perso i the upper teth percetile ears at least 1 times more tha the average salary. I other

More information

ECE 330:541, Stochastic Signals and Systems Lecture Notes on Limit Theorems from Probability Fall 2002

ECE 330:541, Stochastic Signals and Systems Lecture Notes on Limit Theorems from Probability Fall 2002 ECE 330:541, Stochastic Sigals ad Systems Lecture Notes o Limit Theorems from robability Fall 00 I practice, there are two ways we ca costruct a ew sequece of radom variables from a old sequece of radom

More information

Erratum to: An empirical central limit theorem for intermittent maps

Erratum to: An empirical central limit theorem for intermittent maps Probab. Theory Relat. Fields (2013) 155:487 491 DOI 10.1007/s00440-011-0393-0 ERRATUM Erratum to: A empirical cetral limit theorem for itermittet maps J. Dedecker Published olie: 25 October 2011 Spriger-Verlag

More information

NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE

NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE UPB Sci Bull, Series A, Vol 79, Iss, 207 ISSN 22-7027 NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE Gabriel Bercu We itroduce two ew sequeces of Euler-Mascheroi type which have fast covergece

More information

Limit distributions for products of sums

Limit distributions for products of sums Statistics & Probability Letters 62 (23) 93 Limit distributios for products of sums Yogcheg Qi Departmet of Mathematics ad Statistics, Uiversity of Miesota-Duluth, Campus Ceter 4, 7 Uiversity Drive, Duluth,

More information

MOMENT-METHOD ESTIMATION BASED ON CENSORED SAMPLE

MOMENT-METHOD ESTIMATION BASED ON CENSORED SAMPLE Vol. 8 o. Joural of Systems Sciece ad Complexity Apr., 5 MOMET-METHOD ESTIMATIO BASED O CESORED SAMPLE I Zhogxi Departmet of Mathematics, East Chia Uiversity of Sciece ad Techology, Shaghai 37, Chia. Email:

More information

arxiv: v1 [math.pr] 4 Dec 2013

arxiv: v1 [math.pr] 4 Dec 2013 Squared-Norm Empirical Process i Baach Space arxiv:32005v [mathpr] 4 Dec 203 Vicet Q Vu Departmet of Statistics The Ohio State Uiversity Columbus, OH vqv@statosuedu Abstract Jig Lei Departmet of Statistics

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

The Wasserstein distances

The Wasserstein distances The Wasserstei distaces March 20, 2011 This documet presets the proof of the mai results we proved o Wasserstei distaces themselves (ad ot o curves i the Wasserstei space). I particular, triagle iequality

More information

Statistical Analysis on Uncertainty for Autocorrelated Measurements and its Applications to Key Comparisons

Statistical Analysis on Uncertainty for Autocorrelated Measurements and its Applications to Key Comparisons Statistical Aalysis o Ucertaity for Autocorrelated Measuremets ad its Applicatios to Key Comparisos Nie Fa Zhag Natioal Istitute of Stadards ad Techology Gaithersburg, MD 0899, USA Outlies. Itroductio.

More information

A Weak Law of Large Numbers Under Weak Mixing

A Weak Law of Large Numbers Under Weak Mixing A Weak Law of Large Numbers Uder Weak Mixig Bruce E. Hase Uiversity of Wiscosi Jauary 209 Abstract This paper presets a ew weak law of large umbers (WLLN) for heterogeous depedet processes ad arrays. The

More information

LECTURE 8: ASYMPTOTICS I

LECTURE 8: ASYMPTOTICS I LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece

More information

A Note on Matrix Rigidity

A Note on Matrix Rigidity A Note o Matrix Rigidity Joel Friedma Departmet of Computer Sciece Priceto Uiversity Priceto, NJ 08544 Jue 25, 1990 Revised October 25, 1991 Abstract I this paper we give a explicit costructio of matrices

More information

ON POINTWISE BINOMIAL APPROXIMATION

ON POINTWISE BINOMIAL APPROXIMATION Iteratioal Joural of Pure ad Applied Mathematics Volume 71 No. 1 2011, 57-66 ON POINTWISE BINOMIAL APPROXIMATION BY w-functions K. Teerapabolar 1, P. Wogkasem 2 Departmet of Mathematics Faculty of Sciece

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

Chapter 2 Transformations and Expectations

Chapter 2 Transformations and Expectations Chapter Trasformatios a Epectatios Chapter Distributios of Fuctios of a Raom Variable Problem: Let be a raom variable with cf F ( ) If we efie ay fuctio of, say g( ) g( ) is also a raom variable whose

More information

SDS 321: Introduction to Probability and Statistics

SDS 321: Introduction to Probability and Statistics SDS 321: Itroductio to Probability ad Statistics Lecture 23: Cotiuous radom variables- Iequalities, CLT Puramrita Sarkar Departmet of Statistics ad Data Sciece The Uiversity of Texas at Austi www.cs.cmu.edu/

More information

Law of the sum of Bernoulli random variables

Law of the sum of Bernoulli random variables Law of the sum of Beroulli radom variables Nicolas Chevallier Uiversité de Haute Alsace, 4, rue des frères Lumière 68093 Mulhouse icolas.chevallier@uha.fr December 006 Abstract Let be the set of all possible

More information

The central limit theorem for Student s distribution. Problem Karim M. Abadir and Jan R. Magnus. Econometric Theory, 19, 1195 (2003)

The central limit theorem for Student s distribution. Problem Karim M. Abadir and Jan R. Magnus. Econometric Theory, 19, 1195 (2003) The cetral limit theorem for Studet s distributio Problem 03.6.1 Karim M. Abadir ad Ja R. Magus Ecoometric Theory, 19, 1195 (003) Z Ecoometric Theory, 19, 003, 1195 1198+ Prited i the Uited States of America+

More information

Entropy Rates and Asymptotic Equipartition

Entropy Rates and Asymptotic Equipartition Chapter 29 Etropy Rates ad Asymptotic Equipartitio Sectio 29. itroduces the etropy rate the asymptotic etropy per time-step of a stochastic process ad shows that it is well-defied; ad similarly for iformatio,

More information

Empirical Process Theory and Oracle Inequalities

Empirical Process Theory and Oracle Inequalities Stat 928: Statistical Learig Theory Lecture: 10 Empirical Process Theory ad Oracle Iequalities Istructor: Sham Kakade 1 Risk vs Risk See Lecture 0 for a discussio o termiology. 2 The Uio Boud / Boferoi

More information

Sequences and Series of Functions

Sequences and Series of Functions Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges

More information

Detailed proofs of Propositions 3.1 and 3.2

Detailed proofs of Propositions 3.1 and 3.2 Detailed proofs of Propositios 3. ad 3. Proof of Propositio 3. NB: itegratio sets are geerally omitted for itegrals defied over a uit hypercube [0, s with ay s d. We first give four lemmas. The proof of

More information

Statistical Theory MT 2008 Problems 1: Solution sketches

Statistical Theory MT 2008 Problems 1: Solution sketches Statistical Theory MT 008 Problems : Solutio sketches. Which of the followig desities are withi a expoetial family? Explai your reasoig. a) Let 0 < θ < ad put fx, θ) = θ)θ x ; x = 0,,,... b) c) where α

More information

Miskolc Mathematical Notes HU e-issn Uniform approximation by means of some piecewise linear functions. Zoltán Finta

Miskolc Mathematical Notes HU e-issn Uniform approximation by means of some piecewise linear functions. Zoltán Finta Miskolc Mathematical Notes HU e-issn 787-43 Vol. 3 (00, No, pp. 0- DOI: 0.854/MMN.00.56 Uiform approimatio by meas of some piecewise liear fuctios Zoltá Fita Mathematical Notes, Miskolc, Vol. 3., No..,

More information

Kernel density estimator

Kernel density estimator Jauary, 07 NONPARAMETRIC ERNEL DENSITY ESTIMATION I this lecture, we discuss kerel estimatio of probability desity fuctios PDF Noparametric desity estimatio is oe of the cetral problems i statistics I

More information

A Note on Sums of Independent Random Variables

A Note on Sums of Independent Random Variables Cotemorary Mathematics Volume 00 XXXX A Note o Sums of Ideedet Radom Variables Pawe l Hitczeko ad Stehe Motgomery-Smith Abstract I this ote a two sided boud o the tail robability of sums of ideedet ad

More information